I did replaced both o-rings (easy and cheap), but the noise is
still there. Only noticeable when engine is cold (esp in the morning), and when I rev the engine
There is no noise when I turn the steering wheel side to side.

I have a feeling that it could be the drive belt.