@pacificmeister: Yes, because the higher pressure comes from the water side. But I think it only get relevant if you have a higher pressure difference like in a combustion motor.
The more important fact is too keep the shaft spinning completely centric. I struggle with the same problem although I have a second bearing. The non centric rotation t is coming from the bad quality of the coupler.