ARE YOU "SQUARING THE BALL" ON EVERY SWING OR STROKE?
If not, your eye-hand coodination is off, it just isn't accurate. Note that I didn't say hand-eye but I said eye-hand because the eyes direct the hands and not vice versa.
The most common reason for your eye-hand to be off is not tracking the ball visually and mentally to contact with your central vision as opposed to your peripheral vision. Peripheral vision is inaccurate, and central vision will help you square the ball.
You must practice, practice, practice using your central vision to see the ball deep under game conditions.