Everything you describe indicates that things should be working properly. So what else aren't you telling us?
The symptom hints that the +5 pin on the joystick port is being overloaded. Has another part been connected to pin 1, and is that other part doing something silly like shorting it to ground?