He gets pressed almost right next to it. Then spazzes if I move my hair behind my ear or move my hand near him at all. I wear nail polish is it that? He also hates when I go to get him out of the cage but once he's on my shoulder he gets puffy, warm feet, & sometimes will even sing so I don't think he hates me. I sure hope not!
Hands mean predators. Bring the hand up from behind, both when you move your hair or when you pick him up. He should step up onto it when you nudge behind his legs.
Some birds are simply afraid of hands. It is a problem that can only be solved with time and patience. Refrain from sudden movements with your hands. Don't react when he freaks out. After you move your hand leave it there. He'll eventually come close to investigate. He'll learn, but it'll take a lot of work on your part . If you don't put in the effort he'll always be afraid of your hands. Teach him that hands are not something to be afraid of by the suggestions I have given above.