My cat Runs and hisses at me but not my wife or other cats...?

We have had this cat since he was a kitten. Like, litterally a few weeks old, so i know it wasn't anything that was done to him. He lets everyone in the house (my wife and daughter and 2 other cats) near him except for me. Anytime i'm in the house he runs and hides. And when i find him he hisses harshly and runs off to another hidin... is there any ways to tame a cat to show him i'm not going to hurt him? He literally thinks i'm going to strangle him or something... ideas???