"make fun of someone" is always negative. ", that means that you either resent his making fun of you or perhaps you're unsure whether he's making fun of you and want to make sure he isn't. The verb tease would possibly be better here because you can use it in a positive (and negative) sense.
New words, one handy idiom, and a 2-minute quiz — delivered to your inbox to keep your streak alive.