Why do they say he fancies me?

Maybe he acts that way around you because he is nervous or something. He might tell the others that he likes you, or they can tell a difference in behavior when he is around you.