We don't know if he's a narcissist or not, but it doesn't really matter for purposes of this discussion. I'll share my perspective from my own narcissistic lens....
My mother says the same things about me as you say about him....because it's true. I'm a no-show for a lot of important family events. I cannot be relied on to be there when people need me. I'm actually kind of an a**hole to my family. On the flip side, I'm totally independent and have a lucrative career, so have not needed anything from them, either.
If my mother criticizes me, or puts pressure on me to do something I don't want to do, I end the conversation abruptly. I'll then go weeks without speaking to her because she's crossed a line.
My point is, if you want a relationship with him, then you'll have to accept him for who he is. He is unable or unwilling to change -- and only he knows the reasons for that. He doesn't want your judgment of him.