Hello.
Same thing basically happened to me. My father was the neglectful, absent and abusive figure and my mother was scared of him so she kind of sided with him out of fear. From school to my home, I was rejected. Punished at home too because my father didn't want to bother raising his kids so he came up with all sorts of excuses to keep us away from him, including hanging out in rooms and items that we weren't allowed to touch due to being "grounded" (TV, computer, etc). All of this lead to a lot of crap, of course.
Self-compassion might be the first step towards self-esteem, or perhaps it is the same. It can be difficult to acquire when you have a hard time sorting out between your self-hatred, self doubt and all sorts of other things. It makes you wish that you had others to tell you that the things that happened to you are unfair and that you are right to feel and be the way you are...but it's still difficult. No one can really be in your shoes and unless you can untangle the mess yourself, you end up wanting to be reassured by others because you have no confidence in your opinion that what happened was cruel and undeserved and that you should treat yourself with kindness as a result.
There are some people that seem to have a hard time showing and dealing with emotions. My mother's an example of that. Not much in terms of physical comfort or reassurance. There might be several reasons to that, like Penny said. I think a lot of people don't really know how to deal with hypersensitive people though. They might not understand why you are feeling bad and how to deal with the intense emotions, or they might not even be aware of all of this or the fact that some of the emotional flare ups are due to psychological damage.
There's always an explanation as to why certain people can't properly find solutions to this kind of issue. Unfortunately, we are all human and sometimes, some people lose perspective and also get lost in their own emotions. There's a lot of psychological damage suffered from a lot of people, from us here to people with depression, anxiety, other PD's, etc. and they are sometimes caused by a combination of abuse and what we're talking about. The problem is that it is very hard separate all of those elements from the self-hatred, doubt and toxic inner dialogue.
The ideal would be to realize that there are a lot of things that can cause some people that were supposed to care for us to not be up to the task. That's one thing, but there are a lot more obstacles, including anger, and a feeling of injustice.
Self-compassion is probably a way to try and go through all of those feelings as well as realizing that we shouldn't be blaming ourselves, even if it's against our innermost, dysfunctional beliefs, that we were at fault.
Easier written than done.