Its good you don't hide your scars. They are part of you and part of your experience. Whoever you end up with will accept them as part of you. Some might even find it endearing. (Though this doesn't mean you should create MORE.....self-harm is better to avoid if you can help it).
It sounds like you and he should have some space for awhile. He probably really is going to his brother's. Maybe he needs to lick his wounds and talk and have some male bonding. You don't have to see it as being blown off. If he was truly blowing you off he might not have responded at all. If I were in your shoes I would give him all the space he wants and let him have time to think and decide.
You also need space to think and decide. Do you really want THIS guy or is it just because he happens to be there? How does he make you feel? Does he take the time to understand you and listen and show empathy toward you? If not, then he doesn't deserve you. Its a reflection on HIM, not you. You are worthy of someone to love you and care about you no matter what, and you should hold out for that.
Maybe you can distract yourself with something else this weekend. I'm also home alone this weekend. I'm just listening to music and posting on this forum. I'm lonely but it won't kill me. If you feel bad please post on here some more and let us know what you are going through.

Hugs