Emotional Guilting

My boyfriend and I were discussing apartments and since I will be alone while he is working we want something safe. He showed me one possible place asking what I think of it. I said it was okay, because that is what I think of it. I was concerned about the door being half glass, like with a large window. I realize the area is low crime, so it's overall safe. I could tell he was annoyed with me because he didn't think my concerns were valid. What bothers me is he often dredges up my past mistakes to invalidate my present concern or thoughts about things. Saying that my thinking is backwards. While, I don't disagree that I am an anxious person and tend to immediately think worst case scenarios, it still bothered me that rather than telling me that I was being overbearing and unnecessarily negative/paranoid, he chose to point out that I previously behaved a certain way and therefore my thinking now makes no sense/disturbs him. I personally disagree with that argument since we already established that the former behaviour being presented is just that - a past mistake not being repeated. Moreover, he knows I feel shame over it and still brings it up in a manner of laying it all out there. Saying that I can't possibly hold the concerns I presently have because previous behaviour negates it, or invalidates it. It seems like guilting me but I don't understand to what purpose other than for me to agree with him on choosing that apartment. I don't think it makes sense to use a former behaviour that no longer applies because it's stopped, to a present situation or discussion. He said he did not want to belittle me but that his recoiling reactions feels natural. I do understand that complaining isn't attractive and it's something I work on. I think he was being defensive because I didn't like the apartment he shared. I still don't think it's right to use my shameful mistakes to make a point, or to throw my shameful mistakes in my face, or to hold them over me. That's what it seemed like he was doing. Any thoughts?