Repeated Anxious Freak-Outs & Doubts with "My Soulmate"

I'm 23 & my boyfriend is 26. He doesn't have a job, lives on his family's property, doesn't even WANT a job, etc. I find this unattractive & frustrating. I considered him my soulmate after meeting him - feeling that spark that people talk about. I've never felt anything like it, and the first 2-3 months were pure bliss. Then I told him "I love you", and it was like a switch was flipped. I got anxious, moody, uncertain, withdrawn, etc. I question my sexuality sometimes, but I feel this isn't a main reason. I've talked to him about this A LOT and he is super understanding & whatnot. But it's been like 3 months of me feeling weird now & he says he feels fine. Should I just break up with him? I don't want to lose someone who might be my soulmate but I also feel like if he was my soulmate, I would know for sure.

Has anyone experienced stuff like this?

Welcome to the forum.
I have a question about your past relationships. A 'soulmate' has to be an extremely close relationship.
Have you had close relationships in the past and what makes this one so different? Something about him has overwhelmed you despite his drawbacks. Think of your future, together or not.
Proceed with caution. Best of luck to you in sorting this puzzle out.