I don't think you're weird lol.
I'm surprised Matt hasn't kicked me out of the room yet for a similar reason. He is hyper-sensitive to my breathing (not because I'm loud but because we're mega-cuddly so we can feel each other's breathing). For some reason, I have times where, when I'm asleep, my breathing gets rapid then I just stop breathing.
This always wakes him up. Luckily, he wakes me up or pats my back to get me breathing again. Sometimes he does complain lol, though not often. But I'm sure he'll be kicking me to the couch soon