I love spending time alone too, it's the only time I feel completely free and fully myself. As soon as there is another person nearby, I tense up to some degree. Other humans are inherently dangerous and chaotic.
I had a bad childhood, so it's probably a result of that - once you know what parents who supposedly 'love' you are capable of, it sours you to the rest of humanity who have no obligation to love you at all. If my 'loving' dad can kick the shit out of his children, or my 'loving' mum can shut us down emotionally for many years, what is everyone else capable of?
Since I was a teenager (26 years ago!) I've dreamed about everyone in the world disappearing suddenly. It would be heaven, but obviously beyond the realms of possibility unfortunately.