I probably wouldn't be that lonely 'cause if I'm rich then I'd have my own library and that would give me great pleasure. Plus, if you are rich then you're not going to be THAT lonely. Everyone you've known over the course of your life, regardless of how long it's been since you've last talked to them or seen them, will want to be your best friend so it would be kind of hard to be lonely with so many people trying to get in touch with you.
The problem with answering this is you’re asking something in absolute terms, but the answer is relative. How poor? Not able to eat poor? Not able to care for loved ones due to poverty?
It’s easy to say love before money, but one has to have some amount of money just to get by and to be able to support a relationship.