And at the same token looks don’t matter if you really love a person. I have yet to find many people who say these things who would really consider going out with an "ugly" person or someone thought to be less attractive.

They’re just saying the person is nice but they are ugly. They’d be friends but wouldn’t date them.