Everyone is so judgmental of everyone else, always sizing each other up, tearing each other down (quietly, and with faux-tact), being cruel with a grimace, that it’s hard not to hate everyone.
Sebastian does come out a bit unscathed, however. He’s such a hopeless case, such a lost drunk child, that he never bothered being cruel to anyone. He’s the only decent one of the bunch. Maybe that’s why Charles loves him?