He doesn't take pictures of an aging wife, doesnt play chess, cant further Beth's career in any way, gives to real charities, is a legend, has taste, not an ass kisser, and he lives in NYC probably about 2 miles away from him so Howard really isn't able to get to him to hang out. You know how much Howard hates to travel unless it's to the Hamptons to do all those things listed above with empty souls who befriended you because you attend white suit parties for seal and seagull charity events.
And this conversation with cooper was one of the most uncomfortable things I have heard. You know Cooper just wanted to ask "Are you fucking kidding me? You don't understand what hanging out with someone is?"