"I've found that it's not over until the audience is over it, not when I'm over it," Colbert said. "Do you have a sense that the audience is over it?"
Hart replied, "Well, here's the difference. You can continue to live to please others, or you can have a position where you know that you've literally done what you can to try to please. At that moment, when you know that you've given your all to try to please and it's still not received, you have to make a decision to go, 'I'm done trying to please.' That's where I'm at."
As ET previously reported, Hart stepped down from playing master of ceremonies last month after several controversial, homophobic tweets resurfaced from over a decade ago. The Academy Awards, airing Sunday, Feb. 24 on ABC, have yet to find a replacement host, but there's always the possibility of not having one at all. Variety reports that the biggest night in movies plans to go hostless, and will instead have a handful of celebrities introduce various segments.