David Letterman, the former late-night host, said television networks should be more employing women. In fact, he was surprised that CBS didn’t hire a female successor at “The Late Show.”

“I don’t know why they didn’t give my show to a woman,”he said. Letterman made the remarks during an upcoming interview with NBC News’ Tom Brokaw.

The former CBS host was asked if he missed hosting the “Late Show,” which he “thought for sure” he would; but the first day Stephen Colbert took over, the show brought a different “energy.”

“When he went on the air, an energy left me and I felt like, ‘You know, that’s not my problem anymore,”‘ he said. “I devoted so much time, to the damage of other aspects of my life. The concentrated, fixated, focusing on that…it’s good now to not have that.”

While Letterman said he “couldn’t care less about late-night television,” there were some changes he would have liked to see.

“I’m happy for the guys—men and women—there should be more women. And I don’t know why they didn’t give my show to a woman,” Letterman continued. “That would have been fine. You know, I’m happy for their success. And they’re doing things I couldn’t do. So that’s great.”

The entire interview will air Sunday night at 7 p.m. and is part of the upcoming limited series “On Assignment” from NBC.