I think you might like the history podcast You'r Dead to Me. One of the panelist in each episode is always a comedian, but the focus is always more on the history and the historical people they talk about are mostly women/POC. I recommend listening to their Mary Shelley episode to see if you like it.

For more serious history/science/culture podcast, I recommend In Our Time. It's a bit too dry for me to listen to every episode, but I've enjoyed those ones that focus on something I'm interested in.