The podcaster was seen as key to driving young male voters toward Trump in 2024, and Rogan's remarks come days before the midterm.