Actor appeared on the conservative podcast, where he said he refrains from sharing his ‘real strong opinions’ so as not to ‘alienate half my audience’