The Clarkson's Farm star certainly didn't hold back as he shut down claims that Keir Starmer's unpopularity in Number 10 is due to "bad PR"