Dozens of activists, most of them conservatives, reached out recently to Trump in a letter initiated by Humans First