The beginning of Rhodes' break with Trump came when the president gave out hundreds of Jan. 6 pardons