Patel has been lambasted from both the right and the left since being named by Trump to head the Federal Bureau of Investigation.