The reality star doubled down that he is not "a fan" of Leavitt after their blowout fight in the Season 4 finale.