One former Big Brother housemate has claimed he was fired from his job as a school caretaker after complaints were made following his conduct on the ITV show