One member of the "Gilligan's Island" cast turned down the role three times before taking it -- and it ended up affecting their career in ways good and bad.