"There are cases that have resulted in the loss of old friendships," Alito said. "That's something you have to live with."