The former Coronation Street star said watching his brother Adam during the chaotic live final was the 'toughest thing' he's had to go through