A former Premier League star has recalled the reaction from his club manager after being sent home for sneaking out on England duty