The Strictly Come Dancing judge turned his back on a potentially massive pay-cheque to ensure he coudl spend quality time with his children