Mamma Mia! actor Pierce Brosnan had a surprisingly tough childhood where he only got to see his mother twice a year - all the details