Royal preferred to go to ‘sophisticated countries’ as UK trade envoy – and refused to attend ‘golf functions’