People from some parts of the UK were particularly likely to say they could not shake off their financial worries completely while on holiday.