Hundreds gathered in Portsmouth after some refugees arrived by boat from France, a day after masked protesters disrupted traffic at the port of Dover.