Although most of about 80,000 people who swarmed into the tiny North African territory have gone back, it is estimated that 3,000 to 5,000 remain.