The citizens marked ‘permanently shifted’ must have moved somewhere increasing the number there. But the number of voters is on the decline in all States and constituencies, he observed