Experts say issue not about ‘flag waving or nostalgia’ but the public losing ‘sense of shared ownership over what makes Britain great’