The saffron party is concerned over its image following stampede in Puri and spate of gang-rape incidents