Walking down Badrian’s Garden, which is seeped in history, is something of an adventure today, putting life and limbs at risk