Our community weighed fairness to fans against the safety of women, with some pointing to drinking at rugby and cricket and others to football’s long history of hooliganism