One player who represented both sides of north London still maintains hate for one of his former clubs