Fighters are being "hurt, exploited or forgotten" in a failing system, says former boxer Paul Smith, who has criticised a lack of support for athletes.