The heavyweight champion has been accused of 'ducking' Aspinall by the UFC fans despite claiming he would fight at least one more time