More than 1,500 pages of documents have already been released but some had been held back to avoid prejudicing a Metropolitan Police investigation into allegations of misconduct in public office