The Defence Secretary made the remarks in a conversation with Home Secretary Shabana Mahmood and the new Justice Secretary Alex Norris