PM said he ‘wanted to go even further’ but that it would not be possible without the prison system collapsing