One in three of those who expected the Labour leader to do well as prime minister say they have been disappointed