The party will struggle to do internally controversial things because many of its MPs think they will last one term