McCullum spent four years in charge of the Test team and his exit follows the retirement of former captain Ben Stokes