The artists announced they were pulling out of the tour hours after Ed Sheeran broke his silence on the controversy