Navy Secretary John Phelan is leaving his role effective immediately, chief Pentagon spokesman Sean Parnell said Wednesday.