It comes after he seemingly ignored his family's public messages as he celebrated his 27th birthday with his wife