It comes as Victoria was among other family members reportedly left "disgusted" after Brooklyn snubbed his dad on Father's Day and his knighthood achievement