Musk said that the protesters had "no popular support" after a group targeted his new diner in California.