According to sources, the convoy size was reduced in Gujarat and Assam immediately after his speech in Hyderabad