His comments came as shareholders rejected a call for the firm to consider ending its diversity practices.