The event is currently scheduled for May 3, but growing concern over Galliano's past remarks has overseers considering a change.