Fire fighters raced to the scene at the 18th century building with an 'avoid the area' warning put in place