An environmental officer came to the house and told Duffy he either had to ‘move or close his window’