It boasts a fairytale castle with beautiful gardens, and a pub often hailed the best in the entire UK