Visitors who go to this Buckinghamshire village can walk the same streets as royals and sports stars gone by