For more than 50 years, a group of timekeepers has been quietly sneaking extra seconds onto the world's clocks.