Google has posted a new help document named Things to know about Google's web crawling. This document currently lists 9 things on how Google's web crawling works.