This is really cool, they talk through many of the major infra google is built on. The speaker is great.
How to use the robots exclusion protocol to manage how search engines crawl and index your website.
Quoted: search friendly design patterns for web development
Send Not Nathan a friend request or a personal message instead.