.Google.com's Gary Illyes uncovers Googlebot picks up web links rather than "complying with" all of them, negating official paperwork.Googlebot gathers web links rather than observing all of them in real-time.Gary Illyes shared this info in Google.com's 'Search Off The File' podcast.Google.com's documentation opposes the true crawler actions.