.Google.com restricts robots.txt assistance to four areas, clarifying its position on in need of support regulations.Google.com just supports 4 certain robots.txt areas.Unsupported directives in robots.txt will certainly be ignored.Take into consideration bookkeeping your robots.txt files due to this update.