The robots.txt analysis is an Italian by the Italian non-profit web site optimization and search engine Motoricerca's,
Note, however, use this tool, robots.txt should be clear in the character notes, it does not recognize Chinese characters; If character is not considered a valid robots.txt file.
If the Robots file verification passed, usually show the following results:
Analyzing file http://www.XXX.com/robots.txt No errors found in this robots.txt file Hide empty and comments lines: The following block of code DISALLOWS the crawling of the following files and directories: /inc/ to all spiders/robots. Line 1 # robots.txt for www.XXX.com Line 2 User-agent: * Line 3 Disallow: /inc/
In addition, Google Webmaster Tools verification robots can file online, Google is supporting the Chinese comments.
Log in to Google webmaster tools, in the "Control Panel", click the required web site, click on Tools, then click on the line of robots.txt.