User-Agent:*

Disallow: /mecab/
Disallow: /geocode/
Disallow: /crawl/
Disallow: /test/