Robots.txt Generator User-agent (Crawl directive for specific bots) Allow or Disallow Allow Disallow Path (URL Path to Allow/Disallow) Generate robots.txt Generated robots.txt Preview Download robots.txt