FreeGenerator9 platforms

Robots.txt & Sitemap Generator.

Fill the form, get a valid robots.txt and XML sitemap. Sensible defaults for 9 CMS platforms + custom exclusion rules + deployment instructions.

◆ Configure
Exclude from crawling

Pick a mode (robots.txt or sitemap.xml), fill in the form, and click Generate.

Deployment

Three common platforms.

WordPress

  1. Install / open Yoast or Rank Math
  2. Paste into the robots.txt editor
  3. Submit sitemap in Search Console

Webflow

  1. Project Settings → SEO → Robots.txt
  2. Paste the output
  3. Publish project, verify at /robots.txt

Shopify

  1. Edit theme code → templates → robots.txt.liquid
  2. Paste the generated rules inside the {% for %} block
  3. Save; deploys automatically
Start here

Robots + sitemaps are the floor. The ceiling is everything else .

Need a full technical review? The $197 audit runs 40+ checks including indexation, crawlability, and submitted-vs-indexed gap analysis.