Skip to main content
ConvertLab
Tools

Web & URLs

robots.txt Generator

Build robots.txt with allow/disallow rules, crawl delay and sitemap directives.

  • Runs in your browser

Rules

robots.txt

User-agent: *
Allow: /
Disallow: /admin
Disallow: /api
Disallow: /private
Crawl-delay: 10

Sitemap: https://example.com/sitemap.xml

Was this tool useful?

Stored locally in your browser only — not sent anywhere.

Tools you may need

URL Encoder/DecoderPercent-encode text for URLs, or decode an encoded string back to plain text.URL ParserBreak any URL into protocol, host, port, path, query parameters and hash — entirely on-device.Slug GeneratorTurn titles and phrases into clean, URL-friendly slugs.JSON to TypeScriptGenerate TypeScript types from a JSON sample, with named types for nested objects.