Developer Tools

robots.txt Tester

Test supplied robots.txt groups and rules against an explicit crawler token and URL.

Your content stays on your device Free, with no account
robots.txt Tester · local toolsOn device · no uploads

Source & controls

No file selected.

Ready. Run when you choose.

Scope & limits

Supplied text only, ≤200000UTF16 units; HTML≤20000elements. No remote pages/images/robots/linked sitemaps/analytics fetched. HTML stays in a detached inert template. XML DTD/entity directives reject. Bounded checks, not full schema/ranking/crawler certification.

WORKING RESULT

Preview & output

A FEW SIMPLE STEPS

How to use robots.txt Tester

  1. Choose source/settings or load the example. Optional imports show filename/size/status.
  2. Process locally or use drawing/playback controls; review result and scope.
  3. Inspect/play the actual result before explicitly copying/downloading it.
  4. Clear or switch workflows to release inputs, media, workers and output.
PRIVATE BY DESIGN

Why use this tool?

Your text, files, artwork and audio stay on your device. Self-hosted browser code processes everything without uploads or external content fetching.

Tool inputs stay in your browser. Only your theme preference is saved on this device.

A few things worth knowing

What is the supported scope?

Supplied text only, ≤200000UTF16 units; HTML≤20000elements. No remote pages/images/robots/linked sitemaps/analytics fetched. HTML stays in a detached inert template. XML DTD/entity directives reject. Bounded checks, not full schema/ranking/crawler certification.

Does anything leave my browser?

No source is uploaded. Optional microphone input needs permission and remains local. Explicit clipboard/download copies remain outside cleanup.

What happens when settings change?

Old downloads invalidate. Live audio updates or restarts its sweep as labelled. Stop/Clear/page exit release processing and media.