WebTools · SEO tools

Robots.txt Tester

See if a path is allowed for a crawler user-agent. Files and text stay on this device.

How to use Robots.txt Tester

Paste a robots.txt, a user-agent and a path. The tester uses longest-match Allow/Disallow rules in this tab. It does not download robots.txt from the web.

Guide: improve website SEO