Robots.txt Tester
See if a path is allowed for a crawler user-agent. Files and text stay on this device.
How to use Robots.txt Tester
Paste a robots.txt, a user-agent and a path. The tester uses longest-match Allow/Disallow rules in this tab. It does not download robots.txt from the web.