robots.txt checker
Paste the file. This runs in the browser. It does not fetch your origin, so it cannot lie about CORS. It knows Motif's classified tokens and the robots.txt product tokens Motif refuses to pretend are User-Agents.
How to read the result
Named with Disallow: / is blocked. Named with Allow: / is allowed. Unnamed tokens inherit User-agent: * . User-requested fetchers often ignore robots.txt even when named. Policy tokens such as Google-Extended never appear as HTTP User-Agents in Motif.
Related