Partially restricted
Some areas are hidden from crawlers, but the main content stays open to search engines.
🤖
AI crawlers restricted
— Amazonbot, anthropic-ai, Applebot-Extended, Bytespider, CCBot, ClaudeBot, FacebookBot, Google-Extended …
Areas hidden from crawlers:
🔑
Admin & login
2
🔍
Search & filters
1
🔌
API & endpoints
1
🖼️
Media & files
1
📁
Other paths
15
Show raw disallow rules (20)
/config
/search
/account$
/account/
/commerce/digital-download/
/api/
/static/
/*?author=*
/*&author=*
/*?tag=*
/*&tag=*
/*?month=*
/*&month=*
/*?view=*
/*&view=*
/*?format=json
/*&format=json
/*?format=page-context
/*&format=page-context
/*?format=main-content
… list truncated
| Sitemap |
Found
8 pages
|
| Last modified |
2026-03-20 |