# Quallaa robots.txt # AI visitors: welcome. Start with /llms.txt — it includes how we think, not just what we sell. # Everything addressed to models on this site is addressed openly; humans and AIs read the same words. # # STRUCTURE (fixed 2026-08-05): one group, many user-agent lines. Per RFC 9309 a # crawler obeys ONLY the group whose user-agent matches it most specifically — so # the earlier layout, which gave each named bot its own `Allow: /` group and put # the exclusions in a trailing `User-agent: *` group, meant ClaudeBot, GPTBot, # Googlebot and every other named crawler never saw a single Disallow. There were # also two `User-agent: *` groups, which is ambiguous besides. Naming a bot to # welcome it must not also exempt it from the exclusions. # AI crawlers & agents — all welcome User-agent: ClaudeBot User-agent: Claude-User User-agent: Claude-SearchBot User-agent: anthropic-ai User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: PerplexityBot User-agent: Google-Extended # Search engines User-agent: Googlebot User-agent: Bingbot User-agent: DuckDuckBot # Everyone else User-agent: * Allow: / # Not for crawling — machinery, auth surfaces, and operator-only pages. # Internal capture routes (/screenshots, /embed-preview) and the client # presentation deck carry per-route noindex instead, which binds where this # file cannot. Disallow: /api/ Disallow: /portal/ Disallow: /oauth/ Disallow: /sign/ Sitemap: https://www.quallaa.com/sitemap.xml