# Harmony - Affordable Housing Access Platform # https://harmonyworks.com # Sitemap Sitemap: https://harmonyworks.com/sitemap.xml # Internal / non-public pages (keep out of the index) # Applied per-group below since search engines honor their own most-specific block. # Standard Crawlers # /demo-videos is explicitly allowed: "Disallow: /demo" is a prefix match that # would otherwise block it, and it must stay crawlable so engines can see its # noindex meta (longest-match rule makes the Allow win). User-agent: Googlebot Disallow: /design-system Disallow: /prototype Disallow: /backgrounds Disallow: /demo Allow: /demo-videos Allow: / User-agent: Bingbot Disallow: /design-system Disallow: /prototype Disallow: /backgrounds Disallow: /demo Allow: /demo-videos Allow: / User-agent: Slurp Allow: / User-agent: DuckDuckBot Allow: / # Social Media Crawlers User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / User-agent: LinkedInBot Allow: / User-agent: Pinterestbot Allow: / # AI / LLM crawlers (explicitly allowed for discoverability in AI answer engines). # Current bot names as of 2026-07; all are also covered by the "*" group below. # OpenAI — GPTBot (training/crawl), OAI-SearchBot (ChatGPT Search retrieval), ChatGPT-User (user-triggered fetch) User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / # Anthropic (Claude) — ClaudeBot (crawl), Claude-User (user-triggered fetch), anthropic-ai (legacy) User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: anthropic-ai Allow: / # Perplexity — PerplexityBot (crawl), Perplexity-User (user-triggered fetch) User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / # Google / Apple AI training opt-in User-agent: Google-Extended Allow: / User-agent: Applebot-Extended Allow: / # Default User-agent: * Disallow: /design-system Disallow: /prototype Disallow: /backgrounds Disallow: /demo Allow: /demo-videos Allow: / Crawl-delay: 1