# =========================================== # Robots.txt for SEO + AI Crawler Visibility # =========================================== # See /llm.txt for AI content usage guidelines # Default: allow all bots User-agent: * Disallow: # ---------------------- # AI Crawlers # ---------------------- User-agent: GPTBot Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Google-Extended Allow: / # ---------------------- # Major Search Engines # ---------------------- User-agent: Googlebot Allow: / User-agent: Bingbot Allow: / User-agent: DuckDuckBot Allow: / User-agent: Baiduspider Allow: / User-agent: YandexBot Allow: / # ---------------------- # Sitemaps # ---------------------- Sitemap: /sitemap # ---------------------- # Allows # ---------------------- Allow: / # ---------------------- # Disallows # ---------------------- Disallow: /dealers_regions/* Disallow: /feed/