# Robots.txt for Trippovention Website # https://trippovention.com/ # Last Updated: November 06, 2026 # LLMs.txt & Content Signals for AI Crawlers and Agents # https://trippovention.com/llms.txt # https://trippovention.com/.well-known/llms.txt # https://trippovention.com/llms-full.txt # Global rules for all bots (includes every AI/LLM crawler unless a specific block below overrides) User-agent: * Content-Signal: ai-train=no, search=yes, ai-input=yes Allow: / Allow: /assets/*.css Allow: /assets/*.js Allow: /assets/*.webp Allow: /assets/*.png Allow: /assets/*.jpg Allow: /assets/*.jpeg Allow: /assets/*.svg Allow: /assets/*.woff2 Allow: /assets/*.woff Allow: /assets/images/ Disallow: /404.html Disallow: /offline.html Disallow: /thank-you.html Disallow: /*?q=* Disallow: /*?search=* Disallow: /*?error=* Disallow: /_validation/ Disallow: /node_modules/ Disallow: /docs/ Disallow: /scripts/ # Specific search engine instructions User-agent: Googlebot Allow: / User-agent: Googlebot-Image Allow: /assets/images/ Allow: /assets/*.webp Allow: /assets/*.png Allow: /assets/*.jpg User-agent: Bingbot Allow: / Crawl-delay: 1 User-agent: Baiduspider Allow: / Crawl-delay: 2 User-agent: Yandex Allow: / Crawl-delay: 1 # Social media bots (for rich link previews) User-agent: facebookexternalhit Allow: / User-agent: LinkedInBot Allow: / User-agent: WhatsApp Allow: / # Scrapers and SEO audit bots with crawl delay User-agent: AhrefsBot Crawl-delay: 10 User-agent: SemrushBot Crawl-delay: 10 User-agent: MJ12bot Disallow: / User-agent: dotbot Disallow: / User-agent: PetalBot Crawl-delay: 10 # Google Ads crawlers — Explicitly allowed for ad verification User-agent: AdsBot-Google Allow: / User-agent: AdsBot-Google-Mobile Allow: / User-agent: AdsBot-Google-Mobile-Apps Allow: / # AI/LLM Search & Answer Engine Crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / User-agent: Bytespider Allow: / User-agent: Cohere-ai Allow: / User-agent: CCBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: Claude-Web Allow: / User-agent: Anthropic-AI Allow: / User-agent: Perplexity-User Allow: / User-agent: Meta-ExternalAgent Allow: / User-agent: Meta-ExternalFetcher Allow: / User-agent: FacebookBot Allow: / User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / User-agent: Amazonbot Allow: / User-agent: DuckAssistBot Allow: / # Host directive Host: trippovention.com # XML Sitemaps (Sitemap Index + Modular Child Sitemaps + Image Sitemap) Sitemap: https://trippovention.com/sitemap.xml Sitemap: https://trippovention.com/sitemap-pages.xml Sitemap: https://trippovention.com/sitemap-destinations.xml Sitemap: https://trippovention.com/sitemap-packages.xml Sitemap: https://trippovention.com/sitemap-visa.xml Sitemap: https://trippovention.com/image-sitemap.xml