# disallowed user agents
User-agent: Ahrefs
User-agent: AhrefsBot
User-agent: Amazonbot
User-agent: Anthropic-ai
User-agent: AwarioRssBot
User-agent: AwarioSmartBot
User-agent: Bytespider
User-agent: CCBot
User-agent: ClaudeBot
User-agent: Claude-Web
User-agent: Cohere-ai
User-agent: Diffbot
User-agent: FacebookBot
User-agent: Google-Extended
User-agent: huggingface
User-agent: ImagesiftBot
User-agent: Magpie-crawler
User-agent: NewsNow
User-agent: news-please
User-agent: Omgili
User-agent: Omgilibot
User-agent: PerplexityBot
User-agent: Rogerbot 
User-agent: Scrapy
User-agent: SEMrushBot
User-agent: TurnitinBot
User-agent: YouBot
Disallow: /

User-agent: *
Allow: /

Sitemap: https://www.kayakscout.com/sitemap_index.xml