WhiskyGuruBot

What is WhiskyGuruBot?

WhiskyGuruBot is the web crawler operated by WhiskyGuru , a whisky discovery and tracking platform. The bot crawls online whisky retailers to collect publicly available product information such as product names, EAN barcodes, ABV, and bottle volumes. This data is used to build and maintain our whisky database.

User-Agent

Crawl behaviour

• Respects robots.txt: disallowed paths are never crawled
• Respects Crawl-delay directives
• Minimum 5 seconds between requests per domain
• Only crawls publicly accessible product pages
• Does not crawl checkout, cart, account, or search pages
• Uses sitemap lastmod to avoid re-crawling unchanged pages

Opt out

To prevent WhiskyGuruBot from crawling your site, add the following to your robots.txt:

User-agent: WhiskyGuruBot
Disallow: /

Or contact us and we will remove your site immediately.

Contact

Questions or concerns about WhiskyGuruBot? Send us a message.