AdaptiveCatalogBot
The crawler operated by Adaptive Catalog.
What it does
Adaptive Catalog builds product catalog metadata (specifications, descriptions and images) for IT resellers. AdaptiveCatalogBot reads public product pages from manufacturers and retailers to keep that catalog accurate. It fetches product and datasheet pages only; it does not log in, submit forms, buy anything or collect personal data.
How it behaves
- Honors
robots.txt, includingDisallowrules forAdaptiveCatalogBotand*. - Rate limited per site, and backs off when a site slows down or returns errors.
- Signs its requests with HTTP Message Signatures (Web Bot Auth), so you can tell it apart from anything pretending to be it.
How to identify it
- User-Agent
AdaptiveCatalogBot/1.0 (+https://bot.adaptivecatalog.com)- Signature-Agent
https://bot.adaptivecatalog.com- Key directory
https://bot.adaptivecatalog.com/.well-known/http-message-signatures-directory- Key IDs
KkHEg8wu8XgJKoH_gVq2QlN-O_fGgJj3HZY5_Vuzias- Egress IP
74.179.56.117(machine-readable: /ips.json)
A request that carries our User-Agent but no valid signature from a key in the directory above, or that comes from another address, is not from us.
Contact
To report a problem or ask us to slow down or stop, email
support@adaptivecatalog.com. To block the bot, add a
robots.txt rule for AdaptiveCatalogBot.
Last updated 2026-11-19.