About

As the number of SEO, marketing and AI platforms grows, so does the amount of bots used to crawl the web to collect and verify their data. Incorrectly blocking these bots via CDNs or other automated security systems can result in a decrease in visibility through Search Engines and LLMs, as well as problems running paid marketing campaigns. Ensuring that these good bots aren't blocked requires maintaining a list of "good bots" and up-to-date signatures for each which will enable automated systems to identify them and allow them to bypass rate limits or other blocks which are in place.

This tool aims to provide a community-led resource which brings together these signatures in one place.

Contributing

Noticed that we've missed a bot from the list? Spotted an inaccuracy? Please raise a PR over on GitHub.