Technical standards
CCBot (Common Crawl)
CCBot is the crawler of Common Crawl, a non-profit foundation that scrapes the web and publishes a dataset used by nearly every LLM.
Entry by Lorenzo Eeman · PROEMA
Get started
Is your brand citable by AI?
Receive your free GEO score and then request a full GEO diagnostic: what ChatGPT, Perplexity and Gemini do (or don’t) see about you today.