Technical standards
Modern robots.txt
robots.txt is the file that tells bots which paths to crawl. The 2026 take distinguishes training and search bots.
Entry by Lorenzo Eeman · PROEMA
Get started
Is your brand citable by AI?
Receive your free GEO score and then request a full GEO diagnostic: what ChatGPT, Perplexity and Gemini do (or don’t) see about you today.