Guides and glossary for AI visibility

How to manage AI bots in robots.txt

Which bot does what, and which to allow or block, is a decision. We walk through separating search bots from training bots and writing the rule correctly.

7 min read · Updated: 20 Sep 2026

AI visibility glossary

Short, plain explanations of the terms in this field.

How JavaScript-loaded content looks to bots

A page that looks full in the browser can look empty to a bot that does not run JavaScript. We show how to see the gap and what to fix.

6 min read · Updated: 20 Sep 2026

llms.txt: what it does and what it does not

llms.txt gets a lot of attention but there is little evidence of its effect. We explain what the file is, who uses it and why it adds no points to your score.

5 min read · Updated: 20 Sep 2026