I was about to start a monthly column about AI search visibility β€” how to get your pages cited by ChatGPT, Perplexity, Google's AI Mode. Medium was the obvious venue. Big audience, publications that distribute for you, no infrastructure to run. Before writing the first paragraph I ran the check I run on every client site: curl -s https://medium.com/robots.txt Medium disallows the crawlers I was writing about. What's actually in the file Checked 2026-09-17, ...