Major publishers have increasingly restricted AI crawler access to their websites, turning a once largely technical robots.txt decision into a strategic question about training data, licensing, and control of digital content . The shift does not mean publishers have adopted one common position on artificial intelligence. It does mean that AI companies can no longer assume that publicly reachable web content is available for automated collection. One early, high-profile example came in Sept...