If you've ever wondered how AI companies like Google, Anthropic, OpenAI, and Meta get their training data from paywalled publishers such as the New York Times, Wired, or the Washington Post, we may ...

Editor’s note: This work is part of AI Watchdog, The Atlantic’s ongoing investigation into the generative-AI industry. The Common Crawl Foundation is little known outside of Silicon Valley. For more ...

Is this how AI companies are getting access to paywalled journalism? A new report accuses Common Crawl of doing AI's "dirty work," which the organization denies. Chance Townsend is the General ...