Hosted on MSN

AI distillation could shrink models and cut costs

The AI industry is witnessing a transformative trend: the use of distillation to make AI models smaller and cheaper. This shift, spearheaded by companies like DeepSeek and OpenAI, is reshaping the AI ...

Microsoft's new AI training method eliminates bloated system prompts without sacrificing model performance

Microsoft researchers have developed On-Policy Context Distillation (OPCD), a training method that permanently embeds ...
Infosecurity Magazine

Chinese AI Firms Hit Claude with Distillation Attacks, Anthropic Warns

Anthropic accused DeepSeek, Moonshot and MiniMax of illicitly using Claude to steal some of the AI model’s capabilities ...
Wired

Distillation Can Make AI Models Smaller and Cheaper

The original version of this story appeared in Quanta Magazine. The Chinese AI company DeepSeek released a chatbot earlier this year called R1, which drew a huge amount of attention. Most of it ...

Anthropic Accuses DeepSeek and Other Chinese AI Firms of Model Distillation Attempts

Anthropic said it is investing heavily in defences designed to make distillation attacks harder to execute and easier to identify.
InfoWorld

Anthropic alleges large-scale distillation campaigns targeting Claude

The AI company claims DeepSeek, Moonshot, and MiniMax used fraudulent accounts and proxy services to extract Claude’s ...