US crackdown threat could shake out China’s ‘distillation’ AI copycats: analysts
US plans action against AI ‘distillation’, as analysts warn weaker Chinese start-ups could be forced out within a year
The administration of Donald Trump has threatened action to shield the US artificial intelligence industry from being “distilled” by Chinese rivals, in a move analysts say could weed out weaker players in China’s AI sector within a year.
“Distillation” was a widely used technique in which a smaller “student” model was trained on the outputs of a more advanced “teacher” model, allowing developers to replicate capabilities more cheaply, said Helen Toner, interim executive director at Georgetown University’s Centre for Security and Emerging Technology, during testimony before the Senate on Wednesday.
Some Chinese start-ups had claimed to “self-develop” models while relying heavily on distillation, and such firms lacking original research could be “forced out of the game” within six to 12 months, said Zhang Ruiwang, a Beijing-based information systems architect.
Even among more capable developers, distillation is often used to accelerate iteration. Zhang said this could lengthen development cycles: gaps that might previously have been filled within three months could now take a year or more.
