Dieser Bereich kann Inhalte enthalten, die nicht für alle Nutzer geeignet sind. Dazu können unter anderem Texte, Medien oder Diskussionen gehören, die als beleidigend, extremistisch, gewaltbezogen oder anderweitig belastend empfunden werden. Wenn du solche Inhalte nicht sehen möchtest, nutze bitte die jeweiligen Filter- und Meldeoptionen der Plattform oder meide entsprechende Threads/Communities.
If their models truly are reaching parity with new western models as many claim, then it can’t be from distillation alone, they must be gathering their own datasets too. It takes months to train a new model.
Also distillation only really saves you the data collection and preparation (categorization). Training is still expensive, as is inference. It’s likely architectural changes that are making their inference cheaper (MoE vs dense models for one), not sure if they’ve gotten any good methods for making training cheaper.
There is zero proof of distillation. Minimax 2.7 development was surrounded by moderate use of Claude. M3 is their latest generation, and pretty solid, but its performance cannot be attributed solely (or even 5%) to distillation, and that is only lab that has been accused of significant API use. These claims are all 3-4 months old by now, and Anthropic blocked China access after publishing the accusations. Repeated BS is BS from losers trying to lobby for support.