Not improvements to the AI themselves, but rather the software that runs them. Backends like Unsloth are typically generalists - they are compatible with all sorts of hardware, but in exchange, they don’t incorporate the latest improvements or ideas. Projects run by pure human implementation tend to require a lot of oversight to ensure that additions don’t break functionality.

AI is really good at collecting and aggregating information. This makes them ideal for creating tailor-made products that have a narrow focus, since they raid many Githubs and papers, then attempt to make them into a product. Strata is one such backend, which is specially designed for Qwen Next-Flash.

Strata runs much faster than Unsloth and other generalist backends, but lacks flexibility in what it is suited for.

At least, that is my admittedly basic understanding of the situation…