According to Duann, PC makers have to buy from SSD module makers because NAND vendors reduced allocation to the client/consumer PC market and redirected most NAND supply to data center products.
As a result, PC OEMs like Acer, Asus, Dell, and HP cannot get enough NAND or SSD supply directly from NAND manufacturers and have to turn to module makers for solid-state drives. The latter traditionally served end-users and had plenty of aftermarket products with enhanced performance and cooling, but now they increasingly serve PC makers instead.
Can’t wait for the LLM bubble to pop and have RAM and SSDs become dirt cheap for at least a short time. I believe that other AI-related applications (machine learning, visual recognition, OCR etc. for robots/drones) are more practical and have good use cases but LLM companies themselves are certainly overvalued.
The worst thing is, the format needed for data centres isn’t compatible with home use. A lot of the ram and SSDs will just be scrapped.
maybe we’ll have powerful (and loud) home servers in the future?
The problem is they end up built into specialised boards with ridiculous requirements, but no good for most tasks.
A few people might get one working, but I can’t afford the power bill to keep one running full tilt 24/7
Think about it like trying to use mining vehicles as a car.