0x0f

I use llama-swap with a couple of different models, one 8B as a general chat bot, with offloading to several MoE-models for specific workloads. It’s all run on an old dell xps with 64GB ram.

Mine is used for code reviews, general questions, coding assistance and for anything else I can think of.

Yeah, that’s not a waste of money /s

Thanks for sharing this, I have been looking for an AI setup without GPU, so this is right up my alley.