Creeps love an always-on camera that you can wear on your face so that it’s not obvious that you’re filming?
Who could’ve seen that coming
Creeps love an always-on camera that you can wear on your face so that it’s not obvious that you’re filming?
Who could’ve seen that coming
How much RAM do you have and which version of the model did you run?
Local LLMs can be just as fast as long your device clears the requirements. If you noticed a huge difference, there’s a really good chance that you tried to use a model that requires more RAM than you have
If you have access to their git, watch out for the commit history. Check how much code each commit is introducing and/or editing and how fast they are, and how many times these big commits happen.
If you see a project with big commits in very short interval of times, it’s a sign that it was vibe coded
That is a bit too much for your hardware, even the Q4_0. You needed a smaller version (26B likely would suit you better. It would be faster and is a MoE)