• 2 Posts
  • 16 Comments
Joined 3 years ago
cake
Cake day: June 14th, 2023

help-circle








  • ZephyrXero@lemmy.worldtoTechnology@lemmy.worldOpensource AI Must Win
    link
    fedilink
    English
    arrow-up
    0
    arrow-down
    1
    ·
    28 days ago

    There are efforts there. The new Deepseek 4 compresses a lot of its knowledge using something they call engrams. But it’s unfortunately still too big for a consumer GPU.

    Gemma 4 is small enough to run on your cellphone.

    If your GPU has at least 8GB there are a lot of options for self hosting your own local models