• Hirom@beehaw.org
    link
    fedilink
    English
    arrow-up
    1
    ·
    1 month ago

    Fair point, GPUs are often used too, and have other uses for HPC workloads.

    There is still a major misallocations of resources for AI. This infrastructure is badly needed by big tech for their AI growth plans. No one else need this much.

    There’s no good reasons to build at that scale and so fast, for any reason.

    There’s a need to lower overall energy and resources usage, and improve efficiency. Building many large datacenters for LLMs go in the wrong direction.

    • ranzispa@mander.xyz
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 month ago

      I work in research and I have dire need of GPUs. I do not work on LLMs.

      Recently we got granted access to 500 GPUs for 2 months; all of them are spinning - and this is the work of 5 researchers. A normal research HPC institute normally has some 100-200 GPUs. In this sector there are startups which need to execute simulator calculations.

      Yes, GPU infrastructure is very much needed and lacking in Europe.