• deadcream@sopuli.xyz
    link
    fedilink
    arrow-up
    1
    arrow-down
    1
    ·
    11 hours ago

    This will just waste even more energy since cpus are less efficient at this kind of task.

    LLMs require insane amounts of compute, period. The hardware to do that needs energy and emits heat, there is no way around.

      • deadcream@sopuli.xyz
        link
        fedilink
        arrow-up
        1
        arrow-down
        1
        ·
        8 hours ago

        It will still run necessary calculations much slower than a gpu, so you will need to run it much longer for the same result, which is not only inconvenient but will likely use more power in the end anyway.