• brucethemoose@lemmy.world
    link
    fedilink
    English
    arrow-up
    5
    ·
    2 days ago

    You shouldn’t let that discourage you. VLLM is really finicky, but there are easier backends to use (though which one depends on your hardware).