• sp3ctr4l@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    1
    ·
    edit-2
    9 hours ago

    OpenLlama. Alpaca.

    Run a local friend model, today!

    I… actually futzed around with this just to see if it would work, and… yeah, there actually are models that will run on a Steam Deck, with Bazzite.

    EDIT: Got my angry spitting long necked quadrupeds mixed up.

    Alpaca is a flatpak, literally could not be easier to set up a local LLM.