minus-squarehyperhypervisor@programming.devtoSelfhosted@lemmy.world•Getting Started with Self Hosted LLMlinkfedilinkEnglisharrow-up4·4 months agoOk. I haven’t tried it so I’ll take your word for it. I’m just offering an easier alternative since the topic was “getting started” linkfedilink
minus-squarehyperhypervisor@programming.devtoSelfhosted@lemmy.world•Getting Started with Self Hosted LLMlinkfedilinkEnglisharrow-up5·4 months agoIirc it can run anything llama.cpp can because it just uses that under the hood. linkfedilink
minus-squarehyperhypervisor@programming.devtoSelfhosted@lemmy.world•Getting Started with Self Hosted LLMlinkfedilinkEnglisharrow-up8·4 months agoThere’s also llamafile, super simple: download and run it. linkfedilink
Ok. I haven’t tried it so I’ll take your word for it. I’m just offering an easier alternative since the topic was “getting started”