minus-squareT156@lemmy.worldtoSelfhosted@lemmy.world•Would you use a self-hosted, AI-powered search engine for your favorite sites?linkfedilinkEnglisharrow-up11arrow-down2·4 days agoI can’t imagine self hosting an LLM-based search engine would be too viable. The hardware demands, even for a relatively small quantised model, are considerable. Doubly so if you don’t have a GPU to accelerate with. linkfedilink
I can’t imagine self hosting an LLM-based search engine would be too viable. The hardware demands, even for a relatively small quantised model, are considerable. Doubly so if you don’t have a GPU to accelerate with.