Getting started
I’m pretty new to all of this, at least in regards to running things locally.  I’ve recently stumbled across a program called Koboldcpp, and for text-to-text it works decently well enough, depending on the model I have it run.  As for text to image, it does “Okay” I suppose, held back by the fact that it doesn’t seem to be capable of using more than one lora at a time.  I have yet to test the text to speech (or any of the audio) and i’m fairly sure it isn’t capable of video.  No text to video, no image to video.Does anybody have any recommendations for another alternative to koboldcpp?  I’m not even sure the correct term to search for when looking.  Looking for LLM’s just seems like it would point me to the models, not the software that runs them.  Free is great, one time payment is good, just none of the monthly subscription nonsense.
2024-12-10T12:54:55Z
How about Ollama if you’re using it with HF?I’ve never used it, but it seems easy and it seems to get along well with HF.huggingface.coUse Ollama with any GGUF Model on Hugging Face HubWe’re on a journey to advance and democratize artificial intelligence through open source and open science.