Text Generation
Transformers
Safetensors
llama
text-generation-inference

discord and other stuff

#2
by kalle07 - opened

you server is dead ... if you have one you should provide some input ... make advertising on other servers...
promote your model there! why not ? :)
discord: hugging, JAN, Kobold, LM-Studio, Ollama ...

2 technical!
now v06

  • no prompt-template - again (standart alpaca seems to work for the beginning)
  • only 4k context-length? that are 4 pages and only 2 if you want translate some what
  • you dont check that out if its also work at least on 8k ???
  • why you dont create your own GGUF, 99% of all users use GGUF
    -> iv made if you want to remove i delete it

Sign up or log in to comment