Can you use a finetuned model for an assistant?
Hello, I have a model that works well for my assistant. I want to finetune this model - however, given that this can get a bit pricey, I don’t want to waste money on doing that only to find out I won’t be able to select it as one of the options for my assistant.So, is it possible to use a finetuned model for an assistant?
2024-06-07T07:13:04Z
Hi,If you would like to fine-tune a reasonably sized model at a lower cost, especially from a notebook on Google Colab, I invite you to take a look at how to use Unsloth.ai.From the README.md :Unsloth supportsFree NotebooksPerformanceMemory useLlama 3 (8B)Start for free2x faster60% lessMistral v0.3 (7B)Start for free2.2x faster73% lessPhi-3 (medium)Start for free2x faster50% lessPhi-3 (mini)Start for free2x faster50% lessGemma (7B)Start for free2.4x faster71% lessORPOStart for free1.9x faster43% lessDPO ZephyrStart for free1.9x faster43% lessTinyLlamaStart for free3.9x faster74% lessLink to GitHub :GitHub - unslothai/unsloth: Finetune Llama 3, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory