Which Transformers/Libraries Should I use?
I am able to useLM Studioto prompt against Hugging Face models which I’ve downloaded with prompts likeRewrite the following email make it sound more professional:
....AndWhat does the follow Python code do
....AndRewrite the following Python code as Java code
....Which HF transformers/libraries should I be using to create something like this with HF and Python?
2024-12-17T15:43:04Z
LLaMA (e.g., CodeLlama): Great for general-purpose text and code generation. Available variants specialized for code.Model:codellama/CodeLlama-7b-hfMistral: Lightweight yet powerful, suitable for local use.Model:mistralai/Mistral-7B-v0.1Falcon: Optimized for performance and open-weight inference.Model:tiiuae/falcon-7b-instructGPT-NeoX / GPT-J: Smaller GPT-like models optimized for general NLP tasks.Model:EleutherAI/gpt-neox-20borEleutherAI/gpt-j-6BButI recommend you using chatgpt. Chatgpt has versatile ability to compile or generate python code.BUTYou should consider that LLM is just model that was made by human.It worse than you!!!
2024-12-17T20:49:22Z
So those appear to be models, not exactly what I’m looking for.In LM Studio, you can load any GGUF model that your workstation has enough resources for.And you can have LM Studio prompt the LLM for things like “rewrite this code” or “summarize this email” etc.I think that if/when you were to use the HF Pipeline you only get one feature at a time e.g. classification or translation or summarization.Given that LM Studioappearsto be able to do more than one (but I could be wrong) using a single GUFF I’m wondering how I can do that?I want to create something that uses Python and the Electron JS framework.Maybe this is a matter of creating the correct prompts as the LM uses the same LLM for every single task.