Fine-tune code llama on private source code
What’s the best approach to fine-tune code llama to answer questions about source code on my local disk, without sending the code into the cloud?Assume the local machine has sufficient GPU (via petals) and the source code in question is ~1m LOC of C# but is unlabelled (there are no “questions” in the training set).  So I assume this will necessitate an unsupervised learning approach?Know of any good papers or other work addressing this use case?Thanks!-Bob
2023-10-06T17:26:33Z
hey hello! have you been able to fine tune your code yet? It will be great if you write here on your findings.
2024-02-27T08:53:26Z
@stormchaser@boblevy8Any findings/approach/code, please share  ?
2024-05-30T05:45:08Z
You could use this for your data preparation workGitHub - IBM/data-prep-kit: Open source project for data preparation of LLM application builders