How to use llm model's api?
Hello,I’m working with a RAG system that uses a Hugging Face model. However, the Llama models are too large to load locally. Is there a way to use the model’s API instead of loading it directly, and if so, how?
2024-11-06T08:48:25Z
huggingface.coServerless Inference APIWe’re on a journey to advance and democratize artificial intelligence through open source and open science.huggingface.coInference EndpointsWe’re on a journey to advance and democratize artificial intelligence through open source and open science.There are two main ways to do this. TheServerless Inference APIis free to use, but it’s difficult to use it reliably. TheEndpoint APIis stable, but it’s not free.There are also other services that use HF models with other companies’ APIs, but I don’t know much about them.There is a Playground where you can actually use the Inference API, so you can try it out there.huggingface.coInference Playground - a Hugging Face Space by huggingfaceDiscover amazing ML apps made by the community
2024-11-14T18:42:47Z
[deleted for posting spam content]