Deploy an ML model and make it accessible as an API
Hello,Can anyone recommend a cost-effective platform to deploy our RAG model and make it available as an API for ongoing use?
2024-10-28T11:35:02Z
Would it be something like this?huggingface.coAdvanced RAG on Hugging Face documentation using LangChain - Hugging Face...We’re on a journey to advance and democratize artificial intelligence through open source and open science.Medium – 28 Jul 24Build an Agentic RAG using HuggingFace Transformers AgentIntroductionReading time: 41 min readMedium – 4 Aug 24Implementing RAG with Langchain and Hugging FaceUsing Open Source for Information RetrievalReading time: 9 min read
2024-10-28T12:10:47Z
Yes, I’m implementing this, but instead of deploying it as a web app or chatbot, I want to use it purely as an API.
2024-10-28T12:14:59Z
If so, the cheapest way is to deploy it as a web app and use it from the Gradio client.The Endpoint API is probably faster and smarter, but there is a fee.huggingface.coHub API EndpointsWe’re on a journey to advance and democratize artificial intelligence through open source and open science.gradio.appGetting Started With The Python ClientA Step-by-Step Gradio Tutorial
2024-10-28T12:18:02Z
can we make an API using LangServe  and use that API in c# code …???
2024-10-28T12:20:08Z
Gradio can be used from curl, for example, so of course you can get by with C#…About Endpoint, I’ve never used Endpoint, but maybe you can?huggingface.coSend Requests to EndpointsWe’re on a journey to advance and democratize artificial intelligence through open source and open science.
2024-10-28T12:25:33Z
Yes, ThanksBut do you have any idea about Lang Serve using which we can create an Fast API and also use it as an REST API, actually i am not sure about this want some guidance on this
2024-10-28T12:32:18Z
github.comGitHub - langchain-ai/langserve: LangServe 🦜️🏓LangServe 🦜️🏓I don’t know anything about Lang Serve, but from my search, it seems to be intended for use with Cloud Run and the like. Or maybe Amazon AWS?I’m not familiar with cloud services…As for FastAPI, the backend of Gradio should also be FastAPI, so it should be basically the same for HF.
2024-10-28T12:37:34Z
I hope this will give some extra information:python.langchain.com🦜️🏓 LangServe | 🦜️🔗 LangChainRelease Notes
2024-10-28T12:37:56Z
Thanks, this information helps me a lot.
2024-10-29T00:38:37Z
This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.