Post
279
📢 For those who interested in adopting streaming with bare minimum dependencies and setting up a GenAI powered demo in Web, this post might be relevant. Streaming support is inevitable for running local or remote models. Delighted to share the first part of the tutorial.
🎬 https://youtu.be/XgByPLLsiCI
From which you will learn how to:
☑️ Use pure JS for fetching streaming from the specific provider (Replicate)
☑️ Use pure JS with custom proxy streaming provider (FastAPI)
✨ TLDR: We review POST-based approaches for fetching data readers and adopting data parsers.
Using FastAPI as a proxy, we explain how to take control over transferred data.
Resources:
💻 JS: https://gist.github.com/nicolay-r/86fc212086c0955d541244253ec0564b
💻 JS+FastAPI: https://gist.github.com/nicolay-r/840425749cf6d3e397da3d329e894d59
🎬 https://youtu.be/XgByPLLsiCI
From which you will learn how to:
☑️ Use pure JS for fetching streaming from the specific provider (Replicate)
☑️ Use pure JS with custom proxy streaming provider (FastAPI)
✨ TLDR: We review POST-based approaches for fetching data readers and adopting data parsers.
Using FastAPI as a proxy, we explain how to take control over transferred data.
Resources:
💻 JS: https://gist.github.com/nicolay-r/86fc212086c0955d541244253ec0564b
💻 JS+FastAPI: https://gist.github.com/nicolay-r/840425749cf6d3e397da3d329e894d59
