Playground Vs. API Very Different Responses
I have spun up an Inference Endpoint for llama 3.1 8b instruct, but for some reason when I interact with it through the “playground” on the Inference Endpoint page I get dramatically better responses than when I use the API. Does anyone have any idea why that might be?
2024-09-08T05:45:53Z
I’ve never used the Inference Endpoint API directly, but even before that, I couldn’t find any “playground” that looked like it by googling…I did find the following article.huggingface.coFrom OpenAI to Open LLMs with Messages API on Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.huggingface.coMigrating from OpenAI to Open LLMs Using TGI’s Messages API - Hugging Face...We’re on a journey to advance and democratize artificial intelligence through open source and open science.