Embeddig model information
Hi Guys,Is there any embedding model from the huggingface where the size of thereturned embeddingwith dimension1536as openai’stext-embedding-ada-002?
2024-10-20T12:00:58Z
There are many models that are too long or too short for that purpose.huggingface.coMTEB Leaderboard - a Hugging Face Space by mtebDiscover amazing ML apps made by the communityMedium – 26 Feb 24OpenAI vs Open-Source Multilingual Embedding ModelsChoosing the model that works best for your dataReading time: 12 min read
2024-10-20T12:06:42Z
Hey@John6666. I have seen that blog. But the problem is that I dont have openai api keys. But I created myfaiss_indexwith an dimension1536. So from that blog i cause mistral’s model. But that model was very large where my streamlit application gets failed to download the model. Is there any other model? I havejina aiwhere the embedding dimension was 786.
2024-10-20T12:14:27Z
I don’t know much about it, I’d have to do a search, but what about BAAI, dimension seems right and I don’t think it’s big.Medium – 23 Mar 24Retrieval in LangChain: Part 3— Text Embeddings and Vector StoresWelcome to the third article of the series, where we explore Retrieval in LangChain. If you haven't checked out the previous articles from…Reading time: 4 min readSorry, dimension is wrong…1536 dimension modelshuggingface.coAlibaba-NLP/gte-Qwen2-1.5B-instruct · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.huggingface.coizhx/udever-bloom-1b1 · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.Simply ordered by popularityhuggingface.coModels - Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.After all, it may be easiest to find from the MTEB leaderboard.
2024-10-20T14:26:44Z
Hey@John6666. I have a doub that we cant use different embedding model in the time of vector store creation and in the inference. I mean i created faiss_index where i used openai embedding model where in the inference time i used other embedding models which matches the openai’s dimension size.
2024-10-20T22:42:47Z
It’s not impossible to adjust to a lower dimension, apparently…GeeksforGeeks – 1 Jun 17Introduction to Dimensionality Reduction - GeeksforGeeksA Computer Science portal for geeks. It contains well written, well thought and well explained computer science and programming articles, quizzes and practice/competitive programming/company interview Questions.stackoverflow.comReduce an embedding's dimensions using PCAc#, accord.netasked byphilon01:03PM - 17 Oct 23 UTC
2024-10-21T12:17:38Z
This topic was automatically closed 12 hours after the last reply. New replies are no longer allowed.