Add exported openvino model 'openvino_model.xml'
Hello!
This pull request has been automatically generated from the Sentence Transformers backend-export Space.
Pull Request overview
- Add exported OpenVINO model
openvino_model.xml.
Tip:
Consider testing this pull request before merging by loading the model from this PR with the revision argument:
from sentence_transformers import SentenceTransformer
# TODO: Fill in the PR number
pr_number = 2
model = SentenceTransformer(
"HIT-TMG/KaLM-embedding-multilingual-mini-instruct-v1.5",
revision=f"refs/pr/{pr_number}",
backend="openvino",
)
# Verify that everything works as expected
embeddings = model.encode(["The weather is lovely today.", "It's so sunny outside!", "He drove to the stadium."])
print(embeddings.shape)
similarities = model.similarity(embeddings, embeddings)
print(similarities)
Thank you very much for your contribution!
If possible, we will merge the model from this pull request into the main branch after the evaluation. (Due to the holiday, it may take a few days to process.)
@YanshekWoo
thank you for writing back, I hope it can help to optimize model on CPU.
I'm planning to add to openvino version to my code, that's why I'm looking for news from you.
Thank you
Pull Request overview
- Add exported OpenVINO model
openvino_model.xml.
Dear Gurur,
Could you please provide some information about your operating environment? I am encountering some issues while running OpenVINO in my own Python environment.
Hi YanshekWoo,
Unfortunately, I face some issues too. I created this pull request automatically without any experience about OpenVINO because of curios about find onnx or openvino version of this model. If you wish, you can reject this request.
""" This pull request has been automatically generated from the Sentence Transformers backend-export Space. """"
In conclusion, thank you for your contribution.
Moving forward, we can explore CPU-optimized models such as ONNX.