Article
Welcome PaliGemma 2 – New vision language models by Google
•
140
Abhinav Dadhich
resbyte
·
AI & ML interests
None yet
Recent Activity
upvoted
an
article
12 days ago
Welcome PaliGemma 2 – New vision language models by Google
upvoted
an
article
12 days ago
Introducing Idefics2: A Powerful 8B Vision-Language Model for the community
upvoted
a
paper
4 months ago
PaliGemma: A versatile 3B VLM for transfer
Organizations
None yet
resbyte's activity
upvoted
2
articles
12 days ago
Article
Introducing Idefics2: A Powerful 8B Vision-Language Model for the community
•
174
upvoted
a
paper
4 months ago
reacted to
merve's
post with 🔥
6 months ago
Post
5614
I have put together a notebook on Multimodal RAG, where we do not process the documents with hefty pipelines but natively use:
- vidore/colpali for retrieval 📖 it doesn't need indexing with image-text pairs but just images!
- Qwen/Qwen2-VL-2B-Instruct for generation 💬 directly feed images as is to a vision language model with no processing to text!
I used ColPali implementation of the new 🐭 Byaldi library by @bclavie 🤗
https://github.com/answerdotai/byaldi
Link to notebook: https://github.com/merveenoyan/smol-vision/blob/main/ColPali_%2B_Qwen2_VL.ipynb
- vidore/colpali for retrieval 📖 it doesn't need indexing with image-text pairs but just images!
- Qwen/Qwen2-VL-2B-Instruct for generation 💬 directly feed images as is to a vision language model with no processing to text!
I used ColPali implementation of the new 🐭 Byaldi library by @bclavie 🤗
https://github.com/answerdotai/byaldi
Link to notebook: https://github.com/merveenoyan/smol-vision/blob/main/ColPali_%2B_Qwen2_VL.ipynb
liked
2
models
6 months ago
upvoted
an
article
7 months ago
Article
Vision Language Models Explained
•
272
liked
a
model
7 months ago
liked
a
model
about 1 year ago
updated
a
collection
about 1 year ago
liked
3
models
over 1 year ago
liked
2
models
almost 2 years ago
liked
a
Space
over 2 years ago
liked
a
model
over 2 years ago
