Model for evaluation of scanned survey data
Dear allI guess that there may be a good model for the following purpose. I have around 140 scanned PDFs with paper questionnaires. People have checked certain boxes or values on a likert scale. There is only one text box. I will scan these papers, but I asked myself if there maybe a model here that can be used out of the box to evaluate those scans. As I only have these 140 questionnaires, there is not enough data for a model training, I guess. Is there something so sophisticated to be used already?Best regardsMartin
2025-01-12T15:43:02Z
I think it would be possible to achieve this by using a library for Python to convert the PDF to an image and then passing it to aVQA modelwith a certain level of performance, or by building anRAG that can read PDFs, like the ones available on Spaces.
2025-01-13T07:02:59Z
I could also directly scan the pages into images instead of PDFs. And I will look up both solutions that you recommended.Given that there are so many paper based surveys out there I am surprised that there are not already specialized models for that.
2025-01-13T08:13:54Z
No, there might be, but it’s more likely that I just don’t know about it.Also, if you don’t mind using images instead of PDFs, it would be much easier. If you use a general-purpose VLM of a certain size, you can ask questions with text attached to the images, and they will answer. I think it’s possible with 8B or less. The larger the size, the higher the accuracy, but the operating environment becomes more demanding.I can’t post a link, so try searching for “VL” in Spaces…
2025-01-14T10:03:04Z
Thank you, I will look at the spaces. Until now I only looked at models.
2025-01-19T15:28:50Z
Hello everyoneA few days have passed and I have tried several of the models from the VL leaderboard that I found via spaces. However, I got none of them to work. Perhaps because I only have a laptop with a CPU. Do you know a good VQA model, as supposed here with 8B or so, that could also be run on a laptop for inference?Best regardsMartin
2025-01-19T16:36:19Z
You’ll need about 20GB of RAM to use the 8B model. Ideally, you’d want VRAM, but that’s not usually available on laptops.You might be able to get by with 2B or 3B, but it’s pretty slow on a CPU.You can use the Serverless Inference API for free up to 1000 times a day, so why not give it a try?huggingface.coQwen/Qwen2-VL-7B-Instruct · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.huggingface.cometa-llama/Llama-3.2-11B-Vision-Instruct · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.
2025-01-19T16:38:35Z
These are easy to use in small VLM. I think there are other good ones.huggingface.covikhyatk/moondream2 · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.huggingface.coQwen/Qwen2-VL-2B-Instruct · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.huggingface.coHuggingFaceTB/SmolVLM-Instruct · Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.
2025-01-19T16:39:42Z
Thanks I will try them. Recently I also wanted to do somethin with Llama, but read that it is not available in the EU anymore.
2025-01-19T16:55:04Z
Actually, If you look for HF, you’ll find it…But personally, I’d recommend Qwen or Moondream for smaller ones.