Training a model for a PDF with OCR - where to begin?
Total newbie here when it comes to ML etc.I have a pdf with pages that look like this which I can export to jpegs:IMG_26881305×1637 93.2 KBI want to train my model to be able to get the:Question numberThe question linked to the numberThe number of marks linked to that questionAny diagrams linked to the questionAny answer spaces linked to the questionI’m having a go at using Label Studio to label the areas. Then train with Tensorflow? Is this correct first steps?Once I labelled them, how do I know that it also extract or taking into account the actual text or content - not just ‘how it looks like’?Extra: Once trained, how can I integrate my model into embeddings(?) so that I can use LLM (GPT etc) to query/chat bot etc?Would appreciate any help or how you would approach this?Many thanks in advance.S
2023-05-22T13:06:19Z
You may want to consider using an existing library.This article gives a nice intro to the topic.huggingface.coAccelerating Document AIWe’re on a journey to advance and democratize artificial intelligence through open source and open science.Google also recently released a model pix2struct.
2023-05-22T14:50:44Z
This is massively helpful to get me started! I’ll take a look at Donut & pix2struct!Thank you!
2023-12-13T05:00:18Z
Any updates on what was chosen?@syedkhairi@wsfung2008
2024-10-27T10:26:21Z
Hope you guys are doing well. Do you have any update@syedkhairi@wsfung2008regarding this use case? Interested to know how you finally cracked upon this as simple storing and retrieving of text embedding doesn’t solve this.