FineTuning - Possible to extract captions embedded in png files?
Since png can hold text it seems like this would be supported by default but I cant figure out how to extract the captions from the png files when setting up my training images. Is it even possible?Thank you for any help!
2022-12-16T03:11:40Z
Donutmodel might help you extract the captions from images. Below are nice resources for finetuning donut:Transformers-Tutorials/Donut at master · NielsRogge/Transformers-Tutorials · GitHubDocument AI: Fine-tuning Donut for document-parsing using Hugging Face Transformers