Dataloader with streaming dataset for image captioning (BLIP finetune)
Hi I’m hoping to finetune BLIP on this dataset :huggingface.cogoogle-research-datasets/conceptual_captions · Datasets at Hugging FaceWe’re on a journey to advance and democratize artificial intelligence through open source and open science.Instead of loading the entire dataset, I’ll like to stream to data. That’s where I’m stuck. I’m not sure how to write the Dataloader.Referencing this notebook:colab.research.google.comGoogle ColabOn how to to finetune, I’m actually getting no where. Hope I’ve given sufficient information. Thank you.
2024-10-28T14:53:10Z
What about this feature of the datasets library?huggingface.coStreamWe’re on a journey to advance and democratize artificial intelligence through open source and open science.