task_categories:text-generation language:en license:cc-by-nc-4.0 size_categories:100K<n<1M modality:image region:us
---
license: cc-by-nc-4.0
task_categories:
- text-generation
language:
- en
size_categories:
- 100K<n<1M
---
# Alleviating Attention Bias for Visual-Informed Text Generation

## Training Dataset for Allegator finetuning.
The dataset consists of a subset of LLaVA-Instruct-150k and a subset of Flickr30k, with 99,883 and 31,783 samples from each, respectively.

In detail, LLaVA-Instruct-150K contains 158k language-image instruction following samples, including 58k conversations, 23k descriptions, and 77k complex, 182 reasoning.
We augment LLaVA-Instruct-150K with Flickr30K, which has relatively short captions, to enrich visual and textual diversity.


### Acknowledgement
- LLaVA-Instruct-150k [[link]](https://huggingface.co/datasets/liuhaotian/LLaVA-Instruct-150K)
- Flickr30k [[link]](https://www.kaggle.com/datasets/eeshawn/flickr30k)