license:apache-2.0 region:us
---
license: apache-2.0
---

# NovaChart: A Large-scale Dataset for Chart Understanding and Generation

## Overview

NovaChart is a large-scale dataset developed to enhance the chart understanding and generation capabilities of Multimodal Large Language Models (MLLMs). It contains **47K high-resolution chart images** and **856K chart-related instructions**, covering **18 different chart types** and **15 distinct tasks** related to chart understanding and generation. NovaChart was designed to address the limitations of existing chart datasets by increasing chart type diversity, expanding task coverage, and improving dataset scalability.



## Key Features

- **18 Chart Types**: Includes bar charts, line plots, pie charts, scatter plots, radar charts, histograms, heatmaps, word clouds, and more.
- **15 Tasks**: NovaChart covers a variety of tasks across chart understanding and generation, such as:
  - **Chart Data Understanding**: Tasks focusing on interpreting data values, such as data identification and comparison.
  - **Chart Visual Understanding**: Tasks related to visual elements of the chart, such as color recognition and style detection.
  - **Chart Summarization and Analysis**: Higher-level tasks that involve summarizing insights from the chart or identifying patterns.
  - **Chart Generation**: Tasks focused on creating or transforming charts, including code generation for chart rendering and chart type conversions.

- **Comprehensive Metadata**: Each chart is annotated with metadata, including data points, visual elements (e.g., colors, shapes), source data, and visualization code.

  

## Dataset Structure

NovaChart consists of two primary components:

1. **Chart Metadata**:  

   - **Data Points**: Statistical values representing data within the chart.
   - **Visual Elements**: Details such as colors and shapes used in the chart.
   - **Source Data**: The raw data used to generate the chart.
   - **Visualization Code**: Code used to render each chart.

2. **Instruction-Response Pairs**:

   - **Instruction**: A prompt related to a specific task (e.g., "What is the color used to represent Category X?").

   - **Response**: The corresponding answer generated based on the chart metadata.

     

## Usage

TBD



## Citation

If you use this dataset in your work, please cite:

```
@inproceedings{hu2024novachart,
  title={NovaChart: A Large-scale Dataset towards Chart Understanding and Generation of Multimodal Large Language Models},
  author={Hu, Linmei and Wang, Duokang and Pan, Yiming and Yu, Jifan and Shao, Yingxia and Feng, Chong and Nie, Liqiang},
  booktitle={ACM Multimedia 2024},
  year={2024}
}
```

