language:en size_categories:1K<n<10K arxiv:2412.11170 region:us
---
language:
- en
pretty_name: MATE-3D
size_categories:
- 1K<n<10K
---
# Multi-DimensionAl Text-to-3D Quality Evaluation Benchmark (MATE-3D) 🎥📊

[Code](https://github.com/zhangyujie-1998/MATE-3D) · [Project Page](https://mate-3d.github.io/) · [Paper@ArXiv](https://arxiv.org/abs/2412.11170) · [Prompt list](https://huggingface.co/datasets/ccccby/MATE-3D/blob/main/prompt_MATE_3D.json)

Welcome to the MATE-3D dataset! This repository contains around 1,280 textured meshes generated by various models using the [Prompt list](https://huggingface.co/datasets/ccccby/MATE-3D/blob/main/prompt_MATE_3D.json). These textured meshes have been annotated from four evaluation dimensions, including semantic alignment, geometry quality, texture quality, and overall quality.

## Dataset Details 📚

- **Paper:** [Read the Paper](https://arxiv.org/abs/2412.11170)
- **Code:** [Code](https://github.com/zhangyujie-1998/MATE-3D) 
- **Prompt List (160 prompts):** [Prompt list](https://huggingface.co/datasets/ccccby/MATE-3D/blob/main/prompt_MATE_3D.json)
- **Project Page:** [Project Page](https://mate-3d.github.io/)
- **Models Included in MATE-3D dataset:**
  - [DreamFusion](https://github.com/threestudio-project/threestudio?tab=readme-ov-file)
  - [Magic3D](https://github.com/threestudio-project/threestudio?tab=readme-ov-file)
  - [SJC](https://github.com/hyz317/threestudio/tree/d2dc63b1fbf300224ef1dbd93fa39d75cbefaa57)
  - [TextMesh](https://github.com/threestudio-project/threestudio?tab=readme-ov-file)
  - [3DTopia](https://github.com/3DTopia/3DTopia)
  - [Consistent3D](https://github.com/sail-sg/Consistent3D)
  - [LatentNeRF](https://github.com/hyz317/threestudio/tree/d2dc63b1fbf300224ef1dbd93fa39d75cbefaa57)
  - [One-2-3-45++](https://github.com/SUDO-AI-3D/One2345plus?tab=readme-ov-file)
- **Dataset Structure:**
  Generate textured meshes are organized in the following structure (take dreamfusion for an example)
  ```
  ./dreamfusion.zip/
  ├── A_blue_jacket
    ├── model.obj
    ├── material.mtl
    ├── material_0.jpeg
  ├── A_blue_vase
    ├── model.obj
    ├── material.mtl
    ├── material_0.jpeg
  ...
  ```


## Acknowledgements and Citation 🙏

This dataset is based on the text-to-3D generative framework, which utilizes various open-source repositories for textured mesh generation evaluation. If you find this dataset helpful, please consider citing the original work:

```bash
@article{zhang2024benchmarking,
  title={Benchmarking and Learning Multi-Dimensional Quality Evaluator for Text-to-3D Generation},
  author={Yujie Zhang, Bingyang Cui, Qi Yang, Zhu Li, and Yiling Xu},
  journal={arXiv preprint arXiv:2412.11170},
  year={2024}
}
```