Update README.md
Browse files
README.md
CHANGED
@@ -17,13 +17,16 @@ pipeline_tag: visual-question-answering
|
|
17 |

|
18 |
|
19 |
## Introduction
|
20 |
-
- VideoScore is a
|
21 |
-
|
22 |
-
a large video evaluation dataset with multi-aspect human scores.
|
23 |
|
24 |
-
- VideoScore
|
|
|
|
|
25 |
|
26 |
-
- VideoScore
|
|
|
|
|
27 |
|
28 |
- **This is the regression version of VideoScore**
|
29 |
|
|
|
17 |

|
18 |
|
19 |
## Introduction
|
20 |
+
- 🧐🧐[VideoScore-anno-only](https://huggingface.co/TIGER-Lab/VideoScore-anno-only) is a variant from [VideoScore](https://huggingface.co/TIGER-Lab/VideoScore), trained on VideoFeedback dataset
|
21 |
+
excluding the real videos.
|
|
|
22 |
|
23 |
+
- [VideoScore](https://huggingface.co/TIGER-Lab/VideoScore) series is a video quality evaluation model series, taking [Mantis-8B-Idefics2](https://huggingface.co/TIGER-Lab/Mantis-8B-Idefics2) as base-model
|
24 |
+
and trained on [VideoFeedback](https://huggingface.co/datasets/TIGER-Lab/VideoFeedback),
|
25 |
+
a large video evaluation dataset with multi-aspect human scores.
|
26 |
|
27 |
+
- VideoScore can reach 75+ Spearman correlation with humans on VideoFeedback-test, surpassing all the MLLM-prompting methods and feature-based metrics.
|
28 |
+
VideoScore also beat the best baselines on other three benchmarks EvalCrafter, GenAI-Bench and VBench, showing high alignment with human evaluations.
|
29 |
+
For the data details of four benchmarks, please refer to [VideoScore-Bench](https://huggingface.co/datasets/TIGER-Lab/VideoScore-Bench).
|
30 |
|
31 |
- **This is the regression version of VideoScore**
|
32 |
|