Sora Rich annotation
Collection
Contains a rich set of different types of annotations for a set of 198 videos
•
6 items
•
Updated
•
10
Schneider Marcell
Sneccello
AI & ML interests
None yet
Recent Activity
reacted
to
jasoncorkill's
post
with 🚀
6 days ago
This dataset was collected in roughly 4 hours using the Rapidata Python API, showcasing how quickly large-scale annotations can be performed with the right tooling!
All that at less than the cost of a single hour of a typical ML engineer in Zurich!
The new dataset of ~22,000 human annotations evaluating AI-generated videos based on different dimensions, such as Prompt-Video Alignment, Word for Word Prompt Alignment, Style, Speed of Time flow and Quality of Physics.
https://huggingface.co/datasets/Rapidata/text-2-video-Rich-Human-Feedback
reacted
to
jasoncorkill's
post
with ❤️
12 days ago
Runway Gen-3 Alpha: The Style and Coherence Champion
Runway's latest video generation model, Gen-3 Alpha, is something special. It ranks #3 overall on our text-to-video human preference benchmark, but in terms of style and coherence, it outperforms even OpenAI Sora.
However, it struggles with alignment, making it less predictable for controlled outputs.
We've released a new dataset with human evaluations of Runway Gen-3 Alpha: Rapidata's text-2-video human preferences dataset. If you're working on video generation and want to see how your model compares to the biggest players, we can benchmark it for you.
🚀 DM us if you’re interested!
Dataset: https://huggingface.co/datasets/Rapidata/text-2-video-human-preferences-runway-alpha
liked
a dataset
16 days ago
Rapidata/text-2-video-human-preferences-luma-ray2
Organizations
Sneccello's activity
upvoted
a
collection
19 days ago
upvoted
an
article
about 1 month ago
Article
Beyond Image Preferences - Rich Human Feedback for Text-to-Image Generation
By
and 5 others
•
•
13