size_categories:n<1K format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars library:distilabel region:us synthetic distilabel rlaif
---
size_categories: n<1K
dataset_info:
  features:
  - name: video_id
    dtype: string
  - name: scene_id
    dtype: int64
  - name: full_metadata
    struct:
    - name: activities
      list:
      - name: description
        dtype: string
      - name: timestamp
        struct:
        - name: end_timestamp
          dtype: string
        - name: start_timestamp
          dtype: string
    - name: audioVisualCorrelation
      dtype: float64
    - name: cast
      sequence: string
    - name: characterInteraction
      list:
      - name: characters
        sequence: string
      - name: description
        dtype: string
    - name: contextualRelevance
      dtype: string
    - name: dynamismScore
      dtype: float64
    - name: mood
      struct:
      - name: description
        dtype: string
      - name: keyMoments
        list:
        - name: changeDescription
          dtype: string
        - name: timestamp
          dtype: string
    - name: narrativeProgression
      list:
      - name: description
        dtype: string
      - name: timestamp
        dtype: string
    - name: props
      list:
      - name: name
        dtype: string
      - name: timestamp
        struct:
        - name: end_timestamp
          dtype: string
        - name: start_timestamp
          dtype: string
    - name: sceneId
      dtype: int64
    - name: thematicElements
      dtype: string
    - name: timestamps
      struct:
      - name: end_timestamp
        dtype: string
      - name: start_timestamp
        dtype: string
    - name: title
      dtype: string
    - name: videoEditingDetails
      list:
      - name: description
        dtype: string
      - name: timestamps
        struct:
        - name: end_timestamp
          dtype: string
        - name: start_timestamp
          dtype: string
  - name: activities
    sequence: string
  - name: activities_qa
    dtype: string
  - name: mood
    sequence: string
  - name: mood_qa
    dtype: string
  - name: narrativeProgression
    sequence: string
  - name: narrative_progression_qa
    dtype: string
  - name: props
    sequence: string
  - name: props_qa
    dtype: string
  - name: thematicElements
    sequence: string
  - name: thematic_elements_qa
    dtype: string
  - name: videoEditingDetails
    sequence: string
  - name: video_editing_details_qa
    dtype: string
  - name: characters
    sequence: string
  - name: characters_qa
    dtype: string
  - name: model_names
    sequence: string
  splits:
  - name: train
    num_bytes: 105674
    num_examples: 10
  download_size: 123963
  dataset_size: 105674
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
tags:
- synthetic
- distilabel
- rlaif
---

<p align="left">
  <a href="https://github.com/argilla-io/distilabel">
    <img src="https://raw.githubusercontent.com/argilla-io/distilabel/main/docs/assets/distilabel-badge-light.png" alt="Built with Distilabel" width="200" height="32"/>
  </a>
</p>

# Dataset Card for finevideo-qa-v2

This dataset has been created with [distilabel](https://distilabel.argilla.io/).


The pipeline script was uploaded to easily reproduce the dataset:
[qa.py](https://huggingface.co/datasets/dvilasuero/finevideo-qa-v2/raw/main/qa.py).

It can be run directly using the CLI:

```console
distilabel pipeline run --script "https://huggingface.co/datasets/dvilasuero/finevideo-qa-v2/raw/main/qa.py"
```


## Dataset Summary

This dataset contains a `pipeline.yaml` which can be used to reproduce the pipeline that generated it in distilabel using the `distilabel` CLI:

```console
distilabel pipeline run --config "https://huggingface.co/datasets/dvilasuero/finevideo-qa-v2/raw/main/pipeline.yaml"
```

or explore the configuration:

```console
distilabel pipeline info --config "https://huggingface.co/datasets/dvilasuero/finevideo-qa-v2/raw/main/pipeline.yaml"
```

## Dataset structure

The examples have the following structure per configuration:


<details><summary> Configuration: default </summary><hr>

```json
{
    "activities": [
        "Singing",
        "Playing guitar"
    ],
    "activities_qa": "{\n  \"qa\": [\n    {\n      \"answer\": \"What is the activity of the man with a beard and glasses?\",\n      \"question\": \"What is the man with a beard and glasses doing?\"\n    },\n    {\n      \"answer\": \"What instrument is the man with a beard and glasses playing?\",\n      \"question\": \"What instrument is the man playing while singing?\"\n    },\n    {\n      \"answer\": \"Does the man who is singing have a beard?\",\n      \"question\": \"What is the man\u0027s facial hair like?\"\n    },\n    {\n      \"answer\": \"What color is the man\u0027s shirt?\",\n      \"question\": \"What is the color of the man\u0027s shirt?\"\n    },\n    {\n      \"answer\": \"Is the man playing the guitar?\",\n      \"question\": \"What is the man doing?\"\n    },\n    {\n      \"answer\": \"Is the man singing?\",\n      \"question\": \"Is the man singing?\"\n    },\n    {\n      \"answer\": \"Can you describe the man\u0027s hairstyle?\",\n      \"question\": \"What is the man\u0027s hairstyle like?\"\n    },\n    {\n      \"answer\": \"What color is the man\u0027s hair?\",\n      \"question\": \"What is the color of the man\u0027s hair?\"\n    },\n    {\n      \"answer\": \"Does the man have a yellow shirt?\",\n      \"question\": \"Does the man have a yellow shirt?\"\n    },\n    {\n      \"answer\": \"Is the man playing the guitar while singing?\",\n      \"question\": \"Is the man playing the guitar while he sings?\"\n    }\n  ]\n}",
    "characters": [
        "A middle-aged man with salt-and-pepper hair and beard, wearing glasses and a light yellow t-shirt. He plays a guitar while singing."
    ],
    "characters_qa": "{\n  \"qa\": [\n    {\n      \"answer\": \"He is a male.\",\n      \"question\": \"Is the character a male?\"\n    },\n    {\n      \"answer\": \"He has hair that is a mix of grey and brown.\",\n      \"question\": \"What is the color of his hair?\"\n    },\n    {\n      \"answer\": \"He wears glasses.\",\n      \"question\": \"Is he wearing glasses?\"\n    },\n    {\n      \"answer\": \"He has a beard.\",\n      \"question\": \"Does he have a beard?\"\n    },\n    {\n      \"answer\": \"He is wearing a light yellow shirt.\",\n      \"question\": \"What color is his shirt?\"\n    },\n    {\n      \"answer\": \"He is playing a guitar.\",\n      \"question\": \"What is he doing in the video?\"\n    },\n    {\n      \"answer\": \"He is singing.\",\n      \"question\": \"Is singing involved in the scene?\"\n    },\n    {\n      \"answer\": \"He is the only character to perform.\",\n      \"question\": \"Is he the only character performing in the scene?\"\n    },\n    {\n      \"answer\": \"He is in a middle age range.\",\n      \"question\": \"What age range is he in?\"\n    },\n    {\n      \"answer\": \"He is the main focus of the scene.\",\n      \"question\": \"Is the scene centered around him?\"\n    }\n  ]\n}",
    "full_metadata": {
        "activities": [
            {
                "description": "Singing",
                "timestamp": {
                    "end_timestamp": "00:04:43.016",
                    "start_timestamp": "00:00:00.000"
                }
            },
            {
                "description": "Playing guitar",
                "timestamp": {
                    "end_timestamp": "00:04:43.016",
                    "start_timestamp": "00:00:00.000"
                }
            }
        ],
        "audioVisualCorrelation": 1.0,
        "cast": [
            "Singer"
        ],
        "characterInteraction": [
            {
                "characters": [
                    "Singer"
                ],
                "description": "The interaction between Abdul and Ivan is adversarial, leading to a deadly duel."
            }
        ],
        "contextualRelevance": "The song explores the nature of rivalry and the consequences of violence. The death of Ivan and the Muscovite maid\u0027s grief highlight the human cost of conflict.",
        "dynamismScore": 0.4,
        "mood": {
            "description": "Content",
            "keyMoments": []
        },
        "narrativeProgression": [
            {
                "description": "Introduction of Abdul the Bulbul Amir as a brave warrior.",
                "timestamp": "00:00:00.000"
            },
            {
                "description": "Abdul is called upon to defend the rear from a foe.",
                "timestamp": "00:00:15.015"
            },
            {
                "description": "Abdul\u0027s fierceness in battle is described.",
                "timestamp": "00:00:29.997"
            },
            {
                "description": "Introduction of Ivan Skavinsky Skavar, a skilled and charming man who rivals Abdul.",
                "timestamp": "00:00:45.012"
            },
            {
                "description": "Ivan challenges Abdul to a duel after stepping on his toe.",
                "timestamp": "00:01:29.990"
            },
            {
                "description": "Abdul warns Ivan of his impending death.",
                "timestamp": "00:02:01.989"
            },
            {
                "description": "The duel takes place, and Ivan is defeated.",
                "timestamp": "00:02:16.003"
            },
            {
                "description": "The Sultan witnesses the aftermath of the duel.",
                "timestamp": "00:02:47.000"
            },
            {
                "description": "The Sultan visits Ivan as he dies.",
                "timestamp": "00:03:33.013"
            },
            {
                "description": "Ivan is buried near the Danube, mourned by a Muscovite maid.",
                "timestamp": "00:04:03.009"
            },
            {
                "description": "The Muscovite maid remembers Ivan.",
                "timestamp": "00:04:28.001"
            }
        ],
        "props": [
            {
                "name": "Acoustic guitar",
                "timestamp": {
                    "end_timestamp": "00:04:43.016",
                    "start_timestamp": "00:00:00.000"
                }
            }
        ],
        "sceneId": 1,
        "thematicElements": "Bravery, rivalry, death, and love are prominent themes.",
        "timestamps": {
            "end_timestamp": "00:04:43.917",
            "start_timestamp": "00:00:00.000"
        },
        "title": "Scene 1",
        "videoEditingDetails": [
            {
                "description": "Text overlay: \"Abdul the Bulbul Amir\" and credit information.",
                "timestamps": {
                    "end_timestamp": "00:04:43.016",
                    "start_timestamp": "00:00:00.000"
                }
            }
        ]
    },
    "model_names": [
        "meta-llama/Meta-Llama-3.1-8B-Instruct",
        "meta-llama/Meta-Llama-3.1-8B-Instruct",
        "meta-llama/Meta-Llama-3.1-8B-Instruct",
        "meta-llama/Meta-Llama-3.1-8B-Instruct",
        "meta-llama/Meta-Llama-3.1-8B-Instruct",
        "meta-llama/Meta-Llama-3.1-8B-Instruct",
        "meta-llama/Meta-Llama-3.1-8B-Instruct",
        "meta-llama/Meta-Llama-3.1-8B-Instruct"
    ],
    "mood": [
        "Content"
    ],
    "mood_qa": "{ \n    \"qa\": [\n        {\n            \"answer\": \"A person appears to be smiling or has a relaxed facial expression.\",\n            \"question\": \"What is the facial expression of the person in the video?\"\n        },\n        {\n            \"answer\": \"The atmosphere seems tranquil and peaceful.\",\n            \"question\": \"What is the atmosphere in the video?\"\n        },\n        {\n            \"answer\": \"There is a sense of satisfaction or happiness.\",\n            \"question\": \"What is the overall sentiment of the scene?\"\n        },\n        {\n            \"answer\": \"Yes, the person is describing something with a calm and collected tone.\",\n            \"question\": \"Is the person describing something in a calm tone?\"\n        },\n        {\n            \"answer\": \"Yes, the person is describing something contentedly.\",\n            \"question\": \"Is the person describing something contentedly?\"\n        },\n        {\n            \"answer\": \"Contentment.\",\n            \"question\": \"What is the mood of this scene?\"\n        },\n        {\n            \"answer\": \"Yes, the person seems to be feeling content.\",\n            \"question\": \"Does the person seem to be feeling content?\"\n        },\n        {\n            \"answer\": \"The person appears to be engaged and interested in what they are talking about.\",\n            \"question\": \"Does the person appear engaged and interested in what they are talking about?\"\n        },\n        {\n            \"answer\": \"Yes, the person seems to be in a state of comfort and relaxation.\",\n            \"question\": \"Does the person seem to be in a state of comfort and relaxation?\"\n        }\n    ]\n}",
    "narrativeProgression": [
        "Introduction of Abdul the Bulbul Amir as a brave warrior.",
        "Abdul is called upon to defend the rear from a foe.",
        "Abdul\u0027s fierceness in battle is described.",
        "Introduction of Ivan Skavinsky Skavar, a skilled and charming man who rivals Abdul.",
        "Ivan challenges Abdul to a duel after stepping on his toe.",
        "Abdul warns Ivan of his impending death.",
        "The duel takes place, and Ivan is defeated.",
        "The Sultan witnesses the aftermath of the duel.",
        "The Sultan visits Ivan as he dies.",
        "Ivan is buried near the Danube, mourned by a Muscovite maid.",
        "The Muscovite maid remembers Ivan."
    ],
    "narrative_progression_qa": "{\n  \"qa\": [\n    {\n      \"answer\": \"What is the appearance of the male singer in the video?\",\n      \"question\": \"What is the age and hair color of the male singer?\"\n    },\n    {\n      \"answer\": \"What is the clothing of the male singer?\",\n      \"question\": \"What is the color of the t-shirt the man singing is wearing?\"\n    },\n    {\n      \"answer\": \"What object is being played by the male singer?\",\n      \"question\": \"What object is the man with glasses playing?\"\n    },\n    {\n      \"answer\": \"Is there a mention of a brave warrior in the scene description?\",\n      \"question\": \"Is there a character introduced as a brave warrior?\"\n    },\n    {\n      \"answer\": \"Is there a character introduced as a foe?\",\n      \"question\": \"Is a character described as a foe mentioned in the scene description?\"\n    },\n    {\n      \"answer\": \"Is there a character called Ivan described in the scene description?\",\n      \"question\": \"Is a skilled and charming man called Ivan described in the scene description?\"\n    },\n    {\n      \"answer\": \"Does Abdul engage in a duel?\",\n      \"question\": \"Is a duel mentioned in the scene description?\"\n    },\n    {\n      \"answer\": \"Who is defeated in the duel?\",\n      \"question\": \"Who is involved in a duel and is defeated?\"\n    },\n    {\n      \"answer\": \"Is the Danube mentioned in the scene description?\",\n      \"question\": \"Is the Danube mentioned in the scene description as a location?\"\n    },\n    {\n      \"answer\": \"What happens to Ivan after his death?\",\n      \"question\": \"How is Ivan treated after his death?\"\n    }\n  ]\n}",
    "props": [
        "Acoustic guitar"
    ],
    "props_qa": "{\n  \"qa\": [\n    {\n      \"answer\": \"The sound of an acoustic guitar can be heard in the video.\",\n      \"question\": \"Is an acoustic guitar featured in the video?\"\n    },\n    {\n      \"answer\": \"This is a video of someone playing an acoustic guitar.\",\n      \"question\": \"What type of guitar is featured in the video?\"\n    },\n    {\n      \"answer\": \"The video focuses on a solo acoustic guitar performance.\",\n      \"question\": \"Is the video a solo performance or an ensemble?\"\n    },\n    {\n      \"answer\": \"Yes\",\n      \"question\": \"Is an acoustic guitar used in the video?\"\n    },\n    {\n      \"answer\": \"Acoustic\",\n      \"question\": \"What type of guitar can you hear being played in the video?\"\n    }\n  ]\n}",
    "scene_id": 1,
    "thematicElements": [
        "Bravery, rivalry, death, and love are prominent themes."
    ],
    "thematic_elements_qa": "{\n  \"qa\": [\n    {\n      \"answer\": \"Is bravery a theme in the video?\",\n      \"question\": \"What themes are present in the video?\"\n    },\n    {\n      \"answer\": \"Is a rivalry portrayed in the video?\",\n      \"question\": \"What themes are present in the video?\"\n    },\n    {\n      \"answer\": \"Is death a theme in the video?\",\n      \"question\": \"What themes are present in the video?\"\n    },\n    {\n      \"answer\": \"Is love a theme in the video?\",\n      \"question\": \"What themes are present in the video?\"\n    },\n    {\n      \"answer\": \"Can the outcome of the characters\u0027 actions be permanent?\",\n      \"question\": \"What kind of outcomes can be expected from the characters\u0027 actions in the video?\"\n    }\n  ]\n}",
    "videoEditingDetails": [
        "Text overlay: \"Abdul the Bulbul Amir\" and credit information."
    ],
    "video_editing_details_qa": "{\n  \"qa\": [\n    {\n      \"answer\": \"The text \u0027Abdul the Bulbul Amir\u0027 appears as an overlay.\",\n      \"question\": \"What text appears as an overlay in the video?\"\n    },\n    {\n      \"answer\": \"Credit information is displayed, but no further details are provided.\",\n      \"question\": \"Is credit information displayed in the video?\"\n    }\n  ]\n}",
    "video_id": "duXOs0eUY2c"
}
```

This subset can be loaded as:

```python
from datasets import load_dataset

ds = load_dataset("dvilasuero/finevideo-qa-v2", "default")
```

Or simply as it follows, since there's only one configuration and is named `default`: 

```python
from datasets import load_dataset

ds = load_dataset("dvilasuero/finevideo-qa-v2")
```


</details>




