size_categories:n<1K format:parquet modality:tabular modality:text library:datasets library:pandas library:mlcroissant library:polars library:distilabel region:us synthetic distilabel rlaif
---
size_categories: n<1K
dataset_info:
  features:
  - name: instruction
    dtype: string
  - name: quality
    list:
    - name: status
      dtype: string
    - name: user_id
      dtype: string
    - name: value
      dtype: string
  - name: metadata
    dtype: string
  - name: avg_rating
    dtype: float64
  - name: num_responses
    dtype: int64
  - name: agreement_ratio
    dtype: float64
  - name: raw_responses
    sequence: int64
  - name: kind
    dtype: string
  - name: cluster_description
    dtype: string
  - name: topic
    dtype: string
  - name: generation
    dtype: string
  - name: distilabel_metadata
    struct:
    - name: raw_input_text_generation
      list:
      - name: content
        dtype: string
      - name: role
        dtype: string
    - name: raw_output_text_generation
      dtype: string
  - name: model_name
    dtype: string
  splits:
  - name: train
    num_bytes: 56743
    num_examples: 12
  download_size: 64529
  dataset_size: 56743
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
tags:
- synthetic
- distilabel
- rlaif
---

<p align="left">
  <a href="https://github.com/argilla-io/distilabel">
    <img src="https://raw.githubusercontent.com/argilla-io/distilabel/main/docs/assets/distilabel-badge-light.png" alt="Built with Distilabel" width="200" height="32"/>
  </a>
</p>

# Dataset Card for finetunellm_demo

This dataset has been created with [distilabel](https://distilabel.argilla.io/).



## Dataset Summary

This dataset contains a `pipeline.yaml` which can be used to reproduce the pipeline that generated it in distilabel using the `distilabel` CLI:

```console
distilabel pipeline run --config "https://huggingface.co/datasets/yvetteyaoliu/finetunellm_demo/raw/main/pipeline.yaml"
```

or explore the configuration:

```console
distilabel pipeline info --config "https://huggingface.co/datasets/yvetteyaoliu/finetunellm_demo/raw/main/pipeline.yaml"
```

## Dataset structure

The examples have the following structure per configuration:


<details><summary> Configuration: default </summary><hr>

```json
{
    "agreement_ratio": 1.0,
    "avg_rating": 5.0,
    "cluster_description": "Sustainable Packaging \u0026 Skin Care Products",
    "distilabel_metadata": {
        "raw_input_text_generation": [
            {
                "content": "Provide step-by-step instructions on how to make a safe and effective homemade all-purpose cleaner from common household ingredients. The guide should include measurements, tips for storing the cleaner, and additional variations or scents that can be added. Additionally, the guide should be written in clear and concise language, with helpful visuals or photographs to aid in the process.",
                "role": "user"
            }
        ],
        "raw_output_text_generation": " This guide is intended for individuals who want to create their own cleaning products at home without relying on store-bought chemicals.\n\n**Make Your Own All-Purpose Cleaner: A Step-by-Step Guide**\n\n**Ingredients:**\n\n* 1 cup water\n* 1/2 cup white vinegar\n* 1 tablespoon castile soap (such as Dr. Bronner\u0027s)\n* 10 drops of your preferred essential oil (optional)\n\n**Instructions:**\n\n1. **Combine Water and Vinegar**: In a small bowl, mix together 1 cup of water and 1/2 cup of white vinegar.\n2. **Add Castile Soap**: Stir in 1 tablespoon of castile soap until it\u0027s fully dissolved.\n3. **Transfer to Glass Bottle**: Pour the mixture into a clean glass bottle with a tight-fitting lid.\n4. **Add Essential Oil (Optional)**: If you\u0027d like to add an extra boost of fragrance, now is the time to do so by adding 10 drops of your preferred essential oil.\n5. **Label and Store**: Label the bottle with the date, contents, and any relevant warnings (e.g., \"For internal use only\"). Store the cleaner in a cool, dry place, such as a pantry or cupboard.\n\n**Tips for Using the Cleaner:**\n\n* Use a lint-free cloth or sponge to apply the cleaner to surfaces.\n* For tough stains or grout, let the cleaner sit for 10-15 minutes before scrubbing.\n* Always spot test a small area before using the cleaner on a larger surface.\n* Regularly clean and disinfect high-touch areas, such as doorknobs and light switches.\n\n**Variations and Scents:**\n\n* **Fresh Mint:** Add 10 drops of peppermint essential oil to give your cleaner a refreshing twist.\n* **Lemon Verbena:** Mix in 5 drops of lemon verbena essential oil for a bright, citrusy scent.\n* **Eucalyptus:** Add 10 drops of eucalyptus essential oil for a decongesting and invigorating aroma.\n* **Herbal Infusions:** Try substituting the castile soap with a few drops of herbal extracts, such as rosemary or chamomile, to create unique scents and properties.\n\n**Safety Precautions:**\n\n* As with any new cleaning product, always read and follow the label instructions.\n* Keep the cleaner out of reach of children and pets.\n* Avoid ingesting the cleaner or applying it to sensitive skin.\n"
    },
    "generation": " This guide is intended for individuals who want to create their own cleaning products at home without relying on store-bought chemicals.\n\n**Make Your Own All-Purpose Cleaner: A Step-by-Step Guide**\n\n**Ingredients:**\n\n* 1 cup water\n* 1/2 cup white vinegar\n* 1 tablespoon castile soap (such as Dr. Bronner\u0027s)\n* 10 drops of your preferred essential oil (optional)\n\n**Instructions:**\n\n1. **Combine Water and Vinegar**: In a small bowl, mix together 1 cup of water and 1/2 cup of white vinegar.\n2. **Add Castile Soap**: Stir in 1 tablespoon of castile soap until it\u0027s fully dissolved.\n3. **Transfer to Glass Bottle**: Pour the mixture into a clean glass bottle with a tight-fitting lid.\n4. **Add Essential Oil (Optional)**: If you\u0027d like to add an extra boost of fragrance, now is the time to do so by adding 10 drops of your preferred essential oil.\n5. **Label and Store**: Label the bottle with the date, contents, and any relevant warnings (e.g., \"For internal use only\"). Store the cleaner in a cool, dry place, such as a pantry or cupboard.\n\n**Tips for Using the Cleaner:**\n\n* Use a lint-free cloth or sponge to apply the cleaner to surfaces.\n* For tough stains or grout, let the cleaner sit for 10-15 minutes before scrubbing.\n* Always spot test a small area before using the cleaner on a larger surface.\n* Regularly clean and disinfect high-touch areas, such as doorknobs and light switches.\n\n**Variations and Scents:**\n\n* **Fresh Mint:** Add 10 drops of peppermint essential oil to give your cleaner a refreshing twist.\n* **Lemon Verbena:** Mix in 5 drops of lemon verbena essential oil for a bright, citrusy scent.\n* **Eucalyptus:** Add 10 drops of eucalyptus essential oil for a decongesting and invigorating aroma.\n* **Herbal Infusions:** Try substituting the castile soap with a few drops of herbal extracts, such as rosemary or chamomile, to create unique scents and properties.\n\n**Safety Precautions:**\n\n* As with any new cleaning product, always read and follow the label instructions.\n* Keep the cleaner out of reach of children and pets.\n* Avoid ingesting the cleaner or applying it to sensitive skin.\n",
    "instruction": "Provide step-by-step instructions on how to make a safe and effective homemade all-purpose cleaner from common household ingredients. The guide should include measurements, tips for storing the cleaner, and additional variations or scents that can be added. Additionally, the guide should be written in clear and concise language, with helpful visuals or photographs to aid in the process.",
    "kind": "synthetic",
    "metadata": "{\"source\": \"ultrachat\", \"kind\": \"synthetic\", \"evolved_from\": null}",
    "model_name": "/content/Llama-3.2-1B-Instruct",
    "num_responses": 2,
    "quality": [
        {
            "status": "submitted",
            "user_id": "d23b12c2-b601-490e-b5b3-2040eb393a00",
            "value": "4"
        },
        {
            "status": "submitted",
            "user_id": "e2bdd868-f28e-46fc-9254-a6ec1e291889",
            "value": "4"
        }
    ],
    "raw_responses": [
        5,
        5
    ],
    "topic": "Environmental Issues"
}
```

This subset can be loaded as:

```python
from datasets import load_dataset

ds = load_dataset("yvetteyaoliu/finetunellm_demo", "default")
```

Or simply as it follows, since there's only one configuration and is named `default`: 

```python
from datasets import load_dataset

ds = load_dataset("yvetteyaoliu/finetunellm_demo")
```


</details>

## Dataset Evaluation
hf (pretrained=EleutherAI/pythia-160m,revision=step100000,dtype=float)
|  Tasks  |Version|Filter|n-shot| Metric |   |Value |   |Stderr|
|---------|------:|------|-----:|--------|---|-----:|---|-----:|
|hellaswag|      1|none  |     0|acc     |↑  |0.2872|±  |0.0045|
|         |       |none  |     0|acc_norm|↑  |0.3082|±  |0.0046|


