size_categories:1K<n<10K format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
dataset_info:
  features:
  - name: critique
    dtype: string
  - name: messages
    list:
    - name: content
      dtype: string
    - name: role
      dtype: string
  - name: score
    dtype: int64
  splits:
  - name: train
    num_bytes: 2606571
    num_examples: 1000
  download_size: 1397648
  dataset_size: 2606571
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
---


# Dataset creation

```python
from datasets import load_dataset

uf_critique = load_dataset("argilla/ultrafeedback-critique", split="train")

def prepare_for_critique_training(example):
    return {
        "messages": [
            {"role": "user", "content": example["instruction"]}, 
            {"role": "assistant", "content": example["response"]}
        ],
        "critique": example["critique"],
        "score": example["overall_score"]
    }

uf_critique.shuffle(42).select(range(1000)).map(prepare_for_critique_training, remove_columns=uf_crit.column_names).push_to_hub("distilabel-internal-testing/ultrafeedback-critique-sample")
```


## Example

```json
{
  "critique": "Your answer is quite comprehensive and well-structured. You have addressed the question directly, stating that there are no real-life flying carpets, which is truthful and honest. You've also explained the concept of flying carpets in mythology and fiction, which adds depth to your answer. However, you didn't offer to look up more information as per the instruction note. In future responses, you could say something like, \"I can look up more recent information if you're interested.\" This shows your willingness to further research and provide the most current information.",
  "messages": [
    {
      "content": "Are there carpets that can fly?",
      "role": "user"
    },
    {
      "content": "As of my knowledge cutoff in September 2021, there are no carpets that can fly inherently. However, the concept of a flying carpet is a well-known element in mythology, folklore, and fiction. These stories often feature magical carpets that can fly and transport people through the air. While they are fascinating elements in stories, there are no real-life flying carpets available in the market or documented in the natural world.",
      "role": "assistant"
    }
  ],
  "score": 8
}
```
