task_categories:question-answering task_categories:text-generation language:sv license:llama3.3 size_categories:100K<n<1M format:parquet modality:tabular modality:text library:datasets library:dask library:mlcroissant library:polars region:us
---
language: sv
dataset_info:
  features:
  - name: conversation_id
    dtype: string
  - name: instruction
    dtype: string
  - name: response
    dtype: string
  - name: conversations
    list:
    - name: from
      dtype: string
    - name: value
      dtype: string
  - name: gen_input_configs
    struct:
    - name: temperature
      dtype: float64
    - name: top_p
      dtype: float64
    - name: input_generator
      dtype: string
    - name: seed
      dtype: 'null'
    - name: pre_query_template
      dtype: string
  - name: intent
    dtype: string
  - name: knowledge
    dtype: string
  - name: difficulty
    dtype: string
  - name: difficulty_generator
    dtype: string
  - name: input_quality
    dtype: string
  - name: quality_explanation
    dtype: string
  - name: quality_generator
    dtype: string
  - name: task_category
    dtype: string
  - name: other_task_category
    sequence: string
  - name: task_category_generator
    dtype: string
  - name: llama_guard_2
    dtype: string
  - name: instruct_reward
    dtype: float64
  - name: reward_model
    dtype: string
  - name: language
    dtype: string
  - name: correction
    sequence: string
  - name: has_changes
    dtype: string
  - name: min_neighbor_distance
    dtype: float64
  - name: repeat_count
    dtype: int64
  - name: min_similar_conversation_id
    dtype: string
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
task_categories:
- question-answering
- text-generation
license: llama3.3
---





## Short description
Roughly 260k filtered instruction : response pairs in Swedish, filtered from roughtly 650k. 
Contains "normal" QA along with math and coding QA and multiple choice questions and answers.

Filtering, removed: 
Deduplications
Instructions scored less than good or excellent
Responses scored less than -10 from ArmoRM-Llama3-8B-v0.1
Instructions and responses less than 10 in length or more than 2048

### Usage

```python
from datasets import load_dataset
dataset = load_dataset("nicher92/magpie_llama70b_260k_filtered_swedish")
```

### Dataset distributions

Task distribution:
![input_tasks.png](https://cdn-uploads.huggingface.co/production/uploads/63a06a23f3334a6553d9d5d1/-U5NQNDGEZ_L4ESDbR7kv.png)

Length distribution:
![length_dist.png](https://cdn-uploads.huggingface.co/production/uploads/63a06a23f3334a6553d9d5d1/P9ThzQa_ZLdTVVea3uDuR.png)

Question quality distribution:
![input_quality_dist.png](https://cdn-uploads.huggingface.co/production/uploads/63a06a23f3334a6553d9d5d1/QmKiLtSxtzij-VEhMz36a.png)

Hazard distribution according to Llama-Guard-2-8B - most hits seem to be false positives:
![hazard_dist.png](https://cdn-uploads.huggingface.co/production/uploads/63a06a23f3334a6553d9d5d1/9eT7zAVdHGiUC2KfUrt0b.png)