task_categories:text-generation task_categories:text2text-generation language:cs license:cc-by-nc-4.0 size_categories:100K<n<1M format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars region:us instruction tuning collection
---
dataset_info:
  features:
  - name: original_id
    dtype: string
  - name: conversations
    list:
    - name: content
      dtype: string
    - name: role
      dtype: string
  - name: origin
    dtype: string
  - name: instruction_type
    dtype: string
  - name: instruction_translated
    dtype: bool
  - name: output_type
    dtype: string
  - name: output_translated
    dtype: bool
  splits:
  - name: train
    num_bytes: 134452092
    num_examples: 103440
  - name: validation
    num_bytes: 5691595
    num_examples: 3419
  - name: test
    num_bytes: 5676752
    num_examples: 3509
  download_size: 89415649
  dataset_size: 145820439
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
  - split: validation
    path: data/validation-*
  - split: test
    path: data/test-*
license: cc-by-nc-4.0
task_categories:
- text-generation
- text2text-generation
language:
- cs
tags:
- instruction tuning
- collection
size_categories:
- 100K<n<1M
---
# Dataset Card for Czech Instruction Tuning Collection

<!-- Provide a quick summary of the dataset. -->

This dataset is a collection for instruction tuning of LLMs in Czech language.

## Dataset Details

### Dataset Description

<!-- Provide a longer summary of what this dataset is. -->

- **Curated by:** Artificial Intelligence Center, FEE, CTU in Prague
- **Language(s) (NLP):** Czech (cs, ces)
- **License:** [cc-by-nc-4.0](https://creativecommons.org/licenses/by-nc/4.0/deed)

### Dataset Sources

<!-- Provide the basic links for the dataset. -->
The data points in the dataset were collected from following sources:
- [MURI-IT](https://huggingface.co/datasets/akoksal/muri-it-language-split) - supernatural instructions, WikiHow, Reverse instructions
- [Bactrian-X](https://huggingface.co/datasets/MBZUAI/Bactrian-X) - translated instructions from Alpaca and Dolly and generated new outputs using GPT3.5
- [OASST-2](https://huggingface.co/datasets/OpenAssistant/oasst2)
- [ASK LIBRARY](https://huggingface.co/datasets/ctu-aic/ask_library_cs) - scraped webpage with questions and answers
- [QUESTIONS UJC CAS](https://huggingface.co/datasets/ctu-aic/questions_ujc_cas_cs) - scraped webpage with questions and answers


## Uses

<!-- Address questions around how the dataset is intended to be used. -->

### Direct Use

<!-- This section describes suitable use cases for the dataset. -->

This dataset's intended use is instruction tuning of any LLMs in order to improve the knowledge of the Czech language.

### Out-of-Scope Use

<!-- This section addresses misuse, malicious use, and uses that the dataset will not work well for. -->

This dataset should not be used for any other uses.

## Dataset Structure

<!-- This section provides a description of the dataset fields, and additional information about the dataset structure such as criteria used to create the splits, relationships between data points, etc. -->

This dataset consists of the following fields:
- **original_id** (str) - id in the dataset of origin
- **conversations** (List[Dict[str, str]]) - huggingface-style conversation format
- **origin** (str) - the original dataset from which the data point was collected
- **instruction_type** (str) - how was the instruction obtained (written by human, generated by some LLM...)
- **instruction_translated** (bool) - was the instruction in the process translated?
- **output_type** (str) - how was then output obtained (written by human, generated by some LLM...)
- **output_translated** (bool) - was the output in the process translated?

## Dataset Creation

### Curation Rationale

<!-- Motivation for the creation of this dataset. -->

The existence of this collection is motivated by non-existence of such collection, prepared for Czech instruction tuning.

### Source Data

<!-- This section describes the source data (e.g. news text and headlines, social media posts, translated sentences, ...). -->
For the original data sources please refer to the original datasets.

## Bias, Risks, and Limitations

<!-- This section is meant to convey both technical and sociotechnical limitations. -->

This collection contains the biases, risks and limitations of the underlying datasets.

### Recommendations

<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->

Users should be made aware of the risks, biases and limitations of the dataset.

## Citation [TBD]

<!-- If there is a paper or blog post introducing the dataset, the APA and Bibtex information for that should go in this section. -->

## Dataset Card Contact

If you have any questions or issues, please use the dataset discussion here on Hugging Face.