task_categories:translation language:ja license:apache-2.0 size_categories:1K<n<10K format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
license: apache-2.0
dataset_info:
  features:
  - name: id
    dtype: int64
  - name: messages
    list:
    - name: content
      dtype: string
    - name: role
      dtype: string
  - name: think
    dtype: string
  splits:
  - name: train
    num_bytes: 50527990
    num_examples: 6537
  - name: test
    num_bytes: 7703749
    num_examples: 995
  download_size: 26314138
  dataset_size: 58231739
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
  - split: test
    path: data/test-*
task_categories:
- translation
language:
- ja
size_categories:
- 1K<n<10K
---

# Japanese Ultrachat 6.6k

[Japanese Ultrachat 6.6k](https://huggingface.co/datasets/EQUES/japanese_ultrachat_6.6k) is the Japanese-translated version of the subset of [ultrachat_200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k) using machine translation.

[Japanese Ultrachat 6.6k](https://huggingface.co/datasets/EQUES/japanese_ultrachat_6.6k)は[ultrachat_200k](https://huggingface.co/datasets/HuggingFaceH4/ultrachat_200k)の一部分を機械翻訳により和訳したデータセットです. 

## The number of data
- Train split : 6537
- Test split : 995

To be updated.

## Notes
- Beware that the columns 'id' corresponds to the original dataset. Some are missing for now. 


## Method

We used cyberagent/DeepSeek-R1-Distill-Qwen-32B-Japanese. Since we instructed the model to translate the entire JSON, there were some errors in the output format. Therefore, we made corrections manually and with the help of json-repair. We also collected the parts surrounded by the "<think>" tokens that appeared in the output during the translation.

[cyberagent/DeepSeek-R1-Distill-Qwen-32B-Japanese](https://huggingface.co/cyberagent/DeepSeek-R1-Distill-Qwen-32B-Japanese)を用いました。JSON全体を翻訳するよう指示を与えたため, 出力フォーマットの誤りが散見されました。そのため, [json-repair](https://pypi.org/project/json-repair/)や手動によって修正を施しました. 
翻訳に際し出力された「思考」= <think>トークンで挟まれた部分も併せて収集しました.

## References
- [hpprc/ja-en-r1-distill-qwen](https://huggingface.co/datasets/hpprc/ja-en-r1-distill-qwen)


## Acknowledgement