language:hi language:en size_categories:1K<n<10K format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
language:
- hi
- en
dataset_info:
  features:
  - name: prompt
    dtype: string
  - name: rejected
    dtype: string
  - name: chosen
    dtype: string
  splits:
  - name: train
    num_bytes: 6138202
    num_examples: 9231
  download_size: 2413632
  dataset_size: 6138202
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
---

Overview:

- Dataset Name: Gemma2_DPO_EnToHindi
- Dataset Size: 9.23K sentences
- Source: Curated list of English sentences from `https://huggingface.co/datasets/Aarif1430/english-to-hindi` and the translations generated using Gemma2. When asked to translated a short text from English to Hindi, the response given by Gemma2 2B are in the `rejected` column while the `accepted` column contains responses by Gemma2 9B.
- Use Case: Preference alignment using DPO or ORPO for machine translation models, specifically English-to-Hindi translation.


- Language Pair: English to Hindi
- Text Type: General sentences, covering a wide range of topics.
- Text Length: Varied lengths of sentences.