size_categories:100K<n<1M format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
dataset_info:
  features:
  - name: prompt
    dtype: string
  - name: response
    dtype: string
  - name: score
    dtype: float64
  splits:
  - name: train_weighted_sft
    num_bytes: 193324429
    num_examples: 122270
  download_size: 79766423
  dataset_size: 193324429
configs:
- config_name: default
  data_files:
  - split: train_weighted_sft
    path: data/train_weighted_sft-*
---
# allenai/open_instruct: Rejection Sampling Dataset

See https://github.com/allenai/open-instruct/blob/main/docs/algorithms/rejection_sampling.md for more detail

## Configs

```
args:
{'add_timestamp': False,
 'hf_entity': 'dogtooth',
 'hf_repo_id': 'uf_Llama-3.1-Tulu-3-8B-SFT_5_Skywork-Reward-Gemma-2-27B-v0.2',
 'hf_repo_id_scores': 'rejection_sampling_scores',
 'include_reference_completion_for_rejection_sampling': True,
 'input_filename': '/scratch/dkhasha1/tli104/scaling_laws/uf_Llama-3.1-Tulu-3-8B-SFT_5.jsonl',
 'llm_judge': False,
 'max_forward_batch_size': 16,
 'mode': 'judgement',
 'model_names_or_paths': ['Skywork/Skywork-Reward-Gemma-2-27B-v0.2'],
 'num_completions': 5,
 'num_gpus': 6,
 'push_to_hub': True,
 'save_filename': '/scratch/dkhasha1/tli104/scaling_laws/uf_Llama-3.1-Tulu-3-8B-SFT_5_Skywork-Reward-Gemma-2-27B-v0.2.jsonl',
 'save_filename_scores': '/scratch/dkhasha1/tli104/scaling_laws/uf_Llama-3.1-Tulu-3-8B-SFT_5_Skywork-Reward-Gemma-2-27B-v0.2_scores.jsonl',
 'skill': 'chat'}
```

## Additional Information

1. Command used to run `python open_instruct/rejection_sampling/rejection_sampling.py --input_filename /scratch/dkhasha1/tli104/scaling_laws/uf_Llama-3.1-Tulu-3-8B-SFT_5.jsonl --model_names_or_paths Skywork/Skywork-Reward-Gemma-2-27B-v0.2 --save_filename /scratch/dkhasha1/tli104/scaling_laws/uf_Llama-3.1-Tulu-3-8B-SFT_5_Skywork-Reward-Gemma-2-27B-v0.2.jsonl --save_filename_scores /scratch/dkhasha1/tli104/scaling_laws/uf_Llama-3.1-Tulu-3-8B-SFT_5_Skywork-Reward-Gemma-2-27B-v0.2_scores.jsonl --max_forward_batch_size 16 --num_completions 5 --num_gpu 6 --push_to_hub --add_timestamp false --hf_repo_id uf_Llama-3.1-Tulu-3-8B-SFT_5_Skywork-Reward-Gemma-2-27B-v0.2`
