size_categories:n<1K format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
dataset_info:
  features:
  - name: prompt
    dtype: string
  - name: results
    sequence: float64
  - name: text
    dtype: string
  splits:
  - name: train
    num_bytes: 879844
    num_examples: 500
  download_size: 536872
  dataset_size: 879844
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
---
# rewardbench_eval_0328290924: RewardBench CLI Eval. Outputs

See https://github.com/allenai/rewardbench for more details

## Configs
```
args: {'batch_size': 128,
 'chat_template': 'oasst_pythia',
 'dataset': 'HuggingFaceH4/no_robots',
 'debug': False,
 'force_truncation': False,
 'hf_entity': 'natolambert',
 'hf_name': 'rewardbench_eval_0328290924',
 'load_json': False,
 'max_length': 512,
 'model': 'vwxyzjn/reward_modeling__EleutherAI_pythia-14m',
 'not_quantized': False,
 'output_dir': 'results/',
 'prioritize_scoring': False,
 'push_results_to_hub': True,
 'ref_model': None,
 'revision': None,
 'save_all': False,
 'split': 'test',
 'tokenizer': 'EleutherAI/pythia-14m',
 'trust_remote_code': False,
 'upload_model_metadata_to_hf': False,
 'wandb_run': None}
```

## Additional Information

1. Command used to run `python /home/nathanl/.local/bin/rewardbench --model vwxyzjn/reward_modeling__EleutherAI_pythia-14m --dataset HuggingFaceH4/no_robots --split test --batch_size 128 --tokenizer=EleutherAI/pythia-14m --push_results_to_hub --chat_template oasst_pythia`
