task_categories:text-classification task_categories:other language:en license:mit size_categories:n<1K format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
language: en
license: mit
pretty_name: bigbio_pubmed_qa
size_categories:
- n<1K
task_categories:
- text-classification
- other
task_ids:
- text-classification
- medical-diagnosis
---

# bigbio_pubmed_qa

## Dataset Description

This dataset contains evaluation results for bigbio_pubmed_qa with label column N_A, with various model performance metrics and samples.

### Dataset Summary

The dataset contains original samples from the evaluation process, along with metadata like model names, input columns, and scores. This helps with understanding model performance across different tasks and datasets.

### Features

- id: Unique identifier for the sample.
- user: User query/content.
- assistant: Assistant response.
- target: The expected output.
- score: Score of the assistant's response.
- explanation: Explanation of the score.
- input_column: Input column used in the original dataset.
- label_column: Label column in the original dataset.
- model_name: Name of the model used in evaluation.
- dataset_name: Name of the original dataset used.

### Usage

This dataset can be used for:
- Evaluating model robustness across various tasks.
- Assessing potential biases in model responses.
- Model performance monitoring and analysis.

### Citation

If you use this dataset, please cite:
@misc{eval_dataset_bigbio_pubmed_qa, title={Evaluation Dataset for bigbio_pubmed_qa}, author={Gallifant, Jack}, year={2024}, publisher={Hugging Face} }
