size_categories:1K<n<10K format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
dataset_info:
  features:
  - name: text
    dtype: string
  - name: annotations
    list:
    - name: end
      dtype: int64
    - name: start
      dtype: int64
  splits:
  - name: train
    num_bytes: 6143637
    num_examples: 2635
  - name: validation
    num_bytes: 2062173
    num_examples: 878
  - name: test
    num_bytes: 2043746
    num_examples: 879
  download_size: 4696356
  dataset_size: 10249556
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
  - split: validation
    path: data/validation-*
  - split: test
    path: data/test-*
---

# MedMentions-st21pv

This dataset contains the parsed data from the MedMentions dataset (st21pv version).

### Dataset Description

The dataset provides directly the train / validation / test splits of the MedMentions dataset, merging together the titles and abstracts to a single `text` string.
The annotations only consist of the `start` and `end` token indices, marking the beginning and end of each entity. Entity types are not distinguished.

- **License:** CC0

### Dataset Sources

- **Repository:** https://github.com/chanzuckerberg/MedMentions
- **Huggingface Dataset:** https://huggingface.co/datasets/bigbio/medmentions
- **Paper:** Sunil Mohan and Donghui Li. 2019. MedMentions: A Large Biomedical Corpus Annotated with UMLS Concepts. In Proceedings of the 2019 Conference on Automated Knowledge Base Construction (AKBC 2019). Amherst, Massachusetts, USA. May 2019. [Preprint]

