language:en license:mit size_categories:100K<n<1M format:csv modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
language:
- en
license: mit
---

## Dataset Card for IMRAD Classification Dataset (100k Rows)

**Dataset Name:** IMRAD Classification Dataset (100k Rows)

**Dataset Description:**

This dataset contains approximately 100,000 sentences extracted from scientific research papers and labeled according to their corresponding IMRAD (Introduction, Methods, Results, and Discussion) sections. The data was initially sourced from the `unarXive_imrad_clf` dataset on Hugging Face and expanded using data augmentation techniques. This dataset is ideal for training and evaluating machine learning models for IMRAD classification, a crucial task in automating scientific text analysis. 

**Dataset Structure:**

- **Format:** CSV
- **Columns:**
    - `text`: The sentence extracted from the research paper.
    - `label`: The corresponding IMRAD section label:
        - `Introduction`: 0
        - `Discussion`: 1
        - `Methodology`: 2
        - `Results`: 3
        - `Related Work`: 4

**Dataset Creation:**

- **Source Data:** `unarXive_imrad_clf` dataset ([https://huggingface.co/datasets/saier/unarXive_imrad_clf])
- **Data Augmentation:**  Synthetic data was generated using a large language model (e.g., 'gemini-1.5-flash') to increase the size and diversity of the dataset.

**Dataset Statistics:**

- **Number of Sentences:** 100,000 (approximate)
- **Label Distribution:**
    - Introduction: [15862]
    - Discussion: [26001]
    - Methodology: [15148]
    - Results: [24247]
    - Related Work: [19298]

**Potential Uses:**

- Training and evaluating machine learning models for IMRAD section classification.
- Developing automated tools for scientific text analysis, such as information retrieval, summarization, and content recommendation.
- Research on natural language processing (NLP) techniques for scientific text.

**License:** [MIT, CC BY-SA 4.0]

**Citation Information:**

```
[Sid Ali Assoul]. (2024). IMRAD Classification Dataset (100k Rows). Hugging Face Dataset. 
[https://huggingface.co/datasets/stormsidali2001/IMRAD-sections-clf-gemini-augmented](https://huggingface.co/datasets/stormsidali2001/IMRAD-sections-clf-gemini-augmented) 
```

**Contact:**

[Sid Ali Assoul] - [assoulsidali.contact@gmail.com]

