language:en license:mit size_categories:1K<n<10K format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
license: mit
dataset_info:
  features:
  - name: text
    dtype: string
  - name: code
    dtype: string
  splits:
  - name: pandas_documentation_examples
    num_bytes: 560942
    num_examples: 2130
  - name: DS1000
    num_bytes: 77538
    num_examples: 388
  - name: OSSInstruct
    num_bytes: 2303057
    num_examples: 2692
  download_size: 1285889
  dataset_size: 2941537
configs:
- config_name: default
  data_files:
  - split: pandas_documentation_examples
    path: data/pandas_documentation_examples-*
  - split: DS1000
    path: data/DS1000-*
  - split: OSSInstruct
    path: data/OSSInstruct-*
language:
- en
pretty_name: p
---
3 datasets:
* Web scraped pandas documentation, where each instance is a code example generated by gpt-3.5-turbo based on the examples from documentation. Each instance is one pandas method, type, class, etc.
* DS1000 is DS-1000 samples that contain pandas code
* OSS-Instruct is [Magicoder's dataset](https://huggingface.co/datasets/ise-uiuc/Magicoder-OSS-Instruct-75K) where pandas occur.

Filtering and scraping is available [here](https://github.com/poludmik/AgentToBeNamed).