license:apache-2.0 size_categories:10K<n<100K format:json modality:text library:datasets library:pandas library:mlcroissant library:polars doi:10.57967/hf/1331 region:us
---
license: apache-2.0
---
# Dataset Info C++ + Natural Description -> Doxygen Documentation

This dataset was created for my bachelors thesis investigating how LLMs can be fine-tuned to generate doxygen documentation. It was created by using the “Source code analysis dataset” 
by Gelman, Banjo Obayomi, Jessica Moore und David Slater (doi: 10.1016/j.dib.2019.104712).

The following SQL-Statement was used to grab raw data from the dataset:
```
  SELECT * FROM all_data 
  WHERE LENGTH(comment) < 350 AND LENGTH(comment) > 10  AND LENGTH(code) > 100 AND LENGTH(code) < 800  
  AND code NOT LIKE '%//%' AND code NOT LIKE '%/*%' AND code NOT LIKE '%*/%'
  AND filename LIKE '%.cpp%'
  LIMIT 12000 
```

After selecting the Data Code LLaMa Instruct 34B is tasked to combine the human-written description of the functionality with the function code into a Doxygen-Comment. Any results which included the sample doxygen string or no doxygen string at all where filtered from the set. 
