task_categories:text-classification task_categories:summarization task_categories:feature-extraction task_categories:text-generation language:pt license:cc0-1.0 size_categories:100K<n<1M format:parquet modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
license: cc0-1.0
task_categories:
- text-classification
- summarization
- feature-extraction
- text-generation
language:
- pt
pretty_name: News of the Brazilian Newspaper
size_categories:
- 100K<n<1M
---

# News of the Brazilian Newspaper

This repository contains a comprehensive dataset of news articles from a Brazilian newspaper, Folha de São Paulo (http://www.folha.uol.com.br/). The dataset includes 167,053 examples of news articles, comprising headlines, URLs of articles, complete articles, and their respective categories. 

## Dataset Creation

The headlines were initially gathered from Inshorts and were then used to scrape the complete news articles from Folha de São Paulo. The dataset covers a time period ranging from January 2015 to September 2017, providing a wealth of information for researchers, analysts, and developers interested in analyzing and understanding trends in Brazilian news over this time period.

## Data Format

The dataset is provided in a single CSV file, with each row representing a unique news article. The columns of the dataset include the following:

- **Title:** The title of the news article.
- **Text:** The complete text of the news article.
- **Date:** The publish date
- **Category:** The category of the news article.
- **Subcategory:** The subcategory of the news article.
- **Link:** The URL of the news article.

## Usage

This dataset can be used for a variety of applications, such as natural language processing, sentiment analysis, and trend analysis of Brazilian news over the given time period. We hope that this dataset will be a valuable resource for researchers, analysts, and developers who are interested in gaining insights into the news landscape of Brazil.

## Citation

If you use this dataset in your work, please cite the original author Marlesson Santana ( [email](marlessonsa@gmail.com) | [github](https://github.com/marlesson) ):

* https://www.kaggle.com/datasets/marlesson/news-of-the-site-folhauol
* https://github.com/marlesson/scrapy_folha

## License

This dataset is released under the [CC0: Public Domain](https://creativecommons.org/share-your-work/public-domain/cc0/) license.

## Contributing

We welcome contributions to this dataset! If you have additional data to contribute or if you find any issues with the dataset, please create a pull request or submit an issue.