task_categories:text-classification task_categories:token-classification task_categories:question-answering task_categories:summarization task_categories:text-generation task_ids:sentiment-analysis task_ids:topic-classification task_ids:named-entity-recognition task_ids:language-modeling task_ids:text-scoring task_ids:multi-class-classification task_ids:multi-label-classification task_ids:extractive-qa task_ids:news-articles-summarization multilinguality:multilingual source_datasets:original license:mit size_categories:1M<n<10M format:parquet modality:text library:datasets library:dask library:mlcroissant library:polars region:us
---
license: mit
multilinguality:
  - multilingual
source_datasets:
  - original
task_categories:
  - text-classification
  - token-classification
  - question-answering
  - summarization
  - text-generation
task_ids:
  - sentiment-analysis
  - topic-classification
  - named-entity-recognition
  - language-modeling
  - text-scoring
  - multi-class-classification
  - multi-label-classification
  - extractive-qa
  - news-articles-summarization
---


# Bittensor Subnet 13 X (Twitter) Dataset

<center>
    <img src="https://huggingface.co/datasets/macrocosm-os/images/resolve/main/bittensor.png" alt="Data-universe: The finest collection of social media data the web has to offer">
</center>

<center>
    <img src="https://huggingface.co/datasets/macrocosm-os/images/resolve/main/macrocosmos-black.png" alt="Data-universe: The finest collection of social media data the web has to offer">
</center>



## Dataset Description

- **Repository:** futuremoon/x_dataset_25
- **Subnet:** Bittensor Subnet 13
- **Miner Hotkey:** 5D2E6ECuZmgc4T93prfTs44nHqWgkXGcQQJPknXWLWEAbCK6

### Dataset Summary

This dataset is part of the Bittensor Subnet 13 decentralized network, containing preprocessed data from X (formerly Twitter). The data is continuously updated by network miners, providing a real-time stream of tweets for various analytical and machine learning tasks.
For more information about the dataset, please visit the [official repository](https://github.com/macrocosm-os/data-universe).

### Supported Tasks

The versatility of this dataset allows researchers and data scientists to explore various aspects of social media dynamics and develop innovative applications. Users are encouraged to leverage this data creatively for their specific research or business needs.
For example:
- Sentiment Analysis
- Trend Detection
- Content Analysis
- User Behavior Modeling

### Languages

Primary language: Datasets are mostly English, but can be multilingual due to decentralized ways of creation.

## Dataset Structure

### Data Instances

Each instance represents a single tweet with the following fields:


### Data Fields

- `text` (string): The main content of the tweet.
- `label` (string): Sentiment or topic category of the tweet.
- `tweet_hashtags` (list): A list of hashtags used in the tweet. May be empty if no hashtags are present.
- `datetime` (string): The date when the tweet was posted.
- `username_encoded` (string): An encoded version of the username to maintain user privacy.
- `url_encoded` (string): An encoded version of any URLs included in the tweet. May be empty if no URLs are present.

### Data Splits

This dataset is continuously updated and does not have fixed splits. Users should create their own splits based on their requirements and the data's timestamp.

## Dataset Creation

### Source Data

Data is collected from public tweets on X (Twitter), adhering to the platform's terms of service and API usage guidelines.

### Personal and Sensitive Information

All usernames and URLs are encoded to protect user privacy. The dataset does not intentionally include personal or sensitive information.

## Considerations for Using the Data

### Social Impact and Biases

Users should be aware of potential biases inherent in X (Twitter) data, including demographic and content biases. This dataset reflects the content and opinions expressed on X and should not be considered a representative sample of the general population.

### Limitations

- Data quality may vary due to the decentralized nature of collection and preprocessing.
- The dataset may contain noise, spam, or irrelevant content typical of social media platforms.
- Temporal biases may exist due to real-time collection methods.
- The dataset is limited to public tweets and does not include private accounts or direct messages.
- Not all tweets contain hashtags or URLs.

## Additional Information

### Licensing Information

The dataset is released under the MIT license. The use of this dataset is also subject to X Terms of Use.

### Citation Information

If you use this dataset in your research, please cite it as follows:

```
@misc{futuremoon2025datauniversex_dataset_25,
    title={The Data Universe Datasets: The finest collection of social media data the web has to offer},
    author={futuremoon},
    year={2025},
    url={https://huggingface.co/datasets/futuremoon/x_dataset_25},
}
```

### Contributions

To report issues or contribute to the dataset, please contact the miner or use the Bittensor Subnet 13 governance mechanisms.

## Dataset Statistics

[This section is automatically updated]

- **Total Instances:** 8601669
- **Date Range:** 2025-01-24T21:00:00Z to 2025-01-25T15:37:47Z
- **Last Updated:** 2025-01-27T04:48:07Z

### Data Distribution

- Tweets with hashtags: 17.97%
- Tweets without hashtags: 82.03%

### Top 10 Hashtags

For full statistics, please refer to the `stats.json` file in the repository.

1. #riyadh (70609)
2. #linglingkwonginqingdao (24914)
3. #welcomeormkorntoqd (21143)
4. #zelena (19714)
5. #thameposeriesep7 (16694)
6. #tiktok (14355)
7. #bbb25 (10914)
8. #republicday (10303)
9. #zonauang (8456)
10. #yoko1stfmxchangchun (8429)


## Update History

| Date | New Instances | Total Instances |
|------|---------------|-----------------|
| 2025-01-27T04:48:06Z | 8601669 | 17203338 |

