task_categories:text-classification task_categories:text-generation language:fa license:gpl-3.0 size_categories:n<1K format:parquet modality:image modality:tabular modality:text library:datasets library:pandas library:mlcroissant library:polars region:us
---
language:
- fa
license: gpl-3.0
task_categories:
- text-classification
- text-generation
size_categories:
- 100K<n<1Mh
dataset_info:
  features:
  - name: tweet_id
    dtype: float64
  - name: user_id
    dtype: float64
  - name: username
    dtype: string
  - name: name
    dtype: string
  - name: first_name
    dtype: string
  - name: last_name
    dtype: string
  - name: full_text
    dtype: string
  - name: view_count
    dtype: float64
  - name: bookmark_count
    dtype: float64
  - name: favorite_count
    dtype: float64
  - name: reply_count
    dtype: float64
  - name: retweet_count
    dtype: float64
  - name: quote_count
    dtype: float64
  - name: bookmarked
    dtype: bool
  - name: favorited
    dtype: bool
  - name: retweeted
    dtype: bool
  - name: created_at
    dtype: string
  - name: user_mentions
    dtype: float64
  - name: location
    dtype: string
  - name: bio
    dtype: string
  - name: website
    dtype: string
  - name: websites
    dtype: string
  - name: can_dm
    dtype: bool
  - name: can_media_tag
    dtype: bool
  - name: is_quote_status
    dtype: bool
  - name: lang
    dtype: string
  - name: followers_count
    dtype: float64
  - name: following_count
    dtype: float64
  - name: media_count
    dtype: float64
  - name: statuses_count
    dtype: float64
  - name: favourites_count
    dtype: float64
  - name: listed_count
    dtype: float64
  - name: fast_followers_count
    dtype: float64
  - name: normal_followers_count
    dtype: float64
  - name: followed_by
    dtype: bool
  - name: following
    dtype: bool
  - name: profile_banner_url
    dtype: string
  - name: profile_url
    dtype: string
  - name: avatar_url
    dtype: string
  - name: verified
    dtype: bool
  - name: is_blue_verified
    dtype: bool
  - name: user_created_at
    dtype: string
  - name: '0'
    dtype: float64
  - name: '1'
    dtype: float64
  - name: '2'
    dtype: string
  - name: '3'
    dtype: string
  - name: '4'
    dtype: string
  - name: '5'
    dtype: string
  - name: '6'
    dtype: string
  - name: '7'
    dtype: float64
  - name: '8'
    dtype: float64
  - name: '9'
    dtype: float64
  - name: '10'
    dtype: float64
  - name: '11'
    dtype: float64
  - name: '12'
    dtype: float64
  - name: '13'
    dtype: bool
  - name: '14'
    dtype: bool
  - name: '15'
    dtype: bool
  - name: '16'
    dtype: string
  - name: '17'
    dtype: string
  - name: '18'
    dtype: string
  - name: '19'
    dtype: string
  - name: '20'
    dtype: string
  - name: '21'
    dtype: string
  - name: '22'
    dtype: bool
  - name: '23'
    dtype: bool
  - name: '24'
    dtype: bool
  - name: '25'
    dtype: string
  - name: '26'
    dtype: float64
  - name: '27'
    dtype: float64
  - name: '28'
    dtype: float64
  - name: '29'
    dtype: float64
  - name: '30'
    dtype: float64
  - name: '31'
    dtype: float64
  - name: '32'
    dtype: float64
  - name: '33'
    dtype: float64
  - name: '34'
    dtype: bool
  - name: '35'
    dtype: bool
  - name: '36'
    dtype: string
  - name: '37'
    dtype: string
  - name: '38'
    dtype: string
  - name: '39'
    dtype: bool
  - name: '40'
    dtype: bool
  - name: '41'
    dtype: string
  splits:
  - name: train
    num_bytes: 914562
    num_examples: 900
  download_size: 355105
  dataset_size: 914562
configs:
- config_name: default
  data_files:
  - split: train
    path: data/train-*
---

## Dataset Description

This dataset contains high-engagement Persian language tweets collected from Twitter/X during 2024. The dataset includes comprehensive tweet metadata and user information, making it valuable for various NLP tasks, social media analysis, and Persian language processing research.

### Dataset Details

- **Size**: 900 tweets
- **Language**: Persian (Farsi)
- **Time Period**: 2024
- **Collection Criteria**:
  - Language: Persian 
  - Minimum Likes: 1,000+ 
  - Date Range: January 1, 2024 - January 1, 2025
  - Excludes: Media posts and tweets with links 

## Features

The dataset contains 84 columns with rich metadata about tweets and their authors:

### Tweet Information
- `tweet_id`: Unique identifier for the tweet
- `full_text`: The complete text content of the tweet
- `created_at`: Tweet creation timestamp
- `lang`: Language of the tweet
- `is_quote_status`: Whether the tweet is a quote tweet

### Engagement Metrics
- `view_count`: Number of views
- `bookmark_count`: Number of bookmarks
- `favorite_count`: Number of likes
- `reply_count`: Number of replies
- `retweet_count`: Number of retweets
- `quote_count`: Number of quote tweets

### User Information
- `user_id`: Unique identifier for the user
- `username`: User's handle
- `name`: User's display name
- `first_name`: User's first name
- `last_name`: User's last name
- `bio`: User's biography
- `location`: User's location
- `website`: User's website
- `verified`: Verification status
- `is_blue_verified`: Twitter Blue verification status
- `user_created_at`: Account creation date

### User Metrics
- `followers_count`: Number of followers
- `following_count`: Number of accounts followed
- `media_count`: Number of media posts
- `statuses_count`: Number of tweets
- `favourites_count`: Number of likes given
- `listed_count`: Number of lists containing the user
- `fast_followers_count`: Number of fast followers
- `normal_followers_count`: Number of regular followers

## Usage

You can load this dataset using the Hugging Face datasets library:

```python
from datasets import load_dataset

dataset = load_dataset("mshojaei77/persian-tweets-2024")
```
To work with only the text content of the tweets:

```python
# Get just the text column
texts = dataset["train"]["full_text"]

# Example: Process first 5 tweets
for text in texts[:5]:
    print(text)
```

## Data Statistics

- Number of rows: 900
- Number of columns: 84
- Data format: CSV

## Potential Applications

1. Persian Natural Language Processing
2. Sentiment Analysis
3. Social Media Trend Analysis
4. User Behavior Analysis
5. Engagement Pattern Studies
6. Persian Text Classification
7. Social Network Analysis

## Citation

If you use this dataset in your research, please cite:

```bibtex
@dataset{persian_tweets_2024,
  author       = {Mohammad Shojaei},
  title        = {Persian Tweets 2024 Dataset},
  year         = {2024},
  publisher    = {Hugging Face},
  howpublished = {\url{https://huggingface.co/datasets/mshojaei77/persian-tweets-2024}}
}
```

## License

This dataset is released under the GNU General Public License v3.0 (GPL-3.0). This license ensures that:

- You are free to use, modify, and distribute this dataset
- Any derivative works must also be distributed under the GPL-3.0
- The complete license text must be included with any distribution
- Changes made to the original dataset must be documented

For full license details, see [GPL-3.0](https://www.gnu.org/licenses/gpl-3.0.en.html)

## Contact

For questions or issues regarding the dataset, please open an issue on the [Hugging Face dataset repository](https://huggingface.co/datasets/mshojaei77/persian-tweets-2024).