language:en license:apache-2.0 region:us historic
---
dataset_info:
- config_name: results.zip
- config_name: enron_labeled.zip
license: apache-2.0
language:
- en
tags:
- historic
---

# Enron Email Dataset

## Description
The Enron Email Dataset is a collection of emails from the Enron Corporation, which was one of the largest energy companies in the United States. This dataset is widely used for various natural language processing (NLP) tasks, such as email classification, sentiment analysis, and named entity recognition.

## Processed Dataset
This file could not be uploaded due to its size 500MB
The processed dataset, named enron_processed.zip, is a cleaned and deduplicated version of the original Enron Email Dataset. This dataset has undergone preprocessing steps to remove duplicate emails and clean the data for further analysis. It is provided in a compressed ZIP format for convenience.

The processed dataset has been reduced to a CSV that can be loaded in python pandas. However, it contains a reduced number of emails compared to the original dataset due to the removal of duplicates.

To access the processed dataset, you can download the enron_processed.zip file from the source mentioned above. Once downloaded, you can extract the contents of the ZIP file to a desired location on your system.

Please note that the processed dataset is intended for analysis purposes and may not include all the emails from the original dataset.

## Results
The results.zip file contains the analysis results for the Enron Email Dataset. It includes key topics related to the fraud and an additional 1000 randomly selected records. The analysis was performed using a vector database and four language models (LLMs) in few-shot mode.

Each record in the results includes a fraud content score ranging from 0 to 10, indicating the likelihood of fraudulent content in the email. The higher the score, the higher the probability of fraud.

To access the results, you can download the results.zip file from the source mentioned above. Once downloaded, you can extract the contents of the ZIP file to a desired location on your system.

Please note that the results are based on the analysis performed using the specified methods and may not capture all instances of fraud in the dataset.


## Labeled Dataset
The labeled dataset, named enron_labeled.zip, is a version of the Enron Email Dataset that has been manually labeled by a student to detect instances of fraud. This dataset includes additional annotations indicating whether each email is classified as fraudulent or not.

The labeled dataset is provided in a compressed ZIP format for convenience. To access the labeled dataset, you can download the enron_labeled.zip file from the source mentioned above. Once downloaded, you can extract the contents of the ZIP file to a desired location on your system.

Please note that the labeling process is subjective and may not capture all instances of fraud accurately. The labeled dataset is intended for research and analysis purposes, and it is recommended to validate the results with other methods or datasets.

## Dataset Information
- **Dataset Name**: Enron Email Dataset
- **Dataset Size**: 3GB
- **Number of Emails**: The number of emails in the dataset is 250K reduced from the original 500,000
- **Language**: English
- **License**: Apache 2.0
- **Dataset Source**: Enron Email Dataset on Kaggle

license: apache-2.0
language:
  - en
tags:
  - synthetic

## The few shot prompt used was 
"""You are a finance specialist does the following email try to hide loses: These are the enron emails. They used SBE with the name of Raptors to hide loses using mark to market accounting so revenue was realized as profit. Do any of the following emails indicate an abuse of the accounting rules. Please respond to each email with a number on the scale of 0 to 10. where 0 is no abuse while 10 is outright fraud.
Example of such a email:
<Email Start>I'm concerned that the mark to market accounting practices that we placed the loses in the Raptor SBE could be viewed as Fraud
<Email End>
<Score>10<End Score>
<Email Start>Accounting practices  did not report losses so revenue was realized as profit hidding true financial position
<Email End>
<Score>10<End Score>                 
<Email Start>Accounting practices  we placed on the books are 100% legal and trasparent
<Email End>
<Score>0<End Score>
<Email Start>News about the accounting practices at Enron discuss devrivatives and mark to market accounting
<Email End>
<Score>0<End Score>                     
Please score the following email:
<Email Start>
{email}
<Email End>
"""