metadata
license: apache-2.0
datasets:
- knkarthick/samsum
language:
- en
metrics:
- rouge
base_model:
- google-t5/t5-base
pipeline_tag: summarization
tags:
- generated_from_text
Summarizer
This model is a fine-tuned version of google-t5/t5-base on a knkarthick/samsum dataset. It achieves the following results on the evaluation set:
• ROUGE-1: 51.41
• ROUGE-2: 26.72
• ROUGE-L: 42.15
• ROUGE-Lsum: 42.17
Training hyperparameters
The following hyperparameters were used during training:
• learning_rate: 5e-5
• train_batch_size: 2
• gradient_accumulation_steps=2
• seed: 42
• weight_decay=0.01
• lr_scheduler_type: linear
• warmup_ratio=0.1
• num_epochs: 3
Training results
| Training Loss | Epoch | Step |
|---|---|---|
| 1.491800 | 1 | 3650 |
| 1.404900 | 2 | 7350 |
| 1.322800 | 3 | 11000 |
Framework versions
• transformers: 4.56.0
• pytorch: 2.0.1+cu118
• datasets: 2.14.4
• tokenizers: 0.13.3