File size: 1,016 Bytes
eddafbd 967ef6b |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 |
---
license: apache-2.0
datasets:
- knkarthick/samsum
language:
- en
metrics:
- rouge
base_model:
- google-t5/t5-base
pipeline_tag: summarization
tags:
- generated_from_text
---
## Summarizer
This model is a fine-tuned version of google-t5/t5-base on a knkarthick/samsum dataset. It achieves the following results on the evaluation set:
• ROUGE-1: 51.41
• ROUGE-2: 26.72
• ROUGE-L: 42.15
• ROUGE-Lsum: 42.17
## Training hyperparameters
The following hyperparameters were used during training:
• learning_rate: 5e-5
• train_batch_size: 2
• gradient_accumulation_steps=2
• seed: 42
• weight_decay=0.01
• lr_scheduler_type: linear
• warmup_ratio=0.1
• num_epochs: 3
## Training results
| Training Loss | Epoch | Step |
| ------------- | ----- | ----- |
| 1.491800 | 1 | 3650 |
| 1.404900 | 2 | 7350 |
| 1.322800 | 3 | 11000 |
## Framework versions
• transformers: 4.56.0
• pytorch: 2.0.1+cu118
• datasets: 2.14.4
• tokenizers: 0.13.3
|