|
|
--- |
|
|
license: mit |
|
|
datasets: |
|
|
- rajpurkar/squad |
|
|
base_model: |
|
|
- google-t5/t5-base |
|
|
pipeline_tag: question-answering |
|
|
--- |
|
|
# T5 Question Generator |
|
|
|
|
|
This repository contains a fine-tuned T5 model for question generation. The model takes an answer and a context paragraph as input and generates a relevant question. |
|
|
|
|
|
## Model Description |
|
|
|
|
|
This model is a fine-tuned version of the T5 (Text-to-Text Transfer Transformer) model. It has been trained on a dataset of 60000 non-technical questions from SQuAD and 10000 technical questions. The model is conditioned on the answer and the context to generate a question for which the given answer is the correct response. |
|
|
|
|
|
## How to Use |
|
|
|
|
|
You can use this model with the `transformers` library in Python. First, make sure you have the library installed: |
|
|
|
|
|
```bash |
|
|
pip install transformers |
|
|
pip install sentencepiece |
|
|
``` |
|
|
|
|
|
Then, you can use the following code to load the model and generate a question: |
|
|
|
|
|
```python |
|
|
from transformers import T5ForConditionalGeneration, T5Tokenizer |
|
|
|
|
|
model_name = "Ayush472/T5QuestionGenerator" |
|
|
model = T5ForConditionalGeneration.from_pretrained(model_name) |
|
|
tokenizer = T5Tokenizer.from_pretrained(model_name) |
|
|
|
|
|
context = "The Eiffel Tower is a wrought-iron lattice tower on the Champ de Mars in Paris, France. It is named after the engineer Gustave Eiffel, whose company designed and built the tower." |
|
|
answer = "Gustave Eiffel" |
|
|
|
|
|
input_text = f"answer: {answer} context: {context}" |
|
|
input_ids = tokenizer.encode(input_text, return_tensors="pt") |
|
|
|
|
|
output = model.generate(input_ids, max_length=100) |
|
|
generated_question = tokenizer.decode(output[0], skip_special_tokens=True) |
|
|
|
|
|
print(generated_question) |
|
|
# Expected output: Who designed the Eiffel Tower? |
|
|
``` |
|
|
|
|
|
## Model Architecture |
|
|
|
|
|
The model is based on the T5 architecture. T5 is an encoder-decoder model that is pre-trained on a large corpus of text. It is trained using a text-to-text approach, which means that all NLP tasks are cast as a text-to-text problem. |
|
|
|
|
|
## About |
|
|
|
|
|
This model was fine-tuned by Ayush. For any questions or issues, please open an issue in this repository. |
