File size: 321 Bytes
c886304
 
a780bbc
4a52c20
 
 
c886304
 
4a52c20
c886304
4a52c20
c886304
4a52c20
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
---
library_name: transformers
base_model: openai-community/gpt2
license: apache-2.0
language:
- en
---

# GPT-2, But With Mistral's Tokenizer

Finally, an answer to one of the biggest open questions in NLP:

**Q:** Wouldn't it be messed up if someone grafted the tokenizer from Mistral 7B onto GPT-2?<br />
**A:** Ya :)