add tokenizers to reqs
Browse files- requirements.txt +2 -1
requirements.txt
CHANGED
@@ -1 +1,2 @@
|
|
1 |
-
transformers==2.9.1
|
|
|
|
1 |
+
transformers==2.9.1
|
2 |
+
tokenizers==0.7.0
|