MCplayer
/

XY_Tokenizer

Model card Files Files and versions

2.14 GB

1 contributor

History: 7 commits

MCplayer's picture

add middle overlap type

f038693 5 months ago

examples
XY_Tokenizer AutoModel version support 6 months ago
.gitattributes

1.56 kB

XY_Tokenizer AutoModel version support 6 months ago
README.md

3.29 kB

pre-release version 6 months ago
config.json

3.31 kB

pre-release version 6 months ago
configuration_xy_tokenizer.py

3.49 kB

XY_Tokenizer AutoModel version support 6 months ago
feature_extraction_xy_tokenizer.py

10.5 kB

add middle overlap type 5 months ago
modeling_xy_tokenizer.py

61.5 kB

add middle overlap type 5 months ago
preprocessor_config.json

293 Bytes

add middle overlap type 5 months ago
pytorch_model.bin
Detected Pickle imports (4)
- "torch.BoolStorage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.FloatStorage"
What is a pickle import?
2.14 GB
xet

XY_Tokenizer AutoModel version support 6 months ago