[tokenizer] AlternateTokenizer - a minpeter Collection

minpeter 's Collections

[Dataset] unified standard function calling

[Models] Small size high performance BFCL instruction

[Model] BFCL Top Rank Model

[Model] Latest Llama base model

[Model] FMO INT8

[tokenizer] AlternateTokenizer

[Merged] Experimental merge model

[QLoRA] Llama 3.2 1B

[Dataset] Function Calling

[tokenizer] AlternateTokenizer

updated 8 days ago

A series of modified tokenizers for tuning chatml inspired by teknium and hermes.

minpeter/Llama-3.x-AlternateTokenizer

Updated 13 days ago • 1

Note An alternative tokenizer for the final form of the Llama 3.x series.
teknium/Llama-3.1-AlternateTokenizer

Text Generation • Updated Jul 27, 2024 • 146 • 4
minpeter/Llama-3.2-1B-AlternateTokenizer-chatml

Text Generation • Updated 14 days ago • 326
minpeter/Llama-3.2-1B-AlternateTokenizer-tool-chatml

Text Generation • Updated 14 days ago • 389