q10
/

Qwen3-8B-Base-INT8-INT4

Text Generation

text-generation-inference

Model card Files Files and versions

Qwen3-8B-Base-INT8-INT4

10.1 GB

1 contributor

History: 4 commits

q10's picture

q10

Upload README.md with huggingface_hub

3149ba3 verified 3 months ago

.gitattributes

1.57 kB

Upload tokenizer 3 months ago
README.md

9.66 kB

Upload README.md with huggingface_hub 3 months ago
added_tokens.json

707 Bytes

Upload tokenizer 3 months ago
chat_template.jinja

4.12 kB

Upload tokenizer 3 months ago
config.json

3.85 kB

Upload Qwen3ForCausalLM 3 months ago
generation_config.json

117 Bytes

Upload Qwen3ForCausalLM 3 months ago
merges.txt

1.67 MB

Upload tokenizer 3 months ago
pytorch_model-00001-of-00003.bin
Detected Pickle imports (16)
- "torchao.dtypes.affine_quantized_tensor.AffineQuantizedTensor",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.int8",
- "torch.CharStorage",
- "torchao.quantization.linear_activation_quantized_tensor.LinearActivationQuantizedTensor",
- "torch.bfloat16",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict",
- "torch.serialization._get_layout",
- "torchao.dtypes.uintx.q_dq_layout.QDQTensorImpl",
- "torchao.dtypes.uintx.q_dq_layout.QDQLayout",
- "torch.device",
- "torch._tensor._rebuild_from_type_v2",
- "torchao.quantization.quant_primitives.ZeroPointDomain",
- "torch.BFloat16Storage",
- "torchao.quantization.quant_api._int8_asymm_per_token_quant"
How to fix it?
4.99 GB
xet

Upload Qwen3ForCausalLM 3 months ago
pytorch_model-00002-of-00003.bin
Detected Pickle imports (16)
- "torchao.dtypes.affine_quantized_tensor.AffineQuantizedTensor",
- "torch._utils._rebuild_wrapper_subclass",
- "torch.int8",
- "torch.CharStorage",
- "torchao.quantization.linear_activation_quantized_tensor.LinearActivationQuantizedTensor",
- "torch.bfloat16",
- "torch.serialization._get_layout",
- "torch._utils._rebuild_tensor_v2",
- "torchao.dtypes.uintx.q_dq_layout.QDQTensorImpl",
- "collections.OrderedDict",
- "torchao.dtypes.uintx.q_dq_layout.QDQLayout",
- "torch.device",
- "torch._tensor._rebuild_from_type_v2",
- "torchao.quantization.quant_primitives.ZeroPointDomain",
- "torch.BFloat16Storage",
- "torchao.quantization.quant_api._int8_asymm_per_token_quant"
How to fix it?
3.85 GB
xet

Upload Qwen3ForCausalLM 3 months ago
pytorch_model-00003-of-00003.bin
Detected Pickle imports (3)
- "torch.BFloat16Storage",
- "torch._utils._rebuild_tensor_v2",
- "collections.OrderedDict"
What is a pickle import?
1.24 GB
xet

Upload Qwen3ForCausalLM 3 months ago
pytorch_model.bin.index.json

32.9 kB

Upload Qwen3ForCausalLM 3 months ago
special_tokens_map.json

616 Bytes

Upload tokenizer 3 months ago
tokenizer.json

11.4 MB
xet

Upload tokenizer 3 months ago
tokenizer_config.json

5.41 kB

Upload tokenizer 3 months ago
vocab.json

2.78 MB

Upload tokenizer 3 months ago