Text Generation
Transformers
Safetensors
llama
model: llama
repo_name: llama_block_5_language_identification_Community
file_name: llama_block_5_language_identification_Community_5000_5.pt
pruning_style: block
community: 5
pruning_ratio: 20
dataset_label: language_identification
sparsity_ratio: 20
['tasksource/bigbench', 'language_identification']
finetune: Community
modules_size: 2
modules: ['20_attn.v', '22_attn.q']
rank: 2
tags: ['model: llama', 'repo_name: llama_block_5_language_identification_Community', 'file_name: llama_block_5_language_identification_Community_5000_5.pt', 'base_model: meta-llama/Llama-2-7b-hf', 'pruning_style: block', 'community: 5', 'pruning_ratio: 20', 'dataset_label: language_identification', 'sparsity_ratio: 20', "dataset: ['tasksource/bigbench', 'language_identification']", 'finetune: Community', 'modules_size: 2', "modules: ['20_attn.v', '22_attn.q']", 'rank: 2']
text-generation-inference
File size: 183 Bytes
ea3004d |
1 2 3 4 5 6 7 8 9 10 11 |
{
"bos_token_id": 1,
"do_sample": true,
"eos_token_id": 2,
"max_length": 4096,
"pad_token_id": 0,
"temperature": 0.6,
"top_p": 0.9,
"transformers_version": "4.52.4"
}
|