IDEA-CCNL
/

Ziya-LLaMA-13B-v1

Text Generation

text-generation-inference

Model card Files Files and versions

roygan commited on May 29, 2023

Commit

b2f74a7

·

1 Parent(s): 635aa0e

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -91,7 +91,7 @@ device = torch.device("cuda")
 query="帮我写一份去西安的旅游计划"
 model = LlamaForCausalLM.from_pretrained('IDEA-CCNL/Ziya-LLaMA-13B-v1', torch_dtype=torch.float16, device_map="auto")
-tokenizer = AutoTokenizer.from_pretrained('IDEA-CCNL/Ziya-LLaMA-13B-v1')
 inputs = '<human>:' + query.strip() + '\n<bot>:'
 input_ids = tokenizer(inputs, return_tensors="pt").input_ids.to(device)

 query="帮我写一份去西安的旅游计划"
 model = LlamaForCausalLM.from_pretrained('IDEA-CCNL/Ziya-LLaMA-13B-v1', torch_dtype=torch.float16, device_map="auto")
+tokenizer = AutoTokenizer.from_pretrained('IDEA-CCNL/Ziya-LLaMA-13B-v1', use_fast=False)
 inputs = '<human>:' + query.strip() + '\n<bot>:'
 input_ids = tokenizer(inputs, return_tensors="pt").input_ids.to(device)