cloudyu
/

60B-MoE-Coder-v2

Text Generation

Mixture of Experts

text-generation-inference

Inference Endpoints

4-bit precision

Model card Files Files and versions Community

cloudyu commited on Feb 7

Commit

4358b93

•

1 Parent(s): b58a6fd

Update README.md

Files changed (1) hide show

README.md +3 -1

README.md CHANGED Viewed

@@ -14,6 +14,7 @@ license_link: https://huggingface.co/01-ai/Yi-34B-200K/blob/main/LICENSE
 * Metrics not Test
   code example
 ```
 import torch
 from transformers import AutoTokenizer, AutoModelForCausalLM
@@ -34,4 +35,5 @@ while len(prompt) > 0:
     input_ids=input_ids, max_new_tokens=1500,repetition_penalty=1.1
   )
   print(tokenizer.decode(generation_output[0]))
-  prompt = input("please input prompt:")

 * Metrics not Test
   code example
 ```
 import torch
 from transformers import AutoTokenizer, AutoModelForCausalLM
     input_ids=input_ids, max_new_tokens=1500,repetition_penalty=1.1
   )
   print(tokenizer.decode(generation_output[0]))
+  prompt = input("please input prompt:")
+```