Update README.md

README.md

@@ -29,22 +29,7 @@ Baichuan-13B-Chat is the aligned version in the Baichuan-13B series of models, a
   4. **Open-source, free, and commercially usable**: Baichuan-13B is not only fully open to academic research, but developers can also use it for free commercially after applying for and receiving official commercial permission via email.
 
 
-## 使用方式
-
-如下是一个使用Baichuan-13B-Chat进行对话的示例，正确输出为"乔戈里峰。世界第二高峰———乔戈里峰西方登山者称其为k2峰，海拔高度是8611米，位于喀喇昆仑山脉的中巴边境上"
-```python
-import torch
-from transformers import AutoModelForCausalLM, AutoTokenizer
-from transformers.generation.utils import GenerationConfig
-tokenizer = AutoTokenizer.from_pretrained("baichuan-inc/Baichuan-13B-Chat", use_fast=False, trust_remote_code=True)
-model = AutoModelForCausalLM.from_pretrained("baichuan-inc/Baichuan-13B-Chat", device_map="auto", torch_dtype=torch.float16, trust_remote_code=True)
-model.generation_config = GenerationConfig.from_pretrained("baichuan-inc/Baichuan-13B-Chat")
-messages = []
-messages.append({"role": "user", "content": "世界上第二高的山峰是哪座"})
-response = model.chat(tokenizer, messages)
-print(response)
-```
-## int8 量化部署
+## 使用方式(int8)
 
 ```python
 import torch
@@ -54,7 +39,7 @@ tokenizer = AutoTokenizer.from_pretrained("trillionmonster/Baichuan-13B-Chat-8bi
 model = AutoModelForCausalLM.from_pretrained("trillionmonster/Baichuan-13B-Chat-8bit",  device_map="auto", trust_remote_code=True)
 model.generation_config = GenerationConfig.from_pretrained("trillionmonster/Baichuan-13B-Chat-8bit")
 messages = []
-messages.append({"role": "user", "content": "Which moutain is the second highest one in the world?"})
+messages.append({"role": "user", "content": "世界上第二高的山峰是哪座"})
 response = model.chat(tokenizer, messages)
 print(response)
 ```