mcysqrd
/

MODULARMOJO_Mistral_V1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mcysqrd commited on Dec 3, 2023

Commit

bc51176

•

1 Parent(s): 1d23e84

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -31,7 +31,7 @@ model = AutoModelForCausalLM.from_pretrained(model_name,
                                              torch_dtype=torch.bfloat16,
                                             )
-tokenizer = AutoTokenizer.from_pretrained(base_model_id,add_bos_token=True,trust_remote_code=True)
 model.config.use_cache = True
 def stream(user_prompt):

                                              torch_dtype=torch.bfloat16,
                                             )
+tokenizer = AutoTokenizer.from_pretrained(model_name,add_bos_token=True,trust_remote_code=True)
 model.config.use_cache = True
 def stream(user_prompt):