mlabonne
/

Daredevil-8B

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

mlabonne commited on Jun 6

Commit

717953c

•

1 Parent(s): ef151ea

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -241,7 +241,7 @@ prompt = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_
 pipeline = transformers.pipeline(
     "text-generation",
     model=model,
-    torch_dtype=torch.float16,
     device_map="auto",
 )

 pipeline = transformers.pipeline(
     "text-generation",
     model=model,
+    torch_dtype=torch.bfloat16,
     device_map="auto",
 )