Can not use HF transformers for inference?
#11 opened 9 days ago
by
haili-tian
Error when setting max_model_len to 65536 for Ministral-8B-Instruct-2410 on A100 | VLLM
#10 opened 12 days ago
by
Byerose
Where is Ministral 3B?
#9 opened 14 days ago
by
ZeroWw
an error when trying to infer in Chinese
1
#8 opened 17 days ago
by
mario479
Looks like not as good as Qwen2.5 7B
9
#5 opened 20 days ago
by
MonolithFoundation
3B Version Weights
5
#4 opened 20 days ago
by
TKDKid1000
This LLM is hallucinating like crazy. Can someone verify these prompts?
28
#3 opened 20 days ago
by
phil111
Not MRL again :(
3
#1 opened 20 days ago
by
ProdeusUnity