CausalLM
/

72B-preview-llamafied-qwen-llamafy

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

JosephusCheung commited on Nov 30, 2023

Commit

7e3497d

•

1 Parent(s): 8d4caf3

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -3,7 +3,7 @@ license: gpl-3.0
 ---
 # A Chat Model
-It should take an hour or so to be uploaded, and I am working on a gguf version.
 Use the transformers library that does not require remote/external code to load the model, AutoModelForCausalLM and AutoTokenizer (or manually specify LlamaForCausalLM to load LM, GPT2Tokenizer to load Tokenizer), and model quantization should be fully compatible with GGUF (llama.cpp), GPTQ, and AWQ.

 ---
 # A Chat Model
+*There is something wrong with llama.cpp GGUF format, need some time to fix that.*
 Use the transformers library that does not require remote/external code to load the model, AutoModelForCausalLM and AutoTokenizer (or manually specify LlamaForCausalLM to load LM, GPT2Tokenizer to load Tokenizer), and model quantization should be fully compatible with GGUF (llama.cpp), GPTQ, and AWQ.