INSAIT-Institute
/

BgGPT-7B-Instruct-v0.1

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Vesu commited on Feb 18

Commit

9c96e8c

•

1 Parent(s): f159412

Update README.md

Files changed (1) hide show

README.md +4 -0

README.md CHANGED Viewed

@@ -81,3 +81,7 @@ model = AutoModelForCausalLM.from_pretrained(
     use_flash_attn_2=True # optional
 )
 ```

     use_flash_attn_2=True # optional
 )
 ```
+## Use with GGML / llama.cpp
+The model in GGUF format [INSAIT-Institute/BgGPT-7B-Instruct-v0.1-GGUF](https://huggingface.co/INSAIT-Institute/BgGPT-7B-Instruct-v0.1-GGUF)