Supa-AI/gemma2-9b-cpt-sea-lionv3-instruct-q8_0-gguf
This model was converted to GGUF format from aisingapore/gemma2-9b-cpt-sea-lionv3-instruct using llama.cpp.
Refer to the original model card for more details on the model.
Use with llama.cpp
CLI:
llama-cli --hf-repo Supa-AI/gemma2-9b-cpt-sea-lionv3-instruct-q8_0-gguf --hf-file gemma2-9b-cpt-sea-lionv3-instruct.q8_0.gguf -p "Your prompt here"
Server:
llama-server --hf-repo Supa-AI/gemma2-9b-cpt-sea-lionv3-instruct-q8_0-gguf --hf-file gemma2-9b-cpt-sea-lionv3-instruct.q8_0.gguf -c 2048
Model Details
- Quantization Type: q8_0
- Original Model: aisingapore/gemma2-9b-cpt-sea-lionv3-instruct
- Format: GGUF
- Downloads last month
- 18
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.
Model tree for Supa-AI/gemma2-9b-cpt-sea-lionv3-instruct-q8_0-gguf
Base model
google/gemma-2-9b