|
--- |
|
license: cc-by-nc-4.0 |
|
base_model: spow12/Ko-Qwen2-7B-Instruct |
|
tags: |
|
- gguf |
|
model-index: |
|
- name: joongi007/Ko-Qwen2-7B-Instruct-GGUF |
|
results: [] |
|
--- |
|
|
|
- Original model is [spow12/Ko-Qwen2-7B-Instruct](https://huggingface.co/spow12/Ko-Qwen2-7B-Instruct) |
|
- quantized using [llama.cpp](https://github.com/ggerganov/llama.cpp) |
|
|
|
```prompt |
|
<|im_start|>system |
|
{System}<|im_end|> |
|
<|im_start|>user |
|
{User}<|im_end|> |
|
<|im_start|>assistant |
|
{Assistant} |
|
``` |
|
"Flash Attention" function must be activated. [why?](https://www.reddit.com/r/LocalLLaMA/comments/1da19nu/if_your_qwen2_gguf_is_spitting_nonsense_enable/) |
|
|
