xDAN-AI
/

APUS-xDAN-4.0-MOE

Inference Endpoints

Model card Files Files and versions Community

Update README.md

#2

by xdantk - opened Apr 2

base: refs/heads/main

←

from: refs/pr/2

Discussion Files changed

Files changed (1) hide show

README.md +2 -2

README.md CHANGED Viewed

@@ -41,10 +41,10 @@ make LLAMA_CUDA=1
 ```python
 ./main -m APUS-xDAN-4.0-quanzied_version.gguf \
---prompt "You are a helpful assistant." --chatml \
 --interactive \
 --temp 0.7 \
---ctx-size 4096
 ```
 License

 ```python
 ./main -m APUS-xDAN-4.0-quanzied_version.gguf \
+--prompt "You are a helpful assistant named APUS-xDAN4.0 MoE." --chatml \
 --interactive \
 --temp 0.7 \
+--ctx-size 4096 (32k)
 ```
 License