carpincho-13b-ggml-q4 / runCarpincho.sh
aao331's picture
Carpincho-13b-ggml for llama.cpp 10may2023
3bde1b5
./main -m ./carpincho-13b-ggml-model-q4_0.bin -i -ins -t 24