Spaces:

KoboldAI
/

Koboldcpp-Tiefighter

Running on T4

Henk717 commited on Apr 6

Commit

ce28370

•

1 Parent(s): 1dbb897

More efficient ImageGen

Hopefully makes img gen fit in the space

Files changed (1) hide show

Dockerfile CHANGED Viewed

@@ -13,5 +13,5 @@ RUN make LLAMA_OPENBLAS=1 LLAMA_CUBLAS=1 LLAMA_PORTABLE=1
 RUN wget -O model.ggml $MODEL || true
 RUN wget -O imgmodel.ggml $IMGMODEL || true
 RUN wget -O mmproj.ggml $MMPROJ || true
-CMD /bin/python3 ./koboldcpp.py --model model.ggml --sdconfig imgmodel.ggml --mmproj mmproj.ggml $ADDITIONAL --port 7860 --hordeconfig $MODEL_NAME 1 1 --preloadstory default.json --ignoremissing

 RUN wget -O model.ggml $MODEL || true
 RUN wget -O imgmodel.ggml $IMGMODEL || true
 RUN wget -O mmproj.ggml $MMPROJ || true
+CMD /bin/python3 ./koboldcpp.py --model model.ggml --sdconfig imgmodel.ggml clamped 4 quant --mmproj mmproj.ggml $ADDITIONAL --port 7860 --hordeconfig $MODEL_NAME 1 1 --preloadstory default.json --ignoremissing