Text Generation
GGUF
English
nlp
code
Inference Endpoints
aberrio commited on
Commit
7c3da68
1 Parent(s): 2f20fa2

Update and fix test example

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -107,9 +107,9 @@ To test the model against Hugging Face, you can use the following command:
107
 
108
  ```sh
109
  # Example command for testing against Hugging Face
110
- python convert-hf-to-gguf-update.py ./Refact-1_6B-fim 1
111
 
112
- ./main -m ./Refact-1_6B-fim/ggml-model-f16.gguf -n 300 -p "write a function to multiply two integers in python" --temp 1.0 --top-p 1.0 --top-k 1 --repeat_penalty 1.0
113
  ```
114
 
115
  This resolves llama.cpp issue [#3061](https://github.com/ggerganov/llama.cpp/issues/3061).
 
107
 
108
  ```sh
109
  # Example command for testing against Hugging Face
110
+ python convert-hf-to-gguf.py models/smallcloudai/Refact-1_6B-fim
111
 
112
+ ./main --color -e -s 1 -c 256 -n 256 -m ./models/smallcloudai/Refact-1_6B-fim/ggml-model-f16.gguf -p "def multiply(a: int, b: int) -> int:"
113
  ```
114
 
115
  This resolves llama.cpp issue [#3061](https://github.com/ggerganov/llama.cpp/issues/3061).