second-state
/

Phi-3-mini-4k-instruct-GGUF

Text Generation

text-generation-inference

Inference Endpoints

Model card Files Files and versions Community

Xin Liu commited on Apr 23

Commit

4b10f80

•

1 Parent(s): 054a96c

Update

Signed-off-by: Xin Liu <[email protected]>

Files changed (1) hide show

README.md +3 -2

README.md CHANGED Viewed

@@ -52,11 +52,12 @@ tags:
 - Context size: `3072`
-- Run as LlamaEdge command app
   ```bash
   wasmedge --dir .:. --nn-preload default:GGML:AUTO:Phi-3-mini-4k-instruct-Q4.gguf \
     llama-api-server.wasm \
     --prompt-template phi-3-chat \
-    --ctx-size 3072
   ```

 - Context size: `3072`
+- Run as LlamaEdge service
   ```bash
   wasmedge --dir .:. --nn-preload default:GGML:AUTO:Phi-3-mini-4k-instruct-Q4.gguf \
     llama-api-server.wasm \
     --prompt-template phi-3-chat \
+    --ctx-size 3072 \
+    --model-name phi-3-mini
   ```