Update README.md
Browse files
README.md
CHANGED
@@ -46,9 +46,9 @@ model.quantize(examples)
|
|
46 |
model.save_quantized(quantized_model_dir)
|
47 |
```
|
48 |
|
49 |
-
Evaluated through
|
50 |
|
51 |
-
```
|
52 |
#!/bin/bash
|
53 |
|
54 |
# Example usage:
|
|
|
46 |
model.save_quantized(quantized_model_dir)
|
47 |
```
|
48 |
|
49 |
+
Evaluated through vLLM>=0.5.1 with the following script:
|
50 |
|
51 |
+
```bash
|
52 |
#!/bin/bash
|
53 |
|
54 |
# Example usage:
|