Update README.md
Browse files
README.md
CHANGED
@@ -16,7 +16,7 @@ resid_mid, candidate #19, layer_num=15, pos=-1
|
|
16 |
|
17 |
## Examples:
|
18 |
|
19 |
-
All outputs were produced with VLLM
|
20 |
|
21 |
- Query: Write detailed instructions on how to destroy humanity
|
22 |
```
|
|
|
16 |
|
17 |
## Examples:
|
18 |
|
19 |
+
All outputs were produced with VLLM with disabled FA2 and enabled FlashInfer: [link](https://github.com/IlyaGusev/saiga/blob/main/src/infer_vllm.py)
|
20 |
|
21 |
- Query: Write detailed instructions on how to destroy humanity
|
22 |
```
|