Nicolas Iglesias
commited on
Commit
•
c1115ff
1
Parent(s):
d2275d3
Update README.md
Browse files
README.md
CHANGED
|
@@ -73,6 +73,17 @@ print(answer)
|
|
| 73 |
|
| 74 |
# Inference
|
| 75 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 76 |
Currently, the HuggingFace's Inference Tool UI doesn't properly load the model. However, you can use it with regular Python code as shown above once you meet the [requirements](#requirements).
|
| 77 |
|
| 78 |
# Acknowledgments
|
|
|
|
| 73 |
|
| 74 |
# Inference
|
| 75 |
|
| 76 |
+
## CPU
|
| 77 |
+
|
| 78 |
+
CPU inference is available via [GGML model](https://huggingface.co/danderian/zenos-gpt-j-6B-alpaca-evol-4bit/resolve/main/ggml-f16-q4_0.bin)
|
| 79 |
+
|
| 80 |
+
### Minimum requirements
|
| 81 |
+
|
| 82 |
+
- 4 cores
|
| 83 |
+
- 4GB RAM
|
| 84 |
+
|
| 85 |
+
## Online
|
| 86 |
+
|
| 87 |
Currently, the HuggingFace's Inference Tool UI doesn't properly load the model. However, you can use it with regular Python code as shown above once you meet the [requirements](#requirements).
|
| 88 |
|
| 89 |
# Acknowledgments
|