#todo : update the model card
Running benchmarks rn
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | |
|---|---|---|---|---|---|---|---|
| hellaswag | 1 | none | None | acc | 0.5536 | ± | 0.0050 |
| none | None | acc_norm | 0.7294 | ± | 0.0044 |
- Downloads last month
- 77
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.