Maverick-Math-7B
Model description
Maverick-Math is a Mistral Fine-tune, on top of math and code datasets and performs very well on benchmarks .
🏆 Evaluation
gsm8k
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | |
|---|---|---|---|---|---|---|---|
| gsm8k | 3 | strict-match | 5 | exact_match | 0.7331 | ± | 0.0122 |
| flexible-extract | 5 | exact_match | 0.7400 | ± | 0.0121 |
mathqa
| Tasks | Version | Filter | n-shot | Metric | Value | Stderr | |
|---|---|---|---|---|---|---|---|
| mathqa | 1 | none | None | acc | 0.3591 | ± | 0.0088 |
| none | None | acc_norm | 0.3635 | ± | 0.0088 |
- Downloads last month
- 81
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.