budecosystem
/

boomer-bitnet-634m

Text Generation

Model card Files Files and versions Community

dittops commited on Apr 5

Commit

e2cf457

•

1 Parent(s): 0e981c7

Update README.md

Files changed (1) hide show

README.md +3 -4

README.md CHANGED Viewed

@@ -42,10 +42,9 @@ print(tokenizer.batch_decode(outputs))
 We have evaluated the pre-trained model on few of the benchmarks
-| Model Name | ARC | MMLU | Winogrande | Hellaswag | MathQA   | DROP  | GSM8K   |
-|:----------:|:--------:|:----:|:----------:|:---------:|:-----: |:-----:|:----:|
-| Boomer1B   | 22.35     | 25.92| 6.1      | 31.66     | 28.65   | 6.13   | 1.5 |
-| budecosystem/boomer-bitnet-634m | | | | | | | |
 ### Final thought on Boomer!

 We have evaluated the pre-trained model on few of the benchmarks
+| Model Name | ARC | MMLU | Winogrande | Hellaswag | MathQA   | GSM8K   |
+|:----------:|:--------:|:----:|:----------:|:---------:|:-----: |:----:|
+| boomer-bitnet-634m | 26.19 | 25.23 | 51.07 | 34.08 | 23.38 | 0.91 |
 ### Final thought on Boomer!