Hugging Face's logo

latimar
/
Phind-Codellama-34B-v2-exl2

Text Generation
Transformers
llama
text-generation-inference
Model card Files Community
5
latimar commited on
Commit
67ab3fc
•
1 Parent(s): 487b963

Fix table

Browse files
Files changed (1) hide show
  1. README.md +2 -3
README.md CHANGED
@@ -24,12 +24,11 @@ There are the following branches:
24
  * Evaluation dataset used to calculate perplexity: [wikitext-v2](https://huggingface.co/datasets/wikitext/blob/refs%2Fconvert%2Fparquet/wikitext-2-v1/validation/0000.parquet)
25
  * PPL max seq. length used: 1792 (2048 with 5.0-bpw-h8 causes OOM on RTX 4090 when evaluating ppl, so had to go down a bit)
26
 
27
- ----------------------------------------------
28
  | BPW | Perplexity | File Size (Gb) |
29
- ---------------------------------------------|
30
  | 2.55-h6 | 15.0901 | 10.56 |
31
  | 2.75-h6 | 13.6153 | 11.33 |
32
  | 4.125-h6 | 6.8095 | 16.65 |
33
  | 4.625-h6 | 6.7992 | 18.58 |
34
  | 5.0-h8 | 6.7785 | 20.09 |
35
- ----------------------------------------------
 
24
  * Evaluation dataset used to calculate perplexity: [wikitext-v2](https://huggingface.co/datasets/wikitext/blob/refs%2Fconvert%2Fparquet/wikitext-2-v1/validation/0000.parquet)
25
  * PPL max seq. length used: 1792 (2048 with 5.0-bpw-h8 causes OOM on RTX 4090 when evaluating ppl, so had to go down a bit)
26
 
27
+
28
  | BPW | Perplexity | File Size (Gb) |
29
+ |--------------------------------------------|
30
  | 2.55-h6 | 15.0901 | 10.56 |
31
  | 2.75-h6 | 13.6153 | 11.33 |
32
  | 4.125-h6 | 6.8095 | 16.65 |
33
  | 4.625-h6 | 6.7992 | 18.58 |
34
  | 5.0-h8 | 6.7785 | 20.09 |