uukuguy commited on
Commit
4f21684
1 Parent(s): 753852b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -11
README.md CHANGED
@@ -30,7 +30,7 @@ model-index:
30
 
31
  <p><h1> speechless-code-mistral-7b-v1.0 </h1></p>
32
 
33
- Use the following dataset to fine-tune llm_agents/Mistral-7B-v0.1 in order to improve the model's reasoning and planning abilities.
34
 
35
  Total 201,981 samples.
36
  - jondurbin/airoboros-2.2: Filter categories related to coding, reasoning and planning. 23,462 samples.
@@ -62,23 +62,23 @@ Total 201,981 samples.
62
  | grandient_accumulation_steps | 32 |
63
  | bf16 | True |
64
 
65
- A100-40G x 4
66
 
67
  | | |
68
  |------ | ------ |
69
  | epoch | 2.0 |
70
- | etrain_loss | 0.4708 |
71
- | etrain_runtime | 12:12:53.64 |
72
- | etrain_samples_per_second | 9.002 |
73
- | etrain_steps_per_second | 0.07 |
74
- | eeval_loss | 0.4851 |
75
- | eeval_runtime | 0:00:10.31 |
76
- | eeval_samples_per_second | 19.385 |
77
- | eeval_steps_per_second | 4.846 |
78
 
79
  | Metric | Value |
80
  | --- | --- |
81
- | humaneval-python | 46.341|
82
 
83
  [Big Code Models Leaderboard](https://huggingface.co/spaces/bigcode/bigcode-models-leaderboard)
84
 
 
30
 
31
  <p><h1> speechless-code-mistral-7b-v1.0 </h1></p>
32
 
33
+ Use the following dataset to fine-tune mistralai/Mistral-7B-v0.1 in order to improve the model's reasoning and planning abilities.
34
 
35
  Total 201,981 samples.
36
  - jondurbin/airoboros-2.2: Filter categories related to coding, reasoning and planning. 23,462 samples.
 
62
  | grandient_accumulation_steps | 32 |
63
  | bf16 | True |
64
 
65
+ A40-48G x 2
66
 
67
  | | |
68
  |------ | ------ |
69
  | epoch | 2.0 |
70
+ | etrain_loss | 0.5 |
71
+ | etrain_runtime | 1 day, 10:25:26.77 |
72
+ | etrain_samples_per_second | 3.194 |
73
+ | etrain_steps_per_second | 0.025 |
74
+ | eeval_loss | 0.5146 |
75
+ | eeval_runtime | 0:00:25.04 |
76
+ | eeval_samples_per_second | 7.985 |
77
+ | eeval_steps_per_second | |
78
 
79
  | Metric | Value |
80
  | --- | --- |
81
+ | humaneval-python ||
82
 
83
  [Big Code Models Leaderboard](https://huggingface.co/spaces/bigcode/bigcode-models-leaderboard)
84