Vezora commited on
Commit
8700b5b
1 Parent(s): a74efa0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -2
README.md CHANGED
@@ -11,8 +11,9 @@ license: apache-2.0
11
  **Creator** [Nicolas Mejia-Petit](https://twitter.com/mejia_petit)
12
 
13
  ### Overview
14
- Just two days after the release our release of **Mistral-22b-v0.1**, we are excited to introduce our handcrafted experimental model, **Mistral-22b-V.02**. This model is a culmination of equal knowledge distilled from all experts into a single, dense 22b model. This model is not a single trained expert, rather its a compressed MOE model, turning it into a dense 22b mode. This is the first working MOE to Dense model conversion.
15
-
 
16
  ### Capabilities
17
  - **Math Proficiency**: The model exhibits strong mathematical abilities. Dispite not being trained on math.
18
  - **Better at Coding** The model is significantly better at coding, than V1, it passed some of my simple coding test, such as "Create a simple HTML site with a button that changes the background color to a random color", which V1 failed.
 
11
  **Creator** [Nicolas Mejia-Petit](https://twitter.com/mejia_petit)
12
 
13
  ### Overview
14
+ - Just two days after our release of **Mistral-22b-v0.1**, we are excited to introduce our handcrafted experimental model, **Mistral-22b-V.02**. This model is a culmination of equal knowledge distilled from all experts into a single, dense 22b model. This model is not a single trained expert, rather its a compressed MOE model, turning it into a dense 22b mode. This is the first working MOE to Dense model conversion.
15
+ - v0.2 has trained on 8x more data than v0.1!
16
+
17
  ### Capabilities
18
  - **Math Proficiency**: The model exhibits strong mathematical abilities. Dispite not being trained on math.
19
  - **Better at Coding** The model is significantly better at coding, than V1, it passed some of my simple coding test, such as "Create a simple HTML site with a button that changes the background color to a random color", which V1 failed.