Update README.md

README.md

@@ -1,12 +1,17 @@
 ---
 library_name: transformers
-tags: []
+tags:
+- moe
+license: apache-2.0
+language:
+- en
 ---
 
-# Model Card for Model ID
+# Model Card for Hydra MOE 120B
 
-<!-- Provide a quick summary of what the model is/does. -->
+This is a 4x34b MOE model.  I have been expirementing with various gate settings and models.  This is yet another run with a different set of models on the same gate definitions.
 
+I am using mixtral tooling.
 
 
 ## Model Details
@@ -18,12 +23,12 @@ tags: []
 This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
 
 - **Developed by:** [More Information Needed]
-- **Funded by [optional]:** [More Information Needed]
-- **Shared by [optional]:** [More Information Needed]
-- **Model type:** [More Information Needed]
-- **Language(s) (NLP):** [More Information Needed]
-- **License:** [More Information Needed]
-- **Finetuned from model [optional]:** [More Information Needed]
+- **Funded by [optional]:** [ibivibiv](https://huggingface.co/ibivibiv) sadly alone and out of my pocket for now :D lol
+- **Shared by [optional]:** [ibivibiv](https://huggingface.co/ibivibiv)
+- **Model type:** MOE of 4 35B models (mistral/yi/llamma)
+- **Language(s) (NLP):** English
+- **License:** Apache 2.0
+- **MOE'd from models :** jondurbin/nontoxic-bagel-34b-v0.2, 01-ai/Yi-34B, bhenrym14/platypus-yi-34b, abacusai/MM-OV-bagel-DPO-34b-c1000-250
 
 ### Model Sources [optional]
 
@@ -196,6 +201,4 @@ Carbon emissions can be estimated using the [Machine Learning Impact calculator]
 
 ## Model Card Contact
 
-[More Information Needed]
-
-
+[More Information Needed]