Update README.md

README.md

@@ -1,3 +1,39 @@
 ---
 license: apache-2.0
+base_model: upstage/SOLAR-10.7B-v1.0
+tags:
+- generated_from_trainer
+model-index:
+- name: yanolja/KoSOLAR-10.7B-v0.3
+  results: []
 ---
+[<img src="https://raw.githubusercontent.com/OpenAccess-AI-Collective/axolotl/main/image/axolotl-badge-web.png" alt="Built with Axolotl" width="200" height="32"/>](https://github.com/OpenAccess-AI-Collective/axolotl)
+# KoSOLAR-10.7B-v0.3
+
+## Join Our Community on Discord!
+
+If you're passionate about the field of Large Language Models and wish to exchange knowledge and insights, we warmly invite you to join our Discord server. It's worth noting that Korean is the primary language used in this server. The landscape of LLM is evolving rapidly, and without active sharing, our collective knowledge risks becoming outdated swiftly. Let's collaborate and drive greater impact together! Join us here: [Discord Link](https://discord.gg/b27bAHg95m).
+
+## Our Dedicated Team (Alphabetical Order)
+| Research        | Engineering     | Product Management | UX Design   |
+|-----------------|-----------------|--------------------|--------------
+| Myeongho Jeong  | Geon Kim        | Bokyung Huh        | Eunsue Choi |
+| Seungduk Kim    | Rifqi Alfi      |                    |             |
+| Seungtaek Choi  | Sanghoon Han    |                    |             |
+|                 | Suhyun Kang     |                    |             |
+
+## About the Model
+
+This model is a Korean vocabulary-extended version of [upstage/SOLAR-10.7B-v1.0](https://huggingface.co/upstage/SOLAR-10.7B-v1.0), specifically fine-tuned on various Korean web-crawled datasets available on HuggingFace. Our approach was to expand the model's understanding of Korean by pre-training the embeddings for new tokens and partially fine-tuning the `lm_head` embeddings for the already existing tokens while preserving the original parameters of the base model.
+
+### Technical Deep Dive
+
+TBU
+
+### Usage and Limitations
+
+Keep in mind that this model hasn't been fine-tuned with instruction-based training. While it excels in Korean language tasks, we advise careful consideration and further training for specific applications.
+
+### Training Details
+
+TBU