Saxo commited on
Commit
6d8ae7a
โ€ข
1 Parent(s): 92c22b7

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -1
README.md CHANGED
@@ -46,7 +46,9 @@ Hermes-3-Llama-3.1-70B ๋ฒ ์ด์Šค๋ชจ๋ธ์„ ์‚ฌ์šฉํ•ด์„œ H100-80G 8๊ฐœ๋ฅผ ํ†ตํ•ด C
46
  -๊ณ ๊ฐ ๋ฆฌ๋ทฐ๋‚˜ ์†Œ์…œ ํฌ์ŠคํŒ… ๊ณ ์ฐจ์› ๋ถ„์„ ๋ฐ ์ฝ”๋”ฉ๊ณผ ์ž‘๋ฌธ, ์ˆ˜ํ•™, ๋…ผ๋ฆฌํŒ๋‹จ ๋“ฑ์ด ๊ฐ•ํ™”๋œ ๋ชจ๋ธ<br>
47
  -128k-Context Window<br>
48
  -ํ•œ๊ธ€ Function Call ๋ฐ Tool Calling ์ง€์›<br>
49
- -Deepspeed Stage=3, rslora ๋ฐ BAdam Layer Mode ์‚ฌ์šฉ <br><br><br>
 
 
50
 
51
  Finetuned by Mr. Yunsung Ji (Saxo), a data scientist at Linkbricks, a company specializing in AI and big data analytics <br>
52
  CPT(Continue-Pretraining)->SFT->DPO training model based on Hermes-3-Llama-3.1-70B through 8 H100-80Gs as a Korean language model <br>
 
46
  -๊ณ ๊ฐ ๋ฆฌ๋ทฐ๋‚˜ ์†Œ์…œ ํฌ์ŠคํŒ… ๊ณ ์ฐจ์› ๋ถ„์„ ๋ฐ ์ฝ”๋”ฉ๊ณผ ์ž‘๋ฌธ, ์ˆ˜ํ•™, ๋…ผ๋ฆฌํŒ๋‹จ ๋“ฑ์ด ๊ฐ•ํ™”๋œ ๋ชจ๋ธ<br>
47
  -128k-Context Window<br>
48
  -ํ•œ๊ธ€ Function Call ๋ฐ Tool Calling ์ง€์›<br>
49
+ -Deepspeed Stage=3, rslora ๋ฐ BAdam Layer Mode ์‚ฌ์šฉ <br>
50
+ -ollama run benedict/linkbricks-hermes3-llama3.1-70b-korean-advanced-q4
51
+ <br><br>
52
 
53
  Finetuned by Mr. Yunsung Ji (Saxo), a data scientist at Linkbricks, a company specializing in AI and big data analytics <br>
54
  CPT(Continue-Pretraining)->SFT->DPO training model based on Hermes-3-Llama-3.1-70B through 8 H100-80Gs as a Korean language model <br>