IHaveNoClueAndIMustPost commited on
Commit
db659da
1 Parent(s): 2120a8e

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +15 -0
README.md ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ datasets:
3
+ - togethercomputer/RedPajama-Data-1T-Sample
4
+ tags:
5
+ - llama2
6
+ - llama
7
+ ---
8
+ A second model merge by chargoddard. A GGML conversion of the previous merge can be found [here](https://huggingface.co/IHaveNoClueAndIMustPost/Llama-2-22B-GGML).<br>
9
+ I have no idea what I'm doing so if something doesn't work as it should or not at all that's likely on me, not the models themselves.<br><br>
10
+ Description copied from the [original repo](https://huggingface.co/chargoddard/llama2-22b-blocktriangular) below.
11
+
12
+ <i>
13
+ Similar to llama2-22b, but with BLOCK_DIAGONAL=false in the merge and twice the fine-tuning tokens.
14
+
15
+ Again, not intended for direct use - meant as a base for further tuning and merging.</i>