levmckinney hunarbatra commited on
Commit
9d57806
1 Parent(s): c933758

LLaMa2-7b tuned lens (#41)

Browse files

- trained llama2-7b tuned lens with red-pajama-sample (6ccebbf266d47290463ba30151cd1a9deb3aa002)
- moved lamma2-7b to new home (2b379ae798a20397363ad660228c02176d412b57)


Co-authored-by: Hunar Batra <[email protected]>

lens/meta-llama/Llama-2-7b-hf/config.json ADDED
@@ -0,0 +1 @@
 
 
1
+ {"base_model_name_or_path": "meta-llama/Llama-2-7b-hf", "d_model": 4096, "num_hidden_layers": 32, "bias": true, "base_model_revision": null, "unembed_hash": "3313b62209f366e7b19233ae7068501553350611c20f96caf2499c0486f8836b", "lens_type": "linear_tuned_lens"}
lens/meta-llama/Llama-2-7b-hf/params.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f91beb5dce2fec4c52271d61d705bbcfb6e979d26de4f83d2a1656a371de0a7
3
+ size 1074019491