Update README.md

README.md

@@ -1,5 +1,12 @@
----
-license: other
-license_name: meta
-license_link: https://ai.meta.com/llama/license
----
+---
+license: other
+license_name: meta
+license_link: https://ai.meta.com/llama/license
+---
+pretrain dont use will ouput garbage
+
+adjusted tensors for the new tokenizer.
+Some weights of LlamaForCausalLM were not initialized from the model checkpoint at mylesgoose/Meta-Llama-3.1-8B-Instruct-goose-abliterated-reflection and are newly initialized because the shapes did not match:
+- model.embed_tokens.weight: found shape torch.Size([128256, 4096]) in the checkpoint and torch.Size([128262, 4096]) in the model instantiated
+- lm_head.weight: found shape torch.Size([128256, 4096]) in the checkpoint and torch.Size([128262, 4096]) in the model instantiated
+You should probably TRAIN this model on a down-stream task to be able to use it for predictions and inference.