This is the FP-16 version of Dendrite-22B checkpoint 2 made available for merging or further training. | |
After the Frankenllama process it received a 10 hour LoRA session on about 20 megabytes of hand-selected raw text which has allowed it to use its new features more effectively. It still needs further training. |