base_model:
- appvoid/palmer-002-32k
- raidhon/coven_tiny_1.1b_32k_orpo_alpha
- appvoid/palmer-003
library_name: transformers
tags:
- mergekit
- merge
palmer
introducing palmer-004: a new, small, general purpose, extended-context language model
We are thrilled to unveil palmer-004, the fourth iteration in our esteemed palmer series, designed to push the boundaries of performance and context window capacity. Merging the best of palmer-003 with the expansive capabilities of palmer-002-32k, palmer-004 is a testament to the power of innovation and meticulous craftsmanship.
Crafted using the TIES merge method, palmer-004 elevates its predecessor's prowess to a remarkable 32k context window. This model doesn't just aim to match; it surpasses, outperforming the current state-of-the-art coven_tiny_1.1b_32k_orpo_alpha. As of June 1, 2024, palmer-004 stands as the premier 1B model on Hugging Face, setting a new standard for excellence in the open-source AI community.
Experience the future of language modeling with palmer-004 – a fusion of unparalleled performance and cutting-edge technology, offered to you for free. Join us in this exciting journey of innovation and discovery.