---
license: apache-2.0
---

# 1B version of Jamba trained on 10k of the Ultra-Instruct dataset. It is broken though and repeats itself constantly. Keeping it up for posterity and/or experimentation purposes