GGUF
alignment-handbook
Generated from Trainer
trl
sft
Inference Endpoints
conversational
Edit model card
Jan banner

Jan - Discord

Model Description

This is a GGUF version of jan-hq/stealth-rag-v1.1

About Jan

Jan believes in the need for an open-source AI ecosystem and is building the infra and tooling to allow open-source AIs to compete on a level playing field with proprietary ones.

Jan's long-term vision is to build a cognitive framework for future robots, who are practical, useful assistants for humans and businesses in everyday life.

Jan Model Converter

This is a repository for the [open-source converter](https://github.com/janhq/model-converter. We would be grateful if the community could contribute and strengthen this repository. We are aiming to expand the repo that can convert into various types of format

Downloads last month
7
GGUF
Model size
7.24B params
Architecture
llama

3-bit

4-bit

5-bit

8-bit

Inference API
Unable to determine this model's library. Check the docs .

Model tree for janhq/stealth-rag-v1.1-GGUF

Datasets used to train janhq/stealth-rag-v1.1-GGUF