|
--- |
|
language: |
|
- en |
|
- es |
|
--- |
|
|
|
# Model Card for Carpincho-13b |
|
|
|
<!-- Provide a quick summary of what the model is/does. --> |
|
|
|
This is Carpincho-13B an Instruction-tuned LLM based on LLama-13B. It is trained to answer in colloquial spanish Argentine language. |
|
It's based on LLama-13b (https://huggingface.co/decapoda-research/llama-13b-hf). |
|
|
|
## Model Details |
|
|
|
The model is provided in ggml format, for use with the llama.cpp CPU-only LLM inference (https://github.com/ggerganov/llama.cpp) |
|
|
|
## Usage |
|
|
|
Clone the llama.cpp repository: |
|
|
|
git clone https://github.com/ggerganov/llama.cpp |
|
|
|
Compile the tool: |
|
|
|
make |
|
|
|
Download the file carpincho-13b-ggml-model-q4_0.bin into the llama.cpp directory and run this command: |
|
|
|
./main -m ./carpincho-13b-ggml-model-q4_0.bin -i -ins -t 4 |
|
|
|
Change -t 4 to the number of physical CPU cores you have. |
|
|
|
This model requires at least 8GB of free RAM. No GPU is needed to run llama.cpp. |
|
|
|
### Model Description |
|
|
|
<!-- Provide a longer summary of what this model is. --> |
|
|
|
- **Developed by:** Alfredo Ortega (@ortegaalfredo) |
|
- **Model type:** 13B LLM |
|
- **Language(s):** (NLP): English and colloquial Argentine Spanish |
|
- **License:** Free for non-commercial use, but I'm not the police. |
|
- **Finetuned from model:** https://huggingface.co/decapoda-research/llama-13b-hf |
|
|
|
### Model Sources [optional] |
|
|
|
<!-- Provide the basic links for the model. --> |
|
|
|
- **Repository:** https://huggingface.co/decapoda-research/llama-13b-hf |
|
- **Paper [optional]:** https://arxiv.org/abs/2302.13971 |
|
|
|
## Uses |
|
|
|
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. --> |
|
This is a generic LLM chatbot that can be used to interact directly with humans. |
|
|
|
## Bias, Risks, and Limitations |
|
|
|
<!-- This section is meant to convey both technical and sociotechnical limitations. --> |
|
This bot is uncensored and may provide shocking answers. Also it contains bias present in the training material. |
|
|
|
|
|
### Recommendations |
|
|
|
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. --> |
|
|
|
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. |
|
|
|
## Model Card Contact |
|
|
|
Contact the creator at @ortegaalfredo on twitter/github |
