File size: 2,308 Bytes
60192ee 7e8cbad 60192ee aac186c 60192ee |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 69 70 71 72 |
---
language:
- en
- es
---
# Model Card for Carpincho-13b
<!-- Provide a quick summary of what the model is/does. -->
This is Carpincho-13B an Instruction-tuned LLM based on LLama-13B. It is trained to answer in colloquial spanish Argentine language.
It's based on LLama-13b (https://huggingface.co/decapoda-research/llama-13b-hf).
## Model Details
The model is provided in ggml format, for use with the llama.cpp CPU-only LLM inference (https://github.com/ggerganov/llama.cpp)
## Usage
Clone the llama.cpp repository:
git clone https://github.com/ggerganov/llama.cpp
Compile the tool:
make
Download the file carpincho-13b-ggml-model-q4_0.bin into the llama.cpp directory and run this command:
./main -m ./carpincho-13b-ggml-model-q4_0.bin -i -ins -t 4
Change -t 4 to the number of physical CPU cores you have.
This model requires at least 8GB of free RAM. No GPU is needed to run llama.cpp.
### Model Description
<!-- Provide a longer summary of what this model is. -->
- **Developed by:** Alfredo Ortega (@ortegaalfredo)
- **Model type:** 13B LLM
- **Language(s):** (NLP): English and colloquial Argentine Spanish
- **License:** Free for non-commercial use, but I'm not the police.
- **Finetuned from model:** https://huggingface.co/decapoda-research/llama-13b-hf
### Model Sources [optional]
<!-- Provide the basic links for the model. -->
- **Repository:** https://huggingface.co/decapoda-research/llama-13b-hf
- **Paper [optional]:** https://arxiv.org/abs/2302.13971
## Uses
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
This is a generic LLM chatbot that can be used to interact directly with humans.
## Bias, Risks, and Limitations
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
This bot is uncensored and may provide shocking answers. Also it contains bias present in the training material.
### Recommendations
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model.
## Model Card Contact
Contact the creator at @ortegaalfredo on twitter/github |