File size: 2,682 Bytes
fdce146 8567b90 fdce146 44827e0 fdce146 44827e0 fdce146 |
1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 |
---
language:
- en
- es
---
# Model Card for Carpincho-13b
<!-- Provide a quick summary of what the model is/does. -->
This is Carpincho-13B an Instruction-tuned LLM based on LLama-13B. It is trained to answer in colloquial spanish Argentine language.
It's based on LLama-13b (https://huggingface.co/decapoda-research/llama-13b-hf).
## Model Details
The model is provided in two formats: A low rank adaptation model (LoRA) suitable to apply directly to LLama-13B-HF,
and a complete merged model quantized to 4bits that only requires 8GB of VRAM. Both models can be used directly in software like
text-generation-webui https://github.com/oobabooga/text-generation-webui.
Additionally, a test chatbot based on this neural network is running on the twitter account http://twitter.com/arggpt
### Model Description
<!-- Provide a longer summary of what this model is. -->
- **Developed by:** Alfredo Ortega (@ortegaalfredo)
- **Model type:** 13B LLM
- **Language(s):** (NLP): English and colloquial Argentine Spanish
- **License:** Free for non-commercial use
- **Finetuned from model:** https://huggingface.co/decapoda-research/llama-13b-hf
### Model Sources [optional]
<!-- Provide the basic links for the model. -->
- **Repository:** https://huggingface.co/decapoda-research/llama-13b-hf
- **Paper [optional]:** https://arxiv.org/abs/2302.13971
## Uses
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
This is a generic LLM chatbot that can be used to interact directly with humans.
## Bias, Risks, and Limitations
<!-- This section is meant to convey both technical and sociotechnical limitations. -->
This bot is uncensored and may provide shocking answers. Also it contains bias present in the training material.
### Recommendations
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model.
## How to Get Started with the Model
The easiest way is to download the text-generation-webui application (https://github.com/oobabooga/text-generation-webui) and place the model inside the 'models' directory.
Then launch the web interface and run the model as a regular LLama-13B model. LoRA model don't require additional installation, but 4-bit mode (only uses 25% GPU VRAM) needs
additional installation steps detailed at https://github.com/oobabooga/text-generation-webui/blob/main/docs/GPTQ-models-(4-bit-mode).md
## Model Card Contact
Contact the creator at @ortegaalfredo on twitter/github |