aao331 commited on
Commit
60192ee
1 Parent(s): 3bde1b5

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +71 -0
README.md ADDED
@@ -0,0 +1,71 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language:
3
+ - en
4
+ - es
5
+ ---
6
+
7
+ # Model Card for Carpincho-13b
8
+
9
+ <!-- Provide a quick summary of what the model is/does. -->
10
+
11
+ This is Carpincho-13B an Instruction-tuned LLM based on LLama-13B. It is trained to answer in colloquial spanish Argentine language.
12
+ It's based on LLama-13b (https://huggingface.co/decapoda-research/llama-13b-hf).
13
+
14
+ ## Model Details
15
+
16
+ The model is provided in ggml format, for use with the llama.cpp CPU-only LLM inference (https://github.com/ggerganov/llama.cpp)
17
+
18
+ ## Usage
19
+
20
+ Clone the llama.cpp repository:
21
+
22
+ git clone https://github.com/ggerganov/llama.cpp
23
+
24
+ Compile the tool:
25
+
26
+ make
27
+
28
+ Download the file carpincho-13b-ggml-model-q4_0.bin into the llama.cpp directory and run this command:
29
+
30
+ ./main -m ./carpincho-13b-ggml-model-q4_0.bin -i -ins -t 4
31
+
32
+ Change -t 8 to the number of physical CPU cores you have.
33
+
34
+
35
+ ### Model Description
36
+
37
+ <!-- Provide a longer summary of what this model is. -->
38
+
39
+ - **Developed by:** Alfredo Ortega (@ortegaalfredo)
40
+ - **Model type:** 13B LLM
41
+ - **Language(s):** (NLP): English and colloquial Argentine Spanish
42
+ - **License:** Free for non-commercial use, but I'm not the police.
43
+ - **Finetuned from model:** https://huggingface.co/decapoda-research/llama-13b-hf
44
+
45
+ ### Model Sources [optional]
46
+
47
+ <!-- Provide the basic links for the model. -->
48
+
49
+ - **Repository:** https://huggingface.co/decapoda-research/llama-13b-hf
50
+ - **Paper [optional]:** https://arxiv.org/abs/2302.13971
51
+
52
+ ## Uses
53
+
54
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
55
+ This is a generic LLM chatbot that can be used to interact directly with humans.
56
+
57
+ ## Bias, Risks, and Limitations
58
+
59
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
60
+ This bot is uncensored and may provide shocking answers. Also it contains bias present in the training material.
61
+
62
+
63
+ ### Recommendations
64
+
65
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
66
+
67
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model.
68
+
69
+ ## Model Card Contact
70
+
71
+ Contact the creator at @ortegaalfredo on twitter/github