Create README.md
Browse files
README.md
ADDED
@@ -0,0 +1,54 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
1 |
+
---
|
2 |
+
license: apache-2.0
|
3 |
+
datasets:
|
4 |
+
- jpacifico/French-Alpaca-dataset-Instruct-110K
|
5 |
+
language:
|
6 |
+
- fr
|
7 |
+
tags:
|
8 |
+
- french-alpaca
|
9 |
+
- french
|
10 |
+
- 4Q_K_M
|
11 |
+
- Instruct
|
12 |
+
---
|
13 |
+
### French-Alpaca-Instruct Q4
|
14 |
+
|
15 |
+
Quantized 4bits Q4_K_M version of https://huggingface.co/jpacifico/French-Alpaca-Llama3-8B-Instruct-v1.0
|
16 |
+
|
17 |
+
This 4 bits version of French-Alpaca
|
18 |
+
can be used on a CPU device incl. Raspberry Pi 5 8gb, and is supported by LLM cpp tools (llama.cpp, Ollama, LM Studio ..)
|
19 |
+
|
20 |
+
### Usage
|
21 |
+
|
22 |
+
Ollama Modelfile example :
|
23 |
+
|
24 |
+
```bash
|
25 |
+
FROM ./french-alpaca-llama3-4bits-GGUF
|
26 |
+
|
27 |
+
TEMPLATE """Tu trouveras ci-dessous une instruction qui décrit une tâche. Rédige une réponse qui complète de manière appropriée la demande.
|
28 |
+
|
29 |
+
|
30 |
+
{{ if .System }}### Instruction:
|
31 |
+
{{ .System }}{{ end }}
|
32 |
+
|
33 |
+
{{ if .Prompt }}### Input:
|
34 |
+
{{ .Prompt }}{{ end }}
|
35 |
+
|
36 |
+
### Response:
|
37 |
+
"""
|
38 |
+
|
39 |
+
PARAMETER stop "### Response:"
|
40 |
+
PARAMETER stop "### Instruction:"
|
41 |
+
PARAMETER stop "### Input:"
|
42 |
+
PARAMETER stop "Tu trouveras ci-dessous une instruction qui décrit une tâche. Rédige une réponse qui complète de manière appropriée la demande."
|
43 |
+
PARAMETER num_predict 300
|
44 |
+
```
|
45 |
+
|
46 |
+
### Limitations
|
47 |
+
|
48 |
+
The French-Alpaca model is a quick demonstration that a base 8B model can be easily fine-tuned to specialize in a particular language.
|
49 |
+
It does not have any moderation mechanisms.
|
50 |
+
|
51 |
+
- **Developed by:** Jonathan Pacifico, 2024
|
52 |
+
- **Model type:** LLM
|
53 |
+
- **Language(s) (NLP):** French
|
54 |
+
- **License:** Apache-2.0
|