apepkuss79 commited on
Commit
a709b8f
1 Parent(s): e3f5c56

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -0
README.md ADDED
@@ -0,0 +1,52 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: llama3.1
3
+ model_name: Meta-Llama-3.1-8B-Instruct
4
+ arxiv: 2307.09288
5
+ base_model: meta-llama/Meta-Llama-3.1-8B-Instruct
6
+ inference: false
7
+ model_creator: Meta Llama3
8
+ model_type: llama
9
+ pipeline_tag: text-generation
10
+ quantized_by: Second State Inc.
11
+ language:
12
+ - en
13
+ - de
14
+ - fr
15
+ - it
16
+ - pt
17
+ - hi
18
+ - es
19
+ - th
20
+ tags:
21
+ - facebook
22
+ - meta
23
+ - pytorch
24
+ - llama
25
+ - llama-3
26
+ ---
27
+
28
+ ![](https://github.com/GaiaNet-AI/.github/assets/45785633/d6976adc-f97d-4f86-a648-0f2f5c8e7eee)
29
+
30
+ # Meta-Llama-3.1-8B-Instruct-GGUF
31
+
32
+ ## Original Model
33
+
34
+ [meta-llama/Meta-Llama-3.1-8B-Instruct](https://huggingface.co/meta-llama/Meta-Llama-3.1-8B-Instruct)
35
+
36
+ ## Run with Gaianet
37
+
38
+ **Prompt template:**
39
+
40
+ prompt template: `llama-3-chat`
41
+
42
+ **Context size:**
43
+
44
+ chat_ctx_size: `128000`
45
+
46
+ **Run with GaiaNet:**
47
+
48
+ - Quick start: https://docs.gaianet.ai/node-guide/quick-start
49
+
50
+ - Customize your node: https://docs.gaianet.ai/node-guide/customize
51
+
52
+ *Quantized with llama.cpp b3445*