Hugging Face's logo

belyakoff
/
llama-3.2-3b-instruct-fine-tuned-gptq-8bit

Text Generation
Transformers
Safetensors
Russian
English
code
rag
question answering
conversational
Inference Endpoints
Model card Files Community
belyakoff commited on
Commit
c21fed1
•
1 Parent(s): 8d2297c

Upload LlamaForCausalLM

Browse files
Files changed (4) hide show
  1. .gitattributes +1 -0
  2. config.json +3 -0
  3. generation_config.json +12 -0
  4. model.safetensors +3 -0
.gitattributes CHANGED
@@ -33,3 +33,4 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ config.json filter=lfs diff=lfs merge=lfs -text
config.json ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ea1809a6ace01fda5c4a159722fe4d2ddefe973d3133485b5e8b4646d0bc3b13
3
+ size 21450052
generation_config.json ADDED
@@ -0,0 +1,12 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "bos_token_id": 128000,
3
+ "do_sample": true,
4
+ "eos_token_id": [
5
+ 128001,
6
+ 128008,
7
+ 128009
8
+ ],
9
+ "temperature": 0.6,
10
+ "top_p": 0.9,
11
+ "transformers_version": "4.44.2"
12
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:303408d07baee9c59559eaf48f6b4c715214e88a652175be836dc1a2efefe8ed
3
+ size 3676063912