Hugging Face's logo

nm-testing
/
TinyLlama-1.1B-Chat-v1.0-W8A8_channel_weight_static_per_tensor-e2e

Text Generation
Transformers
Safetensors
llama
conversational
text-generation-inference
Inference Endpoints
8-bit precision
compressed-tensors
Model card Files Community
nm-autobot commited on
Commit
b65f599
•
1 Parent(s): adc1e6e

Upload LlamaForCausalLM

Browse files
Files changed (2) hide show
  1. config.json +1 -1
  2. model.safetensors +1 -1
config.json CHANGED
@@ -47,7 +47,7 @@
47
  "kv_cache_scheme": null,
48
  "quant_method": "compressed-tensors",
49
  "quantization_status": "compressed",
50
- "version": "0.6.0.20240926"
51
  },
52
  "eos_token_id": 2,
53
  "head_dim": 64,
 
47
  "kv_cache_scheme": null,
48
  "quant_method": "compressed-tensors",
49
  "quantization_status": "compressed",
50
+ "version": "0.6.0.20240927"
51
  },
52
  "eos_token_id": 2,
53
  "head_dim": 64,
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:9431a505d3b5ea7b6dfaab9f4381d463654f463b4f2a1ebb0fda32bfadc660cb
3
  size 1232059012
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a6e7dd01f726bae94988a632b681bcdbbfe122ae602b680c5a207f21a9c93f7e
3
  size 1232059012