Inferless
/

Mixtral-8x7B-v0.1-int8-GPTQ

Text Generation

text-generation-inference

Model card Files Files and versions Community

Mixtral-8x7B-v0.1-int8-GPTQ

1 contributor

History: 3 commits

rbgo's picture

Update README.md

694c921 verified 10 months ago

.gitattributes

1.52 kB

initial commit 10 months ago
README.md

985 Bytes

Update README.md 10 months ago
config.json

720 Bytes

Upload folder using huggingface_hub 10 months ago
generation_config.json

116 Bytes

Upload folder using huggingface_hub 10 months ago
model.safetensors.index.json

92.7 kB

Upload folder using huggingface_hub 10 months ago
model_int8.pth
Detected Pickle imports (5)
- "torch.CharStorage",
- "torch.FloatStorage",
- "torch._utils._rebuild_tensor_v2",
- "torch.BFloat16Storage",
- "collections.OrderedDict"
What is a pickle import?
46.9 GB
LFS

Upload folder using huggingface_hub 10 months ago
special_tokens_map.json

72 Bytes

Upload folder using huggingface_hub 10 months ago
tokenizer.json

1.8 MB

Upload folder using huggingface_hub 10 months ago
tokenizer.model

493 kB
LFS

Upload folder using huggingface_hub 10 months ago
tokenizer_config.json

967 Bytes

Upload folder using huggingface_hub 10 months ago