QuantFactory
/

Meta-Llama-3-8B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Resources

View closed (6)

Bug

#22 opened 2 months ago by

gguf_init_from_file: invalid magic characters '|1

#21 opened 3 months ago by

How to use this model ?

#20 opened 3 months ago by

Create config.json

#19 opened 5 months ago by

how to integrate in rasa chat bot

#18 opened 5 months ago by

Compatibility with llama-cpp and Ollama

#17 opened 6 months ago by

This quantized Llama3 cannot answer in different language like original Meta Llama3 model

#16 opened 6 months ago by

I did what you wrote and changed the model config... same thing

#15 opened 6 months ago by

Still endless output with any gguf if not instruct mode

#14 opened 6 months ago by

--leave-output-tensor !

#13 opened 6 months ago by

🚩 Report

#11 opened 7 months ago by

How to deploy it on Amazon Sagemaker ?

#8 opened 7 months ago by

exlama quants?

#6 opened 7 months ago by

不同版本对性能的要求

#5 opened 7 months ago by

perfect upload. stop conversation when finished.

#4 opened 7 months ago by

what is the meaning of these suffix

#3 opened 7 months ago by