Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
mysticbeing
/
Llama-3.1-Nemotron-70B-Instruct-HF-FP8-DYNAMIC
like
4
Text Generation
Safetensors
8 languages
llama
fp8
vllm
conversational
arxiv:
4 papers
License:
llama3.1
Model card
Files
Files and versions
Community
Train
27197b3
Llama-3.1-Nemotron-70B-Instruct-HF-FP8-DYNAMIC
/
generation_config.json
mysticbeing
Upload folder using huggingface_hub
089f622
verified
6 days ago
raw
Copy download link
history
blame
Safe
125 Bytes
{
"bos_token_id"
:
128000
,
"eos_token_id"
:
[
128001
,
128008
,
128009
]
,
"transformers_version"
:
"4.46.1"
}