Hermes-2-Pro-Mistral-7B-4bit-32g-GPTQ / generation_config.json
justinthelaw's picture
add model files and update README.md
7ee0383 verified
raw
history blame
136 Bytes
{
"_from_model_config": true,
"bos_token_id": 1,
"do_sample": true,
"eos_token_id": 32000,
"transformers_version": "4.38.2"
}