The space demo‘s inference parameters

#8
by a-r-c - opened

such as Top_p,Temperature,presence_penalty等

You can find this information if you click the "download" icon that appears next to your prompt when you hover over it. This is what it shows:
model": "01-ai/Yi-34B-Chat",
"parameters": {
"temperature": 0.3,
"truncate": 1000,
"max_new_tokens": 1024,
"top_p": 0.8,
"top_k": 50,
"repetition_penalty": 0,
"max_tokens": 1024,
"return_full_text": false

As it seems like your question has been answered, if there is nothing else we can help you with on this matter, we will be closing this discussion for now.

If you have any further questions, feel free to reopen this discussion or start a new one.

Thank you for your contribution to this community!

richardllin changed discussion status to closed

Sign up or log in to comment