What is the best sampling config?
#1
by pootow - opened
What is the best value for temperature, top_k, top_p, etc.?
We recommend:
top_p=0.95temperature=0.6max_tokens=64000
alpayariyak changed discussion status to closed
What is the best value for temperature, top_k, top_p, etc.?
We recommend:
top_p= 0.95temperature = 0.6max_tokens = 64000