How much memory is needed if you make the 128k context length

#13
by ggbondcxk - opened

How much memory is needed if you make the 128k context length

直接下载deepseek v2 chat就能跑128k吗?我看config.json有的,但是超过一定长度,输出就为空了。如果输出长度设置为100k,就会报错

Sign up or log in to comment