Rope fix?
#2
by
DataPhreak
- opened
Just curious, is this model from before or after the rope fix outlined in this: https://github.com/ggerganov/llama.cpp/issues/8650
Good question, I think it was made before the rope fix unfortunately
Even the newest version appears to have issues at 128K