README.md

An attempt to make ParasiticRogue's model a tad better on longer contexts. I just ran the script, all credit for the original merge goes to my friend.

Exl2 quants already being uploaded by him: https://huggingface.co/ParasiticRogue/RP-Stew-v2.5-34B-exl2-4.65

Also, my samplers, instruct and prompt for the model (updated, new format):

Samplers: https://files.catbox.moe/8ficm1.json

Instruct: https://files.catbox.moe/nlflxw.json

Story String: https://files.catbox.moe/6bk6gj.json

If you're using Vectors (I use them for summaries of different story arcs):

Alternative samplers and an "old" version of the prompt, plus instruct (classic format):

Samplers: https://files.catbox.moe/ef67mj.json

Instruct: https://files.catbox.moe/uba6o1.json

Story String: https://files.catbox.moe/t5gfun.json

I'm unsure which one works better, so it's up to your tests.

models:
  - model: F:\Merge\ParasiticRogue_Nontoxic-PiVoT-Bagel-RP-34b
    parameters:
      weight: 0.16
      density: 0.42
  - model: F:\Merge\ParasiticRogue_Nyakura-CausalLM-RP-34B
    parameters:
      weight: 0.22
      density: 0.54
  - model: F:\Merge\migtissera_Tess-34B-v1.5b
    parameters:
      weight: 0.28
      density: 0.66
  - model: F:\Merge\brucethemoose_Capybara-Fixed-Temp
    parameters:
      weight: 0.34
      density: 0.78
merge_method: dare_ties
base_model: F:\Merge\chargoddard_Yi-34B-200K-Llama
parameters:
  int8_mask: true
dtype: bfloat16