Update README.md
Browse files
README.md
CHANGED
@@ -17,15 +17,36 @@ tags:
|
|
17 |
3 test prompts were used, with initial q2k [original for comparison],
|
18 |
matched against the New Imatrix NEO V1 Q2K and New Imatrix NEO V1 IQ3_XXS upgrades.
|
19 |
|
20 |
-
|
21 |
|
22 |
-
|
|
|
|
|
|
|
|
|
23 |
|
24 |
Tech was developed in house by DAVID_AU for the specialized "IMATRIX NEO V1 upgrades."
|
25 |
|
26 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
27 |
|
28 |
-
Upgrades really "shine" on longer form generation (prompts #2 and #3 below).
|
29 |
|
30 |
PPL notes:
|
31 |
|
|
|
17 |
3 test prompts were used, with initial q2k [original for comparison],
|
18 |
matched against the New Imatrix NEO V1 Q2K and New Imatrix NEO V1 IQ3_XXS upgrades.
|
19 |
|
20 |
+
These tests do not display the full level / extent of upgrades, this is a test run to show initial upgrades / changes.
|
21 |
|
22 |
+
Higher quants will result in significantly higher quality.
|
23 |
+
|
24 |
+
4 quants can be downloaded now, including to potent "IQ4_XS".
|
25 |
+
|
26 |
+
Additional quants are uploading...
|
27 |
|
28 |
Tech was developed in house by DAVID_AU for the specialized "IMATRIX NEO V1 upgrades."
|
29 |
|
30 |
+
The NEO Class tech was created after countless investigations and over 120 lab experiments backed by
|
31 |
+
real world testing and qualitative results.
|
32 |
+
|
33 |
+
NEO Class results:
|
34 |
+
|
35 |
+
Better overall function, instruction following, output quality and stronger connections to ideas, concepts and the world in general.
|
36 |
+
|
37 |
+
In addition quants now operate above their "grade" so to speak :
|
38 |
+
|
39 |
+
IE: Q4 / IQ4 operate at Q5KM/Q6 levels.
|
40 |
+
|
41 |
+
Likewise for Q3/IQ3 operate at Q4KM/Q5 levels.
|
42 |
+
|
43 |
+
The examples below illustrate the least amount of improvement using some of the lowest quants.
|
44 |
+
|
45 |
+
Prompts tested with "temp=0" to ensure compliance, 2048 context (model supports 131,000 context / 128k), and "chat" template for COMMAND-R.
|
46 |
+
|
47 |
+
Additional parameters are also minimized.
|
48 |
|
49 |
+
NEO Upgrades really "shine" on longer form generation (prompts #2 and #3 below).
|
50 |
|
51 |
PPL notes:
|
52 |
|