DavidAU commited on
Commit
2ab058c
1 Parent(s): a9704f0

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +25 -4
README.md CHANGED
@@ -17,15 +17,36 @@ tags:
17
  3 test prompts were used, with initial q2k [original for comparison],
18
  matched against the New Imatrix NEO V1 Q2K and New Imatrix NEO V1 IQ3_XXS upgrades.
19
 
20
- (this does not display the full level / extent of upgrades, this is a test run to show initial upgrades / changes.)
21
 
22
- 3 quants noted can be downloaded now. Other quants will upload at a later date.
 
 
 
 
23
 
24
  Tech was developed in house by DAVID_AU for the specialized "IMATRIX NEO V1 upgrades."
25
 
26
- Prompts tested with "temp=0" to ensure compliance, 2048 context (model supports 131,000 context / 128k), and "chat" template for COMMAND-R.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
27
 
28
- Upgrades really "shine" on longer form generation (prompts #2 and #3 below).
29
 
30
  PPL notes:
31
 
 
17
  3 test prompts were used, with initial q2k [original for comparison],
18
  matched against the New Imatrix NEO V1 Q2K and New Imatrix NEO V1 IQ3_XXS upgrades.
19
 
20
+ These tests do not display the full level / extent of upgrades, this is a test run to show initial upgrades / changes.
21
 
22
+ Higher quants will result in significantly higher quality.
23
+
24
+ 4 quants can be downloaded now, including to potent "IQ4_XS".
25
+
26
+ Additional quants are uploading...
27
 
28
  Tech was developed in house by DAVID_AU for the specialized "IMATRIX NEO V1 upgrades."
29
 
30
+ The NEO Class tech was created after countless investigations and over 120 lab experiments backed by
31
+ real world testing and qualitative results.
32
+
33
+ NEO Class results:
34
+
35
+ Better overall function, instruction following, output quality and stronger connections to ideas, concepts and the world in general.
36
+
37
+ In addition quants now operate above their "grade" so to speak :
38
+
39
+ IE: Q4 / IQ4 operate at Q5KM/Q6 levels.
40
+
41
+ Likewise for Q3/IQ3 operate at Q4KM/Q5 levels.
42
+
43
+ The examples below illustrate the least amount of improvement using some of the lowest quants.
44
+
45
+ Prompts tested with "temp=0" to ensure compliance, 2048 context (model supports 131,000 context / 128k), and "chat" template for COMMAND-R.
46
+
47
+ Additional parameters are also minimized.
48
 
49
+ NEO Upgrades really "shine" on longer form generation (prompts #2 and #3 below).
50
 
51
  PPL notes:
52