Text Generation
Transformers
code
Eval Results
Inference Endpoints
Sergey Kostyaev commited on
Commit
4a10c50
1 Parent(s): b9b9229

Requantize models

Browse files

Requantize models after ggml update

starcoder-ggml-q4_0.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:e4e52b000364ad8ecbf3f4ba96652a12c23e45e30fb1a5a69f113a15e86b6e1f
3
- size 11916774288
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:beac3071072969b960c25cf56d81109d2a1a81465c7ab80a62d88ef33db1cef7
3
+ size 10746563472
starcoder-ggml-q4_1.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:65841f7a0ec5be53457077a5069c23502ebddb909c8d9bf91ef91eaf90f6e825
3
- size 14257195920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c75c15b5a1faa24ea839cbfb20a6ac6be4d650382f067ea01c96fc9d07482320
3
+ size 11916774288
starcoder-ggml-q5_0.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:299ffd88f888c6868b98fa138a949de2831d6879c40970a25a02799eb97e3aec
3
  size 13086985104
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2494878d1c4867677b6d068c00a9c7e6b312436ccf0213f1b913c21711eae239
3
  size 13086985104
starcoder-ggml-q5_1.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:c52e0cd23878c3373a8a7f6adb484a00dbae11b1d6bbd84aa20e82378cbb4bfa
3
  size 14257195920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a2f4827e7c9b2a025ebe7931ade7b5de100d31e6f030a362bfeb2af89c4d2230
3
  size 14257195920
starcoder-ggml-q8_0.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2be875afdab1b9e60f825995f852fc14655ec2bec2ae81756aace135c583c6d6
3
- size 21278460816
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:769af86544e37e52fbcbd99552448fc6eb695e440fca0303535db09cd242065d
3
+ size 20108250000