Hugging Face's logo

kyrha
/
rwkv.cpp.quantize

Model card Files
xet
Community
kyrha commited on
Commit
c298723
·
1 Parent(s): 33129d8

Upload 6 files

Browse files

Add Q8 14B, 7B
Add Q4_2 14B, 7B

Files changed (6) hide show
  1. Q4_2-rwkv.cpp-14b-v11.bin +3 -0
  2. Q4_2-rwkv.cpp-7b-v9.bin +3 -0
  3. Q8_0-RWKV-4-Raven-14B-v11x-Eng99%-Other1%-20230501-ctx8192.bin +3 -0
  4. Q8_0-RWKV-4-Raven-7B-v11x-Eng99%-Other1%-20230429-ctx8192.bin +3 -0
  5. Q8_0-rwkv.cpp-14b-v11.bin +3 -0
  6. Q8_0-rwkv.cpp-7b-v9.bin +3 -0
Q4_2-rwkv.cpp-14b-v11.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0352c411955c69f9832654c0889177950847f9eda9f192914293cab4253682d1
3
+ size 9558476069
Q4_2-rwkv.cpp-7b-v9.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a4c0ccaf9b60c9b3c1518f74664339654942158b4cb925cd8d84e082defc46cd
3
+ size 5191671229
Q8_0-RWKV-4-Raven-14B-v11x-Eng99%-Other1%-20230501-ctx8192.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1cb56cd7784264a8f0ed2efd17a97f4866075915f2b1a8497c1abb826edade8b
3
+ size 16374220069
Q8_0-RWKV-4-Raven-7B-v11x-Eng99%-Other1%-20230429-ctx8192.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:75d252da63405e9897bff2957f9b6b1c94d496a50e4772d5fc1ec22fb048f9b5
3
+ size 8681332157
Q8_0-rwkv.cpp-14b-v11.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8689591248cbe44a20ec7d1df43adb6b2b7be03d2c155ed0a46775b52d37b901
3
+ size 16374220069
Q8_0-rwkv.cpp-7b-v9.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:18ba0b6751e2660e5bd38649b9a79e1a393fa2a8be4ebe5de922e2fd96307386
3
+ size 8681332157