Konwoo Kim's picture

Konwoo Kim

konwoo

·

AI & ML interests

None yet

Recent Activity

updated a collection 6 days ago

Data-efficient pre-training by scaling synthetic megadocs

updated a collection 6 days ago

Data-efficient pre-training by scaling synthetic megadocs

updated a collection 6 days ago

Data-efficient pre-training by scaling synthetic megadocs

View all activity

Organizations

Collections 3

View 3 collections

models 46

konwoo/300m4kcda-203Mx8-dcr-plus-z8-pow-0.75-cos-lr0.0030-wd0.40-bs64

0.3B • Updated 6 days ago • 12

konwoo/300m4kcda-203Mx8-dcr-plus-z4-pow-0.75-cos-lr0.0030-wd0.80-bs64

0.3B • Updated 6 days ago • 11

konwoo/300m4kcda-203Mx8-dcr-plus-w2-pow-0.75-cos-lr0.0030-wd0.80-bs64

0.3B • Updated 6 days ago • 12

konwoo/300m4kcda-203Mx8-dcr-plus-s8-pow-0.75-cos-lr0.0030-wd0.80-bs64

0.3B • Updated 6 days ago • 12

konwoo/300m4kcda-203Mx8-dcr-plus-s4-pow-0.75-cos-lr0.0030-wd0.80-bs64

0.3B • Updated 6 days ago • 11

konwoo/300m4kcda-203Mx8-dcr-plus-b4-pow-0.75-cos-lr0.0030-wd0.40-bs64

0.3B • Updated 6 days ago • 12

konwoo/300m4kcda-203Mx4-dcr-plus-z2-pow-0.75-cos-lr0.0030-wd0.80-bs64

0.3B • Updated 6 days ago • 9

konwoo/300m4kcda-203Mx4-dcr-plus-w2s-pow-0.75-cos-lr0.0030-wd0.80-bs64

0.3B • Updated 6 days ago • 10

konwoo/300m4kcda-203Mx32-dcr-plus-z32-pow-0.9-cos-lr0.0010-wd0.40-bs64

0.3B • Updated 6 days ago • 12

konwoo/300m4kcda-203Mx32-dcr-plus-b32-pow-0.9-cos-lr0.0010-wd0.40-bs64

0.3B • Updated 6 days ago • 8

datasets 305

konwoo/dclm-val-500-long

Viewer • Updated 16 days ago • 500 • 16

konwoo/dclm-val-500-short

Viewer • Updated 16 days ago • 500 • 17

konwoo/dclm-164k-512cot-l32-dedup-shuffled

Viewer • Updated 26 days ago • 164k • 52

konwoo/dclm-164k-512cot-l16-dedup-shuffled

Viewer • Updated 26 days ago • 164k • 45

konwoo/dclm-164k-512cot-l8-dedup-shuffled

Viewer • Updated 26 days ago • 164k • 37

konwoo/dclm-164k-512cot-l4-dedup-shuffled

Viewer • Updated 26 days ago • 164k • 31

konwoo/dclm-164k-512cot-l2-dedup-shuffled

Viewer • Updated 26 days ago • 164k • 25

konwoo/wicpt-512cot-merged-nodoc-cpr16

Viewer • Updated 26 days ago • 2.79M • 61

konwoo/wicpt-512cot-merged-doc-cpr16

Viewer • Updated 26 days ago • 2.95M • 65

konwoo/wicpt-512cot-merged-nodoc-cpr1

Viewer • Updated 26 days ago • 328k • 26

View 305 datasets