Xingyu Zhu
JupiterZhu
AI & ML interests
None yet
Recent Activity
upvoted a paper 6 days ago
Periodic Weak Spots: Phase Sensitivity from Chunked KV-Cache Compression submitted a paper 6 days ago
Periodic Weak Spots: Phase Sensitivity from Chunked KV-Cache Compression authored a paper 7 days ago
Periodic Weak Spots: Phase Sensitivity from Chunked KV-Cache CompressionOrganizations
T2MLR pretraining checkpoints: 3 scales x 2 token budgets, trained from scratch on FineWeb-Edu.
-
JupiterZhu/T2MLR_135M_lstart13_lend18_10B_FineWebEdu
Text Generation • 0.2B • Updated • 51 -
JupiterZhu/T2MLR_135M_lstart13_lend18_50B_FineWebEdu
Text Generation • 0.2B • Updated • 54 -
JupiterZhu/T2MLR_362M_lstart9_lend24_10B_FineWebEdu
Text Generation • 0.4B • Updated • 55 -
JupiterZhu/T2MLR_362M_lstart9_lend24_50B_FineWebEdu
Text Generation • 0.4B • Updated • 53
T2MLR pretraining checkpoints: 3 scales x 2 token budgets, trained from scratch on FineWeb-Edu.
-
JupiterZhu/T2MLR_135M_lstart13_lend18_10B_FineWebEdu
Text Generation • 0.2B • Updated • 51 -
JupiterZhu/T2MLR_135M_lstart13_lend18_50B_FineWebEdu
Text Generation • 0.2B • Updated • 54 -
JupiterZhu/T2MLR_362M_lstart9_lend24_10B_FineWebEdu
Text Generation • 0.4B • Updated • 55 -
JupiterZhu/T2MLR_362M_lstart9_lend24_50B_FineWebEdu
Text Generation • 0.4B • Updated • 53
models 6
JupiterZhu/T2MLR_982M_lstart9_lend24_50B_FineWebEdu
Text Generation • 1B • Updated • 54
JupiterZhu/T2MLR_982M_lstart9_lend24_10B_FineWebEdu
Text Generation • 1B • Updated • 58
JupiterZhu/T2MLR_362M_lstart9_lend24_50B_FineWebEdu
Text Generation • 0.4B • Updated • 53
JupiterZhu/T2MLR_362M_lstart9_lend24_10B_FineWebEdu
Text Generation • 0.4B • Updated • 55
JupiterZhu/T2MLR_135M_lstart13_lend18_50B_FineWebEdu
Text Generation • 0.2B • Updated • 54
JupiterZhu/T2MLR_135M_lstart13_lend18_10B_FineWebEdu
Text Generation • 0.2B • Updated • 51
datasets 0
None public yet