'Tim' Lizhang Chen

lzchenut's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

authored a paper 2 months ago

Cautious Weight Decay

Paper • 2510.12402 • Published Oct 14 • 6

authored 4 papers about 1 year ago

Lion Secretly Solves Constrained Optimization: As Lyapunov Predicts

Paper • 2310.05898 • Published Oct 9, 2023 • 2

Communication Efficient Distributed Training with Distributed Lion

Paper • 2404.00438 • Published Mar 30, 2024 • 2

Memory-Efficient LLM Training with Online Subspace Descent

Paper • 2408.12857 • Published Aug 23, 2024 • 16

Cautious Optimizers: Improving Training with One Line of Code

Paper • 2411.16085 • Published Nov 25, 2024 • 19