👋 Open to Work

Jen Wei

bird-of-paradise

·

https://birdofparadise.ai/

AI & ML interests

Training dynamics, optimization & algorithm–hardware co-design

Recent Activity

upvoted a paper 3 days ago

Dion3: Full-Stack Orthogonal Updates

upvoted a paper 3 days ago

Weak-to-Strong Generalization via Direct On-Policy Distillation

commentedon a paper 3 days ago

Dion3: Full-Stack Orthogonal Updates

View all activity

Organizations

Articles 9

Article

3

DeepSeek Engram × OLMo-core: Distributed Implementation

Article

3

The Three Horsemen of Numerical Divergence in Hybrid Models

View all Articles

spaces 2

Post Training Techniques Guide

A visual guide to post-training techniques for LLMs

ReTool Implementation

Enhance LLMs with strategic tool use for math problems

models 3

bird-of-paradise/Llama-Hopper-Reasoning-v1

Reinforcement Learning • Updated Feb 6

bird-of-paradise/deepseek-mla

Text Generation • Updated Feb 27, 2025 • 20

bird-of-paradise/deepseek-moe

Text Generation • Updated Feb 27, 2025 • 5

datasets 4

bird-of-paradise/transformer-from-scratch-tutorial

Updated Jan 12 • 169 • 43

bird-of-paradise/muon-tutorial

Viewer • Updated Jan 12 • 3 • 339 • 15

bird-of-paradise/muon-distributed-reproducibility

Updated Nov 30, 2025 • 118 • 2

bird-of-paradise/muon-distributed

Updated Nov 8, 2025 • 87 • 1