ViuAI commited on
Commit
08e2210
Β·
verified Β·
1 Parent(s): bda5ab6

step3: Config C Kaggle PASS, 0.05 lock pending

Browse files
Files changed (2) hide show
  1. docs/PROGRESS.md +1 -0
  2. docs/TEST_REPORT.md +12 -0
docs/PROGRESS.md CHANGED
@@ -33,6 +33,7 @@ Har kaam ke baad yaha entry karo taaki yaad rahe kab kya kiya tha.
33
  - [x] 2026-09-17: Kaggle session-reset error (no repo after restart) -> `docs/KAGGLE_RUN.md` session-proof cell guide banaya, HF push
34
  - [x] 2026-09-17: Step 3 toy test Kaggle PASS (A 0.01: max 0.283 loss 4.9070 / B 0.02: max 0.266 loss 4.9218, dono PASS), TEST_REPORT entry, HF push β€” balance_weight lock approval pending
35
  - [x] 2026-09-17: improve approved β€” toy me Config C (0.05, 50 steps) joda, HF push β€” Kaggle re-run pending
 
36
  - [x] 2026-09-17: `docs/ROADMAP_SCRATCH.md` banaya (Step 0-10, status: 0-2 done, agla Step 3 toy-Kaggle), HF push
37
  - [ ] TODO: toy router-balance test (Kaggle), FINAL tokenizer (500k lines wait), dense baseline
38
 
 
33
  - [x] 2026-09-17: Kaggle session-reset error (no repo after restart) -> `docs/KAGGLE_RUN.md` session-proof cell guide banaya, HF push
34
  - [x] 2026-09-17: Step 3 toy test Kaggle PASS (A 0.01: max 0.283 loss 4.9070 / B 0.02: max 0.266 loss 4.9218, dono PASS), TEST_REPORT entry, HF push β€” balance_weight lock approval pending
35
  - [x] 2026-09-17: improve approved β€” toy me Config C (0.05, 50 steps) joda, HF push β€” Kaggle re-run pending
36
+ - [x] 2026-09-17: Step 3 Config C Kaggle PASS (max 0.199, sab experts β‰₯5.5%, loss 4.55 β€” A/B se best), TEST_REPORT entry, HF push β€” 0.05 lock approval pending
37
  - [x] 2026-09-17: `docs/ROADMAP_SCRATCH.md` banaya (Step 0-10, status: 0-2 done, agla Step 3 toy-Kaggle), HF push
38
  - [ ] TODO: toy router-balance test (Kaggle), FINAL tokenizer (500k lines wait), dense baseline
39
 
docs/TEST_REPORT.md CHANGED
@@ -56,6 +56,18 @@ Har test ke baad yaha entry hogi: date, env, command, result, verdict.
56
  - Verdict: PASS β€” balance_weight lock user-approval pending (candidate: 0.02)
57
  - Screenshot verified (user-provided)
58
 
 
 
 
 
 
 
 
 
 
 
 
 
59
  ## Template (next test ke liye)
60
  ```
61
  ## YYYY-MM-DD β€” <test naam> (<env>)
 
56
  - Verdict: PASS β€” balance_weight lock user-approval pending (candidate: 0.02)
57
  - Screenshot verified (user-provided)
58
 
59
+ ## 2026-09-17 β€” Step 3 Config C improve attempt (Kaggle, PASS)
60
+ - Env: Kaggle notebook, CPU
61
+ - Cmd: `python model/scripts/toy_router_test.py` (A 0.01/20 steps, B 0.02/20, C 0.05/50 steps)
62
+ - Result:
63
+ - A: loss 5.2516β†’4.9070, max_share 0.283 β†’ PASS
64
+ - B: loss 5.2706β†’4.9218, max_share 0.266 β†’ PASS
65
+ - C: loss 5.3277β†’4.5542, max_share 0.199, usage [0.199,0.131,0.139,0.086,0.086,0.105,0.055,0.199] β†’ PASS (sabse balanced β€” koi expert idle nahi, sab β‰₯5.5%)
66
+ - Note: C ke steps zyada (50 vs 20) isliye loss-compare seedha nahi; balance-sudhar me weight + steps dono ka haath. Phir bhi C dono metric me best.
67
+ - Script verdict: locked C (0.05)
68
+ - Verdict: PASS β€” config lock (0.05) user-approval pending
69
+ - Screenshot verified (user-provided)
70
+
71
  ## Template (next test ke liye)
72
  ```
73
  ## YYYY-MM-DD β€” <test naam> (<env>)