step3: Config C Kaggle PASS, 0.05 lock pending
Browse files- docs/PROGRESS.md +1 -0
- docs/TEST_REPORT.md +12 -0
docs/PROGRESS.md
CHANGED
|
@@ -33,6 +33,7 @@ Har kaam ke baad yaha entry karo taaki yaad rahe kab kya kiya tha.
|
|
| 33 |
- [x] 2026-09-17: Kaggle session-reset error (no repo after restart) -> `docs/KAGGLE_RUN.md` session-proof cell guide banaya, HF push
|
| 34 |
- [x] 2026-09-17: Step 3 toy test Kaggle PASS (A 0.01: max 0.283 loss 4.9070 / B 0.02: max 0.266 loss 4.9218, dono PASS), TEST_REPORT entry, HF push β balance_weight lock approval pending
|
| 35 |
- [x] 2026-09-17: improve approved β toy me Config C (0.05, 50 steps) joda, HF push β Kaggle re-run pending
|
|
|
|
| 36 |
- [x] 2026-09-17: `docs/ROADMAP_SCRATCH.md` banaya (Step 0-10, status: 0-2 done, agla Step 3 toy-Kaggle), HF push
|
| 37 |
- [ ] TODO: toy router-balance test (Kaggle), FINAL tokenizer (500k lines wait), dense baseline
|
| 38 |
|
|
|
|
| 33 |
- [x] 2026-09-17: Kaggle session-reset error (no repo after restart) -> `docs/KAGGLE_RUN.md` session-proof cell guide banaya, HF push
|
| 34 |
- [x] 2026-09-17: Step 3 toy test Kaggle PASS (A 0.01: max 0.283 loss 4.9070 / B 0.02: max 0.266 loss 4.9218, dono PASS), TEST_REPORT entry, HF push β balance_weight lock approval pending
|
| 35 |
- [x] 2026-09-17: improve approved β toy me Config C (0.05, 50 steps) joda, HF push β Kaggle re-run pending
|
| 36 |
+
- [x] 2026-09-17: Step 3 Config C Kaggle PASS (max 0.199, sab experts β₯5.5%, loss 4.55 β A/B se best), TEST_REPORT entry, HF push β 0.05 lock approval pending
|
| 37 |
- [x] 2026-09-17: `docs/ROADMAP_SCRATCH.md` banaya (Step 0-10, status: 0-2 done, agla Step 3 toy-Kaggle), HF push
|
| 38 |
- [ ] TODO: toy router-balance test (Kaggle), FINAL tokenizer (500k lines wait), dense baseline
|
| 39 |
|
docs/TEST_REPORT.md
CHANGED
|
@@ -56,6 +56,18 @@ Har test ke baad yaha entry hogi: date, env, command, result, verdict.
|
|
| 56 |
- Verdict: PASS β balance_weight lock user-approval pending (candidate: 0.02)
|
| 57 |
- Screenshot verified (user-provided)
|
| 58 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 59 |
## Template (next test ke liye)
|
| 60 |
```
|
| 61 |
## YYYY-MM-DD β <test naam> (<env>)
|
|
|
|
| 56 |
- Verdict: PASS β balance_weight lock user-approval pending (candidate: 0.02)
|
| 57 |
- Screenshot verified (user-provided)
|
| 58 |
|
| 59 |
+
## 2026-09-17 β Step 3 Config C improve attempt (Kaggle, PASS)
|
| 60 |
+
- Env: Kaggle notebook, CPU
|
| 61 |
+
- Cmd: `python model/scripts/toy_router_test.py` (A 0.01/20 steps, B 0.02/20, C 0.05/50 steps)
|
| 62 |
+
- Result:
|
| 63 |
+
- A: loss 5.2516β4.9070, max_share 0.283 β PASS
|
| 64 |
+
- B: loss 5.2706β4.9218, max_share 0.266 β PASS
|
| 65 |
+
- C: loss 5.3277β4.5542, max_share 0.199, usage [0.199,0.131,0.139,0.086,0.086,0.105,0.055,0.199] β PASS (sabse balanced β koi expert idle nahi, sab β₯5.5%)
|
| 66 |
+
- Note: C ke steps zyada (50 vs 20) isliye loss-compare seedha nahi; balance-sudhar me weight + steps dono ka haath. Phir bhi C dono metric me best.
|
| 67 |
+
- Script verdict: locked C (0.05)
|
| 68 |
+
- Verdict: PASS β config lock (0.05) user-approval pending
|
| 69 |
+
- Screenshot verified (user-provided)
|
| 70 |
+
|
| 71 |
## Template (next test ke liye)
|
| 72 |
```
|
| 73 |
## YYYY-MM-DD β <test naam> (<env>)
|