Audit fix: Update model/configs/viu_1_5b_moe_config.yaml for ViuMini-Dense-360M
Browse files
model/configs/viu_1_5b_moe_config.yaml
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
-
#
|
| 2 |
-
#
|
| 3 |
# Deep Hierarchical Reasoning (Gemma-2 Style 42 Layers x 28 Experts = 1,176 Micro-Experts)
|
| 4 |
|
| 5 |
dim: 768
|
|
|
|
| 1 |
+
# [DEPRECATED / LEGACY ARCHIVE] — Active 32L Dense model uses: viu1_dense_config.yaml
|
| 2 |
+
# VIU-1.5B Frontier MoE Architecture (Archived)
|
| 3 |
# Deep Hierarchical Reasoning (Gemma-2 Style 42 Layers x 28 Experts = 1,176 Micro-Experts)
|
| 4 |
|
| 5 |
dim: 768
|