ru1ch3n commited on
Commit
ab1197f
·
verified ·
1 Parent(s): 2b0d578

Card: E6 weights and the path D retrains (October 2026)

Browse files
Files changed (1) hide show
  1. README.md +33 -4
README.md CHANGED
@@ -81,8 +81,9 @@ PyTorch payload: `torch.load(path, map_location="cpu", weights_only=False)` retu
81
 
82
  The trained models behind the October 2026 revision results of the benchmark code
83
  (`results/revision_october/`, frozen recipes in `configs/paper/october/recipes.yaml`): one entry for every
84
- trained run that has scored test views in those tables, 651 runs in the cohorts
85
- P4, P5, P6, P7, V4C, V4D, V4E, V4P6, V4P7, N3GJ2, N5MXR6, N6, N8, RPB and RPBn. Runs that failed during training (they are listed with their failure in the result tables) and
 
86
  the recipe-screen runs have no model here. The training and test data are the V2 views in the companion
87
  dataset, under `october2026/`.
88
 
@@ -105,10 +106,11 @@ result tables.
105
  the file before the weights were extracted. `torch.load(path, map_location="cpu", weights_only=True)["model_state"]`
106
  loads it.
107
  - **Rescoring.** For the cohorts with a frozen recipe in `configs/paper/october/recipes.yaml` (P4, P5, V4C, V4D,
108
- N3GJ2, N5MXR6, N6, RPB, RPBn), `reproduce/october/replay_inference.py --run <run_id> --checkpoint weights.pt
109
  --data-root <download>/october2026/v2` rebuilds the network, re-predicts the run's test views and compares each
110
  view mean with the stored score (relative tolerance 1e-4; recorded checks on CUDA and CPU are in
111
- `reproduce/october/README.md`). V4E is listed in `recipes.yaml` as four information cells that the replay script does not rebuild; P6, P7, V4P6, V4P7 and N8 have no entry (they reuse the P4 or V4C recipe of their slice with one change: training-set size, noise, input fill, mixture or grid). The FNOs were
 
112
  trained and scored with cuFFT; on a CPU the script reproduces cuFFT's large-batch inverse real FFT
113
  (`pdeobs.revision.fftcompat`).
114
  - **Checked after upload.** Every `weights.pt` on the Hub has the SHA-256 listed in its manifest part (checked
@@ -117,6 +119,33 @@ result tables.
117
  (Raonic et al.; Zenodo record 10406879, CC BY 4.0). That data is not redistributed here; to rescore these
118
  models, download it from Zenodo and convert it with `python -m pdeobs.revision.external.rpb`.
119
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
120
  ## Citation
121
 
122
  Ruichen Xu, Siyao Wang, Fang Wan, Jiacheng Qiu, Wenhan Gao, Jiaxing Zhang, Linsey Pang, Ravid Shwartz-Ziv, Yann LeCun and
 
81
 
82
  The trained models behind the October 2026 revision results of the benchmark code
83
  (`results/revision_october/`, frozen recipes in `configs/paper/october/recipes.yaml`): one entry for every
84
+ trained run that has scored test views in those tables, 663 runs in the cohorts
85
+ P4, P5, P6, P7, V4C, V4D, V4E, V4P6, V4P7, N3GJ2, N5MXR6, N6, N8, RPB, RPBn and E6 (the 12 E6 runs, nearest-fill
86
+ copies of zero-fill FNO runs, were added on 2026-10-21 as upload part 3). Runs that failed during training (they are listed with their failure in the result tables) and
87
  the recipe-screen runs have no model here. The training and test data are the V2 views in the companion
88
  dataset, under `october2026/`.
89
 
 
106
  the file before the weights were extracted. `torch.load(path, map_location="cpu", weights_only=True)["model_state"]`
107
  loads it.
108
  - **Rescoring.** For the cohorts with a frozen recipe in `configs/paper/october/recipes.yaml` (P4, P5, V4C, V4D,
109
+ N3GJ2, N5MXR6, N6, RPB, RPBn, E6), `reproduce/october/replay_inference.py --run <run_id> --checkpoint weights.pt
110
  --data-root <download>/october2026/v2` rebuilds the network, re-predicts the run's test views and compares each
111
  view mean with the stored score (relative tolerance 1e-4; recorded checks on CUDA and CPU are in
112
+ `reproduce/october/README.md`; an E6 run, Poisson rough G256 seed 1101, replayed on a CPU matches its stored
113
+ scores to 2e-7). V4E is listed in `recipes.yaml` as four information cells that the replay script does not rebuild; P6, P7, V4P6, V4P7 and N8 have no entry (they reuse the P4 or V4C recipe of their slice with one change: training-set size, noise, input fill, mixture or grid). The FNOs were
114
  trained and scored with cuFFT; on a CPU the script reproduces cuFFT's large-batch inverse real FFT
115
  (`pdeobs.revision.fftcompat`).
116
  - **Checked after upload.** Every `weights.pt` on the Hub has the SHA-256 listed in its manifest part (checked
 
119
  (Raonic et al.; Zenodo record 10406879, CC BY 4.0). That data is not redistributed here; to rescore these
120
  models, download it from Zenodo and convert it with `python -m pdeobs.revision.external.rpb`.
121
 
122
+ ## Path D retrains (`october2026/retrains/`)
123
+
124
+ Ten retrains of Poisson medium U256 runs from the public package with `reproduce/october/train_run.py` of the benchmark
125
+ code (reproduction path D, 2026-10-18 to 2026-10-21): P4 FNO seed 1102, P4 Voronoi-CNN seeds 1101-1103, V4C FNO seeds
126
+ 1101-1103 and P4n FNO seeds 1101-1103. P4n is the P4 recipe with `--set v4_norm=train_scalar`: the training-set normaliser
127
+ is its only change. The P4 FNO retrains of seeds 1101 and 1103 collapsed to a constant output, as the original runs did,
128
+ and have no model.
129
+
130
+ ```
131
+ october2026/retrains/<name>/
132
+ weights.pt same format as the October models
133
+ model.json recipe run, --set overrides, final training loss, normaliser, the seven v2eval7 view means of the
134
+ retrain, original and released SHA-256
135
+ history.json per-epoch training history (numeric fields only)
136
+ october2026/retrains/manifest.json the model.json records, and the two retrains without a model
137
+ ```
138
+
139
+ These are retrains, not the campaign's models. Retraining is not bit-identical, so their scores differ from the stored
140
+ scores of the original runs; results and discussion are in `reproduce/october/README.md` of the benchmark code. Rescore a
141
+ retrain with its recipe run and the same `--set` (on a CPU, the P4n seed 1101 replay reproduces the view means in its
142
+ `model.json` to 9e-7):
143
+
144
+ ```bash
145
+ python reproduce/october/replay_inference.py --run P4__poisson__ell009__fno__U256__s1101 --set v4_norm=train_scalar \
146
+ --checkpoint october2026/retrains/P4n__poisson__ell009__fno__U256__s1101/weights.pt --data-root <download>/october2026/v2
147
+ ```
148
+
149
  ## Citation
150
 
151
  Ruichen Xu, Siyao Wang, Fang Wan, Jiacheng Qiu, Wenhan Gao, Jiaxing Zhang, Linsey Pang, Ravid Shwartz-Ziv, Yann LeCun and