SpikingKiki-35B-A3B-V4 โ€” partial upload of a rate-coded SNN conversion (deprecated)

Deprecated / incomplete. This repository contains 9 988 per-module .npz files (19.9 GB) out of the 31 070 modules (โ‰ˆ58-70 GB) produced by the conversion. Entire expert and attention modules are missing (e.g. layer 0 has 168 of 256 experts; self_attn.o_proj is present for 1 of 40 layers). It cannot be loaded as a model. The complete artefact exists only on the (now powered-off) build host.

What the full artefact was: a lossless ANN-to-SNN (LAS) rate-coded conversion of Qwen/Qwen3.6-35B-A3B, each linear module replaced by an integrate-and-fire surrogate (T = 128 timesteps, nominal threshold 0.0625, tau 1.0; per-module thresholds recorded in lif_metadata.json). Not a fused model and not sharded weights: one .npz per module.

Recipe

Item Value
Source Qwen/Qwen3.6-35B-A3B BF16 weights
Script scripts/convert_spikingkiki_35b.py in hypneum-lab/micro-kiki
Parameters T = 128, threshold 0.0625 (nominal), tau 1.0
Output 31 070 module files; 40/40 transformer blocks (Phase C)
Validation 99.5 % sane modules on N = 200 (Phase E)
Uploaded here 9 988 modules, lif_metadata.json, .convert_state.json

Build host & cost

Mac Studio M3 Ultra 512 GB; 1 h 08 wall-clock with 4-worker block-range parallelism (11 086 s reported in the tuner repo). Energy: not recorded. Host off since 2026-10.

Evaluation

No functional evaluation (no quantisation, smoke test or energy benchmark was run after the conversion). The 0.032 mJ/token figure in the project README is a theoretical estimate, not a measurement.

Status / what to do

Either complete the upload from the original host, or treat this repository as an archive of metadata only. Downstream consumer hypneum-lab/dream-of-kiki (DREAM_MICRO_KIKI_REAL=1) cannot use the partial set.

Citation

micro-kiki concept DOI 10.5281/zenodo.19666759.

Provenance

https://github.com/hypneum-lab/micro-kiki (docs/training/spikingkiki-conversion-runbook.md, results/spikingkiki-35b-analysis.json) ยท https://github.com/ailiance/ailiance-mac-tuner

EU AI Act transparency

Derived (converted) weights of Qwen/Qwen3.6-35B-A3B, no additional training data; provider Clรฉment Saillant / L'Electron Rare for Hypneum Lab; research-only; contact clement@saillant.cc.

Downloads last month

-

Downloads are not tracked for this model. How to track
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for clemsail/spikingkiki-35b-a3b-v4

Finetuned
(426)
this model