spoomplesmaxx-mockingbird-36B β€” MLX 3-bit

3-bit MLX quant of spoomplesmaxx-mockingbird-36B for Apple silicon. ~18 GB on disk β€” runs on a 24 GB Mac with room to breathe, comfortable on 32 GB.

pip install mlx-lm
mlx_lm.chat --model aimeri/spoomplesmaxx-mockingbird-36B-mlx-3bit \
  --temp 1.0 --top-p 0.9

The seed-native chat template ships in the tokenizer config; mlx_lm.chat and LM Studio use it automatically.

Sampling β€” read this part

temperature 1.0 Β· top_p 0.9 Β· no penalties

⚠ Never use repetition, presence, or frequency penalties. The template ends every message with <seed:eos>; context-wide penalties suppress that token, the model stops ending its turns, and generation degenerates into the base model's untrained Chinese vocabulary.

Usable temperature window is ~0.95–1.05: lower loops verbatim, higher frays. Full details on the main model card.

mimids 01 Β· Apache 2.0

Downloads last month
18
Safetensors
Model size
36B params
Tensor type
U32
Β·
BF16
Β·
MLX
Hardware compatibility
Log In to add your hardware

3-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for aimeri/spoomplesmaxx-mockingbird-36B-mlx-3bit

Collection including aimeri/spoomplesmaxx-mockingbird-36B-mlx-3bit