Configuration Parsing Warning:In config.json: "num_experts" must be a number

exolabs/gemma-4-12b-coder-fable5-composer2-5-8bit-text-dequant-bf16

Public dequantized BF16 export for vLLM validation.

  • Internal model id: gemma-4-12b-coder-fable5-composer2-5-8bit
  • MLX source: mlx-community/gemma-4-12b-coder-fable5-composer2.5-8bit
  • Original HF comparison model: yuxinlu1/gemma-4-12B-coder-fable5-composer2.5-v1
  • Export dtype: bfloat16
  • Text-only export: True

This checkpoint is the result of dequantizing the quantized MLX checkpoint. It is not the original upstream BF16 checkpoint.

Downloads last month
8
Safetensors
Model size
12B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support