From 44GB (full precision) to 7GB, 4.5 bit quantized!
- Downloads last month
- 34
Model size
12B params
Tensor type
U32
·
BF16 ·
Hardware compatibility
Log In to add your hardware
4-bit
Model tree for mstyslavity/mamay-12b-mlx-optiq_4bit
Base model
shportix/MamayLM-Gemma-3-12B-IT-W4A16