Configuration Parsing Warning: In config.json: "quantization_config.bits" must be an integer

4.5bpw EXL2 quant of https://huggingface.co/TheDrummer/Cydonia-22B-v1.3

6bit heads. Default measurement dataset.

Downloads last month
3
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support