YAML Metadata Warning: empty or missing yaml metadata in repo card
Check out the documentation for more information.
Llamacpp Quantization of Qwenstien2.5-32B-Instruct
Original model https://huggingface.co/maldv/Qwenstein2.5-32B-Instruct
All thanks should go to the original model creator.
This is my first quantization of a model so if you find anything wrong with the quant please let me know.
- Downloads last month
- 4
Hardware compatibility
Log In to add your hardware
4-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support