ALIA-40b-instruct-2601 GPTQ INT4 3b

Aquesta és una versió quantitzada a 3-bits del model ALIA-40b-instruct-2601 del BSC-LT.

Downloads last month
27
Safetensors
Model size
4B params
Tensor type
F16
·
I32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for agustim/ALIA-40b-GPTQ-INT4_3b

Base model

BSC-LT/ALIA-40b
Quantized
(8)
this model