QuantTrio
/

KAT-V1-40B-GPTQ-Int4-Int8Mix

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

KAT-V1-40B-GPTQ-Int4-Int8Mix / configuration.json

JunHowie's picture

Upload folder using huggingface_hub

12b36ba verified 6 months ago

history blame contribute delete

73 Bytes

{"framework": "pytorch", "task": "text-generation", "allow_remote": true}