Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Log In
Sign Up
QuantTrio
/
DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Medium
like
1
Follow
QuantTrio
238
Text Generation
Transformers
Safetensors
deepseek_v3
DeepSeek-R1-0528
GPTQ
Int4-Int8Mix
量化修复
vLLM
conversational
custom_code
text-generation-inference
4-bit precision
gptq
arxiv:
2501.12948
License:
mit
Model card
Files
Files and versions
xet
Community
2
Deploy
Use this model
2318058
DeepSeek-R1-0528-GPTQ-Int4-Int8Mix-Medium
15 GB
2 contributors
History:
5 commits
JunHowie
Upload model-00002-of-00096.safetensors with huggingface_hub
2318058
verified
9 months ago
figures
Upload folder using huggingface_hub
9 months ago
.gitattributes
1.64 kB
Upload folder using huggingface_hub
9 months ago
LICENSE
1.06 kB
Upload folder using huggingface_hub
9 months ago
README.md
9.45 kB
Upload folder using huggingface_hub
9 months ago
config.json
1.88 kB
Upload folder using huggingface_hub
9 months ago
configuration.json
48 Bytes
Upload folder using huggingface_hub
9 months ago
configuration_deepseek.py
9.9 kB
Upload folder using huggingface_hub
9 months ago
generation_config.json
171 Bytes
Upload folder using huggingface_hub
9 months ago
gptq_marlin.py
26.9 kB
Upload folder using huggingface_hub
9 months ago
model-00002-of-00096.safetensors
5 GB
xet
Upload model-00002-of-00096.safetensors with huggingface_hub
9 months ago
model-00004-of-00096.safetensors
5 GB
xet
Upload model-00004-of-00096.safetensors with huggingface_hub
9 months ago
model-00005-of-00096.safetensors
5 GB
xet
Upload model-00005-of-00096.safetensors with huggingface_hub
9 months ago
model.safetensors.index.json
16.7 MB
xet
Upload folder using huggingface_hub
9 months ago
modeling_deepseek.py
75.7 kB
Upload folder using huggingface_hub
9 months ago
tokenizer.json
7.85 MB
Upload folder using huggingface_hub
9 months ago
tokenizer_config.json
3.96 kB
Upload folder using huggingface_hub
9 months ago
