QuantTrio/Qwen3-30B-A3B-Thinking-2507-AWQ
Text Generation • 31B • Updated • 2.33k • 4
Edit Models filters
Model Tree
Apps
Inference Providers
One-click Deployment
Models
228
Active filters: vLLM
QuantTrio/KAT-V1-40B-GPTQ-Int4-Int8Mix
Text Generation • 47B • Updated • 9
QuantTrio/Qwen3-Coder-30B-A3B-Instruct-GPTQ-Int8
Text Generation • 31B • Updated • 5.37k • 8
QuantTrio/Qwen3-Coder-30B-A3B-Instruct-AWQ
Text Generation • 31B • Updated • 286k • 9
EliovpAI/Qwen3-14B-FP8-KV
Text Generation • 15B • Updated • 16 • 2
QuantTrio/GLM-4.5V-AWQ
Image-Text-to-Text • 17B • Updated • 843 • 19
QuantTrio/Seed-OSS-36B-Instruct-AWQ
Text Generation • 36B • Updated • 2.04k • 8
QuantTrio/Seed-OSS-36B-Instruct-GPTQ-Int8
Text Generation • 36B • Updated • 20 • 4
QuantTrio/Seed-OSS-36B-Instruct-GPTQ-Int4
Text Generation • 36B • Updated • 24 • 5
QuantTrio/Seed-OSS-36B-Instruct-GPTQ-Int3
Text Generation • 34B • Updated • 24 • 3
amakhov/tiny-random-llama
Text Generation • 4.18M • Updated • 341
QuantTrio/KAT-V1-40B-AWQ
Text Generation • 41B • Updated • 15 • 2
QuantTrio/DeepSeek-V3.1-AWQ
Text Generation • 684B • Updated • 161 • 5
QuantTrio/DeepSeek-V3.1-AWQ-Fp16Mix
Text Generation • 684B • Updated • 32 • 1
QuantTrio/DeepSeek-V3.1-AWQ-Lite
Text Generation • 684B • Updated • 87 • 3
JunHowie/Qwen3-4B-Instruct-2507-GPTQ-Int4
Text Generation • 4B • Updated • 4.49k • 4
JunHowie/Qwen3-4B-Instruct-2507-GPTQ-Int8
Text Generation • 4B • Updated • 1.74k
JunHowie/Qwen3-4B-Thinking-2507-GPTQ-Int4
Text Generation • 4B • Updated • 24 • 1
JunHowie/Qwen3-4B-Thinking-2507-GPTQ-Int8
Text Generation • 4B • Updated • 9 • 2
JunHowie/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int4
Text Generation • 31B • Updated • 11.3k
JunHowie/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int8
Text Generation • 31B • Updated • 11
JunHowie/Qwen3-30B-A3B-Thinking-2507-GPTQ-Int4
Text Generation • 31B • Updated • 10
JunHowie/Qwen2-7B-Instruct-GPTQ-Int4
Text Generation • 8B • Updated • 7
JunHowie/Qwen2-7B-Instruct-GPTQ-Int8
Text Generation • 8B • Updated • 9
EliovpAI/Deepseek-R1-0528-Qwen3-8B-FP8-KV
Text Generation • 8B • Updated • 42
JunHowie/Qwen3-30B-A3B-Thinking-2507-GPTQ-Int8
Text Generation • 31B • Updated • 9
JunHowie/Seed-OSS-36B-Instruct-GPTQ-Int4
Text Generation • 36B • Updated • 8
JunHowie/Seed-OSS-36B-Instruct-GPTQ-Int8
Text Generation • 36B • Updated • 8
QuantTrio/Qwen3-VL-235B-A22B-Instruct-AWQ
Text Generation • 236B • Updated • 33k • 13
QuantTrio/Qwen3-VL-235B-A22B-Instruct-FP8
Text Generation • Updated • 125