Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

autoquant-agent

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

31

Base only

Active filters: autoquant-agent

INCModel3/Qwen3.5-9B-MXFP8-CT-AutoRound

Text Generation • 10B • Updated Aug 21 • 430

INCModel3/Qwen3.5-35B-A3B-MXFP8-CT-AutoRound

Text Generation • 36B • Updated Aug 21 • 34

LeaderboardModel1/gpt-oss-20b-AutoRound-MXFP8

Text Generation • 21B • Updated Aug 24 • 133

INCModel3/gemma-4-31B-MXFP8-CT-AutoRound

Text Generation • 31B • Updated Aug 21 • 33

LeaderboardModel1/gemma-4-26B-AutoRound-MXFP8

Text Generation • 26B • Updated Aug 23 • 15

LeaderboardModel1/gemma-4-26B-A4B-AutoRound-MXFP8

Text Generation • 26B • Updated Aug 24 • 42

LeaderboardModel1/Qwen3.8-27B-AutoRound-W4A16

Text Generation • 6B • Updated Aug 25 • 234 • 1

LeaderboardModel1/Qwen3.8-27B-AutoRound-W4A16-tuning

Text Generation • 6B • Updated Aug 25 • 181 • 1

LeaderboardModel1/Qwen3.8-27B-AutoRound-W4A16-v2

Text Generation • 6B • Updated Aug 26 • 236 • 2

lvkaokao/Qwen3-30B-A3B-Instruct-2507-mixed-MXFP8-mxfp4experts

Text Generation • 31B • Updated Sep 9 • 24

lvkaokao/Qwen3-30B-A3B-Instruct-2507-fp8kv-MXFP8

Text Generation • 17B • Updated Sep 9 • 33

lvkaokao/Qwen3-30B-A3B-Instruct-2507-fp8kv-fp8attn-MXFP8

Text Generation • 17B • Updated Sep 9 • 32

lvkaokao/Qwen3-235B-A22B-MXFP4-Mixed-CT-RTN-AutoRound

Text Generation • 235B • Updated Sep 9 • 35

INCModel3/Z-Image-Turbo-MXFP8-RTN-AutoRound

Text-to-Image • Updated Sep 10 • 12

INCModel3/Z-Image-Turbo-MXFP4-RTN-AutoRound

Text-to-Image • Updated Sep 10 • 11

INCModel3/FLUX.2-dev-MXFP4-RTN-AutoRound

Text-to-Image • Updated about 1 month ago • 9

INCModel3/FLUX.2-klein-4B-MXFP8-RTN-AutoRound

Text-to-Image • Updated about 1 month ago • 9

INCModel3/FLUX.2-klein-4B-MXFP4-RTN-AutoRound

Text-to-Image • Updated about 1 month ago • 12

INCModel3/FLUX.2-klein-9B-MXFP8-RTN-AutoRound

Text-to-Image • Updated 30 days ago • 26

INCModel3/FLUX.2-klein-9B-MXFP4-RTN-AutoRound

Text-to-Image • Updated 30 days ago • 27 • 1

INCModel3/Qwen3.5-9B-MXFP4-CT-AutoRound

Text Generation • 10B • Updated 29 days ago • 282

INCModel3/Qwen3.5-9B-MXFP4-FP8KV-CT-AutoRound

Text Generation • 5B • Updated 29 days ago • 59

INCModel3/Qwen3.5-9B-MXFP4-FP8KV-FP8Attn-CT-AutoRound

Text Generation • 5B • Updated 29 days ago • 52

INCModel3/Qwen3.5-9B-MXFP8-CT-RTN-AutoRound

Text Generation • 10B • Updated 29 days ago • 42

INCModel3/Qwen3.5-9B-MXFP8-FP8KV-CT-AutoRound

Text Generation • 2B • Updated 29 days ago • 212

INCModel3/Qwen3.5-9B-MXFP8-FP8KV-FP8Attn-CT-AutoRound

Text Generation • 2B • Updated 29 days ago • 30.8k

INCModel3/Qwen3.5-35B-A3B-MXFP8-CT-RTN-AutoRound

Text Generation • 36B • Updated 27 days ago • 110 • 3

INCModel3/Qwen3.5-35B-A3B-MXFP8-FP8KV-CT-AutoRound

Text Generation • 1B • Updated 27 days ago • 31 • 2

INCModel3/Qwen3.5-35B-A3B-MXFP8-FP8KV-FP8Attn-CT-AutoRound

Text Generation • 1B • Updated 27 days ago • 668

INCModel3/Qwen3.8-Flash-Next-MXFP4-Mixed-CT-RTN-AutoRound

Text Generation • Updated 19 days ago • 381