Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

545

Base only

Active filters: llm-compressor

LittleNicky55/MiniMax-M2.7-abliterated-Heretic-FP8

Text Generation • 229B • Updated Apr 19 • 27 • 2

binedge/Qwen3-Embedding-0.6B-FP8

Feature Extraction • 0.6B • Updated Apr 19 • 580 • 1

0ppxnhximxr/gemma-4-31B-it-heretic-FP8-Dynamic

Image-Text-to-Text • 33B • Updated Apr 19 • 1.09k • 1

lovethayo/MiniMax-M2.5-FP8-INT4-AWQ

Text Generation • 39B • Updated Apr 20 • 10

AMbaye018/sarvam-30b-AWQ-then-FP8

Text Generation • 7B • Updated Apr 22 • 8

ocicek/Qwen3.6-27B-NVFP4

Text Generation • 17B • Updated May 2 • 1.46k • 7

YuYu1015/Huihui-Qwen3.6-35B-A3B-abliterated-NVFP4

Text Generation • 21B • Updated Jun 8 • 5.36k • 2

YuYu1015/Huihui-Qwen3.6-27B-abliterated-NVFP4

Text Generation • 19B • Updated Apr 26 • 35 • 1

RedHatAI/Qwen3.6-35B-A3B-FP8-dynamic

Image-Text-to-Text • 35B • Updated Jul 13 • 9.01k • 5

RedHatAI/Kimi-K2.6-FP8-BLOCK

Image-Text-to-Text • 1T • Updated Jul 16 • 22.4k • 4

RedHatAI/Kimi-K2.6-NVFP4

Image-Text-to-Text • Updated Jul 17 • 2.62k • 13

depop-ml/Qwen3.5-9B-FP8-Dynamic

Image-Text-to-Text • 9B • Updated May 27 • 394 • 3

RedHatAI/Qwen3.6-35B-A3B-FP8

Image-Text-to-Text • 36B • Updated 12 days ago • 7.1k

zdy1995love/Mistral-Medium-3.5-128B-NVFP4

Text Generation • 74B • Updated May 3 • 760 • 3

plezan/Mistral-Medium-3.5-128B-W4A16

Image-Text-to-Text • 22B • Updated May 4 • 1.35k • 5

darkc0de/gemma-4-31B-it-heretic-FP8-Dynamic-Q4_K_M-GGUF

Image-Text-to-Text • 31B • Updated May 2 • 989 • 3

amir22010/sarvam-30b-gptq-4bit

Text Generation • 32B • Updated Jun 15

ukkathva/telecom-oss-8b-vllm-fp8

Text Generation • 8B • Updated May 3 • 10

xy-98/gemma-4-31B-it-FP8-block

Image-Text-to-Text • 31B • Updated May 4 • 7

qmxme/Qwen3.6-27B-NVFP4

Text Generation • 10B • Updated May 6 • 175 • 2

BlivionIaG/Qwen3.5-0.8B-AWQ-INT4

Text Generation • 0.8B • Updated May 7 • 752 • 1

gratex/mistral-small-3.2-24b-Instruct-2506-NVFP4A16

Image-Text-to-Text • 14B • Updated May 8 • 594

JDONE-Research/AIOne-Agent-52B-A36B-it-NVFP4A16

Image-Text-to-Text • 39B • Updated May 18 • 17

dokjlahdf/MiniMax-M2.7-abliterated-Heretic-FP8

Text Generation • 229B • Updated May 11 • 9

RedHatAI/Qwen3.5-4B-FP8-dynamic

Image-Text-to-Text • 5B • Updated May 11 • 91.9k • 5

WaveCut/gemma-4-26B-A4B-it-heretic-W4A16-G64-RTN-vllm

Image-Text-to-Text • 27B • Updated Jul 16 • 444

gratex/Qwen3.6-27B-W4A16-g32-asym

Image-Text-to-Text • 29B • Updated May 13 • 1.94k

gratex/Kimi-K2.6-REAM-25

Image-Text-to-Text • 130B • Updated May 15 • 52

vadery/qwen36-27b-ft-grm-w8a8

Image-Text-to-Text • 28B • Updated May 22 • 150

vadery/Qwen3.5-0.8B-W8A8

Image-Text-to-Text • 0.9B • Updated May 22 • 60