Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,860

Base only

Active filters: quantization

SC117/Ornith-1.0-35B-MTP-APEX-GGUF

Text Generation • 0.4B • Updated 4 days ago • 12.7k • 19

clark-labs/clark-air-sana-1.6b-1.58bit

Text-to-Image • Updated 3 days ago • 69 • 11

SC117/Qwen3.6-35B-A3B-uncensored-heretic-Native-MTP-Preserved-APEX-GGUF

Image-Text-to-Text • 0.4B • Updated 5 days ago • 28k • 15

wepiqx/Ornith-1.0-9B-ASHQ1-GGUF

Text Generation • 9B • Updated about 4 hours ago • 913 • 6

Winnougan/LTX-2.3-INT8

Updated 4 days ago • 14

sphaela/Qwen3.6-27B-AutoRound-GGUF

27B • Updated 14 days ago • 7.29k • 31

wepiqx/Qwythos-9B-Claude-Mythos-5-1M-MTP-SHQ8-GGUF

Text Generation • 9B • Updated 8 days ago • 2.79k • 6

Winnougan/Comfy-Qwen3-VL-INT8

Updated 3 days ago • 4

Winnougan/Wan2.2-INT8-Convrot

Updated about 1 hour ago • 4

realrebelai/SCAIL-2_GGUF

Image-to-Video • 16B • Updated 17 days ago • 43.6k • 42

tonera/FLUX.2-klein-4B-Nunchaku

Image-to-Image • Updated 8 days ago • 258 • 3

molbal/krea2-gguf

Text-to-Image • 13B • Updated 7 days ago • 4.23k • 3

nerkyor/Qwen3.6-27B-DSV4Pro-Thinking-Distill-NVFP4

Text Generation • 19B • Updated 3 days ago • 251 • 3

tonera/FLUX.2-klein-9b-kv-Nunchaku

Image-to-Image • Updated 8 days ago • 352 • 10

transformerlab/ideogram-4-gguf-q4_k

Text-to-Image • 19B • Updated 22 days ago • 1.34k • 9

Abiray/SCAIL-2-GGUF

Image-to-Video • 16B • Updated 17 days ago • 2.17k • 11

Mapika/GLM-5.2-NVFP4

Text Generation • 379B • Updated 14 days ago • 10.8k • 5

realrebelai/Boogu-Image-Base_GGUFs

Text-to-Image • 10B • Updated 11 days ago • 2.23k • 9

wepiqx/Qwythos-9B-Claude-Mythos-5-1M-SHQ8-GGUF

Text Generation • 9B • Updated 8 days ago • 2.46k • 6

tonera/vitoom-nunchaku

Updated 1 day ago • 2

ai-in-projectmanagement/ProjectManagementLLM

Text Generation • Updated Jun 19, 2025 • 14

Sunbird/Sunflower-14B-W8A8

Text Generation • 15B • Updated Oct 9, 2025 • 1

tsqn/Z-Image-Turbo_GGUF

Text-to-Image • 6B • Updated Dec 12, 2025 • 377 • 3

deepsky-ia/TinyLlama-1.1B-Chat-v1.0-GGUF-MacQuantized

Text Generation • 1B • Updated about 6 hours ago • 11 • 1

SoybeanMilk/Breeze-ASR-25-quantized.w4a16

Automatic Speech Recognition • 2B • Updated Feb 13 • 5 • 1

MoringLabs/Nemotron-3-Super-120B-A12B-MLX-3.6bit

Text Generation • 121B • Updated Mar 18 • 458 • 6

tonera/Qwen3-text-Nunchaku

Updated Apr 9 • 239 • 7

AEON-7/Gemma-4-E4B-DECKARD-HERETIC-NVFP4

Text Generation • 6B • Updated 10 days ago • 62 • 1

AsadIsmail/Qwen2.5-VL-7B-Instruct-ternary

Image-Text-to-Text • Updated Apr 27 • 1

YTan2000/Qwen3.6-35B-A3B-TQ3_4S

Image-Text-to-Text • 35B • Updated Apr 18 • 1.54k • 80