Edit Models filters

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

2,615

Full-text search

Active filters: llama.cpp

TeichAI/GLM-4.7-Flash-Claude-Opus-4.5-High-Reasoning-Distill-GGUF

30B • Updated 23 days ago • 87.3k • 473

TeichAI/Qwen3.5-27B-Claude-Opus-4.6-Distill-GGUF

27B • Updated 13 days ago • 14.1k • 29

jinaai/jina-embeddings-v5-text-small-retrieval

Sentence Similarity • 0.6B • Updated 15 days ago • 163k • 16

jinaai/jina-embeddings-v5-text-small-text-matching

Sentence Similarity • 0.6B • Updated 15 days ago • 16.4k • 10

prithivMLmods/Qwen3-VL-4B-Instruct-Unredacted-MAX-GGUF

Image-Text-to-Image • 4B • Updated about 1 month ago • 3.41k • 7

LiquidAI/LFM2-24B-A2B-GGUF

Text Generation • 24B • Updated 28 days ago • 35.7k • 109

jinaai/jina-reranker-v3-GGUF

Text Ranking • 0.6B • Updated Oct 4, 2025 • 1.28k • 14

LiquidAI/LFM2.5-1.2B-Instruct-GGUF

Text Generation • 1B • Updated Jan 5 • 60.5k • 141

LiquidAI/LFM2.5-Audio-1.5B-GGUF

1B • Updated Feb 4 • 6.23k • 82

Ex0bit/Qwen3.5-122B-A10B-PRISM-PRO-GGUF

Image-Text-to-Text • 122B • Updated 15 days ago • 177 • 18

marksverdhei/LCO-Embedding-Omni-7B-GGUF

Feature Extraction • 8B • Updated 13 days ago • 816 • 5

Voodisss/Qwen3-Reranker-0.6B-GGUF-llama_cpp

Text Ranking • 0.6B • Updated 7 days ago • 396 • 2

khazarai/Qwen3-4B-Gemini-3.1-Pro-Reasoning-Distilled

Text Generation • 4B • Updated 6 days ago • 3.74k • 2

kai-os/MiroThinker-1.7-mini-Q3_K_M-GGUF

Text Generation • 31B • Updated 5 days ago • 46 • 2

wangzhang/Qwen3.5-122B-A10B-abliterated-GGUF

Text Generation • 122B • Updated 2 days ago • 63 • 2

ia-espirita/riv-ai

Text Generation • 8B • Updated 1 day ago • 87 • 2

google/gemma-7b-it-GGUF

9B • Updated Aug 14, 2024 • 86 • 45

google/gemma-7b-GGUF

9B • Updated Jun 27, 2024 • 52 • 22

google/gemma-2b-it-GGUF

3B • Updated Jun 27, 2024 • 131 • 21

google/gemma-2b-GGUF

3B • Updated Jun 27, 2024 • 156 • 17

google/gemma-1.1-7b-it-GGUF

9B • Updated Jun 27, 2024 • 2 • 21

google/gemma-1.1-2b-it-GGUF

3B • Updated Jun 27, 2024 • 3 • 20

google/codegemma-2b-GGUF

Text Generation • 3B • Updated Jun 27, 2024 • 67 • 30

google/gemma-2-2b-it-GGUF

3B • Updated Aug 27, 2024 • 217 • 86

google/gemma-2-2b-GGUF

3B • Updated Aug 2, 2024 • 50 • 19

nvjob/Mistral-24B-crack-ru

24B • Updated Feb 28, 2025 • 191 • 2

mistralai/Devstral-Small-2507_gguf

Text Generation • 24B • Updated Jul 23, 2025 • 1.15k • 45

LiquidAI/LFM2-1.2B-GGUF

Text Generation • 1B • Updated Dec 5, 2025 • 10.9k • 105

LiquidAI/LFM2-700M-GGUF

Text Generation • 0.7B • Updated Dec 5, 2025 • 38k • 46

mistralai/Magistral-Small-2509-GGUF

24B • Updated Sep 18, 2025 • 1.19k • 71