Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

8,150

Base only

Active filters: llama.cpp

chai1208/Qwen3.5-35B-A3B-patent-Q8_0-GGUF

35B • Updated Mar 15 • 178

chhatramani/nyayalm-6legaltaskrag_qwen3-4B-Q4_K_M-GGUF

4B • Updated Mar 15 • 6

NicolasSaba/Clone_Nicolas_V1

8B • Updated Mar 15 • 6

apache256/qwen_finetune

0.8B • Updated Mar 15 • 10

RamRamki/medical-phi3

4B • Updated Mar 15 • 15 • 1

mrrobots18/gguf-poc-alignment-nullderef

32 • Updated Mar 15

JIULANG/unsloth-Qwen3.5-4B-Instruct-CitationMarker-GGUG

4B • Updated Mar 15 • 268

SALEETAI/Medical-Llama-3-GGUF

4B • Updated Mar 15 • 10

Pruthvirahul/astramind-gguf

3B • Updated Jun 11 • 9

qingyi26/GGUF_clip_memory_corruption

1 • Updated Mar 15

qingyi26/GGUF_semantic_output_manipulation

chhatramani/nyayalm-civilcode_qwen3-4B_2e_GGUF

4B • Updated Mar 15 • 6

ia-espirita/riv-ai

Text Generation • 8B • Updated May 4 • 69 • 5

ishmaifan/patent-sum-llama3.2-3b-gguf

3B • Updated Mar 16 • 24

drissea-ai/drissy-qwen3.5-2b-GGUF

Image-Text-to-Text • 2B • Updated Mar 16 • 44 • 2

rkumar70900/qwen2.5-1.5b-gguf-experiments

Text Generation • 2B • Updated Mar 15 • 12

asazot/gemma_ft_q4_k_m

0.3B • Updated Mar 16 • 8

N-Bot-Int/SmolSam3-GGUF

3B • Updated Mar 16 • 11

kostakoff/Mixtral-8x7B-Instruct-v0.1-GGUF

Text Generation • 47B • Updated Mar 16 • 22

adamwhite625/gemma-2-2b-text2sql-12k-gguf

3B • Updated Mar 16 • 6

Liberol/OnlyGeminiFinalModel

8B • Updated Mar 16 • 15

amps93/Qwen3.5-9B-FT-NER-KR-V2-GGUF

9B • Updated Mar 16 • 39

NicolasSaba/cerebro-v2-GGUF

8B • Updated Mar 16 • 9

mirshadkotta/flutter-expert-llama3-gguf

0.4B • Updated Mar 16 • 75

NicolasSaba/Clone_Nicolas_V2

8B • Updated Mar 16 • 9

hienbm/gemma-3-4b-mtaste-gguf

4B • Updated Mar 16 • 10

jaidhev/SQL_ENG_2

4B • Updated Mar 16 • 9

alirizaercan/qwen2.5-0.5b-lunarlander-action-gguf

Text Generation • 0.5B • Updated Mar 17 • 3

khazarai/Qwen3-4B-Kimi2.5-Reasoning-Distilled-GGUF

Text Generation • 4B • Updated Apr 19 • 3.43k • 9

TirGun/Qwen3.5-4B-GGUF

Text Generation • 4B • Updated Mar 17 • 745