Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

88

Base only

Active filters: q4

zhangrover/nerkyor-Qwen3.8-27B-EfficientThink-SimPO-KQVQ4-IQ3Floor-10G-MTP-GGUF

Text Generation • 0.5B • Updated 21 days ago • 2.09k • 6

zhangrover/Unsloth-Qwen3.8-27B-UD-KQVQ4-IQ3Floor-10G-MTP-GGUF

Text Generation • 0.5B • Updated 21 days ago • 895 • 1

Bluckr/llama-7B-ggml-q4_0-Pofi-Assistant

Text Generation • Updated Aug 13, 2023 • 2

AXCXEPT/EZO-AutoCoTRAG-Qwen2.5-72B-Instruct_q4

Text Generation • 74B • Updated Sep 24, 2024 • 26 • 9

saishshinde15/Clyrai_Base_Reasoning_GGUF

3B • Updated Aug 6, 2025 • 51

adriabama06/whisper-large-v3-ggml

Updated Jun 11, 2025 • 1

openmed-community/granite-4.0-micro-OpenMed-GGUF

Text Generation • 3B • Updated Oct 14, 2025 • 119 • 4

LibraxisAI/whisper-large-v3-q4

Automatic Speech Recognition • Updated May 11 • 26

LibraxisAI/Bielik-11B-v3.0-mlx-q4

Text Generation • 11B • Updated May 11 • 60 • 1

ipsilondev/chatterbox-multilingual-ONNX-q4

Text-to-Speech • Updated Jan 12 • 13

TrevorJS/voxtral-mini-realtime-gguf

4B • Updated Mar 28 • 174 • 9

qoranet/QORA-Vision-Image

Zero-Shot Image Classification • Updated Mar 1 • 24 • 1

qoranet/QORA-Vision-Video

Video Classification • Updated Mar 1 • 22

qoranet/QORA-TTS-12Hz-0.6B

Text-to-Speech • Updated Apr 6 • 19 • 1

0xdfi/Qwen3.5-35B-A3B-REAP-pile10k-30p-MLX-q4

Text Generation • 25B • Updated Mar 12 • 58 • 1

0xdfi/Qwen3.5-35B-A3B-REAP-pile10k-15p-MLX-q4

Text Generation • 30B • Updated Mar 12 • 41

TrevorJS/voxtral-tts-q4-gguf

Text-to-Speech • 4B • Updated Mar 28 • 269 • 15

verify01234/chatterbox-multilingual-ONNX-q4

Text-to-Speech • Updated Apr 14

stamsam/FrankenGemma4_MLX_4Bit

Text Generation • 8B • Updated Aug 1 • 19 • 1

thomasjvu/alkahest-0.8b-q4-onnx

Image-Text-to-Text • Updated May 13 • 12

scasella91/talkie-1930-13b-it-MLX-q4

Text Generation • 13B • Updated May 1 • 28

sombra-x/Kimi-K2.6-REAP-Solidity

Text Generation • 688B • Updated May 2 • 91

Vocabook/chatterbox-multilingual-ONNX-q4

Text-to-Speech • Updated May 18

mentriaai/Qwen3.5-0.8B-mentria

Image-Text-to-Text • Updated Sep 1

plawanrath/qwen2.5-7b-instruct-q4-mlx-cba

Text Generation • 8B • Updated 2 days ago • 121

plawanrath/mistral-7b-instruct-v0.3-q4-mlx-cba

Text Generation • 7B • Updated 2 days ago • 149

plawanrath/phi-3.5-mini-instruct-q4-mlx-cba

Text Generation • 4B • Updated 2 days ago • 112

MLXBits/sulphur-2-distill-mlx-q4

Image-Text-to-Video • Updated May 12 • 219 • 26

lsb/stable-audio-3-small-music-onnx

Text-to-Audio • Updated May 22 • 39 • 4

Surpem/Supertron2.1-0.6B-GGUF

Text Generation • 0.6B • Updated May 27 • 38 • 3