Inference Providers
Active filters: 3-bit
0xSero/DeepSeek-V3.2-REAP-345B-W3A16
Text Generation
• 2B • Updated • 60
• 11
MaziyarPanahi/Yi-Coder-9B-Chat-GGUF
Text Generation
• 9B • Updated • 99.4k
• 7
Text Generation
• 15B • Updated • 101k
• 7
MaziyarPanahi/Mistral-Small-24B-Instruct-2501-GGUF
Text Generation
• 24B • Updated • 102k
• 10
MaziyarPanahi/Qwen3-1.7B-GGUF
Text Generation
• 2B • Updated • 152k
• 7
MaziyarPanahi/Qwen3-4B-Instruct-2507-GGUF
Text Generation
• 4B • Updated • 104k
• 2
mlx-community/Qwen3-VL-4B-Instruct-3bit
Image-Text-to-Text
• Updated • 1.43k
• 4
0xSero/GLM-4.7-EXL3-3bpw_H6
Text Generation
• 67B • Updated • 33
• 2
MaziyarPanahi/LFM2-24B-A2B-GGUF
Text Generation
• 24B • Updated • 515
• 2
MetaphoricalCode/Qwen3.5-27B-heretic-v2-exl3-3bpw-hb6
Text Generation
• 7B • Updated • 41
• 1
Brooooooklyn/qwen3.5-9B-unsloth-mlx
Text Generation
• 4B • Updated • 696
• 1
Brooooooklyn/qwen3.5-35B-A3B-unsloth-mlx
Text Generation
• 6B • Updated • 92
• 1
kaitchup/Llama-2-7b-gptq-3bit
Text Generation
• Updated • 17
clibrain/Llama-2-7b-ft-instruct-es-gptq-3bit
Text Generation
• Updated • 8
• 3
clibrain/Llama-2-13b-ft-instruct-es-gptq-3bit
Text Generation
• Updated • 8
• 3
MiNeves-tops/opt-125m-gptq-3bit
Text Generation
• Updated • 4
Text Generation
• Updated • 7
LoneStriker/Yi-6B-200K-3.0bpw-h6-exl2
Text Generation
• Updated • 3
danny0122/Llama-2-7b-hf-gptq-3bits
Text Generation
• 6B • Updated • 2
danny0122/Llama-2-7b-hf-gptq-3bitssafe
Text Generation
• 6B • Updated • 3
danny0122/stablelm-base-alpha-3b-gptq-3bits
Text Generation
• 3B • Updated • 3
danny0122/stablelm-base-alpha-3b-gptq-3bitssafe
Text Generation
• 3B • Updated • 3
SicariusSicariiStuff/Tenebra_PreAlpha_128g_3BIT
Text Generation
• 31B • Updated • 2
mahihossain666/llama-2-70b-hf-quantized-3bits-GPTQ
Text Generation
• 65B • Updated • 4
SicariusSicariiStuff/Tenebra_PreAlpha_No_Group_g_3BIT
Text Generation
• 31B • Updated • 5
kaitchup/Mistral-7B-v0.1-gptq-3bit
Text Generation
• 7B • Updated • 4
kaitchup/Llama-2-13b-hf-gptq-3bit
Text Generation
• 12B • Updated • 5
kaitchup/Llama-2-7b-hf-gptq-3bit
Text Generation
• 6B • Updated • 761
• 1
Text Generation
• 3B • Updated • 202
• 6
MaziyarPanahi/Tess-XS-v1-3-yarn-128K-Mistral-7B-Instruct-v0.1-GGUF
Text Generation
• 7B • Updated • 189
• 6