Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,402

Base only

Active filters: nvfp4

amer8/DeepSeek-R1-Distill-Llama-8B-NVFP4

Text Generation • 5B • Updated Apr 11 • 13 • 1

lopi999/wan22_i2v_nvfp4

Image-to-Video • 14B • Updated Jan 28 • 53 • 2

ealexeev/TheDrummer-Valkyrie-49B-v2.1-NVFP4

Text Generation • 29B • Updated Mar 7 • 127

ealexeev/TheDrummer-Skyfall-31B-v4.1-NVFP4

18B • Updated Mar 6 • 49 • 1

ealexeev/TheDrummer-Rocinante-X-12B-v1-NVFP4

Text Generation • 7B • Updated Mar 6 • 11

JongYeop/Llama-3.1-8B-Instruct-NVFP4-W4A4

5B • Updated Jan 29 • 36

JongYeop/Mistral-7B-Instruct-v0.2-FP4-W4A4

Text Generation • 4B • Updated Jan 30 • 9

LibraxisAI/Qwen3-VL-235B-A22B-Instruct-mlx-nvfp4

Image-Text-to-Text • 59B • Updated May 11 • 176

Firworks/SERA-8B-nvfp4

5B • Updated Feb 1 • 10

Firworks/SERA-8B-GA-nvfp4

5B • Updated Feb 1 • 10

Firworks/SERA-32B-nvfp4

19B • Updated Feb 1 • 8 • 1

Firworks/SERA-32B-GA-nvfp4

19B • Updated Feb 1 • 5 • 1

JongYeop/Qwen2.5-7B-Instruct-FP4-W4A4

Text Generation • 5B • Updated Feb 2 • 15

JEILDLWLRMA/Qwen3-VL-8B-Instruct-NVFP4

Image-to-Text • 6B • Updated Feb 2 • 214k • 2

JongYeop/Llama-3.1-70B-Instruct-NVFP4-W4A4

41B • Updated Feb 2 • 9

GadflyII/GLM-4.7-Flash-MTP-NVFP4

Text Generation • 19B • Updated Feb 2 • 671 • 5

cloud19/sainemo-12b-fp4-blackwell

12B • Updated Feb 2 • 4

TheHouseOfTheDude/Behemoth-R1-V2_ModelOpt-NVFP4

Text Generation • 62B • Updated Feb 2 • 8

GadflyII/Qwen3-Coder-Next-NVFP4

Text Generation • Updated Feb 4 • 126k • 45

vincentzed-hf/Qwen3-Coder-Next-NVFP4

Text Generation • Updated Feb 16 • 715 • 7

JongYeop/Qwen2.5-14B-Instruct-FP4-W4A4

Text Generation • 9B • Updated Feb 6 • 295

JEILDLWLRMA/Qwen3-VL-8B-Instruct-NVFP4-FP8-Dynamic

Image-to-Text • 6B • Updated Feb 6 • 29 • 1

Shifusen/Maginum-Cydoms-24B-NVFP4

Text Generation • 14B • Updated Feb 7 • 5

JEILDLWLRMA/Qwen3-VL-4B-Instruct-NVFP4

Image-to-Text • 3B • Updated Feb 7 • 842 • 2

vistralis/Qwen3-4B-NVFP4

Text Generation • 3B • Updated Feb 7 • 20 • 1

Firworks/Step-3.5-Flash-nvfp4

111B • Updated Feb 9 • 11

JongYeop/Qwen2.5-3B-Instruct-FP4-W4A4

Text Generation • 2B • Updated Feb 9 • 9

surogate/Qwen3-Next-80B-A3B-Thinking-NVFP4

Text Generation • Updated Feb 11 • 8

surogate/Qwen3-Next-80B-A3B-Instruct-NVFP4

Text Generation • Updated Feb 11 • 9

williamchangtw/Qwen3-Next-80B-A3B-Thinking-NVFP4

Text Generation • Updated Feb 11 • 9