Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

29

Base only

Active filters: optimum-intel

nsbendre25/llama-3-8B-Instruct-ov-fp16-int4-sym

Text Generation • Updated Apr 30, 2024 • 7 • 1

nsbendre25/Phi-3-mini-128k-instruct-ov-fp16-int4-asym

Text Generation • Updated Apr 30, 2024 • 8

nsbendre25/llama-3-70B-Instruct-ov-fp16-int4-asym

Text Generation • Updated Apr 30, 2024 • 9

akkipro/e5-base-v2-ov-int8

Feature Extraction • Updated May 9, 2024 • 3

Mitchins/t5-base-artgen-multi-instruct-OpenVINO

Text Generation • Updated Sep 3, 2025 • 1

ahmedzk11/tiny-random-minicpm-o-2_6

14M • Updated Jan 7 • 9

hrithik-dev8/tiny-random-MiniCPM-o-2_6

Image-Text-to-Text • 21.8M • Updated Jan 4 • 13

notlikejoe/tiny-random-MiniCPM-o-2_6

Text Generation • 6.17M • Updated Jan 16 • 10

umaimaparveennineteen/tiny-random-MiniCPM-0-2_6

Text Generation • 2.95M • Updated Feb 3 • 8

umaimaparveennineteen/tiny-random-MiniCPM-o-2_6

2.73M • Updated Feb 4 • 1

Nsan05/tiny-random-MiniCPM-o-2_6

5.02M • Updated Feb 11 • 1

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-optimum

Updated Apr 28 • 3

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-optimum-static-128-decode

Updated Apr 29 • 5

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-KVu8-optimum-static-128-decode

Updated Apr 29 • 4

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-KVu8-optimum-static-16k-decode

Updated Apr 29 • 3

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-optimum-static-16k-decode

Updated Apr 29 • 7

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-optimum-static-16k-prefill

Updated Apr 29 • 7

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-KVu8-optimum-static-16k-prefill

Updated Apr 29 • 3

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-optimum-static-128-prefill

Updated Apr 29 • 4

xpuenabler/gpt-oss-6.6b-8E-nf4-awq-KVu8-optimum-static-128-prefill

Updated Apr 29 • 3

Morteza89/gemma-4-26b-a4b-int4-ov

Image-Text-to-Text • Updated 18 days ago • 82

Morteza89/gemma-4-26b-a4b-it-int4-ov

Image-Text-to-Text • Updated 18 days ago • 33

Morteza89/gpt-oss-120b-int4-ov

Text Generation • Updated 18 days ago • 134

Morteza89/gpt-oss-120b-int8-ov

Text Generation • Updated 18 days ago • 14

Morteza89/qwen2-57b-a14b-int4-ov

Text Generation • Updated 11 days ago • 35

Morteza89/qwen3.6-35b-a3b-int4-ov

Image-Text-to-Text • Updated 18 days ago • 29

Morteza89/llama-3.3-70b-instruct-int4-ov

Text Generation • Updated 17 days ago • 15 • 1

Morteza89/DeepSeek-R1-Distill-Qwen-32B-int4-ov

Text Generation • Updated 9 days ago • 13

Morteza89/DeepSeek-R1-Distill-Llama-70B-int4-ov

Text Generation • Updated 9 days ago • 15