Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

13,406

Base only

Active filters: dpo

mradermacher/Qwen2.5-Lumen-14B-i1-GGUF

15B • Updated Sep 22, 2024 • 2.74k • 8

taicheng/zephyr-7b-align-scan-dpo0.1data-5e-07-0.01-1-cosine-8

Text Generation • 7B • Updated Sep 24, 2024 • 11

QuantFactory/L3.1-Niitorm-8B-DPO-t0.0001-GGUF

8B • Updated Sep 22, 2024 • 101 • 3

LBK95/Llama-2-7b-hf-DPO-LookAhead3_FullEval_TTree1.4_TLoop0.7_TEval0.2_Filter0.2_V3.0

Updated Sep 23, 2024 • 11

tsavage68/IE_M2_1000steps_1e5rate_01beta_cSFTDPO

Text Generation • 7B • Updated Sep 23, 2024 • 12

tsavage68/IE_M2_1000steps_1e5rate_03beta_SFT

Text Generation • 7B • Updated Sep 23, 2024 • 8

DUAL-GPO/zephyr-7b-ipo-10k-40k-0.001-i1

Updated Sep 23, 2024 • 9

Katayoon/VPO-Pess-Zephyr-7B-iter-1

7B • Updated Sep 23, 2024 • 6

tsavage68/IE_L3_1000steps_1e5rate_01beta_cSFTDPO

Text Generation • 8B • Updated Sep 23, 2024 • 9

tsavage68/IE_M2_1000steps_1e5rate_05beta_cSFTDPO

Text Generation • 7B • Updated Sep 23, 2024 • 13

tsavage68/IE_M2_1000steps_1e6rate_01beta_cSFTDPO

Text Generation • 7B • Updated Sep 23, 2024 • 9

tsavage68/IE_M2_1000steps_1e6rate_03beta_cSFTDPO

Text Generation • 7B • Updated Sep 23, 2024 • 9

tsavage68/IE_M2_1000steps_1e6rate_05beta_cSFTDPO

Text Generation • 7B • Updated Sep 23, 2024 • 8

Katayoon/VPO-Pess-Zephyr-7B-iter-2

7B • Updated Sep 23, 2024 • 6

tsavage68/IE_L3_1000steps_1e5rate_03beta_SFT

Text Generation • 8B • Updated Sep 23, 2024 • 10

tsavage68/IE_M2_1000steps_1e7rate_01beta_cSFTDPO

Text Generation • 7B • Updated Sep 23, 2024 • 9

tsavage68/IE_L3_1000steps_1e5rate_05beta_cSFTDPO

Text Generation • 8B • Updated Sep 23, 2024 • 9

tsavage68/IE_M2_1000steps_1e7rate_03beta_SFT

Text Generation • 7B • Updated Sep 23, 2024 • 9

tsavage68/IE_L3_1000steps_1e6rate_01beta_cSFTDPO

Text Generation • 8B • Updated Sep 23, 2024 • 9

tsavage68/IE_L3_1000steps_1e6rate_03beta_cSFTDPO

Text Generation • 8B • Updated Sep 23, 2024 • 7

tsavage68/IE_M2_1000steps_1e7rate_05beta_cSFTDPO

Text Generation • 7B • Updated Sep 23, 2024 • 9

tsavage68/IE_L3_1000steps_1e6rate_05beta_cSFTDPO

Text Generation • 8B • Updated Sep 23, 2024 • 9

tsavage68/IE_M2_1000steps_1e8rate_01beta_cSFTDPO

Text Generation • 7B • Updated Sep 23, 2024 • 8

tsavage68/IE_L3_1000steps_1e7rate_01beta_cSFTDPO

Text Generation • 8B • Updated Sep 23, 2024 • 8

tsavage68/IE_M2_1000steps_1e8rate_03beta_cSFTDPO

Text Generation • 7B • Updated Sep 23, 2024 • 13

tsavage68/IE_L3_1000steps_1e7rate_03beta_cSFTDPO

Text Generation • 8B • Updated Sep 23, 2024 • 9

tsavage68/IE_M2_1000steps_1e8rate_05beta_cSFTDPO

Text Generation • 7B • Updated Sep 23, 2024 • 10

Katayoon/VPO-Pess-Zephyr-7B-iter-3

7B • Updated Sep 23, 2024 • 6

tsavage68/IE_M2_100steps_1e7rate_01beta_cSFTDPO

Text Generation • 7B • Updated Sep 23, 2024 • 17

tsavage68/IE_L3_1000steps_1e7rate_05beta_cSFTDPO

Text Generation • 8B • Updated Sep 23, 2024 • 8