Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

176

Base only

Active filters: 70b

titan087/Llama3-70B-ShiningValiant2-exl2-4b

Text Generation • Updated Apr 20, 2024 • 23

mradermacher/Llama3-70B-ShiningValiant2-GGUF

71B • Updated May 10, 2024 • 1.13k • 1

mradermacher/Llama3-70B-ShiningValiant2-i1-GGUF

71B • Updated May 10, 2024 • 3.15k • 1

ValiantLabs/Llama3-70B-Fireplace

Text Generation • 71B • Updated Mar 12, 2025 • 8.5k • • 3

ryzen88/Llama-3-70b-Arimas-story-RP-V1

Text Generation • 71B • Updated May 27, 2024 • 34 • 2

mradermacher/Llama-3-70b-Arimas-story-RP-V1-GGUF

71B • Updated May 26, 2024 • 1.04k

mradermacher/Llama-3-70b-Arimas-story-RP-V1-i1-GGUF

71B • Updated May 27, 2024 • 2.32k • 1

kim512/Llama-3-70b-Arimas-story-RP-V1-3.0bpw-exl2

Text Generation • Updated May 26, 2024 • 11

kim512/Llama-3-70b-Arimas-story-RP-V1-3.5bpw-exl2

Text Generation • Updated May 26, 2024 • 9

kim512/Llama-3-70b-Arimas-story-RP-V1-4.0bpw-exl2

Text Generation • Updated May 26, 2024 • 11

kim512/Llama-3-70b-Arimas-story-RP-V1-4.5bpw-exl2

Text Generation • Updated May 26, 2024 • 11

kim512/Llama-3-70b-Arimas-story-RP-V1-5.0bpw-exl2

Text Generation • Updated May 26, 2024 • 7

kim512/Llama-3-70b-Arimas-story-RP-V1-6.0bpw-exl2

Text Generation • Updated May 26, 2024 • 11

kim512/Llama-3-70b-Arimas-story-RP-V1-8.0bpw-exl2

Text Generation • Updated May 26, 2024 • 10

ryzen88/Llama-3-70b-Arimas-story-RP-V1.6

Text Generation • 71B • Updated Jun 5, 2024 • 77 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 11 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-3.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 9 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.0bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 14 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-4.5bpw-h6-exl2

Text Generation • Updated Jun 17, 2024 • 17 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-6.0bpw-h6-exl2

Updated Jun 17, 2024 • 1

kim512/Llama-3-70b-Arimas-story-RP-V1.6-8.0bpw-h8-exl2

Text Generation • Updated Jun 17, 2024 • 11 • 1

ModelCloud/Meta-Llama-3.1-70B-Instruct-gptq-4bit

Text Generation • 71B • Updated Jul 27, 2024 • 37 • 4

mradermacher/Llama2-70B-ShiningValiant-GGUF

69B • Updated Sep 17, 2024 • 2.3k

mradermacher/Llama2-70B-ShiningValiant-i1-GGUF

69B • Updated Sep 19, 2024 • 5.29k

mradermacher/Llama3-70B-Fireplace-GGUF

71B • Updated Feb 6, 2025 • 295

mradermacher/Llama3-70B-Fireplace-i1-GGUF

71B • Updated Oct 24, 2024 • 1.03k

ValiantLabs/Llama3.1-70B-ShiningValiant2

Text Generation • 71B • Updated Jan 21, 2025 • 27 • 4

bartowski/Llama3.1-70B-ShiningValiant2-GGUF

Text Generation • 71B • Updated Oct 31, 2024 • 1.95k • 3

mradermacher/Llama3.1-70B-ShiningValiant2-GGUF

71B • Updated Nov 12, 2024 • 498

mradermacher/Llama3.1-70B-ShiningValiant2-i1-GGUF

71B • Updated Nov 12, 2024 • 1.11k