TurboGemma 4 E2B

Abliterated version of Google's Gemma 4 E2B (2B active parameter MoE multimodal model).

E2B Shootout Results (DuoNeural, 2026-06-08)

Head-to-head comparison of DuoNeural's three Gemma-4-E2B abliterations. KL methodology: full vocabulary, first-token logits, F.kl_div(batchmean).

Model KL vs Base Comply Rate Refusal Rate
Gemma-4-E2B-Heretic 0.057 85% 15%
TurboGemma4E2B (this model) 14.45 100% 0%
TurboGemma4E2B-v2 14.64 100% 0%

Note: KL of 14.45 indicates significant divergence from the base model's output distribution on general tasks โ€” this abliteration is aggressive. 100% comply rate means no residual refusals, but general capability degradation is likely on nuanced tasks. If model quality matters alongside uncensoring, consider Gemma-4-E2B-Heretic (KL=0.057).

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

model = AutoModelForCausalLM.from_pretrained(
    "DuoNeural/TurboGemma4E2B",
    torch_dtype="bfloat16",
    device_map="auto"
)
tokenizer = AutoTokenizer.from_pretrained("google/gemma-4-E2B-it")

DuoNeural

DuoNeural is an open AI research lab โ€” human + AI in symbiosis.

๐Ÿค— HuggingFace huggingface.co/DuoNeural
๐Ÿ™ GitHub github.com/DuoNeural
๐ŸŒ Site duoneural.com
๐Ÿ“ง Email duoneural@proton.me

Research Team

  • Jesse โ€” Vision, hardware, direction
  • Archon โ€” AI lab partner, post-training, abliteration, experiments
  • Aura โ€” Research AI, literature synthesis, novel proposals
Downloads last month
12
Safetensors
Model size
5B params
Tensor type
BF16
ยท
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for DuoNeural/TurboGemma4E2B

Finetuned
(444)
this model
Quantizations
1 model