Efficient Knowledge Distillation for LLMs: Offline Top-K Logits and a Fused Chunked KL Loss Paper • 2608.03796 • Published Aug 4 • 21
LLM Compression by Block Removal with Constrained Binary Optimization Paper • 2602.00161 • Published Jun 17 • 9
Quantization-Aware Healing: A Practical Recipe for Recovering Compressed, 4-Bit LLMs Paper • 2608.20953 • Published Aug 21 • 15
Tiel-Coder-35B-A3B Collection A dedicated coder improving on Ornith1.5 without fine tuning. • 6 items • Updated Sep 7 • 9
Cyber-Tiel-Coder-35B-A3B Collection The improved an uncensored Tiel-Coder • 6 items • Updated Sep 9 • 17
view article Article Quantization-Aware Healing: a compressed, 4-bit model that outperforms its full-precision original MultiverseComputingCAI • Aug 25 • 73
Unsloth Dynamic 3.0 Quants Collection Introducing Dynamic V3.0 quants, our new SOTA quantization methodology. • 4 items • Updated about 2 hours ago • 80
APEX Quants (GGUF) Collection MoE models quantized with the APEX Quantization technique ( https://github.com/mudler/apex-quant ) • 49 items • Updated 1 day ago • 150