Frozenlock
/

Qwen3.8-27B-int4-AutoRound

Image-Text-to-Text

speculative-decoding

4-bit precision

Model card Files Files and versions

very fast model on 2X rtx 3090

#5

by stxpnet888 - opened 25 days ago

I got 130t/s max and arount 70-80 t/s average. This is great quant,Thanks.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment