NVFP4
Collection
Fast inference for Blackwell GPUs
•
7 items
•
Updated
•
3
Compressed with llm-compressor v0.9.0 and transformers v4.57.1. We used the example script but increased the number of samples from 20 to 128.
- Downloads last month
- 67
Model tree for ig1/Qwen3-Next-80B-A3B-Instruct-NVFP4
Base model
Qwen/Qwen3-Next-80B-A3B-Instruct