nvidia

/

GLM-5-NVFP4

like 24

Follow

NVIDIA 54.7k

Hi, We are working on it and plan to share asap.

Is it also supported by vLLM?

Hi @tstarkey-nvidia , which specific NVFP4 qformat is used for this nvidia/GLM-5-NVFP4?

We see a GLM-5.1 NVFP4 model shared from third-party: lukealonso/GLM-5.1-NVFP4, which seems to work pretty well:

https://github.com/microsoft/Tutel?tab=readme-ov-file#steps-for-glm-551-claude-code-mode