How to Load SVDQ Models
Were all the SVDQ models you uploaded loaded using the Nunchaku FLUX DiT Loader node? The reason I ask is that your organization previously released only GGUF quantized models.
Hello, yes that is correct you need to load them using the Nunchaku FLUX DiT Loader.
Here is a workflow for reference.
Could you help add SVDQ quantization support for the SRPO and OneReward models? Thanks~
Hello again,
Thanks for the suggestion, those are on my to-do list. I have tried to make an SVDQuant of them, but they need a bit of special attention to work correctly. I will give it another look in December.
Hello again,
Thanks for the suggestion, those are on my to-do list. I have tried to make an SVDQuant of them, but they need a bit of special attention to work correctly. I will give it another look in December.
Thank you very much.