Diamond grid pattern caused by VAE
Credit to @ZootAllures9111
Qwen 2.1 VAE has a clear grid-like pattern in its images. It's more noticeable when you generate a high-resolution image that has people with light skin tones and zoom in on their faces.
Or just passthrough a source image to the VAE, no other processing needed
yep, there are some mitigations, GLSL node, a nodepack or re-encode to flux
https://www.reddit.com/r/StableDiffusion/comments/1wlv3tf/qwen_image_21_noisepatterningmoire_mild_workaround/
How can we determine whether this is caused by VAE or by the DIT part?
How can we determine whether this is caused by VAE or by the DIT part?
It's very well known qwen vae causes this. Even from the old 2511 qwen image
You can test by [load image > vae encode > vae decode > save image]. No other processing
So it's either save image node causes it (lol no), or the Qwen VAE does 😉
How can we determine whether this is caused by VAE or by the DIT part?
vae, it happens with krea too (it used qwen vae)
How can we determine whether this is caused by VAE or by the DIT part?
vae, it happens with krea too (it used qwen vae)
When I used some of the trained krea2, there were parallel stripes with an interval of 16px. However, it was clearly caused by the DiT part. Because Gemini helped me write a latent nyquist fix, it could be fixed.
I've tried finetuning the Qwen-Image-2.1 VAE to fix this high-frequency grid issue, uploaded results here https://huggingface.co/madebyollin/texture-fix-vae-for-qwen-image-2.1. I haven't done thorough tests on faces but the finetune seems to improve results on foliage/greenery at least:
interesting
did anyone fix this this issue yet?, how hard can it be for them, they made the model, why they are not fixing it.
am using the model now to upscale textures it works very well but I pixelate the textures, and the pixelizer having a hard time with the grid noise and generates noisy pixels. At first I thought it won't matter am downscaling the images anyway, but I was wrong.
reference:
pixelized with script:
generated:
these are the results maybe its normal but I dont know.