Pressure from far-right activist groups is inducing payment processors to crack down on adult content on mainstream platforms (where previously they were restricted in scope to adult platforms), starting first with Steam, now recently itch.io. We saw similar on Civit recently, except they were unlucky enough to have partnered with a payment processor who didn't care that they complied and pulled out anyway. A friend of mine recently lost all her income because of similar stuff (and the Itch move badly hurt other people in my circles.)
This is pretty far-removed from a lot of the people reading this, andI don't want to tell you how to feel about this happening, *but all the same, don't assume that Hugging Face is going to be safe because it's an "academic-coded" platform.* If you make things for mature audiences here, please make sure you have local backups of your data and models.
I recently have been looking at a paper titled "Why Warmup the Learning Rate? Underlying Mechanisms and Improvements", by Dayal Singh Kalra and Maissam Barkeshli, and was struck by "warmup" being analogous to simulated annealing. https://arxiv.org/abs/2406.09405 Taking the physical analogy further, the "warmup" is a stochastic process to knock the system out of current local minima, allowing easier transition toward newer minima. It works because it reduces "fit" and therefore "friction".
In regards to the latest mistral model and GGUFs for it:
Yes, they may be subpar and may require changes to llama.cpp to support the interleaved sliding window
Yes, I got excited when a conversion worked and released them ASAP
That said, generation seems to work right now and seems to mimic the output from spaces that are running the original model
I have appended -TEST to the model names in an attempt to indicate that they are not final or perfect, but if people still feel mislead and that it's not the right thing to do, please post (civilly) below your thoughts, I will highly consider pulling the conversions if that's what people think is best. After all, that's what I'm here for, in service to you all !