https://huggingface.co/lightonai/LightOnOCR-1B-1025

#1495
by mingyi456 - opened

Hi, there is already an existing gguf quant by ggml-org, but sadly the only mmproj file is in Q8_0.

https://huggingface.co/lightonai/LightOnOCR-1B-1025

It's queued and ouer system correctly recognized it as vision model ! :D

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#LightOnOCR-1B-1025-GGUF for quants to appear.

Sign up or log in to comment