GGUF file for quick testing of WIP implmentation of llama.cpp Qwen2.5 VL.

You can find the lastest version of implmentation here. (Don't forget to switch to qwen25-vl branch)

You can also follow the llama.cpp draft PR here

GGUF

Model size

3B params

Architecture

qwen2vl

Hardware compatibility

We're not able to determine the quantization variants.

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support