Apply for community grant: Academic project (gpu)

#1
by royeis - opened

The project demos a loading bar for reasoning models from the paper "Overclocking LLM Reasoning: Monitoring and Controlling Thinking Path Lengths in LLMs" - https://arxiv.org/abs/2506.07240.
It allows users to prompt a reasoning model with a problem and observe the thinking process accompanied by a loading bar visualization.

I am applying for this grant following a suggestion made by @NeilsRogge in our github repo: https://github.com/royeisen/reasoning_loading_bar/issues/1

Hi @royeis , we've assigned ZeroGPU to this Space. Please check the compatibility and usage sections of this page so your Space can run on ZeroGPU.

royeis changed discussion status to closed
royeis changed discussion status to open

Thanks @hysts !
This space encounters a GPU memory limit related runtime error:
image.png

The demo uses roughly 65GB:

image.png

If you could provide a device with this amount of memory it would be great. Otherwise, please let me know and I'll find another solution.

@royeis I think the error is related to CPU RAM limit, not GPU RAM. The underlying hardware for ZeroGPU Spaces is half H200 in the sense of MIG, so it has roughly 70GB VRAM.
Unfortunately, there's no grantable hardware that meets both the CPU and GPU RAM requirements. Hopefully, you'll be able to find another way.

Sign up or log in to comment