Spaces:

ariG23498
/

gemma3n-image-audio

Runtime error

ariG23498 HF Staff commited on Jun 30

Commit

a3e6d78

1 Parent(s): e7427b0

device map fix

Files changed (1) hide show

app.py CHANGED Viewed

@@ -9,8 +9,7 @@ processor = AutoProcessor.from_pretrained(MODEL_PATH)
 model = AutoModelForImageTextToText.from_pretrained(
     MODEL_PATH,
     torch_dtype=torch.bfloat16,
-    device_map="cuda"
-).eval()
 @spaces.GPU
 def process_inputs(image, audio):

 model = AutoModelForImageTextToText.from_pretrained(
     MODEL_PATH,
     torch_dtype=torch.bfloat16,
+).eval().to("cuda")
 @spaces.GPU
 def process_inputs(image, audio):