Hi, is there a list of models that you provide support for multi lora inference ?
Are traditional models like Bert or ModernBert for Token Classification supported for a multi lora inference?
StarboundCoder
starboundcoder
AI & ML interests
None yet
Recent Activity
commented on
an
article
about 1 month ago
TGI Multi-LoRA: Deploy Once, Serve 30 Models
Organizations
None yet
commented on
TGI Multi-LoRA: Deploy Once, Serve 30 Models
about 1 month ago