technically it is representing the padding unused/wasted compute so even if it being on the left would actually be the same thing/correct representation but I think he wants to show that that is the actual wasted compute (to be quantifiable)
Akash
akash-inferq
AI & ML interests
None yet
Recent Activity
commentedon an article about 1 month ago
Continuous batching from first principles upvoted an article about 1 month ago
Continuous batching from first principlesOrganizations
None yet
commented on Continuous batching from first principles about 1 month ago
upvoted an article about 1 month ago
Article
Continuous batching from first principles
- +1
•
364
Issues while running the model within vLLMs nightly docker build as given in the readme
1
#1 opened 4 months ago
by akash-inferq
liked a
Space about 1 year ago