Article
Unbelievable! Run 70B LLM Inference on a Single 4GB GPU with This NEW Technique
lyogavin
• • 47bjorker
bjorker
·
AI & ML interests
None yet
Recent Activity
liked a model 17 days ago
MiniMaxAI/MiniMax-M2.7 liked a Space 12 months ago
DontPlanToEnd/UGI-Leaderboard liked a model about 1 year ago
sleepdeprived3/NonDenominational-Christian-Bible-Expert-v2.0-12BOrganizations
None yet
upvoted an article over 1 year ago
upvoted an article almost 2 years ago
Article
Run a Chatgpt-like Chatbot on a Single GPU with ROCm
andyll7772
• • 2