A quantization model with a total size of less than 107GB should be well-suited for deployment on a 128GB Mac.
#11
by mimeng1990 - opened
A quantization model with a total size of less than 107GB should be well-suited for deployment on a 128GB Mac.