Update README.md
Browse files
README.md
CHANGED
|
@@ -102,7 +102,7 @@ It is the result of quantising to 4bit using [AutoGPTQ](https://github.com/PanQi
|
|
| 102 |
## Repositories available
|
| 103 |
|
| 104 |
* [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/starcoderplus-GPTQ)
|
| 105 |
-
* [
|
| 106 |
* [Unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/bigcode/starcoderplus)
|
| 107 |
|
| 108 |
## How to easily download and use this model in text-generation-webui
|
|
|
|
| 102 |
## Repositories available
|
| 103 |
|
| 104 |
* [4-bit GPTQ models for GPU inference](https://huggingface.co/TheBloke/starcoderplus-GPTQ)
|
| 105 |
+
* [4, 5, and 8-bit GGML models for CPU+GPU inference](https://huggingface.co/TheBloke/starcoderplus-GGML)
|
| 106 |
* [Unquantised fp16 model in pytorch format, for GPU inference and for further conversions](https://huggingface.co/bigcode/starcoderplus)
|
| 107 |
|
| 108 |
## How to easily download and use this model in text-generation-webui
|