Instructions to use arkii/chatglm2-6b-ggml with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use arkii/chatglm2-6b-ggml with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoModel model = AutoModel.from_pretrained("arkii/chatglm2-6b-ggml", device_map="auto") - Notebooks
- Google Colab
- Kaggle
|
Download README.md from arkii/chatglm2-6b-ggml: direct link, hf CLI and curl.
- Browser
- Download file 764 Bytes
-
https://huggingface.co/arkii/chatglm2-6b-ggml/resolve/main/README.md
- Command line
-
hf download hf://arkii/chatglm2-6b-ggml/README.md
-
curl -L -o README.md https://huggingface.co/arkii/chatglm2-6b-ggml/resolve/main/README.md
764 Bytes
metadata
license: apache-2.0
language:
- en
- zh
library_name: transformers
tags:
- llama-cpp
- gglm
- chatglm-6b
ChatGLM2-6B-GGLM
Can be loaded and used by chatglm.cpp
Integrated with langchain framework in CustomLLM form
python chatglm_langchain.py
Prompt: 小明的妈妈有两个孩子,一个叫大明 另外一个叫什么?
小明的妈妈有两个孩子,一个叫大明,另外一个叫小明。
Use under the shell command line
chatglm -m ./models/chatglm2-6b-ggml.q8_0.bin -p 你好
