Instructions to use harshatheg/GPC-1 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use harshatheg/GPC-1 with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="harshatheg/GPC-1")

# pip install -U transformers accelerate
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("harshatheg/GPC-1")
model = AutoModelForMultimodalLM.from_pretrained("harshatheg/GPC-1", device_map="auto")

PEFT
How to use harshatheg/GPC-1 with PEFT:
```
Task type is invalid.
```
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use harshatheg/GPC-1 with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "harshatheg/GPC-1"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "harshatheg/GPC-1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/harshatheg/GPC-1

SGLang

How to use harshatheg/GPC-1 with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "harshatheg/GPC-1" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "harshatheg/GPC-1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "harshatheg/GPC-1" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "harshatheg/GPC-1",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use harshatheg/GPC-1 with Docker Model Runner:
```
docker model run hf.co/harshatheg/GPC-1
```

GPC-1 / assets /base_files.sha256.json

harshatheg

Release v1

c87a0aa about 2 months ago

Raw History Blame Contribute Delete

2.77 kB

{
  "files": {
    "chat_template.jinja": "a4aee8afcf2e0711942cf848899be66016f8d14a889ff9ede07bca099c28f715",
    "config.json": "5e4d7f74fec2f360eb9cfbfcd6ec0c4c76e684d3a11caaed259d9fd9bfbc7944",
    "generation_config.json": "4f25002776b741773666203dcea8f54619f177ace3ae483d311102092a4658e0",
    "merges.txt": "a9d356d7bdf1ef4949e3e748e95b8e10ad9d4e2e838eddc38a0a7b6b94d1db8d",
    "model-00001-of-00016.safetensors": "43a908b3d324d59b66c73a33e5c182809eb2df7da474b2fd2cbdabb16baeee38",
    "model-00002-of-00016.safetensors": "4de54e39c2ecc6f3fb5e79e752f84b65c96c316d0d848c9b55d36a062df69e70",
    "model-00003-of-00016.safetensors": "847472ab2e3e10da0baea3993890ce393cc1b364f53674a00a92ac6ed856ec0d",
    "model-00004-of-00016.safetensors": "81b2b46905d62b66c6a0d2360050c266ea9416f913708e9a1447b28465f458f0",
    "model-00005-of-00016.safetensors": "3a13dfef35c76070c92e7a303640f90b11795dd1ecc6e501d0e00d8310b0e3a2",
    "model-00006-of-00016.safetensors": "baeb2742c637cb517e6410c1b7dc53ea69312078a1f0b708d43d7a62dffa22a9",
    "model-00007-of-00016.safetensors": "5cc9bcd2e0a8e17f1319f8d808fd6595d9944f2a0e01e9e7cb8d550b9646e413",
    "model-00008-of-00016.safetensors": "f294ac742f1f1762b8f05963812b33dd3bff1701b0ec887fe46717c7d66a638e",
    "model-00009-of-00016.safetensors": "2198de19b6c6eda23f6b72f787f861ee4495ff9f29551f3b40cef72f1afbd96d",
    "model-00010-of-00016.safetensors": "3fecc834fc976ae9205039b01c53049f18ca5b68d973f0977bfe90335faf0918",
    "model-00011-of-00016.safetensors": "4e253c10600a5368df08bdd92e97c69c4b3b59fc4e7d8326a5f33b0888358779",
    "model-00012-of-00016.safetensors": "420af5489aecba4d174c875520e3fcf5180ead42c9c6d8bc903ce8cb910f996c",
    "model-00013-of-00016.safetensors": "a2b5627ba8a9b4564a795388ee90c757abb0f386aa6bef813ff3b6c52a9a85f7",
    "model-00014-of-00016.safetensors": "e52489ba1847e0b1d89a445fa4f3b26dd1f2e957c70b35657e6333ea9be8f12a",
    "model-00015-of-00016.safetensors": "7ef51deb1d96fe34a37d8bec88b4f7151c0ac762b802fe446c990ed4580bbb67",
    "model-00016-of-00016.safetensors": "4df5299dd7e8033e6821336584fd5b8830c116cdea7385e64e3b0c2b14609ea8",
    "model.safetensors.index.json": "f8448aa8b2fbf3519723b0c2965fc94ed64cafdd463381636a1df351952b3f1a",
    "preprocessor_config.json": "27225450ac9c6529872ee1924fcb0962ff5634834f817040f444118116f4e516",
    "tokenizer.json": "5f9e4d4901a92b997e463c1f46055088b6cca5ca61a6522d1b9f64c4bb81cb42",
    "tokenizer_config.json": "316230d6a809701f4db5ea8f8fc862bc3a6f3229c937c174e674ff3ca0a64ac8",
    "video_preprocessor_config.json": "7768af27c1fafa9cc9011c1dc20067e03f8915e03b63504550e11d5066986d13",
    "vocab.json": "ce99b4cb2983d118806ce0a8b777a35b093e2000a503ebde25853284c9dfa003"
  },
  "model_id": "harshatheg/GPC-1",
  "revision": "base-278124e95f96d21b"
}

	{
	"files": {
	"chat_template.jinja": "a4aee8afcf2e0711942cf848899be66016f8d14a889ff9ede07bca099c28f715",
	"config.json": "5e4d7f74fec2f360eb9cfbfcd6ec0c4c76e684d3a11caaed259d9fd9bfbc7944",
	"generation_config.json": "4f25002776b741773666203dcea8f54619f177ace3ae483d311102092a4658e0",
	"merges.txt": "a9d356d7bdf1ef4949e3e748e95b8e10ad9d4e2e838eddc38a0a7b6b94d1db8d",
	"model-00001-of-00016.safetensors": "43a908b3d324d59b66c73a33e5c182809eb2df7da474b2fd2cbdabb16baeee38",
	"model-00002-of-00016.safetensors": "4de54e39c2ecc6f3fb5e79e752f84b65c96c316d0d848c9b55d36a062df69e70",
	"model-00003-of-00016.safetensors": "847472ab2e3e10da0baea3993890ce393cc1b364f53674a00a92ac6ed856ec0d",
	"model-00004-of-00016.safetensors": "81b2b46905d62b66c6a0d2360050c266ea9416f913708e9a1447b28465f458f0",
	"model-00005-of-00016.safetensors": "3a13dfef35c76070c92e7a303640f90b11795dd1ecc6e501d0e00d8310b0e3a2",
	"model-00006-of-00016.safetensors": "baeb2742c637cb517e6410c1b7dc53ea69312078a1f0b708d43d7a62dffa22a9",
	"model-00007-of-00016.safetensors": "5cc9bcd2e0a8e17f1319f8d808fd6595d9944f2a0e01e9e7cb8d550b9646e413",
	"model-00008-of-00016.safetensors": "f294ac742f1f1762b8f05963812b33dd3bff1701b0ec887fe46717c7d66a638e",
	"model-00009-of-00016.safetensors": "2198de19b6c6eda23f6b72f787f861ee4495ff9f29551f3b40cef72f1afbd96d",
	"model-00010-of-00016.safetensors": "3fecc834fc976ae9205039b01c53049f18ca5b68d973f0977bfe90335faf0918",
	"model-00011-of-00016.safetensors": "4e253c10600a5368df08bdd92e97c69c4b3b59fc4e7d8326a5f33b0888358779",
	"model-00012-of-00016.safetensors": "420af5489aecba4d174c875520e3fcf5180ead42c9c6d8bc903ce8cb910f996c",
	"model-00013-of-00016.safetensors": "a2b5627ba8a9b4564a795388ee90c757abb0f386aa6bef813ff3b6c52a9a85f7",
	"model-00014-of-00016.safetensors": "e52489ba1847e0b1d89a445fa4f3b26dd1f2e957c70b35657e6333ea9be8f12a",
	"model-00015-of-00016.safetensors": "7ef51deb1d96fe34a37d8bec88b4f7151c0ac762b802fe446c990ed4580bbb67",
	"model-00016-of-00016.safetensors": "4df5299dd7e8033e6821336584fd5b8830c116cdea7385e64e3b0c2b14609ea8",
	"model.safetensors.index.json": "f8448aa8b2fbf3519723b0c2965fc94ed64cafdd463381636a1df351952b3f1a",
	"preprocessor_config.json": "27225450ac9c6529872ee1924fcb0962ff5634834f817040f444118116f4e516",
	"tokenizer.json": "5f9e4d4901a92b997e463c1f46055088b6cca5ca61a6522d1b9f64c4bb81cb42",
	"tokenizer_config.json": "316230d6a809701f4db5ea8f8fc862bc3a6f3229c937c174e674ff3ca0a64ac8",
	"video_preprocessor_config.json": "7768af27c1fafa9cc9011c1dc20067e03f8915e03b63504550e11d5066986d13",
	"vocab.json": "ce99b4cb2983d118806ce0a8b777a35b093e2000a503ebde25853284c9dfa003"
	},
	"model_id": "harshatheg/GPC-1",
	"revision": "base-278124e95f96d21b"
	}