Text Generation
Transformers
Safetensors
qwen2
agentic-rl
llm-agent
skill-library
grpo
search-qa
conversational
text-generation-inference
Instructions to use YuyaoGe/SkillForge_Search_7B with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use YuyaoGe/SkillForge_Search_7B with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="YuyaoGe/SkillForge_Search_7B") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("YuyaoGe/SkillForge_Search_7B") model = AutoModelForCausalLM.from_pretrained("YuyaoGe/SkillForge_Search_7B", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use YuyaoGe/SkillForge_Search_7B with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "YuyaoGe/SkillForge_Search_7B" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "YuyaoGe/SkillForge_Search_7B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/YuyaoGe/SkillForge_Search_7B
- SGLang
How to use YuyaoGe/SkillForge_Search_7B with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "YuyaoGe/SkillForge_Search_7B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "YuyaoGe/SkillForge_Search_7B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "YuyaoGe/SkillForge_Search_7B" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "YuyaoGe/SkillForge_Search_7B", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use YuyaoGe/SkillForge_Search_7B with Docker Model Runner:
docker model run hf.co/YuyaoGe/SkillForge_Search_7B
Yuyao Ge commited on
Commit ·
3a0fed1
1
Parent(s): 058eb10
Add the model card and the overview figure
Browse files
README.md
CHANGED
|
@@ -15,6 +15,7 @@ tags:
|
|
| 15 |
|
| 16 |
[](https://arxiv.org/abs/2610.09832)
|
| 17 |
[](https://arxiv.org/pdf/2610.09832)
|
|
|
|
| 18 |
[](https://geyuyao.com/skillforge/)
|
| 19 |
[](https://geyuyao.com/skillforge/)
|
| 20 |
[](https://huggingface.co/collections/YuyaoGe/skillforge)
|
|
@@ -127,6 +128,10 @@ out = model.generate(ids, max_new_tokens=256, do_sample=False)
|
|
| 127 |
print(tok.decode(out[0][ids.shape[-1]:], skip_special_tokens=True))
|
| 128 |
```
|
| 129 |
|
|
|
|
|
|
|
|
|
|
|
|
|
| 130 |
This is a research artifact: a 7B text policy for a text environment. It emits search
|
| 131 |
queries and answers in the Search-R1 action format; the retrieval backend is not part
|
| 132 |
of this repository.
|
|
|
|
| 15 |
|
| 16 |
[](https://arxiv.org/abs/2610.09832)
|
| 17 |
[](https://arxiv.org/pdf/2610.09832)
|
| 18 |
+
[](https://github.com/YuyaoGe/SkillForge)
|
| 19 |
[](https://geyuyao.com/skillforge/)
|
| 20 |
[](https://geyuyao.com/skillforge/)
|
| 21 |
[](https://huggingface.co/collections/YuyaoGe/skillforge)
|
|
|
|
| 128 |
print(tok.decode(out[0][ids.shape[-1]:], skip_special_tokens=True))
|
| 129 |
```
|
| 130 |
|
| 131 |
+
The training loop, the skill lifecycle and the environment harnesses are in
|
| 132 |
+
[YuyaoGe/SkillForge](https://github.com/YuyaoGe/SkillForge) — but that is the code, not the runtime library: this
|
| 133 |
+
policy still needs its skills retrieved and injected at call time.
|
| 134 |
+
|
| 135 |
This is a research artifact: a 7B text policy for a text environment. It emits search
|
| 136 |
queries and answers in the Search-R1 action format; the retrieval backend is not part
|
| 137 |
of this repository.
|