Instructions to use RthItalia/Rth-lm-25b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use RthItalia/Rth-lm-25b with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf RthItalia/Rth-lm-25b # Run inference directly in the terminal: llama cli -hf RthItalia/Rth-lm-25b
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf RthItalia/Rth-lm-25b # Run inference directly in the terminal: llama cli -hf RthItalia/Rth-lm-25b
Build from source code
git clone https://github.com/ggml-org/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-app # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama serve -hf RthItalia/Rth-lm-25b # Run inference directly in the terminal: ./build/bin/llama cli -hf RthItalia/Rth-lm-25b
Use Docker
docker model run hf.co/RthItalia/Rth-lm-25b
- Llama new
- LM Studio
- Jan
- Ollama
How to use RthItalia/Rth-lm-25b with Ollama:
ollama run hf.co/RthItalia/Rth-lm-25b
- Unsloth Desktop
- Docker Model Runner
How to use RthItalia/Rth-lm-25b with Docker Model Runner:
docker model run hf.co/RthItalia/Rth-lm-25b
- Lemonade
How to use RthItalia/Rth-lm-25b with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull RthItalia/Rth-lm-25b
Run and chat with the model
lemonade run user.Rth-lm-25b-{{QUANT_TAG}}List all available models
lemonade list
- Atomic Chat
Commit History
-
Update README.md
Verified signature998de73 -
Upload folder using huggingface_hub
Verified signature140a0bd -
Upload souls/text_align_tiny_repair/TEXT_ALIGN_TINY_REPAIR.pt with huggingface_hub
Verified signaturec2f07d0
-
Add Code Align v3, Math Align v2, and FRO cascade report
Verified signature901924c -
Add Code Align v3, Math Align v2, and FRO cascade report
Verified signature38cbcef -
Add Code Align v3 and FRO cascade report
Verified signature565c015 -
Add Code Align v3 and FRO cascade report
Verified signature843d99d -
Add Code Align v3 and FRO cascade report
Verified signature22d87bb -
Add FRO-controlled full cascade evaluation
Verified signature1b946ad -
Add FRO-controlled full cascade evaluation
Verified signature6b65ebd -
Add FRO-controlled full cascade evaluation
Verified signature5ee7921 -
Add FRO-LM Small v1 control-plane evaluation
Verified signature5b5e88c -
Add FRO-LM Small v1 control-plane evaluation
Verified signature164797d -
Add FRO-LM Small v1 control-plane evaluation
Verified signature14a72ec -
Add FRO-LM Small v1 control-plane evaluation
Verified signaturee93669f -
Update RTH-LM model card with FRO-LM Small v0
Verified signature9a53696 -
Update model card with FRO-LM Small v0
Verified signature349b173 -
Add FRO-LM Small v0 controller
Verified signature624ea37 -
Add FRO-LM Small v0 controller
Verified signatureff2d30c
-
Refresh SwarmLM v3b cascade report artifacts
Verified signaturedc0a107 -
Refresh SwarmLM v3b cascade report artifacts
Verified signature0e48599 -
Add SwarmLM v3b cascade raw JSONL
Verified signature00ba2dd -
Add SwarmLM orchestrator v3b cascade artifacts
Verified signatureea905d4 -
Add SwarmLM orchestrator v3b cascade artifacts
Verified signaturee410732 -
Add SwarmLM orchestrator v3b cascade artifacts
Verified signaturee32b4b2
-
Add SwarmLM v2 model card
Verified signaturedd59169 -
Add reports/swarmlm_v2_cascade_hashed/manifest.json
Verified signature1f361d2 -
Add reports/swarmlm_v2_cascade_hashed/eval_swarmlm_v2_cascade.jsonl
Verified signature87702e5 -
Add reports/swarmlm_v2_cascade_hashed/SWARMLM_V2_CASCADE_REPORT.md
Verified signature5aab929 -
Add reports/swarmlm_v2_suite_hashed/manifest.json
Verified signatureb96fa5a -
Add reports/swarmlm_v2_suite_hashed/eval_swarmlm_v2_suite.jsonl
Verified signature995d39d -
Add reports/swarmlm_v2_suite_hashed/SWARMLM_V2_EVAL_REPORT_INTERPRETED.md
Verified signature485a98c -
Add reports/swarmlm_v2_suite_hashed/SWARMLM_V2_EVAL_REPORT.md
Verified signature4490775 -
Add reports/swarmlm_v2/SWARMLM_V2_SOULS_MANIFEST.json
Verified signature73487ff -
Add souls/orchestrator_v2/ORCHESTRATOR_V2.pt
Verified signature291825b -
Add souls/agentic_v2/AGENTIC_V2.pt
Verified signaturea1fd5eb -
Add souls/instruction_v2/INSTRUCTION_V2.pt
Verified signaturedf4a63a -
Add souls/text_align_v2/TEXT_ALIGN_V2.pt
Verified signature8cacca9 -
Update model card with SwarmLM v1 results
Verified signaturef4323a4 -
Add reports/HF_SWARMLM_CARD_UPDATE.md
Verified signatureafa56d0 -
Add reports/ALIGN_V2_PLAN.md
Verified signaturede2a7ea -
Add SwarmLM v1 technical report
Verified signatured55bb9c -
Add Orchestrator v1 Soul
Verified signature6504bdd -
Add Agentic v1 Soul
Verified signature7ec0210 -
Add Instruction v1 Soul
Verified signaturef828748 -
Add Text v2 aligned Soul
Verified signature243d972 -
Add SwarmLM v1 scientific evaluation report
Verified signaturef72aca6 -
Update README.md
Verified signature8fb69a3 -
Add Soul v2 smoke evaluation report
Verified signature2865955 -
Add Text v2 Soul checkpoint
Verified signature8fc3387