How to use from the
Use from the
Transformers library
# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="MC7ever/spark-darwin-5way", trust_remote_code=True)
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)
# pip install -U transformers accelerate
# Load model directly
from transformers import AutoModelForCausalLM
model = AutoModelForCausalLM.from_pretrained("MC7ever/spark-darwin-5way", trust_remote_code=True, device_map="auto")
Quick Links

spark-darwin-5way

Darwin uniform-soup of 5 Spark2.5-4B donors (pre-Ocean baseline for the 6-way at MC7ever/spark-darwin-6way). 290/290 tensors verified. Needs transformers==5.17.0 + trust_remote_code=True.

Downloads last month
45
Safetensors
Model size
4B params
Tensor type
BF16
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for MC7ever/spark-darwin-5way