Text Generation
Transformers
Safetensors
mistral
Generated from Trainer
conversational
text-generation-inference
Instructions to use Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# pip install -U transformers accelerate # Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts") model = AutoModelForCausalLM.from_pretrained("Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=256) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts
- SGLang
How to use Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Docker Model Runner
How to use Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts with Docker Model Runner:
docker model run hf.co/Aurore-Reveil/seed-2.0-reasoning-reverse-ckpts
File size: 79,143 Bytes
c94ee02 | 1 2 3 4 5 6 7 8 9 10 11 12 13 | [2026-02-24 02:51:52,548] [WARNING] [py.warnings._showwarnmsg:110] [PID:24011] /home/devuser/axo/axolotl/.venv/lib/python3.12/site-packages/torch/backends/__init__.py:46: UserWarning: Please use the new API settings to control TF32 behavior, such as torch.backends.cudnn.conv.fp32_precision = 'tf32' or torch.backends.cuda.matmul.fp32_precision = 'ieee'. Old settings, e.g, torch.backends.cuda.matmul.allow_tf32 = True, torch.backends.cudnn.allow_tf32 = True, allowTF32CuDNN() and allowTF32CuBLAS() will be deprecated after Pytorch 2.9. Please see https://pytorch.org/docs/main/notes/cuda.html#tensorfloat-32-tf32-on-ampere-and-later-devices (Triggered internally at /pytorch/aten/src/ATen/Context.cpp:80.)
self.setter(val)
[2026-02-24 02:51:56,062] [WARNING] [huggingface_hub.utils._http._warn_on_warning_headers:779] [PID:24011] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.
Downloading (incomplete total...): 0.00B [00:00, ?B/s]
Fetching 5 files: 0%| | 0/5 [00:00<?, ?it/s][A
Fetching 5 files: 20%|ββββββββββ | 1/5 [00:55<03:41, 55.27s/it][A
Fetching 5 files: 100%|ββββββββββββββββββββββββββββββββββββββββββββββββββ| 5/5 [00:55<00:00, 11.05s/it]
Download complete: : 0.00B [00:55, ?B/s]
Download complete: : 0.00B [00:55, ?B/s]
Loading weights: 0%| | 0/363 [00:00<?, ?it/s]
Loading weights: 0%| | 1/363 [00:00<00:00, 17848.10it/s, Materializing param=lm_head.weight]
Loading weights: 0%| | 1/363 [00:00<00:00, 7825.19it/s, Materializing param=lm_head.weight]
Loading weights: 1%| | 2/363 [00:00<00:00, 8004.40it/s, Materializing param=model.embed_tokens.weight
Loading weights: 1%| | 2/363 [00:00<00:00, 6497.76it/s, Materializing param=model.embed_tokens.weight
Loading weights: 1%| | 3/363 [00:00<00:00, 7113.01it/s, Materializing param=model.layers.0.input_laye
Loading weights: 1%| | 3/363 [00:00<00:00, 6235.34it/s, Materializing param=model.layers.0.input_laye
Loading weights: 1%| | 4/363 [00:00<00:00, 6574.14it/s, Materializing param=model.layers.0.mlp.down_p
Loading weights: 1%| | 4/363 [00:00<00:00, 5994.00it/s, Materializing param=model.layers.0.mlp.down_p
Loading weights: 1%| | 5/363 [00:00<00:00, 6440.88it/s, Materializing param=model.layers.0.mlp.gate_p
Loading weights: 1%| | 5/363 [00:00<00:00, 6022.84it/s, Materializing param=model.layers.0.mlp.gate_p
Loading weights: 2%| | 6/363 [00:00<00:00, 6400.26it/s, Materializing param=model.layers.0.mlp.up_pro
Loading weights: 2%| | 6/363 [00:00<00:00, 6081.64it/s, Materializing param=model.layers.0.mlp.up_pro
Loading weights: 2%| | 7/363 [00:00<00:00, 6410.51it/s, Materializing param=model.layers.0.post_atten
Loading weights: 2%| | 7/363 [00:00<00:00, 6110.33it/s, Materializing param=model.layers.0.post_atten
Loading weights: 2%| | 8/363 [00:00<00:00, 3904.40it/s, Materializing param=model.layers.0.self_attn.
Loading weights: 2%| | 8/363 [00:00<00:00, 3789.75it/s, Materializing param=model.layers.0.self_attn.
Loading weights: 2%| | 9/363 [00:00<00:00, 4097.78it/s, Materializing param=model.layers.0.self_attn.
Loading weights: 2%| | 9/363 [00:00<00:00, 4012.83it/s, Materializing param=model.layers.0.self_attn.
Loading weights: 3%| | 10/363 [00:00<00:00, 4268.58it/s, Materializing param=model.layers.0.self_attn
Loading weights: 3%| | 10/363 [00:00<00:00, 4159.78it/s, Materializing param=model.layers.0.self_attn
Loading weights: 3%| | 11/363 [00:00<00:00, 4385.68it/s, Materializing param=model.layers.0.self_attn
Loading weights: 3%| | 11/363 [00:00<00:00, 4295.44it/s, Materializing param=model.layers.0.self_attn
Loading weights: 3%| | 12/363 [00:00<00:00, 3827.79it/s, Materializing param=model.layers.1.input_lay
Loading weights: 3%| | 12/363 [00:00<00:00, 3760.86it/s, Materializing param=model.layers.1.input_lay
Loading weights: 4%| | 13/363 [00:00<00:00, 3924.99it/s, Materializing param=model.layers.1.mlp.down_
Loading weights: 4%| | 13/363 [00:00<00:00, 3863.80it/s, Materializing param=model.layers.1.mlp.down_
Loading weights: 4%| | 14/363 [00:00<00:00, 3920.96it/s, Materializing param=model.layers.1.mlp.gate_
Loading weights: 4%| | 14/363 [00:00<00:00, 3859.11it/s, Materializing param=model.layers.1.mlp.gate_
Loading weights: 4%| | 15/363 [00:00<00:00, 4026.53it/s, Materializing param=model.layers.1.mlp.up_pr
Loading weights: 4%| | 15/363 [00:00<00:00, 3974.64it/s, Materializing param=model.layers.1.mlp.up_pr
Loading weights: 4%| | 16/363 [00:00<00:00, 3870.62it/s, Materializing param=model.layers.1.post_atte
Loading weights: 4%| | 16/363 [00:00<00:00, 3822.56it/s, Materializing param=model.layers.1.post_atte
Loading weights: 5%| | 17/363 [00:00<00:00, 3967.46it/s, Materializing param=model.layers.1.self_attn
Loading weights: 5%| | 17/363 [00:00<00:00, 3925.52it/s, Materializing param=model.layers.1.self_attn
Loading weights: 5%| | 18/363 [00:00<00:00, 4050.29it/s, Materializing param=model.layers.1.self_attn
Loading weights: 5%| | 18/363 [00:00<00:00, 4001.77it/s, Materializing param=model.layers.1.self_attn
Loading weights: 5%| | 19/363 [00:00<00:00, 3879.46it/s, Materializing param=model.layers.1.self_attn
Loading weights: 5%| | 19/363 [00:00<00:00, 3836.87it/s, Materializing param=model.layers.1.self_attn
Loading weights: 6%| | 20/363 [00:00<00:00, 3960.25it/s, Materializing param=model.layers.1.self_attn
Loading weights: 6%| | 20/363 [00:00<00:00, 3922.11it/s, Materializing param=model.layers.1.self_attn
Loading weights: 6%| | 21/363 [00:00<00:00, 4040.76it/s, Materializing param=model.layers.2.input_lay
Loading weights: 6%| | 21/363 [00:00<00:00, 4001.47it/s, Materializing param=model.layers.2.input_lay
Loading weights: 6%| | 22/363 [00:00<00:00, 4115.00it/s, Materializing param=model.layers.2.mlp.down_
Loading weights: 6%| | 22/363 [00:00<00:00, 4068.01it/s, Materializing param=model.layers.2.mlp.down_
Loading weights: 6%| | 23/363 [00:00<00:00, 4175.42it/s, Materializing param=model.layers.2.mlp.gate_
Loading weights: 6%| | 23/363 [00:00<00:00, 4138.35it/s, Materializing param=model.layers.2.mlp.gate_
Loading weights: 7%| | 24/363 [00:00<00:00, 4234.53it/s, Materializing param=model.layers.2.mlp.up_pr
Loading weights: 7%| | 24/363 [00:00<00:00, 4197.98it/s, Materializing param=model.layers.2.mlp.up_pr
Loading weights: 7%| | 25/363 [00:00<00:00, 4315.66it/s, Materializing param=model.layers.2.post_atte
Loading weights: 7%| | 25/363 [00:00<00:00, 4278.68it/s, Materializing param=model.layers.2.post_atte
Loading weights: 7%| | 26/363 [00:00<00:00, 4066.37it/s, Materializing param=model.layers.2.self_attn
Loading weights: 7%| | 26/363 [00:00<00:00, 4028.66it/s, Materializing param=model.layers.2.self_attn
Loading weights: 7%| | 27/363 [00:00<00:00, 3983.33it/s, Materializing param=model.layers.2.self_attn
Loading weights: 7%| | 27/363 [00:00<00:00, 3951.64it/s, Materializing param=model.layers.2.self_attn
Loading weights: 8%| | 28/363 [00:00<00:00, 4036.87it/s, Materializing param=model.layers.2.self_attn
Loading weights: 8%| | 28/363 [00:00<00:00, 4008.35it/s, Materializing param=model.layers.2.self_attn
Loading weights: 8%| | 29/363 [00:00<00:00, 4078.28it/s, Materializing param=model.layers.2.self_attn
Loading weights: 8%| | 29/363 [00:00<00:00, 4051.93it/s, Materializing param=model.layers.2.self_attn
Loading weights: 8%| | 30/363 [00:00<00:00, 4074.91it/s, Materializing param=model.layers.3.input_lay
Loading weights: 8%| | 30/363 [00:00<00:00, 4039.46it/s, Materializing param=model.layers.3.input_lay
Loading weights: 9%| | 31/363 [00:00<00:00, 4118.05it/s, Materializing param=model.layers.3.mlp.down_
Loading weights: 9%| | 31/363 [00:00<00:00, 4091.36it/s, Materializing param=model.layers.3.mlp.down_
Loading weights: 9%| | 32/363 [00:00<00:00, 4169.55it/s, Materializing param=model.layers.3.mlp.gate_
Loading weights: 9%| | 32/363 [00:00<00:00, 4142.27it/s, Materializing param=model.layers.3.mlp.gate_
Loading weights: 9%| | 33/363 [00:00<00:00, 4216.15it/s, Materializing param=model.layers.3.mlp.up_pr
Loading weights: 9%| | 33/363 [00:00<00:00, 4190.37it/s, Materializing param=model.layers.3.mlp.up_pr
Loading weights: 9%| | 34/363 [00:00<00:00, 4266.97it/s, Materializing param=model.layers.3.post_atte
Loading weights: 9%| | 34/363 [00:00<00:00, 4239.95it/s, Materializing param=model.layers.3.post_atte
Loading weights: 10%| | 35/363 [00:00<00:00, 4309.93it/s, Materializing param=model.layers.3.self_attn
Loading weights: 10%| | 35/363 [00:00<00:00, 4284.40it/s, Materializing param=model.layers.3.self_attn
Loading weights: 10%| | 36/363 [00:00<00:00, 4356.21it/s, Materializing param=model.layers.3.self_attn
Loading weights: 10%| | 36/363 [00:00<00:00, 4330.47it/s, Materializing param=model.layers.3.self_attn
Loading weights: 10%| | 37/363 [00:00<00:00, 4139.26it/s, Materializing param=model.layers.3.self_attn
Loading weights: 10%| | 37/363 [00:00<00:00, 4110.97it/s, Materializing param=model.layers.3.self_attn
Loading weights: 10%| | 38/363 [00:00<00:00, 4172.89it/s, Materializing param=model.layers.3.self_attn
Loading weights: 10%| | 38/363 [00:00<00:00, 4148.88it/s, Materializing param=model.layers.3.self_attn
Loading weights: 11%| | 39/363 [00:00<00:00, 4218.86it/s, Materializing param=model.layers.4.input_lay
Loading weights: 11%| | 39/363 [00:00<00:00, 4196.56it/s, Materializing param=model.layers.4.input_lay
Loading weights: 11%| | 40/363 [00:00<00:00, 4252.46it/s, Materializing param=model.layers.4.mlp.down_
Loading weights: 11%| | 40/363 [00:00<00:00, 4228.13it/s, Materializing param=model.layers.4.mlp.down_
Loading weights: 11%| | 41/363 [00:00<00:00, 4149.47it/s, Materializing param=model.layers.4.mlp.gate_
Loading weights: 11%| | 41/363 [00:00<00:00, 4125.68it/s, Materializing param=model.layers.4.mlp.gate_
Loading weights: 12%| | 42/363 [00:00<00:00, 4181.76it/s, Materializing param=model.layers.4.mlp.up_pr
Loading weights: 12%| | 42/363 [00:00<00:00, 4161.11it/s, Materializing param=model.layers.4.mlp.up_pr
Loading weights: 12%| | 43/363 [00:00<00:00, 4053.74it/s, Materializing param=model.layers.4.post_atte
Loading weights: 12%| | 43/363 [00:00<00:00, 4029.65it/s, Materializing param=model.layers.4.post_atte
Loading weights: 12%| | 44/363 [00:00<00:00, 4088.83it/s, Materializing param=model.layers.4.self_attn
Loading weights: 12%| | 44/363 [00:00<00:00, 4069.54it/s, Materializing param=model.layers.4.self_attn
Loading weights: 12%| | 45/363 [00:00<00:00, 4040.15it/s, Materializing param=model.layers.4.self_attn
Loading weights: 12%| | 45/363 [00:00<00:00, 4020.36it/s, Materializing param=model.layers.4.self_attn
Loading weights: 13%|β| 46/363 [00:00<00:00, 4071.80it/s, Materializing param=model.layers.4.self_attn
Loading weights: 13%|β| 46/363 [00:00<00:00, 3922.38it/s, Materializing param=model.layers.4.self_attn
Loading weights: 13%|β| 47/363 [00:00<00:00, 3969.24it/s, Materializing param=model.layers.4.self_attn
Loading weights: 13%|β| 47/363 [00:00<00:00, 3951.02it/s, Materializing param=model.layers.4.self_attn
Loading weights: 13%|β| 48/363 [00:00<00:00, 3756.30it/s, Materializing param=model.layers.5.input_lay
Loading weights: 13%|β| 48/363 [00:00<00:00, 3740.04it/s, Materializing param=model.layers.5.input_lay
Loading weights: 13%|β| 49/363 [00:00<00:00, 3784.85it/s, Materializing param=model.layers.5.mlp.down_
Loading weights: 13%|β| 49/363 [00:00<00:00, 3769.23it/s, Materializing param=model.layers.5.mlp.down_
Loading weights: 14%|β| 50/363 [00:00<00:00, 3815.64it/s, Materializing param=model.layers.5.mlp.gate_
Loading weights: 14%|β| 50/363 [00:00<00:00, 3800.63it/s, Materializing param=model.layers.5.mlp.gate_
Loading weights: 14%|β| 51/363 [00:00<00:00, 3848.95it/s, Materializing param=model.layers.5.mlp.up_pr
Loading weights: 14%|β| 51/363 [00:00<00:00, 3834.12it/s, Materializing param=model.layers.5.mlp.up_pr
Loading weights: 14%|β| 52/363 [00:00<00:00, 3713.80it/s, Materializing param=model.layers.5.post_atte
Loading weights: 14%|β| 52/363 [00:00<00:00, 3697.18it/s, Materializing param=model.layers.5.post_atte
Loading weights: 15%|β| 53/363 [00:00<00:00, 3738.24it/s, Materializing param=model.layers.5.self_attn
Loading weights: 15%|β| 53/363 [00:00<00:00, 3723.96it/s, Materializing param=model.layers.5.self_attn
Loading weights: 15%|β| 54/363 [00:00<00:00, 3772.99it/s, Materializing param=model.layers.5.self_attn
Loading weights: 15%|β| 54/363 [00:00<00:00, 3759.71it/s, Materializing param=model.layers.5.self_attn
Loading weights: 15%|β| 55/363 [00:00<00:00, 3799.13it/s, Materializing param=model.layers.5.self_attn
Loading weights: 15%|β| 55/363 [00:00<00:00, 3785.60it/s, Materializing param=model.layers.5.self_attn
Loading weights: 15%|β| 56/363 [00:00<00:00, 3817.59it/s, Materializing param=model.layers.5.self_attn
Loading weights: 15%|β| 56/363 [00:00<00:00, 3803.99it/s, Materializing param=model.layers.5.self_attn
Loading weights: 16%|β| 57/363 [00:00<00:00, 3845.45it/s, Materializing param=model.layers.6.input_lay
Loading weights: 16%|β| 57/363 [00:00<00:00, 3832.07it/s, Materializing param=model.layers.6.input_lay
Loading weights: 16%|β| 58/363 [00:00<00:00, 3873.66it/s, Materializing param=model.layers.6.mlp.down_
Loading weights: 16%|β| 58/363 [00:00<00:00, 3860.32it/s, Materializing param=model.layers.6.mlp.down_
Loading weights: 16%|β| 59/363 [00:00<00:00, 3898.85it/s, Materializing param=model.layers.6.mlp.gate_
Loading weights: 16%|β| 59/363 [00:00<00:00, 3885.38it/s, Materializing param=model.layers.6.mlp.gate_
Loading weights: 17%|β| 60/363 [00:00<00:00, 3882.84it/s, Materializing param=model.layers.6.mlp.up_pr
Loading weights: 17%|β| 60/363 [00:00<00:00, 3869.34it/s, Materializing param=model.layers.6.mlp.up_pr
Loading weights: 17%|β| 61/363 [00:00<00:00, 3906.62it/s, Materializing param=model.layers.6.post_atte
Loading weights: 17%|β| 61/363 [00:00<00:00, 3893.72it/s, Materializing param=model.layers.6.post_atte
Loading weights: 17%|β| 62/363 [00:00<00:00, 3930.75it/s, Materializing param=model.layers.6.self_attn
Loading weights: 17%|β| 62/363 [00:00<00:00, 3917.73it/s, Materializing param=model.layers.6.self_attn
Loading weights: 17%|β| 63/363 [00:00<00:00, 3955.41it/s, Materializing param=model.layers.6.self_attn
Loading weights: 17%|β| 63/363 [00:00<00:00, 3942.96it/s, Materializing param=model.layers.6.self_attn
Loading weights: 18%|β| 64/363 [00:00<00:00, 3977.23it/s, Materializing param=model.layers.6.self_attn
Loading weights: 18%|β| 64/363 [00:00<00:00, 3693.59it/s, Materializing param=model.layers.6.self_attn
Loading weights: 18%|β| 65/363 [00:00<00:00, 3729.80it/s, Materializing param=model.layers.6.self_attn
Loading weights: 18%|β| 65/363 [00:00<00:00, 3718.25it/s, Materializing param=model.layers.6.self_attn
Loading weights: 18%|β| 66/363 [00:00<00:00, 3753.19it/s, Materializing param=model.layers.7.input_lay
Loading weights: 18%|β| 66/363 [00:00<00:00, 3740.82it/s, Materializing param=model.layers.7.input_lay
Loading weights: 18%|β| 67/363 [00:00<00:00, 3776.82it/s, Materializing param=model.layers.7.mlp.down_
Loading weights: 18%|β| 67/363 [00:00<00:00, 3766.09it/s, Materializing param=model.layers.7.mlp.down_
Loading weights: 19%|β| 68/363 [00:00<00:00, 3802.23it/s, Materializing param=model.layers.7.mlp.gate_
Loading weights: 19%|β| 68/363 [00:00<00:00, 3791.97it/s, Materializing param=model.layers.7.mlp.gate_
Loading weights: 19%|β| 69/363 [00:00<00:00, 3831.78it/s, Materializing param=model.layers.7.mlp.up_pr
Loading weights: 19%|β| 69/363 [00:00<00:00, 3821.71it/s, Materializing param=model.layers.7.mlp.up_pr
Loading weights: 19%|β| 70/363 [00:00<00:00, 3849.90it/s, Materializing param=model.layers.7.post_atte
Loading weights: 19%|β| 70/363 [00:00<00:00, 3839.23it/s, Materializing param=model.layers.7.post_atte
Loading weights: 20%|β| 71/363 [00:00<00:00, 3873.86it/s, Materializing param=model.layers.7.self_attn
Loading weights: 20%|β| 71/363 [00:00<00:00, 3860.56it/s, Materializing param=model.layers.7.self_attn
Loading weights: 20%|β| 72/363 [00:00<00:00, 3803.06it/s, Materializing param=model.layers.7.self_attn
Loading weights: 20%|β| 72/363 [00:00<00:00, 3791.75it/s, Materializing param=model.layers.7.self_attn
Loading weights: 20%|β| 73/363 [00:00<00:00, 3823.86it/s, Materializing param=model.layers.7.self_attn
Loading weights: 20%|β| 73/363 [00:00<00:00, 3813.95it/s, Materializing param=model.layers.7.self_attn
Loading weights: 20%|β| 74/363 [00:00<00:00, 3847.46it/s, Materializing param=model.layers.7.self_attn
Loading weights: 20%|β| 74/363 [00:00<00:00, 3800.17it/s, Materializing param=model.layers.7.self_attn
Loading weights: 21%|β| 75/363 [00:00<00:00, 3834.76it/s, Materializing param=model.layers.8.input_lay
Loading weights: 21%|β| 75/363 [00:00<00:00, 3824.59it/s, Materializing param=model.layers.8.input_lay
Loading weights: 21%|β| 76/363 [00:00<00:00, 3855.57it/s, Materializing param=model.layers.8.mlp.down_
Loading weights: 21%|β| 76/363 [00:00<00:00, 3845.80it/s, Materializing param=model.layers.8.mlp.down_
Loading weights: 21%|β| 77/363 [00:00<00:00, 3877.51it/s, Materializing param=model.layers.8.mlp.gate_
Loading weights: 21%|β| 77/363 [00:00<00:00, 3867.99it/s, Materializing param=model.layers.8.mlp.gate_
Loading weights: 21%|β| 78/363 [00:00<00:00, 3898.38it/s, Materializing param=model.layers.8.mlp.up_pr
Loading weights: 21%|β| 78/363 [00:00<00:00, 3888.88it/s, Materializing param=model.layers.8.mlp.up_pr
Loading weights: 22%|β| 79/363 [00:00<00:00, 3891.87it/s, Materializing param=model.layers.8.post_atte
Loading weights: 22%|β| 79/363 [00:00<00:00, 3881.34it/s, Materializing param=model.layers.8.post_atte
Loading weights: 22%|β| 80/363 [00:00<00:00, 3907.81it/s, Materializing param=model.layers.8.self_attn
Loading weights: 22%|β| 80/363 [00:00<00:00, 3898.19it/s, Materializing param=model.layers.8.self_attn
Loading weights: 22%|β| 81/363 [00:00<00:00, 3926.98it/s, Materializing param=model.layers.8.self_attn
Loading weights: 22%|β| 81/363 [00:00<00:00, 3917.56it/s, Materializing param=model.layers.8.self_attn
Loading weights: 23%|β| 82/363 [00:00<00:00, 3950.03it/s, Materializing param=model.layers.8.self_attn
Loading weights: 23%|β| 82/363 [00:00<00:00, 3941.16it/s, Materializing param=model.layers.8.self_attn
Loading weights: 23%|β| 83/363 [00:00<00:00, 3973.56it/s, Materializing param=model.layers.8.self_attn
Loading weights: 23%|β| 83/363 [00:00<00:00, 3964.60it/s, Materializing param=model.layers.8.self_attn
Loading weights: 23%|β| 84/363 [00:00<00:00, 3996.61it/s, Materializing param=model.layers.9.input_lay
Loading weights: 23%|β| 84/363 [00:00<00:00, 3987.75it/s, Materializing param=model.layers.9.input_lay
Loading weights: 23%|β| 85/363 [00:00<00:00, 4017.03it/s, Materializing param=model.layers.9.mlp.down_
Loading weights: 23%|β| 85/363 [00:00<00:00, 4007.82it/s, Materializing param=model.layers.9.mlp.down_
Loading weights: 24%|β| 86/363 [00:00<00:00, 4038.95it/s, Materializing param=model.layers.9.mlp.gate_
Loading weights: 24%|β| 86/363 [00:00<00:00, 4029.97it/s, Materializing param=model.layers.9.mlp.gate_
Loading weights: 24%|β| 87/363 [00:00<00:00, 4055.67it/s, Materializing param=model.layers.9.mlp.up_pr
Loading weights: 24%|β| 87/363 [00:00<00:00, 4045.95it/s, Materializing param=model.layers.9.mlp.up_pr
Loading weights: 24%|β| 88/363 [00:00<00:00, 4076.55it/s, Materializing param=model.layers.9.post_atte
Loading weights: 24%|β| 88/363 [00:00<00:00, 4065.86it/s, Materializing param=model.layers.9.post_atte
Loading weights: 25%|β| 89/363 [00:00<00:00, 4090.08it/s, Materializing param=model.layers.9.self_attn
Loading weights: 25%|β| 89/363 [00:00<00:00, 4080.46it/s, Materializing param=model.layers.9.self_attn
Loading weights: 25%|β| 90/363 [00:00<00:00, 4110.81it/s, Materializing param=model.layers.9.self_attn
Loading weights: 25%|β| 90/363 [00:00<00:00, 4101.65it/s, Materializing param=model.layers.9.self_attn
Loading weights: 25%|β| 91/363 [00:00<00:00, 4129.68it/s, Materializing param=model.layers.9.self_attn
Loading weights: 25%|β| 91/363 [00:00<00:00, 4120.05it/s, Materializing param=model.layers.9.self_attn
Loading weights: 25%|β| 92/363 [00:00<00:00, 4146.40it/s, Materializing param=model.layers.9.self_attn
Loading weights: 25%|β| 92/363 [00:00<00:00, 4137.28it/s, Materializing param=model.layers.9.self_attn
Loading weights: 26%|β| 93/363 [00:00<00:00, 4164.21it/s, Materializing param=model.layers.10.input_la
Loading weights: 26%|β| 93/363 [00:00<00:00, 4067.43it/s, Materializing param=model.layers.10.input_la
Loading weights: 26%|β| 94/363 [00:00<00:00, 4091.03it/s, Materializing param=model.layers.10.mlp.down
Loading weights: 26%|β| 94/363 [00:00<00:00, 4081.41it/s, Materializing param=model.layers.10.mlp.down
Loading weights: 26%|β| 95/363 [00:00<00:00, 3993.29it/s, Materializing param=model.layers.10.mlp.gate
Loading weights: 26%|β| 95/363 [00:00<00:00, 3983.59it/s, Materializing param=model.layers.10.mlp.gate
Loading weights: 26%|β| 96/363 [00:00<00:00, 4005.98it/s, Materializing param=model.layers.10.mlp.up_p
Loading weights: 26%|β| 96/363 [00:00<00:00, 3997.39it/s, Materializing param=model.layers.10.mlp.up_p
Loading weights: 27%|β| 97/363 [00:00<00:00, 4009.53it/s, Materializing param=model.layers.10.post_att
Loading weights: 27%|β| 97/363 [00:00<00:00, 4000.74it/s, Materializing param=model.layers.10.post_att
Loading weights: 27%|β| 98/363 [00:00<00:00, 3901.42it/s, Materializing param=model.layers.10.self_att
Loading weights: 27%|β| 98/363 [00:00<00:00, 3892.29it/s, Materializing param=model.layers.10.self_att
Loading weights: 27%|β| 99/363 [00:00<00:00, 3906.12it/s, Materializing param=model.layers.10.self_att
Loading weights: 27%|β| 99/363 [00:00<00:00, 3822.23it/s, Materializing param=model.layers.10.self_att
Loading weights: 28%|β| 100/363 [00:00<00:00, 3844.07it/s, Materializing param=model.layers.10.self_at
Loading weights: 28%|β| 100/363 [00:00<00:00, 3836.02it/s, Materializing param=model.layers.10.self_at
Loading weights: 28%|β| 101/363 [00:00<00:00, 3858.75it/s, Materializing param=model.layers.10.self_at
Loading weights: 28%|β| 101/363 [00:00<00:00, 3851.03it/s, Materializing param=model.layers.10.self_at
Loading weights: 28%|β| 102/363 [00:00<00:00, 3826.71it/s, Materializing param=model.layers.11.input_l
Loading weights: 28%|β| 102/363 [00:00<00:00, 3817.94it/s, Materializing param=model.layers.11.input_l
Loading weights: 28%|β| 103/363 [00:00<00:00, 3838.58it/s, Materializing param=model.layers.11.mlp.dow
Loading weights: 28%|β| 103/363 [00:00<00:00, 3764.76it/s, Materializing param=model.layers.11.mlp.dow
Loading weights: 29%|β| 104/363 [00:00<00:00, 3787.74it/s, Materializing param=model.layers.11.mlp.gat
Loading weights: 29%|β| 104/363 [00:00<00:00, 3780.52it/s, Materializing param=model.layers.11.mlp.gat
Loading weights: 29%|β| 105/363 [00:00<00:00, 3733.49it/s, Materializing param=model.layers.11.mlp.up_
Loading weights: 29%|β| 105/363 [00:00<00:00, 3726.16it/s, Materializing param=model.layers.11.mlp.up_
Loading weights: 29%|β| 106/363 [00:00<00:00, 3731.24it/s, Materializing param=model.layers.11.post_at
Loading weights: 29%|β| 106/363 [00:00<00:00, 3723.18it/s, Materializing param=model.layers.11.post_at
Loading weights: 29%|β| 107/363 [00:00<00:00, 3745.54it/s, Materializing param=model.layers.11.self_at
Loading weights: 29%|β| 107/363 [00:00<00:00, 3737.99it/s, Materializing param=model.layers.11.self_at
Loading weights: 30%|β| 108/363 [00:00<00:00, 3758.12it/s, Materializing param=model.layers.11.self_at
Loading weights: 30%|β| 108/363 [00:00<00:00, 3751.33it/s, Materializing param=model.layers.11.self_at
Loading weights: 30%|β| 109/363 [00:00<00:00, 3772.48it/s, Materializing param=model.layers.11.self_at
Loading weights: 30%|β| 109/363 [00:00<00:00, 3765.58it/s, Materializing param=model.layers.11.self_at
Loading weights: 30%|β| 110/363 [00:00<00:00, 3785.97it/s, Materializing param=model.layers.11.self_at
Loading weights: 30%|β| 110/363 [00:00<00:00, 3779.15it/s, Materializing param=model.layers.11.self_at
Loading weights: 31%|β| 111/363 [00:00<00:00, 3802.48it/s, Materializing param=model.layers.12.input_l
Loading weights: 31%|β| 111/363 [00:00<00:00, 3795.84it/s, Materializing param=model.layers.12.input_l
Loading weights: 31%|β| 112/363 [00:00<00:00, 3815.17it/s, Materializing param=model.layers.12.mlp.dow
Loading weights: 31%|β| 112/363 [00:00<00:00, 3806.36it/s, Materializing param=model.layers.12.mlp.dow
Loading weights: 31%|β| 113/363 [00:00<00:00, 3827.29it/s, Materializing param=model.layers.12.mlp.gat
Loading weights: 31%|β| 113/363 [00:00<00:00, 3820.75it/s, Materializing param=model.layers.12.mlp.gat
Loading weights: 31%|β| 114/363 [00:00<00:00, 3824.59it/s, Materializing param=model.layers.12.mlp.up_
Loading weights: 31%|β| 114/363 [00:00<00:00, 3817.42it/s, Materializing param=model.layers.12.mlp.up_
Loading weights: 32%|β| 115/363 [00:00<00:00, 3838.58it/s, Materializing param=model.layers.12.post_at
Loading weights: 32%|β| 115/363 [00:00<00:00, 3832.03it/s, Materializing param=model.layers.12.post_at
Loading weights: 32%|β| 116/363 [00:00<00:00, 3851.06it/s, Materializing param=model.layers.12.self_at
Loading weights: 32%|β| 116/363 [00:00<00:00, 3844.12it/s, Materializing param=model.layers.12.self_at
Loading weights: 32%|β| 117/363 [00:00<00:00, 3864.10it/s, Materializing param=model.layers.12.self_at
Loading weights: 32%|β| 117/363 [00:00<00:00, 3857.48it/s, Materializing param=model.layers.12.self_at
Loading weights: 33%|β| 118/363 [00:00<00:00, 3876.01it/s, Materializing param=model.layers.12.self_at
Loading weights: 33%|β| 118/363 [00:00<00:00, 3869.31it/s, Materializing param=model.layers.12.self_at
Loading weights: 33%|β| 119/363 [00:00<00:00, 3888.40it/s, Materializing param=model.layers.12.self_at
Loading weights: 33%|β| 119/363 [00:00<00:00, 3881.71it/s, Materializing param=model.layers.12.self_at
Loading weights: 33%|β| 120/363 [00:00<00:00, 3904.04it/s, Materializing param=model.layers.13.input_l
Loading weights: 33%|β| 120/363 [00:00<00:00, 3865.99it/s, Materializing param=model.layers.13.input_l
Loading weights: 33%|β| 121/363 [00:00<00:00, 3883.91it/s, Materializing param=model.layers.13.mlp.dow
Loading weights: 33%|β| 121/363 [00:00<00:00, 3877.00it/s, Materializing param=model.layers.13.mlp.dow
Loading weights: 34%|β| 122/363 [00:00<00:00, 3896.51it/s, Materializing param=model.layers.13.mlp.gat
Loading weights: 34%|β| 122/363 [00:00<00:00, 3889.93it/s, Materializing param=model.layers.13.mlp.gat
Loading weights: 34%|β| 123/363 [00:00<00:00, 3905.70it/s, Materializing param=model.layers.13.mlp.up_
Loading weights: 34%|β| 123/363 [00:00<00:00, 3899.41it/s, Materializing param=model.layers.13.mlp.up_
Loading weights: 34%|β| 124/363 [00:00<00:00, 3919.76it/s, Materializing param=model.layers.13.post_at
Loading weights: 34%|β| 124/363 [00:00<00:00, 3913.22it/s, Materializing param=model.layers.13.post_at
Loading weights: 34%|β| 125/363 [00:00<00:00, 3930.84it/s, Materializing param=model.layers.13.self_at
Loading weights: 34%|β| 125/363 [00:00<00:00, 3924.43it/s, Materializing param=model.layers.13.self_at
Loading weights: 35%|β| 126/363 [00:00<00:00, 3845.33it/s, Materializing param=model.layers.13.self_at
Loading weights: 35%|β| 126/363 [00:00<00:00, 3838.40it/s, Materializing param=model.layers.13.self_at
Loading weights: 35%|β| 127/363 [00:00<00:00, 3833.47it/s, Materializing param=model.layers.13.self_at
Loading weights: 35%|β| 127/363 [00:00<00:00, 3827.11it/s, Materializing param=model.layers.13.self_at
Loading weights: 35%|β| 128/363 [00:00<00:00, 3845.04it/s, Materializing param=model.layers.13.self_at
Loading weights: 35%|β| 128/363 [00:00<00:00, 3839.29it/s, Materializing param=model.layers.13.self_at
Loading weights: 36%|β| 129/363 [00:00<00:00, 3856.08it/s, Materializing param=model.layers.14.input_l
Loading weights: 36%|β| 129/363 [00:00<00:00, 3850.45it/s, Materializing param=model.layers.14.input_l
Loading weights: 36%|β| 130/363 [00:00<00:00, 3838.10it/s, Materializing param=model.layers.14.mlp.dow
Loading weights: 36%|β| 130/363 [00:00<00:00, 3831.60it/s, Materializing param=model.layers.14.mlp.dow
Loading weights: 36%|β| 131/363 [00:00<00:00, 3850.01it/s, Materializing param=model.layers.14.mlp.gat
Loading weights: 36%|β| 131/363 [00:00<00:00, 3844.62it/s, Materializing param=model.layers.14.mlp.gat
Loading weights: 36%|β| 132/363 [00:00<00:00, 3862.40it/s, Materializing param=model.layers.14.mlp.up_
Loading weights: 36%|β| 132/363 [00:00<00:00, 3856.75it/s, Materializing param=model.layers.14.mlp.up_
Loading weights: 37%|β| 133/363 [00:00<00:00, 3874.47it/s, Materializing param=model.layers.14.post_at
Loading weights: 37%|β| 133/363 [00:00<00:00, 3867.41it/s, Materializing param=model.layers.14.post_at
Loading weights: 37%|β| 134/363 [00:00<00:00, 3887.27it/s, Materializing param=model.layers.14.self_at
Loading weights: 37%|β| 134/363 [00:00<00:00, 3880.02it/s, Materializing param=model.layers.14.self_at
Loading weights: 37%|β| 135/363 [00:00<00:00, 3897.65it/s, Materializing param=model.layers.14.self_at
Loading weights: 37%|β| 135/363 [00:00<00:00, 3892.05it/s, Materializing param=model.layers.14.self_at
Loading weights: 37%|β| 136/363 [00:00<00:00, 3910.69it/s, Materializing param=model.layers.14.self_at
Loading weights: 37%|β| 136/363 [00:00<00:00, 3904.96it/s, Materializing param=model.layers.14.self_at
Loading weights: 38%|β| 137/363 [00:00<00:00, 3922.21it/s, Materializing param=model.layers.14.self_at
Loading weights: 38%|β| 137/363 [00:00<00:00, 3916.65it/s, Materializing param=model.layers.14.self_at
Loading weights: 38%|β| 138/363 [00:00<00:00, 3934.19it/s, Materializing param=model.layers.15.input_l
Loading weights: 38%|β| 138/363 [00:00<00:00, 3928.69it/s, Materializing param=model.layers.15.input_l
Loading weights: 38%|β| 139/363 [00:00<00:00, 3947.65it/s, Materializing param=model.layers.15.mlp.dow
Loading weights: 38%|β| 139/363 [00:00<00:00, 3942.36it/s, Materializing param=model.layers.15.mlp.dow
Loading weights: 39%|β| 140/363 [00:00<00:00, 3959.61it/s, Materializing param=model.layers.15.mlp.gat
Loading weights: 39%|β| 140/363 [00:00<00:00, 3952.58it/s, Materializing param=model.layers.15.mlp.gat
Loading weights: 39%|β| 141/363 [00:00<00:00, 3969.85it/s, Materializing param=model.layers.15.mlp.up_
Loading weights: 39%|β| 141/363 [00:00<00:00, 3964.45it/s, Materializing param=model.layers.15.mlp.up_
Loading weights: 39%|β| 142/363 [00:00<00:00, 3982.34it/s, Materializing param=model.layers.15.post_at
Loading weights: 39%|β| 142/363 [00:00<00:00, 3976.76it/s, Materializing param=model.layers.15.post_at
Loading weights: 39%|β| 143/363 [00:00<00:00, 3992.21it/s, Materializing param=model.layers.15.self_at
Loading weights: 39%|β| 143/363 [00:00<00:00, 3987.01it/s, Materializing param=model.layers.15.self_at
Loading weights: 40%|β| 144/363 [00:00<00:00, 4006.21it/s, Materializing param=model.layers.15.self_at
Loading weights: 40%|β| 144/363 [00:00<00:00, 4000.82it/s, Materializing param=model.layers.15.self_at
Loading weights: 40%|β| 145/363 [00:00<00:00, 3989.83it/s, Materializing param=model.layers.15.self_at
Loading weights: 40%|β| 145/363 [00:00<00:00, 3958.38it/s, Materializing param=model.layers.15.self_at
Loading weights: 40%|β| 146/363 [00:00<00:00, 3975.95it/s, Materializing param=model.layers.15.self_at
Loading weights: 40%|β| 146/363 [00:00<00:00, 3970.95it/s, Materializing param=model.layers.15.self_at
Loading weights: 40%|β| 147/363 [00:00<00:00, 3941.99it/s, Materializing param=model.layers.16.input_l
Loading weights: 40%|β| 147/363 [00:00<00:00, 3936.20it/s, Materializing param=model.layers.16.input_l
Loading weights: 41%|β| 148/363 [00:00<00:00, 3901.38it/s, Materializing param=model.layers.16.mlp.dow
Loading weights: 41%|β| 148/363 [00:00<00:00, 3895.90it/s, Materializing param=model.layers.16.mlp.dow
Loading weights: 41%|β| 149/363 [00:00<00:00, 3913.90it/s, Materializing param=model.layers.16.mlp.gat
Loading weights: 41%|β| 149/363 [00:00<00:00, 3908.88it/s, Materializing param=model.layers.16.mlp.gat
Loading weights: 41%|β| 150/363 [00:00<00:00, 3926.91it/s, Materializing param=model.layers.16.mlp.up_
Loading weights: 41%|β| 150/363 [00:00<00:00, 3922.04it/s, Materializing param=model.layers.16.mlp.up_
Loading weights: 42%|β| 151/363 [00:00<00:00, 3937.90it/s, Materializing param=model.layers.16.post_at
Loading weights: 42%|β| 151/363 [00:00<00:00, 3901.70it/s, Materializing param=model.layers.16.post_at
Loading weights: 42%|β| 152/363 [00:00<00:00, 3917.24it/s, Materializing param=model.layers.16.self_at
Loading weights: 42%|β| 152/363 [00:00<00:00, 3912.00it/s, Materializing param=model.layers.16.self_at
Loading weights: 42%|β| 153/363 [00:00<00:00, 3904.81it/s, Materializing param=model.layers.16.self_at
Loading weights: 42%|β| 153/363 [00:00<00:00, 3899.85it/s, Materializing param=model.layers.16.self_at
Loading weights: 42%|β| 154/363 [00:00<00:00, 3917.20it/s, Materializing param=model.layers.16.self_at
Loading weights: 42%|β| 154/363 [00:00<00:00, 3912.45it/s, Materializing param=model.layers.16.self_at
Loading weights: 43%|β| 155/363 [00:00<00:00, 3927.96it/s, Materializing param=model.layers.16.self_at
Loading weights: 43%|β| 155/363 [00:00<00:00, 3923.08it/s, Materializing param=model.layers.16.self_at
Loading weights: 43%|β| 156/363 [00:00<00:00, 3938.81it/s, Materializing param=model.layers.17.input_l
Loading weights: 43%|β| 156/363 [00:00<00:00, 3933.89it/s, Materializing param=model.layers.17.input_l
Loading weights: 43%|β| 157/363 [00:00<00:00, 3915.92it/s, Materializing param=model.layers.17.mlp.dow
Loading weights: 43%|β| 157/363 [00:00<00:00, 3909.97it/s, Materializing param=model.layers.17.mlp.dow
Loading weights: 44%|β| 158/363 [00:00<00:00, 3908.93it/s, Materializing param=model.layers.17.mlp.gat
Loading weights: 44%|β| 158/363 [00:00<00:00, 3903.15it/s, Materializing param=model.layers.17.mlp.gat
Loading weights: 44%|β| 159/363 [00:00<00:00, 3917.88it/s, Materializing param=model.layers.17.mlp.up_
Loading weights: 44%|β| 159/363 [00:00<00:00, 3912.99it/s, Materializing param=model.layers.17.mlp.up_
Loading weights: 44%|β| 160/363 [00:00<00:00, 3927.02it/s, Materializing param=model.layers.17.post_at
Loading weights: 44%|β| 160/363 [00:00<00:00, 3922.11it/s, Materializing param=model.layers.17.post_at
Loading weights: 44%|β| 161/363 [00:00<00:00, 3937.28it/s, Materializing param=model.layers.17.self_at
Loading weights: 44%|β| 161/363 [00:00<00:00, 3932.56it/s, Materializing param=model.layers.17.self_at
Loading weights: 45%|β| 162/363 [00:00<00:00, 3947.53it/s, Materializing param=model.layers.17.self_at
Loading weights: 45%|β| 162/363 [00:00<00:00, 3942.79it/s, Materializing param=model.layers.17.self_at
Loading weights: 45%|β| 163/363 [00:00<00:00, 3956.59it/s, Materializing param=model.layers.17.self_at
Loading weights: 45%|β| 163/363 [00:00<00:00, 3951.84it/s, Materializing param=model.layers.17.self_at
Loading weights: 45%|β| 164/363 [00:00<00:00, 3967.07it/s, Materializing param=model.layers.17.self_at
Loading weights: 45%|β| 164/363 [00:00<00:00, 3960.97it/s, Materializing param=model.layers.17.self_at
Loading weights: 45%|β| 165/363 [00:00<00:00, 3975.46it/s, Materializing param=model.layers.18.input_l
Loading weights: 45%|β| 165/363 [00:00<00:00, 3970.92it/s, Materializing param=model.layers.18.input_l
Loading weights: 46%|β| 166/363 [00:00<00:00, 3962.41it/s, Materializing param=model.layers.18.mlp.dow
Loading weights: 46%|β| 166/363 [00:00<00:00, 3956.80it/s, Materializing param=model.layers.18.mlp.dow
Loading weights: 46%|β| 167/363 [00:00<00:00, 3973.07it/s, Materializing param=model.layers.18.mlp.gat
Loading weights: 46%|β| 167/363 [00:00<00:00, 3968.32it/s, Materializing param=model.layers.18.mlp.gat
Loading weights: 46%|β| 168/363 [00:00<00:00, 3931.11it/s, Materializing param=model.layers.18.mlp.up_
Loading weights: 46%|β| 168/363 [00:00<00:00, 3925.72it/s, Materializing param=model.layers.18.mlp.up_
Loading weights: 47%|β| 169/363 [00:00<00:00, 3855.86it/s, Materializing param=model.layers.18.post_at
Loading weights: 47%|β| 169/363 [00:00<00:00, 3849.93it/s, Materializing param=model.layers.18.post_at
Loading weights: 47%|β| 170/363 [00:00<00:00, 3864.48it/s, Materializing param=model.layers.18.self_at
Loading weights: 47%|β| 170/363 [00:00<00:00, 3859.90it/s, Materializing param=model.layers.18.self_at
Loading weights: 47%|β| 171/363 [00:00<00:00, 3874.24it/s, Materializing param=model.layers.18.self_at
Loading weights: 47%|β| 171/363 [00:00<00:00, 3869.81it/s, Materializing param=model.layers.18.self_at
Loading weights: 47%|β| 172/363 [00:00<00:00, 3882.95it/s, Materializing param=model.layers.18.self_at
Loading weights: 47%|β| 172/363 [00:00<00:00, 3878.40it/s, Materializing param=model.layers.18.self_at
Loading weights: 48%|β| 173/363 [00:00<00:00, 3891.01it/s, Materializing param=model.layers.18.self_at
Loading weights: 48%|β| 173/363 [00:00<00:00, 3886.49it/s, Materializing param=model.layers.18.self_at
Loading weights: 48%|β| 174/363 [00:00<00:00, 3864.20it/s, Materializing param=model.layers.19.input_l
Loading weights: 48%|β| 174/363 [00:00<00:00, 3859.40it/s, Materializing param=model.layers.19.input_l
Loading weights: 48%|β| 175/363 [00:00<00:00, 3872.53it/s, Materializing param=model.layers.19.mlp.dow
Loading weights: 48%|β| 175/363 [00:00<00:00, 3868.10it/s, Materializing param=model.layers.19.mlp.dow
Loading weights: 48%|β| 176/363 [00:00<00:00, 3882.06it/s, Materializing param=model.layers.19.mlp.gat
Loading weights: 48%|β| 176/363 [00:00<00:00, 3876.33it/s, Materializing param=model.layers.19.mlp.gat
Loading weights: 49%|β| 177/363 [00:00<00:00, 3861.07it/s, Materializing param=model.layers.19.mlp.up_
Loading weights: 49%|β| 177/363 [00:00<00:00, 3856.34it/s, Materializing param=model.layers.19.mlp.up_
Loading weights: 49%|β| 178/363 [00:00<00:00, 3868.86it/s, Materializing param=model.layers.19.post_at
Loading weights: 49%|β| 178/363 [00:00<00:00, 3864.44it/s, Materializing param=model.layers.19.post_at
Loading weights: 49%|β| 179/363 [00:00<00:00, 3877.62it/s, Materializing param=model.layers.19.self_at
Loading weights: 49%|β| 179/363 [00:00<00:00, 3873.42it/s, Materializing param=model.layers.19.self_at
Loading weights: 50%|β| 180/363 [00:00<00:00, 3887.77it/s, Materializing param=model.layers.19.self_at
Loading weights: 50%|β| 180/363 [00:00<00:00, 3883.79it/s, Materializing param=model.layers.19.self_at
Loading weights: 50%|β| 181/363 [00:00<00:00, 3896.53it/s, Materializing param=model.layers.19.self_at
Loading weights: 50%|β| 181/363 [00:00<00:00, 3892.42it/s, Materializing param=model.layers.19.self_at
Loading weights: 50%|β| 182/363 [00:00<00:00, 3904.67it/s, Materializing param=model.layers.19.self_at
Loading weights: 50%|β| 182/363 [00:00<00:00, 3900.28it/s, Materializing param=model.layers.19.self_at
Loading weights: 50%|β| 183/363 [00:00<00:00, 3887.98it/s, Materializing param=model.layers.20.input_l
Loading weights: 50%|β| 183/363 [00:00<00:00, 3883.14it/s, Materializing param=model.layers.20.input_l
Loading weights: 51%|β| 184/363 [00:00<00:00, 3897.24it/s, Materializing param=model.layers.20.mlp.dow
Loading weights: 51%|β| 184/363 [00:00<00:00, 3893.43it/s, Materializing param=model.layers.20.mlp.dow
Loading weights: 51%|β| 185/363 [00:00<00:00, 3891.03it/s, Materializing param=model.layers.20.mlp.gat
Loading weights: 51%|β| 185/363 [00:00<00:00, 3885.95it/s, Materializing param=model.layers.20.mlp.gat
Loading weights: 51%|β| 186/363 [00:00<00:00, 3898.71it/s, Materializing param=model.layers.20.mlp.up_
Loading weights: 51%|β| 186/363 [00:00<00:00, 3894.70it/s, Materializing param=model.layers.20.mlp.up_
Loading weights: 52%|β| 187/363 [00:00<00:00, 3907.51it/s, Materializing param=model.layers.20.post_at
Loading weights: 52%|β| 187/363 [00:00<00:00, 3852.60it/s, Materializing param=model.layers.20.post_at
Loading weights: 52%|β| 188/363 [00:00<00:00, 3865.74it/s, Materializing param=model.layers.20.self_at
Loading weights: 52%|β| 188/363 [00:00<00:00, 3861.80it/s, Materializing param=model.layers.20.self_at
Loading weights: 52%|β| 189/363 [00:00<00:00, 3788.75it/s, Materializing param=model.layers.20.self_at
Loading weights: 52%|β| 189/363 [00:00<00:00, 3784.28it/s, Materializing param=model.layers.20.self_at
Loading weights: 52%|β| 190/363 [00:00<00:00, 3792.91it/s, Materializing param=model.layers.20.self_at
Loading weights: 52%|β| 190/363 [00:00<00:00, 3789.14it/s, Materializing param=model.layers.20.self_at
Loading weights: 53%|β| 191/363 [00:00<00:00, 3783.52it/s, Materializing param=model.layers.20.self_at
Loading weights: 53%|β| 191/363 [00:00<00:00, 3779.19it/s, Materializing param=model.layers.20.self_at
Loading weights: 53%|β| 192/363 [00:00<00:00, 3789.32it/s, Materializing param=model.layers.21.input_l
Loading weights: 53%|β| 192/363 [00:00<00:00, 3785.54it/s, Materializing param=model.layers.21.input_l
Loading weights: 53%|β| 193/363 [00:00<00:00, 3797.67it/s, Materializing param=model.layers.21.mlp.dow
Loading weights: 53%|β| 193/363 [00:00<00:00, 3794.04it/s, Materializing param=model.layers.21.mlp.dow
Loading weights: 53%|β| 194/363 [00:00<00:00, 3807.28it/s, Materializing param=model.layers.21.mlp.gat
Loading weights: 53%|β| 194/363 [00:00<00:00, 3803.61it/s, Materializing param=model.layers.21.mlp.gat
Loading weights: 54%|β| 195/363 [00:00<00:00, 3816.12it/s, Materializing param=model.layers.21.mlp.up_
Loading weights: 54%|β| 195/363 [00:00<00:00, 3812.35it/s, Materializing param=model.layers.21.mlp.up_
Loading weights: 54%|β| 196/363 [00:00<00:00, 3824.80it/s, Materializing param=model.layers.21.post_at
Loading weights: 54%|β| 196/363 [00:00<00:00, 3820.93it/s, Materializing param=model.layers.21.post_at
Loading weights: 54%|β| 197/363 [00:00<00:00, 3757.48it/s, Materializing param=model.layers.21.self_at
Loading weights: 54%|β| 197/363 [00:00<00:00, 3753.66it/s, Materializing param=model.layers.21.self_at
Loading weights: 55%|β| 198/363 [00:00<00:00, 3763.48it/s, Materializing param=model.layers.21.self_at
Loading weights: 55%|β| 198/363 [00:00<00:00, 3759.82it/s, Materializing param=model.layers.21.self_at
Loading weights: 55%|β| 199/363 [00:00<00:00, 3771.55it/s, Materializing param=model.layers.21.self_at
Loading weights: 55%|β| 199/363 [00:00<00:00, 3768.09it/s, Materializing param=model.layers.21.self_at
Loading weights: 55%|β| 200/363 [00:00<00:00, 3777.44it/s, Materializing param=model.layers.21.self_at
Loading weights: 55%|β| 200/363 [00:00<00:00, 3773.72it/s, Materializing param=model.layers.21.self_at
Loading weights: 55%|β| 201/363 [00:00<00:00, 3785.52it/s, Materializing param=model.layers.22.input_l
Loading weights: 55%|β| 201/363 [00:00<00:00, 3782.01it/s, Materializing param=model.layers.22.input_l
Loading weights: 56%|β| 202/363 [00:00<00:00, 3738.82it/s, Materializing param=model.layers.22.mlp.dow
Loading weights: 56%|β| 202/363 [00:00<00:00, 3734.83it/s, Materializing param=model.layers.22.mlp.dow
Loading weights: 56%|β| 203/363 [00:00<00:00, 3746.78it/s, Materializing param=model.layers.22.mlp.gat
Loading weights: 56%|β| 203/363 [00:00<00:00, 3743.40it/s, Materializing param=model.layers.22.mlp.gat
Loading weights: 56%|β| 204/363 [00:00<00:00, 3755.04it/s, Materializing param=model.layers.22.mlp.up_
Loading weights: 56%|β| 204/363 [00:00<00:00, 3744.50it/s, Materializing param=model.layers.22.mlp.up_
Loading weights: 56%|β| 205/363 [00:00<00:00, 3756.78it/s, Materializing param=model.layers.22.post_at
Loading weights: 56%|β| 205/363 [00:00<00:00, 3753.04it/s, Materializing param=model.layers.22.post_at
Loading weights: 57%|β| 206/363 [00:00<00:00, 3740.52it/s, Materializing param=model.layers.22.self_at
Loading weights: 57%|β| 206/363 [00:00<00:00, 3736.83it/s, Materializing param=model.layers.22.self_at
Loading weights: 57%|β| 207/363 [00:00<00:00, 3748.10it/s, Materializing param=model.layers.22.self_at
Loading weights: 57%|β| 207/363 [00:00<00:00, 3716.64it/s, Materializing param=model.layers.22.self_at
Loading weights: 57%|β| 208/363 [00:00<00:00, 3727.60it/s, Materializing param=model.layers.22.self_at
Loading weights: 57%|β| 208/363 [00:00<00:00, 3724.12it/s, Materializing param=model.layers.22.self_at
Loading weights: 58%|β| 209/363 [00:00<00:00, 3722.00it/s, Materializing param=model.layers.22.self_at
Loading weights: 58%|β| 209/363 [00:00<00:00, 3718.43it/s, Materializing param=model.layers.22.self_at
Loading weights: 58%|β| 210/363 [00:00<00:00, 3729.60it/s, Materializing param=model.layers.23.input_l
Loading weights: 58%|β| 210/363 [00:00<00:00, 3726.54it/s, Materializing param=model.layers.23.input_l
Loading weights: 58%|β| 211/363 [00:00<00:00, 3734.33it/s, Materializing param=model.layers.23.mlp.dow
Loading weights: 58%|β| 211/363 [00:00<00:00, 3731.04it/s, Materializing param=model.layers.23.mlp.dow
Loading weights: 58%|β| 212/363 [00:00<00:00, 3742.44it/s, Materializing param=model.layers.23.mlp.gat
Loading weights: 58%|β| 212/363 [00:00<00:00, 3739.18it/s, Materializing param=model.layers.23.mlp.gat
Loading weights: 59%|β| 213/363 [00:00<00:00, 3728.89it/s, Materializing param=model.layers.23.mlp.up_
Loading weights: 59%|β| 213/363 [00:00<00:00, 3725.35it/s, Materializing param=model.layers.23.mlp.up_
Loading weights: 59%|β| 214/363 [00:00<00:00, 3736.29it/s, Materializing param=model.layers.23.post_at
Loading weights: 59%|β| 214/363 [00:00<00:00, 3732.94it/s, Materializing param=model.layers.23.post_at
Loading weights: 59%|β| 215/363 [00:00<00:00, 3742.77it/s, Materializing param=model.layers.23.self_at
Loading weights: 59%|β| 215/363 [00:00<00:00, 3739.42it/s, Materializing param=model.layers.23.self_at
Loading weights: 60%|β| 216/363 [00:00<00:00, 3751.09it/s, Materializing param=model.layers.23.self_at
Loading weights: 60%|β| 216/363 [00:00<00:00, 3747.63it/s, Materializing param=model.layers.23.self_at
Loading weights: 60%|β| 217/363 [00:00<00:00, 3758.51it/s, Materializing param=model.layers.23.self_at
Loading weights: 60%|β| 217/363 [00:00<00:00, 3755.25it/s, Materializing param=model.layers.23.self_at
Loading weights: 60%|β| 218/363 [00:00<00:00, 3765.61it/s, Materializing param=model.layers.23.self_at
Loading weights: 60%|β| 218/363 [00:00<00:00, 3762.45it/s, Materializing param=model.layers.23.self_at
Loading weights: 60%|β| 219/363 [00:00<00:00, 3773.47it/s, Materializing param=model.layers.24.input_l
Loading weights: 60%|β| 219/363 [00:00<00:00, 3770.37it/s, Materializing param=model.layers.24.input_l
Loading weights: 61%|β| 220/363 [00:00<00:00, 3781.16it/s, Materializing param=model.layers.24.mlp.dow
Loading weights: 61%|β| 220/363 [00:00<00:00, 3778.27it/s, Materializing param=model.layers.24.mlp.dow
Loading weights: 61%|β| 221/363 [00:00<00:00, 3788.43it/s, Materializing param=model.layers.24.mlp.gat
Loading weights: 61%|β| 221/363 [00:00<00:00, 3784.36it/s, Materializing param=model.layers.24.mlp.gat
Loading weights: 61%|β| 222/363 [00:00<00:00, 3795.29it/s, Materializing param=model.layers.24.mlp.up_
Loading weights: 61%|β| 222/363 [00:00<00:00, 3792.18it/s, Materializing param=model.layers.24.mlp.up_
Loading weights: 61%|β| 223/363 [00:00<00:00, 3779.69it/s, Materializing param=model.layers.24.post_at
Loading weights: 61%|β| 223/363 [00:00<00:00, 3776.20it/s, Materializing param=model.layers.24.post_at
Loading weights: 62%|β| 224/363 [00:00<00:00, 3786.68it/s, Materializing param=model.layers.24.self_at
Loading weights: 62%|β| 224/363 [00:00<00:00, 3783.48it/s, Materializing param=model.layers.24.self_at
Loading weights: 62%|β| 225/363 [00:00<00:00, 3795.23it/s, Materializing param=model.layers.24.self_at
Loading weights: 62%|β| 225/363 [00:00<00:00, 3791.98it/s, Materializing param=model.layers.24.self_at
Loading weights: 62%|β| 226/363 [00:00<00:00, 3800.91it/s, Materializing param=model.layers.24.self_at
Loading weights: 62%|β| 226/363 [00:00<00:00, 3791.10it/s, Materializing param=model.layers.24.self_at
Loading weights: 63%|β| 227/363 [00:00<00:00, 3713.32it/s, Materializing param=model.layers.24.self_at
Loading weights: 63%|β| 227/363 [00:00<00:00, 3710.28it/s, Materializing param=model.layers.24.self_at
Loading weights: 63%|β| 228/363 [00:00<00:00, 3720.29it/s, Materializing param=model.layers.25.input_l
Loading weights: 63%|β| 228/363 [00:00<00:00, 3717.21it/s, Materializing param=model.layers.25.input_l
Loading weights: 63%|β| 229/363 [00:00<00:00, 3727.47it/s, Materializing param=model.layers.25.mlp.dow
Loading weights: 63%|β| 229/363 [00:00<00:00, 3724.50it/s, Materializing param=model.layers.25.mlp.dow
Loading weights: 63%|β| 230/363 [00:00<00:00, 3735.05it/s, Materializing param=model.layers.25.mlp.gat
Loading weights: 63%|β| 230/363 [00:00<00:00, 3731.59it/s, Materializing param=model.layers.25.mlp.gat
Loading weights: 64%|β| 231/363 [00:00<00:00, 3740.27it/s, Materializing param=model.layers.25.mlp.up_
Loading weights: 64%|β| 231/363 [00:00<00:00, 3737.19it/s, Materializing param=model.layers.25.mlp.up_
Loading weights: 64%|β| 232/363 [00:00<00:00, 3725.83it/s, Materializing param=model.layers.25.post_at
Loading weights: 64%|β| 232/363 [00:00<00:00, 3722.74it/s, Materializing param=model.layers.25.post_at
Loading weights: 64%|β| 233/363 [00:00<00:00, 3731.60it/s, Materializing param=model.layers.25.self_at
Loading weights: 64%|β| 233/363 [00:00<00:00, 3728.50it/s, Materializing param=model.layers.25.self_at
Loading weights: 64%|β| 234/363 [00:00<00:00, 3739.89it/s, Materializing param=model.layers.25.self_at
Loading weights: 64%|β| 234/363 [00:00<00:00, 3736.80it/s, Materializing param=model.layers.25.self_at
Loading weights: 65%|β| 235/363 [00:00<00:00, 3736.52it/s, Materializing param=model.layers.25.self_at
Loading weights: 65%|β| 235/363 [00:00<00:00, 3733.18it/s, Materializing param=model.layers.25.self_at
Loading weights: 65%|β| 236/363 [00:00<00:00, 3743.23it/s, Materializing param=model.layers.25.self_at
Loading weights: 65%|β| 236/363 [00:00<00:00, 3740.48it/s, Materializing param=model.layers.25.self_at
Loading weights: 65%|β| 237/363 [00:00<00:00, 3750.79it/s, Materializing param=model.layers.26.input_l
Loading weights: 65%|β| 237/363 [00:00<00:00, 3748.01it/s, Materializing param=model.layers.26.input_l
Loading weights: 66%|β| 238/363 [00:00<00:00, 3742.63it/s, Materializing param=model.layers.26.mlp.dow
Loading weights: 66%|β| 238/363 [00:00<00:00, 3737.87it/s, Materializing param=model.layers.26.mlp.dow
Loading weights: 66%|β| 239/363 [00:00<00:00, 3747.49it/s, Materializing param=model.layers.26.mlp.gat
Loading weights: 66%|β| 239/363 [00:00<00:00, 3744.62it/s, Materializing param=model.layers.26.mlp.gat
Loading weights: 66%|β| 240/363 [00:00<00:00, 3754.89it/s, Materializing param=model.layers.26.mlp.up_
Loading weights: 66%|β| 240/363 [00:00<00:00, 3752.05it/s, Materializing param=model.layers.26.mlp.up_
Loading weights: 66%|β| 241/363 [00:00<00:00, 3762.27it/s, Materializing param=model.layers.26.post_at
Loading weights: 66%|β| 241/363 [00:00<00:00, 3758.39it/s, Materializing param=model.layers.26.post_at
Loading weights: 67%|β| 242/363 [00:00<00:00, 3768.72it/s, Materializing param=model.layers.26.self_at
Loading weights: 67%|β| 242/363 [00:00<00:00, 3765.80it/s, Materializing param=model.layers.26.self_at
Loading weights: 67%|β| 243/363 [00:00<00:00, 3775.22it/s, Materializing param=model.layers.26.self_at
Loading weights: 67%|β| 243/363 [00:00<00:00, 3771.34it/s, Materializing param=model.layers.26.self_at
Loading weights: 67%|β| 244/363 [00:00<00:00, 3755.04it/s, Materializing param=model.layers.26.self_at
Loading weights: 67%|β| 244/363 [00:00<00:00, 3751.90it/s, Materializing param=model.layers.26.self_at
Loading weights: 67%|β| 245/363 [00:00<00:00, 3762.48it/s, Materializing param=model.layers.26.self_at
Loading weights: 67%|β| 245/363 [00:00<00:00, 3759.48it/s, Materializing param=model.layers.26.self_at
Loading weights: 68%|β| 246/363 [00:00<00:00, 3770.13it/s, Materializing param=model.layers.27.input_l
Loading weights: 68%|β| 246/363 [00:00<00:00, 3767.41it/s, Materializing param=model.layers.27.input_l
Loading weights: 68%|β| 247/363 [00:00<00:00, 3776.68it/s, Materializing param=model.layers.27.mlp.dow
Loading weights: 68%|β| 247/363 [00:00<00:00, 3773.66it/s, Materializing param=model.layers.27.mlp.dow
Loading weights: 68%|β| 248/363 [00:00<00:00, 3767.43it/s, Materializing param=model.layers.27.mlp.gat
Loading weights: 68%|β| 248/363 [00:00<00:00, 3764.29it/s, Materializing param=model.layers.27.mlp.gat
Loading weights: 69%|β| 249/363 [00:00<00:00, 3725.56it/s, Materializing param=model.layers.27.mlp.up_
Loading weights: 69%|β| 249/363 [00:00<00:00, 3722.36it/s, Materializing param=model.layers.27.mlp.up_
Loading weights: 69%|β| 250/363 [00:00<00:00, 3731.51it/s, Materializing param=model.layers.27.post_at
Loading weights: 69%|β| 250/363 [00:00<00:00, 3728.56it/s, Materializing param=model.layers.27.post_at
Loading weights: 69%|β| 251/363 [00:00<00:00, 3738.48it/s, Materializing param=model.layers.27.self_at
Loading weights: 69%|β| 251/363 [00:00<00:00, 3735.72it/s, Materializing param=model.layers.27.self_at
Loading weights: 69%|β| 252/363 [00:00<00:00, 3746.00it/s, Materializing param=model.layers.27.self_at
Loading weights: 69%|β| 252/363 [00:00<00:00, 3743.27it/s, Materializing param=model.layers.27.self_at
Loading weights: 70%|β| 253/363 [00:00<00:00, 3752.73it/s, Materializing param=model.layers.27.self_at
Loading weights: 70%|β| 253/363 [00:00<00:00, 3749.88it/s, Materializing param=model.layers.27.self_at
Loading weights: 70%|β| 254/363 [00:00<00:00, 3725.96it/s, Materializing param=model.layers.27.self_at
Loading weights: 70%|β| 254/363 [00:00<00:00, 3722.98it/s, Materializing param=model.layers.27.self_at
Loading weights: 70%|β| 255/363 [00:00<00:00, 3732.03it/s, Materializing param=model.layers.28.input_l
Loading weights: 70%|β| 255/363 [00:00<00:00, 3729.26it/s, Materializing param=model.layers.28.input_l
Loading weights: 71%|β| 256/363 [00:00<00:00, 3738.92it/s, Materializing param=model.layers.28.mlp.dow
Loading weights: 71%|β| 256/363 [00:00<00:00, 3736.26it/s, Materializing param=model.layers.28.mlp.dow
Loading weights: 71%|β| 257/363 [00:00<00:00, 3738.21it/s, Materializing param=model.layers.28.mlp.gat
Loading weights: 71%|β| 257/363 [00:00<00:00, 3735.45it/s, Materializing param=model.layers.28.mlp.gat
Loading weights: 71%|β| 258/363 [00:00<00:00, 3744.62it/s, Materializing param=model.layers.28.mlp.up_
Loading weights: 71%|β| 258/363 [00:00<00:00, 3742.16it/s, Materializing param=model.layers.28.mlp.up_
Loading weights: 71%|β| 259/363 [00:00<00:00, 3751.78it/s, Materializing param=model.layers.28.post_at
Loading weights: 71%|β| 259/363 [00:00<00:00, 3749.02it/s, Materializing param=model.layers.28.post_at
Loading weights: 72%|β| 260/363 [00:00<00:00, 3719.89it/s, Materializing param=model.layers.28.self_at
Loading weights: 72%|β| 260/363 [00:00<00:00, 3716.83it/s, Materializing param=model.layers.28.self_at
Loading weights: 72%|β| 261/363 [00:00<00:00, 3725.28it/s, Materializing param=model.layers.28.self_at
Loading weights: 72%|β| 261/363 [00:00<00:00, 3722.77it/s, Materializing param=model.layers.28.self_at
Loading weights: 72%|β| 262/363 [00:00<00:00, 3714.63it/s, Materializing param=model.layers.28.self_at
Loading weights: 72%|β| 262/363 [00:00<00:00, 3711.77it/s, Materializing param=model.layers.28.self_at
Loading weights: 72%|β| 263/363 [00:00<00:00, 3679.23it/s, Materializing param=model.layers.28.self_at
Loading weights: 72%|β| 263/363 [00:00<00:00, 3676.49it/s, Materializing param=model.layers.28.self_at
Loading weights: 73%|β| 264/363 [00:00<00:00, 3678.74it/s, Materializing param=model.layers.29.input_l
Loading weights: 73%|β| 264/363 [00:00<00:00, 3676.36it/s, Materializing param=model.layers.29.input_l
Loading weights: 73%|β| 265/363 [00:00<00:00, 3687.22it/s, Materializing param=model.layers.29.mlp.dow
Loading weights: 73%|β| 265/363 [00:00<00:00, 3685.15it/s, Materializing param=model.layers.29.mlp.dow
Loading weights: 73%|β| 266/363 [00:00<00:00, 3695.99it/s, Materializing param=model.layers.29.mlp.gat
Loading weights: 73%|β| 266/363 [00:00<00:00, 3694.13it/s, Materializing param=model.layers.29.mlp.gat
Loading weights: 74%|β| 267/363 [00:00<00:00, 3705.12it/s, Materializing param=model.layers.29.mlp.up_
Loading weights: 74%|β| 267/363 [00:00<00:00, 3703.18it/s, Materializing param=model.layers.29.mlp.up_
Loading weights: 74%|β| 268/363 [00:00<00:00, 3714.15it/s, Materializing param=model.layers.29.post_at
Loading weights: 74%|β| 268/363 [00:00<00:00, 3712.13it/s, Materializing param=model.layers.29.post_at
Loading weights: 74%|β| 269/363 [00:00<00:00, 3723.05it/s, Materializing param=model.layers.29.self_at
Loading weights: 74%|β| 269/363 [00:00<00:00, 3721.00it/s, Materializing param=model.layers.29.self_at
Loading weights: 74%|β| 270/363 [00:00<00:00, 3731.99it/s, Materializing param=model.layers.29.self_at
Loading weights: 74%|β| 270/363 [00:00<00:00, 3729.14it/s, Materializing param=model.layers.29.self_at
Loading weights: 75%|β| 271/363 [00:00<00:00, 3739.84it/s, Materializing param=model.layers.29.self_at
Loading weights: 75%|β| 271/363 [00:00<00:00, 3737.75it/s, Materializing param=model.layers.29.self_at
Loading weights: 75%|β| 272/363 [00:00<00:00, 3748.69it/s, Materializing param=model.layers.29.self_at
Loading weights: 75%|β| 272/363 [00:00<00:00, 3746.38it/s, Materializing param=model.layers.29.self_at
Loading weights: 75%|β| 273/363 [00:00<00:00, 3757.31it/s, Materializing param=model.layers.30.input_l
Loading weights: 75%|β| 273/363 [00:00<00:00, 3755.24it/s, Materializing param=model.layers.30.input_l
Loading weights: 75%|β| 274/363 [00:00<00:00, 3766.18it/s, Materializing param=model.layers.30.mlp.dow
Loading weights: 75%|β| 274/363 [00:00<00:00, 3764.01it/s, Materializing param=model.layers.30.mlp.dow
Loading weights: 76%|β| 275/363 [00:00<00:00, 3774.87it/s, Materializing param=model.layers.30.mlp.gat
Loading weights: 76%|β| 275/363 [00:00<00:00, 3772.81it/s, Materializing param=model.layers.30.mlp.gat
Loading weights: 76%|β| 276/363 [00:00<00:00, 3783.67it/s, Materializing param=model.layers.30.mlp.up_
Loading weights: 76%|β| 276/363 [00:00<00:00, 3781.78it/s, Materializing param=model.layers.30.mlp.up_
Loading weights: 76%|β| 277/363 [00:00<00:00, 3792.54it/s, Materializing param=model.layers.30.post_at
Loading weights: 76%|β| 277/363 [00:00<00:00, 3790.57it/s, Materializing param=model.layers.30.post_at
Loading weights: 77%|β| 278/363 [00:00<00:00, 3801.31it/s, Materializing param=model.layers.30.self_at
Loading weights: 77%|β| 278/363 [00:00<00:00, 3799.14it/s, Materializing param=model.layers.30.self_at
Loading weights: 77%|β| 279/363 [00:00<00:00, 3809.75it/s, Materializing param=model.layers.30.self_at
Loading weights: 77%|β| 279/363 [00:00<00:00, 3807.59it/s, Materializing param=model.layers.30.self_at
Loading weights: 77%|β| 280/363 [00:00<00:00, 3818.32it/s, Materializing param=model.layers.30.self_at
Loading weights: 77%|β| 280/363 [00:00<00:00, 3816.37it/s, Materializing param=model.layers.30.self_at
Loading weights: 77%|β| 281/363 [00:00<00:00, 3826.62it/s, Materializing param=model.layers.30.self_at
Loading weights: 77%|β| 281/363 [00:00<00:00, 3824.56it/s, Materializing param=model.layers.30.self_at
Loading weights: 78%|β| 282/363 [00:00<00:00, 3835.54it/s, Materializing param=model.layers.31.input_l
Loading weights: 78%|β| 282/363 [00:00<00:00, 3833.42it/s, Materializing param=model.layers.31.input_l
Loading weights: 78%|β| 283/363 [00:00<00:00, 3843.70it/s, Materializing param=model.layers.31.mlp.dow
Loading weights: 78%|β| 283/363 [00:00<00:00, 3841.62it/s, Materializing param=model.layers.31.mlp.dow
Loading weights: 78%|β| 284/363 [00:00<00:00, 3852.05it/s, Materializing param=model.layers.31.mlp.gat
Loading weights: 78%|β| 284/363 [00:00<00:00, 3849.99it/s, Materializing param=model.layers.31.mlp.gat
Loading weights: 79%|β| 285/363 [00:00<00:00, 3860.71it/s, Materializing param=model.layers.31.mlp.up_
Loading weights: 79%|β| 285/363 [00:00<00:00, 3858.80it/s, Materializing param=model.layers.31.mlp.up_
Loading weights: 79%|β| 286/363 [00:00<00:00, 3869.43it/s, Materializing param=model.layers.31.post_at
Loading weights: 79%|β| 286/363 [00:00<00:00, 3867.38it/s, Materializing param=model.layers.31.post_at
Loading weights: 79%|β| 287/363 [00:00<00:00, 3878.01it/s, Materializing param=model.layers.31.self_at
Loading weights: 79%|β| 287/363 [00:00<00:00, 3875.94it/s, Materializing param=model.layers.31.self_at
Loading weights: 79%|β| 288/363 [00:00<00:00, 3886.55it/s, Materializing param=model.layers.31.self_at
Loading weights: 79%|β| 288/363 [00:00<00:00, 3884.63it/s, Materializing param=model.layers.31.self_at
Loading weights: 80%|β| 289/363 [00:00<00:00, 3895.35it/s, Materializing param=model.layers.31.self_at
Loading weights: 80%|β| 289/363 [00:00<00:00, 3892.86it/s, Materializing param=model.layers.31.self_at
Loading weights: 80%|β| 290/363 [00:00<00:00, 3903.41it/s, Materializing param=model.layers.31.self_at
Loading weights: 80%|β| 290/363 [00:00<00:00, 3901.54it/s, Materializing param=model.layers.31.self_at
Loading weights: 80%|β| 291/363 [00:00<00:00, 3911.68it/s, Materializing param=model.layers.32.input_l
Loading weights: 80%|β| 291/363 [00:00<00:00, 3909.61it/s, Materializing param=model.layers.32.input_l
Loading weights: 80%|β| 292/363 [00:00<00:00, 3920.15it/s, Materializing param=model.layers.32.mlp.dow
Loading weights: 80%|β| 292/363 [00:00<00:00, 3918.09it/s, Materializing param=model.layers.32.mlp.dow
Loading weights: 81%|β| 293/363 [00:00<00:00, 3928.61it/s, Materializing param=model.layers.32.mlp.gat
Loading weights: 81%|β| 293/363 [00:00<00:00, 3926.26it/s, Materializing param=model.layers.32.mlp.gat
Loading weights: 81%|β| 294/363 [00:00<00:00, 3936.79it/s, Materializing param=model.layers.32.mlp.up_
Loading weights: 81%|β| 294/363 [00:00<00:00, 3934.74it/s, Materializing param=model.layers.32.mlp.up_
Loading weights: 81%|β| 295/363 [00:00<00:00, 3945.26it/s, Materializing param=model.layers.32.post_at
Loading weights: 81%|β| 295/363 [00:00<00:00, 3943.12it/s, Materializing param=model.layers.32.post_at
Loading weights: 82%|β| 296/363 [00:00<00:00, 3953.63it/s, Materializing param=model.layers.32.self_at
Loading weights: 82%|β| 296/363 [00:00<00:00, 3951.37it/s, Materializing param=model.layers.32.self_at
Loading weights: 82%|β| 297/363 [00:00<00:00, 3961.92it/s, Materializing param=model.layers.32.self_at
Loading weights: 82%|β| 297/363 [00:00<00:00, 3959.82it/s, Materializing param=model.layers.32.self_at
Loading weights: 82%|β| 298/363 [00:00<00:00, 3970.43it/s, Materializing param=model.layers.32.self_at
Loading weights: 82%|β| 298/363 [00:00<00:00, 3968.30it/s, Materializing param=model.layers.32.self_at
Loading weights: 82%|β| 299/363 [00:00<00:00, 3978.89it/s, Materializing param=model.layers.32.self_at
Loading weights: 82%|β| 299/363 [00:00<00:00, 3976.80it/s, Materializing param=model.layers.32.self_at
Loading weights: 83%|β| 300/363 [00:00<00:00, 3987.25it/s, Materializing param=model.layers.33.input_l
Loading weights: 83%|β| 300/363 [00:00<00:00, 3985.04it/s, Materializing param=model.layers.33.input_l
Loading weights: 83%|β| 301/363 [00:00<00:00, 3995.35it/s, Materializing param=model.layers.33.mlp.dow
Loading weights: 83%|β| 301/363 [00:00<00:00, 3993.35it/s, Materializing param=model.layers.33.mlp.dow
Loading weights: 83%|β| 302/363 [00:00<00:00, 4002.83it/s, Materializing param=model.layers.33.mlp.gat
Loading weights: 83%|β| 302/363 [00:00<00:00, 4000.66it/s, Materializing param=model.layers.33.mlp.gat
Loading weights: 83%|β| 303/363 [00:00<00:00, 4010.90it/s, Materializing param=model.layers.33.mlp.up_
Loading weights: 83%|β| 303/363 [00:00<00:00, 4008.70it/s, Materializing param=model.layers.33.mlp.up_
Loading weights: 84%|β| 304/363 [00:00<00:00, 4018.56it/s, Materializing param=model.layers.33.post_at
Loading weights: 84%|β| 304/363 [00:00<00:00, 4016.41it/s, Materializing param=model.layers.33.post_at
Loading weights: 84%|β| 305/363 [00:00<00:00, 4026.47it/s, Materializing param=model.layers.33.self_at
Loading weights: 84%|β| 305/363 [00:00<00:00, 4024.56it/s, Materializing param=model.layers.33.self_at
Loading weights: 84%|β| 306/363 [00:00<00:00, 4034.78it/s, Materializing param=model.layers.33.self_at
Loading weights: 84%|β| 306/363 [00:00<00:00, 4032.69it/s, Materializing param=model.layers.33.self_at
Loading weights: 85%|β| 307/363 [00:00<00:00, 4042.89it/s, Materializing param=model.layers.33.self_at
Loading weights: 85%|β| 307/363 [00:00<00:00, 4040.74it/s, Materializing param=model.layers.33.self_at
Loading weights: 85%|β| 308/363 [00:00<00:00, 4050.90it/s, Materializing param=model.layers.33.self_at
Loading weights: 85%|β| 308/363 [00:00<00:00, 4048.80it/s, Materializing param=model.layers.33.self_at
Loading weights: 85%|β| 309/363 [00:00<00:00, 4058.99it/s, Materializing param=model.layers.34.input_l
Loading weights: 85%|β| 309/363 [00:00<00:00, 4056.91it/s, Materializing param=model.layers.34.input_l
Loading weights: 85%|β| 310/363 [00:00<00:00, 4067.17it/s, Materializing param=model.layers.34.mlp.dow
Loading weights: 85%|β| 310/363 [00:00<00:00, 4065.06it/s, Materializing param=model.layers.34.mlp.dow
Loading weights: 86%|β| 311/363 [00:00<00:00, 4075.26it/s, Materializing param=model.layers.34.mlp.gat
Loading weights: 86%|β| 311/363 [00:00<00:00, 4073.18it/s, Materializing param=model.layers.34.mlp.gat
Loading weights: 86%|β| 312/363 [00:00<00:00, 4082.91it/s, Materializing param=model.layers.34.mlp.up_
Loading weights: 86%|β| 312/363 [00:00<00:00, 4081.02it/s, Materializing param=model.layers.34.mlp.up_
Loading weights: 86%|β| 313/363 [00:00<00:00, 4091.33it/s, Materializing param=model.layers.34.post_at
Loading weights: 86%|β| 313/363 [00:00<00:00, 4089.10it/s, Materializing param=model.layers.34.post_at
Loading weights: 87%|β| 314/363 [00:00<00:00, 4098.75it/s, Materializing param=model.layers.34.self_at
Loading weights: 87%|β| 314/363 [00:00<00:00, 4096.59it/s, Materializing param=model.layers.34.self_at
Loading weights: 87%|β| 315/363 [00:00<00:00, 4106.58it/s, Materializing param=model.layers.34.self_at
Loading weights: 87%|β| 315/363 [00:00<00:00, 4104.53it/s, Materializing param=model.layers.34.self_at
Loading weights: 87%|β| 316/363 [00:00<00:00, 4114.49it/s, Materializing param=model.layers.34.self_at
Loading weights: 87%|β| 316/363 [00:00<00:00, 4112.14it/s, Materializing param=model.layers.34.self_at
Loading weights: 87%|β| 317/363 [00:00<00:00, 4122.08it/s, Materializing param=model.layers.34.self_at
Loading weights: 87%|β| 317/363 [00:00<00:00, 4119.85it/s, Materializing param=model.layers.34.self_at
Loading weights: 88%|β| 318/363 [00:00<00:00, 4129.85it/s, Materializing param=model.layers.35.input_l
Loading weights: 88%|β| 318/363 [00:00<00:00, 4127.70it/s, Materializing param=model.layers.35.input_l
Loading weights: 88%|β| 319/363 [00:00<00:00, 4137.71it/s, Materializing param=model.layers.35.mlp.dow
Loading weights: 88%|β| 319/363 [00:00<00:00, 4135.65it/s, Materializing param=model.layers.35.mlp.dow
Loading weights: 88%|β| 320/363 [00:00<00:00, 4145.89it/s, Materializing param=model.layers.35.mlp.gat
Loading weights: 88%|β| 320/363 [00:00<00:00, 4143.79it/s, Materializing param=model.layers.35.mlp.gat
Loading weights: 88%|β| 321/363 [00:00<00:00, 4153.80it/s, Materializing param=model.layers.35.mlp.up_
Loading weights: 88%|β| 321/363 [00:00<00:00, 4151.67it/s, Materializing param=model.layers.35.mlp.up_
Loading weights: 89%|β| 322/363 [00:00<00:00, 4161.62it/s, Materializing param=model.layers.35.post_at
Loading weights: 89%|β| 322/363 [00:00<00:00, 4158.89it/s, Materializing param=model.layers.35.post_at
Loading weights: 89%|β| 323/363 [00:00<00:00, 4168.67it/s, Materializing param=model.layers.35.self_at
Loading weights: 89%|β| 323/363 [00:00<00:00, 4166.56it/s, Materializing param=model.layers.35.self_at
Loading weights: 89%|β| 324/363 [00:00<00:00, 4176.58it/s, Materializing param=model.layers.35.self_at
Loading weights: 89%|β| 324/363 [00:00<00:00, 4174.35it/s, Materializing param=model.layers.35.self_at
Loading weights: 90%|β| 325/363 [00:00<00:00, 4184.06it/s, Materializing param=model.layers.35.self_at
Loading weights: 90%|β| 325/363 [00:00<00:00, 4181.91it/s, Materializing param=model.layers.35.self_at
Loading weights: 90%|β| 326/363 [00:00<00:00, 4191.67it/s, Materializing param=model.layers.35.self_at
Loading weights: 90%|β| 326/363 [00:00<00:00, 4189.63it/s, Materializing param=model.layers.35.self_at
Loading weights: 90%|β| 327/363 [00:00<00:00, 4199.71it/s, Materializing param=model.layers.36.input_l
Loading weights: 90%|β| 327/363 [00:00<00:00, 4197.55it/s, Materializing param=model.layers.36.input_l
Loading weights: 90%|β| 328/363 [00:00<00:00, 4207.48it/s, Materializing param=model.layers.36.mlp.dow
Loading weights: 90%|β| 328/363 [00:00<00:00, 4205.37it/s, Materializing param=model.layers.36.mlp.dow
Loading weights: 91%|β| 329/363 [00:00<00:00, 4215.25it/s, Materializing param=model.layers.36.mlp.gat
Loading weights: 91%|β| 329/363 [00:00<00:00, 4213.10it/s, Materializing param=model.layers.36.mlp.gat
Loading weights: 91%|β| 330/363 [00:00<00:00, 4222.60it/s, Materializing param=model.layers.36.mlp.up_
Loading weights: 91%|β| 330/363 [00:00<00:00, 4220.50it/s, Materializing param=model.layers.36.mlp.up_
Loading weights: 91%|β| 331/363 [00:00<00:00, 4230.05it/s, Materializing param=model.layers.36.post_at
Loading weights: 91%|β| 331/363 [00:00<00:00, 4227.86it/s, Materializing param=model.layers.36.post_at
Loading weights: 91%|β| 332/363 [00:00<00:00, 4237.61it/s, Materializing param=model.layers.36.self_at
Loading weights: 91%|β| 332/363 [00:00<00:00, 4234.78it/s, Materializing param=model.layers.36.self_at
Loading weights: 92%|β| 333/363 [00:00<00:00, 4244.42it/s, Materializing param=model.layers.36.self_at
Loading weights: 92%|β| 333/363 [00:00<00:00, 4242.41it/s, Materializing param=model.layers.36.self_at
Loading weights: 92%|β| 334/363 [00:00<00:00, 4252.36it/s, Materializing param=model.layers.36.self_at
Loading weights: 92%|β| 334/363 [00:00<00:00, 4250.27it/s, Materializing param=model.layers.36.self_at
Loading weights: 92%|β| 335/363 [00:00<00:00, 4260.05it/s, Materializing param=model.layers.36.self_at
Loading weights: 92%|β| 335/363 [00:00<00:00, 4257.82it/s, Materializing param=model.layers.36.self_at
Loading weights: 93%|β| 336/363 [00:00<00:00, 4267.60it/s, Materializing param=model.layers.37.input_l
Loading weights: 93%|β| 336/363 [00:00<00:00, 4265.48it/s, Materializing param=model.layers.37.input_l
Loading weights: 93%|β| 337/363 [00:00<00:00, 4275.31it/s, Materializing param=model.layers.37.mlp.dow
Loading weights: 93%|β| 337/363 [00:00<00:00, 4273.14it/s, Materializing param=model.layers.37.mlp.dow
Loading weights: 93%|β| 338/363 [00:00<00:00, 4282.84it/s, Materializing param=model.layers.37.mlp.gat
Loading weights: 93%|β| 338/363 [00:00<00:00, 4280.60it/s, Materializing param=model.layers.37.mlp.gat
Loading weights: 93%|β| 339/363 [00:00<00:00, 4290.23it/s, Materializing param=model.layers.37.mlp.up_
Loading weights: 93%|β| 339/363 [00:00<00:00, 4288.07it/s, Materializing param=model.layers.37.mlp.up_
Loading weights: 94%|β| 340/363 [00:00<00:00, 4297.73it/s, Materializing param=model.layers.37.post_at
Loading weights: 94%|β| 340/363 [00:00<00:00, 4295.57it/s, Materializing param=model.layers.37.post_at
Loading weights: 94%|β| 341/363 [00:00<00:00, 4305.39it/s, Materializing param=model.layers.37.self_at
Loading weights: 94%|β| 341/363 [00:00<00:00, 4303.30it/s, Materializing param=model.layers.37.self_at
Loading weights: 94%|β| 342/363 [00:00<00:00, 4312.90it/s, Materializing param=model.layers.37.self_at
Loading weights: 94%|β| 342/363 [00:00<00:00, 4310.67it/s, Materializing param=model.layers.37.self_at
Loading weights: 94%|β| 343/363 [00:00<00:00, 4319.69it/s, Materializing param=model.layers.37.self_at
Loading weights: 94%|β| 343/363 [00:00<00:00, 4317.61it/s, Materializing param=model.layers.37.self_at
Loading weights: 95%|β| 344/363 [00:00<00:00, 4327.19it/s, Materializing param=model.layers.37.self_at
Loading weights: 95%|β| 344/363 [00:00<00:00, 4325.05it/s, Materializing param=model.layers.37.self_at
Loading weights: 95%|β| 345/363 [00:00<00:00, 4334.27it/s, Materializing param=model.layers.38.input_l
Loading weights: 95%|β| 345/363 [00:00<00:00, 4332.10it/s, Materializing param=model.layers.38.input_l
Loading weights: 95%|β| 346/363 [00:00<00:00, 4341.64it/s, Materializing param=model.layers.38.mlp.dow
Loading weights: 95%|β| 346/363 [00:00<00:00, 4339.48it/s, Materializing param=model.layers.38.mlp.dow
Loading weights: 96%|β| 347/363 [00:00<00:00, 4349.04it/s, Materializing param=model.layers.38.mlp.gat
Loading weights: 96%|β| 347/363 [00:00<00:00, 4346.90it/s, Materializing param=model.layers.38.mlp.gat
Loading weights: 96%|β| 348/363 [00:00<00:00, 4356.48it/s, Materializing param=model.layers.38.mlp.up_
Loading weights: 96%|β| 348/363 [00:00<00:00, 4354.44it/s, Materializing param=model.layers.38.mlp.up_
Loading weights: 96%|β| 349/363 [00:00<00:00, 4363.80it/s, Materializing param=model.layers.38.post_at
Loading weights: 96%|β| 349/363 [00:00<00:00, 4361.67it/s, Materializing param=model.layers.38.post_at
Loading weights: 96%|β| 350/363 [00:00<00:00, 4371.27it/s, Materializing param=model.layers.38.self_at
Loading weights: 96%|β| 350/363 [00:00<00:00, 4369.05it/s, Materializing param=model.layers.38.self_at
Loading weights: 97%|β| 351/363 [00:00<00:00, 4378.62it/s, Materializing param=model.layers.38.self_at
Loading weights: 97%|β| 351/363 [00:00<00:00, 4376.43it/s, Materializing param=model.layers.38.self_at
Loading weights: 97%|β| 352/363 [00:00<00:00, 4385.86it/s, Materializing param=model.layers.38.self_at
Loading weights: 97%|β| 352/363 [00:00<00:00, 4383.43it/s, Materializing param=model.layers.38.self_at
Loading weights: 97%|β| 353/363 [00:00<00:00, 4392.94it/s, Materializing param=model.layers.38.self_at
Loading weights: 97%|β| 353/363 [00:00<00:00, 4390.05it/s, Materializing param=model.layers.38.self_at
Loading weights: 98%|β| 354/363 [00:00<00:00, 4399.15it/s, Materializing param=model.layers.39.input_l
Loading weights: 98%|β| 354/363 [00:00<00:00, 4396.99it/s, Materializing param=model.layers.39.input_l
Loading weights: 98%|β| 355/363 [00:00<00:00, 4406.52it/s, Materializing param=model.layers.39.mlp.dow
Loading weights: 98%|β| 355/363 [00:00<00:00, 4404.09it/s, Materializing param=model.layers.39.mlp.dow
Loading weights: 98%|β| 356/363 [00:00<00:00, 4413.48it/s, Materializing param=model.layers.39.mlp.gat
Loading weights: 98%|β| 356/363 [00:00<00:00, 4411.39it/s, Materializing param=model.layers.39.mlp.gat
Loading weights: 98%|β| 357/363 [00:00<00:00, 4420.87it/s, Materializing param=model.layers.39.mlp.up_
Loading weights: 98%|β| 357/363 [00:00<00:00, 4418.76it/s, Materializing param=model.layers.39.mlp.up_
Loading weights: 99%|β| 358/363 [00:00<00:00, 4428.32it/s, Materializing param=model.layers.39.post_at
Loading weights: 99%|β| 358/363 [00:00<00:00, 4426.14it/s, Materializing param=model.layers.39.post_at
Loading weights: 99%|β| 359/363 [00:00<00:00, 4435.72it/s, Materializing param=model.layers.39.self_at
Loading weights: 99%|β| 359/363 [00:00<00:00, 4433.53it/s, Materializing param=model.layers.39.self_at
Loading weights: 99%|β| 360/363 [00:00<00:00, 4442.82it/s, Materializing param=model.layers.39.self_at
Loading weights: 99%|β| 360/363 [00:00<00:00, 4440.65it/s, Materializing param=model.layers.39.self_at
Loading weights: 99%|β| 361/363 [00:00<00:00, 4449.96it/s, Materializing param=model.layers.39.self_at
Loading weights: 99%|β| 361/363 [00:00<00:00, 4447.78it/s, Materializing param=model.layers.39.self_at
Loading weights: 100%|β| 362/363 [00:00<00:00, 4457.06it/s, Materializing param=model.layers.39.self_at
Loading weights: 100%|β| 362/363 [00:00<00:00, 4454.38it/s, Materializing param=model.layers.39.self_at
Loading weights: 100%|ββββββ| 363/363 [00:00<00:00, 4463.67it/s, Materializing param=model.norm.weight]
Loading weights: 100%|ββββββ| 363/363 [00:00<00:00, 4461.18it/s, Materializing param=model.norm.weight]
Loading weights: 100%|ββββββ| 363/363 [00:00<00:00, 4456.50it/s, Materializing param=model.norm.weight]
[2026-02-24 02:55:54,138] [WARNING] [torchao.<module>:39] [PID:24011] Skipping import of cpp extensions due to incompatible torch version 2.9.0+cu130 for torchao version 0.13.0
[2026-02-24 02:55:55,030] [WARNING] [accelerate.utils.dataclasses.__post_init__:1962] [PID:24011] sync_module_states is obsolete in FSDP2, as it is not needed anymore.Setting sync_module_states to None.Multiple deprecation warnings due to FSDP2 conversion:
sharding_strategy is deprecated in favor of reshard_after_forward. This will be removed in a future version of Accelerate.
[0m |