File size: 79,143 Bytes
c94ee02
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
[2026-02-24 02:51:52,548] [WARNING] [py.warnings._showwarnmsg:110] [PID:24011] /home/devuser/axo/axolotl/.venv/lib/python3.12/site-packages/torch/backends/__init__.py:46: UserWarning: Please use the new API settings to control TF32 behavior, such as torch.backends.cudnn.conv.fp32_precision = 'tf32' or torch.backends.cuda.matmul.fp32_precision = 'ieee'. Old settings, e.g, torch.backends.cuda.matmul.allow_tf32 = True, torch.backends.cudnn.allow_tf32 = True, allowTF32CuDNN() and allowTF32CuBLAS() will be deprecated after Pytorch 2.9. Please see https://pytorch.org/docs/main/notes/cuda.html#tensorfloat-32-tf32-on-ampere-and-later-devices (Triggered internally at /pytorch/aten/src/ATen/Context.cpp:80.)
  self.setter(val)

[2026-02-24 02:51:56,062] [WARNING] [huggingface_hub.utils._http._warn_on_warning_headers:779] [PID:24011] Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.

Downloading (incomplete total...): 0.00B [00:00, ?B/s]

Fetching 5 files:   0%|                                                          | 0/5 [00:00<?, ?it/s]

Fetching 5 files:  20%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ                                        | 1/5 [00:55<03:41, 55.27s/it]
Fetching 5 files: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 5/5 [00:55<00:00, 11.05s/it]

Download complete: : 0.00B [00:55, ?B/s]              
Download complete: : 0.00B [00:55, ?B/s]

Loading weights:   0%|                                                         | 0/363 [00:00<?, ?it/s]
Loading weights:   0%|          | 1/363 [00:00<00:00, 17848.10it/s, Materializing param=lm_head.weight]
Loading weights:   0%|           | 1/363 [00:00<00:00, 7825.19it/s, Materializing param=lm_head.weight]
Loading weights:   1%| | 2/363 [00:00<00:00, 8004.40it/s, Materializing param=model.embed_tokens.weight
Loading weights:   1%| | 2/363 [00:00<00:00, 6497.76it/s, Materializing param=model.embed_tokens.weight
Loading weights:   1%| | 3/363 [00:00<00:00, 7113.01it/s, Materializing param=model.layers.0.input_laye
Loading weights:   1%| | 3/363 [00:00<00:00, 6235.34it/s, Materializing param=model.layers.0.input_laye
Loading weights:   1%| | 4/363 [00:00<00:00, 6574.14it/s, Materializing param=model.layers.0.mlp.down_p
Loading weights:   1%| | 4/363 [00:00<00:00, 5994.00it/s, Materializing param=model.layers.0.mlp.down_p
Loading weights:   1%| | 5/363 [00:00<00:00, 6440.88it/s, Materializing param=model.layers.0.mlp.gate_p
Loading weights:   1%| | 5/363 [00:00<00:00, 6022.84it/s, Materializing param=model.layers.0.mlp.gate_p
Loading weights:   2%| | 6/363 [00:00<00:00, 6400.26it/s, Materializing param=model.layers.0.mlp.up_pro
Loading weights:   2%| | 6/363 [00:00<00:00, 6081.64it/s, Materializing param=model.layers.0.mlp.up_pro
Loading weights:   2%| | 7/363 [00:00<00:00, 6410.51it/s, Materializing param=model.layers.0.post_atten
Loading weights:   2%| | 7/363 [00:00<00:00, 6110.33it/s, Materializing param=model.layers.0.post_atten
Loading weights:   2%| | 8/363 [00:00<00:00, 3904.40it/s, Materializing param=model.layers.0.self_attn.
Loading weights:   2%| | 8/363 [00:00<00:00, 3789.75it/s, Materializing param=model.layers.0.self_attn.
Loading weights:   2%| | 9/363 [00:00<00:00, 4097.78it/s, Materializing param=model.layers.0.self_attn.
Loading weights:   2%| | 9/363 [00:00<00:00, 4012.83it/s, Materializing param=model.layers.0.self_attn.
Loading weights:   3%| | 10/363 [00:00<00:00, 4268.58it/s, Materializing param=model.layers.0.self_attn
Loading weights:   3%| | 10/363 [00:00<00:00, 4159.78it/s, Materializing param=model.layers.0.self_attn
Loading weights:   3%| | 11/363 [00:00<00:00, 4385.68it/s, Materializing param=model.layers.0.self_attn
Loading weights:   3%| | 11/363 [00:00<00:00, 4295.44it/s, Materializing param=model.layers.0.self_attn
Loading weights:   3%| | 12/363 [00:00<00:00, 3827.79it/s, Materializing param=model.layers.1.input_lay
Loading weights:   3%| | 12/363 [00:00<00:00, 3760.86it/s, Materializing param=model.layers.1.input_lay
Loading weights:   4%| | 13/363 [00:00<00:00, 3924.99it/s, Materializing param=model.layers.1.mlp.down_
Loading weights:   4%| | 13/363 [00:00<00:00, 3863.80it/s, Materializing param=model.layers.1.mlp.down_
Loading weights:   4%| | 14/363 [00:00<00:00, 3920.96it/s, Materializing param=model.layers.1.mlp.gate_
Loading weights:   4%| | 14/363 [00:00<00:00, 3859.11it/s, Materializing param=model.layers.1.mlp.gate_
Loading weights:   4%| | 15/363 [00:00<00:00, 4026.53it/s, Materializing param=model.layers.1.mlp.up_pr
Loading weights:   4%| | 15/363 [00:00<00:00, 3974.64it/s, Materializing param=model.layers.1.mlp.up_pr
Loading weights:   4%| | 16/363 [00:00<00:00, 3870.62it/s, Materializing param=model.layers.1.post_atte
Loading weights:   4%| | 16/363 [00:00<00:00, 3822.56it/s, Materializing param=model.layers.1.post_atte
Loading weights:   5%| | 17/363 [00:00<00:00, 3967.46it/s, Materializing param=model.layers.1.self_attn
Loading weights:   5%| | 17/363 [00:00<00:00, 3925.52it/s, Materializing param=model.layers.1.self_attn
Loading weights:   5%| | 18/363 [00:00<00:00, 4050.29it/s, Materializing param=model.layers.1.self_attn
Loading weights:   5%| | 18/363 [00:00<00:00, 4001.77it/s, Materializing param=model.layers.1.self_attn
Loading weights:   5%| | 19/363 [00:00<00:00, 3879.46it/s, Materializing param=model.layers.1.self_attn
Loading weights:   5%| | 19/363 [00:00<00:00, 3836.87it/s, Materializing param=model.layers.1.self_attn
Loading weights:   6%| | 20/363 [00:00<00:00, 3960.25it/s, Materializing param=model.layers.1.self_attn
Loading weights:   6%| | 20/363 [00:00<00:00, 3922.11it/s, Materializing param=model.layers.1.self_attn
Loading weights:   6%| | 21/363 [00:00<00:00, 4040.76it/s, Materializing param=model.layers.2.input_lay
Loading weights:   6%| | 21/363 [00:00<00:00, 4001.47it/s, Materializing param=model.layers.2.input_lay
Loading weights:   6%| | 22/363 [00:00<00:00, 4115.00it/s, Materializing param=model.layers.2.mlp.down_
Loading weights:   6%| | 22/363 [00:00<00:00, 4068.01it/s, Materializing param=model.layers.2.mlp.down_
Loading weights:   6%| | 23/363 [00:00<00:00, 4175.42it/s, Materializing param=model.layers.2.mlp.gate_
Loading weights:   6%| | 23/363 [00:00<00:00, 4138.35it/s, Materializing param=model.layers.2.mlp.gate_
Loading weights:   7%| | 24/363 [00:00<00:00, 4234.53it/s, Materializing param=model.layers.2.mlp.up_pr
Loading weights:   7%| | 24/363 [00:00<00:00, 4197.98it/s, Materializing param=model.layers.2.mlp.up_pr
Loading weights:   7%| | 25/363 [00:00<00:00, 4315.66it/s, Materializing param=model.layers.2.post_atte
Loading weights:   7%| | 25/363 [00:00<00:00, 4278.68it/s, Materializing param=model.layers.2.post_atte
Loading weights:   7%| | 26/363 [00:00<00:00, 4066.37it/s, Materializing param=model.layers.2.self_attn
Loading weights:   7%| | 26/363 [00:00<00:00, 4028.66it/s, Materializing param=model.layers.2.self_attn
Loading weights:   7%| | 27/363 [00:00<00:00, 3983.33it/s, Materializing param=model.layers.2.self_attn
Loading weights:   7%| | 27/363 [00:00<00:00, 3951.64it/s, Materializing param=model.layers.2.self_attn
Loading weights:   8%| | 28/363 [00:00<00:00, 4036.87it/s, Materializing param=model.layers.2.self_attn
Loading weights:   8%| | 28/363 [00:00<00:00, 4008.35it/s, Materializing param=model.layers.2.self_attn
Loading weights:   8%| | 29/363 [00:00<00:00, 4078.28it/s, Materializing param=model.layers.2.self_attn
Loading weights:   8%| | 29/363 [00:00<00:00, 4051.93it/s, Materializing param=model.layers.2.self_attn
Loading weights:   8%| | 30/363 [00:00<00:00, 4074.91it/s, Materializing param=model.layers.3.input_lay
Loading weights:   8%| | 30/363 [00:00<00:00, 4039.46it/s, Materializing param=model.layers.3.input_lay
Loading weights:   9%| | 31/363 [00:00<00:00, 4118.05it/s, Materializing param=model.layers.3.mlp.down_
Loading weights:   9%| | 31/363 [00:00<00:00, 4091.36it/s, Materializing param=model.layers.3.mlp.down_
Loading weights:   9%| | 32/363 [00:00<00:00, 4169.55it/s, Materializing param=model.layers.3.mlp.gate_
Loading weights:   9%| | 32/363 [00:00<00:00, 4142.27it/s, Materializing param=model.layers.3.mlp.gate_
Loading weights:   9%| | 33/363 [00:00<00:00, 4216.15it/s, Materializing param=model.layers.3.mlp.up_pr
Loading weights:   9%| | 33/363 [00:00<00:00, 4190.37it/s, Materializing param=model.layers.3.mlp.up_pr
Loading weights:   9%| | 34/363 [00:00<00:00, 4266.97it/s, Materializing param=model.layers.3.post_atte
Loading weights:   9%| | 34/363 [00:00<00:00, 4239.95it/s, Materializing param=model.layers.3.post_atte
Loading weights:  10%| | 35/363 [00:00<00:00, 4309.93it/s, Materializing param=model.layers.3.self_attn
Loading weights:  10%| | 35/363 [00:00<00:00, 4284.40it/s, Materializing param=model.layers.3.self_attn
Loading weights:  10%| | 36/363 [00:00<00:00, 4356.21it/s, Materializing param=model.layers.3.self_attn
Loading weights:  10%| | 36/363 [00:00<00:00, 4330.47it/s, Materializing param=model.layers.3.self_attn
Loading weights:  10%| | 37/363 [00:00<00:00, 4139.26it/s, Materializing param=model.layers.3.self_attn
Loading weights:  10%| | 37/363 [00:00<00:00, 4110.97it/s, Materializing param=model.layers.3.self_attn
Loading weights:  10%| | 38/363 [00:00<00:00, 4172.89it/s, Materializing param=model.layers.3.self_attn
Loading weights:  10%| | 38/363 [00:00<00:00, 4148.88it/s, Materializing param=model.layers.3.self_attn
Loading weights:  11%| | 39/363 [00:00<00:00, 4218.86it/s, Materializing param=model.layers.4.input_lay
Loading weights:  11%| | 39/363 [00:00<00:00, 4196.56it/s, Materializing param=model.layers.4.input_lay
Loading weights:  11%| | 40/363 [00:00<00:00, 4252.46it/s, Materializing param=model.layers.4.mlp.down_
Loading weights:  11%| | 40/363 [00:00<00:00, 4228.13it/s, Materializing param=model.layers.4.mlp.down_
Loading weights:  11%| | 41/363 [00:00<00:00, 4149.47it/s, Materializing param=model.layers.4.mlp.gate_
Loading weights:  11%| | 41/363 [00:00<00:00, 4125.68it/s, Materializing param=model.layers.4.mlp.gate_
Loading weights:  12%| | 42/363 [00:00<00:00, 4181.76it/s, Materializing param=model.layers.4.mlp.up_pr
Loading weights:  12%| | 42/363 [00:00<00:00, 4161.11it/s, Materializing param=model.layers.4.mlp.up_pr
Loading weights:  12%| | 43/363 [00:00<00:00, 4053.74it/s, Materializing param=model.layers.4.post_atte
Loading weights:  12%| | 43/363 [00:00<00:00, 4029.65it/s, Materializing param=model.layers.4.post_atte
Loading weights:  12%| | 44/363 [00:00<00:00, 4088.83it/s, Materializing param=model.layers.4.self_attn
Loading weights:  12%| | 44/363 [00:00<00:00, 4069.54it/s, Materializing param=model.layers.4.self_attn
Loading weights:  12%| | 45/363 [00:00<00:00, 4040.15it/s, Materializing param=model.layers.4.self_attn
Loading weights:  12%| | 45/363 [00:00<00:00, 4020.36it/s, Materializing param=model.layers.4.self_attn
Loading weights:  13%|▏| 46/363 [00:00<00:00, 4071.80it/s, Materializing param=model.layers.4.self_attn
Loading weights:  13%|▏| 46/363 [00:00<00:00, 3922.38it/s, Materializing param=model.layers.4.self_attn
Loading weights:  13%|▏| 47/363 [00:00<00:00, 3969.24it/s, Materializing param=model.layers.4.self_attn
Loading weights:  13%|▏| 47/363 [00:00<00:00, 3951.02it/s, Materializing param=model.layers.4.self_attn
Loading weights:  13%|▏| 48/363 [00:00<00:00, 3756.30it/s, Materializing param=model.layers.5.input_lay
Loading weights:  13%|▏| 48/363 [00:00<00:00, 3740.04it/s, Materializing param=model.layers.5.input_lay
Loading weights:  13%|▏| 49/363 [00:00<00:00, 3784.85it/s, Materializing param=model.layers.5.mlp.down_
Loading weights:  13%|▏| 49/363 [00:00<00:00, 3769.23it/s, Materializing param=model.layers.5.mlp.down_
Loading weights:  14%|▏| 50/363 [00:00<00:00, 3815.64it/s, Materializing param=model.layers.5.mlp.gate_
Loading weights:  14%|▏| 50/363 [00:00<00:00, 3800.63it/s, Materializing param=model.layers.5.mlp.gate_
Loading weights:  14%|▏| 51/363 [00:00<00:00, 3848.95it/s, Materializing param=model.layers.5.mlp.up_pr
Loading weights:  14%|▏| 51/363 [00:00<00:00, 3834.12it/s, Materializing param=model.layers.5.mlp.up_pr
Loading weights:  14%|▏| 52/363 [00:00<00:00, 3713.80it/s, Materializing param=model.layers.5.post_atte
Loading weights:  14%|▏| 52/363 [00:00<00:00, 3697.18it/s, Materializing param=model.layers.5.post_atte
Loading weights:  15%|▏| 53/363 [00:00<00:00, 3738.24it/s, Materializing param=model.layers.5.self_attn
Loading weights:  15%|▏| 53/363 [00:00<00:00, 3723.96it/s, Materializing param=model.layers.5.self_attn
Loading weights:  15%|▏| 54/363 [00:00<00:00, 3772.99it/s, Materializing param=model.layers.5.self_attn
Loading weights:  15%|▏| 54/363 [00:00<00:00, 3759.71it/s, Materializing param=model.layers.5.self_attn
Loading weights:  15%|▏| 55/363 [00:00<00:00, 3799.13it/s, Materializing param=model.layers.5.self_attn
Loading weights:  15%|▏| 55/363 [00:00<00:00, 3785.60it/s, Materializing param=model.layers.5.self_attn
Loading weights:  15%|▏| 56/363 [00:00<00:00, 3817.59it/s, Materializing param=model.layers.5.self_attn
Loading weights:  15%|▏| 56/363 [00:00<00:00, 3803.99it/s, Materializing param=model.layers.5.self_attn
Loading weights:  16%|▏| 57/363 [00:00<00:00, 3845.45it/s, Materializing param=model.layers.6.input_lay
Loading weights:  16%|▏| 57/363 [00:00<00:00, 3832.07it/s, Materializing param=model.layers.6.input_lay
Loading weights:  16%|▏| 58/363 [00:00<00:00, 3873.66it/s, Materializing param=model.layers.6.mlp.down_
Loading weights:  16%|▏| 58/363 [00:00<00:00, 3860.32it/s, Materializing param=model.layers.6.mlp.down_
Loading weights:  16%|▏| 59/363 [00:00<00:00, 3898.85it/s, Materializing param=model.layers.6.mlp.gate_
Loading weights:  16%|▏| 59/363 [00:00<00:00, 3885.38it/s, Materializing param=model.layers.6.mlp.gate_
Loading weights:  17%|▏| 60/363 [00:00<00:00, 3882.84it/s, Materializing param=model.layers.6.mlp.up_pr
Loading weights:  17%|▏| 60/363 [00:00<00:00, 3869.34it/s, Materializing param=model.layers.6.mlp.up_pr
Loading weights:  17%|▏| 61/363 [00:00<00:00, 3906.62it/s, Materializing param=model.layers.6.post_atte
Loading weights:  17%|▏| 61/363 [00:00<00:00, 3893.72it/s, Materializing param=model.layers.6.post_atte
Loading weights:  17%|▏| 62/363 [00:00<00:00, 3930.75it/s, Materializing param=model.layers.6.self_attn
Loading weights:  17%|▏| 62/363 [00:00<00:00, 3917.73it/s, Materializing param=model.layers.6.self_attn
Loading weights:  17%|▏| 63/363 [00:00<00:00, 3955.41it/s, Materializing param=model.layers.6.self_attn
Loading weights:  17%|▏| 63/363 [00:00<00:00, 3942.96it/s, Materializing param=model.layers.6.self_attn
Loading weights:  18%|▏| 64/363 [00:00<00:00, 3977.23it/s, Materializing param=model.layers.6.self_attn
Loading weights:  18%|▏| 64/363 [00:00<00:00, 3693.59it/s, Materializing param=model.layers.6.self_attn
Loading weights:  18%|▏| 65/363 [00:00<00:00, 3729.80it/s, Materializing param=model.layers.6.self_attn
Loading weights:  18%|▏| 65/363 [00:00<00:00, 3718.25it/s, Materializing param=model.layers.6.self_attn
Loading weights:  18%|▏| 66/363 [00:00<00:00, 3753.19it/s, Materializing param=model.layers.7.input_lay
Loading weights:  18%|▏| 66/363 [00:00<00:00, 3740.82it/s, Materializing param=model.layers.7.input_lay
Loading weights:  18%|▏| 67/363 [00:00<00:00, 3776.82it/s, Materializing param=model.layers.7.mlp.down_
Loading weights:  18%|▏| 67/363 [00:00<00:00, 3766.09it/s, Materializing param=model.layers.7.mlp.down_
Loading weights:  19%|▏| 68/363 [00:00<00:00, 3802.23it/s, Materializing param=model.layers.7.mlp.gate_
Loading weights:  19%|▏| 68/363 [00:00<00:00, 3791.97it/s, Materializing param=model.layers.7.mlp.gate_
Loading weights:  19%|▏| 69/363 [00:00<00:00, 3831.78it/s, Materializing param=model.layers.7.mlp.up_pr
Loading weights:  19%|▏| 69/363 [00:00<00:00, 3821.71it/s, Materializing param=model.layers.7.mlp.up_pr
Loading weights:  19%|▏| 70/363 [00:00<00:00, 3849.90it/s, Materializing param=model.layers.7.post_atte
Loading weights:  19%|▏| 70/363 [00:00<00:00, 3839.23it/s, Materializing param=model.layers.7.post_atte
Loading weights:  20%|▏| 71/363 [00:00<00:00, 3873.86it/s, Materializing param=model.layers.7.self_attn
Loading weights:  20%|▏| 71/363 [00:00<00:00, 3860.56it/s, Materializing param=model.layers.7.self_attn
Loading weights:  20%|▏| 72/363 [00:00<00:00, 3803.06it/s, Materializing param=model.layers.7.self_attn
Loading weights:  20%|▏| 72/363 [00:00<00:00, 3791.75it/s, Materializing param=model.layers.7.self_attn
Loading weights:  20%|▏| 73/363 [00:00<00:00, 3823.86it/s, Materializing param=model.layers.7.self_attn
Loading weights:  20%|▏| 73/363 [00:00<00:00, 3813.95it/s, Materializing param=model.layers.7.self_attn
Loading weights:  20%|▏| 74/363 [00:00<00:00, 3847.46it/s, Materializing param=model.layers.7.self_attn
Loading weights:  20%|▏| 74/363 [00:00<00:00, 3800.17it/s, Materializing param=model.layers.7.self_attn
Loading weights:  21%|▏| 75/363 [00:00<00:00, 3834.76it/s, Materializing param=model.layers.8.input_lay
Loading weights:  21%|▏| 75/363 [00:00<00:00, 3824.59it/s, Materializing param=model.layers.8.input_lay
Loading weights:  21%|▏| 76/363 [00:00<00:00, 3855.57it/s, Materializing param=model.layers.8.mlp.down_
Loading weights:  21%|▏| 76/363 [00:00<00:00, 3845.80it/s, Materializing param=model.layers.8.mlp.down_
Loading weights:  21%|▏| 77/363 [00:00<00:00, 3877.51it/s, Materializing param=model.layers.8.mlp.gate_
Loading weights:  21%|▏| 77/363 [00:00<00:00, 3867.99it/s, Materializing param=model.layers.8.mlp.gate_
Loading weights:  21%|▏| 78/363 [00:00<00:00, 3898.38it/s, Materializing param=model.layers.8.mlp.up_pr
Loading weights:  21%|▏| 78/363 [00:00<00:00, 3888.88it/s, Materializing param=model.layers.8.mlp.up_pr
Loading weights:  22%|▏| 79/363 [00:00<00:00, 3891.87it/s, Materializing param=model.layers.8.post_atte
Loading weights:  22%|▏| 79/363 [00:00<00:00, 3881.34it/s, Materializing param=model.layers.8.post_atte
Loading weights:  22%|▏| 80/363 [00:00<00:00, 3907.81it/s, Materializing param=model.layers.8.self_attn
Loading weights:  22%|▏| 80/363 [00:00<00:00, 3898.19it/s, Materializing param=model.layers.8.self_attn
Loading weights:  22%|▏| 81/363 [00:00<00:00, 3926.98it/s, Materializing param=model.layers.8.self_attn
Loading weights:  22%|▏| 81/363 [00:00<00:00, 3917.56it/s, Materializing param=model.layers.8.self_attn
Loading weights:  23%|▏| 82/363 [00:00<00:00, 3950.03it/s, Materializing param=model.layers.8.self_attn
Loading weights:  23%|▏| 82/363 [00:00<00:00, 3941.16it/s, Materializing param=model.layers.8.self_attn
Loading weights:  23%|▏| 83/363 [00:00<00:00, 3973.56it/s, Materializing param=model.layers.8.self_attn
Loading weights:  23%|▏| 83/363 [00:00<00:00, 3964.60it/s, Materializing param=model.layers.8.self_attn
Loading weights:  23%|▏| 84/363 [00:00<00:00, 3996.61it/s, Materializing param=model.layers.9.input_lay
Loading weights:  23%|▏| 84/363 [00:00<00:00, 3987.75it/s, Materializing param=model.layers.9.input_lay
Loading weights:  23%|▏| 85/363 [00:00<00:00, 4017.03it/s, Materializing param=model.layers.9.mlp.down_
Loading weights:  23%|▏| 85/363 [00:00<00:00, 4007.82it/s, Materializing param=model.layers.9.mlp.down_
Loading weights:  24%|▏| 86/363 [00:00<00:00, 4038.95it/s, Materializing param=model.layers.9.mlp.gate_
Loading weights:  24%|▏| 86/363 [00:00<00:00, 4029.97it/s, Materializing param=model.layers.9.mlp.gate_
Loading weights:  24%|▏| 87/363 [00:00<00:00, 4055.67it/s, Materializing param=model.layers.9.mlp.up_pr
Loading weights:  24%|▏| 87/363 [00:00<00:00, 4045.95it/s, Materializing param=model.layers.9.mlp.up_pr
Loading weights:  24%|▏| 88/363 [00:00<00:00, 4076.55it/s, Materializing param=model.layers.9.post_atte
Loading weights:  24%|▏| 88/363 [00:00<00:00, 4065.86it/s, Materializing param=model.layers.9.post_atte
Loading weights:  25%|▏| 89/363 [00:00<00:00, 4090.08it/s, Materializing param=model.layers.9.self_attn
Loading weights:  25%|▏| 89/363 [00:00<00:00, 4080.46it/s, Materializing param=model.layers.9.self_attn
Loading weights:  25%|▏| 90/363 [00:00<00:00, 4110.81it/s, Materializing param=model.layers.9.self_attn
Loading weights:  25%|▏| 90/363 [00:00<00:00, 4101.65it/s, Materializing param=model.layers.9.self_attn
Loading weights:  25%|β–Ž| 91/363 [00:00<00:00, 4129.68it/s, Materializing param=model.layers.9.self_attn
Loading weights:  25%|β–Ž| 91/363 [00:00<00:00, 4120.05it/s, Materializing param=model.layers.9.self_attn
Loading weights:  25%|β–Ž| 92/363 [00:00<00:00, 4146.40it/s, Materializing param=model.layers.9.self_attn
Loading weights:  25%|β–Ž| 92/363 [00:00<00:00, 4137.28it/s, Materializing param=model.layers.9.self_attn
Loading weights:  26%|β–Ž| 93/363 [00:00<00:00, 4164.21it/s, Materializing param=model.layers.10.input_la
Loading weights:  26%|β–Ž| 93/363 [00:00<00:00, 4067.43it/s, Materializing param=model.layers.10.input_la
Loading weights:  26%|β–Ž| 94/363 [00:00<00:00, 4091.03it/s, Materializing param=model.layers.10.mlp.down
Loading weights:  26%|β–Ž| 94/363 [00:00<00:00, 4081.41it/s, Materializing param=model.layers.10.mlp.down
Loading weights:  26%|β–Ž| 95/363 [00:00<00:00, 3993.29it/s, Materializing param=model.layers.10.mlp.gate
Loading weights:  26%|β–Ž| 95/363 [00:00<00:00, 3983.59it/s, Materializing param=model.layers.10.mlp.gate
Loading weights:  26%|β–Ž| 96/363 [00:00<00:00, 4005.98it/s, Materializing param=model.layers.10.mlp.up_p
Loading weights:  26%|β–Ž| 96/363 [00:00<00:00, 3997.39it/s, Materializing param=model.layers.10.mlp.up_p
Loading weights:  27%|β–Ž| 97/363 [00:00<00:00, 4009.53it/s, Materializing param=model.layers.10.post_att
Loading weights:  27%|β–Ž| 97/363 [00:00<00:00, 4000.74it/s, Materializing param=model.layers.10.post_att
Loading weights:  27%|β–Ž| 98/363 [00:00<00:00, 3901.42it/s, Materializing param=model.layers.10.self_att
Loading weights:  27%|β–Ž| 98/363 [00:00<00:00, 3892.29it/s, Materializing param=model.layers.10.self_att
Loading weights:  27%|β–Ž| 99/363 [00:00<00:00, 3906.12it/s, Materializing param=model.layers.10.self_att
Loading weights:  27%|β–Ž| 99/363 [00:00<00:00, 3822.23it/s, Materializing param=model.layers.10.self_att
Loading weights:  28%|β–Ž| 100/363 [00:00<00:00, 3844.07it/s, Materializing param=model.layers.10.self_at
Loading weights:  28%|β–Ž| 100/363 [00:00<00:00, 3836.02it/s, Materializing param=model.layers.10.self_at
Loading weights:  28%|β–Ž| 101/363 [00:00<00:00, 3858.75it/s, Materializing param=model.layers.10.self_at
Loading weights:  28%|β–Ž| 101/363 [00:00<00:00, 3851.03it/s, Materializing param=model.layers.10.self_at
Loading weights:  28%|β–Ž| 102/363 [00:00<00:00, 3826.71it/s, Materializing param=model.layers.11.input_l
Loading weights:  28%|β–Ž| 102/363 [00:00<00:00, 3817.94it/s, Materializing param=model.layers.11.input_l
Loading weights:  28%|β–Ž| 103/363 [00:00<00:00, 3838.58it/s, Materializing param=model.layers.11.mlp.dow
Loading weights:  28%|β–Ž| 103/363 [00:00<00:00, 3764.76it/s, Materializing param=model.layers.11.mlp.dow
Loading weights:  29%|β–Ž| 104/363 [00:00<00:00, 3787.74it/s, Materializing param=model.layers.11.mlp.gat
Loading weights:  29%|β–Ž| 104/363 [00:00<00:00, 3780.52it/s, Materializing param=model.layers.11.mlp.gat
Loading weights:  29%|β–Ž| 105/363 [00:00<00:00, 3733.49it/s, Materializing param=model.layers.11.mlp.up_
Loading weights:  29%|β–Ž| 105/363 [00:00<00:00, 3726.16it/s, Materializing param=model.layers.11.mlp.up_
Loading weights:  29%|β–Ž| 106/363 [00:00<00:00, 3731.24it/s, Materializing param=model.layers.11.post_at
Loading weights:  29%|β–Ž| 106/363 [00:00<00:00, 3723.18it/s, Materializing param=model.layers.11.post_at
Loading weights:  29%|β–Ž| 107/363 [00:00<00:00, 3745.54it/s, Materializing param=model.layers.11.self_at
Loading weights:  29%|β–Ž| 107/363 [00:00<00:00, 3737.99it/s, Materializing param=model.layers.11.self_at
Loading weights:  30%|β–Ž| 108/363 [00:00<00:00, 3758.12it/s, Materializing param=model.layers.11.self_at
Loading weights:  30%|β–Ž| 108/363 [00:00<00:00, 3751.33it/s, Materializing param=model.layers.11.self_at
Loading weights:  30%|β–Ž| 109/363 [00:00<00:00, 3772.48it/s, Materializing param=model.layers.11.self_at
Loading weights:  30%|β–Ž| 109/363 [00:00<00:00, 3765.58it/s, Materializing param=model.layers.11.self_at
Loading weights:  30%|β–Ž| 110/363 [00:00<00:00, 3785.97it/s, Materializing param=model.layers.11.self_at
Loading weights:  30%|β–Ž| 110/363 [00:00<00:00, 3779.15it/s, Materializing param=model.layers.11.self_at
Loading weights:  31%|β–Ž| 111/363 [00:00<00:00, 3802.48it/s, Materializing param=model.layers.12.input_l
Loading weights:  31%|β–Ž| 111/363 [00:00<00:00, 3795.84it/s, Materializing param=model.layers.12.input_l
Loading weights:  31%|β–Ž| 112/363 [00:00<00:00, 3815.17it/s, Materializing param=model.layers.12.mlp.dow
Loading weights:  31%|β–Ž| 112/363 [00:00<00:00, 3806.36it/s, Materializing param=model.layers.12.mlp.dow
Loading weights:  31%|β–Ž| 113/363 [00:00<00:00, 3827.29it/s, Materializing param=model.layers.12.mlp.gat
Loading weights:  31%|β–Ž| 113/363 [00:00<00:00, 3820.75it/s, Materializing param=model.layers.12.mlp.gat
Loading weights:  31%|β–Ž| 114/363 [00:00<00:00, 3824.59it/s, Materializing param=model.layers.12.mlp.up_
Loading weights:  31%|β–Ž| 114/363 [00:00<00:00, 3817.42it/s, Materializing param=model.layers.12.mlp.up_
Loading weights:  32%|β–Ž| 115/363 [00:00<00:00, 3838.58it/s, Materializing param=model.layers.12.post_at
Loading weights:  32%|β–Ž| 115/363 [00:00<00:00, 3832.03it/s, Materializing param=model.layers.12.post_at
Loading weights:  32%|β–Ž| 116/363 [00:00<00:00, 3851.06it/s, Materializing param=model.layers.12.self_at
Loading weights:  32%|β–Ž| 116/363 [00:00<00:00, 3844.12it/s, Materializing param=model.layers.12.self_at
Loading weights:  32%|β–Ž| 117/363 [00:00<00:00, 3864.10it/s, Materializing param=model.layers.12.self_at
Loading weights:  32%|β–Ž| 117/363 [00:00<00:00, 3857.48it/s, Materializing param=model.layers.12.self_at
Loading weights:  33%|β–Ž| 118/363 [00:00<00:00, 3876.01it/s, Materializing param=model.layers.12.self_at
Loading weights:  33%|β–Ž| 118/363 [00:00<00:00, 3869.31it/s, Materializing param=model.layers.12.self_at
Loading weights:  33%|β–Ž| 119/363 [00:00<00:00, 3888.40it/s, Materializing param=model.layers.12.self_at
Loading weights:  33%|β–Ž| 119/363 [00:00<00:00, 3881.71it/s, Materializing param=model.layers.12.self_at
Loading weights:  33%|β–Ž| 120/363 [00:00<00:00, 3904.04it/s, Materializing param=model.layers.13.input_l
Loading weights:  33%|β–Ž| 120/363 [00:00<00:00, 3865.99it/s, Materializing param=model.layers.13.input_l
Loading weights:  33%|β–Ž| 121/363 [00:00<00:00, 3883.91it/s, Materializing param=model.layers.13.mlp.dow
Loading weights:  33%|β–Ž| 121/363 [00:00<00:00, 3877.00it/s, Materializing param=model.layers.13.mlp.dow
Loading weights:  34%|β–Ž| 122/363 [00:00<00:00, 3896.51it/s, Materializing param=model.layers.13.mlp.gat
Loading weights:  34%|β–Ž| 122/363 [00:00<00:00, 3889.93it/s, Materializing param=model.layers.13.mlp.gat
Loading weights:  34%|β–Ž| 123/363 [00:00<00:00, 3905.70it/s, Materializing param=model.layers.13.mlp.up_
Loading weights:  34%|β–Ž| 123/363 [00:00<00:00, 3899.41it/s, Materializing param=model.layers.13.mlp.up_
Loading weights:  34%|β–Ž| 124/363 [00:00<00:00, 3919.76it/s, Materializing param=model.layers.13.post_at
Loading weights:  34%|β–Ž| 124/363 [00:00<00:00, 3913.22it/s, Materializing param=model.layers.13.post_at
Loading weights:  34%|β–Ž| 125/363 [00:00<00:00, 3930.84it/s, Materializing param=model.layers.13.self_at
Loading weights:  34%|β–Ž| 125/363 [00:00<00:00, 3924.43it/s, Materializing param=model.layers.13.self_at
Loading weights:  35%|β–Ž| 126/363 [00:00<00:00, 3845.33it/s, Materializing param=model.layers.13.self_at
Loading weights:  35%|β–Ž| 126/363 [00:00<00:00, 3838.40it/s, Materializing param=model.layers.13.self_at
Loading weights:  35%|β–Ž| 127/363 [00:00<00:00, 3833.47it/s, Materializing param=model.layers.13.self_at
Loading weights:  35%|β–Ž| 127/363 [00:00<00:00, 3827.11it/s, Materializing param=model.layers.13.self_at
Loading weights:  35%|β–Ž| 128/363 [00:00<00:00, 3845.04it/s, Materializing param=model.layers.13.self_at
Loading weights:  35%|β–Ž| 128/363 [00:00<00:00, 3839.29it/s, Materializing param=model.layers.13.self_at
Loading weights:  36%|β–Ž| 129/363 [00:00<00:00, 3856.08it/s, Materializing param=model.layers.14.input_l
Loading weights:  36%|β–Ž| 129/363 [00:00<00:00, 3850.45it/s, Materializing param=model.layers.14.input_l
Loading weights:  36%|β–Ž| 130/363 [00:00<00:00, 3838.10it/s, Materializing param=model.layers.14.mlp.dow
Loading weights:  36%|β–Ž| 130/363 [00:00<00:00, 3831.60it/s, Materializing param=model.layers.14.mlp.dow
Loading weights:  36%|β–Ž| 131/363 [00:00<00:00, 3850.01it/s, Materializing param=model.layers.14.mlp.gat
Loading weights:  36%|β–Ž| 131/363 [00:00<00:00, 3844.62it/s, Materializing param=model.layers.14.mlp.gat
Loading weights:  36%|β–Ž| 132/363 [00:00<00:00, 3862.40it/s, Materializing param=model.layers.14.mlp.up_
Loading weights:  36%|β–Ž| 132/363 [00:00<00:00, 3856.75it/s, Materializing param=model.layers.14.mlp.up_
Loading weights:  37%|β–Ž| 133/363 [00:00<00:00, 3874.47it/s, Materializing param=model.layers.14.post_at
Loading weights:  37%|β–Ž| 133/363 [00:00<00:00, 3867.41it/s, Materializing param=model.layers.14.post_at
Loading weights:  37%|β–Ž| 134/363 [00:00<00:00, 3887.27it/s, Materializing param=model.layers.14.self_at
Loading weights:  37%|β–Ž| 134/363 [00:00<00:00, 3880.02it/s, Materializing param=model.layers.14.self_at
Loading weights:  37%|β–Ž| 135/363 [00:00<00:00, 3897.65it/s, Materializing param=model.layers.14.self_at
Loading weights:  37%|β–Ž| 135/363 [00:00<00:00, 3892.05it/s, Materializing param=model.layers.14.self_at
Loading weights:  37%|β–Ž| 136/363 [00:00<00:00, 3910.69it/s, Materializing param=model.layers.14.self_at
Loading weights:  37%|β–Ž| 136/363 [00:00<00:00, 3904.96it/s, Materializing param=model.layers.14.self_at
Loading weights:  38%|▍| 137/363 [00:00<00:00, 3922.21it/s, Materializing param=model.layers.14.self_at
Loading weights:  38%|▍| 137/363 [00:00<00:00, 3916.65it/s, Materializing param=model.layers.14.self_at
Loading weights:  38%|▍| 138/363 [00:00<00:00, 3934.19it/s, Materializing param=model.layers.15.input_l
Loading weights:  38%|▍| 138/363 [00:00<00:00, 3928.69it/s, Materializing param=model.layers.15.input_l
Loading weights:  38%|▍| 139/363 [00:00<00:00, 3947.65it/s, Materializing param=model.layers.15.mlp.dow
Loading weights:  38%|▍| 139/363 [00:00<00:00, 3942.36it/s, Materializing param=model.layers.15.mlp.dow
Loading weights:  39%|▍| 140/363 [00:00<00:00, 3959.61it/s, Materializing param=model.layers.15.mlp.gat
Loading weights:  39%|▍| 140/363 [00:00<00:00, 3952.58it/s, Materializing param=model.layers.15.mlp.gat
Loading weights:  39%|▍| 141/363 [00:00<00:00, 3969.85it/s, Materializing param=model.layers.15.mlp.up_
Loading weights:  39%|▍| 141/363 [00:00<00:00, 3964.45it/s, Materializing param=model.layers.15.mlp.up_
Loading weights:  39%|▍| 142/363 [00:00<00:00, 3982.34it/s, Materializing param=model.layers.15.post_at
Loading weights:  39%|▍| 142/363 [00:00<00:00, 3976.76it/s, Materializing param=model.layers.15.post_at
Loading weights:  39%|▍| 143/363 [00:00<00:00, 3992.21it/s, Materializing param=model.layers.15.self_at
Loading weights:  39%|▍| 143/363 [00:00<00:00, 3987.01it/s, Materializing param=model.layers.15.self_at
Loading weights:  40%|▍| 144/363 [00:00<00:00, 4006.21it/s, Materializing param=model.layers.15.self_at
Loading weights:  40%|▍| 144/363 [00:00<00:00, 4000.82it/s, Materializing param=model.layers.15.self_at
Loading weights:  40%|▍| 145/363 [00:00<00:00, 3989.83it/s, Materializing param=model.layers.15.self_at
Loading weights:  40%|▍| 145/363 [00:00<00:00, 3958.38it/s, Materializing param=model.layers.15.self_at
Loading weights:  40%|▍| 146/363 [00:00<00:00, 3975.95it/s, Materializing param=model.layers.15.self_at
Loading weights:  40%|▍| 146/363 [00:00<00:00, 3970.95it/s, Materializing param=model.layers.15.self_at
Loading weights:  40%|▍| 147/363 [00:00<00:00, 3941.99it/s, Materializing param=model.layers.16.input_l
Loading weights:  40%|▍| 147/363 [00:00<00:00, 3936.20it/s, Materializing param=model.layers.16.input_l
Loading weights:  41%|▍| 148/363 [00:00<00:00, 3901.38it/s, Materializing param=model.layers.16.mlp.dow
Loading weights:  41%|▍| 148/363 [00:00<00:00, 3895.90it/s, Materializing param=model.layers.16.mlp.dow
Loading weights:  41%|▍| 149/363 [00:00<00:00, 3913.90it/s, Materializing param=model.layers.16.mlp.gat
Loading weights:  41%|▍| 149/363 [00:00<00:00, 3908.88it/s, Materializing param=model.layers.16.mlp.gat
Loading weights:  41%|▍| 150/363 [00:00<00:00, 3926.91it/s, Materializing param=model.layers.16.mlp.up_
Loading weights:  41%|▍| 150/363 [00:00<00:00, 3922.04it/s, Materializing param=model.layers.16.mlp.up_
Loading weights:  42%|▍| 151/363 [00:00<00:00, 3937.90it/s, Materializing param=model.layers.16.post_at
Loading weights:  42%|▍| 151/363 [00:00<00:00, 3901.70it/s, Materializing param=model.layers.16.post_at
Loading weights:  42%|▍| 152/363 [00:00<00:00, 3917.24it/s, Materializing param=model.layers.16.self_at
Loading weights:  42%|▍| 152/363 [00:00<00:00, 3912.00it/s, Materializing param=model.layers.16.self_at
Loading weights:  42%|▍| 153/363 [00:00<00:00, 3904.81it/s, Materializing param=model.layers.16.self_at
Loading weights:  42%|▍| 153/363 [00:00<00:00, 3899.85it/s, Materializing param=model.layers.16.self_at
Loading weights:  42%|▍| 154/363 [00:00<00:00, 3917.20it/s, Materializing param=model.layers.16.self_at
Loading weights:  42%|▍| 154/363 [00:00<00:00, 3912.45it/s, Materializing param=model.layers.16.self_at
Loading weights:  43%|▍| 155/363 [00:00<00:00, 3927.96it/s, Materializing param=model.layers.16.self_at
Loading weights:  43%|▍| 155/363 [00:00<00:00, 3923.08it/s, Materializing param=model.layers.16.self_at
Loading weights:  43%|▍| 156/363 [00:00<00:00, 3938.81it/s, Materializing param=model.layers.17.input_l
Loading weights:  43%|▍| 156/363 [00:00<00:00, 3933.89it/s, Materializing param=model.layers.17.input_l
Loading weights:  43%|▍| 157/363 [00:00<00:00, 3915.92it/s, Materializing param=model.layers.17.mlp.dow
Loading weights:  43%|▍| 157/363 [00:00<00:00, 3909.97it/s, Materializing param=model.layers.17.mlp.dow
Loading weights:  44%|▍| 158/363 [00:00<00:00, 3908.93it/s, Materializing param=model.layers.17.mlp.gat
Loading weights:  44%|▍| 158/363 [00:00<00:00, 3903.15it/s, Materializing param=model.layers.17.mlp.gat
Loading weights:  44%|▍| 159/363 [00:00<00:00, 3917.88it/s, Materializing param=model.layers.17.mlp.up_
Loading weights:  44%|▍| 159/363 [00:00<00:00, 3912.99it/s, Materializing param=model.layers.17.mlp.up_
Loading weights:  44%|▍| 160/363 [00:00<00:00, 3927.02it/s, Materializing param=model.layers.17.post_at
Loading weights:  44%|▍| 160/363 [00:00<00:00, 3922.11it/s, Materializing param=model.layers.17.post_at
Loading weights:  44%|▍| 161/363 [00:00<00:00, 3937.28it/s, Materializing param=model.layers.17.self_at
Loading weights:  44%|▍| 161/363 [00:00<00:00, 3932.56it/s, Materializing param=model.layers.17.self_at
Loading weights:  45%|▍| 162/363 [00:00<00:00, 3947.53it/s, Materializing param=model.layers.17.self_at
Loading weights:  45%|▍| 162/363 [00:00<00:00, 3942.79it/s, Materializing param=model.layers.17.self_at
Loading weights:  45%|▍| 163/363 [00:00<00:00, 3956.59it/s, Materializing param=model.layers.17.self_at
Loading weights:  45%|▍| 163/363 [00:00<00:00, 3951.84it/s, Materializing param=model.layers.17.self_at
Loading weights:  45%|▍| 164/363 [00:00<00:00, 3967.07it/s, Materializing param=model.layers.17.self_at
Loading weights:  45%|▍| 164/363 [00:00<00:00, 3960.97it/s, Materializing param=model.layers.17.self_at
Loading weights:  45%|▍| 165/363 [00:00<00:00, 3975.46it/s, Materializing param=model.layers.18.input_l
Loading weights:  45%|▍| 165/363 [00:00<00:00, 3970.92it/s, Materializing param=model.layers.18.input_l
Loading weights:  46%|▍| 166/363 [00:00<00:00, 3962.41it/s, Materializing param=model.layers.18.mlp.dow
Loading weights:  46%|▍| 166/363 [00:00<00:00, 3956.80it/s, Materializing param=model.layers.18.mlp.dow
Loading weights:  46%|▍| 167/363 [00:00<00:00, 3973.07it/s, Materializing param=model.layers.18.mlp.gat
Loading weights:  46%|▍| 167/363 [00:00<00:00, 3968.32it/s, Materializing param=model.layers.18.mlp.gat
Loading weights:  46%|▍| 168/363 [00:00<00:00, 3931.11it/s, Materializing param=model.layers.18.mlp.up_
Loading weights:  46%|▍| 168/363 [00:00<00:00, 3925.72it/s, Materializing param=model.layers.18.mlp.up_
Loading weights:  47%|▍| 169/363 [00:00<00:00, 3855.86it/s, Materializing param=model.layers.18.post_at
Loading weights:  47%|▍| 169/363 [00:00<00:00, 3849.93it/s, Materializing param=model.layers.18.post_at
Loading weights:  47%|▍| 170/363 [00:00<00:00, 3864.48it/s, Materializing param=model.layers.18.self_at
Loading weights:  47%|▍| 170/363 [00:00<00:00, 3859.90it/s, Materializing param=model.layers.18.self_at
Loading weights:  47%|▍| 171/363 [00:00<00:00, 3874.24it/s, Materializing param=model.layers.18.self_at
Loading weights:  47%|▍| 171/363 [00:00<00:00, 3869.81it/s, Materializing param=model.layers.18.self_at
Loading weights:  47%|▍| 172/363 [00:00<00:00, 3882.95it/s, Materializing param=model.layers.18.self_at
Loading weights:  47%|▍| 172/363 [00:00<00:00, 3878.40it/s, Materializing param=model.layers.18.self_at
Loading weights:  48%|▍| 173/363 [00:00<00:00, 3891.01it/s, Materializing param=model.layers.18.self_at
Loading weights:  48%|▍| 173/363 [00:00<00:00, 3886.49it/s, Materializing param=model.layers.18.self_at
Loading weights:  48%|▍| 174/363 [00:00<00:00, 3864.20it/s, Materializing param=model.layers.19.input_l
Loading weights:  48%|▍| 174/363 [00:00<00:00, 3859.40it/s, Materializing param=model.layers.19.input_l
Loading weights:  48%|▍| 175/363 [00:00<00:00, 3872.53it/s, Materializing param=model.layers.19.mlp.dow
Loading weights:  48%|▍| 175/363 [00:00<00:00, 3868.10it/s, Materializing param=model.layers.19.mlp.dow
Loading weights:  48%|▍| 176/363 [00:00<00:00, 3882.06it/s, Materializing param=model.layers.19.mlp.gat
Loading weights:  48%|▍| 176/363 [00:00<00:00, 3876.33it/s, Materializing param=model.layers.19.mlp.gat
Loading weights:  49%|▍| 177/363 [00:00<00:00, 3861.07it/s, Materializing param=model.layers.19.mlp.up_
Loading weights:  49%|▍| 177/363 [00:00<00:00, 3856.34it/s, Materializing param=model.layers.19.mlp.up_
Loading weights:  49%|▍| 178/363 [00:00<00:00, 3868.86it/s, Materializing param=model.layers.19.post_at
Loading weights:  49%|▍| 178/363 [00:00<00:00, 3864.44it/s, Materializing param=model.layers.19.post_at
Loading weights:  49%|▍| 179/363 [00:00<00:00, 3877.62it/s, Materializing param=model.layers.19.self_at
Loading weights:  49%|▍| 179/363 [00:00<00:00, 3873.42it/s, Materializing param=model.layers.19.self_at
Loading weights:  50%|▍| 180/363 [00:00<00:00, 3887.77it/s, Materializing param=model.layers.19.self_at
Loading weights:  50%|▍| 180/363 [00:00<00:00, 3883.79it/s, Materializing param=model.layers.19.self_at
Loading weights:  50%|▍| 181/363 [00:00<00:00, 3896.53it/s, Materializing param=model.layers.19.self_at
Loading weights:  50%|▍| 181/363 [00:00<00:00, 3892.42it/s, Materializing param=model.layers.19.self_at
Loading weights:  50%|β–Œ| 182/363 [00:00<00:00, 3904.67it/s, Materializing param=model.layers.19.self_at
Loading weights:  50%|β–Œ| 182/363 [00:00<00:00, 3900.28it/s, Materializing param=model.layers.19.self_at
Loading weights:  50%|β–Œ| 183/363 [00:00<00:00, 3887.98it/s, Materializing param=model.layers.20.input_l
Loading weights:  50%|β–Œ| 183/363 [00:00<00:00, 3883.14it/s, Materializing param=model.layers.20.input_l
Loading weights:  51%|β–Œ| 184/363 [00:00<00:00, 3897.24it/s, Materializing param=model.layers.20.mlp.dow
Loading weights:  51%|β–Œ| 184/363 [00:00<00:00, 3893.43it/s, Materializing param=model.layers.20.mlp.dow
Loading weights:  51%|β–Œ| 185/363 [00:00<00:00, 3891.03it/s, Materializing param=model.layers.20.mlp.gat
Loading weights:  51%|β–Œ| 185/363 [00:00<00:00, 3885.95it/s, Materializing param=model.layers.20.mlp.gat
Loading weights:  51%|β–Œ| 186/363 [00:00<00:00, 3898.71it/s, Materializing param=model.layers.20.mlp.up_
Loading weights:  51%|β–Œ| 186/363 [00:00<00:00, 3894.70it/s, Materializing param=model.layers.20.mlp.up_
Loading weights:  52%|β–Œ| 187/363 [00:00<00:00, 3907.51it/s, Materializing param=model.layers.20.post_at
Loading weights:  52%|β–Œ| 187/363 [00:00<00:00, 3852.60it/s, Materializing param=model.layers.20.post_at
Loading weights:  52%|β–Œ| 188/363 [00:00<00:00, 3865.74it/s, Materializing param=model.layers.20.self_at
Loading weights:  52%|β–Œ| 188/363 [00:00<00:00, 3861.80it/s, Materializing param=model.layers.20.self_at
Loading weights:  52%|β–Œ| 189/363 [00:00<00:00, 3788.75it/s, Materializing param=model.layers.20.self_at
Loading weights:  52%|β–Œ| 189/363 [00:00<00:00, 3784.28it/s, Materializing param=model.layers.20.self_at
Loading weights:  52%|β–Œ| 190/363 [00:00<00:00, 3792.91it/s, Materializing param=model.layers.20.self_at
Loading weights:  52%|β–Œ| 190/363 [00:00<00:00, 3789.14it/s, Materializing param=model.layers.20.self_at
Loading weights:  53%|β–Œ| 191/363 [00:00<00:00, 3783.52it/s, Materializing param=model.layers.20.self_at
Loading weights:  53%|β–Œ| 191/363 [00:00<00:00, 3779.19it/s, Materializing param=model.layers.20.self_at
Loading weights:  53%|β–Œ| 192/363 [00:00<00:00, 3789.32it/s, Materializing param=model.layers.21.input_l
Loading weights:  53%|β–Œ| 192/363 [00:00<00:00, 3785.54it/s, Materializing param=model.layers.21.input_l
Loading weights:  53%|β–Œ| 193/363 [00:00<00:00, 3797.67it/s, Materializing param=model.layers.21.mlp.dow
Loading weights:  53%|β–Œ| 193/363 [00:00<00:00, 3794.04it/s, Materializing param=model.layers.21.mlp.dow
Loading weights:  53%|β–Œ| 194/363 [00:00<00:00, 3807.28it/s, Materializing param=model.layers.21.mlp.gat
Loading weights:  53%|β–Œ| 194/363 [00:00<00:00, 3803.61it/s, Materializing param=model.layers.21.mlp.gat
Loading weights:  54%|β–Œ| 195/363 [00:00<00:00, 3816.12it/s, Materializing param=model.layers.21.mlp.up_
Loading weights:  54%|β–Œ| 195/363 [00:00<00:00, 3812.35it/s, Materializing param=model.layers.21.mlp.up_
Loading weights:  54%|β–Œ| 196/363 [00:00<00:00, 3824.80it/s, Materializing param=model.layers.21.post_at
Loading weights:  54%|β–Œ| 196/363 [00:00<00:00, 3820.93it/s, Materializing param=model.layers.21.post_at
Loading weights:  54%|β–Œ| 197/363 [00:00<00:00, 3757.48it/s, Materializing param=model.layers.21.self_at
Loading weights:  54%|β–Œ| 197/363 [00:00<00:00, 3753.66it/s, Materializing param=model.layers.21.self_at
Loading weights:  55%|β–Œ| 198/363 [00:00<00:00, 3763.48it/s, Materializing param=model.layers.21.self_at
Loading weights:  55%|β–Œ| 198/363 [00:00<00:00, 3759.82it/s, Materializing param=model.layers.21.self_at
Loading weights:  55%|β–Œ| 199/363 [00:00<00:00, 3771.55it/s, Materializing param=model.layers.21.self_at
Loading weights:  55%|β–Œ| 199/363 [00:00<00:00, 3768.09it/s, Materializing param=model.layers.21.self_at
Loading weights:  55%|β–Œ| 200/363 [00:00<00:00, 3777.44it/s, Materializing param=model.layers.21.self_at
Loading weights:  55%|β–Œ| 200/363 [00:00<00:00, 3773.72it/s, Materializing param=model.layers.21.self_at
Loading weights:  55%|β–Œ| 201/363 [00:00<00:00, 3785.52it/s, Materializing param=model.layers.22.input_l
Loading weights:  55%|β–Œ| 201/363 [00:00<00:00, 3782.01it/s, Materializing param=model.layers.22.input_l
Loading weights:  56%|β–Œ| 202/363 [00:00<00:00, 3738.82it/s, Materializing param=model.layers.22.mlp.dow
Loading weights:  56%|β–Œ| 202/363 [00:00<00:00, 3734.83it/s, Materializing param=model.layers.22.mlp.dow
Loading weights:  56%|β–Œ| 203/363 [00:00<00:00, 3746.78it/s, Materializing param=model.layers.22.mlp.gat
Loading weights:  56%|β–Œ| 203/363 [00:00<00:00, 3743.40it/s, Materializing param=model.layers.22.mlp.gat
Loading weights:  56%|β–Œ| 204/363 [00:00<00:00, 3755.04it/s, Materializing param=model.layers.22.mlp.up_
Loading weights:  56%|β–Œ| 204/363 [00:00<00:00, 3744.50it/s, Materializing param=model.layers.22.mlp.up_
Loading weights:  56%|β–Œ| 205/363 [00:00<00:00, 3756.78it/s, Materializing param=model.layers.22.post_at
Loading weights:  56%|β–Œ| 205/363 [00:00<00:00, 3753.04it/s, Materializing param=model.layers.22.post_at
Loading weights:  57%|β–Œ| 206/363 [00:00<00:00, 3740.52it/s, Materializing param=model.layers.22.self_at
Loading weights:  57%|β–Œ| 206/363 [00:00<00:00, 3736.83it/s, Materializing param=model.layers.22.self_at
Loading weights:  57%|β–Œ| 207/363 [00:00<00:00, 3748.10it/s, Materializing param=model.layers.22.self_at
Loading weights:  57%|β–Œ| 207/363 [00:00<00:00, 3716.64it/s, Materializing param=model.layers.22.self_at
Loading weights:  57%|β–Œ| 208/363 [00:00<00:00, 3727.60it/s, Materializing param=model.layers.22.self_at
Loading weights:  57%|β–Œ| 208/363 [00:00<00:00, 3724.12it/s, Materializing param=model.layers.22.self_at
Loading weights:  58%|β–Œ| 209/363 [00:00<00:00, 3722.00it/s, Materializing param=model.layers.22.self_at
Loading weights:  58%|β–Œ| 209/363 [00:00<00:00, 3718.43it/s, Materializing param=model.layers.22.self_at
Loading weights:  58%|β–Œ| 210/363 [00:00<00:00, 3729.60it/s, Materializing param=model.layers.23.input_l
Loading weights:  58%|β–Œ| 210/363 [00:00<00:00, 3726.54it/s, Materializing param=model.layers.23.input_l
Loading weights:  58%|β–Œ| 211/363 [00:00<00:00, 3734.33it/s, Materializing param=model.layers.23.mlp.dow
Loading weights:  58%|β–Œ| 211/363 [00:00<00:00, 3731.04it/s, Materializing param=model.layers.23.mlp.dow
Loading weights:  58%|β–Œ| 212/363 [00:00<00:00, 3742.44it/s, Materializing param=model.layers.23.mlp.gat
Loading weights:  58%|β–Œ| 212/363 [00:00<00:00, 3739.18it/s, Materializing param=model.layers.23.mlp.gat
Loading weights:  59%|β–Œ| 213/363 [00:00<00:00, 3728.89it/s, Materializing param=model.layers.23.mlp.up_
Loading weights:  59%|β–Œ| 213/363 [00:00<00:00, 3725.35it/s, Materializing param=model.layers.23.mlp.up_
Loading weights:  59%|β–Œ| 214/363 [00:00<00:00, 3736.29it/s, Materializing param=model.layers.23.post_at
Loading weights:  59%|β–Œ| 214/363 [00:00<00:00, 3732.94it/s, Materializing param=model.layers.23.post_at
Loading weights:  59%|β–Œ| 215/363 [00:00<00:00, 3742.77it/s, Materializing param=model.layers.23.self_at
Loading weights:  59%|β–Œ| 215/363 [00:00<00:00, 3739.42it/s, Materializing param=model.layers.23.self_at
Loading weights:  60%|β–Œ| 216/363 [00:00<00:00, 3751.09it/s, Materializing param=model.layers.23.self_at
Loading weights:  60%|β–Œ| 216/363 [00:00<00:00, 3747.63it/s, Materializing param=model.layers.23.self_at
Loading weights:  60%|β–Œ| 217/363 [00:00<00:00, 3758.51it/s, Materializing param=model.layers.23.self_at
Loading weights:  60%|β–Œ| 217/363 [00:00<00:00, 3755.25it/s, Materializing param=model.layers.23.self_at
Loading weights:  60%|β–Œ| 218/363 [00:00<00:00, 3765.61it/s, Materializing param=model.layers.23.self_at
Loading weights:  60%|β–Œ| 218/363 [00:00<00:00, 3762.45it/s, Materializing param=model.layers.23.self_at
Loading weights:  60%|β–Œ| 219/363 [00:00<00:00, 3773.47it/s, Materializing param=model.layers.24.input_l
Loading weights:  60%|β–Œ| 219/363 [00:00<00:00, 3770.37it/s, Materializing param=model.layers.24.input_l
Loading weights:  61%|β–Œ| 220/363 [00:00<00:00, 3781.16it/s, Materializing param=model.layers.24.mlp.dow
Loading weights:  61%|β–Œ| 220/363 [00:00<00:00, 3778.27it/s, Materializing param=model.layers.24.mlp.dow
Loading weights:  61%|β–Œ| 221/363 [00:00<00:00, 3788.43it/s, Materializing param=model.layers.24.mlp.gat
Loading weights:  61%|β–Œ| 221/363 [00:00<00:00, 3784.36it/s, Materializing param=model.layers.24.mlp.gat
Loading weights:  61%|β–Œ| 222/363 [00:00<00:00, 3795.29it/s, Materializing param=model.layers.24.mlp.up_
Loading weights:  61%|β–Œ| 222/363 [00:00<00:00, 3792.18it/s, Materializing param=model.layers.24.mlp.up_
Loading weights:  61%|β–Œ| 223/363 [00:00<00:00, 3779.69it/s, Materializing param=model.layers.24.post_at
Loading weights:  61%|β–Œ| 223/363 [00:00<00:00, 3776.20it/s, Materializing param=model.layers.24.post_at
Loading weights:  62%|β–Œ| 224/363 [00:00<00:00, 3786.68it/s, Materializing param=model.layers.24.self_at
Loading weights:  62%|β–Œ| 224/363 [00:00<00:00, 3783.48it/s, Materializing param=model.layers.24.self_at
Loading weights:  62%|β–Œ| 225/363 [00:00<00:00, 3795.23it/s, Materializing param=model.layers.24.self_at
Loading weights:  62%|β–Œ| 225/363 [00:00<00:00, 3791.98it/s, Materializing param=model.layers.24.self_at
Loading weights:  62%|β–Œ| 226/363 [00:00<00:00, 3800.91it/s, Materializing param=model.layers.24.self_at
Loading weights:  62%|β–Œ| 226/363 [00:00<00:00, 3791.10it/s, Materializing param=model.layers.24.self_at
Loading weights:  63%|β–‹| 227/363 [00:00<00:00, 3713.32it/s, Materializing param=model.layers.24.self_at
Loading weights:  63%|β–‹| 227/363 [00:00<00:00, 3710.28it/s, Materializing param=model.layers.24.self_at
Loading weights:  63%|β–‹| 228/363 [00:00<00:00, 3720.29it/s, Materializing param=model.layers.25.input_l
Loading weights:  63%|β–‹| 228/363 [00:00<00:00, 3717.21it/s, Materializing param=model.layers.25.input_l
Loading weights:  63%|β–‹| 229/363 [00:00<00:00, 3727.47it/s, Materializing param=model.layers.25.mlp.dow
Loading weights:  63%|β–‹| 229/363 [00:00<00:00, 3724.50it/s, Materializing param=model.layers.25.mlp.dow
Loading weights:  63%|β–‹| 230/363 [00:00<00:00, 3735.05it/s, Materializing param=model.layers.25.mlp.gat
Loading weights:  63%|β–‹| 230/363 [00:00<00:00, 3731.59it/s, Materializing param=model.layers.25.mlp.gat
Loading weights:  64%|β–‹| 231/363 [00:00<00:00, 3740.27it/s, Materializing param=model.layers.25.mlp.up_
Loading weights:  64%|β–‹| 231/363 [00:00<00:00, 3737.19it/s, Materializing param=model.layers.25.mlp.up_
Loading weights:  64%|β–‹| 232/363 [00:00<00:00, 3725.83it/s, Materializing param=model.layers.25.post_at
Loading weights:  64%|β–‹| 232/363 [00:00<00:00, 3722.74it/s, Materializing param=model.layers.25.post_at
Loading weights:  64%|β–‹| 233/363 [00:00<00:00, 3731.60it/s, Materializing param=model.layers.25.self_at
Loading weights:  64%|β–‹| 233/363 [00:00<00:00, 3728.50it/s, Materializing param=model.layers.25.self_at
Loading weights:  64%|β–‹| 234/363 [00:00<00:00, 3739.89it/s, Materializing param=model.layers.25.self_at
Loading weights:  64%|β–‹| 234/363 [00:00<00:00, 3736.80it/s, Materializing param=model.layers.25.self_at
Loading weights:  65%|β–‹| 235/363 [00:00<00:00, 3736.52it/s, Materializing param=model.layers.25.self_at
Loading weights:  65%|β–‹| 235/363 [00:00<00:00, 3733.18it/s, Materializing param=model.layers.25.self_at
Loading weights:  65%|β–‹| 236/363 [00:00<00:00, 3743.23it/s, Materializing param=model.layers.25.self_at
Loading weights:  65%|β–‹| 236/363 [00:00<00:00, 3740.48it/s, Materializing param=model.layers.25.self_at
Loading weights:  65%|β–‹| 237/363 [00:00<00:00, 3750.79it/s, Materializing param=model.layers.26.input_l
Loading weights:  65%|β–‹| 237/363 [00:00<00:00, 3748.01it/s, Materializing param=model.layers.26.input_l
Loading weights:  66%|β–‹| 238/363 [00:00<00:00, 3742.63it/s, Materializing param=model.layers.26.mlp.dow
Loading weights:  66%|β–‹| 238/363 [00:00<00:00, 3737.87it/s, Materializing param=model.layers.26.mlp.dow
Loading weights:  66%|β–‹| 239/363 [00:00<00:00, 3747.49it/s, Materializing param=model.layers.26.mlp.gat
Loading weights:  66%|β–‹| 239/363 [00:00<00:00, 3744.62it/s, Materializing param=model.layers.26.mlp.gat
Loading weights:  66%|β–‹| 240/363 [00:00<00:00, 3754.89it/s, Materializing param=model.layers.26.mlp.up_
Loading weights:  66%|β–‹| 240/363 [00:00<00:00, 3752.05it/s, Materializing param=model.layers.26.mlp.up_
Loading weights:  66%|β–‹| 241/363 [00:00<00:00, 3762.27it/s, Materializing param=model.layers.26.post_at
Loading weights:  66%|β–‹| 241/363 [00:00<00:00, 3758.39it/s, Materializing param=model.layers.26.post_at
Loading weights:  67%|β–‹| 242/363 [00:00<00:00, 3768.72it/s, Materializing param=model.layers.26.self_at
Loading weights:  67%|β–‹| 242/363 [00:00<00:00, 3765.80it/s, Materializing param=model.layers.26.self_at
Loading weights:  67%|β–‹| 243/363 [00:00<00:00, 3775.22it/s, Materializing param=model.layers.26.self_at
Loading weights:  67%|β–‹| 243/363 [00:00<00:00, 3771.34it/s, Materializing param=model.layers.26.self_at
Loading weights:  67%|β–‹| 244/363 [00:00<00:00, 3755.04it/s, Materializing param=model.layers.26.self_at
Loading weights:  67%|β–‹| 244/363 [00:00<00:00, 3751.90it/s, Materializing param=model.layers.26.self_at
Loading weights:  67%|β–‹| 245/363 [00:00<00:00, 3762.48it/s, Materializing param=model.layers.26.self_at
Loading weights:  67%|β–‹| 245/363 [00:00<00:00, 3759.48it/s, Materializing param=model.layers.26.self_at
Loading weights:  68%|β–‹| 246/363 [00:00<00:00, 3770.13it/s, Materializing param=model.layers.27.input_l
Loading weights:  68%|β–‹| 246/363 [00:00<00:00, 3767.41it/s, Materializing param=model.layers.27.input_l
Loading weights:  68%|β–‹| 247/363 [00:00<00:00, 3776.68it/s, Materializing param=model.layers.27.mlp.dow
Loading weights:  68%|β–‹| 247/363 [00:00<00:00, 3773.66it/s, Materializing param=model.layers.27.mlp.dow
Loading weights:  68%|β–‹| 248/363 [00:00<00:00, 3767.43it/s, Materializing param=model.layers.27.mlp.gat
Loading weights:  68%|β–‹| 248/363 [00:00<00:00, 3764.29it/s, Materializing param=model.layers.27.mlp.gat
Loading weights:  69%|β–‹| 249/363 [00:00<00:00, 3725.56it/s, Materializing param=model.layers.27.mlp.up_
Loading weights:  69%|β–‹| 249/363 [00:00<00:00, 3722.36it/s, Materializing param=model.layers.27.mlp.up_
Loading weights:  69%|β–‹| 250/363 [00:00<00:00, 3731.51it/s, Materializing param=model.layers.27.post_at
Loading weights:  69%|β–‹| 250/363 [00:00<00:00, 3728.56it/s, Materializing param=model.layers.27.post_at
Loading weights:  69%|β–‹| 251/363 [00:00<00:00, 3738.48it/s, Materializing param=model.layers.27.self_at
Loading weights:  69%|β–‹| 251/363 [00:00<00:00, 3735.72it/s, Materializing param=model.layers.27.self_at
Loading weights:  69%|β–‹| 252/363 [00:00<00:00, 3746.00it/s, Materializing param=model.layers.27.self_at
Loading weights:  69%|β–‹| 252/363 [00:00<00:00, 3743.27it/s, Materializing param=model.layers.27.self_at
Loading weights:  70%|β–‹| 253/363 [00:00<00:00, 3752.73it/s, Materializing param=model.layers.27.self_at
Loading weights:  70%|β–‹| 253/363 [00:00<00:00, 3749.88it/s, Materializing param=model.layers.27.self_at
Loading weights:  70%|β–‹| 254/363 [00:00<00:00, 3725.96it/s, Materializing param=model.layers.27.self_at
Loading weights:  70%|β–‹| 254/363 [00:00<00:00, 3722.98it/s, Materializing param=model.layers.27.self_at
Loading weights:  70%|β–‹| 255/363 [00:00<00:00, 3732.03it/s, Materializing param=model.layers.28.input_l
Loading weights:  70%|β–‹| 255/363 [00:00<00:00, 3729.26it/s, Materializing param=model.layers.28.input_l
Loading weights:  71%|β–‹| 256/363 [00:00<00:00, 3738.92it/s, Materializing param=model.layers.28.mlp.dow
Loading weights:  71%|β–‹| 256/363 [00:00<00:00, 3736.26it/s, Materializing param=model.layers.28.mlp.dow
Loading weights:  71%|β–‹| 257/363 [00:00<00:00, 3738.21it/s, Materializing param=model.layers.28.mlp.gat
Loading weights:  71%|β–‹| 257/363 [00:00<00:00, 3735.45it/s, Materializing param=model.layers.28.mlp.gat
Loading weights:  71%|β–‹| 258/363 [00:00<00:00, 3744.62it/s, Materializing param=model.layers.28.mlp.up_
Loading weights:  71%|β–‹| 258/363 [00:00<00:00, 3742.16it/s, Materializing param=model.layers.28.mlp.up_
Loading weights:  71%|β–‹| 259/363 [00:00<00:00, 3751.78it/s, Materializing param=model.layers.28.post_at
Loading weights:  71%|β–‹| 259/363 [00:00<00:00, 3749.02it/s, Materializing param=model.layers.28.post_at
Loading weights:  72%|β–‹| 260/363 [00:00<00:00, 3719.89it/s, Materializing param=model.layers.28.self_at
Loading weights:  72%|β–‹| 260/363 [00:00<00:00, 3716.83it/s, Materializing param=model.layers.28.self_at
Loading weights:  72%|β–‹| 261/363 [00:00<00:00, 3725.28it/s, Materializing param=model.layers.28.self_at
Loading weights:  72%|β–‹| 261/363 [00:00<00:00, 3722.77it/s, Materializing param=model.layers.28.self_at
Loading weights:  72%|β–‹| 262/363 [00:00<00:00, 3714.63it/s, Materializing param=model.layers.28.self_at
Loading weights:  72%|β–‹| 262/363 [00:00<00:00, 3711.77it/s, Materializing param=model.layers.28.self_at
Loading weights:  72%|β–‹| 263/363 [00:00<00:00, 3679.23it/s, Materializing param=model.layers.28.self_at
Loading weights:  72%|β–‹| 263/363 [00:00<00:00, 3676.49it/s, Materializing param=model.layers.28.self_at
Loading weights:  73%|β–‹| 264/363 [00:00<00:00, 3678.74it/s, Materializing param=model.layers.29.input_l
Loading weights:  73%|β–‹| 264/363 [00:00<00:00, 3676.36it/s, Materializing param=model.layers.29.input_l
Loading weights:  73%|β–‹| 265/363 [00:00<00:00, 3687.22it/s, Materializing param=model.layers.29.mlp.dow
Loading weights:  73%|β–‹| 265/363 [00:00<00:00, 3685.15it/s, Materializing param=model.layers.29.mlp.dow
Loading weights:  73%|β–‹| 266/363 [00:00<00:00, 3695.99it/s, Materializing param=model.layers.29.mlp.gat
Loading weights:  73%|β–‹| 266/363 [00:00<00:00, 3694.13it/s, Materializing param=model.layers.29.mlp.gat
Loading weights:  74%|β–‹| 267/363 [00:00<00:00, 3705.12it/s, Materializing param=model.layers.29.mlp.up_
Loading weights:  74%|β–‹| 267/363 [00:00<00:00, 3703.18it/s, Materializing param=model.layers.29.mlp.up_
Loading weights:  74%|β–‹| 268/363 [00:00<00:00, 3714.15it/s, Materializing param=model.layers.29.post_at
Loading weights:  74%|β–‹| 268/363 [00:00<00:00, 3712.13it/s, Materializing param=model.layers.29.post_at
Loading weights:  74%|β–‹| 269/363 [00:00<00:00, 3723.05it/s, Materializing param=model.layers.29.self_at
Loading weights:  74%|β–‹| 269/363 [00:00<00:00, 3721.00it/s, Materializing param=model.layers.29.self_at
Loading weights:  74%|β–‹| 270/363 [00:00<00:00, 3731.99it/s, Materializing param=model.layers.29.self_at
Loading weights:  74%|β–‹| 270/363 [00:00<00:00, 3729.14it/s, Materializing param=model.layers.29.self_at
Loading weights:  75%|β–‹| 271/363 [00:00<00:00, 3739.84it/s, Materializing param=model.layers.29.self_at
Loading weights:  75%|β–‹| 271/363 [00:00<00:00, 3737.75it/s, Materializing param=model.layers.29.self_at
Loading weights:  75%|β–‹| 272/363 [00:00<00:00, 3748.69it/s, Materializing param=model.layers.29.self_at
Loading weights:  75%|β–‹| 272/363 [00:00<00:00, 3746.38it/s, Materializing param=model.layers.29.self_at
Loading weights:  75%|β–Š| 273/363 [00:00<00:00, 3757.31it/s, Materializing param=model.layers.30.input_l
Loading weights:  75%|β–Š| 273/363 [00:00<00:00, 3755.24it/s, Materializing param=model.layers.30.input_l
Loading weights:  75%|β–Š| 274/363 [00:00<00:00, 3766.18it/s, Materializing param=model.layers.30.mlp.dow
Loading weights:  75%|β–Š| 274/363 [00:00<00:00, 3764.01it/s, Materializing param=model.layers.30.mlp.dow
Loading weights:  76%|β–Š| 275/363 [00:00<00:00, 3774.87it/s, Materializing param=model.layers.30.mlp.gat
Loading weights:  76%|β–Š| 275/363 [00:00<00:00, 3772.81it/s, Materializing param=model.layers.30.mlp.gat
Loading weights:  76%|β–Š| 276/363 [00:00<00:00, 3783.67it/s, Materializing param=model.layers.30.mlp.up_
Loading weights:  76%|β–Š| 276/363 [00:00<00:00, 3781.78it/s, Materializing param=model.layers.30.mlp.up_
Loading weights:  76%|β–Š| 277/363 [00:00<00:00, 3792.54it/s, Materializing param=model.layers.30.post_at
Loading weights:  76%|β–Š| 277/363 [00:00<00:00, 3790.57it/s, Materializing param=model.layers.30.post_at
Loading weights:  77%|β–Š| 278/363 [00:00<00:00, 3801.31it/s, Materializing param=model.layers.30.self_at
Loading weights:  77%|β–Š| 278/363 [00:00<00:00, 3799.14it/s, Materializing param=model.layers.30.self_at
Loading weights:  77%|β–Š| 279/363 [00:00<00:00, 3809.75it/s, Materializing param=model.layers.30.self_at
Loading weights:  77%|β–Š| 279/363 [00:00<00:00, 3807.59it/s, Materializing param=model.layers.30.self_at
Loading weights:  77%|β–Š| 280/363 [00:00<00:00, 3818.32it/s, Materializing param=model.layers.30.self_at
Loading weights:  77%|β–Š| 280/363 [00:00<00:00, 3816.37it/s, Materializing param=model.layers.30.self_at
Loading weights:  77%|β–Š| 281/363 [00:00<00:00, 3826.62it/s, Materializing param=model.layers.30.self_at
Loading weights:  77%|β–Š| 281/363 [00:00<00:00, 3824.56it/s, Materializing param=model.layers.30.self_at
Loading weights:  78%|β–Š| 282/363 [00:00<00:00, 3835.54it/s, Materializing param=model.layers.31.input_l
Loading weights:  78%|β–Š| 282/363 [00:00<00:00, 3833.42it/s, Materializing param=model.layers.31.input_l
Loading weights:  78%|β–Š| 283/363 [00:00<00:00, 3843.70it/s, Materializing param=model.layers.31.mlp.dow
Loading weights:  78%|β–Š| 283/363 [00:00<00:00, 3841.62it/s, Materializing param=model.layers.31.mlp.dow
Loading weights:  78%|β–Š| 284/363 [00:00<00:00, 3852.05it/s, Materializing param=model.layers.31.mlp.gat
Loading weights:  78%|β–Š| 284/363 [00:00<00:00, 3849.99it/s, Materializing param=model.layers.31.mlp.gat
Loading weights:  79%|β–Š| 285/363 [00:00<00:00, 3860.71it/s, Materializing param=model.layers.31.mlp.up_
Loading weights:  79%|β–Š| 285/363 [00:00<00:00, 3858.80it/s, Materializing param=model.layers.31.mlp.up_
Loading weights:  79%|β–Š| 286/363 [00:00<00:00, 3869.43it/s, Materializing param=model.layers.31.post_at
Loading weights:  79%|β–Š| 286/363 [00:00<00:00, 3867.38it/s, Materializing param=model.layers.31.post_at
Loading weights:  79%|β–Š| 287/363 [00:00<00:00, 3878.01it/s, Materializing param=model.layers.31.self_at
Loading weights:  79%|β–Š| 287/363 [00:00<00:00, 3875.94it/s, Materializing param=model.layers.31.self_at
Loading weights:  79%|β–Š| 288/363 [00:00<00:00, 3886.55it/s, Materializing param=model.layers.31.self_at
Loading weights:  79%|β–Š| 288/363 [00:00<00:00, 3884.63it/s, Materializing param=model.layers.31.self_at
Loading weights:  80%|β–Š| 289/363 [00:00<00:00, 3895.35it/s, Materializing param=model.layers.31.self_at
Loading weights:  80%|β–Š| 289/363 [00:00<00:00, 3892.86it/s, Materializing param=model.layers.31.self_at
Loading weights:  80%|β–Š| 290/363 [00:00<00:00, 3903.41it/s, Materializing param=model.layers.31.self_at
Loading weights:  80%|β–Š| 290/363 [00:00<00:00, 3901.54it/s, Materializing param=model.layers.31.self_at
Loading weights:  80%|β–Š| 291/363 [00:00<00:00, 3911.68it/s, Materializing param=model.layers.32.input_l
Loading weights:  80%|β–Š| 291/363 [00:00<00:00, 3909.61it/s, Materializing param=model.layers.32.input_l
Loading weights:  80%|β–Š| 292/363 [00:00<00:00, 3920.15it/s, Materializing param=model.layers.32.mlp.dow
Loading weights:  80%|β–Š| 292/363 [00:00<00:00, 3918.09it/s, Materializing param=model.layers.32.mlp.dow
Loading weights:  81%|β–Š| 293/363 [00:00<00:00, 3928.61it/s, Materializing param=model.layers.32.mlp.gat
Loading weights:  81%|β–Š| 293/363 [00:00<00:00, 3926.26it/s, Materializing param=model.layers.32.mlp.gat
Loading weights:  81%|β–Š| 294/363 [00:00<00:00, 3936.79it/s, Materializing param=model.layers.32.mlp.up_
Loading weights:  81%|β–Š| 294/363 [00:00<00:00, 3934.74it/s, Materializing param=model.layers.32.mlp.up_
Loading weights:  81%|β–Š| 295/363 [00:00<00:00, 3945.26it/s, Materializing param=model.layers.32.post_at
Loading weights:  81%|β–Š| 295/363 [00:00<00:00, 3943.12it/s, Materializing param=model.layers.32.post_at
Loading weights:  82%|β–Š| 296/363 [00:00<00:00, 3953.63it/s, Materializing param=model.layers.32.self_at
Loading weights:  82%|β–Š| 296/363 [00:00<00:00, 3951.37it/s, Materializing param=model.layers.32.self_at
Loading weights:  82%|β–Š| 297/363 [00:00<00:00, 3961.92it/s, Materializing param=model.layers.32.self_at
Loading weights:  82%|β–Š| 297/363 [00:00<00:00, 3959.82it/s, Materializing param=model.layers.32.self_at
Loading weights:  82%|β–Š| 298/363 [00:00<00:00, 3970.43it/s, Materializing param=model.layers.32.self_at
Loading weights:  82%|β–Š| 298/363 [00:00<00:00, 3968.30it/s, Materializing param=model.layers.32.self_at
Loading weights:  82%|β–Š| 299/363 [00:00<00:00, 3978.89it/s, Materializing param=model.layers.32.self_at
Loading weights:  82%|β–Š| 299/363 [00:00<00:00, 3976.80it/s, Materializing param=model.layers.32.self_at
Loading weights:  83%|β–Š| 300/363 [00:00<00:00, 3987.25it/s, Materializing param=model.layers.33.input_l
Loading weights:  83%|β–Š| 300/363 [00:00<00:00, 3985.04it/s, Materializing param=model.layers.33.input_l
Loading weights:  83%|β–Š| 301/363 [00:00<00:00, 3995.35it/s, Materializing param=model.layers.33.mlp.dow
Loading weights:  83%|β–Š| 301/363 [00:00<00:00, 3993.35it/s, Materializing param=model.layers.33.mlp.dow
Loading weights:  83%|β–Š| 302/363 [00:00<00:00, 4002.83it/s, Materializing param=model.layers.33.mlp.gat
Loading weights:  83%|β–Š| 302/363 [00:00<00:00, 4000.66it/s, Materializing param=model.layers.33.mlp.gat
Loading weights:  83%|β–Š| 303/363 [00:00<00:00, 4010.90it/s, Materializing param=model.layers.33.mlp.up_
Loading weights:  83%|β–Š| 303/363 [00:00<00:00, 4008.70it/s, Materializing param=model.layers.33.mlp.up_
Loading weights:  84%|β–Š| 304/363 [00:00<00:00, 4018.56it/s, Materializing param=model.layers.33.post_at
Loading weights:  84%|β–Š| 304/363 [00:00<00:00, 4016.41it/s, Materializing param=model.layers.33.post_at
Loading weights:  84%|β–Š| 305/363 [00:00<00:00, 4026.47it/s, Materializing param=model.layers.33.self_at
Loading weights:  84%|β–Š| 305/363 [00:00<00:00, 4024.56it/s, Materializing param=model.layers.33.self_at
Loading weights:  84%|β–Š| 306/363 [00:00<00:00, 4034.78it/s, Materializing param=model.layers.33.self_at
Loading weights:  84%|β–Š| 306/363 [00:00<00:00, 4032.69it/s, Materializing param=model.layers.33.self_at
Loading weights:  85%|β–Š| 307/363 [00:00<00:00, 4042.89it/s, Materializing param=model.layers.33.self_at
Loading weights:  85%|β–Š| 307/363 [00:00<00:00, 4040.74it/s, Materializing param=model.layers.33.self_at
Loading weights:  85%|β–Š| 308/363 [00:00<00:00, 4050.90it/s, Materializing param=model.layers.33.self_at
Loading weights:  85%|β–Š| 308/363 [00:00<00:00, 4048.80it/s, Materializing param=model.layers.33.self_at
Loading weights:  85%|β–Š| 309/363 [00:00<00:00, 4058.99it/s, Materializing param=model.layers.34.input_l
Loading weights:  85%|β–Š| 309/363 [00:00<00:00, 4056.91it/s, Materializing param=model.layers.34.input_l
Loading weights:  85%|β–Š| 310/363 [00:00<00:00, 4067.17it/s, Materializing param=model.layers.34.mlp.dow
Loading weights:  85%|β–Š| 310/363 [00:00<00:00, 4065.06it/s, Materializing param=model.layers.34.mlp.dow
Loading weights:  86%|β–Š| 311/363 [00:00<00:00, 4075.26it/s, Materializing param=model.layers.34.mlp.gat
Loading weights:  86%|β–Š| 311/363 [00:00<00:00, 4073.18it/s, Materializing param=model.layers.34.mlp.gat
Loading weights:  86%|β–Š| 312/363 [00:00<00:00, 4082.91it/s, Materializing param=model.layers.34.mlp.up_
Loading weights:  86%|β–Š| 312/363 [00:00<00:00, 4081.02it/s, Materializing param=model.layers.34.mlp.up_
Loading weights:  86%|β–Š| 313/363 [00:00<00:00, 4091.33it/s, Materializing param=model.layers.34.post_at
Loading weights:  86%|β–Š| 313/363 [00:00<00:00, 4089.10it/s, Materializing param=model.layers.34.post_at
Loading weights:  87%|β–Š| 314/363 [00:00<00:00, 4098.75it/s, Materializing param=model.layers.34.self_at
Loading weights:  87%|β–Š| 314/363 [00:00<00:00, 4096.59it/s, Materializing param=model.layers.34.self_at
Loading weights:  87%|β–Š| 315/363 [00:00<00:00, 4106.58it/s, Materializing param=model.layers.34.self_at
Loading weights:  87%|β–Š| 315/363 [00:00<00:00, 4104.53it/s, Materializing param=model.layers.34.self_at
Loading weights:  87%|β–Š| 316/363 [00:00<00:00, 4114.49it/s, Materializing param=model.layers.34.self_at
Loading weights:  87%|β–Š| 316/363 [00:00<00:00, 4112.14it/s, Materializing param=model.layers.34.self_at
Loading weights:  87%|β–Š| 317/363 [00:00<00:00, 4122.08it/s, Materializing param=model.layers.34.self_at
Loading weights:  87%|β–Š| 317/363 [00:00<00:00, 4119.85it/s, Materializing param=model.layers.34.self_at
Loading weights:  88%|β–‰| 318/363 [00:00<00:00, 4129.85it/s, Materializing param=model.layers.35.input_l
Loading weights:  88%|β–‰| 318/363 [00:00<00:00, 4127.70it/s, Materializing param=model.layers.35.input_l
Loading weights:  88%|β–‰| 319/363 [00:00<00:00, 4137.71it/s, Materializing param=model.layers.35.mlp.dow
Loading weights:  88%|β–‰| 319/363 [00:00<00:00, 4135.65it/s, Materializing param=model.layers.35.mlp.dow
Loading weights:  88%|β–‰| 320/363 [00:00<00:00, 4145.89it/s, Materializing param=model.layers.35.mlp.gat
Loading weights:  88%|β–‰| 320/363 [00:00<00:00, 4143.79it/s, Materializing param=model.layers.35.mlp.gat
Loading weights:  88%|β–‰| 321/363 [00:00<00:00, 4153.80it/s, Materializing param=model.layers.35.mlp.up_
Loading weights:  88%|β–‰| 321/363 [00:00<00:00, 4151.67it/s, Materializing param=model.layers.35.mlp.up_
Loading weights:  89%|β–‰| 322/363 [00:00<00:00, 4161.62it/s, Materializing param=model.layers.35.post_at
Loading weights:  89%|β–‰| 322/363 [00:00<00:00, 4158.89it/s, Materializing param=model.layers.35.post_at
Loading weights:  89%|β–‰| 323/363 [00:00<00:00, 4168.67it/s, Materializing param=model.layers.35.self_at
Loading weights:  89%|β–‰| 323/363 [00:00<00:00, 4166.56it/s, Materializing param=model.layers.35.self_at
Loading weights:  89%|β–‰| 324/363 [00:00<00:00, 4176.58it/s, Materializing param=model.layers.35.self_at
Loading weights:  89%|β–‰| 324/363 [00:00<00:00, 4174.35it/s, Materializing param=model.layers.35.self_at
Loading weights:  90%|β–‰| 325/363 [00:00<00:00, 4184.06it/s, Materializing param=model.layers.35.self_at
Loading weights:  90%|β–‰| 325/363 [00:00<00:00, 4181.91it/s, Materializing param=model.layers.35.self_at
Loading weights:  90%|β–‰| 326/363 [00:00<00:00, 4191.67it/s, Materializing param=model.layers.35.self_at
Loading weights:  90%|β–‰| 326/363 [00:00<00:00, 4189.63it/s, Materializing param=model.layers.35.self_at
Loading weights:  90%|β–‰| 327/363 [00:00<00:00, 4199.71it/s, Materializing param=model.layers.36.input_l
Loading weights:  90%|β–‰| 327/363 [00:00<00:00, 4197.55it/s, Materializing param=model.layers.36.input_l
Loading weights:  90%|β–‰| 328/363 [00:00<00:00, 4207.48it/s, Materializing param=model.layers.36.mlp.dow
Loading weights:  90%|β–‰| 328/363 [00:00<00:00, 4205.37it/s, Materializing param=model.layers.36.mlp.dow
Loading weights:  91%|β–‰| 329/363 [00:00<00:00, 4215.25it/s, Materializing param=model.layers.36.mlp.gat
Loading weights:  91%|β–‰| 329/363 [00:00<00:00, 4213.10it/s, Materializing param=model.layers.36.mlp.gat
Loading weights:  91%|β–‰| 330/363 [00:00<00:00, 4222.60it/s, Materializing param=model.layers.36.mlp.up_
Loading weights:  91%|β–‰| 330/363 [00:00<00:00, 4220.50it/s, Materializing param=model.layers.36.mlp.up_
Loading weights:  91%|β–‰| 331/363 [00:00<00:00, 4230.05it/s, Materializing param=model.layers.36.post_at
Loading weights:  91%|β–‰| 331/363 [00:00<00:00, 4227.86it/s, Materializing param=model.layers.36.post_at
Loading weights:  91%|β–‰| 332/363 [00:00<00:00, 4237.61it/s, Materializing param=model.layers.36.self_at
Loading weights:  91%|β–‰| 332/363 [00:00<00:00, 4234.78it/s, Materializing param=model.layers.36.self_at
Loading weights:  92%|β–‰| 333/363 [00:00<00:00, 4244.42it/s, Materializing param=model.layers.36.self_at
Loading weights:  92%|β–‰| 333/363 [00:00<00:00, 4242.41it/s, Materializing param=model.layers.36.self_at
Loading weights:  92%|β–‰| 334/363 [00:00<00:00, 4252.36it/s, Materializing param=model.layers.36.self_at
Loading weights:  92%|β–‰| 334/363 [00:00<00:00, 4250.27it/s, Materializing param=model.layers.36.self_at
Loading weights:  92%|β–‰| 335/363 [00:00<00:00, 4260.05it/s, Materializing param=model.layers.36.self_at
Loading weights:  92%|β–‰| 335/363 [00:00<00:00, 4257.82it/s, Materializing param=model.layers.36.self_at
Loading weights:  93%|β–‰| 336/363 [00:00<00:00, 4267.60it/s, Materializing param=model.layers.37.input_l
Loading weights:  93%|β–‰| 336/363 [00:00<00:00, 4265.48it/s, Materializing param=model.layers.37.input_l
Loading weights:  93%|β–‰| 337/363 [00:00<00:00, 4275.31it/s, Materializing param=model.layers.37.mlp.dow
Loading weights:  93%|β–‰| 337/363 [00:00<00:00, 4273.14it/s, Materializing param=model.layers.37.mlp.dow
Loading weights:  93%|β–‰| 338/363 [00:00<00:00, 4282.84it/s, Materializing param=model.layers.37.mlp.gat
Loading weights:  93%|β–‰| 338/363 [00:00<00:00, 4280.60it/s, Materializing param=model.layers.37.mlp.gat
Loading weights:  93%|β–‰| 339/363 [00:00<00:00, 4290.23it/s, Materializing param=model.layers.37.mlp.up_
Loading weights:  93%|β–‰| 339/363 [00:00<00:00, 4288.07it/s, Materializing param=model.layers.37.mlp.up_
Loading weights:  94%|β–‰| 340/363 [00:00<00:00, 4297.73it/s, Materializing param=model.layers.37.post_at
Loading weights:  94%|β–‰| 340/363 [00:00<00:00, 4295.57it/s, Materializing param=model.layers.37.post_at
Loading weights:  94%|β–‰| 341/363 [00:00<00:00, 4305.39it/s, Materializing param=model.layers.37.self_at
Loading weights:  94%|β–‰| 341/363 [00:00<00:00, 4303.30it/s, Materializing param=model.layers.37.self_at
Loading weights:  94%|β–‰| 342/363 [00:00<00:00, 4312.90it/s, Materializing param=model.layers.37.self_at
Loading weights:  94%|β–‰| 342/363 [00:00<00:00, 4310.67it/s, Materializing param=model.layers.37.self_at
Loading weights:  94%|β–‰| 343/363 [00:00<00:00, 4319.69it/s, Materializing param=model.layers.37.self_at
Loading weights:  94%|β–‰| 343/363 [00:00<00:00, 4317.61it/s, Materializing param=model.layers.37.self_at
Loading weights:  95%|β–‰| 344/363 [00:00<00:00, 4327.19it/s, Materializing param=model.layers.37.self_at
Loading weights:  95%|β–‰| 344/363 [00:00<00:00, 4325.05it/s, Materializing param=model.layers.37.self_at
Loading weights:  95%|β–‰| 345/363 [00:00<00:00, 4334.27it/s, Materializing param=model.layers.38.input_l
Loading weights:  95%|β–‰| 345/363 [00:00<00:00, 4332.10it/s, Materializing param=model.layers.38.input_l
Loading weights:  95%|β–‰| 346/363 [00:00<00:00, 4341.64it/s, Materializing param=model.layers.38.mlp.dow
Loading weights:  95%|β–‰| 346/363 [00:00<00:00, 4339.48it/s, Materializing param=model.layers.38.mlp.dow
Loading weights:  96%|β–‰| 347/363 [00:00<00:00, 4349.04it/s, Materializing param=model.layers.38.mlp.gat
Loading weights:  96%|β–‰| 347/363 [00:00<00:00, 4346.90it/s, Materializing param=model.layers.38.mlp.gat
Loading weights:  96%|β–‰| 348/363 [00:00<00:00, 4356.48it/s, Materializing param=model.layers.38.mlp.up_
Loading weights:  96%|β–‰| 348/363 [00:00<00:00, 4354.44it/s, Materializing param=model.layers.38.mlp.up_
Loading weights:  96%|β–‰| 349/363 [00:00<00:00, 4363.80it/s, Materializing param=model.layers.38.post_at
Loading weights:  96%|β–‰| 349/363 [00:00<00:00, 4361.67it/s, Materializing param=model.layers.38.post_at
Loading weights:  96%|β–‰| 350/363 [00:00<00:00, 4371.27it/s, Materializing param=model.layers.38.self_at
Loading weights:  96%|β–‰| 350/363 [00:00<00:00, 4369.05it/s, Materializing param=model.layers.38.self_at
Loading weights:  97%|β–‰| 351/363 [00:00<00:00, 4378.62it/s, Materializing param=model.layers.38.self_at
Loading weights:  97%|β–‰| 351/363 [00:00<00:00, 4376.43it/s, Materializing param=model.layers.38.self_at
Loading weights:  97%|β–‰| 352/363 [00:00<00:00, 4385.86it/s, Materializing param=model.layers.38.self_at
Loading weights:  97%|β–‰| 352/363 [00:00<00:00, 4383.43it/s, Materializing param=model.layers.38.self_at
Loading weights:  97%|β–‰| 353/363 [00:00<00:00, 4392.94it/s, Materializing param=model.layers.38.self_at
Loading weights:  97%|β–‰| 353/363 [00:00<00:00, 4390.05it/s, Materializing param=model.layers.38.self_at
Loading weights:  98%|β–‰| 354/363 [00:00<00:00, 4399.15it/s, Materializing param=model.layers.39.input_l
Loading weights:  98%|β–‰| 354/363 [00:00<00:00, 4396.99it/s, Materializing param=model.layers.39.input_l
Loading weights:  98%|β–‰| 355/363 [00:00<00:00, 4406.52it/s, Materializing param=model.layers.39.mlp.dow
Loading weights:  98%|β–‰| 355/363 [00:00<00:00, 4404.09it/s, Materializing param=model.layers.39.mlp.dow
Loading weights:  98%|β–‰| 356/363 [00:00<00:00, 4413.48it/s, Materializing param=model.layers.39.mlp.gat
Loading weights:  98%|β–‰| 356/363 [00:00<00:00, 4411.39it/s, Materializing param=model.layers.39.mlp.gat
Loading weights:  98%|β–‰| 357/363 [00:00<00:00, 4420.87it/s, Materializing param=model.layers.39.mlp.up_
Loading weights:  98%|β–‰| 357/363 [00:00<00:00, 4418.76it/s, Materializing param=model.layers.39.mlp.up_
Loading weights:  99%|β–‰| 358/363 [00:00<00:00, 4428.32it/s, Materializing param=model.layers.39.post_at
Loading weights:  99%|β–‰| 358/363 [00:00<00:00, 4426.14it/s, Materializing param=model.layers.39.post_at
Loading weights:  99%|β–‰| 359/363 [00:00<00:00, 4435.72it/s, Materializing param=model.layers.39.self_at
Loading weights:  99%|β–‰| 359/363 [00:00<00:00, 4433.53it/s, Materializing param=model.layers.39.self_at
Loading weights:  99%|β–‰| 360/363 [00:00<00:00, 4442.82it/s, Materializing param=model.layers.39.self_at
Loading weights:  99%|β–‰| 360/363 [00:00<00:00, 4440.65it/s, Materializing param=model.layers.39.self_at
Loading weights:  99%|β–‰| 361/363 [00:00<00:00, 4449.96it/s, Materializing param=model.layers.39.self_at
Loading weights:  99%|β–‰| 361/363 [00:00<00:00, 4447.78it/s, Materializing param=model.layers.39.self_at
Loading weights: 100%|β–‰| 362/363 [00:00<00:00, 4457.06it/s, Materializing param=model.layers.39.self_at
Loading weights: 100%|β–‰| 362/363 [00:00<00:00, 4454.38it/s, Materializing param=model.layers.39.self_at
Loading weights: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 363/363 [00:00<00:00, 4463.67it/s, Materializing param=model.norm.weight]
Loading weights: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 363/363 [00:00<00:00, 4461.18it/s, Materializing param=model.norm.weight]
Loading weights: 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 363/363 [00:00<00:00, 4456.50it/s, Materializing param=model.norm.weight]
[2026-02-24 02:55:54,138] [WARNING] [torchao.<module>:39] [PID:24011] Skipping import of cpp extensions due to incompatible torch version 2.9.0+cu130 for torchao version 0.13.0
[2026-02-24 02:55:55,030] [WARNING] [accelerate.utils.dataclasses.__post_init__:1962] [PID:24011] sync_module_states is obsolete in FSDP2, as it is not needed anymore.Setting sync_module_states to None.Multiple deprecation warnings due to FSDP2 conversion:
sharding_strategy is deprecated in favor of reshard_after_forward. This will be removed in a future version of Accelerate.