ssc-lke-mms-model-mix-adapt-max3

This model was trained from scratch on an unknown dataset. It achieves the following results on the evaluation set:

Model description

More information needed

More information needed

More information needed

The following hyperparameters were used during training:

learning_rate: 0.0005
train_batch_size: 1
eval_batch_size: 6
seed: 42
gradient_accumulation_steps: 2
total_train_batch_size: 2
optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
lr_scheduler_type: linear
lr_scheduler_warmup_steps: 100
num_epochs: 5
mixed_precision_training: Native AMP

Training Loss	Epoch	Step	Validation Loss	Cer	Wer
0.6404	0.2339	200	0.7329	0.1791	0.6321
0.6154	0.4678	400	0.7215	0.1791	0.6169
0.6719	0.7018	600	0.7296	0.1741	0.6036
0.6197	0.9357	800	0.7267	0.1768	0.6153
0.6249	1.1696	1000	0.7200	0.1743	0.5987
0.6446	1.4035	1200	0.7218	0.1726	0.6122
0.6173	1.6374	1400	0.7138	0.1734	0.6078
0.5768	1.8713	1600	0.7102	0.1730	0.5952
0.6334	2.1053	1800	0.7147	0.1715	0.5897
0.5523	2.3392	2000	0.7053	0.1709	0.5889
0.6428	2.5731	2200	0.7135	0.1721	0.5921
0.5659	2.8070	2400	0.7084	0.1700	0.5960
0.6178	3.0409	2600	0.7120	0.1728	0.5973
0.5678	3.2749	2800	0.7107	0.1709	0.5921
0.5156	3.5088	3000	0.7057	0.1700	0.5871
0.5565	3.7427	3200	0.7053	0.1690	0.5839
0.5346	3.9766	3400	0.7028	0.1712	0.5912
0.5854	4.2105	3600	0.7011	0.1710	0.5938
0.4753	4.4444	3800	0.7091	0.1732	0.5993
0.5383	4.6784	4000	0.7020	0.1680	0.5828
0.5722	4.9123	4200	0.7023	0.1681	0.5846

Safetensors

Model size

1.0B params

Tensor type

F32