Hugging Face's logo

ViuAI
/
ViuMini-Dense-360M

Text Generation
PyTorch
Hindi
English
dense
transformer
indic
hindi
hinglish
english
gqa
gemma-4
Model card Files
xet
 Community
ViuMini-Dense-360M

Commit History

16 days ago

  1. feat: update RTX 5090 runner and config

    ViuAI
    Verified signature
    9f69669

  2. feat: update RTX 5090 runner and config

    ViuAI
    Verified signature
    925405f

  3. feat: update RTX 5090 notebook runner and optimized config

    ViuAI
    Verified signature
    1dfd5ce

17 days ago

  1. sync log step_1000

    ViuAI
    Verified signature
    8ef4aae

  2. full ckpt step_1000 (resume)

    ViuAI
    Verified signature
    1de08d3

  3. config: set Stage 1 micro 32 accum 4 for peak Tensor Core speed

    ViuAI
    Verified signature
    8866f9e

  4. config: set micro 16 accum 8 with grad_ckpt true for safe high-throughput pretraining

    ViuAI
    Verified signature
    97527fa

  5. fix: restore grad_ckpt and safe micro 8 accum 8 for zero-OOM guarantee on T4

    ViuAI
    Verified signature
    96be75f

  6. perf: disable grad_ckpt on T4 and enlarge loss chunk_size to 2048 for 10k+ tok/s

    ViuAI
    Verified signature
    7d4c3f5

  7. config: update Stage 1 batch_size to 16 for micro=16 accum=8 per GPU

    ViuAI
    Verified signature
    20ebd23

  8. refactor: consolidate pure 32L Dense architecture, purge MoE files, audit hardening

    ViuAI
    Verified signature
    3a5d3e5

  9. Update docs/KAGGLE_RUN.md: log_every: 10 and real-time step streaming

    ViuAI
    Verified signature
    f185a5b

  10. Update model/configs/train_kaggle_t4.yaml: log_every: 10 and real-time step streaming

    ViuAI
    Verified signature
    a68274b

  11. Remove dead config model/configs/model_config.yaml

    ViuAI
    Verified signature
    f3b7a40

  12. Remove dead config model/configs/viu_1_5b_moe_config.yaml

    ViuAI
    Verified signature
    c4713b4

  13. Remove dead config model/configs/viu1_moe_config.yaml

    ViuAI
    Verified signature
    ff9965d

  14. Archive model_config.yaml to deprecated folder

    ViuAI
    Verified signature
    629d126

  15. Archive viu_1_5b_moe_config.yaml to deprecated folder

    ViuAI
    Verified signature
    96ebcea

  16. Archive viu1_moe_config.yaml to deprecated folder

    ViuAI
    Verified signature
    e910481

  17. Fix model/scripts/train.py: batch math comments and find_unused_parameters=False

    ViuAI
    Verified signature
    ef65129

  18. Fix model/configs/train_config.yaml: batch math comments and find_unused_parameters=False

    ViuAI
    Verified signature
    d7975ca

  19. Audit fix: Update tokenizer/configs/tokenizer_config.json for ViuMini-Dense-360M

    ViuAI
    Verified signature
    8ab3701

  20. Audit fix: Update tokenizer/configs/tokenizer_config.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    91f527b

  21. Audit fix: Update model/scripts/train.py for ViuMini-Dense-360M

    ViuAI
    Verified signature
    e52f2b4

  22. Audit fix: Update model/configs/viu_1_5b_moe_config.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    5d2e7a3

  23. Audit fix: Update model/configs/viu1_moe_config.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    a072aa0

  24. Audit fix: Update model/configs/model_config.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    d32d6e4

  25. Audit fix: Update model/configs/train_dense_baseline.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    41869c6

  26. Audit fix: Update model/configs/train_h100_h200.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    232a8e4

  27. Audit fix: Update model/configs/train_rtx5090.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    70b87d7

  28. Audit fix: Update model/configs/train_rtx4090.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    d33c293

  29. Audit fix: Update model/configs/train_rtx3090.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    da2ff29

  30. Audit fix: Update model/configs/config.json for ViuMini-Dense-360M

    ViuAI
    Verified signature
    6e8fe69

  31. Audit fix: Update model/configs/viu1_dense_config.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    d8ba5af

  32. Audit fix: Update model/NOTES.md for ViuMini-Dense-360M

    ViuAI
    Verified signature
    42788da

  33. Audit fix: Update docs/PROGRESS.md for ViuMini-Dense-360M

    ViuAI
    Verified signature
    268f804

  34. Audit fix: Update docs/KAGGLE_RUN.md for ViuMini-Dense-360M

    ViuAI
    Verified signature
    f859acd

  35. Audit fix: Update requirements.txt for ViuMini-Dense-360M

    ViuAI
    Verified signature
    d248f4a

  36. Audit fix: Update NOTES.md for ViuMini-Dense-360M

    ViuAI
    Verified signature
    bd55c48

  37. Audit fix: Update README.md for ViuMini-Dense-360M

    ViuAI
    Verified signature
    1d7d841

  38. Update model/scripts/push_to_hf.py for ViuMini-Dense-360M

    ViuAI
    Verified signature
    d9702de

  39. Update model/scripts/train.py for ViuMini-Dense-360M

    ViuAI
    Verified signature
    dedfdc7

  40. Update model/configs/train_rtx5090.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    a2f494b

  41. Update model/configs/train_rtx4090.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    c8a4a4d

  42. Update model/configs/train_rtx3090.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    ee5595d

  43. Update model/configs/train_dense_baseline.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    08fb77d

  44. Update model/configs/train_config.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    6a651bd

  45. Update model/configs/train_kaggle_t4.yaml for ViuMini-Dense-360M

    ViuAI
    Verified signature
    c01244c

  46. Update docs/HF_PUSH_GUIDE.md for ViuMini-Dense-360M

    ViuAI
    Verified signature
    1a95c50

  47. Update docs/PROGRESS.md for ViuMini-Dense-360M

    ViuAI
    Verified signature
    0aeabb2