Image-to-Video
video
world-model
interactive-world-model
lora
diffusion
action-conditioning
game-world-model
Instructions to use DANNY621/H3-World with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Inference
- Notebooks
- Google Colab
- Kaggle
File size: 3,105 Bytes
bee86c6 d4757ed bee86c6 d4757ed bee86c6 dafaa6b bee86c6 cb1a1fe d4757ed 8883340 d4757ed bee86c6 dafaa6b bee86c6 dafaa6b bee86c6 d4757ed bee86c6 dafaa6b bee86c6 d4757ed bee86c6 d4757ed bee86c6 d4757ed dafaa6b bee86c6 d4757ed dafaa6b d4757ed | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 | ---
license: other
license_name: minimax-h3-community-license-agreement
license_link: https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE
base_model: MiniMaxAI/MiniMax-H3
datasets:
- acvlab/ABot-World-Explorer-500h
tags:
- video
- image-to-video
- world-model
- interactive-world-model
- lora
- diffusion
- action-conditioning
- game-world-model
---
# 🎮 H3-World: Turning Language Understanding into World Control
<img src="teaser.png" alt="H3-World teaser" width="100%">
H3-World is the **first interactive world model** built on [MiniMax-H3](https://huggingface.co/MiniMaxAI/MiniMax-H3). Given an initial frame and keyboard controls, it generates action-controlled video with coordinated character and camera motion.
H3-World converts keyboard states into one language instruction per future video latent and uses directed attention routing to bind each instruction to its corresponding latent interval. Using 8,000 gameplay clips from [ABot-World-Explorer-500h](https://huggingface.co/datasets/acvlab/ABot-World-Explorer-500h), it learns 65.6M LoRA parameters, only 0.199% of the 33B MiniMax-H3 backbone.
## Checkpoint
| File | Description |
| --- | --- |
| `step-10000.safetensors` | Released rank-32 H3-World LoRA checkpoint |
Character controls use `W`, `A`, `S`, and `D`. Camera controls use `I`, `J`, `K`, and `L`, with `F` indicating fast camera motion.
## Usage
This checkpoint is a LoRA delta for MiniMax-H3. It requires the MiniMax-H3 base weights and H3-World's directed-attention patch; loading the LoRA through an unmodified MiniMax-H3 pipeline will not reproduce the reported behavior.
Please use the official [H3-World code repository](https://github.com/Danzer1xxxxChan/H3-World) for setup, inference, and training instructions.
## License
This checkpoint is a LoRA adapter trained from MiniMax-H3 and is treated as a Model Derivative of MiniMax-H3. Use, modification, redistribution, and deployment of the checkpoint and any resulting model are subject to the [MiniMax H3 Community License Agreement](https://huggingface.co/MiniMaxAI/MiniMax-H3/blob/main/LICENSE).
The H3-World source code is separately licensed under the [Apache License 2.0](https://github.com/Danzer1xxxxChan/H3-World/blob/main/LICENSE). That license applies only to H3-World's independently copyrightable source-code contributions and does not replace, modify, or supersede the MiniMax-H3 license terms applicable to this checkpoint.
## Citation
```bibtex
@misc{chen2026h3worldturninglanguageunderstanding,
title={H3-World: Turning Language Understanding into World Control},
author={Danze Chen and Zeqing Wang and Ziyue Lin and Xingyi Yang and Yeying Jin},
year={2026},
eprint={2609.01560},
archivePrefix={arXiv},
primaryClass={cs.CV},
url={https://arxiv.org/abs/2609.01560},
}
```
## Acknowledgements
- [MiniMax-H3](https://huggingface.co/MiniMaxAI/MiniMax-H3)
- [DiffSynth-Studio](https://github.com/modelscope/DiffSynth-Studio)
- [ABot-World-Explorer-500h](https://huggingface.co/datasets/acvlab/ABot-World-Explorer-500h) |