{"id":51599929,"url":"https://github.com/datawhalechina/learn-world-model","last_synced_at":"2026-07-11T21:02:10.548Z","repository":{"id":359654442,"uuid":"1238452812","full_name":"datawhalechina/learn-world-model","owner":"datawhalechina","description":"Learn everything about world model","archived":false,"fork":false,"pushed_at":"2026-07-09T00:02:35.000Z","size":20429,"stargazers_count":304,"open_issues_count":0,"forks_count":21,"subscribers_count":2,"default_branch":"main","last_synced_at":"2026-07-09T02:05:10.044Z","etag":null,"topics":["self-teaching","tutorial","world-model"],"latest_commit_sha":null,"homepage":"https://datawhalechina.github.io/learn-world-model/","language":"TypeScript","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/datawhalechina.png","metadata":{"files":{"readme":"README-CN.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2026-05-14T06:15:34.000Z","updated_at":"2026-07-09T00:02:39.000Z","dependencies_parsed_at":null,"dependency_job_id":"f0bfdbb5-b692-4764-8c7c-72e4e4c22c6e","html_url":"https://github.com/datawhalechina/learn-world-model","commit_stats":null,"previous_names":["zhimin-z/learn-world-model","datawhalechina/learn-world-model"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/datawhalechina/learn-world-model","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datawhalechina%2Flearn-world-model","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datawhalechina%2Flearn-world-model/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datawhalechina%2Flearn-world-model/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datawhalechina%2Flearn-world-model/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/datawhalechina","download_url":"https://codeload.github.com/datawhalechina/learn-world-model/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/datawhalechina%2Flearn-world-model/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":35375153,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-07-11T02:00:05.354Z","response_time":104,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["self-teaching","tutorial","world-model"],"created_at":"2026-07-11T21:02:05.931Z","updated_at":"2026-07-11T21:02:10.539Z","avatar_url":"https://github.com/datawhalechina.png","language":"TypeScript","funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n  \u003cimg src=\"./docs/public/preface.png\" width=\"100%\" alt=\"Learn World Models Banner\"\u003e\n  \u003cbr\u003e\n\n[English](./README.md) · [中文](./README-CN.md)\n\n# Learn World Models（⚠️ Alpha 内测版）\n\n[![在线阅读](https://img.shields.io/badge/在线阅读-blue?style=for-the-badge\u0026logo=github)](https://datawhalechina.github.io/learn-world-model)\n[![收藏数](https://img.shields.io/github/stars/datawhalechina/learn-world-model?style=for-the-badge\u0026logo=github\u0026label=收藏数)](https://github.com/datawhalechina/learn-world-model/stargazers)\n[![许可证: MIT](https://img.shields.io/badge/许可证-MIT-yellow?style=for-the-badge)](https://github.com/datawhalechina/learn-world-model/blob/main/LICENSE)\n\u003e **通过动手构建掌握世界模型：从潜在动力学的直觉，到可运行的仿真、规划与评估系统。**\n\n\u003c/div\u003e\n\n\u003e [!CAUTION]\n\u003e ⚠️ **Alpha 内测版本**：此为早期构建版本，内容仍在持续补全与调整中，部分章节、示例或表述可能继续变化。欢迎通过 Issue 反馈问题或建议。\n\n---\n\n## ✨ 界面速览\n\n### 🏠 课程主页\n\u003e 清晰的学习路径，讲义与项目分区导航。\n\n![课程主页](./docs/public/screenshots/readme/en-home.png)\n\n### 📖 讲义页面\n\u003e 概念优先的讲解风格，配合 mermaid 流程图与面向深度学习读者的背景知识框。\n\n![讲义页面](./docs/public/screenshots/readme/en-lecture-01.png)\n\n### 🗂️ 架构深度解析\n\u003e 七大架构族、三种规划机制、逐维对比表格。\n\n![架构讲义](./docs/public/screenshots/readme/en-lecture-03.png)\n\n---\n\n## 本课程涵盖什么\n\n五讲 + 六个项目，从世界模型的直觉出发，逐步完成训练、评估与因果探查这一整套现代世界模型流水线。\n\n| # | 类型 | 标题 | 核心内容 |\n|---|------|------|---------|\n| L01 | 讲义 | 内部仿真与历史背景 | Craik 的心智模型、预测编码、世界模型演化的四个时代 |\n| L02 | 讲义 | 观测编码与潜在动力学 | VAE、CNN 编码器、ELBO，GRU → MDN-RNN → RSSM |\n| L03 | 讲义 | 架构模式、学习范式与规划 | 七大架构族、CEM-MPC、潜在 Actor-Critic、TD-MPC |\n| L04 | 讲义 | 按模型划分的评估指标 | FID、奖励相关性、一致性损失、PSNR、时程漂移 |\n| L05 | 讲义 | 前沿争论 | 语言 vs 物理 grounding、Bitter Lesson、AGI 作为研究目标 |\n| P01 | 项目 | 训练 VAE 编码器 | 小型 CNN VAE 处理 64×64 像素观测；ELBO 损失曲线；潜在维度滑块可视化 |\n| P02 | 项目 | 构建 RSSM 动力学模型 | GRU、MDN-RNN、RSSM 三者对比；先验与后验轨迹对比图 |\n| P03 | 项目 | 训练 Dreamer 智能体 | 完整训练循环：编码器 + RSSM + 潜在 Actor-Critic，在小型像素环境上训练 |\n| P04 | 项目 | 替换动力学骨干网络 | 将 RSSM 替换为小型因果 Transformer（STORM 风格）；架构对比分析 |\n| P05 | 项目 | 世界模型评估仪表盘 | 两个模型指标并排展示：FID、奖励相关性、PSNR、潜在漂移曲线 |\n| P06 | 项目 | 反事实的动作条件世界模型 | 干预与反事实 rollout、逆动力学正则化、动作影响度指标 |\n\n---\n\n## 课程路线图\n\n```mermaid\nflowchart TD\n    L01[\"L01 历史与直觉\"] --\u003e L02A\n    L02A[\"L02 Part A：VAE 编码器\"] --\u003e P01[\"P01 训练 VAE，可视化潜在空间\"]\n    L02A --\u003e L02B[\"L02 Part B：GRU 到 RSSM\"]\n    L02B --\u003e P02[\"P02 构建 RSSM，对比先验与后验\"]\n    L02B --\u003e L03A[\"L03 Part A：架构模式\"]\n    L03A --\u003e L03B[\"L03 Part B：规划机制\"]\n    L03B --\u003e P03[\"P03 训练 Dreamer 智能体\"]\n    P02 --\u003e P04[\"P04 替换 RSSM 为 Transformer 骨干\"]\n    L03A --\u003e P04\n    P03 \u0026 P04 --\u003e L04[\"L04 评估指标体系\"]\n    L04 --\u003e P05[\"P05 评估仪表盘\"]\n    P03 \u0026 P04 --\u003e P06[\"P06 反事实动作条件世界模型\"]\n    P05 --\u003e L05[\"L05 前沿争论\"]\n    P06 --\u003e L05\n```\n\n推荐学习顺序：L01、L02、P01、P02、L03、P03、P04、L04、P05、P06、L05\n\n不需要把所有理论读完再动手。先构建，带着问题回来看下一讲，效果更好。\n\n---\n\n## 快速开始\n\n```sh\nnpm install\nnpm run docs:dev        # 开发服务器（热更新）\nnpm run docs:build      # 生产构建\nnpm run docs:preview    # 预览构建结果\n```\n\n构建之后刷新 README 截图：\n\n```sh\nnpm run docs:build\nnpm run screenshots:readme\n```\n\n---\n\n## 仓库结构\n\n```\nlearn-world-model/\n├── docs/                                  # VitePress 文档站\n│   ├── .vitepress/config.mts             # 导航与侧边栏（EN + ZH）\n│   ├── en/lectures/                       # 5 个英文讲义页\n│   ├── zh/lectures/                       # 5 个中文讲义页\n│   ├── en/projects/                       # 6 个英文项目页\n│   └── zh/projects/                       # 6 个中文项目页\n├── external/world-model-tutorial/         # 项目引用的 PyTorch 源码\n│   └── references.md                      # 四时代历史与架构综述\n├── scripts/                               # 构建工具（截图、PDF）\n└── package.json\n```\n\n---\n\n## 交流社群\n\n扫描二维码加入微信交流群：\n\n\u003cdiv align=\"center\"\u003e\n  \u003cimg src=\"./docs/public/wechat-group-qr-code.png\" width=\"300\" alt=\"微信交流群二维码\"\u003e\n\u003c/div\u003e\n\n---\n\n## 参与贡献\n\n欢迎提交 Pull Request。在提交之前，请阅读 [CLAUDE.md](./CLAUDE.md) 中适用于所有讲义和项目文件的写作规范（禁用破折号、禁止线性 mermaid 图、禁止箭头链式行文、中英文同步更新等）。不符合规范的内容需修改后方可合并。\n\n---\n\n## 贡献者名单（教程部分）\n\n| 姓名 | 职责 | 简介 | GitHub |\n| ---- | ---- | ---- | ------ |\n| 赵志民 | 项目负责人 | 皇后大学 | [@zhimin-z](https://github.com/zhimin-z) |\n| 王琦 | 项目负责人 | 上海交通大学 | [@qiwang067](https://github.com/qiwang067) |\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdatawhalechina%2Flearn-world-model","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdatawhalechina%2Flearn-world-model","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdatawhalechina%2Flearn-world-model/lists"}