{"id":45697251,"url":"https://github.com/glidea/tinygpt","last_synced_at":"2026-02-24T21:06:14.833Z","repository":{"id":325590531,"uuid":"1092825435","full_name":"glidea/tinygpt","owner":"glidea","description":"Learning LLM by doing","archived":false,"fork":false,"pushed_at":"2025-11-22T06:55:09.000Z","size":578,"stargazers_count":66,"open_issues_count":0,"forks_count":5,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-11-22T08:28:37.965Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/glidea.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2025-11-09T11:47:15.000Z","updated_at":"2025-11-22T06:55:12.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/glidea/tinygpt","commit_stats":null,"previous_names":["glidea/tinygpt"],"tags_count":null,"template":false,"template_full_name":null,"purl":"pkg:github/glidea/tinygpt","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/glidea%2Ftinygpt","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/glidea%2Ftinygpt/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/glidea%2Ftinygpt/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/glidea%2Ftinygpt/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/glidea","download_url":"https://codeload.github.com/glidea/tinygpt/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/glidea%2Ftinygpt/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":29800988,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-02-24T21:02:39.706Z","status":"ssl_error","status_checked_at":"2026-02-24T21:02:21.834Z","response_time":75,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2026-02-24T21:06:14.362Z","updated_at":"2026-02-24T21:06:14.826Z","avatar_url":"https://github.com/glidea.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"TinyGPT 旨在帮助非 AI 领域的开发者轻松理解大语言模型的核心原理\n\n---\n\n## ✨ 特性\n\n*   **完整训练流程**: 涵盖从 **预训练、SFT 到 DPO**\n*   **低门槛**: 无需云端 GPU，同时兼容 Mac M 芯片\n*   **为学习而生**:\n      * 内置 **[@teacher AI](/teacher.md)**，引导式教学\n      * 不追求性能和效果，仅使用经典算法做入门实现\n      * 有类型注释，懂的都懂 🤷🏻‍♀️...\n\n\n## 🚀 开始吧！\n\n\u003e 每个章节相互独立，可任意开始\n\n也可直接让老师带你，比如：\n\n```bash\n# 在 Cursor，Claude Code 或任何带 Bash Tool 的环境中：\n@teacher 带我预训练\n```\n\n\u003cimg src=\"images/preview-guide.png\" width=\"400\"\u003e\n\n\n*   [预训练](/a_pretrain/README.md): 手搓 10M 的超小模型（比 Qwen3-0.6B 还要小 60 倍）\n*   [SFT](/b_sft/README.md) (WIP): Qwen3-0.6B 版加法器\n*   [DPO](/c_dpo/README.md) (WIP): 反向安全对齐，Qwen3-0.6B 越狱破限\n\n\n## 🙏 鸣谢 \u0026 拓展学习推荐\n\n\u003e 没看以下资料之前我也是门外汉一枚，成功不一定能复制，但学习一定可以！\n\n* [Minimind](https://github.com/jingyaogong/minimind): 学习参考了很多，感谢 jingyaogong 大佬。推荐作为进阶学习项目\n* [从零构建大模型](https://book.douban.com/subject/37305124/): 豆瓣 9.3 分，对初学者非常友好\n* [王木头学科学](https://www.bilibili.com/video/BV1XH4y1T76e/?vd_source=4a37854f1727b85c1376f579e932bde9): 如果想理解 Why，强烈推荐\n\n\n---\n\n\u003ctable\u003e\n  \u003ctr\u003e\n    \u003ctd align=\"center\"\u003e\n      \u003cimg src=\"https://github.com/glidea/zenfeed/blob/main/docs/images/wechat.png?raw=true\" alt=\"Wechat QR Code\" width=\"300\"\u003e\n      \u003cbr\u003e\n      \u003cstrong\u003eAI 学习交流社群\u003c/strong\u003e\n    \u003c/td\u003e\n    \u003ctd align=\"center\"\u003e\n      \u003cimg src=\"https://github.com/glidea/banana-prompt-quicker/blob/main/images/glidea.png?raw=true\" width=\"250\"\u003e\n      \u003cbr\u003e\n      \u003cstrong\u003e\u003ca href=\"https://glidea.zenfeed.xyz/\"\u003e我的其它项目\u003c/a\u003e\u003c/strong\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n  \u003ctr\u003e\n    \u003ctd align=\"center\" colspan=\"2\"\u003e\n      \u003cimg src=\"https://github.com/glidea/banana-prompt-quicker/blob/main/images/readnote.png?raw=true\" width=\"400\"\u003e\n      \u003cbr\u003e\n      \u003cstrong\u003e\u003ca href=\"https://www.xiaohongshu.com/user/profile/5f7dc54d0000000001004afb\"\u003e📕 小红书账号 - 持续分享 AI 原创\u003c/a\u003e\u003c/strong\u003e\n    \u003c/td\u003e\n  \u003c/tr\u003e\n\u003c/table\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fglidea%2Ftinygpt","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fglidea%2Ftinygpt","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fglidea%2Ftinygpt/lists"}