{"id":30442474,"url":"https://github.com/voyager466920/analog_gpt","last_synced_at":"2025-08-23T08:10:50.575Z","repository":{"id":298833658,"uuid":"1001271734","full_name":"Voyager466920/Analog_GPT","owner":"Voyager466920","description":"💫 AnalogGPT is a Large Language Model that runs fully on the paper. No GPU, no computer required. Just a pen, paper and patience required. I added a Youtube to demonstrate how it works!","archived":false,"fork":false,"pushed_at":"2025-06-26T12:50:19.000Z","size":11128,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"main","last_synced_at":"2025-07-01T04:29:45.003Z","etag":null,"topics":["ai","analog","analoggpt","artificial","gpt","inteligence","paper","transformer-architecture"],"latest_commit_sha":null,"homepage":"https://www.youtube.com/watch?v=6gqxgyYj3Hs\u0026feature=youtu.be","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Voyager466920.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-06-13T05:30:01.000Z","updated_at":"2025-06-29T03:40:39.000Z","dependencies_parsed_at":"2025-07-01T04:39:48.400Z","dependency_job_id":null,"html_url":"https://github.com/Voyager466920/Analog_GPT","commit_stats":null,"previous_names":["dutchvandaline/analog_gpt","voyager466920/analog_gpt"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Voyager466920/Analog_GPT","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Voyager466920%2FAnalog_GPT","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Voyager466920%2FAnalog_GPT/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Voyager466920%2FAnalog_GPT/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Voyager466920%2FAnalog_GPT/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Voyager466920","download_url":"https://codeload.github.com/Voyager466920/Analog_GPT/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Voyager466920%2FAnalog_GPT/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":271746033,"owners_count":24813534,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-23T02:00:09.327Z","response_time":69,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","analog","analoggpt","artificial","gpt","inteligence","paper","transformer-architecture"],"created_at":"2025-08-23T08:10:48.741Z","updated_at":"2025-08-23T08:10:50.567Z","avatar_url":"https://github.com/Voyager466920.png","language":"Python","funding_links":["https://www.buymeacoffee.com/PequodApp"],"categories":[],"sub_categories":[],"readme":"\u003ca id=\"readme-top\"\u003e\u003c/a\u003e\n\u003cdiv align=\"center\"\u003e\n\n[![Contributors][contributors-shield]][contributors-url]\n[![Forks][forks-shield]][forks-url]\n[![Stargazers][stars-shield]][stars-url]\n[![Issues][issues-shield]][issues-url]\n\n\u003c/div\u003e\n\n\n\u003c!-- PROJECT LOGO --\u003e\n  \u003ch3 align=\"center\"\u003eAnalogGPT\u003c/h3\u003e\n\n  \u003cp align=\"center\"\u003e\n    AnalogGPT is a Large Language Model that runs fully on the paper.\n    \u003cbr /\u003e\n    \u003ca href=\"\"\u003e \u003c!--앱스토어 url href=\"여기에\" 부분에 추가--\u003e\n    \u003c/a\u003e\n    \u003cbr /\u003e\n    \u003ca href=\"https://github.com/DutchVandaline/Analog_GPT\"\u003e\u003cstrong\u003eExplore the docs »\u003c/strong\u003e\u003c/a\u003e\n    \u003cbr /\u003e\n    \u003cbr /\u003e\n    \u003ca href=\"https://github.com/DutchVandaline/Analog_GPT\"\u003eView Demo\u003c/a\u003e\n    ·\n    \u003ca href=\"https://github.com/DutchVandaline/Analog_GPT/issues/new?labels=bug\u0026template=bug-report---.md\"\u003eReport Bug\u003c/a\u003e\n    ·\n    \u003ca href=\"https://github.com/DutchVandaline/Analog_GPT/issues/new?labels=enhancement\u0026template=feature-request---.md\"\u003eRequest Feature\u003c/a\u003e\n  \u003c/p\u003e\n\u003c/div\u003e\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://youtu.be/6gqxgyYj3Hs\" target=\"_blank\"\u003e\n    \u003cimg src=\"http://img.youtube.com/vi/6gqxgyYj3Hs/0.jpg\" width=\"600\"\u003e\n  \u003c/a\u003e\n  \u003cbr\u003e\n  \u003csub\u003eThis is the Youtube Video about AnalogGPT!\u003c/sub\u003e\n\u003c/p\u003e\n\n\n\u003cbr\u003e\n\u003c!-- TABLE OF CONTENTS --\u003e\n\u003cdetails\u003e\n  \u003csummary\u003eTable of Contents\u003c/summary\u003e\n  \u003col\u003e\n    \u003cli\u003e\n      \u003ca href=\"#about-the-project\"\u003eAbout The Project\u003c/a\u003e\n      \u003cul\u003e\n        \u003cli\u003e\u003ca href=\"#built-with\"\u003eBuilt With\u003c/a\u003e\u003c/li\u003e\n      \u003c/ul\u003e\n    \u003c/li\u003e\n    \u003cli\u003e\n      \u003ca href=\"#getting-started\"\u003eGetting Started\u003c/a\u003e\n      \u003cul\u003e\n        \u003cli\u003e\u003ca href=\"#prerequisites\"\u003ePrerequisites\u003c/a\u003e\u003c/li\u003e\n        \u003cli\u003e\u003ca href=\"#installation\"\u003eInstallation\u003c/a\u003e\u003c/li\u003e\n      \u003c/ul\u003e\n    \u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#contributing\"\u003eContributing\u003c/a\u003e\u003c/li\u003e\n    \u003cli\u003e\u003ca href=\"#contact\"\u003eContact\u003c/a\u003e\u003c/li\u003e\n  \u003c/ol\u003e\n\u003c/details\u003e\n\n\n\n\u003c!-- ABOUT THE PROJECT --\u003e\n## About The Project\n\u003c!-- 이미지 삽입 ![Pequod](https://github.com/user-attachments/assets/8bf45ee3-1001-459a-8db2-f32632e20dfc)--\u003e\n🚨 To download the PDF file, please hit a star on this repo, then click `AnalogGPT.pdf`, press `download raw file` button on the upper right corner.\n\n🥫 These days, a lot of companies and even countries are trying to get their hands on GPUs. Modern AI needs a ton of GPU power for calculation. But imagine this — what if there’s a large language model that doesn’t need a GPU at all? Or even run *without* a computer?\nI created **AnalogGPT** which is a fully paper-based version of GPT built from scratch.\u003cbr/\u003e\n\n🚀 Via **AnalogGPT** you can fully understand how Generative Pretrained Transformer works by calculating with your bare hands. You are becoming a GPU that calculates these numbers. As the model size is 15K, it's representation capacity is limited. I'll notify the hyper parameters below. Feel free to modify my code and test various things.\n\n\u003cp align=\"right\"\u003e(\u003ca href=\"#readme-top\"\u003eback to top\u003c/a\u003e)\u003c/p\u003e\n\n## Key Features\n🖥️ **[No GPU]** You don't need a GPU or even computer to run this model.\u003cbr/\u003e\n💡 **[Learn how Transformer works]** With calculating with your bare hands, you can understand what attention is.\u003cbr/\u003e\n🔧 **[Next Token Prediction]** This is dedicated for next token prediction task.\u003cbr/\u003e\n\n\n\u003c!--\n\u003cimg src=\"https://github.com/user-attachments/assets/7f15a1f3-65ca-4ae7-912a-4b3ccd8533bd\"  width=\"270\" height=\"270\"/\u003e\n\u003cimg src=\"https://github.com/user-attachments/assets/e8c4e3cb-f104-434a-aa85-7c6a830e7427\"  width=\"270\" height=\"270\"/\u003e\n\u003cimg src=\"https://github.com/user-attachments/assets/ee63f9bc-6e4f-4300-8772-ca883150ca8f\"  width=\"270\" height=\"270\"/\u003e\n--\u003e\n### Built With\n\n* [![Pytorch][Pytorch]][Pytorch-url]\n* [![Pycharm][Pycharm]][Pycharm-url]\n  \n\n\u003cp align=\"right\"\u003e(\u003ca href=\"#readme-top\"\u003eback to top\u003c/a\u003e)\u003c/p\u003e\n\n\n\n\u003c!-- GETTING STARTED --\u003e\n\u003c!--\n이 부분 주석 제거\n## Getting Started\n📱 You can download BottleCamp at the AppStore. Press the following Image!\n\u003cdiv style=\"text-align: center;\"\u003e\n    \u003ca href=\"https://apps.apple.com/kr/app/pequod/id6593668188?l=en-GB\"\u003e\n      \u003cimg src=\"https://github.com/user-attachments/assets/d1a69119-6219-409b-b302-9ce24308aeb0\"  width=\"350\" height=\"350\"\n            style=\"height: auto; margin-left: 8px; margin-right: 8px;\"/\u003e\n    \u003c/a\u003e\n\u003c/div\u003e\n--\u003e\n### Prerequisites\n\n💫 Before using, please hit star on this repo!\u003cbr\u003e\n📜 You can download the PDF from github\u003cbr\u003e\nIf you want to modify the code or train more, follow the following steps.\n### Installation\n\n1. Clone the repo\n   ```sh\n   git clone https://github.com/DutchVandaline/Analog_GPT.git\n   ```\n2. Excecute on PyCharm\n3. Use your code to modify the model.\n\n\u003cp align=\"right\"\u003e(\u003ca href=\"#readme-top\"\u003eback to top\u003c/a\u003e)\u003c/p\u003e\n\n\n\u003c!-- CONTRIBUTING --\u003e\n## Contributing\nIf you liked this project, please buy me a coffee! It helps me do creative stuffs. \u003cbr/\u003e \u003cbr/\u003e\n\u003ca href=\"https://www.buymeacoffee.com/PequodApp\" target=\"_blank\"\u003e\n  \u003cimg src=\"https://cdn.buymeacoffee.com/buttons/v2/default-yellow.png\" alt=\"Buy Me A Coffee\" style=\"height: 60px; width: 217px;\" \u003e\n\u003c/a\u003e\n\nContributions are what make the open source community such an amazing place to learn, inspire, and create. Any contributions you make are **greatly appreciated**.\n\nIf you have a suggestion that would make this better, please fork the repo and create a pull request. You can also simply open an issue with the tag \"enhancement\".\nDon't forget to give the project a star! Thanks again!\n\n1. Fork the Project\n2. Create your Feature Branch (`git checkout -b feature/AmazingFeature`)\n3. Commit your Changes (`git commit -m 'Add some AmazingFeature'`)\n4. Push to the Branch (`git push origin feature/AmazingFeature`)\n5. Open a Pull Request\n\n\u003cp align=\"right\"\u003e(\u003ca href=\"#readme-top\"\u003eback to top\u003c/a\u003e)\u003c/p\u003e\n\n\u003c!-- CONTACT --\u003e\n## Contact\n\nDutch Vanaline - developerha0013@gmail.com\n\nProject Link: [https://github.com/DutchVandaline?tab=repositories](https://github.com/DutchVandaline?tab=repositories)\n\n\u003cp align=\"right\"\u003e(\u003ca href=\"#readme-top\"\u003eback to top\u003c/a\u003e)\u003c/p\u003e\n\n\n\n\n\n\n\u003c!-- MARKDOWN LINKS \u0026 IMAGES --\u003e\n\u003c!-- https://www.markdownguide.org/basic-syntax/#reference-style-links --\u003e\n[contributors-shield]: https://img.shields.io/github/contributors/DutchVandaline/Analog_GPT.svg?style=for-the-badge\n[contributors-url]: https://github.com/DutchVandaline/Wait_However/graphs/contributors\n[forks-shield]: https://img.shields.io/github/forks/DutchVandaline/Analog_GPT.svg?style=for-the-badge\n[forks-url]: https://github.com/DutchVandaline/Wait_However/network/members\n[stars-shield]: https://img.shields.io/github/stars/DutchVandaline/Analog_GPT.svg?style=for-the-badge\n[stars-url]: https://github.com/DutchVandaline/Wait_However/stargazers\n[issues-shield]: https://img.shields.io/github/issues/DutchVandaline/Analog_GPT.svg?style=for-the-badge\n[issues-url]: https://github.com/DutchVandaline/Wait_However/issues\n\n[Pytorch]: https://img.shields.io/badge/PyTorch-EE4C2C?style=for-the-badge\u0026logo=pytorch\u0026logoColor=white\n[Pytorch-url]: https://pytorch.org/\n[Pycharm]: https://img.shields.io/badge/PyCharm-000000?style=for-the-badge\u0026logo=pycharm\u0026logoColor=white\n[Pycharm-url]: https://www.jetbrains.com/pycharm/\n\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvoyager466920%2Fanalog_gpt","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fvoyager466920%2Fanalog_gpt","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvoyager466920%2Fanalog_gpt/lists"}