{"id":15063864,"url":"https://github.com/tensor-fusion/gpt-haskell","last_synced_at":"2025-07-03T05:01:55.487Z","repository":{"id":241057005,"uuid":"804192025","full_name":"tensor-fusion/GPT-Haskell","owner":"tensor-fusion","description":"A pure Haskell implementation of a decoder-only transformer (GPT)","archived":false,"fork":false,"pushed_at":"2024-06-22T09:59:05.000Z","size":23,"stargazers_count":19,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-04-10T11:40:59.906Z","etag":null,"topics":["deep-learning","gpt","gpt-2","haskell","large-language-models","transformer"],"latest_commit_sha":null,"homepage":"","language":"Haskell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/tensor-fusion.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-05-22T06:07:31.000Z","updated_at":"2025-02-16T05:01:26.000Z","dependencies_parsed_at":"2024-05-22T07:29:12.374Z","dependency_job_id":"120a8956-3c63-4916-85f0-ffe42dcca400","html_url":"https://github.com/tensor-fusion/GPT-Haskell","commit_stats":null,"previous_names":["milton-l/gpt-haskell","tensor-fusion/gpt-haskell"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/tensor-fusion/GPT-Haskell","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tensor-fusion%2FGPT-Haskell","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tensor-fusion%2FGPT-Haskell/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tensor-fusion%2FGPT-Haskell/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tensor-fusion%2FGPT-Haskell/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/tensor-fusion","download_url":"https://codeload.github.com/tensor-fusion/GPT-Haskell/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tensor-fusion%2FGPT-Haskell/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":263264642,"owners_count":23439247,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["deep-learning","gpt","gpt-2","haskell","large-language-models","transformer"],"created_at":"2024-09-25T00:08:10.184Z","updated_at":"2025-07-03T05:01:55.461Z","avatar_url":"https://github.com/tensor-fusion.png","language":"Haskell","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Haskell GPT\n\nSuper minimal implementation of [GPT-2](https://d4mucfpksywv.cloudfront.net/better-language-models/language_models_are_unsupervised_multitask_learners.pdf) in Haskell.\n\nHighly inspired by:\n- [openai/gpt-2](https://github.com/openai/gpt-2).\n- [karpathy/minGPT](https://github.com/karpathy/mingpt).\n- [picoGPT](https://github.com/jaymody/picoGPT).\n\nStructure is similar to [picoGPT](https://github.com/jaymody/picoGPT). Code contains:\n- Translation of OpenAI's BPE Tokenizer\n- Decoder-only transformer\n- GPT-2 generation\n\nYou can run tests with\n\n```\ncabal build\ncabal test\n```\n\n(You'll first need to download GPT-2 weights, tokenizer, and hyperparams into `/models`)\n\n## TODO\n- [ ] Merge changes containing top-k sampling and tensorflow inference for actual text generation\n- [ ] Nix deps management\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftensor-fusion%2Fgpt-haskell","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftensor-fusion%2Fgpt-haskell","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftensor-fusion%2Fgpt-haskell/lists"}