{"id":47422,"url":"https://github.com/bdqnghi/awesome-ai4code","name":"awesome-ai4code","description":"A collection of recent papers, benchmarks and datasets of AI4Code domain.","projects_count":79,"last_synced_at":"2026-08-03T04:00:23.176Z","repository":{"id":37320712,"uuid":"403027290","full_name":"bdqnghi/awesome-ai4code","owner":"bdqnghi","description":"A collection of recent papers, benchmarks and datasets of AI4Code domain.","archived":false,"fork":false,"pushed_at":"2024-04-23T11:56:35.000Z","size":79,"stargazers_count":61,"open_issues_count":0,"forks_count":6,"subscribers_count":1,"default_branch":"main","last_synced_at":"2026-07-15T00:03:40.509Z","etag":null,"topics":["code-representation","machine-learning","program-analysis"],"latest_commit_sha":null,"homepage":"","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/bdqnghi.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2021-09-04T10:27:37.000Z","updated_at":"2026-07-04T19:13:00.000Z","dependencies_parsed_at":"2024-01-17T02:14:36.244Z","dependency_job_id":"35734b36-1e9b-45cf-945e-10f3c7a864a7","html_url":"https://github.com/bdqnghi/awesome-ai4code","commit_stats":null,"previous_names":["bdqnghi/awesome-ai4code","bdqnghi/awesome-ai4code-papers"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/bdqnghi/awesome-ai4code","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bdqnghi%2Fawesome-ai4code","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bdqnghi%2Fawesome-ai4code/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bdqnghi%2Fawesome-ai4code/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bdqnghi%2Fawesome-ai4code/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/bdqnghi","download_url":"https://codeload.github.com/bdqnghi/awesome-ai4code/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/bdqnghi%2Fawesome-ai4code/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":36216799,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-07-20T02:08:10.276Z","status":"online","status_checked_at":"2026-08-03T02:00:06.975Z","response_time":56,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"created_at":"2024-01-14T11:15:14.707Z","updated_at":"2026-08-03T04:00:23.176Z","primary_language":null,"list_of_lists":false,"displayable":true,"categories":["Tools/Products","Academic","Pretrained CodeLLMs","Talks and Tutorials","Talk and Tutorial","Dataset and Benchmark"],"sub_categories":["AI code completion tools","Conferences","More General Coding Assistants","Papers (This list is a bit outdated, need to update)","ChatGPT in your editor","LLM-powered natural language compilers"],"readme":"# A Collection of Tools, Papers and Recent Trendings in AI for Software (AI4SE, AI4Code).\n\nA niche collection of AI4Code papers and other resources (dataset, tutorial, etc.). There are also other collections that cover a wider range of content about AI4Code, such as:\n- https://ml4code.github.io/\n- https://github.com/src-d/awesome-machine-learning-on-source-code (Due to the lack of maintainers, this collection may be obsolete).\n\n## Tools/Products\n\nA list of of AI coding tools (assistants, completion, refactoring, etc.).\n\n### AI code completion tools\n\n- [GitHub Copilot](https://github.com/features/copilot)\n- [CodiumAI](https://www.codium.ai/)\n- [Refact.ai](https://refact.ai/)\n- [FauxPilot](https://github.com/fauxpilot/fauxpilot)\n- [CodeComplete](https://codecomplete.ai)\n- [Continue](https://continue.dev/)\n- [Amazon CodeWhisperer](https://aws.amazon.com/codewhisperer/)\n- [Obsidian copilot auto completion](https://github.com/j0rd1smit/obsidian-copilot-auto-completion)\n- [JetBrains AI](https://www.jetbrains.com/ai/)\n  [Codeium](https://www.codeium.com/)\n- [Tabnine](https://www.tabnine.com/)\n- [Replit Ghostwriter](https://replit.com/site/ghostwriter)\n- [GitLab Code Suggestions](https://docs.gitlab.com/ee/user/project/repository/code_suggestions.html)\n- [Sourcegraph Cody](https://about.sourcegraph.com/cody)\n\n### More General Coding Assistants\n\n- [Replit Ghostwriter](https://replit.com/site/ghostwriter)\n- [Cosine](https://ai.cosine.sh/)\n- [Autodoc](https://github.com/context-labs/autodoc)\n- [Sourcegraph Cody](https://about.sourcegraph.com/cody)\n- [ZZZ Code AI](https://zzzcode.ai/)\n- [StackSpot AI](https://ai.stackspot.com/)\n- [Pixee](https://pixee.ai)\n- [16x Prompt](https://prompt.16x.engineer/)\n- [Cursor](https://www.cursor.sh/) (editor)\n- [Wizi](https://github.com/wizi-ai/code-search)\n- [Phind](https://www.phind.com/)\n- [Safurai](https://www.safurai.com/)\n- [CensusGPT](https://censusgpt.com/)\n\n### ChatGPT in your editor\n- [CodeGPT.nvim](https://github.com/dpayne/CodeGPT.nvim)\n- [org-ai](https://github.com/rksm/org-ai)\n- [Genie AI - ChatGPT - VS Code](https://github.com/ai-genie/chatgpt-vscode)\n\n### LLM-powered natural language compilers \n- [Parsel 🐍](https://github.com/ezelikman/parsel)\n\n\n## Academic\n### Conferences\n##### Software Enginnering/Programming Languages\nThe emphasis is on combining program analysis and deep learning to solve novel software engineering/programming languages task. In most cases, strong empirical results are required. Typically, new datasets are usually curated.\n- [Interational Conference on Software Engineering (ICSE)](http://www.icse-conferences.org/)\n- [Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE)](https://www.esec-fse.org/)\n- [Automated Software Engineering (ASE)](https://conf.researchr.org/home/ase-2021).\n- [Programming Language Design and Implementation (PLDI)](https://conf.researchr.org/series/pldi)\n##### Machine Learning/AI\nThe emphasis is on desigining novel neural network architectures to process code. Typically, new datasets are usually curated.\n- [Association for the Advancement of Artificial Intelligence (AAAI)](https://aaai.org/Conferences/conferences.php)\n- [Interational Conference in Machine Learning (ICML)](https://icml.cc/)\n- [International Conference on Neural Information Processing Systems(NeurIPS)](https://nips.cc/)\n- [International Conference on Learning Representation (ICLR)](https://iclr.cc/)\n\n##### Natural Language Processing\nThe emphasis is on applying NLP techniques for code, and the evaluation is primarily on running the models on known benchmark datasets; unique tasks are rarely introduced.\n- [Empirical Methods in Natural Language Processing (EMNLP)](https://aclanthology.org/venues/emnlp/)\n- [North American Chapter of the Association for Computational Linguistics (NAACL)](https://aclanthology.org/venues/naacl/)\n- [Annual Meeting of the Association for Computational Linguistics (ACL)](https://2021.aclweb.org/)\n\n### Papers (This list is a bit outdated, need to update)\n#### Evaluate CodeLLMs\n- [Large Language Models of Code Fail at Completing Code with Potential Bugs](https://arxiv.org/pdf/2306.03438.pdf) - Tuan Dinh, Jinman Zhao, Samson Tan, Renato Negrinho, Leonard Lausen, Sheng Zha, George Karypis.\n- [Large Language Models Meet NL2Code: A Survey](https://arxiv.org/pdf/2212.09420.pdf) - Daoguang Zan, Bei Chen, Fengji Zhang, Dianjie Lu, Bingchao Wu, Bei Guan, Yongji Wang, Jian-Guang Lou (EMNLP 2023)\n\n#### Techniques for Code Generation\n- [SKCODER: A Sketch-based Approach for Automatic Code Generation)(https://arxiv.org/pdf/2302.06144.pdf) - Jia Allen Li, Yongmin Li, Ge Li, Zhi Jin, Yiyang Hao, Xing Hu\n\n#### Repo-Level CodeLLMs\n- [RepoFusion: Training Code Models to Understand Your Repository](https://arxiv.org/pdf/2306.10998.pdf) - Disha Shrivastava, Denis Kocetkov, Harm de Vries, Dzmitry Bahdanau, Torsten Scholak\n\n#### Benchmarking CodeLLMs\n- [XCODEEVAL: An Execution-based Large Scale Multilingual Multitask Benchmark for Code Understanding, Generation, Translation and Retrieval](https://arxiv.org/pdf/2303.03004v3.pdf) - Mohammad Abdullah Matin Khan, M Saiful Bari, Xuan Long Do, Weishi Wang, Md Rizwan Parvez, Shafiq Joty\n- \n## Pretrained CodeLLMs\n- [CodeT5: Identifier-aware Unified Pre-trained Encoder-Decoder Models for Code Understanding and Generation](https://arxiv.org/pdf/2109.00859.pdf) - Yue Wang, Weishi Wang, Shafiq Joty, Steven C.H. Hoi (EMNLP 2021) (***CodeT5***).  \n- [CodeBERT:A Pre-Trained Model for Programming and Natural Language](https://arxiv.org/pdf/2002.08155.pdf) - Zhangyin Feng, Daya Guo, Duyu Tang, Nan Duan, Xiaocheng Feng, Ming Gong, Linjun Shou, Bing Qin, Ting Liu, Daxin Jiang, Ming Zhou (EMNLP 2020 Findings) (***CodeBERT***).\n- [Learning and Evaluating Contextual Embedding of Source Code](https://arxiv.org/abs/2001.00059) - Aditya Kanade, Petros Maniatis, Gogul Balakrishnan, Kensen Shi. (ICML 2020) (***CuBERT***).\n- [GraphCodeBERT: Pre-training Code Representations with Data Flow](https://arxiv.org/pdf/2009.08366.pdf) - Daya Guo, Shuo Ren, Shuai Lu, Zhangyin Feng, Duyu Tang, Shujie Liu, Long Zhou, Nan Duan, Alexey Svyatkovskiy, Shengyu Fu, Michele Tufano, Shao Kun Deng, Colin Clement, Dawn Drain, Neel Sundaresan, Jian Yin, Daxin Jiang, Ming Zhou (ICLR 2021) (***GraphCodeBERT***).\n- [InferCode: Self-Supervised Learning of Code Representations by Predicting Subtrees](https://bdqnghi.github.io/files/ICSE_2021.pdf) -Nghi D. Q. BUI, Yijun YU, Lingxiao JIANG (ICSE 2021) (***InferCode***).\n- [Self-Supervised Learning for Code Retrieval and Summarization through Semantic-Preserving Program Transformations](https://arxiv.org/pdf/2009.08366.pdf) - Nghi D. Q. BUI, Yijun YU, Lingxiao JIANG (SIGIR 2021) (***Corder***).\n- [Unsupervised Translation of Programming Languages](https://arxiv.org/pdf/2006.03511.pdf) - Marie-Anne Lachaux, Baptiste Roziere, Lowik Chanussot, Guillaume Lample (NeurIPS 2020) (***Transcoder***).\n- [Contrastive Code Representation Learning](https://arxiv.org/pdf/2007.04973.pdf) - \nParas Jain, Ajay Jain, Tianjun Zhang, Pieter Abbeel, Joseph E. Gonzalez, Ion Stoica (arxiv 2020) (***ContraCode***).\n- [CoTexT: Multi-task Learning with Code-Text Transformer](https://arxiv.org/abs/2105.08645), Long Phan, Hieu Tran, Daniel Le, Hieu Nguyen, James Anibal, Alec Peltekian, Yanfang Ye (arXiv 2021) (***CoTexT***)\n- [How could Neural Networks understand Programs?](https://arxiv.org/pdf/2105.04297.pdf), Dinglan Peng, Shuxin Zheng, Yatao Li, Guolin Ke, Di He, Tie-Yan Liu (ICML 2021) (***OSCAR***)\n- [Unified Pre-training for Program Understanding and Generation](https://aclanthology.org/2021.naacl-main.211.pdf), Wasi Uddin Ahmad, Saikat Chakraborty, Baishakhi Ray, Kai-Wei Chang (NAACL 2021) (***PLBART***).\n- [Exploring Software Naturalness through Neural Language Models](https://arxiv.org/abs/2006.12641), Luca Buratti, Saurabh Pujar, Mihaela Bornea, Scott McCarley, Yunhui Zheng, Gaetano Rossiello, Alessandro Morari, Jim Laredo, Veronika Thost, Yufan Zhuang, Giacomo Domeniconi, (arXiv 2020) (***C-BERT***).\n- [PYMT5: multi-mode translation of natural language and PYTHON code with transformers](https://arxiv.org/abs/2010.03150), Colin B. Clement, Dawn Drain, Jonathan Timcheck, Alexey Svyatkovskiy, Neel Sundaresan (EMNLP 2020) (***PYMT5***).\n- [DOBF: A Deobfuscation Pre-Training Objective for Programming Languages](https://arxiv.org/abs/2102.07492), Baptiste Roziere, Marie-Anne Lachaux, Marc Szafraniec, Guillaume Lample, (arXiv 2021) (***DOBF***).\n- [Studying the Usage of Text-To-Text Transfer Transformer to Support Code-Related Tasks](https://arxiv.org/abs/2102.02017), , Antonio Mastropaolo, Simone Scalabrino, Nathan Cooper, David Nader Palacio, Denys Poshyvanyk, Rocco Oliveto, Gabriele Bavota (ICSE 2021).\n- [CodeTrans: Towards Cracking the Language of Silicone’s Code Through Self-Supervised Deep Learning and High Performance Computing](https://arxiv.org/abs/2104.02443), Ahmed Elnaggar, Wei Ding, Llion Jones, Tom Gibbs, Tamas Feher, Christoph Angerer, Silvia Severini, Florian Matthes, Burkhard Rost (arXiv 2021/04( (***CodeTrans***).\n- [Disentangled Code Representation Learning for Multiple Programming Languages](https://aclanthology.org/2021.findings-acl.391.pdf),Jingfeng Zhang, Haiwen Hong, Yin Zhang, Yao Wan, Ye Liu, Yulei Sui (ACL-Fingings 2021) (***CODEDISEN***).\n- [SYNCOBERT: Syntax-Guided Multi-Modal Contrastive Pre-Training for Code Representation](https://arxiv.org/pdf/2108.04556v3.pdf), Xin Wang, Yasheng Wang, Fei Mi, Pingyi Zhou, Yao Wan, Xiao Liu, Li Li, Hao Wu, Jin Liu, Xin Jiang, (arXiv 2021) (***SYNCOBERT***).\n- [TreeBERT: A Tree-Based Pre-Trained Model for Programming Language](https://arxiv.org/abs/2105.12485), Xue Jiang, Zhuoran Zheng, Chen Lyu, Liang Li, Lei Lyu, (UAI 2021) (***TreeBERT***).\n- [Empirical Study of Transformers for Source Code](https://arxiv.org/abs/2010.07987), Nadezhda Chirkova, Sergey Troshin (ESEC/FSE 2021).\n\n## Dataset and Benchmark\n- [CodeSearchNet Challenge](https://github.com/github/CodeSearchNet).\n- [IBM Project CodeNet](https://github.com/IBM/Project_CodeNet).\n- [Semantic Parsing Text to SQL Challenge](https://yale-lily.github.io/spider).\n- [CodeXGlue Benchmark](https://github.com/microsoft/CodeXGLUE).\n- [APPS (Automated Programming Progress Standard)](https://github.com/hendrycks/apps).\n- [Python Programming Puzzles](https://github.com/microsoft/PythonProgrammingPuzzles).\n- [Big Clone Bench](https://github.com/clonebench/BigCloneBench).\n- [Google Code Jam](https://github.com/Jur1cek/gcj-dataset).\n- [HumanEval][https://arxiv.org/abs/2107.03374]\n- [SWE-Bench][https://github.com/princeton-nlp/SWE-bench]\n\n## Talks and Tutorials\n- [How Facebook uses Machine Learning to increase developer's productivity](https://www.youtube.com/watch?v=S7VJzAhzPTU).\n- [Machine Programming at Intel](https://www.youtube.com/watch?v=JMBEmUMSo8M).\n- [ETH Zurich Workshop on Software Correctness and Reliability](https://www.youtube.com/channel/UCNDScEU0cJlOoWeqvg11hDw).\n- [Workshop on Natural Language Processing for Programming](https://nlp4prog.github.io/2021/)\n- [KDD Workshop on Programming Language Processing](https://nlp4prog.github.io/2021/)\n\n## Articles\n- \u003ca href=\"https://cacm.acm.org/magazines/2020/7/245690-your-wish-is-my-cmd/fulltext\" target=\"_blank\"\u003e Automating the writing of code.\u003c/a\u003e\n- \u003ca href=\"https://arxiv.org/pdf/1709.06182.pdf\" target=\"_blank\"\u003e A Survey of Machine Learning for Big Code and Naturalness.\u003c/a\u003e\n- \u003ca href=\"https://www.forbes.com/sites/moorinsights/2021/06/04/ibm-codenet-artificial-intelligence-that-can-program-computers-and-solve-a-100-billion-legacy-code-problem/?sh=153c91d16cdc\" target=\"_blank\"\u003e Artificial Intelligence That Can Program Computers.\u003c/a\u003e\n- \u003ca href=\"https://betanews.com/2023/12/04/software-testers-turn-to-ai-to-improve-productivity/\" target=\"_blank\"\u003e Software testers turn to AI to improve productivity.\u003c/a\u003e\n- \u003ca href=\"https://www.computerworld.com/article/3711404/heres-why-half-of-developers-will-soon-use-ai-augmented-software.html\" target=\"_blank\"\u003e Half of developers will soon use AI-augmented software.\u003c/a\u003e\n- \u003ca href=\"https://github.blog/2023-11-08-the-state-of-open-source-and-ai/\" target=\"_blank\"\u003e State of AI in Software Development, Github.\u003c/a\u003e\n- \u003ca href=\"https://arxiv.org/pdf/2306.15033.pdf\" target=\"_blank\"\u003e Sea Change in Software Development: Economic and Productivity Analysis of the AI-Powered Developer Lifecycle, from Github and Havard Business Review.\u003c/a\u003e\n- \u003ca href=\"https://www.watermelontools.com/post/reimagining-code-review-with-rag-to-save-us-from-lgtm\" target=\"_blank\"\u003e WatermelonTools for AI-based Code Review.\u003c/a\u003e\n- \u003ca href=\"https://cio.economictimes.indiatimes.com/news/artificial-intelligence/impact-of-genai-on-software-development/105405709\" target=\"_blank\"\u003e Impact of AI on Software Development.\u003c/a\u003e\n- \u003ca href=\"https://www.semafor.com/article/11/08/2023/githubs-ai-coding-assistant-copilot-is-a-moneymaker\" target=\"_blank\"\u003e GitHub’s AI coding assistant, Copilot, is a moneymaker.\u003c/a\u003e\n- \u003ca href=\"https://www.infoworld.com/article/3709191/is-chatgpt-writing-your-code-watch-out-for-malware.html\" target=\"_blank\"\u003e Is ChatGPT writing your code? Watch out for malware.\u003c/a\u003e\n- \u003ca href=\"https://www.ft.com/content/81db7c36-f9ae-496b-9dd4-971aefe6f9a9\" target=\"_blank\"\u003e Microsoft pioneers use of generative AI in software — at a price .\u003c/a\u003e\n- \u003ca href=\"https://blogs.sap.com/2023/11/02/why-sap-build-code-is-a-game-changer-for-sap-developers/\" target=\"_blank\"\u003e SAP Build Code is a Game-Changer for SAP Developers .\u003c/a\u003e\n- \u003ca href=\"https://learn.gitlab.com/ailgf/2023-devsecops-report-ai\" target=\"_blank\"\u003e The State of AI in Software Development, Gitlab.\u003c/a\u003e\n- \u003ca href=\"https://stackoverflow.blog/2023/10/12/integrating-ai-tools-into-your-workflow/\" target=\"_blank\"\u003e Integrating AI tools into your workflow.\u003c/a\u003e\n- \u003ca href=\"https://www.semafor.com/article/10/04/2023/ai-is-spurring-the-rise-of-the-novice-coder\" target=\"_blank\"\u003e The rise of the novice coder: Can AI turn every employee into a developer?.\u003c/a\u003e\n\n","projects_url":"https://awesome.ecosyste.ms/api/v1/lists/bdqnghi%2Fawesome-ai4code/projects"}