Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

awesome-compilers

:sunglasses: Curated list of awesome resources on Compilers, Interpreters and Runtimes
https://github.com/aalhour/awesome-compilers

Last synced: 3 days ago
JSON representation

Learning
- Books
  - Elements of Computing Systems - How to build a computer from Nand Gates all the way to Compilers and Operating Systems.
  - Structure and Interpretation of Computer Programs - Study the building blocks of computation using Scheme by building a Scheme interpreter in a Scheme!
  - Basics of Compiler Design - Provides a short treatment of the basic concepts.
  - Build Your Own Lisp - Learn C and build your own Lisp Programming Language in 1000 LoC.
  - Compilers: Principles, Techniques and Tools - The Dragons Book. A classic textbook on Compiler Construction.
  - Crafting Interpreters - An all-stop-shop for learning (nearly) everything you need to learn to build an interpreted, full-featured, efficient scripting language.
  - HN
  - Create Your Own Programming Languauge - Example-driven approach to building your own programming language with video tutorials and source code projects.
  - HN
  - Engineering a Compiler - The modern textbook on Compilers Construction, covering SSA-Form and recent research on Code Generation.
  - Essentials of Programming Languages - Fundamental concepts of programming languages with a focus on Semantics, Interpretation and CPS (Continuation Passing Style).
  - Language Implementation Patterns - Learn the patterns behind building programming languages and build an interpreter yourself, using ANTLR.
  - Modern Compiler Implementation in ML - Build a compiler using ML (MetaLanguage) with a textbook that has one of the best coverage on all compiler stages. The book comes with a reference compiler implementation to guide your software development process.
  - MCI in C
  - Programming Language Pragmatics - Integrated treatement of language design and implementation, the examples feature famous architectures like ARM and x86 64-bit.
  - Programming Languages: Application and Interpretation - Excellent introduction to the subject that uses an incremental approach to building programs. The mistakes are included too to highlight key concepts.
  - PDF
  - Programming Languages: Theory and Practice - Collected lecture notes for the _Programming Languages_ course taught at Carnegie Mellon University, most suitable as an introductory text on the subject.
  - Project Oberon - The design of an operating system and compiler.
  - 2013 Edition
  - Virtual Machines - Good book on how to build Virtual Machines especially tailored for the topic of building Programming Languages.
  - Virtual Machines: Versatile Platforms for Systems and Processes - Key textbook on the subject of Virtual Machines which examines virtual machine technologies across the disciplines that use them, e.g.: OS and Programming Languages.
  - Write a Compiler in Go - Well-known introduction to the Go programming language and its ecosystem through building a Compiler project.
  - Write an Interpreter in Go - Successor of the "Write a Compiler in Go" book, but this one builds an interpreter project instead.
  - Writing Compilers and Interpreters: A Software Engineering Approach - How to build Compilers using Java, this book is tailored for the working Software Engineer.
  - Using C++
  - Writing Interpreters and Compilers for the Raspberry Pi Using Python - If you want to learn how to write interpreters and compilers, and at the same time learn how Python, Python bytecode, assembly language, and dynamic typing work, this is the book for you.
  - Advanced Compiler Design and Implementation - In-depth treatement of advanced design topics such as: Intermediate Representation, SSA, Code Optimization and the various processor architectures.
  - Advanced Design and Implementation of Virtual Machines - Step-by-step hollistic introduction to the design of Virtual Machine architectures, topics and algorithms. Contains illustrated figures and implementations for the algorithms in the book.
  - Advanced Topics in Types and Programming Languages - Intensive study of Type Systems, covering topics such as, but not limited to: Precise Type Analyses; Type Systems for Low-Level Languages and Advanced Techniques in ML-style Type Inference..
  - A Retargetable C Compiler: Design and Implementation - Examines the design and implementation of Icc, a production-quality, retargetable compiler, designed at AT&T Bell Labs for the ANSI C programming language.
  - Building an Optimizing Compiler - Fills the gap in the domain of code optimization. This book provides a high level design for a thorough optimizer, code generator, scheduler and register allocator for a generic modern RISC processor.
  - Compiling with Continuations - Introduction to CPS (Continuation-Passing Style) as an Intermediate Representation in Compiler for doing optimizations and program transformations.
  - Design Concepts in Programming Languages - Systematic exploration of techniques and ideas used in Programming Language Design, covers topics such as: Operational and Denotational Semantic techniques, Dynamic Semantic techniques and Static Semantic techniques.
  - Instruction Level Parallelism - This book precisely formulates and simplifies the presentation of Instruction Level Parallelism (ILP) compilation techniques.
  - Linkers and Loaders - Definitive text on the compile-time and runtime processes of linking and loading.
  - Optimizing Compilers for Modern Architectures - Optimizing program generation based on recent gains and breakthroughs in modern high-performance CPU architectures.
  - Parsing Techniques: A Practical Guide - Definitive guide on parsing algorithms and techniques, also contains an introduction to Formal Grammar and Parsing Theory.
  - 1st Edition, PDF
  - The Garbage Collection Handbook: The Art of Automatic Memory Management - The living-classic and definitive text on the topic of Garbage Collection, also covers hardware-based optimizations in light of modern advances in CPU architectures.
  - The Implementation of Functional Programming Languages - Classic textbook on implementing Functional Languages, covers Structured Types, Pattern Matching Semantics, Lambda Calculus Transformation, Polymorphic Type Checking and many other topics.
  - The SSA Book - The only in-depth study of SSA-form (Static Single Assignment Form) in book format.
  - Types and Programming Languages - Comprehensive introduction to the topic of Type Systems and Programming Languages from a Type-Theoretic perspective.
  - Warren's Abstract Machine: Prolog in Haskell - Introduction to WAM from Logic Programming in Prolog.
  - Build Your Own Lisp - Learn C and build your own Lisp Programming Language in 1000 LoC.
  - HTML5/EPUB version
  - GitHub Repo
  - Programming Languages: Application and Interpretation - Excellent introduction to the subject that uses an incremental approach to building programs. The mistakes are included too to highlight key concepts.
  - PDF
  - Computer Systems: A Programmer’s Perspective - General treatment of Computer Systems including Compilers, Interpreters and Runtimes.
- Papers
- Specifications
- Courses
  - Compilers Construction, Cambridge - Introduction to compiler construction course from the University of Cambridge.
  - Compiler Construction for Undergrads, RICE University - Introduction to compiler construction and language translators course from the RICE University.
  - YouTube - Introduction to Compilers theory and construction course from Stanford.
  - Design and Construction of Compilers, University of Texas - Design and construction of compilers including lexical analysis, parsing, code generation techniques, error analysis and simple code optimizations.
  - PDF
  - DSL Design and Implementation Summer School - Summer School program on the topics of DSL Design and Implementation hosted by the EPFL University.
  - Foundations of Programming Languages - Concepts that underlie the design, definition, implementation and use of modern programming languages from a formal standpoint.
  - Nand2Tetris: How to Build a Computer from First Principles, Part 2 - This 2nd part of the Nand2Tetris course covers basic language design and elementary compiler construction concepts in addition to many other topics on a basic level.
  - NPTEL's Principles of Compiler Design Course - Introductory course from NPTEL on Compiler Design.
  - NPTEL's Compiler Design Course - Slightly more advanced course than their Principles of Compiler Design course, covers SSA Form to a good degree.
  - YouTube Video Playlist
  - Programming Languages: Part A, by Grossman - Part 1 of a 3-part course series to the basic concepts of programming languages, with a strong emphasis on functional programming.
  - Programming Languages: Part B, by Grossman - Part 2 of a 3-part course series to the basic concepts of programming languages, with a strong emphasis on functional programming.
  - Programming Languages: Part C, by Grossman - Part 3 of a 3-part course series to the basic concepts of programming languages, with a strong emphasis on functional programming.
  - Types, Logic, Semantics, and Verification from Oregon University's Summer School - Summer School program that consists of 80 minute lectures presented by internationally recognized leaders in programming languages and formal reasoning research.
  - Virtual Machines and Managed Runtimes, UCB CS294 - Introductory course on Virtual Machines and Managed Runtimes from the University of Berkeley.
  - Virtual Machines Summer School 2016 (VMSS 2016) - VMSS is a Summer School program that aims to give an overview of the field, targeted at early career researchers.
  - YouTube Videos Playlist
- Talks and Conferences
  - Curry On! Conference - Programming Languages Conference.
  - YouTube Channel
  - LLVM Developers Meeting YouTube Channel
  - Anders Hejlsberg on Modern Compiler Construction
  - An Introduction to Combinator Compilers and Graph Reduction Machines
  - Building an Interpreter in RPython
  - CPython - A Ten-Hour Codewalk
  - How to Build a Virtual Machine - Terence Parr gives an idea of the core mechanisms behind virtual machines by building one, in front of your eyes, from scratch. It is the same kind of commercial interpreter he made for Renault cars.
  - Java AOT (Ahead of Time) Compilation
  - MetaScala: A Tiny DIY JVM - Metascala is a tiny metacircular Java Virtual Machine (JVM) written in the Scala programming language.
  - Meta-Tracing, RPython and PyPy
  - One VM to Rule Them All, One VM to Bind Them - Tutorial on the Truffel technology.
  - Programming Should Eat Itself - StrangeLoop Talk on Reflective Programming and Kenichi Asai's Black Programming Language.
  - Python, Linkers and Virtual Memory - PYCON US
  - Reverse Engineering the MOS 6502 CPU
  - Single Static Assignment Form Seminar - Introductory seminar on SSA Form, Compiler Optimizations under it and its applications in other areas such as Program Analysis and Verification.
  - The JVM (Java Virtual Machine) Architecture
  - The Most Beautiful Program Ever Written - William Byrd on a Lisp interpreter written in 15 lines of Lisp.
  - The MoVfuscator: turning mov into a soul crushing RE nightmare
  - HN
  - Part 1
  - Part 2
  - Part 3
  - Type-Driven Development with Idris
  - Understanding Compiler Optimization
  - Lang.NEXT Conference 2012
  - Reverse Engineering the MOS 6502 CPU
  - Exploring Python’s Bytecode
- Articles
  - Accidentally Turing Complete
  - Part 1 - An Interpreter
  - Part 2 - An x64 JIT
  - Part 3 - LLVM
  - Part 4 - In Python
  - ALIVe: Automatic LLVM InstCombine Verifier
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Reddit
  - How to Compile with Continuations
  - Interpreter, Compiler and JIT
  - Introducing the B3 JIT Compiler
  - LLVM Architecture - Chapter from the book Architecture of Open Source Applications.
  - LLVM for Graduate Students - Introduction to doing research with the LLVM compiler infrastructure.
  - Pratt Parsers: Expression Parsing Made Easy
  - Rust Compiler Walk-Through
  - Rust's Incremental Compilation
  - The Memory Models that Underlie Programming Languages
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - A Tourist’s Guide to the LLVM Source Code
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Rust’s Upcoming MIR
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
  - Graal and Truffel - Obscure research project could radically accelerate innovation in programming language design.
- Tutorials
  - A Tutorial Implementation of a Dependently Typed Lambda Calculus
  - A Beginner's Guide to Linkers - Tutorial for helping C & C++ programmers understand the essentials of what the linker does.
  - Algorithm W Step By Step
  - Building a LISP from scratch with Swift
  - Compiler Optmization Tutorial
  - Hindley-Damas-Milner Tutorial - Extensively documented walkthrough for typechecking a basic functional language using the Hindley-Damas-Milner algorithm.
  - How I Wrote a Programming Language, and How You Can Too
  - Reddit
  - Kaleidoscope: Implementing a Language with LLVM in Objective Caml
  - Let’s Build A Simple Interpreter
  - Lisperator - How to implement a programming language in JavaScript.
  - Little Lisp Interpreter - Interpreter that supports function invocation, lambdas, lets, ifs, numbers, strings, a few library functions, and lists in under 120 lines of JavaScript.
  - `lis.py`, v1: (How to Write a (Lisp) Interpreter (in Python)) - Tutorial by Peter Norvig on writing a simple Lisp interpreter.
  - `lis.py`, v2: An ((Even Better) Lisp) Interpreter (in Python) - Follow-up tutorial by Peter Norvig on making `lis.py` slightly better.
  - LLVM Tutorial: Implementing Kaleidoscope
  - Python version with LLVMPY
  - Metacompiler Tutorial, Part 1
  - Project: A Programming Language - Chapter 11 from the book _Eloquent JavaScript_, 2nd Edition.
  - Write You a Haskell
  - Writing a Language in Truffel - Interpreter development tutorial using Truffel, by Cristian Esquivias.
- Community Discussions
  - Can we stop recommending the Dragon Book, please? - StackExchange thread criticising the [Dragons Book](https://www.amazon.com/dp/0321486811) in favor of alternatives.
  - What is difference between an LL and Recursive Descent parser?
  - @HN - Article discussions on HN and Reddit.
  - How to Write a Compiler - Article discussion on Reddit.
  - How to Write a Very Basic Compiler
  - How to Write a Prolog Interpreter in a Purely Functional Language
  - Reddit
  - Implementing Type Inference
  - I want to build a VM, any good references?
  - Resources for Amatuer Compilers Writers
  - What are the good open source implementations of Java Virtual Machine?
  - What are the latest research trends in Compilers and PLs
Tools and Frameworks
- Language Agnostic
  - B3: The Bare Bones Backend - WebKit's optimizing JIT Compiler for procedures containing C-like code.
  - Capstone - Lightweight multi-platform, multi-architecture disassembly framework with bindings to various famous programming languages.
  - LLVM - The LLVM Compiler-Backend Framework.
  - MicroVM - The "Mu" Framewrok for Programming Languages development based on the MuVM Specification.
  - QBE: The Quick Backend - Pure C embeddable SSA-based compiler backend.
  - Capstone - Lightweight multi-platform, multi-architecture disassembly framework with bindings to various famous programming languages.
- C / C++
  - GCC - The GNU Compiler Collection (C as a Backend).
  - libJIT - Library for generic Just-In-Time compiler functionality independent of any particular bytecode, language, or runtime.
  - myJIT - Library for machine-code generation and execution at run-time.
  - PCC - The Portable C Compiler (C as a Backend).
  - Ragel - Ragel State Machine Compiler.
  - TCC - The Tiny C Compiler (C as a Backend).
  - libFirm - C-library that provides a graph-based intermediate representation, optimizations, and assembly code generation suitable for use in compilers.
- CLR
  - Cecil - Library to generate and inspect programs and libraries in the ECMA CIL format.
  - Reflexil - Assembly code editor which can be used as a plugin with other .NET/CLR tools.
- Go
  - goyacc - YACC Implementation in Go. Standard LALR(1) parser generator.
  - LLVM Go binding - Official Go LLVM binding.
- Graal
  - Graal Core - Compiler and Truffel Partial Evaluator.
  - Graal VM - Graal's multi-language VM distribution.
- JavaScript
  - IRHudra - Tool for displaying intermediate representations used by V8 and Dart VM optimizing compilers.
  - JISON - Context-free grammar parser generator for JavaScript.
  - Nearley - Simple, fast, powerful parser toolkit for JavaScript.
  - PEG.js - Simple parser generator for JavaScript.
  - JISON - Context-free grammar parser generator for JavaScript.
- JVM
  - BYAAC/J - BYACC/Java is an extension of the Berkeley v 1.8 YACC-compatible parser generator for Java.
  - FCP JVM - JVM Backend for generating Java Byte Code that conforms to the JDK v1.5+ Specification and the Dalvik VM.
  - JavaCPP Presets for LLVM - Library for easily interacting with the LLVM API.
  - JFlex - JFlex is a lexical analyzer generator for Java with full Unicode support.
  - JLex - JLex is a lexical analyzer generator, that can be used in combination with CUP.
- Python
  - AST - Python's builtin Abstract Syntax Tree package.
  - Dis - Python's builtin Disassembler package.
  - Parsing - Pure-Python module that implements an LR(1) parser generator, as well as CFSM and GLR parser drivers.
  - PLY - Implementation of lex and yacc parsing tools for Python.
  - PyParsing - Alternative approach to creating and executing simple grammars, vs. the traditional lex/yacc approach, or the use of regular expressions.
  - RPython - RPython is a framework for the implementatation of dynamic languages.
  - List of Language Parsing Tools at the Python Wiki
  - Survey of Python Parsers, by Ned Batchelder
  - Survey of Python Parsers, by Ned Batchelder
- Rust
  - Nom - Parser Combinator Framework.
  - RLS - The Rust Language Server implementation (aka RLS).
Compilers and Interpreters
- Serious Projects
  - Lua's Annotated Source Code - Annotated source code of the Lua Programming Language Interpreter v5.1.4.
  - Simple-MSIL-Compiler - C compiler that compiles to CLR.
- Educational and Toy Projects
  - HN
  - Black - Scheme interpreter for the Reflective Programming Language "Black", by Kenichi Asai's.
  - HN
  - Reddit
  - HN
  - tinyc.c - Tiny-C language compiler in C.
Runtimes and VMs
- Educational and Toy Projects
  - HLVM
  - JamVM - [GitHub project mirror](https://github.com/cfriedt/jamvm).
  - Apache Harmony
  - Other JVM Runtimes
  - OpenJDK
Blogs
- Educational and Toy Projects
Communities
- Educational and Toy Projects
  - /r/Compilers - Subreddit community about the theory and development of compilers.
  - /r/ProgrammingLanguages - Subreddit community that is dedicated to discussion of programming languages, programming language theory, design, their syntax and compilers.
Verticals
- Educational and Toy Projects
  - 68 Resources for Creating Programming Languages
  - Awesome Static Analysis
  - Compiler Conferences, Workshops and Journals
  - Languages and Compilers Network Graph
  - miniKanren.org - Papers, Talks and Implementations of miniKanren and microKanren.
  - PLT Enlightenment
  - Resources for Amateur Compiler Writers
  - SSA Form Bibliography
  - Summer Schools

Programming Languages

HTML 2

Ecosyste.ms: Awesome

awesome-compilers

Learning

Books

Papers

Specifications

Courses

Talks and Conferences

Articles

Tutorials

Community Discussions

Tools and Frameworks

Language Agnostic

C / C++

CLR

Go

Graal

JavaScript

JVM

Python

Rust

Compilers and Interpreters

Serious Projects

Educational and Toy Projects

Runtimes and VMs

Educational and Toy Projects

Blogs

Educational and Toy Projects

Communities

Educational and Toy Projects

Verticals

Educational and Toy Projects