Projects in Awesome Lists tagged with lexer

https://github.com/westes/flex

The Fast Lexical Analyzer - scanner generator for lexing in C and C++

c flex lexer lexer-generator

Last synced: 04 Oct 2025

https://github.com/alecthomas/participle

A parser library for Go

ast ebnf go golang grammar lexer parser parser-api parser-framework parser-library participle

Last synced: 13 May 2025

https://github.com/maciejhirsz/logos

Create ridiculously fast Lexers

lexer lexer-generator parser parsing rust

Last synced: 06 May 2025

https://github.com/chevrotain/chevrotain

Parser Building Toolkit for JavaScript

grammars javascript lexer open-source parser-library parsing tokenizer typescript

Last synced: 12 Dec 2025

https://github.com/Chevrotain/chevrotain

Parser Building Toolkit for JavaScript

grammars javascript lexer open-source parser-library parsing tokenizer typescript

Last synced: 24 Mar 2025

https://github.com/csstree/csstree

A tool set for CSS including fast detailed parser, walker, generator and lexer based on W3C specs and browser implementations

ast css css-parser fast generator lexer parser w3c walker

Last synced: 14 May 2025

https://github.com/arthursonzogni/diagon

Interactive ASCII art diagram generators. :star2:

antlr arthursonzogni ascii ascii-art ascii-diagram cmake cpp generators lexer markdown parser uml uml-diagram unicode webapp webapplication webassembly

Last synced: 14 May 2025

https://github.com/ArthurSonzogni/Diagon

Interactive ASCII art diagram generators. :star2:

antlr arthursonzogni ascii ascii-art ascii-diagram cmake cpp generators lexer markdown parser uml uml-diagram unicode webapp webapplication webassembly

Last synced: 19 Mar 2025

https://github.com/chipsalliance/verible

Verible is a suite of SystemVerilog developer tools, including a parser, style-linter, formatter and language server

analysis formatter hacktoberfest language-server-protocol lexer linter lsp-server parser productivity style-linter sv-lrm syntax-tree systemverilog systemverilog-developer systemverilog-parser verible yacc

Last synced: 14 May 2025

https://chipsalliance.github.io/verible/

Verible is a suite of SystemVerilog developer tools, including a parser, style-linter, formatter and language server

analysis formatter hacktoberfest language-server-protocol lexer linter lsp-server parser productivity style-linter sv-lrm syntax-tree systemverilog systemverilog-developer systemverilog-parser verible yacc

Last synced: 15 Mar 2025

https://github.com/katef/libfsm

DFA regular expression library & friends

automata compiler compiler-principles compilers dfa finite-state-automata finite-state-machine finite-state-machines fsm lex lexer lexer-generator lexical-analysis lexing nfa regex regex-validator regexes regexp

Last synced: 15 Apr 2025

https://github.com/no-context/moo

Optimised tokenizer/lexer generator! 🐄 Uses /y for performance. Moo.

javascript lexer regexp tokenizer

Last synced: 24 Apr 2025

https://github.com/jensneuse/graphql-go-tools

GraphQL Router / API Gateway framework written in Golang, focussing on correctness, extensibility, and high-performance. Supports Federation v1 & v2, Subscriptions & more.

ast ast-normalization ast-parser ast-printer ast-transformation ast-visitor complexity-analysis execution execution-engine golang graphql graphql-tools introspection introspection-query lexer linter parser parsing printing validation

Last synced: 13 Jun 2025

https://github.com/wundergraph/graphql-go-tools

GraphQL Router / API Gateway framework written in Golang, focussing on correctness, extensibility, and high-performance. Supports Federation v1 & v2, Subscriptions & more.

ast ast-normalization ast-parser ast-printer ast-transformation ast-visitor complexity-analysis execution execution-engine golang graphql graphql-tools introspection introspection-query lexer linter parser parsing printing validation

Last synced: 14 May 2025

https://github.com/jetbrains/grammar-kit

Grammar files support & parser/PSI generation for IntelliJ IDEA

grammar intellij lexer parser

Last synced: 15 May 2025

https://github.com/JetBrains/Grammar-Kit

Grammar files support & parser/PSI generation for IntelliJ IDEA

grammar intellij lexer parser

Last synced: 09 Apr 2025

https://github.com/ArashPartow/exprtk

C++ Mathematical Expression Parsing And Evaluation Library https://www.partow.net/programming/exprtk/index.html

ast c-plus-plus compiler expression-evaluator expression-parser exprtk grammar high-performance language lexer math math-expressions mathematics mirrored-repository mit-license numerical-calculations optimization-algorithms parser scientific-computing semantic-analyzer

Last synced: 15 Mar 2025

https://github.com/jflex-de/jflex

The fast scanner generator for Java™ with full Unicode support

bazel-rules cup dfa dfa-minimization flex grammar java lexer lexer-generator lexical-analyzer maven-plugin nfa parsing regexp scanner scanner-generator tokenizer yacc

Last synced: 13 May 2025

https://github.com/zakirullin/tiny-compiler

A tiny compiler for a language featuring LL(2) with Lexer, Parser, ASM-like codegen and VM. Complex enough to give you a flavour of how the "real" thing works whilst not being a mere toy example

asm ast compiler lexer parser

Last synced: 04 Apr 2025

https://github.com/genivia/re-flex

A high-performance C++ regex library and lexical analyzer generator with Unicode support. Extends Flex++ with Unicode support, indent/dedent anchors, lazy quantifiers, functions for lex and syntax error reporting and more. Seamlessly integrates with Bison and other parsers.

bison compiler flex flex-regex fuzzy-matching graphviz-dot lex lexer lexer-generator lexical-analyzer pcre regex regex-engine regex-library regex-pattern regular-expression regular-expressions

Last synced: 15 May 2025

https://github.com/Genivia/RE-flex

A high-performance C++ regex library and lexical analyzer generator with Unicode support. Extends Flex++ with Unicode support, indent/dedent anchors, lazy quantifiers, functions for lex and syntax error reporting and more. Seamlessly integrates with Bison and other parsers.

bison compiler flex flex-regex fuzzy-matching graphviz-dot lex lexer lexer-generator lexical-analyzer pcre regex regex-engine regex-library regex-pattern regular-expression regular-expressions

Last synced: 05 Apr 2025

https://github.com/glayzzle/php-parser

:herb: NodeJS PHP Parser - extract AST or tokens

ast development javascript lexer parser php php-ast php-parser static-code-analysis tokenizer

Last synced: 14 May 2025

https://github.com/softdevteam/grmtools

Rust grammar tool libraries and binaries

error-recovery generator grammar lex lexer lr parser rust yacc

Last synced: 13 May 2025

https://github.com/DQNEO/minigo

minigo🐥is a small Go compiler made from scratch. It can compile itself.

assembly compiler go golang lexer parser

Last synced: 30 Apr 2025

https://github.com/dqneo/minigo

minigo🐥is a small Go compiler made from scratch. It can compile itself.

assembly compiler go golang lexer parser

Last synced: 05 Apr 2025

https://github.com/ascoders/syntax-parser

Light and fast 🚀parser! With zero dependents. - Sql Parser Demo added!

lexer parser sql sql-parser

Last synced: 05 Apr 2025

https://github.com/tdewolff/parse

Go parsers for web formats

css go html javascript js json lexer parse svg xml

Last synced: 14 May 2025

https://github.com/Water-Melon/Melang

A script language of time-sharing scheduling coroutine in single thread

base64 coroutine cron injection interpreter json language lexer linux md5 mysql parser-generator programming-language rc4 reactive-programming script-language sha1 sha256 syntax-analysis unix

Last synced: 04 Apr 2025

https://github.com/water-melon/melang

A script language of time-sharing scheduling coroutine in single thread

base64 coroutine cron injection interpreter json language lexer linux md5 mysql parser-generator programming-language rc4 reactive-programming script-language sha1 sha256 syntax-analysis unix

Last synced: 16 May 2025

https://github.com/timtadh/lexmachine

Lex machinary for go.

dfa go lex lexer lexical-analysis-engines lexical-analysis-framework nfa regular-expression tokenizer

Last synced: 29 Jun 2025

https://github.com/b3b00/csly

a C# embeddable lexer and parser generator (.Net core)

csharp dot-net expression-parser grammar-rules lexer lexer-generator mathematical-parser parser parser-generator recursive-descent-parser

Last synced: 08 Apr 2025

https://github.com/carthage-software/mago

Mago is a toolchain for PHP that aims to provide a set of tools to help developers write better code.

code-analyzer code-style coding-standards formatter lexer linter parser php static-analysis type-checker

Last synced: 12 Nov 2025

https://github.com/Rydgel/monkey-rust

An interpreter for the Monkey programming language written in Rust

interpreter lexer monkey nom parser rust

Last synced: 27 Apr 2025

https://github.com/wgrape/lexer

A lexical analyzer based on DFA that is built using JS and supports multi-language extensions / 一个基于DFA的支持多语言扩展的JS版开源词法分析器

dfa javascript lexer lexical-analysis lexical-analyzer

Last synced: 05 Apr 2025

https://github.com/php-rust-tools/parser

A handwritten fault-tolerant, recursive-descent parser for PHP written in Rust.

fault-tolerant lexer parser php-parser php-rust php-rust-tools recursive-descent-parser rust

Last synced: 14 Apr 2025

https://github.com/dqneo/babygo

babygo👶 is a small Go compiler made from scratch, which can compile itself. It's going to be the smallest and simplest go compiler in the world.

ast compiler go golang lexer linux parser x86-64

Last synced: 06 Apr 2025

https://github.com/wadackel/rs-monkey-lang

Monkey Programming Language written in Rust.

interpreter lexer monkey parser rust

Last synced: 08 Oct 2025

https://github.com/igorkulman/swiftpascalinterpreter

Simple Swift interpreter for the Pascal language inspired by the Let’s Build A Simple Interpreter article series.

ast grammar interpreter lexer parse pascal pascal-language pascal-programs playground procedure swift

Last synced: 09 Apr 2025

https://github.com/igorkulman/SwiftPascalInterpreter

Simple Swift interpreter for the Pascal language inspired by the Let’s Build A Simple Interpreter article series.

ast grammar interpreter lexer parse pascal pascal-language pascal-programs playground procedure swift

Last synced: 22 Apr 2025

https://github.com/ghaiklor/llvm-kaleidoscope

LLVM Tutorial: Kaleidoscope (Implementing a Language with LLVM)

kaleidoscope language lexer lexical-analysis llvm llvm-ir llvm-tutorial

Last synced: 12 Apr 2025

https://github.com/cerbero90/lazy-json

🐼 Framework-agnostic package to load JSON of any dimension and from any source into Laravel lazy collections recursively.

json laravel lexer parser stream

Last synced: 25 Dec 2025

https://github.com/here-be/snapdragon

snapdragon is an extremely pluggable, powerful and easy-to-use parser-renderer factory.

ast compile compiler javascript lex lexer node nodejs parse parser render source-map token tokenize

Last synced: 15 May 2025

https://github.com/cucumber/gherkin

A parser and compiler for the Gherkin language.

c dart dotnet elixir gherkin go java javascript lexer objective-c parser perl php polyglot-release python ruby tidelift

Last synced: 14 May 2025

https://github.com/louisdh/cub

The Cub Programming Language

ast bytecode compiler interpreter lexer parser virtual-machine

Last synced: 02 Sep 2025

https://github.com/graphql-dotnet/parser

A lexer and parser for GraphQL in .NET

ast graphql lexer parse

Last synced: 16 May 2025

https://github.com/fsprojects/fslexyacc

Lexer and parser generators for F#

fsharp lex lexer parser yacc

Last synced: 15 May 2025

https://github.com/ariasql/ariasql

The AriaSQL relational database management system.

btree database dbms disk golang json lexer open-source parser rdbms relational-database server sql sqlserver

Last synced: 03 Apr 2025

https://github.com/arcsysu/SYsU-lang

A mini, simple and modular compiler lab for SYsU/SysY(tiny C). Based on Clang/LLVM/ANTLR4/Bison/Flex.

antlr antlr4 bison clang compiler flex lex lexer llvm llvm-ir parser sysy yacc

Last synced: 26 Apr 2025

https://github.com/phplrt/phplrt

PHP Language Recognition Tool

ast combinator compiler grammar lexer library ll1 llk lookahead parser php phplrt recursive-descent-parser tool trace

Last synced: 14 Apr 2025

https://github.com/tufanbarisyildirim/gonginx

Nginx configuration parser helps you to parse, edit, regenerate your nginx config in your go applications

devops devops-tools golang lexer nginx parser

Last synced: 22 Mar 2025

https://github.com/aappleby/matcheroni

A minimalist single-header library for building pattern-matchers, lexers, and parsers.

c cplusplus-20 lexer lexing parser parsing parsing-expression-grammar parsing-expression-grammars pattern-matching regex regular-expression regular-expression-engine regular-expressions text-processing

Last synced: 24 Apr 2025

https://github.com/berdal84/Nodable

Nodable is node-able. The goal of Nodable is to provide an original hybrid source code editor, using both textual and nodal paradigms.

dear-imgui editor expression fun graph imgui lexer linux macos node opengl parser sdl2 windows

Last synced: 08 May 2025

https://github.com/vinzenz/libpypa

libpypa is a Python parser implemented in pure C++

ast c-plus-plus lexer parse parser-library python

Last synced: 15 Mar 2025

https://github.com/plyara/plyara

Parse YARA rules and operate over them more easily.

lexer parser ply python python3 sly yara yara-parser yara-rules

Last synced: 05 May 2025

https://github.com/riicchhaarrd/ocean

Programming language that compiles into a x86 ELF executable.

ast c compiler elf lexer programming-language x86

Last synced: 14 Apr 2025

https://github.com/louisdh/lioness

The Lioness Programming Language

ast bytecode compiler interpreter lexer parser virtual-machine

Last synced: 15 Apr 2025

https://github.com/florianschanda/miss_hit

MATLAB Independent, Small & Safe, High Integrity Tools - code formatter and more

code-formatter formal-methods lexer linter matlab metrics octave parser python3 simulink static-analyzer style-checker

Last synced: 04 Apr 2025

https://github.com/evanbacon/xcode

super fast pbxproj parser written in TypeScript

chevrotain lexer pbxproj xcode

Last synced: 14 Oct 2025

https://github.com/untitaker/html5gum

A WHATWG-compliant HTML5 tokenizer and tag soup parser

html html5 lexer parser parsing sax tokenizer whatwg xml

Last synced: 15 May 2025

https://github.com/EvanBacon/xcode

super fast pbxproj parser written in TypeScript

chevrotain lexer pbxproj xcode

Last synced: 29 Apr 2025

https://github.com/ibara/pl0c

Self-hosting PL/0 to C compiler to teach basic compiler construction from a practical, hands-on perspective.

c code-generation code-generator code-generators compilation compiler compilers compiling freebsd lexer linux netbsd openbsd parser pascal pl-0 recursive-descent recursive-descent-parser unix

Last synced: 24 Oct 2025

https://github.com/foonathan/lex

Replaced by foonathan/lexy

cplusplus lexer tokenizer

Last synced: 08 May 2025

https://github.com/pfnet/rflex

Fast lexer code generator for Rust

lexer lexer-generator rust

Last synced: 05 Apr 2025

https://github.com/mykolaharmash/works-for-me

Collection of developer toolkits

developer-toolkit developer-tools development-environment development-workflow devtools lexer parser tokenizer

Last synced: 09 Aug 2025

https://github.com/annimon/own-programming-language-tutorial

Source code for course "How to create your own programming language"

interpreted-programming-language interpreter java lexer parser programming-language tutorial

Last synced: 05 Apr 2025

https://github.com/digineo/go-uci

Native Go bindings for OpenWrt's UCI.

configuration configuration-management go lexer native openwrt parser uci

Last synced: 07 Apr 2025

https://github.com/julialang/tokenize.jl

Tokenization for Julia source code

julia lexer lexing tokenizer

Last synced: 06 Apr 2025

https://github.com/kamadorueda/santiago

Santiago is a lexing and parsing toolkit for Rust

bison bison-flex bison-grammar bison-yacc flex lexer lexical-analysis parser parser-combinators parser-generator parsing rust

Last synced: 10 Oct 2025

https://github.com/andrew-johnson-4/lsts

Large Scale Type Systems (programming language)

assisted-reasoning ast category-theory compiler dependent-types error-reporting lambda-calculus lambda-calculus-interpreter language lexer lint lsts parser proof-assistant refinement-types rust theorem-prover type-checking

Last synced: 07 Apr 2025

https://github.com/andrew-johnson-4/LSTS

Large Scale Type Systems (programming language)

assisted-reasoning ast category-theory compiler dependent-types error-reporting lambda-calculus lambda-calculus-interpreter language lexer lint lsts parser proof-assistant refinement-types rust theorem-prover type-checking

Last synced: 13 Apr 2025

https://github.com/h2337/clex

clex is a simple lexer generator

finite-state-machine lex lexer lexer-framework lexer-generator lexer-library lexical-analysis lexical-analyzer nfa regex regex-engine regexp

Last synced: 13 Aug 2025

https://github.com/kamadorueda/nixel

Parser for the Nix Expressions Language

abstract-syntax-tree concrete-syntax-trees lexer nix nixos parser

Last synced: 09 May 2025

https://github.com/noti0na1/socc

Simple C Compiler in OCaml

assembly c compiler lexer linux menhir ocaml ocamllex parser x64

Last synced: 24 Mar 2025

https://github.com/weltling/parle

Parser and lexer for PHP

lexer parser php

Last synced: 06 Jul 2025

https://github.com/bzick/tokenizer

Tokenizer (lexer) for golang

golang lexer parse parser tokenizer tokenizing

Last synced: 28 Apr 2025

https://github.com/sebbekarlsson/tac

tac x86 compiler

compiler lexer x86

Last synced: 13 Oct 2025

https://github.com/bbuck/go-lexer

Lexer based on Rob Pike's talk on YouTube (view README)

golang lexer

Last synced: 15 Apr 2025

https://github.com/Northern-Lights/yara-parser

Tools for parsing rulesets using the exact grammar as YARA. Written in Go.

detection go golang grammar json lexer ruleset security security-tools signatures yara yara-parser yara-ruleset

Last synced: 05 May 2025

https://github.com/mkirchner/stutter

Implement a Lisp, in C, from scratch, no libs

ast c from-scratch lexer lisp make-a-lisp parser

Last synced: 14 May 2025

https://github.com/vektah/goparsify

golang parser-combinator library

ast golang lexer parse parser-combinators

Last synced: 19 Sep 2025

https://github.com/krasun/gosqlparser

Simple SQL parser

go go-library golang lexer lexer-parser parser sql sqlparser

Last synced: 15 Jul 2025

https://github.com/jsiebern/re-typescript

An opinionated attempt at finally solving typescript interop for ReasonML / OCaml.

bucklescript decoding jsoo lexer menhir ocaml parsing reason reason-react reasonml typescript

Last synced: 07 May 2025

https://github.com/1computer1/lexure

Parser and utilities for non-technical user input

args lexer parser

Last synced: 11 Apr 2025

https://github.com/dibyendumajumdar/ravi-compiler

Parser and compiler for Ravi and Lua

abstract-syntax-tree ast c compiler compiler-construction intermediate-representation lexer lua parser

Last synced: 14 Apr 2025

https://github.com/ympons/expreso

:coffee: A boolean expression parser and evaluator in Elixir.

boolean-expression elixir eval expreso lexer parser

Last synced: 25 Jul 2025

https://github.com/jaysmito101/lexpp

Small Extremely Powerful Header Only C++ Lexical Analyzer/String Parser Library

cpp11 header-only header-only-library lexer lexical-analyzer string-parser

Last synced: 01 Apr 2025

https://github.com/quil-lang/alexa

A Lexical Analyzer Generator

common-lisp lex lexer lexical-analysis

Last synced: 16 Dec 2025

https://github.com/orbitalquark/scintillua

Scintillua enables Scintilla lexers to be written in Lua, particularly using LPeg. It can also be used as a standalone Lua library for syntax highlighting support.

lexer lexers lpeg lua scintilla scintillua scite syntax-highlighting

Last synced: 01 May 2025

https://github.com/sssooonnnggg/rslua

Yet another Lua lexer and Lua parser for Lua 5.3 written in pure Rust.

ast handwritten lexer lua parser rust transpiler

Last synced: 20 Mar 2025

https://github.com/sys27/xfunc

xFunc provides a powerful parser and analyzer for mathematical expressions. It excels at calculating derivatives, simplifying expressions, and achieving high performance.

analyzer c-sharp complex-numbers derivative differentiation dotnet evaluate-expressions expression lexer logic math math-parser mathematics parse parser simplification units units-of-measure