Projects in Awesome Lists tagged with lexical-analyzer

https://github.com/jflex-de/jflex

The fast scanner generator for Java™ with full Unicode support

bazel-rules cup dfa dfa-minimization flex grammar java lexer lexer-generator lexical-analyzer maven-plugin nfa parsing regexp scanner scanner-generator tokenizer yacc

Last synced: 06 Nov 2024

https://github.com/Genivia/RE-flex

A high-performance C++ regex library and lexical analyzer generator with Unicode support. Extends Flex++ with Unicode support, indent/dedent anchors, lazy quantifiers, functions for lex and syntax error reporting and more. Seamlessly integrates with Bison and other parsers.

bison compiler flex flex-regex fuzzy-matching graphviz-dot lex lexer lexer-generator lexical-analyzer pcre regex regex-engine regex-library regex-pattern regular-expression regular-expressions

Last synced: 05 Nov 2024

https://github.com/wgrape/lexer

A lexical analyzer based on DFA that is built using JS and supports multi-language extensions / 一个基于DFA的支持多语言扩展的JS版开源词法分析器

dfa javascript lexer lexical-analysis lexical-analyzer

Last synced: 21 Dec 2024

https://github.com/wizardpisces/tiny-sass-compiler

Another sass compiler write from scatch，runnable on both node and browser

cli compiler lexical-analyzer parser sass superstruct typescript

Last synced: 11 Nov 2024

https://github.com/mantoufan/yzhanjsinterpreter

A JavaScript Interpreter Using JS itself. JavaScript 解释器，包含词法分析、语法解析和执行。基于 LR 实现 eval

interpreter js-interpreter lexical-analyzer syntax-parser

Last synced: 19 Dec 2024

https://github.com/lsys/lexicalrichness

:smile_cat: :speech_balloon: A module to compute textual lexical richness (aka lexical diversity).

data-mining data-science information-retrieval lexical-analysis lexical-analyzer linguistic-analysis natural-language natural-language-processing nlp python

Last synced: 18 Dec 2024

https://github.com/jafarlihi/clex

clex is a simple lexer generator

finite-state-machine lex lexer lexer-framework lexer-generator lexer-library lexical-analysis lexical-analyzer nfa regex regex-engine regexp

Last synced: 12 Nov 2024

https://github.com/jaysmito101/lexpp

Small Extremely Powerful Header Only C++ Lexical Analyzer/String Parser Library

cpp11 header-only header-only-library lexer lexical-analyzer string-parser

Last synced: 02 Nov 2024

https://github.com/liulalemx/felig-toolkit

A toolset for Amharic Language pre-processing. Includes an Amharic Stemmer, Transliterator, Stopword remover , Lexical analyzer, Corpus indexer and Term weighter.

amharic amharic-corpus amharic-nlp amharic-stemmer corpus lexical-analyzer linguistics stopword-removal transliterator

Last synced: 18 Nov 2024

https://github.com/yeaseen/c-compiler

:hamburger: A subset of C Compiler[Lexical Analyzer, Syntax Analyzer, Semantic Analyzer & Intermediate Code Generator] , DAG & TAC implemented in C++ using Flex and Yacc-Bison as an assignment of sessional course CSE310 in undergradute studies in CSE, BUET

assembly-8086 bison c-compiler compiler-construction compiler-design cse-buet dag intermediate-code-generation lexical-analyzer parser parser-generator semantic-analyzer symbol-table tac yacc

Last synced: 17 Nov 2024

https://github.com/softcircuits/silk

Simple Interpreted Language Kit (SILK). An easy way to add scripting and automation to your .NET applications.

compiler csharp csharp-library interpreter lexical-analyzer parser

Last synced: 11 Nov 2024

https://github.com/sergey0xff/lexit

An open source lexer generator

compiler grammar grammar-parser lexer lexer-generator lexical-analyzer python python3

Last synced: 09 Nov 2024

https://github.com/howl-anderson/microcompiler

一个微型的 LL/LR/LALR 语法解析器 | A micro compiler project to provide LL/LR/LALR syntax parser

compiler compiler-construction compiler-frontend compiler-principles compiler-tool compilers compilers-design lalr-parser lexer lexical-analysis lexical-analysis-engines lexical-analyzer lexical-parser ll-parser ll1 ll1-grammar lr-parser parser-generator

Last synced: 21 Nov 2024

https://github.com/merzak-x/lexicalanalyser

Lexical Analyser is a Lexer / Tokenizer that determines whether a source code is accepted by a given Deterministic Finite State Automaton or not.

deterministic-finite-automata dfa dfsa lexical-analyser lexical-analysis lexical-analyzer

Last synced: 07 Nov 2024

https://github.com/brunocampos01/compiladores

Aulas, exercícios e resumos da matéria introdução à compiladores (INE5622).

compiladores compiler ine ine5622 introducao-a-compiladores java javacc lexical-analyzer semantic-analyzer sintaxis-analyzer ufsc

Last synced: 16 Nov 2024

https://github.com/shakilgithub20/compiler-construction-lab

These are Premier University Compiler-Construction-Lab program (eight semester).

comment-remove compiler-designs computation-of-first-sets computation-of-follow-sets elimination-of-left-factoring elimination-of-left-recursion lexical-analyzer python3 regular-expression

Last synced: 11 Oct 2024

https://github.com/ranaaditya/lex-yacc-programs

first step towards crafting compilers

bison bison-yacc compiler compiler-design flex hacktoberfest hacktoberfest2021 lex lexical-analyzer lexical-parser yaac

Last synced: 21 Nov 2024

https://github.com/pranjay-poddar/compiler-design-mini-project-18csc304j

Compiler Design Mini Project

compiler-design lexical-analyzer linux tokens

Last synced: 29 Oct 2024

https://github.com/ya2ir/c_lexer

C Lexer, Written in C

c lexer lexical-analysis lexical-analyzer tokenization tokenizer

Last synced: 14 Dec 2024

https://github.com/melchisedech333/lex-yacc-experiments

:wrench: My studies involving context-free grammar analysis. The analyzers were built using familiar tools such as YACC, Lex and Bison. Topics covered include token filtering, simple variable manipulation, and arrays.

bison bison-grammar bison-parser bison-yacc compiler-development language-development lex lex-example lex-yacc-parser lexical-analysis lexical-analyzer parser-generator parsing semantic-analysis syntactic-analysis tokenization tokenizer-parser yacc yacc-example yacc-lex

Last synced: 08 Dec 2024

https://github.com/pjiwm/rlox-ast

A Rust implementation for the interpreted language jlox from the book Crafting Interpreters by Robert Nystorm

abstract-syntax-tree dynamically-typed interpreter lexer lexical-analyzer lox-language parser resolver rust scripting-language visitor-pattern

Last synced: 13 Nov 2024

https://github.com/sonus21/c-programm-to-3-address-translator

Translate a C program to 3 Address Code.

bison c c-plus-plus compiler lex lexical-analyzer programming-language yacc

Last synced: 10 Nov 2024

https://github.com/kuanhungchen/spring-2020-compiler-design

🛠 A simple compiler which targets on subset of C language and generates RISC-V assembly code.

code-generator compiler compiler-design lexical-analyzer risc-v syntax-analyzer

Last synced: 10 Nov 2024

https://github.com/amirisback/automata-theory-language

Final Task Auotomata Theory Language

automata final java lexical-analyzer oop task

Last synced: 09 Dec 2024

https://github.com/szilu/symbion-expr

Javascript expression parser/evaluator/solver library

expression expression-evaluator expression-parser expression-tree grammar-rules lexical-analyzer

Last synced: 06 Dec 2024

https://github.com/deveshsangwan/lexical-analyzer-for-c

Lexical analyzer for C programs

flex hacktoberfest lexer lexical-analyzer

Last synced: 14 Nov 2024

https://github.com/sskender/programming-language-translation

Programming Language Translation FER labs

abstract-syntax-tree ast compiler compiler-construction compiler-design fer lexer lexical-analysis lexical-analyzer ll1-grammar ll1-parser parser recursive-descent-parser syntax syntax-analysis syntax-tree syntax-trees token tokens topdown

Last synced: 28 Nov 2024

https://github.com/fadel-hasan/python-compiler

simple python compiler by using flex\bison

bison-flex bison-parser compiler compiler-design flex-bison lex lex-yacc lexer-parser lexical-analysis lexical-analyzer parser parsing python python-compiler python-lex-yacc python-parser python3 yacc

Last synced: 13 Nov 2024

https://github.com/arthursudbrackibarra/lexical-analyzer

A simple lexical analyzer for a custom and fictional programming language.

java lexical-analyzer

Last synced: 29 Nov 2024

https://github.com/tawfik-s/compiler-design

compiler design and analysis phases

compiler compiler-design lexical-analysis lexical-analyzer ll1-grammar

Last synced: 19 Nov 2024

https://github.com/aminul-islam-niloy/compiler-design-using-c-

Compiler Design using C++

compiler first-follow-compiler lexical-analyzer postfix

Last synced: 13 Nov 2024

https://github.com/oguzhan-yilmaz/lexical-analyzer-for-psi-lang

A lexical analyzer for custom defined PSI Language, developed for Programming Languages Course.

c lexical-analyzer

Last synced: 30 Nov 2024

https://github.com/bullheadandplato/compiler-palm-tree

CS462 term project. lexical analyzer and parser for/in C++ language

compiler lexical-analyzer parser

Last synced: 05 Nov 2024

https://github.com/dan-niles/rpal-interpreter

A lexical analyser and parser for the RPAL language, built for CS3513: Programming Languages

lexical-analyzer parser programming-languages rpal

Last synced: 12 Nov 2024

https://github.com/fabiannorbertoescobar/compilador

TP de Lenguajes y Compiladores

asm assembler batch bison c compiladores compiler flex intermediate-code-generation intermediate-language lex lexical-analyzer parser polish-notation reverse-polish-notation sintaxis-analyzer yacc

Last synced: 09 Nov 2024

https://github.com/geovani-moc/analizador-lexico

Analisador léxico para alguns elementos da linguagem C ANSI C89.

analizador-lexico compiler javacc lexical-analyzer

Last synced: 25 Nov 2024

https://github.com/ahmednassar7/lexical-analyzer

A simple java based lexical analyzer

compiler java lexical-analyzer lexical-parser lexical-semantics

Last synced: 06 Nov 2024

https://github.com/akphi/mer-c-less

a simple parser for a simple language

lexical-analyzer parser syntax-analyzer

Last synced: 05 Nov 2024

https://github.com/ambidextrous9/compiler

Implementations of various compiler tools.

compiler compiler-design lexical-analyzer non-recursive parser symbol-table yacc

Last synced: 12 Nov 2024

https://github.com/ahmedfathydev/java-lexical-analyzer

Java lexical analyzer for our compiler course.

compiler csharp java lexical-analyzer

Last synced: 06 Nov 2024

https://github.com/grahms/slang-rust-lexical-analyzer

The SamoraLang Rust Lexical Analyzer is a lexer implemented in Rust for the SamoraLang programming language. This lexer is designed to tokenize SamoraLang source code, providing a foundation for further stages in the language processing pipeline.

lexer lexical-analysis lexical-analyzer rust-lang samora-lang

Last synced: 12 Nov 2024

https://github.com/cryptosingh1337/lexical-analyzer

Lexical Analyzer

java lexical-analyzer spring-boot tailwindcss thymeleaf

Last synced: 09 Nov 2024

https://github.com/liu42/lexicalparser

《编译原理》课程设计，基于有穷自动机的类 C 语言词法分析器

automata compiler course-project grammar-rules homework-project lexical-analysis lexical-analyzer lexical-parser

Last synced: 23 Nov 2024

https://github.com/pkarpovich/kpi-2016

My programming language (KPI-2016 + IDE)

assembler bstu compiler cpp fit ide lexical-analyzer polish-notation semantic-analyzer sintaxis-analyzer smelov

Last synced: 14 Nov 2024

https://github.com/bilalmohib/compiler-construction

Work Related to compiler construction

c compiler lex lexical-analyzer

Last synced: 19 Nov 2024

https://github.com/apurva313/compiler-design

learn to analyze, design, and implement various compiler components, fostering a deep understanding of programming languages, syntax analysis, optimization, and code generation.

compiler-design lexical-analysis lexical-analyzer

Last synced: 19 Nov 2024

https://github.com/sarvesh30112002/sql-analyzer

SQL Analyzer is a software that reads SQL queries, performs token analysis, and evaluates the complexity of the queries. The main goals of this project are to categorize and count different types of tokens, analyze query complexity factors such as joins, subqueries, aggregate functions, and conditions, and provide valuable insights into query.

java jdbc lexical-analyzer semantic-analysis sql sql-analyzer sql-query-analysis syntax-analysis

Last synced: 19 Nov 2024

https://github.com/melgoharyme/java-compiler-5-phases

A project focused on implementing the "Allocate Cursor" statement in a programming language. This repository contains code and documentation for a compiler that parses, analyzes, and generates executable code. Contributions welcome. Licensed under MIT.

code-generation code-optimization java java-compiler java-compiler-in-memory javacompiler lexical-analysis lexical-analyzer oop semantic-analysis syntax-analysis

Last synced: 19 Nov 2024

https://github.com/domamaric/ppj

A FER course, Programming Language Translation, laboratory exercies.

compiler lexical-analyzer ll1-grammar ll1-parser semantic-analyzer syntax-analyzer

Last synced: 09 Nov 2024

https://github.com/tomokimiyauci/lexer

Lexical analyzer for JavaScript

lex lexer lexical-analyzer token tokenizer

Last synced: 21 Nov 2024

https://github.com/hkedia321/lexicalanalyzer

TOC project - Lexical analyzer using php. Try and upload the c_code.c file in the website. Files in the same folder will only be read.

c css html lexical-analyzer php toc

Last synced: 21 Nov 2024

https://github.com/shashwatkathuria/compiler-design-lex-examples

Some examples of lexical analysis.

compiler-design lex lexical-analysis lexical-analyzer lexical-parser

Last synced: 26 Nov 2024

https://github.com/marcosvbras/marvin-the-compiler

compiler lexer lexical-analysis lexical-analyzer python semantic-analysis syntax-analyzer

Last synced: 05 Dec 2024

https://github.com/anupam-io/strange-if-else

A simple bison based parser to detect and solve a strange if-else sequence.

bison compiler flex grammar lex lexical-analyzer yacc

Last synced: 16 Dec 2024

https://github.com/zunainaliazam/langx-compiler

It is a compiler of our custom language LangX which is inspired from Python and C++.

compiler-construction lexical-analyzer parser-generator semantic-analyzer syntax-analyzer

Last synced: 19 Dec 2024

https://github.com/aromalanil/compiler-design-lab

Programs for Compiler Design Lab🧪 of S7 KTU

c compiler compiler-design flex ktu lab lex lexical-analysis lexical-analyzer

Last synced: 13 Dec 2024

https://github.com/uilianries/conan-flex

Conan.io package for GNU Flex

conan flex lexical-analyzer

Last synced: 18 Dec 2024

https://github.com/nandahkrishna/compilerdesignlab

Programs written for the Compiler Design Laboratory in the 6th semester

c c-programming compiler compiler-design compiler-principles compilers lex lexical-analysis lexical-analyzer

Last synced: 03 Dec 2024

https://github.com/chengzeyi/sharpccompiler

Simple compiler. 自制简单语言编译器

compiler lexical-analyzer parser

Last synced: 03 Dec 2024

https://github.com/ssoad/lexical_analyzer

Complex Lexical Analyzer Using Python 3

compiler compiler-design lexical-analysis lexical-analyzer lexical-parser lexical-semantics

Last synced: 12 Nov 2024

https://github.com/saket-sk/semester6-sppu-systems-programming-lab

Collection of codes and assignments I performed for the SL-V Systems Programming Lab (SPPU).

lex lexical-analyzer parser pass-assembler sppu system-programming yacc-lex

Last synced: 10 Nov 2024

https://github.com/tom-weatherhead/thaw-lexical-analyzer

A Node.js lexical analyzer (scanner) that tokenizes text input for a parser. Written in TypeScript.

interpreter lexical-analyzer programming-languages scanner typescript

Last synced: 17 Nov 2024

https://github.com/alphabetsalphabets/kalculator

It's calculator with a 'K'

calculator lexical-analyzer rust rust-lang

Last synced: 20 Nov 2024

https://github.com/gojax64/lexical_analyzer

Lexical analyzer designed in Language Translators II class (compilers) for the following particular grammar. Designed and implemented in the PyQt 6 framework

lexical-analyzer pyqt6

Last synced: 30 Nov 2024

https://github.com/zombotron/analise_lexica_scanner

Analisador léxico que receba um código-fonte como entrada e gera como saída um arquivo que contém a tabela de tokens e a tabela de símbolos.

es6 javascript javascript-es6 lexical-analysis lexical-analyzer node node-js nodejs

Last synced: 30 Nov 2024

https://github.com/yazaldefilimone/letter.parser

📄 | Recursive descent parser | Abstract Syntax Trees | Tokenizer

compiler compiler-design lexical-analyzer parser scanner tokenizer

Last synced: 16 Dec 2024

https://github.com/lsys/lexicaldiversity-example

Hosting MyBinder example for the LexicalRichness package.

binder binder-jupyter-notebook binder-ready binderhub data-mining data-science information-retrieval lexical-analysis lexical-analyzer linguistic-analysis natural-language natural-language-processing nlp python

Last synced: 13 Dec 2024

https://github.com/lu1smgb/mc

Analizador lexico para las prácticas de Modelos de Computación. Curso 2022-2023. Universidad de Granada.

cpp email lex lexical-analyzer modelos-de-computacion

Last synced: 20 Nov 2024

https://github.com/aryanprince/lexical-interpreter-engine

Advanced WinForms drawing app in C# with a custom parser for user commands, enabling variable assignment and dynamic shape generation based on parsed commands.

c-sharp cicd dotnet-framework drawing-library gdi-plus github-actions lexical-analyzer windows-forms

Last synced: 23 Nov 2024

https://github.com/sinipelto/popl-exercises

Principles of Programming Languages Autumn 2019 Course Exercises.

bnf custom-programming-language lexer lexical-analysis lexical-analyzer parser principles programming-language syntax-analysis syntax-tree tokenizer

Last synced: 11 Dec 2024

https://github.com/balintsoos/fordprog

lexical-analysis lexical-analyzer syntax-analysis

Last synced: 17 Dec 2024

https://github.com/edfloreshz/lexical_analysis

This project was made as part of the compiler course for my university.

lexical-analysis lexical-analyzer

Last synced: 19 Dec 2024

https://github.com/haronbh/lexical-analyzer-with-java

Java program serves as a lexical analyzer that validates a specific pattern within a given string. The validation is done based on predefined rules, and it checks if the input string conforms to a certain structure

compilation java lexical-analysis lexical-analyzer parser

Last synced: 01 Dec 2024

https://github.com/markjasongalang/lexical-analyzer-in-cli-using-java

Command-line lexical analyzer which only accepts arithmetic expressions

command-line eclipse-ide integers lexical-analyzer tokenizer

Last synced: 22 Nov 2024

https://github.com/ali7haider/compiler-construction-lab

This repository contains the code and assignments developed during the Compiler Construction Lab taught by Sir Laeeq in the Fall 2024 semester. The focus is on the design and implementation of compilers, covering topics such as lexical analysis, syntax analysis, semantic analysis, and code generation.

compiler compilerconstruction lexer-parser lexical-analyzer parser syntax-analysis syntax-analyzer

Last synced: 09 Nov 2024

https://github.com/junaidsalim/lexical_analyzer

This is our Formal Languages and Automata Theory Project. This repo contains Program of Lexical Analyzer for C++ that will tokenize C++ program.

automata automata-theory cplusplus flex lex lexical-analyzer

Last synced: 18 Dec 2024

https://github.com/sreecharanv/tokenization-and-categorization-using-ocaml-a-lexical-analysis-approach

An OCaml-based lexical analyzer that identifies and classifies tokens such as identifiers, operators, punctuation symbols, integer literals, and keywords. The project involves tokenizing input text, categorizing tokens, and printing them with their respective categories. Key functions include tokenize, is_alnum, is_punctuation, and print_tokens.

lexical-analysis lexical-analyzer ocaml ocaml-program tokenization

Last synced: 12 Oct 2024