https://github.com/bsfishy/lexer
https://github.com/bsfishy/lexer
Last synced: 9 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/bsfishy/lexer
- Owner: BSFishy
- License: mit
- Created: 2024-08-08T23:06:32.000Z (almost 2 years ago)
- Default Branch: main
- Last Pushed: 2024-10-07T00:46:09.000Z (almost 2 years ago)
- Last Synced: 2025-09-23T03:52:41.865Z (10 months ago)
- Language: Rust
- Size: 134 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
- License: LICENSE
Awesome Lists containing this project
README
# lexers
This repository contains some experimentation with building lexers. My goal with
this project is to build a couple of different types of lexers with different features
to get to know how to build good lexers.
I am working on implementing the following types of lexers:
- [Recursive descent lexer](./recursive_descent/)
- [Backtracking lexer](./backtracking/)
- State machine lexer
Additionally, I am working on implementing a "more production-ready" lexer, where
I take my learnings from previous experiments and implement more features that I
would want in a production-ready lexer, such as source spans.