https://github.com/stefan-hoeck/idris2-parser

Total lexer and parser for Idris2
https://github.com/stefan-hoeck/idris2-parser

Last synced: 3 months ago
JSON representation

Total lexer and parser for Idris2

• Host: GitHub
• URL: https://github.com/stefan-hoeck/idris2-parser
• Owner: stefan-hoeck
• License: bsd-3-clause
• Created: 2023-01-03T07:15:18.000Z (almost 2 years ago)
• Default Branch: main
• Last Pushed: 2024-04-05T05:16:24.000Z (8 months ago)
• Last Synced: 2024-04-05T06:26:08.158Z (8 months ago)
• Language: Idris
• Size: 407 KB
• Stars: 8
• Watchers: 3
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# idris2-parser: Total Lexers and Parsers for Idris2

This is a library for writing provably total lexers and parsers

in the Idris programming language. While it provides a domain specific

language (DSL) of combinators similar to what can be found in the

*contrib* library and the Idris compiler API, it's main focus lies

on making the manual writing of lexers and parsers as nice as possible.

There are several advantages to not using a combinator library and

using explicit mutual recursion instead:

* Performance can easily improve by an order of magnitude

* Perfect control over the errors our parsers throw and when they are

  being thrown

* The code is not necessarily more obfuscated

A [tutorial](docs/src/Intro.md) is in the making where the points above

will be addressed.

## parser-toml

The parser-toml sub-project provides a feature-complete, total lexer

and parser for the [TOML config file format](https://toml.io/en/)

implemented manually using the techniques described in the tutorial.

## parser-json

This sub-project provides a lexer and parser for the

[JSON file format](https://en.wikipedia.org/wiki/JSON). They will eventually

replace the lexer and parser currently used in

[idris2-json](https://github.com/stefan-hoeck/idris2-json).

## parser-webidl

As of now, this module provides the most complex parser written in

the manual style presented here:

A full-spec lexer and parser for the

[WebIDL language](https://webidl.spec.whatwg.org/).

They will eventually replace the lexer and parser currently used in

[idris2-webidl](https://github.com/stefan-hoeck/idris2-webidl).

This sub-project not only demonstrates how to manually write a total

parser for a non-trivial language, it also shows, that these

parsers perform considerably better than the ones written with a

combinators library such as the one from contrib: The parser presented

here parses an example WebIDL string of about 2'000 lines of code in

about 8 ms on my machine, while the parser currently in use in the

idris-webidl project takes over 60 ms for the same string.