https://github.com/wbsoft/parce

:deciduous_tree: Python lexer that can remember tokens and state and only reparse changed parts of a text document
https://github.com/wbsoft/parce

lexing parsing python3 text tokenizer tree-structure

Last synced: 3 months ago
JSON representation

:deciduous_tree: Python lexer that can remember tokens and state and only reparse changed parts of a text document

• Host: GitHub
• URL: https://github.com/wbsoft/parce
• Owner: wbsoft
• License: gpl-3.0
• Created: 2019-12-12T05:52:54.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2023-06-10T21:06:14.000Z (over 1 year ago)
• Last Synced: 2024-10-16T09:32:53.124Z (3 months ago)
• Topics: lexing, parsing, python3, text, tokenizer, tree-structure
• Language: Python
• Homepage: http://parce.info
• Size: 2.21 MB
• Stars: 10
• Watchers: 2
• Forks: 1
• Open Issues: 1
• Metadata Files:
  • Readme: README.rst
  • Changelog: ChangeLog
  • License: LICENSE

Awesome Lists containing this project

README

        
The parce module

================

::

   import parce

`Homepage       `_                          •

`Development    `_             •

`Download       `_             •

`Documentation  `_                          •

`License        `_

This Python package, `parce`, can be used to lex text into a tree structure

using a language definition. The tree structure can subsequently be queried and

transformed in various powerful ways.

The `parce` module is designed to be very fast, while being written in pure

Python, using native data structures as much as possible. Lexing and

transforming can be done in a background thread.

A key feature of parce is that you can re-lex and re-transform only modified

parts of a text if you already have lexed it. This makes parce suitable for

text editors etc. that need to keep a tokenized structure of the text

up-to-date e.g. to support syntax highlighting as you type.

The module is written and maintained by Wilbert Berendsen. Python 3.5 and

higher is supported. Besides Python itself there are no other dependencies.

Testing is done by running ``pytest-3`` in the root directory.

The logo is a public domain tree image with the name in the Gentium italic font.

Why the name? It's short, sounds like 'parse', and has the meaning of

"friend", "buddy", "bro." :-)