https://github.com/rryi/tokens.jl

parse text into tokens, build memory-efficient token lists and trees,

lexer mutable-strings parser parsing string string-manipulation string-tree string-vector token tokenize

Last synced: 02 Mar 2026