Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/haskell/tokenize
Simple tokenizer for English text
https://github.com/haskell/tokenize
Last synced: about 1 month ago
JSON representation
Simple tokenizer for English text
- Host: GitHub
- URL: https://github.com/haskell/tokenize
- Owner: haskell
- License: other
- Created: 2024-04-08T17:21:01.000Z (7 months ago)
- Default Branch: master
- Last Pushed: 2024-09-20T20:03:38.000Z (about 2 months ago)
- Last Synced: 2024-09-29T17:41:25.920Z (about 1 month ago)
- Language: Haskell
- Homepage: https://hackage.haskell.org/package/tokenize
- Size: 13.7 KB
- Stars: 3
- Watchers: 6
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- Changelog: CHANGELOG.md
- License: LICENSE
Awesome Lists containing this project
README
[![Hackage version](https://img.shields.io/hackage/v/tokenize.svg?label=Hackage&color=informational)](http://hackage.haskell.org/package/tokenize)
[![tokenize on Stackage Nightly](https://stackage.org/package/tokenize/badge/nightly)](https://stackage.org/nightly/package/tokenize)
[![Stackage LTS version](https://www.stackage.org/package/tokenize/badge/lts?label=Stackage)](https://www.stackage.org/package/tokenize)
[![Cabal build](https://github.com/haskell/tokenize/workflows/Haskell-CI/badge.svg)](https://github.com/haskell/tokenize/actions)The `tokenize` Package
======================Simple tokenizer for English text.
Used by `hackage-server`.See [`tokenize` on Hackage](http://hackage.haskell.org/package/tokenize) for more information.