Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/haskell/tokenize

Simple tokenizer for English text
https://github.com/haskell/tokenize

Last synced: about 1 month ago
JSON representation

Simple tokenizer for English text

Awesome Lists containing this project

README

        

[![Hackage version](https://img.shields.io/hackage/v/tokenize.svg?label=Hackage&color=informational)](http://hackage.haskell.org/package/tokenize)
[![tokenize on Stackage Nightly](https://stackage.org/package/tokenize/badge/nightly)](https://stackage.org/nightly/package/tokenize)
[![Stackage LTS version](https://www.stackage.org/package/tokenize/badge/lts?label=Stackage)](https://www.stackage.org/package/tokenize)
[![Cabal build](https://github.com/haskell/tokenize/workflows/Haskell-CI/badge.svg)](https://github.com/haskell/tokenize/actions)

The `tokenize` Package
======================

Simple tokenizer for English text.
Used by `hackage-server`.

See [`tokenize` on Hackage](http://hackage.haskell.org/package/tokenize) for more information.