https://github.com/t94j0/chatbot-tokenizer

Tokenizer for chat messages
https://github.com/t94j0/chatbot-tokenizer

chatbot discord tokenizer

Last synced: 2 months ago
JSON representation

Tokenizer for chat messages

• Host: GitHub
• URL: https://github.com/t94j0/chatbot-tokenizer
• Owner: t94j0
• Created: 2019-02-17T05:20:10.000Z (over 7 years ago)
• Default Branch: master
• Last Pushed: 2019-03-09T22:42:43.000Z (over 7 years ago)
• Last Synced: 2026-02-10T04:32:32.391Z (5 months ago)
• Topics: chatbot, discord, tokenizer
• Language: Python
• Homepage:
• Size: 5.86 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Tokenizer for text messages

## Setup

`pip3 install -U chatbottokenizer`

## Usage

```py

from chatbottokenizer import Tokenizer

INPUT_STRING = '!bot create george'

tokens = Tokenizer('!bot', INPUT_STRING)

if tokens.match('create '):

  items = tokens.items()

  print('Name is: {}'.format(items['name']))

```

Note: `.items()` must be called after a `.match()`