https://github.com/brendano/ark-tweet-nlp

CMU ARK Twitter Part-of-Speech Tagger
https://github.com/brendano/ark-tweet-nlp

Last synced: 3 months ago
JSON representation

CMU ARK Twitter Part-of-Speech Tagger

• Host: GitHub
• URL: https://github.com/brendano/ark-tweet-nlp
• Owner: brendano
• License: other
• Created: 2011-07-15T04:50:16.000Z (over 13 years ago)
• Default Branch: master
• Last Pushed: 2023-12-17T15:42:12.000Z (11 months ago)
• Last Synced: 2024-05-16T14:43:20.780Z (6 months ago)
• Language: Java
• Homepage: http://www.ark.cs.cmu.edu/TweetNLP/
• Size: 58.8 MB
• Stars: 574
• Watchers: 65
• Forks: 202
• Open Issues: 26
• Metadata Files:
  • Readme: README.txt
  • License: LICENSE.txt

Awesome Lists containing this project

README

        
CMU ARK Twitter Part-of-Speech Tagger v0.3.2

http://www.ark.cs.cmu.edu/TweetNLP/

Basic usage for released version

================================

Requires Java 6.  To run the tagger on example data, try:

    java -Xmx500m -jar ark-tweet-nlp-0.3.2.jar examples/example_tweets.txt

where the jar file is the one included in the release download.

The tagger outputs tokens, predicted part-of-speech tags, and confidences.

Use the "--help" flag for more information.  On Unix systems, "./runTagger.sh"

invokes the tagger; e.g.

    ./runTagger.sh examples/example_tweets.txt

    ./runTagger.sh --help

We also include a script that invokes just the tokenizer:

    ./twokenize.sh examples/example_tweets.txt

You may have to adjust the parameters to "java" depending on your system.

If instead you are using a source checkout, see docs/hacking.txt for info.

Information

===========

Version 0.3 of the tagger is much faster and more accurate.  Please see the

tech report on the website for details.

For the Java API, see src/cmu/arktweetnlp; especially Tagger.java.

See also documentation in docs/ and src/cmu/arktweetnlp/package.html.

This tagger is described in the following two papers, available at the website.

Please cite these if you write a research paper using this software.

Part-of-Speech Tagging for Twitter: Annotation, Features, and Experiments

Kevin Gimpel, Nathan Schneider, Brendan O'Connor, Dipanjan Das, Daniel Mills,

  Jacob Eisenstein, Michael Heilman, Dani Yogatama, Jeffrey Flanigan, and 

  Noah A. Smith

In Proceedings of the Annual Meeting of the Association

  for Computational Linguistics, companion volume, Portland, OR, June 2011.

http://www.ark.cs.cmu.edu/TweetNLP/gimpel+etal.acl11.pdf

Part-of-Speech Tagging for Twitter: Word Clusters and Other Advances

Olutobi Owoputi, Brendan O'Connor, Chris Dyer, Kevin Gimpel, and

  Nathan Schneider.

Technical Report, Machine Learning Department. CMU-ML-12-107. September 2012.

Contact

=======

Please contact Brendan O'Connor ([email protected]) and Kevin Gimpel

([email protected]) if you encounter any problems.