https://github.com/rocky/p5-lead-sentence

Find leading sentence in some text
https://github.com/rocky/p5-lead-sentence

Last synced: about 1 month ago
JSON representation

Find leading sentence in some text

• Host: GitHub
• URL: https://github.com/rocky/p5-lead-sentence
• Owner: rocky
• Created: 2015-03-10T14:59:49.000Z (almost 10 years ago)
• Default Branch: master
• Last Pushed: 2016-01-09T13:13:13.000Z (almost 9 years ago)
• Last Synced: 2024-08-15T00:28:56.248Z (4 months ago)
• Language: Perl
• Size: 16.6 KB
• Stars: 1
• Watchers: 3
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
Some Perl code I wrote when I worked at the Associated Press to find the leading sentence for some text (news stories).

It uses heuristics for sentence ends:

* Space or quote and space after a dot

* Not space before punctuation mark

* Word with punctuation mark isn't capitalized (could be an abbreviation)

* Word after space is capitalized (Next word starts a sentence)

* Word with punctuation mark isn't capitalized (could be an abbreviation)

* Word with punctuation mark isn't known abbreviation

* Following word with capitalization is known sentence begin word, e.g. The

* Sentence length is at least so many characters

* Sentence length is no more than so many characters.

We rank possible endings and pick the highest one.