https://github.com/gkovacs/smart-subtitles-extract-subtitle

Subtitle extraction system for Smart Subtitles http://up.csail.mit.edu/other-pubs/chi2014-smartsubs.pdf
https://github.com/gkovacs/smart-subtitles-extract-subtitle

Last synced: about 2 months ago
JSON representation

Subtitle extraction system for Smart Subtitles http://up.csail.mit.edu/other-pubs/chi2014-smartsubs.pdf

• Host: GitHub
• URL: https://github.com/gkovacs/smart-subtitles-extract-subtitle
• Owner: gkovacs
• Created: 2012-09-07T04:31:28.000Z (over 12 years ago)
• Default Branch: master
• Last Pushed: 2019-06-08T01:20:36.000Z (over 5 years ago)
• Last Synced: 2024-04-15T02:58:19.269Z (9 months ago)
• Language: Python
• Homepage:
• Size: 85.9 KB
• Stars: 29
• Watchers: 4
• Forks: 6
• Open Issues: 0
• Metadata Files:
  • Readme: readme.md

Awesome Lists containing this project

README

        
# smart-subtitles-extract-subtitle

## About

Code for our subtitle extraction algorithm used in our CHI 2014 paper: "Smart Subtitles for Vocabulary Learning"

[Paper: CHI 2014](http://up.csail.mit.edu/other-pubs/chi2014-smartsubs.pdf)

[ACM DL](https://dl.acm.org/citation.cfm?id=2557256)

[Video](https://www.youtube.com/watch?v=3j-eXUB3eaA)

[Web app system code](https://github.com/gkovacs/smart-subtitles-system-chi2014)

[Subtitle extraction system code](https://github.com/gkovacs/smart-subtitles-extract-subtitle)

[LaTeX sources for paper](https://github.com/gkovacs/smart-subtitles-paper-chi2014)

## Abstract

Language learners often use subtitled videos to help them learn. However, standard subtitles are geared more towards comprehension than vocabulary learning, as translations are nonliteral and are provided only for phrases, not vocabulary. This paper presents Smart Subtitles, which are interactive subtitles tailored towards vocabulary learning. Smart Subtitles can be automatically generated from common video sources such as subtitled DVDs. They provide features such as vocabulary definitions on hover, and dialog-based video navigation. In our pilot study with intermediate learners studying Chinese, participants correctly defined over twice as many new words in a post-viewing vocabulary test when they used Smart Subtitles, compared to dual Chinese-English subtitles. Learners spent the same amount of time watching clips with each tool, and enjoyed viewing videos with Smart Subtitles as much as with dual subtitles. Learners understood videos equally well using either tool, as indicated by selfassessments and independent evaluations of their summaries.

## License

MIT

## Author

[Geza Kovacs](https://www.gkovacs.com)