https://github.com/cmkang/CTSN

https://github.com/cmkang/CTSN

Last synced: 3 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/cmkang/CTSN
• Owner: cmkang
• Created: 2016-11-23T12:36:48.000Z (almost 8 years ago)
• Default Branch: master
• Last Pushed: 2016-12-19T02:12:01.000Z (almost 8 years ago)
• Last Synced: 2024-06-28T06:35:37.226Z (5 months ago)
• Size: 4.14 MB
• Stars: 13
• Watchers: 6
• Forks: 6
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# CTSN: Detection and Recognition of Text Embedded in Online Images via Neural Context Models

![alt tag](https://raw.githubusercontent.com/cmkang/CTSN/master/intro.png)

This project hosts the code and dataset for our AAAI 2017 paper [[pdf](https://raw.githubusercontent.com/cmkang/CTSN/master/aaai2017_cameraready.pdf)]

We address the problem of detecting and recognizing the text embedded in online images that are circulated over the Web. 

Our idea is to leverage context information for both text detection and recognition. For detection, we use local image context around the text region, based on that the text often sequentially appear in online images. For recognition, we exploit the metadata associated with the input online image, including tags, comments, and title, which are used as a topic prior for the word candidates in the image. 

To infuse such two sets of context information, we propose a \textit{contextual text spotting network} (CTSN). We perform comparative evaluation with five state-of-the-art text spotting methods on newly collected Instagram and Flickr datasets. We show that our approach that benefits from context information is more successful for text spotting in online images.

##Reference

```

@inproceedings{ctsn:2017:AAAI,

    author    = {Chulmoo Kang, Gunhee Kim and Suk I. Yoo},

    title     = "{Detection and Recognition of Text Embedded in Online Images via Neural Context Models}"

    booktitle = {AAAI},

    year      = 2017

}

```

##Code and Dataset

Comming Soon in February 2017 (before the AAAI2017)

##License

MIT License