https://github.com/emanuetre/crossmodal

Python code for the cross-modal retrieval system proposed at ACM MM '10 in "A New Approach to Cross-Modal Multimedia Retrieval"
https://github.com/emanuetre/crossmodal

Last synced: about 2 months ago
JSON representation

Python code for the cross-modal retrieval system proposed at ACM MM '10 in "A New Approach to Cross-Modal Multimedia Retrieval"

• Host: GitHub
• URL: https://github.com/emanuetre/crossmodal
• Owner: emanuetre
• License: isc
• Created: 2015-04-28T22:17:49.000Z (over 9 years ago)
• Default Branch: master
• Last Pushed: 2015-05-04T18:13:14.000Z (over 9 years ago)
• Last Synced: 2024-08-01T02:24:41.624Z (4 months ago)
• Language: Python
• Homepage:
• Size: 1.24 MB
• Stars: 20
• Watchers: 1
• Forks: 5
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-self-supervised-multimodal-learning - Github

README

        
# crossmodal

Python code for the cross-modal retrieval system proposed by N. Rasiwasia, J.C. Pereira, E. Coviello, G. Doyle, G.R.G. Lanckriet, R. Levy, N. Vasconcelos in the ACM MultiMedia '10 paper 

["A New Approach to Cross-Modal Multimedia Retrieval"](http://acsweb.ucsd.edu/~ecoviell/pubs/ANewApproachtoCross-ModalMultimediaRetrieval.pdf).

Dependencies

------------

numpy

sklean 0.16

scipy.io (to read .mat files)

Todo

----

* remove dependency on .mat format

* refactor code to run multiple experiments (CM, SM, SCM)

Citing

------

When using the code or the dataset, please cite:

@inproceedings{rasiwasia2010new,

  title={A new approach to cross-modal multimedia retrieval},

  

  author={Rasiwasia, Nikhil and Costa Pereira, Jose and Coviello, Emanuele and Doyle, Gabriel and Lanckriet, Gert RG and Levy, Roger and Vasconcelos, Nuno},

  

  booktitle={Proceedings of the international conference on Multimedia},

  

  pages={251--260},

  

  year={2010},

  

  organization={ACM}

  

}

@article{costa2014role,

  title={On the role of correlation and abstraction in cross-modal multimedia retrieval},

  

  author={Costa Pereira, Jose and Coviello, Emanuele and Doyle, Gabriel and Rasiwasia, Nikhil and Lanckriet, Gert RG and Levy, Roger and Vasconcelos, Nuno},

  

  journal={Pattern Analysis and Machine Intelligence, IEEE Transactions on},

  

  volume={36},

  

  number={3},

  

  pages={521--535},

  

  year={2014},

  

  publisher={IEEE}

  

}