skip to main content
10.1145/2072298.2072452acmconferencesArticle/Chapter ViewAbstractPublication PagesmmConference Proceedingsconference-collections
demonstration

TapTell: understanding visual intents on-the-go

Published: 28 November 2011 Publication History

Abstract

This demonstration presents a mobile-based visual recognition and recommendation application on Windows Phone 7 called TapTell. This is different from other mobile-based visual search mechanisms which merely focus on the search process. TapTell firstly discovers and understands users' visual intents via a circle based natural user interaction called "O" gestures. Following, a Tap action is operated to choose the "O" gestured regions. The context-aware visual search mechanism is utilized for recognizing the intents and associating them with indexed metadata. Finally, the "Tell" action recommends relevant entities utilizing contextual information. The TapTell system has been evaluated at different scenarios on million scale images.

References

[1]
http://msdn.microsoft.com/en-us/library/bb259689.aspx.
[2]
V. Chandrasekhar phet al. CHoG: Compressed histogram of gradients A low bit-rate feature descriptor. In Proc. of IEEE CVPR, pages 2504--2511, 2009.
[3]
L.-Y. Duan and W. Gao. Side Discriminative Mobile Visual Search. In Workshop on Mobile Visual Search, 2011.
[4]
D. Nister and H. Stewenius. Scalable recognition with a vocabulary tree. In Proc. IEEE CVPR, pages 2161--2168, 2006.
[5]
S. Robertson and H. Zaragoza. The probabilistic relevance framework: BM25 and beyond. Information Retrieval, 3(4):333--389, 2009.
[6]
Z. Zhang, X. Liang, A. Ganesh, and Y. Ma. TILT: transform invariant low-rank textures. Proc. of ACCV, pages 314--328, 2011.

Cited By

View all
  • (2015)Exploratory Product Image Search With Circle-to-Search InteractionIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2014.237227225:7(1190-1202)Online publication date: Jul-2015

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
MM '11: Proceedings of the 19th ACM international conference on Multimedia
November 2011
944 pages
ISBN:9781450306164
DOI:10.1145/2072298

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 28 November 2011

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. mobile recommendation
  2. mobile visual search
  3. visual intent

Qualifiers

  • Demonstration

Conference

MM '11
Sponsor:
MM '11: ACM Multimedia Conference
November 28 - December 1, 2011
Arizona, Scottsdale, USA

Acceptance Rates

Overall Acceptance Rate 2,145 of 8,556 submissions, 25%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)1
  • Downloads (Last 6 weeks)0
Reflects downloads up to 28 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2015)Exploratory Product Image Search With Circle-to-Search InteractionIEEE Transactions on Circuits and Systems for Video Technology10.1109/TCSVT.2014.237227225:7(1190-1202)Online publication date: Jul-2015

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media