short-paper

The VAT: enhanced video analysis

Authors:

Virginia Kuhn,

Alan Craig,

Michael Simeone,

Sandeep Puthanveetil Satheesan,

Luigi MariniAuthors Info & Claims

XSEDE '15: Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure

Article No.: 11, Pages 1 - 4

https://doi.org/10.1145/2792745.2792756

Published: 26 July 2015 Publication History

Get Access

Abstract

The practice of extracting knowledge from large volumes of video data suffers from a problem of variety. Security, military, and commercial identification and retrieval are well-traveled paths for identifying very particular objects or people found in recorded footage, yet there are extremely few established technology solutions and use cases for understanding what large-scale video collections can help us discover about contemporary culture and history. This dearth is not due to a lack of imagination on the part of researchers; rather, we contend, in order to grow a common set of instruments, measures, and procedural methods, there is a need for a common gateway into content and analytics for cultural and historical experts to utilize. The Video Analysis Tableau (VAT), formerly the LSVA, is a research project aimed at establishing a software workbench for video analysis, annotation, and visualization, using both current and experimental discovery methods and built on the Clowder framework/interface. The VAT employs a host of algorithms for machine reading, in addition to spaces for user generated tagging and annotation; it is currently being expanded into a gateway project in order to foster a strong community of practice that includes researchers in a variety of disciplines.

References

[1]

Atkinson, S., Evans, R., and Lehmann, J. 2014. The DEEP FILM Access Project: Ontology and Metadata Design for Digital Film Production Assets. Conference Paper. https://bighumanities.files.wordpress.com/2014/10/atkinson.pdf

Google Scholar

[2]

Bock, D and Kuhn, V. 2013. Bock Movie Cube. Video. https://archive.org/details/BockMovieCube

Google Scholar

[3]

Cutting, J. and Iricinschi, C. 2014. Re-Presentations of Space in Hollywood Movies: An Event-Indexing Analysis. In Cognitive Science. Cognitive Science Society, Inc. DOI= 10.1111/cogs.12151

Crossref

Google Scholar

[4]

Frick, W. 2015. What to Do When People Draw Different Conclusions From the Same Data. Harvard Business Review Blog. Harvard Business School Publishing. https://hbr.org/2015/03/what-to-do-when-people-draw-different-conclusions-from-the-same-data

Google Scholar

[5]

Ferguson, K. L. 2015. Volumetric Cinema. In {in}Transition. New York University Digital Library Technology Services. http://mediacommons.futureofthebook.org/intransition/2015/03/10/volumetric-cinema

Google Scholar

[6]

Henn, S. 2014. When Women Stopped Coding. NPR Planet Money. National Public Radio. http://www.npr.org/blogs/money/2014/10/21/357629765/when-women-stopped-coding

Google Scholar

[7]

Lee, K. 2014. The Gender Gap in Screen Time.The New York Times. http://www.nytimes.com/2014/03/02/movies/awardsseason/cinemetrics-extracts-statistical-data-from-movies.html?hpw&rref=movies&_r=0

Google Scholar

[8]

Manovich, L. 2013. Visualizing Vertov. In Russian Journal of Communication and Cinematicity. Taylor & Francis and Edinburgh University Press. http://softwarestudies.com/cultural_analytics/Manovich.Visualizing_Vertov.2013.pdf

Crossref

Google Scholar

[9]

Moretti, F. 2013. Distant Reading. Book. Verso. London.

Google Scholar

Cited By

View all

Masson EOlesen C(2021)Digital Access as Archival Reconstitution: Algorithmic Sampling, Visualization, and the Production of Meaning in Large Moving Image RepositoriesL'accès numérique comme reconstitution de l’archive : l'échantillonnage algorithmique, visualisation et la production de sens dans les archives d’images en mouvement numérisées à grande échelleSignata10.4000/signata.3011Online publication date: 31-May-2021
https://doi.org/10.4000/signata.3011
Marini LGutierrez-Polo IKooper RSatheesan SBurnette MLee JNicholson TZhao YMcHenry KSanielevici S(2018)ClowderProceedings of the Practice and Experience on Advanced Research Computing: Seamless Creativity10.1145/3219104.3219159(1-8)Online publication date: 22-Jul-2018
https://dl.acm.org/doi/10.1145/3219104.3219159
Satheesan SAlameda JBradley SDietze MGalewsky BJansen GKooper RKumar PLee JMarciano RMarini LMinsker BNavarro CSchmidt ASlavenas MSullivan WZhang BZhao YZharnitsky IMcHenry KSanielevici S(2018)Brown DogProceedings of the Practice and Experience on Advanced Research Computing: Seamless Creativity10.1145/3219104.3219132(1-8)Online publication date: 22-Jul-2018
https://dl.acm.org/doi/10.1145/3219104.3219132
Show More Cited By

Index Terms

The VAT: enhanced video analysis
1. Applied computing
  1. Arts and humanities
    1. Fine arts
    2. Performing arts
2. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Computer vision tasks
        Video summarization

Recommendations

MOVIE: Large Scale Automated Analysis of MOVing ImagEs
XSEDE '14: Proceedings of the 2014 Annual Conference on Extreme Science and Engineering Discovery Environment

In this paper we describe our efforts at establishing a software workbench for video analysis, annotation, and visualization, using both current and experimental discovery methods. This project builds upon our previous research with video and image ...
A longitudinal study of intellectual cohesion in digital humanities using bibliometric analyses

As digital humanities continues to expand and become more inclusive, little is known about the extent to which its knowledge is integrated. A bibliometric analysis of published literature in digital humanities was conducted to examine the degree of its ...
ConfermentSampo – A Knowledge Graph, Data Service, and Semantic Portal for Intangible Academic Cultural Heritage 1643–2023 in Finland
Knowledge Graphs and Semantic Web
Abstract
This article presents a model for representing and studying academic intangible cultural heritage pertaining to conferment ceremonies organized by universities in Europe since the 1100’s. A new Linked Open Data (LOD) service and semantic portal on ...

Comments

Information & Contributors

Information

Published In

XSEDE '15: Proceedings of the 2015 XSEDE Conference: Scientific Advancements Enabled by Enhanced Cyberinfrastructure

July 2015

296 pages

ISBN:9781450337205

DOI:10.1145/2792745

General Chair:
Gregory D. Peterson
National Institute of Computational Sciences

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 26 July 2015

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Short-paper

Funding Sources

National Science Foundation XSEDE program

Conference

XSEDE '15

Sponsor:

San Diego Super Computing Ctr
HPCWire
Omnibond
Indiana University
CASC
NICS
Intel
DDN
CORSA
ALLINEA
RENCI

XSEDE '15: Extreme Science Engineering Discovery Environment 2015 Conference

July 26 - 30, 2015

Missouri, St. Louis

Acceptance Rates

XSEDE '15 Paper Acceptance Rate 49 of 70 submissions, 70%;

Overall Acceptance Rate 129 of 190 submissions, 68%

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

4
Total Citations
View Citations
103
Total Downloads

Downloads (Last 12 months)1
Downloads (Last 6 weeks)0

Reflects downloads up to 07 Mar 2025

Other Metrics

View Author Metrics

Citations

Cited By

View all

Masson EOlesen C(2021)Digital Access as Archival Reconstitution: Algorithmic Sampling, Visualization, and the Production of Meaning in Large Moving Image RepositoriesL'accès numérique comme reconstitution de l’archive : l'échantillonnage algorithmique, visualisation et la production de sens dans les archives d’images en mouvement numérisées à grande échelleSignata10.4000/signata.3011Online publication date: 31-May-2021
https://doi.org/10.4000/signata.3011
Marini LGutierrez-Polo IKooper RSatheesan SBurnette MLee JNicholson TZhao YMcHenry KSanielevici S(2018)ClowderProceedings of the Practice and Experience on Advanced Research Computing: Seamless Creativity10.1145/3219104.3219159(1-8)Online publication date: 22-Jul-2018
https://dl.acm.org/doi/10.1145/3219104.3219159
Satheesan SAlameda JBradley SDietze MGalewsky BJansen GKooper RKumar PLee JMarciano RMarini LMinsker BNavarro CSchmidt ASlavenas MSullivan WZhang BZhao YZharnitsky IMcHenry KSanielevici S(2018)Brown DogProceedings of the Practice and Experience on Advanced Research Computing: Seamless Creativity10.1145/3219104.3219132(1-8)Online publication date: 22-Jul-2018
https://dl.acm.org/doi/10.1145/3219104.3219132
Padhy SAlameda JKooper RLiu RSatheesan SZharnitsky IJansen GDietze MKumar PLee JMarciano RMarini LMinsker BNavarro CSlavenas MSullivan WMcHenry KGaither K(2016)An Architecture for Automatic Deployment of Brown Dog Services at Scale into Diverse Computing InfrastructuresProceedings of the XSEDE16 Conference on Diversity, Big Data, and Science at Scale10.1145/2949550.2949647(1-8)Online publication date: 17-Jul-2016
https://dl.acm.org/doi/10.1145/2949550.2949647

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Abstract

References

Cited By

Index Terms

Recommendations

MOVIE: Large Scale Automated Analysis of MOVing ImagEs

A longitudinal study of intellectual cohesion in digital humanities using bibliometric analyses

ConfermentSampo – A Knowledge Graph, Data Service, and Semantic Portal for Intangible Academic Cultural Heritage 1643–2023 in Finland

Comments

Information

Published In

Sponsors

Publisher

Publication History

Permissions

Check for updates

Author Tags

Qualifiers

Funding Sources

Conference

Acceptance Rates

Contributors

Other Metrics

Bibliometrics

Article Metrics

Other Metrics

Citations

Cited By

Login options

Full Access

View options

PDF

eReader

Share

Share this Publication link

Share on social media

Affiliations