skip to main content
10.1145/3072940.3072967acmconferencesArticle/Chapter ViewAbstractPublication PagessiggraphConference Proceedingsconference-collections
other

Transforming the commonplace through machine perception: light field synthesis and audio feature extraction in the rover project

Published: 30 July 2017 Publication History

Abstract

Rover is a mechatronic imaging device inserted into quotidian space, transforming the sights and sounds of the everyday through its peculiar modes of machine perception. Using computational light field photography and machine listening, it creates a kind of cinema following the logic of dreams: suspended but mobile, familiar yet infinitely variable in detail. Rover draws on diverse traditions of robotic exploration, landscape and still-life depiction, and audio field recording to create a hybrid form between photography and cinema. This paper describes the mechatronic, machine perception, and audio-visual synthesis techniques developed for the piece.

Supplementary Material

MP4 File (artpapers-0067.mp4)

References

[1]
V. Vash, "Synthetic Aperture Imaging Using Dense Camera Arrays," PhD Thesis, Stanford University (2007).
[2]
"Integral Photography," Scientific American, 165 (1911).
[3]
M. Levoy and P. Hanrahan, "Light field rendering," Proceedings of the 23rd Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH (1996).
[4]
The Stanford Multi-Camera Array, <https://graphics.stanford.edu/projects/array/>.
[5]
"Light Field Gantry," <http://lightfield.stanford.edu/acq.html>.
[6]
R. Ng, "Light Field Photography with a Hand-Held Plenoptic Camera," Stanford University Computer Science Tech Report CSTR 2005-02 (2005).
[7]
Lytro Illum, <https://www.lytro.com/imaging>.
[8]
W.G. Sebald, Rings of Saturn (New York: New Directions, 1995).
[9]
R. Barthes, Camera Lucida (New York: Hill & Wang, 1980).
[10]
A. Tarkovsky, Instant Light: Tarkovsky Polaroids (London: Thames & Hudson, 2006).
[11]
G. Richter, Gerhard Richter: Landscapes (Ostfildern: Cantz Verlag, 1998) pp. 84--87, 97--99.
[12]
GRBL, an open-source, embedded, high-performance g-code-parser and CNC milling controller written in optimized C, <https://github.com/grbl/grbl>.
[13]
Python / OpenCV Camera Calibration Example, <http://opencv-python-tutroals.readthedocs.io/en/latest/py_tutorials/py_calib3d/py_calibration/py_calibration.html>.
[14]
C. Wu, "VisualSFM: A Visual Structure from Motion System" (2011), <http://ccwu.me/vsfm/>.
[15]
C. Wu, "SiftGPU: A GPU implementation of Scale Invariant Feature Transform (SIFT)" (2007), <http://cs.unc.edu/~ccwu/siftgpu>.
[16]
C. Wu, et al., "Multicore Bundle Adjustment," Proceedings of IEEE CVPR, pp. 3057--3064 (2011).
[17]
N. Collins, SuperCollider Music Information Retrieval Library (SCMIR), <https://composerprogrammer.com/code.html>.
[18]
Black Box 2.0 Festival (6 May--7 June 2015), <http://www.aktionsart.org/allprojects/2015/5/6/black-box-2>.
[19]
Supported by an Amazon Web Services Cloud Credits for Research Grant, awarded December 2016.
[20]
CoreXY Cartesian Motion Platform, <http://corexy.com/theory.html>.

Cited By

View all
  • (2020)Pattern analysis based acoustic signal processing: a survey of the state-of-artInternational Journal of Speech Technology10.1007/s10772-020-09681-3Online publication date: 3-Feb-2020
  • (2019)RoverProceedings of the 2019 on Creativity and Cognition10.1145/3325480.3329184(471-475)Online publication date: 13-Jun-2019

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
SIGGRAPH '17: ACM SIGGRAPH 2017 Art Gallery
July 2017
96 pages
ISBN:9781450349987
DOI:10.1145/3072940
Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 30 July 2017

Check for updates

Qualifiers

  • Other

Conference

SIGGRAPH '17
Sponsor:

Acceptance Rates

Overall Acceptance Rate 1,822 of 8,601 submissions, 21%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)8
  • Downloads (Last 6 weeks)0
Reflects downloads up to 18 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2020)Pattern analysis based acoustic signal processing: a survey of the state-of-artInternational Journal of Speech Technology10.1007/s10772-020-09681-3Online publication date: 3-Feb-2020
  • (2019)RoverProceedings of the 2019 on Creativity and Cognition10.1145/3325480.3329184(471-475)Online publication date: 13-Jun-2019

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media