Tobias Dürschmid
Maximilian Söchting
Amir Semmo
ABSTRACT
With the continuous advances of mobile graphics hardware, high-quality image stylization is becoming feasible and increasingly used in casual creativity apps. The creative expression facilitated by these mobile apps, however, is typically limited with respect to the usage and application of pre-defined visual styles, which ultimately do not include their design and composition---an inherent requirement of prosumers. We present ProsumerFX, a GPU-based app that enables to interactively design parameterizable image stylization components on-device by reusing building blocks. Furthermore, the presentation of the effects can be customized by modifying the icons, names, and order of parameters and presets. Thereby, the customized visual styles are defined as platform-independent effects and can be shared with other users via a web-based platform and database. Together with the presented mobile app, this system approach supports collaborative works for designing visual styles, including their rapid prototyping, A/B testing, publishing, and distribution. Thus, it satisfies the needs for creative expression of both professionals as well as the general public.
Supplemental Material
Available for Download
zip
a1-durschmid.zip (10.6 KB)
Supplemental material.
- Apple Inc. 2015. Model-View-Controller. (21 Oct. 2015). https://developer.apple.com/library/content/documentation/General/Conceptual/DevPedia-CocoaCore/MVC.htmlGoogle Scholar
- Saeideh Bakhshi, David A. Shamma, Lyndon Kennedy, and Eric Gilbert. 2015. Why We Filter Our Photos and How It Impacts Engagement. In Proc. ICWSM. AAAI Press, 12--21. http://www.aaai.org/ocs/index.php/ICWSM/ICWSM15/paper/view/10573/10484Google Scholar
- Luca Benedetti, Holger Winnemöller, Massimiliano Corsini, and Roberto Scopigno. 2014. Painting with Bob: Assisted Creativity for Novices. In Proc. ACM Symposium on User Interface Software and Technology. ACM, New York, 419--428. Google ScholarDigital Library
- Adrien Bousseau, Matt Kaplan, Joëlle Thollot, and François X. Sillion. 2006. Interactive Watercolor Rendering with Temporal Coherence and Abstraction. In Proc. NPAR. ACM, New York, 141--149. Google ScholarDigital Library
- Tolga Capin, Kari Pulli, and Tomas Akenine-Möller. 2008. The State of the Art in Mobile Graphics Research. IEEE Computer Graphics and Applications 28, 4 (2008), 74--84. Google ScholarDigital Library
- Kapil Dev. 2013. Mobile Expressive Renderings: The State of the Art. IEEE Computer Graphics andApplications 33, 3 (2013), 22--31. Google ScholarDigital Library
- Stephen DiVerdi, Aravind Krishnaswamy, Radomir Mäch, and Daichi Ito. 2013. Painting with Polygons: A Procedural Watercolor Engine. IEEE Transactions on Visualization and Computer Graphics 19, 5 (2013), 723--735. Google ScholarDigital Library
- Tobias Dürschmid. 2017. A Framework for Editing and Execution of Image and Video Processing Techniques on Mobile Devices. (26 July 2017).Google Scholar
- Tobias Dürschmid, Matthias Trapp, and Jürgen Döllner. 2017. Towards Architectural Styles for Android App Software Product Lines. In Proc. International Conference on Mobile Software Engineering and Systems. IEEE Press, Piscataway, NJ, USA, 58--62. Google ScholarDigital Library
- Jan Fischer, Michael Haller, and Bruce H Thomas. 2008. Stylized Depiction in Mixed Reality. International Journal of Virtual Reality 7, 4 (Dec. 2008), 71--79. http://mi-lab.org/files/publications2008/fischer2008-ijvr.pdfGoogle Scholar
- Christian Fuchs. 2010. Web 2.0, Prosumption, and Surveillance. Surveillance & Society 8, 3 (2 Sept. 2010), 288--309. https://ojs.library.queensu.ca/index.php/surveillance-and-society/article/view/4165Google Scholar
- Erich Gamma, Richard Helm, Ralph Johnson, and John Vlissides. 1995. Design Patterns - Elements of Reusable Object-Oriented Software. Addison-Wesley. Google ScholarDigital Library
- Leon A. Gatys, Alexander S. Ecker, and Matthias Bethge. 2016. Image Style Transfer Using Convolutional Neural Networks. In Proc. CVPR. IEEE Computer Society, Los Alamitos, 2414--2423.Google ScholarCross Ref
- Tobias Isenberg. 2016. Interactive NPAR: What Type of Tools Should We Create?. In Proc. NPAR. Eurographics Association, Goslar, Germany, 89--96. Google ScholarDigital Library
- Justin Johnson, Alexandre Alahi, and Li Fei-Fei. 2016. Perceptual Losses for Real-Time Style Transfer and Super-Resolution. In Proc. ECCV. Springer International, Cham, Switzerland, 694--711.Google Scholar
- Dongwann Kang and Kyunghyun Yoon. 2015. Interactive Painterly Rendering for Mobile Devices. In Proc. International Conference on Entertainment Computing. Springer International Publishing, Cham, Switzerland, 445--450.Google ScholarDigital Library
- Johannes Kopf, Michael F. Cohen, Dani Lischinski, and Matt Uyttendaele. 2007. Joint Bilateral Upsampling. ACM Transactions on Graphics 26, 3 (July 2007). Google ScholarDigital Library
- Jan Eric Kyprianidis, John Collomosse, Tinghuai Wang, and Tobias Isenberg. 2013. State of the "Art": A Taxonomy of Artistic Stylization Techniques for Images and Video. IEEE Transactions on Visualization and Computer Graphics 19, 5 (May 2013), 866--885. Google ScholarDigital Library
- Junkyu Oh, SeungRol Maeng, and Jinho Park. 2012. Efficient Watercolor Painting on Mobile Devices. International Journal of Contents 8, 4 (2012), 36--41.Google ScholarCross Ref
- David Lorge Parnas. 1972. On the Criteria to Be Used in Decomposing Systems into Modules. Commun. ACM 15, 12 (Dec. 1972), 1053--1058. Google ScholarDigital Library
- Sebastian Pasewaldt, Amir Semmo, Jürgen Döllner, and Frank Schlegel. 2016. BeCasso: Artistic Image Processing and Editing on Mobile Devices. In Proc. SIGGRAPH ASIA Mobile Graphics and Interactive Applications. ACM, New York, 14:1--14:1. Google ScholarDigital Library
- Coimbatore Krishna Prahalad and Venkat Ramaswamy. 2004. The future of competition: Co-creating unique value with customers. Harvard Business Press.Google Scholar
- Emil Praun, Hughes Hoppe, Matthew Webb, and Adam Finkelstein. 2001. Real-Time Hatching. In Proc. SIGGRAPH. ACM, New York, 581--586. Google ScholarDigital Library
- Dirk Riehle, Wolf Siberski, Dirk Bäumer, Daniel Megert, and Heinz Zülighoven. 1997. Pattern Languages of Program Design 3. Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA, Chapter Serializer, 293--312. Google ScholarDigital Library
- George Ritzer, Paul Dean, and Nathan Jurgenson. 2012. The Coming of Age of the Prosumer. American Behavioral Scientist 56, 4 (2012), 379--398.Google ScholarCross Ref
- George Ritzer and Nathan Jurgenson. 2010. Production, Consumption, Prosumption. Journal of Consumer Culture 10, 1 (2010), 13--36.Google ScholarCross Ref
- Paul Rosin and John Collomosse (Eds.). 2013. Image and Video based Artistic Stylisation. Computational Imaging and Vision, Vol. 42. Springer, London/Heidelberg. Google ScholarDigital Library
- Jeremy Selan. 2004. Using Lookup Tables to Accelerate Color Transformations. In GPU Gems. Addison-Wesley, 381--392. http://http.developer.nvidia.com/GPUGems2/gpugems2_chapter24.htmlGoogle Scholar
- Amir Semmo, Jürgen Döllner, and Frank Schlegel. 2016a. BeCasso: Image Stylization by Interactive Oil Paint Filtering on Mobile Devices. In ACM SIGGRAPH 2016 Appy Hour. ACM, New York, 6:1--6:1. Google ScholarDigital Library
- Amir Semmo, Tobias Dürschmid, Matthias Trapp, Mandy Klingbeil, Jürgen Döllner, and Sebastian Pasewaldt. 2016b. Interactive Image Filtering with Multiple Levels-of-control on Mobile Devices. In Proc. SIGGRAPH ASIA Mobile Graphics and Interactive Applications. ACM, New York, 2:1--2:8. Google ScholarDigital Library
- Amir Semmo, Tobias Isenberg, and Jürgen Döllner. 2017a. Neural Style Transfer: A Paradigm Shift for Image-based Artistic Rendering?. In Proc. International Symposium on Non-Photorealistic Animation and Rendering. CM, 5:1--5:13. Google ScholarDigital Library
- Amir Semmo, Daniel Limberger, Jan Eric Kyprianidis, and Jürgen Döllner. 2016c. Image Stylization by Interactive Oil Paint Filtering. Computers & Graphics 55, C (April 2016), 157--171. Google ScholarDigital Library
- Amir Semmo, Matthias Trapp, Jürgen Döllner, and Mandy Klingbeil. 2017b. Pictory: Combining Neural Style Transfer and Image Filtering. In ACM SIGGRAPH 2017 Appy Hour (SIGGRAPH '17). ACM. Google ScholarDigital Library
- Maximilian Söchting. 2017. Design, Implementation and Web-based Provisioning of a Database for Image Processing Operations. (26 July 2017).Google Scholar
- Alvin Toffler. 1980. The Third Wave. Bantam Books.Google Scholar
- Romain Vergne and Pascal Barla. 2015. Designing Gratin, A GPU-Tailored Node-Based System. Journal of Computer Graphics Techniques (JCGT) 4, 4 (Nov. 2015), 54--71. http://jcgt.org/published/0004/04/03/Google Scholar
- Miaoyi Wang, Bin Wang, Yun Fei, Kanglai Qian, Wenping Wang, Jiating Chen, and Jun-Hai Yong. 2014. Towards Photo Watercolorization with Artistic Verisimilitude. IEEE Transactions on Visualization and Computer Graphics 20, 10 (Feb. 2014), 1451--1460.Google ScholarCross Ref
- Daniel Wexler and Gilles Dezeustre. 2012. Intelligent Brush Strokes. In Proc. ACM SIGGRAPH Talks. ACM, New York, NY, USA, 50:1--50:1. Google ScholarDigital Library
- Holger Winnemöller. 2013. NPR in the Wild. In Image and Video based Artistic Stylisation, Paul Rosin and John Collomosse (Eds.). Computational Imaging and Vision, Vol. 42. Springer, London/Heidelberg, Chapter 17, 353--374.Google Scholar
- Holger Winnemöller, Jan Eric Kyprianidis, and Sven Olsen. 2012. XDoG: An eXtended Difference-of-Gaussians Compendium including Advanced Image Stylization. Computers & Graphics 36, 6 (Oct. 2012), 740--753. Google ScholarDigital Library
- Holger Winnemöller, Sven C. Olsen, and Bruce Gooch. 2006. Real-Time Video Abstraction. ACM Transactions on Graphics 25, 3 (July 2006), 1221--1226. Google ScholarDigital Library
Index Terms
- ProsumerFX: mobile design of image stylization components
Recommendations
Graphite: Interactive Photo-to-Drawing Stylization on Mobile Devices
SIGGRAPH '20: ACM SIGGRAPH 2020 Appy HourWe present Graphite, an iOS mobile app that enables users to transform photos into drawings and illustrations with ease. Graphite implements a novel flow-aligned rendering approach that is based on the analysis of local image-feature directions. A ...
Trios: Stylistic Rendering of 3D Photos
SIGGRAPH '22: ACM SIGGRAPH 2022 Appy Hour3D photography has emerged as a medium that provides an immersive dimension to 2D photos. We present Trios, an interactive mobile app that combines the vividness of image-based artistic rendering with 3D photos by implementing an end-to-end pipeline ...
Dynamic ambient lighting for mobile devices
UIST '11 Adjunct: Proceedings of the 24th annual ACM symposium adjunct on User interface software and technologyThe information a small mobile device can show via its display has been always limited by its size. In large information spaces, relevant information, such as important locations on a map can get clipped when a user starts zooming and panning. Dynamic ...
Comments