Skip to main content
SpringerLink
Log in

Deep Matting for AR Based Interior Design

  • Conference paper
  • First Online:
Frontiers of Computer Vision (IW-FCV 2020)

Part of the book series: Communications in Computer and Information Science ((CCIS,volume 1212))

Included in the following conference series:

Abstract

In the applications of interior and architectural design, there are various tasks range from ensuring desired floor colors/textures plans, to deciding furnishing arrangement styles: all depending upon the choices of designers themselves. Thus in this modern era of artificial intelligence, computer vision based applications are very popular. Many research studies have been conducted to address different interior design applications using virtual reality technology. However, VR based applications do not provide a realistic experience to the user for interior design. Therefore in this study, we present an Augmented Reality (AR) based end-to-end systematic approach for interior design initialized by deep matting of an indoor scene. In our proposed application, the user has the authority to choose various colors/textures to change the interior of the region of interest in an indoor environment. Our proposed application has different modules working jointly for efficient interactive interior design. It allows the user to select its region of interest (wall or floor) and then give options to choose a color/texture to map on ROI for interior design experience. The final results of our proposed approach give realistic experience to the users as we estimate the global illumination changes on the ROI in our joint modules. Hence in this way, our presented interactive interior design application is user-friendly and works efficiently with realistic looking outputs.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Log in via an institution
Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

Notes

  1. 1.

    http://mrgongan.2hae.net/.

  2. 2.

    http://mrgongan.2hae.net/.

References

  1. Bell, S., Bala, K.: Learning visual similarity for product design with convolutional neural networks. ACM Trans. Graph. (TOG) 34(4), 98 (2015)

    Article  Google Scholar 

  2. Brooker, G., Stone, S.: Re-readings: 2: Interior Architecture and the Principles of Remodelling Existing Buildings. Routledge, London (2019)

    Google Scholar 

  3. Chen, L.C., Zhu, Y., Papandreou, G., Schroff, F., Adam, H.: Encoder-decoder with atrous separable convolution for semantic image segmentation. In: Proceedings of the European Conference on Computer Vision (ECCV), pp. 801–818 (2018)

    Google Scholar 

  4. Chen, Q., Li, D., Tang, C.K.: KNN matting. IEEE Trans. Pattern Anal. Mach. Intell. 35(9), 2175–2188 (2013)

    Article  Google Scholar 

  5. Cho, D., Tai, Y.-W., Kweon, I.: Natural image matting using deep convolutional neural networks. In: Leibe, B., Matas, J., Sebe, N., Welling, M. (eds.) ECCV 2016. LNCS, vol. 9906, pp. 626–643. Springer, Cham (2016). https://doi.org/10.1007/978-3-319-46475-6_39

    Chapter  Google Scholar 

  6. Gastal, E.S., Oliveira, M.M.: Shared sampling for real-time alpha matting. In: Computer Graphics Forum, vol. 29, pp. 575–584. Wiley Online Library (2010)

    Google Scholar 

  7. Grimley, C., Love, M.: The Interior Design Reference & Specification Book Updated & Revised: Everything Interior Designers Need to Know Every Day. Rockport Publishers (2018)

    Google Scholar 

  8. Han, T., Seo, Y.H.: Mixed reality system for virtual interior design. Int. J. Smart Home 7(3), 133–142 (2013)

    Google Scholar 

  9. He, J., Balzano, L., Szlam, A.: Incremental gradient on the Grassmannian for online foreground and background separation in subsampled video. In: 2012 IEEE Conference on Computer Vision and Pattern Recognition, pp. 1568–1575. IEEE (2012)

    Google Scholar 

  10. He, K., Rhemann, C., Rother, C., Tang, X., Sun, J.: A global sampling method for alpha matting. In: CVPR 2011, pp. 2049–2056. IEEE (2011)

    Google Scholar 

  11. Hunt, R.: The Reproduction of Colour, 6th edn. Wiley, Hoboken (2004)

    Book  Google Scholar 

  12. Isola, P., Zhu, J.Y., Zhou, T., Efros, A.A.: Image-to-image translation with conditional adversarial networks. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 1125–1134 (2017)

    Google Scholar 

  13. Nasir, S., Zahid, M.N., Khan, T.A., Kadir, K., Khan, S.: Augmented reality application for architects and interior designers: interno a cost effective solution. In: 2018 IEEE 5th International Conference on Smart Instrumentation, Measurement and Application (ICSIMA), pp. 1–6. IEEE (2018)

    Google Scholar 

  14. Park, J., Sil Kim, S., Park, H., Woo, W.: Dreamhouse: NUI-based photo-realistic AR authoring system for interior design. In: Proceedings of the 7th Augmented Human International Conference 2016, p. 14. ACM (2016)

    Google Scholar 

  15. Phan, V.T., Choo, S.Y.: Interior design in augmented reality environment. Int. J. Comput. Appl. 5(5), 16–21 (2010)

    Google Scholar 

  16. Shahrian, E., Rajan, D., Price, B., Cohen, S.: Improving image matting using comprehensive sampling sets. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 636–643 (2013)

    Google Scholar 

  17. Siltanen, S.: Diminished reality for augmented reality interior design. Vis. Comput. 33(2), 193–208 (2015). https://doi.org/10.1007/s00371-015-1174-z

    Article  MathSciNet  Google Scholar 

  18. Sultana, M., Mahmood, A., Javed, S., Jung, S.K.: Unsupervised deep context prediction for background estimation and foreground segmentation. Mach. Vis. Appl. 30(3), 375–395 (2018). https://doi.org/10.1007/s00138-018-0993-0

    Article  Google Scholar 

  19. Sultana, M., Mahmood, A., Javed, S., Jung, S.K.: Unsupervised RGBD video object segmentation using GANs. arXiv abs/1811.01526 (2018)

    Google Scholar 

  20. Tautkute, I., Trzcinski, T., Skorupa, A., Brocki, L., Marasek, K.: DeepStyle: multimodal search engine for fashion and interior design. IEEE Access 7, 84613–84628 (2019)

    Article  Google Scholar 

  21. Wang, Y., Luo, Z., Jodoin, P.M.: Interactive deep learning method for segmenting moving objects. Pattern Recogn. Lett. 96, 66–75 (2017)

    Article  Google Scholar 

  22. Xu, N., Price, B., Cohen, S., Huang, T.: Deep image matting. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 2970–2979 (2017)

    Google Scholar 

  23. Ye, X., Yang, J., Sun, X., Li, K., Hou, C., Wang, Y.: Foreground-background separation from video clips via motion-assisted matrix restoration. IEEE Trans. Circ. Syst. Video Technol. 25(11), 1721–1734 (2015)

    Article  Google Scholar 

  24. Zhou, B., Zhao, H., Puig, X., Fidler, S., Barriuso, A., Torralba, A.: Scene parsing through ADE20K dataset. In: Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, pp. 633–641 (2017)

    Google Scholar 

  25. Zhou, X., Yang, C., Yu, W.: Moving object detection by detecting contiguous outliers in the low-rank representation. IEEE Trans. Pattern Anal. Mach. Intell. 35(3), 597–610 (2012)

    Article  Google Scholar 

Download references

Acknowledgement

This study was supported by the BK21 Plus project (SW Human Resource Development Program for Supporting Smart Life) funded by the Ministry of Education, School of Computer Science and Engineering, Kyungpook National University, Korea (21A20131600005).

Author information

Authors and Affiliations

  1. Kyungpook National University, Daegu, South Korea

    Maryam Sultana, In Su Kim & Soon Ki Jung

Authors
  1. Maryam Sultana
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. In Su Kim
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Soon Ki Jung
    View author publications

    You can also search for this author in PubMed Google Scholar

Corresponding author

Correspondence to Soon Ki Jung .

Editor information

Editors and Affiliations

  1. Saitama Institute of Technology, Saitama, Japan

    Wataru Ohyama

  2. Kyungpook National University, Daegu, Korea (Republic of)

    Soon Ki Jung

Rights and permissions

Reprints and permissions

Copyright information

© 2020 Springer Nature Singapore Pte Ltd.

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Sultana, M., Kim, I.S., Jung, S.K. (2020). Deep Matting for AR Based Interior Design. In: Ohyama, W., Jung, S. (eds) Frontiers of Computer Vision. IW-FCV 2020. Communications in Computer and Information Science, vol 1212. Springer, Singapore. https://doi.org/10.1007/978-981-15-4818-5_3

Download citation

  • DOI: https://doi.org/10.1007/978-981-15-4818-5_3

  • Published:

  • Publisher Name: Springer, Singapore

  • Print ISBN: 978-981-15-4817-8

  • Online ISBN: 978-981-15-4818-5

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics

Search

Navigation