Skip to main content

Text Semantics and Layout Defects Detection in Android Apps Using Dynamic Execution and Screenshot Analysis

  • Conference paper
  • First Online:
Information and Software Technologies (ICIST 2018)

Abstract

The paper presents classification of the text defects. It provides a list of user interface text defects and the method based on static/dynamic code analysis for detecting defects in Android applications. This paper proposes a list of static analysis rules for detecting every defect and the tool model implementing those rules. The method and the tool are based on the application of multiple Android application emulators, execution of the application through certain execution paths on multiple hardware and software configurations while taking application screen-shots. The defects are identified by running analysis rules on each taken screen-shot and searching for defect patterns. The results are presented by testing sample Android application.

This is a preview of subscription content, log in via an institution to check access.

Access this chapter

Chapter
USD 29.95
Price excludes VAT (USA)
  • Available as PDF
  • Read on any device
  • Instant download
  • Own it forever
eBook
USD 39.99
Price excludes VAT (USA)
  • Available as EPUB and PDF
  • Read on any device
  • Instant download
  • Own it forever
Softcover Book
USD 54.99
Price excludes VAT (USA)
  • Compact, lightweight edition
  • Dispatched in 3 to 5 business days
  • Free shipping worldwide - see info

Tax calculation will be finalised at checkout

Purchases are for personal use only

Institutional subscriptions

References

  1. Packevičius, Š., Ušaniov, A., Stanskis, Š., Bareiša, E.: The testing method based on image analysis for automated detection of UI defects intended for mobile applications. In: Dregvaite, G., Damasevicius, R. (eds.) ICIST 2015. CCIS, vol. 538, pp. 560–576. Springer, Cham (2015). https://doi.org/10.1007/978-3-319-24770-0_48

    Chapter  Google Scholar 

  2. Rasool, G., Arshad, Z.: A review of code smell mining techniques. J. Softw. Evol. Process 27(11), 867–895 (2015)

    Article  Google Scholar 

  3. Lelli, V., Blouin, A., Baudry, B.: Classifying and qualifying GUI defects. In: 2015 IEEE 8th International Conference on Software Testing, Verification and Validation (ICST) (2015)

    Google Scholar 

  4. Moran, K., et al.: Automated reporting of GUI design violations for mobile apps. In: 40th International Conference on Software Engineering (ICSE 2018) (2018)

    Google Scholar 

  5. Chang, T.-H., Yeh, T., Miller, R.C.: GUI testing using computer vision. In: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, pp. 1535–1544. ACM, Atlanta (2010)

    Google Scholar 

  6. Yeh, T., Chang, T.-H., Miller, R.C.: Sikuli: using GUI screenshots for search and automation. In: Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology, pp. 183–192. ACM, Victoria (2009)

    Google Scholar 

  7. Baek, Y.-M., Bae, D.-H.: Automated model-based Android GUI testing using multi-level GUI comparison criteria. In: Proceedings of the 31st IEEE/ACM International Conference on Automated Software Engineering, pp. 238–249. ACM, Singapore (2016)

    Google Scholar 

  8. Chillarege, R., et al.: Orthogonal defect classification-a concept for in-process measurements. IEEE Trans. Softw. Eng. 18(11), 943–956 (1992)

    Article  Google Scholar 

  9. IEEE Standard Classification for Software Anomalies: IEEE Std 1044-2009 (Revision of IEEE Std 1044-1993), pp. 1–23 (2010)

    Google Scholar 

  10. Beizer, B.: Software Testing Techniques, 2nd edn. Van Nostrand Reinhold Electrical/Computer Science and Engineering Series. Van Nostrand Reinhold. New York (1990). xviii, 290 p.

    Google Scholar 

  11. Johnson, J.: GUI Bloopers 2.0: Common User Interface Design Don’ts and Dos. Morgan Kaufmann Publishers Inc., San Francisco (2007). 424 p.

    Google Scholar 

  12. Li, Y., et al.: DroidBot: a lightweight UI-guided test input generator for Android. In: Proceedings of the 39th International Conference on Software Engineering Companion, pp. 23–26. IEEE Press, Buenos Aires (2017)

    Google Scholar 

  13. Kay, A.: Tesseract: an open-source optical character recognition engine. Linux J. 2007(159), 2 (2007)

    Google Scholar 

  14. Gunning, R.: The fog index after twenty years. J. Bus. Commun. 6(2), 3–13 (1969)

    Article  Google Scholar 

  15. Mailloux, S.L., et al.: How reliable is computerized assessment of readability? Comput. Nurs. 13(5), 221–225 (1995)

    Google Scholar 

  16. Roman-Rangel, E., Marchand-Maillet, S.: Automatic removal of visual stop-words. In: Proceedings of the 22nd ACM International Conference on Multimedia, pp. 1145–1148. ACM, Orlando (2014)

    Google Scholar 

  17. Chen, Y., et al.: Detecting offensive language in social media to protect adolescent online safety. In: 2012 International Conference on Privacy, Security, Risk and Trust and 2012 International Conference on Social Computing (2012)

    Google Scholar 

  18. Anderka, M., Stein, B., Lipka, N.: Detection of text quality flaws as a one-class classification problem. In: Proceedings of the 20th ACM International Conference on Information and Knowledge Management, pp. 2313–2316. ACM, Glasgow (2011)

    Google Scholar 

  19. Shneiderman, B.: Designing computer system messages. Commun. ACM 25(9), 610–611 (1982)

    Article  Google Scholar 

  20. Choi, W., Necula, G., Sen, K.: Guided GUI testing of android apps with minimal restart and approximate learning. SIGPLAN Not. 48(10), 623–640 (2013)

    Article  Google Scholar 

  21. Ganov, S.R., et al.: Test generation for graphical user interfaces based on symbolic execution. In Proceedings of the 3rd International Workshop on Automation of Software Test, pp. 33–40. ACM, Leipzig (2008)

    Google Scholar 

  22. Machiry, A., Tahiliani, R., Naik, M.: Dynodroid: an input generation system for Android apps. In: Proceedings of the 2013 9th Joint Meeting on Foundations of Software Engineering, pp. 224–234. ACM, Saint Petersburg (2013)

    Google Scholar 

  23. Amalfitano, D., et al.: Using GUI ripping for automated testing of Android applications. In: Proceedings of the 27th IEEE/ACM International Conference on Automated Software Engineering. ACM (2012)

    Google Scholar 

  24. Memon, A., Nagarajan, A., Xie, Q.: Automating regression testing for evolving GUI software. J. Softw. Maintenance Evol. Res. Pract. 17(1), 27–64 (2005)

    Article  Google Scholar 

  25. Memon, A., Banerjee, I., Nagarajan, A.: GUI ripping: reverse engineering of graphical user interfaces for testing. In: 2013 20th Working Conference on Reverse Engineering (WCRE). IEEE Computer Society (2003)

    Google Scholar 

  26. Xun, Y., Memon, A.M.: Generating event sequence-based test cases using GUI runtime state feedback. IEEE Trans. Softw. Eng. 36(1), 81–95 (2010)

    Article  Google Scholar 

  27. Su, T., et al.: Guided, stochastic model-based GUI testing of Android apps. In: Proceedings of the 2017 11th Joint Meeting on Foundations of Software Engineering, pp. 245–256. ACM, Paderborn (2017)

    Google Scholar 

  28. Miguel, J.L.S., Takada, S.: Generating test cases for Android applications through GUI modeling, usage modeling, and change analysis. In: Proceedings of the Eighth International C* Conference on Computer Science and Software Engineering, pp. 146–147. ACM, Yokohama (2008)

    Google Scholar 

  29. Su, T.: FSMdroid: guided GUI testing of android apps. In: Proceedings of the 38th International Conference on Software Engineering Companion, pp. 689–691. ACM, Austin (2016)

    Google Scholar 

  30. Zeng, X., et al.: Automated test input generation for Android: are we really there yet in an industrial case? In: Proceedings of the 2016 24th ACM SIGSOFT International Symposium on Foundations of Software Engineering, pp. 987–992. ACM, Seattle (2016)

    Google Scholar 

  31. Baride, S., Dutta, K.: A cloud based software testing paradigm for mobile applications. SIGSOFT Softw. Eng. Notes 36(3), 1–4 (2011)

    Article  Google Scholar 

  32. Starov, O., Vilkomir, S., Kharchenko, V.: Cloud testing for mobile software systems-concept and prototyping. In: ICSOFT (2013)

    Google Scholar 

  33. Chiatti, A., et al.: Text extraction from smartphone screenshots to archive in situ media behavior. In: Proceedings of the Knowledge Capture Conference, pp. 1–4. ACM, Austin (2017)

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Šarūnas Packevičius .

Editor information

Editors and Affiliations

Rights and permissions

Reprints and permissions

Copyright information

© 2018 Springer Nature Switzerland AG

About this paper

Check for updates. Verify currency and authenticity via CrossMark

Cite this paper

Packevičius, Š., Barisas, D., Ušaniov, A., Guogis, E., Bareiša, E. (2018). Text Semantics and Layout Defects Detection in Android Apps Using Dynamic Execution and Screenshot Analysis. In: Damaševičius, R., Vasiljevienė, G. (eds) Information and Software Technologies. ICIST 2018. Communications in Computer and Information Science, vol 920. Springer, Cham. https://doi.org/10.1007/978-3-319-99972-2_22

Download citation

  • DOI: https://doi.org/10.1007/978-3-319-99972-2_22

  • Published:

  • Publisher Name: Springer, Cham

  • Print ISBN: 978-3-319-99971-5

  • Online ISBN: 978-3-319-99972-2

  • eBook Packages: Computer ScienceComputer Science (R0)

Publish with us

Policies and ethics