Abstract
Cross-browser incompatibilities (XBIs) are defined as inconsistencies that can be observed in Web applications when they are rendered in a specific browser compared to others. These inconsistencies are associated with differences in the way each browser implements its capabilities and renders Web applications. The inconsistencies range from minor layout differences to lack of core functionalities of Web applications when rendered in specific browsers. The state of the art proposes different approaches for detecting XBIs and many of them are based on classification models, using features extracted from the document object model (DOM) structure (DOM-based approaches) and screenshots (computer vision approaches) of Web applications. To the best of our knowledge, a comparison between DOM-based and computer vision classification models has not yet been reported in the literature, and a combination between both approaches could possibly lead to increased accuracy of classification models. In this article, we extend the use of these classification models for detecting layout XBIs in responsive design Web applications, rendered on different browser viewport widths and devices (iPhone 12 mini, iPhone 12, iPhone 12 Pro Max, and Pixel XL). We investigate the use of state-of-the-art classification models (Browserbite, CrossCheck, and our previous work) for detecting layout cross-browser failures, which consist of layout XBIs that negatively affect the layout of responsive design Web applications. Furthermore, we propose an enhanced classification model that combines features from different state-of-the-art classification models (DOM based and computer vision) using feature selection. We built two datasets for evaluating the efficacy of classification models in separately detecting external and internal layout failures using data from 72 responsive design Web applications. The proposed classification model reported the highest F1-score for detecting external layout failures (0.65) and internal layout failures (0.35), and these results reported significant differences compared to Browserbite and CrossCheck classification models. Nevertheless, the experiment showed a lower accuracy in the classification of internal layout failures and suggests the use of other image similarity metrics or deep learning models for increasing the efficacy of classification models.
- 2001. Random forests. Machine Learning 45, 1 (
Oct. 2001), 5–32. Google ScholarDigital Library . - 2011. Detecting cross-browser issues in web applications. In Proceedings of the 33rd International Conference on Software Engineering (ICSE’11). 1146–1148. Google ScholarDigital Library .
- 2012. CrossCheck: Combining crawling and differencing to better detect cross-browser incompatibilities in web applications. In Proceedings of the 5th International Conference on Software Testing, Verification, and Validation (ICST’12). 171–180. Google ScholarDigital Library .
- 2013. X-PERT: Accurate identification of cross-browser issues in web applications. In Proceedings of the 35th International Conference on Software Engineering (ICSE’13). 702–711. Google ScholarCross Ref .
- 2010. A cross-browser web application testing tool. In Proceedings of the 2010 IEEE International Conference on Software Maintenance (ICSM’10). 1–6. Google ScholarDigital Library .
- 2014. X-PERT: A web application testing tool for cross-browser inconsistency detection. In Proceedings of the 2014 International Symposium on Software Testing and Analysis (ISSTA’14).ACM, New York, NY, 417–420. Google ScholarDigital Library .
- 2012. WebMate: A tool for testing Web 2.0 applications. In Proceedings of the Workshop on JavaScript Tools (JSTools’12).ACM, New York, NY, 11–15. Google ScholarDigital Library .
- 2014. WebMate: Web application test generation in the real world. In Proceedings of the Workshops of the IEEE 7th International Conference on Software Testing, Verification, and Validation Workshops (ICSTW’14). 413–418. Google ScholarDigital Library .
- 2016. X-Check: A novel cross-browser testing service based on record/replay. In Proceedings of the 2016 IEEE International Conference on Web Services (ICWS’16). 123–130. Google ScholarCross Ref .
- 2014. Feature selection: A literature review. Smart Computing Review 4, 3 (2014), 211–229.Google ScholarDigital Library .
- 2017. A method for multi-class sentiment classification based on an improved one-vs-one (OVO) strategy and the support vector machine (SVM) algorithm. Information Sciences 394–395 (2017), 38–52. Google ScholarDigital Library .
- 2017. Automated repair of layout cross browser issues using search-based techniques. In Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA’17). ACM, New York, NY, 249–260. Google ScholarDigital Library .
- 2011. Automated cross-browser compatibility testing. In Proceedings of the 33rd International Conference on Software Engineering (ICSE’11).ACM, New York, NY, 561–570. Google ScholarDigital Library .
- 2018. Layout cross-browser incompatibility detection using machine learning and DOM segmentation. In Proceedings of the 33rd Annual ACM Symposium on Applied Computing (SAC’18). ACM, New York, NY, 2159–2166. Google ScholarDigital Library .
- 2011. Evaluation: From precision, recall and F-measure to ROC, informedness, markedness, and correlation. Journal of Machine Learning Technologies 2, 1 (2011), 37–63.Google ScholarCross Ref .
- 1986. Induction of decision trees. Machine Learning 1, 1 (
March 1986), 81–106. Google ScholarCross Ref . - 2016. Multilayer perceptron: Architecture optimization and training. International Journal of Interactive Multimedia and Artificial Intelligence 4, 1 (2016), 26–30.Google ScholarCross Ref .
- 2005. Decision trees. In Data Mining and Knowledge Discovery Handbook. Springer, 165–192. Google ScholarCross Ref .
- 2014. Cross-Browser Testing in Browserbite. Springer International Publishing, Cham, Switzerland, 503–506. Google ScholarCross Ref .
- 2016. Browserbite: Cross-browser testing via image processing. Software: Practice and Experience 46, 11 (
Nov. 2016), 1459–1477. Google ScholarDigital Library . - 2015. Automatic deformations detection in Internet interfaces: ADDII. In Human-Computer Interaction: Users and Contexts. Lecture Notes in Computer Science, Vol. 9171. Springer, 43–53. Google ScholarCross Ref
- 2017. ReDeCheck: An automatic layout failure checking tool for responsively designed web pages. In Proceedings of the 26th ACM SIGSOFT International Symposium on Software Testing and Analysis (ISSTA’17). ACM, New York, NY, 360–363. Google ScholarDigital Library .
- 2019a. Layout cross-platform and cross-browser incompatibilities detection using classification of DOM elements. ACM Transactions on the Web 13, 2 (March 2019), Article 12, 27 pages. Google ScholarDigital Library .
- 2019b. Towards cross-browser incompatibilities detection: A systematic literature review. International Journal of Software Engineering & Applications 10, 6 (Nov. 2019), Article 12, 15 pages. Google ScholarCross Ref .
- 1982. On testing non-testable programs. Computer Journal 25, 4 (1982), 465–470. Google ScholarCross Ref .
- 2016. Tuning kernel parameters for SVM based on expected square distance ratio. Information Sciences 370–371 (2016), 92–102. Google ScholarDigital Library .
Index Terms
- Layout Cross-Browser Failure Classification for Mobile Responsive Design Web Applications: Combining Classification Models Using Feature Selection
Recommendations
Layout Cross-Platform and Cross-Browser Incompatibilities Detection using Classification of DOM Elements
Web applications can be accessed through a variety of user agent configurations, in which the browser, platform, and device capabilities are not under the control of developers. In order to grant the compatibility of a web application in each ...
Layout cross-browser incompatibility detection using machine learning and DOM segmentation
SAC '18: Proceedings of the 33rd Annual ACM Symposium on Applied ComputingCross-Browser Incompatibilities, namely XBIs, are differences in the behavior of web applications as they are rendered in distinct browser implementations. Web applications can be rendered in a wide variety of configuration environments, varying their ...
Classifier and feature set ensembles for web page classification
Web page classification is an important research direction on web mining. The abundant amount of data available on the web makes it essential to develop efficient and robust models for web mining tasks. Web page classification is the process of ...
Comments