Authors:
Madalina Dicu
1
;
Adrian Sterca
1
;
Camelia Chira
1
and
Radu Orghidan
2
Affiliations:
1
Faculty of Mathematics and Computer Science, Babeş-Bolyai University, 1 M. Kogalniceanu, Cluj-Napoca, Romania
;
2
Endava Romania, 51 A. V. Voevod, Cluj-Napoca, Romania
Keyword(s):
UICVD Dataset, Robotic Process Automation, User Interface Recognition, User Interface Understanding, Computer Vision.
Abstract:
This paper introduces the UICVD Dataset, a novel resource fostering advancements in Robotic Process Automation (RPA) and Computer Vision. The paper focuses on recognizing UI (User Interface) components of a web application which is not as well known as recognizing real objects in images in the field of computer vision. This dataset derives from extensive screen captures within an enterprise application, offering a rare, in-depth look at real-world automation and interface scenarios. For RPA, the UICVD Dataset helps in training the machine model of an RPA agent for recognizing various UI components of the web application which is the target of the automation process. In Computer Vision, it serves as an invaluable tool for identifying and understanding user interface elements, ranging from basic icons to intricate structural details. Designed to support a wide spectrum of research and development initiatives, the UICVD Dataset is positioned as a critical asset for technology advancemen
ts in automation and user interface recognition. Its extensive, detailed content and ease of access make it a promising resource for enhancing existing applications and inspiring innovations in RPA and Computer Vision.
(More)