22 December 2021 Relational reasoning for real-time object searching
Tao Ren, Zhuoran Dong, Fang Qi, Puqing Dong, Shuang Chen
Author Affiliations +
Abstract

We propose a method that can reason and find hidden objects from a set of images. It discovers relationships between all objects detected by a backbone neural network. We focus on object searching and location determination in the real world. Given the name of an object, the system detects the object and outputs a bounding box containing it if it is in sight. Otherwise, the system outputs bounding boxes containing relevant objects around which the target object is most likely to appear. The primary process of the system includes training and reasoning. The former establishes system experience of object relations, and the latter implements object searching based on this experience. The system consists of a relational discovery module and a searching module. We have tested the proposed method on multiple datasets (COCO, PASCAL VOC, and ImageNet) and multiple backbone networks, and the results show that the proposed method has strong robustness and generalizability. The system can continuously highlight the most relevant objects in the line of sight, thus providing hints for approaching and locating the target objects until they are found, and the proposed method can meet the requirements of real time and accuracy if a suitable backbone network is selected.

© 2021 SPIE and IS&T 1017-9909/2021/$28.00 © 2021 SPIE and IS&T
Tao Ren, Zhuoran Dong, Fang Qi, Puqing Dong, and Shuang Chen "Relational reasoning for real-time object searching," Journal of Electronic Imaging 30(6), 063025 (22 December 2021). https://doi.org/10.1117/1.JEI.30.6.063025
Received: 7 April 2021; Accepted: 3 December 2021; Published: 22 December 2021
Lens.org Logo
CITATIONS
Cited by 1 scholarly publication.
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Mining

Detection and tracking algorithms

Target detection

Image classification

Data mining

Video

Glasses

Back to Top