Detection of Birds in a 3D Environment Referring to Audio-Visual Information | IEEE Conference Publication | IEEE Xplore

Detection of Birds in a 3D Environment Referring to Audio-Visual Information


Abstract:

We propose a method to detect birds in a 3D environment referring to both audio information observed from a microphone array and visual information observed from a panora...Show More

Abstract:

We propose a method to detect birds in a 3D environment referring to both audio information observed from a microphone array and visual information observed from a panorama camera. In general, in panorama images, birds appear relatively too small to be detected accurately even with the state-of-the-art deep learning models. Thus, the proposed method takes a two step approach where the birds are first roughly located referring to audio information by Sound Source Localization (SSL), and then image detection is applied within its vicinity. Through evaluation on a dataset annotated with bounding boxes surrounding the birds, we show that the proposed method improves detection performance of birds that appear in relatively small sizes in the image, in both accuracy and processing speed.
Date of Conference: 29 November 2022 - 02 December 2022
Date Added to IEEE Xplore: 24 November 2022
ISBN Information:
Conference Location: Madrid, Spain

References

References is not available for this document.