A tendency exists that neural network approaches become increasingly popular among submodules of speaker diarization such as voice activity detection, speaker embedding extraction and clustering. Still, end-to-end speaker diarization training remains a challenging task, partly due to hard loss design for the speaker-label ambiguity problem. Permutation-invariant training (PIT) loss could be a possible solution, but its time complexity exceeds O(N!) where N indicates the number of speakers in the audio. In this paper, we improve the PIT loss and further propose a novel optimal mapping loss which directly computes the best matches between output speakers and target speakers. Our proposed loss is based on the Hungarian algorithm and successfully reduces the time complexity to about O(N3) for large N, while keeping the same performance as PIT loss.
Cite as: Lin, Q., Li, T., Yang, L., Wang, J., Li, M. (2020) Optimal Mapping Loss: A Faster Loss for End-to-End Speaker Diarization. Proc. The Speaker and Language Recognition Workshop (Odyssey 2020), 125-131, doi: 10.21437/Odyssey.2020-18
@inproceedings{lin20_odyssey,
author={Qingjian Lin and Tingle Li and Lin Yang and Junjie Wang and Ming Li},
title={{Optimal Mapping Loss: A Faster Loss for End-to-End Speaker Diarization}},
year=2020,
booktitle={Proc. The Speaker and Language Recognition Workshop (Odyssey 2020)},
pages={125--131},
doi={10.21437/Odyssey.2020-18}
}