Towards Lifelong Human Assisted Speaker DiarizationMeysam Shamsi, Anthony Larcher , Loïc Barrault,, Sylvain Meignier , Yevheni Prokopalo, Marie Tahon, Ambuj Mehrish, Simon Petitrenaud, Olivier Galibert, Samuel Gaist, André Anjos, Sébastien Marcel, Marta Costa-Jussà,

  LIUM - Laboratoire d'Informatique de l'Université du Mans
  Institut Informatique Claude Chappe
  LNE - Laboratoire National de Métrologie et d’Essais
  IDIAP Research Institute




Contact: (meysam.shamsi, anthony.larcher, sylvain.meignier, marie.tahon)@univ-lemans.fr


DOI: https://doi.org/10.1016/j.csl.2022.101437

This paper introduces the resources necessary to develop and evaluate human assisted lifelong learning speaker diarization systems. It describes the ALLIES corpus and associated protocols, especially designed for diarization of a collection audio recordings across time.

This dataset is compared to existing corpora and the performances of three baseline systems, based on x-vectors, i-vectors and VBxHMM, are reported for reference. Those systems are then extended to include an active correction process that efficiently guides a human annotator to improve the automatically generated hypotheses.

An open-source simulated human expert is provided to ensure reproducibility of the human assisted correction process and its fair evaluation. An exhaustive evaluation, of the human assisted correction shows the high potential of this approach.

The ALLIES corpus, a baseline system including the active correction module and all evaluation tools are made freely available to the scientific community. 



Read the PDF

Partagez :