At this fall’s interspeech, we’ll be presenting a paper on our prosoBeast, an annotation tool for looking at intonation:
Gerazov B. and M. Wagner (2021). ProsoBeast Prosody Annotation Tool. Proceedings of Interspeech. 2621–2625 [doi][archive] [git] [video]
Abstract:
The labelling of speech corpora is a laborious and time-consuming process. The ProsoBeast Annotation Tool seeks to ease and accelerate this process by providing an interactive 2D representation of the prosodic landscape of the data, in which contours are distributed based on their similarity. This interactive map allows the user to inspect and label the utterances. The tool integrates several state-of-the-art methods for dimensionality reduction and feature embedding, including variational autoencoders. The user can use these to find a good representation for their data. In addition, as most of these methods are stochastic, each can be used to generate an unlimited number of different prosodic maps. The web app then allows the user to seamlessly switch between these alternative representations in the annotation process. Experiments with a sample prosodically rich dataset have shown that the tool manages to find good representations of varied data and is helpful both for annotation and label correction. The tool is released as free software for use by the community.
A 3 min video presentation of the paper is available here: