Dataset of audiovisual unscripted monologues with speech annotations.

Overview

1. Neuropsychology Lab, Department of Psychology, Carl von Ossietzky Universität Oldenburg, Oldenburg, Germany
2. Department of Medical Physics and Acoustics, Carl von Ossietzky Universität Oldenburg, Oldenburg, Germany
3. Translational Psychology, Department of Psychology, Carl von Ossietzky Universität Oldenburg, Oldenburg, Germany
4. Research Center for Neurosensory Science, Carl von Ossietzky Universität Oldenburg, Oldenburg, Germany

Abstract

This article presents a publicly accessible multimodal dataset comprising audiovisual recordings of unscripted German monologues and a corresponding time-resolved linguistic speech annotation corpus. The audiovisual dataset consists of more than 300 minutes of natural speech material recorded from six speakers across 60 takes. Recordings were captured using a Canon EOS 700D camera and a Neumann KM-184 microphone, with audio sampled at 48 kHz and video at 25 frames per second. Speakers produced spontaneous monologues on self-selected everyday topics under controlled laboratory conditions. Recording sessions included variations such as background babble noise presented via in-ear headphones and optional visual modifications, including the use of glasses or lipstick. Audio and video were acquired simultaneously, synchronized during post-processing, and segmented into individual stories.

The accompanying speech annotation corpus provides detailed linguistic information aligned with the audiovisual material at millisecond resolution. An annotation pipeline combining established tools—OCTRA, G2P, MAUS, PHO2SYL, and the RFTagger—was used to derive orthographic transcripts, canonical phonological representations, phonetic segmentations, syllabification, and part-of-speech tags. Manual correction steps were applied to ensure transcription accuracy and to improve the quality of forced alignment. Each recording is accompanied by an events.tsv file containing time-stamped word, phoneme, and pause annotations; a JSON sidecar describing variable metadata; and a machine-actionable HED-formatted event file to support integration with neuroimaging standards such as BIDS. The structure of the resource follows a consistent file-naming scheme to ensure reliable linkage between audiovisual recordings and speech annotations.

This combined audiovisual and linguistic resource supports a wide range of reuse applications, including acoustic-phonetic analysis, linguistic and neurolinguistic research, annotation benchmarking, and the development or evaluation of speech-processing tools. The resource’s naturalistic content and high temporal precision enable detailed examination of spontaneous speech and facilitate replication-oriented research across disciplines.

Reproduced under the paper's license (CC BY), from the paper cited above.

Code

No file of the authors' code could be read here: it is described below, and read at its source.

Tracing map

Proposed by the machine: these links were found in the paper and verified at the source, without human review. The map will receive a Zenodo DOI once one of the paper's authors has validated it with their ORCID.

What the map holds:

• 1 repository of the authors' code, each at its verified commit, with its license and how the link was found in the paper;
• 0 scripts, each with its path and the digest of its content;
• no match between paragraphs and code yet;
• neither the text of the paper nor the code itself.

Its JSON (tracing-map.json) is deposited on Zenodo with its DOI once the map is validated.

Data

Datasets cited

• zenodo:13341921 — at Zenodo; found in the references
• zenodo:8082844 — at Zenodo; found in the references

Versions

The history of this record: each version stored by the harvester or made by a correction of its authors or of the maintainers of its code, and what changed in its facts. The texts of the paper (its abstract, its availability statements) are not part of it; versions that changed only those are not listed.

Version 1, 27 September 2026: the first record

Recorded: type, language, journal, volume, pages, dates, 4 authors, 3 keywords, 1 funder, 7 references.

Cite

This paper

Jaeger, M., Daeglau, M., Grimm, G., & Bleichner, M. G. (2026). Dataset of audiovisual unscripted monologues with speech annotations. Data in brief, 67, 112932. https://doi.org/10.1016/j.dib.2026.112932

The tracing map gets a citation of its own once an author has validated it and it has a DOI.

Similar papers

The papers with a page that share the most with this one: the tools found in their code, their categories, datasets, cited references and authors, the rarest counting most.

[1] doi:10.1111/psyp.70360

The Effect of Task Demand on EEG Responses to Irrelevant Sound and Speech in Simulated Surgical Environments.

Journal: Psychophysiology

In common: Zenodo 8082844, 1 reference

[2] doi:10.1371/journal.pbio.3003876 [code]

Competing speech streams are simultaneously represented in the human cortex during attention switching.

Journal: PLoS biology

In common: 1 reference

Contribute

The authors of this paper can claim it, correct its record and validate its tracing map, and the maintainers of its code (its owner, or a public member of its organization) correct what it says of their repository; anyone signed in can ask for its removal. Every request goes to OSCR's own machine, which answers it; your account page follows them.

Request its removal

To ask OSCR to remove this record, the copies of its authors' scripts or its tracing map, use the removal request page: signed in, you say who you are, what to remove and why, then review and confirm the request. Published rules decide every request (how).

Discussion: questions and error reports about this paper and its code, from signed-in readers and its authors. It opens with sign-in.

Reproductions: reports from readers who ran the authors' code: what they reproduced, with which environment, commit and data. It opens with sign-in.

Activity: what happens around this paper: new versions of its record, its map's validation, discussions and reproductions. It opens with sign-in.