paper-with-me

홈 › Papers

»textklang« – Towards a Multi-Modal Exploration Platform for German Poetry

2022-06-01 · LREC 2022 6 · Nadja Schauffler, Toni Bernhart, Andre Blessing, Gunilla Eschenbach, Markus Gärtner, Kerstin Jung, Anna Kinder, Julia Koch, Sandra Richter, Gabriel Viehhauser, Ngoc Thang Vu, Lorenz Wesemann, Jonas Kuhn

We present the steps taken towards an exploration platform for a multi-modal corpus of German lyric poetry from the Romantic era developed in the project »textklang«. This interdisciplinary project develops a mixed-methods approach for the systematic investigation of the relationship between written text (here lyric poetry) and its potential and actual sonic realisation (in recitations, musical performances etc.). The multi-modal »textklang« platform will be designed to technically and analytically combine three modalities: the poetic text, the audio signal of a recorded recitation and, at a later stage, music scores of a musical setting of a poem. The methodological workflow will enable scholars to develop hypotheses about the relationship between textual form and sonic/prosodic realisation based on theoretical considerations, text interpretation and evidence from recorded recitations. The full workflow will support hypothesis testing either through systematic corpus analysis alone or with addtional contrastive perception experiments. For the experimental track, researchers will be enabled to manipulate prosodic parameters in (re-)synthesised variants of the original recordings. The focus of this paper is on the design of the base corpus and on tools for systematic exploration – placing special emphasis on our response to challenges stemming from multi-modality and the methodologically diverse interdisciplinary setup.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

An Open-Source Monitoring Framework for Data Exploration and Progress Tracking in Multi-Center Radiology Studies

2026-06-15 · Markus Bujotzek, Jonas Scherer, Stefan Denner, Peter Neher 외 arxiv

Multi-center studies are crucial for advancing medical and radiological research. Data exploration, collaboration discovery, and study progress monitoring are essential for maximizing their potential. However, in practic…

The VoxWorld Platform for Multimodal Embodied Agents

2022-06-01 · LREC 2022 6 · Nikhil Krishnaswamy, William Pickard, Brittany Cates, Nathaniel Blanchard 외

We present a five-year retrospective on the development of the VoxWorld platform, first introduced as a multimodal platform for modeling motion language, that has evolved into a platform for rapidly building and deployin…

multimodal interaction

Excavating in the Wild: The GOOSE-Ex Dataset for Semantic Segmentation

2024-09-27 · Raphael Hagmanns, Peter Mortimer, Miguel Granero, Thorsten Luettel 외

The successful deployment of deep learning-based techniques for autonomous systems is highly dependent on the data availability for the respective system in its deployment environment. Especially for unstructured outdoor…

Semantic Segmentation

Constructing Multimodal Language Learner Texts Using LARA: Experiences with Nine Languages

2020-05-01 · LREC 2020 5 · Elham Akhlaghi, Branislav B{\'e}di, Fatih Bekta{\c{s}}, Harald Berthelsen 외

LARA (Learning and Reading Assistant) is an open source platform whose purpose is to support easy conversion of plain texts into multimodal online versions suitable for use by language learners. This involves semi-automa…

Querying a Dozen Corpora and a Thousand Years with Fintan

2022-06-01 · LREC 2022 6 · Christian Chiarcos, Christian Fäth, Maxim Ionov

Large-scale diachronic corpus studies covering longer time periods are difficult if more than one corpus are to be consulted and, as a result, different formats and annotation schemas need to be processed and queried in …