Canonicalizing the Deutsches Textarchiv

  • Virtually all conventional text-based natural language processing techniques - from traditional information retrieval systems to full-fledged parsers - require reference to a fixed lexicon accessed by surface form, typically trained from or constructed for synchronic input text adhering strictly to contemporary orthographic conventions. Unconventional input such as historical text which violates these conventions therefore presents difficulties for any such system due to lexical variants present in the input but missing from the application lexicon. To facilitate the extension of synchronically-oriented natural language processing techniques to historical text while minimizing the need for specialized lexical resources, one may first attempt an automatic canonicalization of the input text. This paper provides an informal overview of the various canonicalization techniques currently employed by the Deutsches Textarchiv project at the Berlin-Brandenburg Academy of Sciences and Humanities to prepare a corpus of historical German text for part-of-speech tagging, lemmatization, and integration into a robust online information retrieval system.

Download full text files

Export metadata

Additional Services

Share in Twitter Search Google Scholar
Author:Bryan Jurish
Document Type:Conference Proceeding
Date of Publication (online):2013/08/08
Publishing Institution:Berlin-Brandenburgische Akademie der Wissenschaften
Release Date:2013/08/08
GND Keyword:Korpus <Linguistik>; Deutsch
Source:Hafemann, Ingelore (Hrsg.): Perspektiven einer corpusbasierten historischen Linguistik und Philologie : Internationale Tagung des Akademienvorhabens „Altägyptisches Wörterbuch“ an der BBAW, 12.-13. Dezember 2011 (Thesaurus Linguae Aegyptiae ; 4). Berlin, S. 235-244
Institutes:BBAW / Akademienvorhaben Strukturen und Transformationen des Wortschatzes der ägyptischen Sprache. Text- und Wissenskultur im alten Ägypten
Dewey Decimal Classification:4 Sprache / 43 Deutsch, germanische Sprachen allgemein / 430 Germanische Sprachen; Deutsch
Schriftenreihen in Einzelbeiträgen:BBAW / Schriftenreihen / Thesaurus Linguae Aegyptiae / 4.2013 : Perspektiven einer corpusbasierten historischen Linguistik und Philologie
Akzeptieren ✔
            Diese Webseite verwendet technisch erforderliche Session-Cookies. Durch die weitere Nutzung der Webseite stimmen Sie diesem zu.                 Unsere Datenschutzerklärung finden Sie hier.