• search hit 1 of 1
Back to Result List

For a fistful of blogs: Discovery and comparative benchmarking of republishable German content

  • We introduce two corpora gathered on the web and related to computer-mediated communication: blog posts and blog comments. In order to build such corpora, we addressed following issues: website discovery and crawling, content extraction constraints, and text quality assessment. The blogs were manually classified as to their license and content type. Our results show that it is possible to find blogs in German under Creative Commons license, and that it is possible to perform text extraction and linguistic annotation efficiently enough to allow for a comparison with more traditional text types such as newspaper corpora and subtitles. The comparison gives insights on distributional properties of the processed web texts on token and type level. For example, quantitative analysis reveals that blog posts are close to written language, while comments are slightly closer to spoken language.

Download full text files

Export metadata

Additional Services

Share in Twitter Search Google Scholar
Author:Adrien Barbaresi, Kay-Michael Würzner
Document Type:Conference Proceeding
Date of Publication (online):2015/04/15
Release Date:2015/04/15
Tag:Computer-mediated communication; Corpus linguistics; Text quality assessment; Web crawling
GND Keyword:Linguistik; Korpus <Linguistik>; Computerlinguistik; Web log; Creative Commons; Sprachstatistik
Source:Faaß, Gertrud / Ruppenhofer, Josef (eds.): WORKSHOP PROCEEDINGS OF THE 12TH EDITION OF THE KONVENS CONFERENCE. Hildesheim: 2014, S. 2-10
Institutes:BBAW / Akademienvorhaben Digitales Wörterbuch der Deutschen Sprache
Dewey Decimal Classification:4 Sprache / 40 Sprache / 400 Sprache