Araneum Germanicum German Web Corpus

• Crawled in July 2013, January 2014 & February 2015 by SpiderLing 0.72, 0.74 & 0.77, respectively
• TLD restriction initially set to include the most relevant national (.de, .at, .ch, .lu) and generic (.eu, .com, .edu, .info, .org, .net) TLDs only (2013 crawl), later this restriction has been released
• Language similarity threshold set to 0.5
• Tagged by Tree Tagger using the German parameter file based on the Stuttgart-Tübingen Tagset
• Native tagset mapped to Araneum Universal Tagset
• Paragraph-level deduplicated, tokens in duplicate pararaphs marked

Versions available

• Araneum Germanicum Maius: 1,200,000,146 tokens, 875,465,845 unmarked words
• Araneum Germanicum Minus: 120,446,068 tokens, 95,963,273 unmarked words

Revision history

• 15.02 Reprocessed & rededuplicated
• 14.04 First full release
• 13.10 Initial publicly released Minus version