https://github.com/adbar/trafilatura

Python & command-line tool to gather text on the Web: web crawling/scraping, extraction of text, metadata, comments

article-extractor corpus corpus-builder corpus-tools crawler html-to-markdown html2text news news-aggregator news-crawler nlp readability rss-feed scraping tei text-cleaning text-extraction text-mining text-preprocessing web-scraping

Last synced: 24 Dec 2025

https://github.com/adbar/German-NLP

Curated list of open-access/open-source/off-the-shelf resources and tools developed with a particular focus on German

computational-linguistics corpus-linguistics german-language natural-language-processing nlp text-mining

Last synced: 14 Mar 2025

https://github.com/adbar/simplemma

Simple multilingual lemmatizer for Python, especially useful for speed and efficiency

corpus-tools language-detection language-identification lemmatiser lemmatization lemmatizer low-resource-nlp morphological-analysis nlp tokenization tokenizer wordlist

Last synced: 24 Dec 2025

https://github.com/adbar/geokelone

integrates spatial and textual data processing tools into a modular software package which features preprocessing, geocoding, disambiguation and visualization

digital-humanities geocoder mapping text-visualization

Last synced: 24 Dec 2025

https://github.com/adbar/flux-toolchain

Filtering and Language-identification for URL Crawling Seeds (FLUCS) a.k.a. FLUX-Toolchain

Last synced: 24 May 2026

https://github.com/adbar/vardial-experiments

Experiments conducted on the occasion of the VarDial shared tasks

Last synced: 26 May 2026

https://github.com/adbar/valency-oriented-chunker

A one-pass FSA valency-oriented chunker for German (proof of concept)

Last synced: 26 May 2026