{"id":21006236,"url":"https://github.com/derlin/swisstext","last_synced_at":"2025-04-12T07:33:23.986Z","repository":{"id":151664458,"uuid":"143871514","full_name":"derlin/swisstext","owner":"derlin","description":"SwissText: a suite of automated tools for the creation of Swiss German corpora","archived":false,"fork":false,"pushed_at":"2020-07-07T15:09:09.000Z","size":24716,"stargazers_count":5,"open_issues_count":0,"forks_count":0,"subscribers_count":4,"default_branch":"master","last_synced_at":"2025-03-09T11:01:55.371Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://derlin.github.io/swisstext","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"other","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/derlin.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-08-07T12:40:37.000Z","updated_at":"2024-06-22T02:46:04.000Z","dependencies_parsed_at":null,"dependency_job_id":"83dc98c4-1577-4851-b5b9-0c2dde22b8e8","html_url":"https://github.com/derlin/swisstext","commit_stats":null,"previous_names":[],"tags_count":4,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/derlin%2Fswisstext","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/derlin%2Fswisstext/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/derlin%2Fswisstext/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/derlin%2Fswisstext/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/derlin","download_url":"https://codeload.github.com/derlin/swisstext/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":248534008,"owners_count":21120200,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-19T08:50:01.851Z","updated_at":"2025-04-12T07:33:23.954Z","avatar_url":"https://github.com/derlin.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# SwissText\n\nA suite of automated tools for the creation of Swiss German corpora by semi-automated web crawling.\n\n\n\u003cp align=center\u003e ✻ Read the docs https://derlin.github.io/swisstext ✻ \u003c/p\u003e\n\u003cp align=center\u003e ✻ Overview (Google Slides) http://bit.ly/swisstext-slides ✻ \u003c/p\u003e\n\n-------------------------------------------------\n\n**Paper**: (LREC, 2020) \\\n[Automatic Creation of Text Corpora for Low-Resource Languages from the Internet: The Case of Swiss German](https://arxiv.org/abs/1912.00159)\n\n**Citation**:\n```bibtex\n@article{linder2019automatic,\n  title={Automatic Creation of Text Corpora for Low-Resource Languages from the Internet: The Case of Swiss German},\n  author={Linder, Lucy and Jungo, Michael and Hennebert, Jean and Musat, Claudiu and Fischer, Andreas},\n  journal={arXiv preprint arXiv:1912.00159},\n  year={2019}\n}\n```\n→ See the **branch [lrec](https://github.com/derlin/swisstext/tree/lrec)** and \nthe **repository [swisstext-lrec](https://github.com/derlin/swisstext-lrec)** for the exact version used in the paper.\n\n-------------------------------------------------\n\n## Installation and usage\n\nInstall the tools:\n```bash\n# clone\ngit clone git@github.com:derlin/swisstext.git\n# install (note: pass the option -d for editable mode)\n./install.sh\n```\nThis will make the following commands available:\n\n* `st_search`: make queries to a search engine and retrieve potentially interesting URLs;\n* `st_scrape`: visit URLs in order to find new sentences;\n* `st_frontend`: launch a webapp to manage the database, validate and label sentences, propose new seeds and much more.\n\nFind more in the [documentation](https://derlin.github.io/swisstext) or the [overview slides](http://bit.ly/swisstext-slides).\n\n\n-------------------------------------------------\n\nSwissText Crawler (c) by Lucy Linder\n\nThe SwissText Crawler is licensed under a Creative Commons Attribution-NonCommercial 4.0 Unported License.\n\nYou should have received a copy of the license along with this work.  \nIf not, see \u003chttp://creativecommons.org/licenses/by-nc/4.0/\u003e.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fderlin%2Fswisstext","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fderlin%2Fswisstext","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fderlin%2Fswisstext/lists"}