{"id":13411345,"url":"https://github.com/open-discourse/open-discourse","last_synced_at":"2025-03-14T17:30:39.841Z","repository":{"id":38452000,"uuid":"300547467","full_name":"open-discourse/open-discourse","owner":"open-discourse","description":"Open Discourse is the first fully comprehensive corpus of the plenary proceedings of the federal German Parliament (Bundestag).","archived":false,"fork":false,"pushed_at":"2024-07-22T19:44:13.000Z","size":1758,"stargazers_count":85,"open_issues_count":17,"forks_count":8,"subscribers_count":8,"default_branch":"main","last_synced_at":"2024-07-31T20:45:36.606Z","etag":null,"topics":["bundestag","corpus","data","hacktoberfest"],"latest_commit_sha":null,"homepage":"https://opendiscourse.de","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/open-discourse.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":".github/FUNDING.yml","license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null},"funding":{"github":["open-discourse"],"patreon":"opendiscourse"}},"created_at":"2020-10-02T08:16:15.000Z","updated_at":"2024-07-22T19:54:14.000Z","dependencies_parsed_at":"2024-05-04T09:21:53.704Z","dependency_job_id":"835de17a-e0fe-4b87-854a-de7842cc74d4","html_url":"https://github.com/open-discourse/open-discourse","commit_stats":null,"previous_names":[],"tags_count":5,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/open-discourse%2Fopen-discourse","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/open-discourse%2Fopen-discourse/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/open-discourse%2Fopen-discourse/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/open-discourse%2Fopen-discourse/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/open-discourse","download_url":"https://codeload.github.com/open-discourse/open-discourse/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243618595,"owners_count":20320263,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["bundestag","corpus","data","hacktoberfest"],"created_at":"2024-07-30T20:01:13.048Z","updated_at":"2025-03-14T17:30:39.528Z","avatar_url":"https://github.com/open-discourse.png","language":"Python","funding_links":["https://github.com/sponsors/open-discourse","https://patreon.com/opendiscourse","https://www.patreon.com/opendiscourse","https://www.patreon.com/opendiscourse/"],"categories":["Python"],"sub_categories":[],"readme":"\u003c!-- markdownlint-disable MD033 --\u003e\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"https://opendiscourse.de/\"\u003e\n    \u003cimg\n      alt=\"Open Discourse\"\n      src=\"https://opendiscourse.de/images/github/open-discourse_full_black_transparent.png\"\n      width=\"400\"\n    /\u003e\n  \u003c/a\u003e\n\u003c/p\u003e\n\n# Table of Content\n\n- [Project Status](#project-status)\n- [Project Info](#project-info)\n- [Repository Structure](#repository-structure)\n- [Docker Setup](#docker-setup)\n- [Local Setup](#local-setup)\n  - [Start the Database](#start-the-database)\n    - [Database: Normal Start](#database-normal-start)\n    - [Database: Initial Start / Reset](#database-initial-start--reset)\n  - [Generate Data](#generate-data)\n  - [Start the Full Text Search](#start-the-full-text-search)\n    - [Run Frontend with Docker](#run-frontend-with-docker)\n    - [Run Frontend locally](#run-frontend-locally)\n- [Further Documentation](#further-documentation)\n- [Notes](#notes)\n\n## Project Status\n\n**Note:** This repository is currently **not under active development**. We hope to resume development in the future if we can secure funding through the following platforms:\n\n- [GitHub Sponsors](https://github.com/sponsors/open-discourse)\n- [Patreon](https://www.patreon.com/opendiscourse)\n- Grants or institutional funding\n\nWe sincerely appreciate any financial support which will help us continue improving this project.\n\n### Contributing\n\nWhile we are not actively developing at the moment, contributions from the open-source community are incredibly valuable and encouraged. If you have ideas, bug fixes, or improvements, please feel free create an issue or open a pull request!\n\nThank you for your support and contributions! Together, we can keep this project moving forward.\n\n## Project Info\n\nThe platform is our contribution to democratizing access to political debates and issues.\n\nOpen Discourse is a non-profit project of the employees of Limebit GmbH. The idea emerged from the skills and motivations of the employees, in break conversations and from the common ideas of democracy.\n\nWe hope that through our preliminary work, data-based journalism, science and civil society will benefit and that the facilitated access to data will encourage to analyze the political history of the Bundestag based on the language used by politicians.\n\nWe are happy for every financial support via: https://www.patreon.com/opendiscourse/ or https://github.com/sponsors/open-discourse\n\n## Repository Structure\n\nThis Repo is structured in three different parts.\n\n- [database](./database):\n  - Docker-Container for the Postgres Database\n  - Contains Scripts that update the Database\n- [frontend](./frontend):\n  - Frontend for the Full Text Search\n- [proxy](./proxy):\n  - Docker-Container for the Proxy, which protects the database\n- [python](./python):\n  - Includes every python script in different subsections, sorted by execution order\n\n## Docker Setup\n\nFor a quick setup using Docker, please read the [DOCKER_SETUP](./DOCKER_SETUP.md)\n\n## Local Setup\n\nRequired software:\n[python3](https://www.python.org/downloads/),\n[yarn](https://yarnpkg.com/),\n[docker-compose](https://docs.docker.com/compose/),\n[node version 12](https://nodejs.org/dist/latest-v12.x/docs/api/) - ideally installed via node version manager (nvm)\n\n- run `yarn` in following directories:\n  - `database`\n  - `frontend`\n- run `sh setup.sh` in the `python` directory\n- run `docker-compose build` in the `root` folder\n\n### Start the Database\n\nThese steps will guide you through starting the Database\n\n#### Database: Normal Start\n\nYou can easily start the Database via docker-compose.\n\n```Shell\n// run from repository root\ndocker-compose up -d database\n```\n\n#### Database: Initial Start / Reset\n\nFor the initial start of the Database, you will also need to upload the schema.\n\n```Shell\n// run from database folder\nyarn run db:update:local\n```\n\n### Generate Data\n\nGenerate the OpenDiscourse-Database from the ground up. The Database has to be started for this script to finish.\n\nThis script is just a pipeline executing all scripts in `src`. You can also manually run every script seperatly. For Documentation on this, please visit the [README in src](./python/src/README.md)\n\n```Shell\n// run from python folder\nsh build.sh\n```\n\n### Start the Full Text Search\n\n_Note:_ All of the previous steps have to be completed at least once for the Full Text Search to work properly.\n\nIf you want to setup the Full Text Search, follow these steps:\n\n- run `yarn` in following directories:\n  - `frontend`\n  - `proxy`\n\nChoose one of the following ways to start the Frontend:\n\n#### Run Frontend with Docker\n\n- run `docker-compose up -d` in the `root` folder\n\n#### Run Frontend locally\n\n- run `docker-compose up -d database proxy`in the `root` folder\n- run `yarn dev` in the `frontend` folder\n\n## Further Documentation\n\n- Documentation of the database can be found in the [README in database](./database/README.md)\n- Documentation of the frontend can be found in the [README in frontend](./frontend/README.md)\n- Documentation of the proxy can be found in the [README in proxy](./proxy/README.md)\n- Documentation of the python service can be found in the [README in python](./python/README.md)\n- Documentation of every python-script can be found in the [README in python/src](./python/src/README.md)\n\n## Notes\n\n- We use [Python 3.7.4](https://www.python.org/downloads/release/python-374/) [d](https://bit.ly/2KE5DFm)uring development of the project\n- The graphql endpoint was deprecated and removed by version 1.1.0\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopen-discourse%2Fopen-discourse","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fopen-discourse%2Fopen-discourse","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fopen-discourse%2Fopen-discourse/lists"}