https://github.com/brawer/bern-addresses
https://github.com/brawer/bern-addresses
Last synced: 3 months ago
JSON representation
- Host: GitHub
- URL: https://github.com/brawer/bern-addresses
- Owner: brawer
- License: mit
- Created: 2023-04-06T13:48:37.000Z (about 2 years ago)
- Default Branch: main
- Last Pushed: 2025-03-31T11:51:20.000Z (3 months ago)
- Last Synced: 2025-03-31T12:35:26.498Z (3 months ago)
- Language: Python
- Size: 275 MB
- Stars: 1
- Watchers: 3
- Forks: 0
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Bern Address Book
## Setup
```sh
[SEMI-DEPRECATED]
$ git clone https://github.com/brawer/bern-addresses.git
$ cd bern-addresses
$ python3 -m venv venv
$ venv/bin/pip3 install -r requirements.txt
$ venv/bin/python3 src/fetch.py
```
## Input Pipeline
```sh
git restore proofread/
python3 src/convert_hocr_to_plaintext.py
python3 src/cleanup/blackhole_lines.py
python3 src/cleanup/fix_line_order.py
python3 src/cleanup/sanitize.py
python3 src/cleanup/fix_conjunctions.py
python3 src/cleanup/apply_replacement.py
python3 src/cleanup/fix_conjunctions.py
python3 src/cleanup/fix_indentation.py
```
### Processing specific volumes
Use `PROCESS_VOLUMES='1862-07-31,1877-03-31'` to only process a subset of volumes.
## Check a single Excel spreadsheet (before import)
```sh
git pull
venv/bin/python3 src/check_reviewed.py NAME.xlsx
```