https://github.com/cfelde/data-wrangling-quotes
Data wrangling quotes with Sigbla
https://github.com/cfelde/data-wrangling-quotes
data-wrangling kotlin quotes sigbla
Last synced: 10 months ago
JSON representation
Data wrangling quotes with Sigbla
- Host: GitHub
- URL: https://github.com/cfelde/data-wrangling-quotes
- Owner: cfelde
- License: unlicense
- Created: 2024-01-21T14:13:19.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2024-01-21T14:14:14.000Z (over 2 years ago)
- Last Synced: 2025-03-30T16:25:51.255Z (about 1 year ago)
- Topics: data-wrangling, kotlin, quotes, sigbla
- Language: Kotlin
- Homepage:
- Size: 15.7 MB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Data wrangling quotes
I have over the last few years captured screenshots on my phone of quotes from the Economist Espresso news app.
Whatever quote I liked at the time I took a screenshot of, and now I wanted to use those quotes for something.
To do that I needed to get the quotes into a text file, which meant doing a few things:
1. Download all the quotes from Google Photos, and crop out just the quote. These are stored in the quotes folder
2. Use the tesseract command line tool to OCR the images into text, see [quotes/ocr.sh](quotes/ocr.sh)
3. Because OCR isn't perfect, I needed to manually inspect and make some changes..
Point 3 is key for what this repo is about. I've been building [Sigbla](https://github.com/sigbla/sigbla-app/) for a
while now and this is the perfect tool for this task.
After running [quotes/txt.sh](quotes/txt.sh) I have a file named output in the quotes folder. It contains all the
quotes using some ad-hoc structure allowing me to easily separate each quote and refer to the relevant image.
Opening the output file in a text editor and then manually opening each image was just too painful. Instead, I wanted
the image to be shown next to the quote so that I could easily spot any issue and fix it without any
hassle.
That's what the code in the [Quotes.kt](src/main/kotlin/Quotes.kt) file does. Load the output file, fix some common
issues, set up the table and image resources, and save any changes to a Sigbla table file. Then I could simply open
this in my browser and quickly go through each quote and fix any issues in no time.
Here's some typical examples of the issues that need fixing from the OCR process. I can simply edit these in the browser
and have that change be stored in the quotes.sigt file for later use.
Data wrangling is often about stuff like this, a one-off task that just needs to be done as quickly and pain free as
possible, and I'm glad my efforts in making [Sigbla](https://sigbla.app) allowed me to write less than 100 lines of
code to aid in that.