Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/bramses/quoordinates
Use OpenAI Embeddings to visualize Kindle Highlights from Readwise!
https://github.com/bramses/quoordinates
embeddings future-of-reading kindle nomic openai readwise supabase
Last synced: 3 months ago
JSON representation
Use OpenAI Embeddings to visualize Kindle Highlights from Readwise!
- Host: GitHub
- URL: https://github.com/bramses/quoordinates
- Owner: bramses
- Created: 2023-07-24T23:42:19.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-05-14T16:48:36.000Z (8 months ago)
- Last Synced: 2024-10-15T07:29:38.430Z (3 months ago)
- Topics: embeddings, future-of-reading, kindle, nomic, openai, readwise, supabase
- Language: JavaScript
- Homepage: https://atlas.nomic.ai/map/2f41176d-366b-4e21-a915-607320cee284/3cdfc12c-dd63-4a08-87ca-063c710379dd
- Size: 22.3 MB
- Stars: 28
- Watchers: 2
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- awesome-readwise - quoordinates - A tool to visualize Kindle Highlights from Readwise using OpenAI Embeddings. (Tools / AI)
README
# Quoordinates (Quote Coordinates)
[**check out the general purpose PostgresDB prototype version of Quoordinates I'm working on -- Commonbase!!**](https://github.com/bramses/commonbase-prototype)
- Readwise
- OpenAI Embeddings
- Nomic
- PSQL (PostgreSQL)
1. fetch highlights from readwise
1. (optional) start at date
2. upsert data in database
3. embed highlights with openai
4. place embeddings into nomic visualization
`embed-into-supabase.js` is a node script that embeds highlights into supabase
`nomic-viz.py` is a python script that visualizes highlights in nomic
`readwise-highlights.py` is a python script that fetches highlights from readwise
## Downstream Dependents
The apps below depend on Quoordinates and display how versatile this technology is:
- [Commonplace Bot](https://github.com/bramses/commonplace-bot) - A Discord Bot where quotes can be surfaced, discussed, and transformed in an MMO like format.
- [Quo Host](https://github.com/bramses/quo-host/tree/main) - A realtime speech to semantic search to "higlight within highlight" surfacer. Sound smarter on podcasts.
- [Kindle Streamer](https://github.com/bramses/kindle-streamer) - Use OCR on a cron job to take a picture of Kindle, and generate a visual bookmark using DALL-E.
## Setup
1. Create a `.env` file with the following variables:
```
READWISE_ACCESS_TOKEN=
SUPABASE_URL=
SUPABASE_KEY=
OPENAI_API_KEY=
OPENAI_ORG=
DAY_LAST_FETCHED=
LOG_PATH=
```
2. Install dependencies
```
poetry init
poetry shell
poetry install
```
and
```
npm install
```
3. Run the script to get readwise highlights
```
python readwise-highlights.py
```
4. Run the script to embed highlights
```
node embed-into-supabase.js
```
5. Run the script to visualize highlights
```
python nomic-viz.py
```
## Other
There are other tools in this repo too!
- [compile quotes](https://github.com/bramses/quoordinates/blob/main/compile-quotes.js) - use k-means to make a cluster of all quotes from a book and give them topic titles
- [share-pic](https://github.com/bramses/quoordinates/blob/28a58bcd27ac8a4d3480129f028d282d3bf138c9/share-pic.js#L461) - use a quote, dalle, and cf images to save a quote and image in one eye catching piece
## Images
