https://github.com/zkemail/archive.zk.email
A repository to store historical, timestamped DKIM keys; and for anyone to upload their own. Basically https://archive.org for public key registries.
https://github.com/zkemail/archive.zk.email
Last synced: 10 months ago
JSON representation
A repository to store historical, timestamped DKIM keys; and for anyone to upload their own. Basically https://archive.org for public key registries.
- Host: GitHub
- URL: https://github.com/zkemail/archive.zk.email
- Owner: zkemail
- License: mit
- Created: 2023-11-29T13:58:12.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2025-07-11T08:00:19.000Z (11 months ago)
- Last Synced: 2025-07-19T21:22:25.452Z (11 months ago)
- Language: TypeScript
- Homepage: https://archive.zk.email
- Size: 1.28 MB
- Stars: 10
- Watchers: 4
- Forks: 8
- Open Issues: 45
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
This repository is part of the [Proof of Email](https://prove.email/) project -- read more at [prove.email/blog/archive](https://prove.email/blog/archive)!
# DKIM archive website
The website lets the user search for a domain and returns archived DKIM selectors and keys for that domain. Visit the website at https://archive.prove.email/
Under `/contribute`, users can contribute with new domains and selectors, which are extracted from the `DKIM-Signature` header field in each email message in the user's Gmail account.
When domains and selectors are added, the site fetches the DKIM key via DNS and stores it in the database.
For each record, the site also generates an on-chain proof with [Witness](https://witness.co), which functions as a data availability timestamp.
## Development
For information on how to help with development, see [development.md](development.md).
## Domain search API
A public API endpoint for fetching keys for a certain domain is available at `https://archive.prove.email/api/key?domain={domain_name}`. The response will contain a list of all known selectors and DKIM keys for `domain_name` and its subdomains.
An example call from the command line:
```bash
curl "https://archive.prove.email/api/key?domain=ethereum.org" | python -m json.tool
```
## Extract domains and selectors from an exported mailbox
The scraper tools (src/util/mbox_scraper.py` and `(src/util/pst_scraper.py`) allow for extacting domains and selectors
from the messages in an email account from any provider, by scraping a file that is exported from the mail account.
### 1. Export email messages
#### a. From Gmail
Go to https://takeout.google.com/settings/takeout and click **Deselect all**, then scroll down and select **Mail**, click **Next step**, and leave the default settings for the export format. When you click **Create export**, you will then get an email in the next few days with a link to download a .mbox file with all your email messages. Download it within 7 days to avoid expiration.
#### b. From Outlook
Go to https://outlook.live.com/mail/0/options/general/export/exportMailbox and click **Export Mailbox**.
It will say 'Status: Export in Progress", then you will get an email in the next few days with a download link to a .pst file.
Continue with [extracting domains and selectors](#archive_extract) from the file.
#### c. From other email providers
The easiest option is if your email provider's web client lets you export emails as an .mbox or a .pst file.
You can then use that feature and continue with [extracting domains and selectors](#archive_extract).
If no export feature is available, an alternative is to connect your email account to a client such as Mozilla Thunderbird, Gnome Evolution or Microsoft Outlook, and use the export feature from within the email client.
### 2. Extract domains and selectors
When you have obtained an .mbox or a .pst file, use `mbox_scraper.py` or `pst_scraper.py` to extract the domains and selectors
Example for .mbox files:
```bash
python3 src/util/mbox_scraper.py inbox.mbox > domains_and_selectors.tsv
```
Example for .pst files:
```bash
pip3 install libpff-python
python3 src/util/pst_scraper.py inbox.pst > domains_and_selectors.tsv
```
The output file, (`domains_and_selectors.tsv` in the examples above), is a [TSV](https://en.wikipedia.org/wiki/Tab-separated_values) file with two columns: domain and selector.
You can now use the .tsv file to contribute to the archive on the [Upload from TSV file](https://archive.prove.email/upload_tsv) page.
# DB Migration Guide
## Modifying the Prisma Database Schema
When you modify the `schema.prisma` file, you need to create and include a migration file. This file contains the SQL commands necessary to update the database structure.
### Creating a Migration File
To create a migration file:
1. Run the following command:
```
pnpm prisma migrate dev --name --create-only
```
Replace `` with a descriptive name for your migration (e.g., `add_index_to_dsp`).
2. Prisma will detect changes in `schema.prisma` and create a migration file that applies these changes to the database.
3. The new migration file will be added to the `prisma/migrations` directory.
### Testing Migrations Locally
To test the migration on a local database:
1. Ensure you are connected to a local database clone.
2. Run the command without the `--create-only` flag:
```
pnpm prisma migrate dev --name
```
This will create the migration file AND apply the changes to your connected database.
### Including Migrations in Pull Requests
Always include the new migration file in your pull request. This ensures that the database is updated correctly during deployment.
### Existing Migrations
You can find previous migration files in the GitHub repository:
[https://github.com/zkemail/archive.prove.email/tree/main/prisma/migrations](https://github.com/zkemail/archive.prove.email/tree/main/prisma/migrations)