{"id":38913779,"url":"https://github.com/wwwehr/hl-evm-block-sync","last_synced_at":"2026-01-17T15:23:53.492Z","repository":{"id":311099440,"uuid":"1041643461","full_name":"wwwehr/hl-evm-block-sync","owner":"wwwehr","description":"Fastest way to pull down hyperliquid evm block files from s3","archived":false,"fork":false,"pushed_at":"2025-08-22T04:06:30.000Z","size":10,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":0,"default_branch":"master","last_synced_at":"2025-08-22T06:22:19.312Z","etag":null,"topics":["hyperliquid-dex","hyperliquid-evm"],"latest_commit_sha":null,"homepage":"","language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/wwwehr.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-08-20T19:47:07.000Z","updated_at":"2025-08-22T04:06:30.000Z","dependencies_parsed_at":"2025-08-22T06:22:24.732Z","dependency_job_id":"af9edfd5-e61f-4dff-abfa-c69b8ae43687","html_url":"https://github.com/wwwehr/hl-evm-block-sync","commit_stats":null,"previous_names":["wwwehr/hl-evm-block-sync"],"tags_count":null,"template":false,"template_full_name":null,"purl":"pkg:github/wwwehr/hl-evm-block-sync","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wwwehr%2Fhl-evm-block-sync","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wwwehr%2Fhl-evm-block-sync/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wwwehr%2Fhl-evm-block-sync/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wwwehr%2Fhl-evm-block-sync/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/wwwehr","download_url":"https://codeload.github.com/wwwehr/hl-evm-block-sync/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/wwwehr%2Fhl-evm-block-sync/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28511384,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-17T13:38:16.342Z","status":"ssl_error","status_checked_at":"2026-01-17T13:37:44.060Z","response_time":85,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["hyperliquid-dex","hyperliquid-evm"],"created_at":"2026-01-17T15:23:52.701Z","updated_at":"2026-01-17T15:23:53.480Z","avatar_url":"https://github.com/wwwehr.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"# 🚀 Hyperliquid DEX – S3Sync Runner\n\nFastest way to pull down evm block files from s3\n\nThis script automates syncing **massive S3 object stores** in a **safe, resumable, and time-tracked way**. The traditional `s3 sync` is just wayy to slow.\n\n## Features\n\n- ✅ Auto-installs [nidor1998/s3sync](https://github.com/nidor1998/s3sync) (latest release) into `~/.local/bin`  \n- ✅ Sequential per-prefix syncs (e.g., `21000000/`, `22000000/`, …)  \n- ✅ Per-prefix timing: `22000000 took 12 minutes!`  \n- ✅ Total runtime summary at the end  \n- ✅ Designed for **tiny files at scale** (EVM block archives)  \n- ✅ Zero-config bootstrap — just run the script  \n\n## Quick Start\n\nInstead of cloning a full repo, you can just download the runner script directly:\n\n```bash\ncurl -L -o s3sync-runner.sh https://raw.githubusercontent.com/wwwehr/hl-evm-block-sync/refs/heads/master/sync.sh\nchmod +x s3sync-runner.sh\n./s3sync-runner.sh\n```\n\n\u003e Skipping to relevant block section\n```bash\n./s3sync-runner.sh --start-at 30000000\n```\n\nThe script will:\n* Install or update s3sync into ~/.local/bin\n* Discover top-level prefixes in your S3 bucket\n* Sync them one at a time, printing elapsed minutes\n\n## Configuration\n\nEdit the top of s3sync-runner.sh if needed:\n```bash\nBUCKET=\"hl-testnet-evm-blocks\"   # could be hl-mainnet-evm-blocks\nREGION=\"ap-northeast-1\"          # hardcoded bucket region\nDEST=\"$HOME/evm-blocks-testnet\"  # local target directory (this is what nanoreth will look at)\nWORKERS=512                      # worker threads per sync (lotsa workers needs lotsa RAM)\n```\n\n## Example Output\n```bash\n[2025-08-20 20:01:02] START  21000000\n[2025-08-20 20:13:15] 21000000 took 12 minutes!\n[2025-08-20 20:13:15] START  22000000\n[2025-08-20 20:26:40] 22000000 took 13 minutes!\n[2025-08-20 20:26:40] ALL DONE in 25 minutes.\n```\n\n## Hackathon Context\n\nThis runner was built as part of the Hyperliquid DEX Hackathon to accelerate:\n* ⛓️ Blockchain archive node ingestion\n* 📂 EVM block dataset replication\n* 🧩 DEX ecosystem data pipelines\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwwwehr%2Fhl-evm-block-sync","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fwwwehr%2Fhl-evm-block-sync","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fwwwehr%2Fhl-evm-block-sync/lists"}