{"id":47184559,"url":"https://github.com/austintgriffith/ethskills-research","last_synced_at":"2026-03-13T08:36:38.781Z","repository":{"id":338274066,"uuid":"1157298987","full_name":"austintgriffith/ethskills-research","owner":"austintgriffith","description":"Research lab for ethskills.com — baseline audits, gap analysis, content mining","archived":false,"fork":false,"pushed_at":"2026-03-07T02:11:29.000Z","size":170,"stargazers_count":3,"open_issues_count":1,"forks_count":1,"subscribers_count":0,"default_branch":"master","last_synced_at":"2026-03-07T09:44:18.325Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/austintgriffith.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2026-02-13T16:57:31.000Z","updated_at":"2026-03-07T02:11:34.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/austintgriffith/ethskills-research","commit_stats":null,"previous_names":["austintgriffith/ethskills-research"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/austintgriffith/ethskills-research","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/austintgriffith%2Fethskills-research","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/austintgriffith%2Fethskills-research/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/austintgriffith%2Fethskills-research/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/austintgriffith%2Fethskills-research/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/austintgriffith","download_url":"https://codeload.github.com/austintgriffith/ethskills-research/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/austintgriffith%2Fethskills-research/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":30462543,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-03-13T06:34:02.089Z","status":"ssl_error","status_checked_at":"2026-03-13T06:33:49.182Z","response_time":60,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2026-03-13T08:36:38.126Z","updated_at":"2026-03-13T08:36:38.761Z","avatar_url":"https://github.com/austintgriffith.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"# ethskills-research\n\nResearch lab for [ethskills.com](https://ethskills.com) — figuring out what LLMs don't know about Ethereum.\n\n## What's Here\n\n### `/results/` — Baseline Audits\nStock LLM knowledge tests. We ask models Ethereum questions with no tools and see what they get wrong.\n\n- `baseline-sonnet-4.5.md` — Claude Sonnet 4.5 baseline\n- `baseline-gpt-5.2.md` — GPT-5.2 baseline  \n- `baseline-opus-4.6.md` — Opus 4.6 baseline\n- `gap-analysis-summary.md` — **Start here.** Compiled gaps across all models.\n\n### `/research/` — Deep Dives\nResearch on specific topics LLMs don't know:\n\n- `erc-8004.md` — Trustless agent identity standard (completely unknown to all models)\n- `x402.md` — HTTP 402 payment protocol (completely unknown)\n- `protocol-upgrades.md` — Pectra \u0026 Fusaka details\n- `ai-ethereum-projects.md` — AI + Ethereum landscape\n- `new-eips-ercs.md` — Recent standards\n\n### `/content-mining/` — Source Material\nRaw research used to build skill content:\n\n- `contract-addresses.md` — Verified addresses\n- `defi-composability.md` — Current DeFi state\n- `ethereum-apps-ecosystem.md` — App landscape\n- `scaffold-eth-patterns.md` — SE2 patterns\n- `speedrun-ethereum.md` — SRE content\n- And more\n\n## Methodology\n\n1. **Test** — Ask a stock LLM 20 Ethereum questions (no tools)\n2. **Find gaps** — What did it get wrong or not know?\n3. **Fill** — Write corrections with verified on-chain data\n4. **Prune** — If the LLM already knows it, cut it\n5. **Repeat** — Models improve, gaps change, content evolves\n\n## Key Findings (Feb 2026)\n\nAll tested models (Sonnet 4.5, GPT-5.2, Opus 4.6):\n- Think gas is **10-30 gwei** (reality: 0.05-0.3 gwei)\n- Have **never heard of ERC-8004** (trustless agent identity)\n- Have **never heard of x402** (HTTP payments)\n- Think L2 transactions cost **$0.01-2.00** (reality: \u003c$0.001)\n- **Unsure if Pectra/Fusaka shipped** (both live)\n- **Hallucinate contract addresses** when asked\n\n## Related\n\n- [ethskills site repo](https://github.com/austintgriffith/ethskills) — the published skills\n- [ethskills.com](https://ethskills.com) — live site\n\n## License\n\nMIT\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faustintgriffith%2Fethskills-research","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Faustintgriffith%2Fethskills-research","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faustintgriffith%2Fethskills-research/lists"}