{"id":30119773,"url":"https://github.com/danielmiessler/substrate","last_synced_at":"2026-02-09T12:07:41.308Z","repository":{"id":248406388,"uuid":"827972843","full_name":"danielmiessler/Substrate","owner":"danielmiessler","description":"An Open-source Framework for Human Understanding, Meaning, and Progress.","archived":false,"fork":false,"pushed_at":"2025-03-06T04:34:32.000Z","size":41,"stargazers_count":523,"open_issues_count":13,"forks_count":69,"subscribers_count":57,"default_branch":"main","last_synced_at":"2025-07-30T00:48:32.620Z","etag":null,"topics":["ai","humans","meaning","purpose"],"latest_commit_sha":null,"homepage":"https://www.youtube.com/watch?v=ky7ejowc_qY","language":null,"has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/danielmiessler.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2024-07-12T19:34:29.000Z","updated_at":"2025-07-27T18:34:59.000Z","dependencies_parsed_at":"2024-07-14T18:07:56.077Z","dependency_job_id":"fa226fdd-4f0a-4496-80d0-20a58ad5e9df","html_url":"https://github.com/danielmiessler/Substrate","commit_stats":null,"previous_names":["human-substrate/problems","danielmiessler/substrate"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/danielmiessler/Substrate","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danielmiessler%2FSubstrate","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danielmiessler%2FSubstrate/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danielmiessler%2FSubstrate/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danielmiessler%2FSubstrate/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/danielmiessler","download_url":"https://codeload.github.com/danielmiessler/Substrate/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/danielmiessler%2FSubstrate/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":269726493,"owners_count":24465376,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-08-10T02:00:08.965Z","response_time":71,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","humans","meaning","purpose"],"created_at":"2025-08-10T12:43:18.900Z","updated_at":"2026-02-09T12:07:41.299Z","avatar_url":"https://github.com/danielmiessler.png","language":null,"funding_links":[],"categories":[],"sub_categories":[],"readme":"\u003cdiv align=\"center\"\u003e\n\n\u003cimg src=\"https://github.com/user-attachments/assets/2137f529-e5de-4d8e-9ae2-3d67a797d0c9\" width=\"300\"/\u003e\n\n# **Substrate**\n\n### **Infrastructure for Human Knowledge \u0026 Progress**\n\n[![GitHub last commit](https://img.shields.io/github/last-commit/danielmiessler/Substrate?style=for-the-badge\u0026logo=github)](https://github.com/danielmiessler/Substrate/commits/main)\n[![License: MIT](https://img.shields.io/badge/License-MIT-00ADD8.svg?style=for-the-badge)](https://opensource.org/licenses/MIT)\n[![Stars](https://img.shields.io/github/stars/danielmiessler/Substrate?style=for-the-badge\u0026logo=github)](https://github.com/danielmiessler/Substrate/stargazers)\n[![TypeScript](https://img.shields.io/badge/TypeScript-007ACC?style=for-the-badge\u0026logo=typescript\u0026logoColor=white)](https://www.typescriptlang.org/)\n[![Bun](https://img.shields.io/badge/Bun-000000?style=for-the-badge\u0026logo=bun\u0026logoColor=white)](https://bun.sh)\n\n\u003cp align=\"center\"\u003e\n  \u003ca href=\"#-what-is-substrate\"\u003eWhat Is It\u003c/a\u003e •\n  \u003ca href=\"#-data--evidence\"\u003eData\u003c/a\u003e •\n  \u003ca href=\"#-quick-start\"\u003eQuick Start\u003c/a\u003e •\n  \u003ca href=\"#-documentation\"\u003eDocs\u003c/a\u003e •\n  \u003ca href=\"#-contribute\"\u003eContribute\u003c/a\u003e •\n  \u003ca href=\"#-roadmap\"\u003eRoadmap\u003c/a\u003e\n\u003c/p\u003e\n\n\u003c/div\u003e\n\n---\n\n## 🎯 What Is Substrate?\n\n\u003cdiv align=\"center\"\u003e\n\u003ca href=\"https://www.youtube.com/watch?v=ky7ejowc_qY\"\u003e\n  \u003cimg src=\"https://img.youtube.com/vi/ky7ejowc_qY/0.jpg\" alt=\"Substrate Introduction\" width=\"600\"\u003e\n\u003c/a\u003e\n\n**[→ Watch Introduction Video](https://www.youtube.com/watch?v=ky7ejowc_qY)** • **[→ Read Blog Post](https://danielmiessler.com/blog/how-my-projects-fit-together)**\n\u003c/div\u003e\n\n---\n\n### **A Shared Foundation for Human Progress**\n\nThink of **substrate** as the base layer—the common ground where we can all work together to understand problems and drive solutions forward. Instead of fragmented discussions and reinventing the wheel, Substrate gives us **one place** to:\n\n- **Document problems** → What's actually broken, with evidence\n- **Track solutions** → What works, what doesn't, with results\n- **Connect progress** → Link people, organizations, and projects actually moving things forward\n- **Build on each other** → Arguments and ideas that build on shared evidence\n- **Measure outcomes** → Did it work? What actually changed?\n\n**The Purpose: Accelerate Human Progress**\n\nWe can't solve problems we don't understand. We can't build on solutions we can't find. Substrate provides:\n\n- 🎯 **Shared understanding** → One place to understand what's wrong and what works\n- 🚀 **Faster progress** → Build on existing knowledge instead of starting over\n- 📊 **Evidence-based action** → Ground decisions in authoritative data, not opinions\n- 🔗 **Connected knowledge** → See how problems, solutions, people, and data interconnect\n- 🌍 **Collective intelligence** → Human insight + AI analysis working together toward progress\n\n**An open-source framework connecting 17+ knowledge components:**\n\n```mermaid\ngraph TB\n    subgraph \"🌍 The Substrate\"\n        A[🧩 Problems]\n        B[💡 Solutions]\n        C[📊 Data Sources]\n        D[🗣️ Arguments]\n        E[📋 Claims]\n        F[👥 People]\n        G[🏢 Organizations]\n        H[🚀 Projects]\n        I[📈 Plans]\n        J[🎯 Values]\n        K[💭 Ideas]\n    end\n\n    L[👤 Human Contributors] --\u003e A\n    L --\u003e B\n    L --\u003e D\n    M[🤖 AI Analysis] --\u003e A\n    M --\u003e B\n    M --\u003e D\n\n    A -.connects to.-\u003e B\n    B -.connects to.-\u003e C\n    D -.connects to.-\u003e C\n    E -.connects to.-\u003e C\n    F -.connects to.-\u003e G\n    G -.connects to.-\u003e H\n    H -.connects to.-\u003e B\n\n    A --\u003e N[🔍 Shared Understanding]\n    B --\u003e N\n    C --\u003e N\n    D --\u003e N\n```\n\n\u003ctable\u003e\n\u003ctr\u003e\n\u003ctd width=\"50%\"\u003e\n\n### 🏗️ **Structured Components**\n\n- **Problems** - Documented challenges with evidence\n- **Solutions** - Proven approaches with results\n- **Arguments** - Reasoning chains with quality scores\n- **Claims** - Assertions linked to evidence\n- **Plans** - Actionable strategies with metrics\n- **Ideas** - Frameworks and concepts\n- **People \u0026 Organizations** - Who's working on what\n- **Projects** - Active initiatives with outcomes\n\n\u003c/td\u003e\n\u003ctd width=\"50%\"\u003e\n\n### 📊 **Authoritative Data**\n\n- **13 Data Sources** across 100+ years\n- **Library science methodology** (8 dimensions)\n- **Government agencies** + verified databases\n- **TypeScript automation** with Bun runtime\n- **Full documentation** for every dataset\n- **Free APIs** with excellent access\n- **Human wellbeing indicators** beyond GDP\n- **Real-time** to annual update frequencies\n\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\n---\n\n## 🚀 What's New\n\n\u003e [!TIP]\n\u003e **October 2025 - Massive Data Expansion!**\n\u003e\n\u003e We just added **8 authoritative data sources** measuring human wellbeing beyond traditional economic metrics. Now track financial stress, health crises, social connection, worker agency, and environmental health.\n\n\u003cdetails\u003e\n\u003csummary\u003e\u003cstrong\u003e📅 Latest Updates (Click to expand)\u003c/strong\u003e\u003c/summary\u003e\n\n### 🔥 October 27, 2025 - Human Wellbeing Infrastructure\n\n**5 NEW US Wellbeing Data Sources:**\n\n| Added | Source | What It Measures |\n|-------|--------|------------------|\n| 🆕 | **DS-00004** FRED Economic Wellbeing | Debt stress, unemployment, inequality |\n| 🆕 | **DS-00005** CDC WONDER Mortality | Overdoses, suicides, deaths of despair |\n| 🆕 | **DS-00006** Census ACS Social | Living alone, commute times, isolation |\n| 🆕 | **DS-00007** BLS JOLTS Labor | Worker \"permission to quit\" index |\n| 🆕 | **DS-00008** EPA Air Quality | PM2.5, ozone, environmental health |\n\n**Why This Matters:**\n\u003e \"If we measure only GDP and unemployment, we will miss the slow-motion collapse of human thriving happening in plain sight.\"\n\nThese sources capture:\n- 💰 **Leading indicators** - Financial stress predicts recessions\n- 🎭 **Behavioral truth** - Actions reveal what surveys miss\n- 🏗️ **Structural determinants** - Air quality you can't \"self-care\" out of\n- 🚨 **Crisis detection** - County-level suffering visibility\n- 🆓 **Worker agency** - Quit rate = economic freedom measure\n\n### October 25, 2025 - Core Data Updates\n- ✅ Pulitzer Prize, GDP, inflation data refreshed\n- ✅ Knowledge Worker Salaries validation completed\n\n### October 16-18, 2025 - Infrastructure\n- 🏗️ Library science methodology (8-dimension evaluation)\n- ⚡ TypeScript automation with auto-discovery\n- 📊 Central logging and health monitoring\n- 📚 Complete documentation suite\n\n---\n\n\u003cdetails\u003e\n\u003csummary\u003e\u003cstrong\u003e📜 Previous Updates (Click to expand)\u003c/strong\u003e\u003c/summary\u003e\n\n### September 2024 - Community Growth\n- ✅ Claims, Arguments, and Values frameworks\n- ✅ 6+ community contributors\n- ✅ 10+ merged pull requests\n- ✅ TELOS integration\n\n### August 2024 - Framework Expansion\n- ✅ Extended component types (Plans, Ideas, Models)\n- ✅ Improved documentation structure\n- ✅ Enhanced contribution guidelines\n\n### July 2024 - Foundation\n- ✅ Single-repo structure with 17+ object types\n- ✅ Core framework and documentation\n- ✅ Public launch with initial datasets\n- ✅ Community contribution framework\n\n\u003c/details\u003e\n\n---\n\n**[→ View Full Changelog](./UPDATES.md)**\n\n\u003c/details\u003e\n\n---\n\n## 📊 Data \u0026 Evidence\n\n\u003e [!NOTE]\n\u003e All data sources include **complete library science cataloging** with 8-dimension evaluation: Authority, Currency, Objectivity, Accuracy, Methodology, Coverage, Reliability, and Provenance.\n\n\u003e [!IMPORTANT]\n\u003e **We know data can be controversial.** That's exactly why we:\n\u003e - 📊 **Collect from multiple sources** - Cross-reference data from different authoritative providers\n\u003e - 🔍 **Provide complete transparency** - Every source fully documented with provenance, methodology, and limitations\n\u003e - 📝 **Full logging** - All data pulls logged with timestamps, source versions, and processing steps\n\u003e - 🔓 **Open source everything** - TypeScript update scripts show exactly how data is fetched and transformed\n\u003e\n\u003e You can verify, audit, and challenge our data. That's the point.\n\n### **Core Datasets** (`Data/`)\n\n| Dataset | Time Span | Data Points | Source | Status |\n|---------|-----------|-------------|--------|--------|\n| 🇺🇸 **US GDP** | 1929-2025 | 96 years + 314 quarters | FRED/BEA | ✅ Active |\n| 💵 **US Inflation** | 1947-2025 | 945 months | FRED/BLS | ✅ Active |\n| 🦠 **Bay Area COVID Wastewater** | 2022-2025 | 161 weeks | CDPH | ✅ Active |\n| 🏆 **Pulitzer Prize Winners** | 1918-2024 | 249 winners | Wikidata | ✅ Active |\n| 💼 **Knowledge Worker Salaries** | Global | Multi-region | Research | ✅ Active |\n\n### **Wellbeing Data Sources** (`Data-Sources/`) 🆕\n\n\u003cdetails\u003e\n\u003csummary\u003e\u003cstrong\u003e🌍 Global Health \u0026 Development (Click to expand)\u003c/strong\u003e\u003c/summary\u003e\n\n| ID | Name | Coverage | Indicators | Update |\n|----|------|----------|------------|--------|\n| **DS-00001** | [WHO Global Health Observatory](./Data-Sources/DS-00001—WHO_Global_Health_Observatory/) | 194 countries | 2,000+ health indicators | Quarterly |\n| **DS-00002** | [UN SDG Indicators](./Data-Sources/DS-00002—UN_SDG_Indicators/) | 193 countries | 231 SDG targets | Biannual |\n| **DS-00003** | [World Bank Open Data](./Data-Sources/DS-00003—World_Bank_Open_Data/) | Global | Development metrics | Varies |\n\n\u003c/details\u003e\n\n\u003cdetails open\u003e\n\u003csummary\u003e\u003cstrong\u003e🇺🇸 US Human Wellbeing (October 2025)\u003c/strong\u003e\u003c/summary\u003e\n\n\u003ctable\u003e\n\u003ctr\u003e\n\u003cth width=\"15%\"\u003eSource\u003c/th\u003e\n\u003cth width=\"35%\"\u003eKey Indicators\u003c/th\u003e\n\u003cth width=\"30%\"\u003eWhy It Matters\u003c/th\u003e\n\u003cth width=\"20%\"\u003eUpdate Freq\u003c/th\u003e\n\u003c/tr\u003e\n\n\u003ctr\u003e\n\u003ctd\u003e\u003cstrong\u003eDS-00004\u003c/strong\u003e\u003cbr/\u003e\u003ca href=\"./Data-Sources/DS-00004—FRED_Economic_Wellbeing/\"\u003eFRED Economic\u003c/a\u003e\u003c/td\u003e\n\u003ctd\u003e\n• Debt service ratio\u003cbr/\u003e\n• Credit card delinquency\u003cbr/\u003e\n• Financial stress index\u003cbr/\u003e\n• Underemployment (U-6)\u003cbr/\u003e\n• Consumer sentiment\u003cbr/\u003e\n• GINI inequality\n\u003c/td\u003e\n\u003ctd\u003e💰 \u003cstrong\u003eEconomic Security Foundation\u003c/strong\u003e\u003cbr/\u003eDebt \u003e12% = stress, \u003e14% = crisis. Leading indicator of recession.\u003c/td\u003e\n\u003ctd\u003eWeekly to Annual\u003c/td\u003e\n\u003c/tr\u003e\n\n\u003ctr\u003e\n\u003ctd\u003e\u003cstrong\u003eDS-00005\u003c/strong\u003e\u003cbr/\u003e\u003ca href=\"./Data-Sources/DS-00005—CDC_WONDER_Mortality/\"\u003eCDC WONDER\u003c/a\u003e\u003c/td\u003e\n\u003ctd\u003e\n• Drug overdose deaths\u003cbr/\u003e\n• Opioid-specific deaths\u003cbr/\u003e\n• Suicide rates\u003cbr/\u003e\n• All-cause mortality\n\u003c/td\u003e\n\u003ctd\u003e🚨 \u003cstrong\u003eCrisis Detection\u003c/strong\u003e\u003cbr/\u003eDeaths of despair reveal community breakdown surveys miss. County-level visibility.\u003c/td\u003e\n\u003ctd\u003eAnnual (1-2yr lag)\u003c/td\u003e\n\u003c/tr\u003e\n\n\u003ctr\u003e\n\u003ctd\u003e\u003cstrong\u003eDS-00006\u003c/strong\u003e\u003cbr/\u003e\u003ca href=\"./Data-Sources/DS-00006—Census_ACS_Social_Wellbeing/\"\u003eCensus ACS\u003c/a\u003e\u003c/td\u003e\n\u003ctd\u003e\n• Living alone (isolation)\u003cbr/\u003e\n• Commute times (time poverty)\u003cbr/\u003e\n• No internet (digital divide)\u003cbr/\u003e\n• Household demographics\n\u003c/td\u003e\n\u003ctd\u003e🤝 \u003cstrong\u003eSocial Connection\u003c/strong\u003e\u003cbr/\u003eStructural isolation and time poverty constrain flourishing. Census tract granularity.\u003c/td\u003e\n\u003ctd\u003eAnnual\u003c/td\u003e\n\u003c/tr\u003e\n\n\u003ctr\u003e\n\u003ctd\u003e\u003cstrong\u003eDS-00007\u003c/strong\u003e\u003cbr/\u003e\u003ca href=\"./Data-Sources/DS-00007—BLS_JOLTS_Labor_Market/\"\u003eBLS JOLTS\u003c/a\u003e\u003c/td\u003e\n\u003ctd\u003e\n• \u003cstrong\u003eQuit rate\u003c/strong\u003e (worker agency)\u003cbr/\u003e\n• Job openings\u003cbr/\u003e\n• Hire rate\u003cbr/\u003e\n• Layoff/discharge rate\n\u003c/td\u003e\n\u003ctd\u003e🆓 \u003cstrong\u003e\"Permission to Quit\"\u003c/strong\u003e\u003cbr/\u003ePeople only quit when they have options. Measures economic freedom and dignity.\u003c/td\u003e\n\u003ctd\u003eMonthly\u003c/td\u003e\n\u003c/tr\u003e\n\n\u003ctr\u003e\n\u003ctd\u003e\u003cstrong\u003eDS-00008\u003c/strong\u003e\u003cbr/\u003e\u003ca href=\"./Data-Sources/DS-00008—EPA_Air_Quality_System/\"\u003eEPA Air Quality\u003c/a\u003e\u003c/td\u003e\n\u003ctd\u003e\n• PM2.5 (particulate matter)\u003cbr/\u003e\n• Ozone (O3)\u003cbr/\u003e\n• SO2, CO, NO2\u003cbr/\u003e\n• AQI exceedances\n\u003c/td\u003e\n\u003ctd\u003e🌫️ \u003cstrong\u003eEnvironmental Health\u003c/strong\u003e\u003cbr/\u003eYou can't \"self-care\" out of breathing toxic air. Structural wellbeing constraint.\u003c/td\u003e\n\u003ctd\u003eReal-time\u003c/td\u003e\n\u003c/tr\u003e\n\n\u003c/table\u003e\n\n\u003c/details\u003e\n\n### **Composite Wellbeing Indices**\n\n\u003e [!TIP]\n\u003e Combine multiple data sources to create powerful wellbeing metrics:\n\n- 💸 **Financial Stress Composite** - Debt + delinquency + evictions + stress index\n- 🚨 **Crisis Alert Composite** - Overdoses + suicides + long-term unemployment\n- 🤝 **Community Health Composite** - Living alone + commute + digital divide (inverted)\n- 🆓 **Worker Agency Index** - Quit rate + job openings / unemployment\n- 🌫️ **Environmental Health Index** - PM2.5 + ozone (inverted)\n\n**[→ Wellbeing Implementation Guide](./Data-Sources/WELLBEING_DATA_SOURCES.md)** | **[→ Data Directory](./Data/README.md)**\n\n---\n\n## 🤖 Human \u0026 AI Collaboration\n\n\u003e **Substrate provides the pieces. You and your AI create the connections.**\n\n\u003ctable\u003e\n\u003ctr\u003e\n\u003ctd width=\"50%\"\u003e\n\n### 👤 **Humans Contribute**\n\n- Document problems and solutions\n- Add authoritative data sources\n- Create arguments and claims\n- Link entities explicitly\n- Validate AI suggestions\n- Rate quality of evidence\n\n\u003c/td\u003e\n\u003ctd width=\"50%\"\u003e\n\n### 🤖 **AI Analyzes**\n\n- Scan thousands of components\n- Suggest relationships automatically\n- Detect patterns across datasets\n- Score argument quality\n- Find contradictions\n- Generate knowledge graphs\n\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\n**Everything is designed for dual consumption:**\n- ✅ **Human-readable** - Markdown and CSV anyone can open\n- ✅ **Machine-parseable** - Consistent formats AI can query\n- ✅ **Fully documented** - Complete methodology for every dataset\n- ✅ **Linked with IDs** - Unambiguous entity references\n\n### Use Cases\n\n\u003cdetails\u003e\n\u003csummary\u003e\u003cstrong\u003e🔍 OSINT \u0026 Investigation\u003c/strong\u003e\u003c/summary\u003e\n\n- Cross-reference public records, corporate filings, government data\n- Link people → organizations → transactions → policies\n- Surface connections invisible in isolated databases\n- Build evidence chains from claims to verifiable records\n- Pattern detection for fraud, corruption, illicit networks\n\n\u003c/details\u003e\n\n\u003cdetails\u003e\n\u003csummary\u003e\u003cstrong\u003e📊 Research \u0026 Analysis\u003c/strong\u003e\u003c/summary\u003e\n\n- Track claims against authoritative data sources\n- Evaluate argument quality based on evidence backing\n- Compare solutions across different implementations\n- Measure progress toward stated goals with real metrics\n- Cross-correlate economic, health, social, environmental data\n\n\u003c/details\u003e\n\n\u003cdetails\u003e\n\u003csummary\u003e\u003cstrong\u003e🌐 Public Accountability\u003c/strong\u003e\u003c/summary\u003e\n\n- Verify political claims against documented evidence\n- Track campaign promises → policy outcomes → measured results\n- Link donations → voting records → policy positions\n- Monitor government spending against stated objectives\n- Environmental justice analysis (who breathes toxic air?)\n\n\u003c/details\u003e\n\n---\n\n## 🚀 Quick Start\n\n### **View the Data** (No Installation Required)\n\nAll datasets are available as **CSV and Markdown files** you can browse directly:\n\n```bash\n# Clone the repository\ngit clone https://github.com/danielmiessler/Substrate.git\ncd Substrate\n\n# Explore core datasets\nls Data/*/\n\n# Explore wellbeing data sources\nls Data-Sources/*/\n```\n\n### **Run the Automation** (Optional)\n\n\u003e [!WARNING]\n\u003e Requires [Bun](https://bun.sh) runtime. Install: `curl -fsSL https://bun.sh/install | bash`\n\n```bash\n# Install dependencies\nbun install\n\n# Update a specific dataset\ncd Data/US-GDP\nbun run update.ts\n\n# Update a wellbeing source (requires API key)\nexport FRED_API_KEY=\"your_key_here\"\ncd Data-Sources/DS-00004—FRED_Economic_Wellbeing\nbun run update.ts\n\n# Update all datasets\nbun run scripts/update-all.ts\n```\n\n### **Get API Keys** (Free)\n\n| Data Source | Get Key | Rate Limit |\n|-------------|---------|------------|\n| FRED Economic | [fred.stlouisfed.org/docs/api](https://fred.stlouisfed.org/docs/api/api_key.html) | 120 req/min |\n| Census ACS | [api.census.gov/data/key_signup](https://api.census.gov/data/key_signup.html) | 500 req/day |\n| EPA Air Quality | Email: aqs.support@epa.gov | 10 req/min |\n| BLS JOLTS | [bls.gov/developers/home](https://www.bls.gov/developers/home.htm) | 500 req/day |\n| CDC WONDER | No key required | Fair use |\n\n**[→ Complete Getting Started Guide](./GETTING_STARTED.md)** | **[→ Quick Reference](./QUICK_REFERENCE.md)**\n\n---\n\n## 💡 Contribute\n\n\u003e [!IMPORTANT]\n\u003e **Anyone can submit components.** No gatekeeping on ideas—just structured formats.\n\n### **What You Can Add**\n\n\u003ctable\u003e\n\u003ctr\u003e\n\u003ctd width=\"33%\"\u003e\n\n**📋 Problems**\n- Water quality issues\n- Healthcare access gaps\n- Climate change impacts\n\n**💡 Solutions**\n- Filtration systems\n- Telemedicine networks\n- Infrastructure adaptation\n\n**📈 Plans**\n- Political platforms\n- Policy proposals\n- Action roadmaps\n\n\u003c/td\u003e\n\u003ctd width=\"33%\"\u003e\n\n**🗣️ Arguments**\n- \"This works because X, Y, Z\"\n- \"This failed due to A, B\"\n- (We don't judge—community rates)\n\n**📊 Data**\n- Public records\n- Research datasets\n- Compiled statistics\n\n**💭 Ideas**\n- Theoretical frameworks\n- Novel measurement approaches\n- Conceptual models\n\n\u003c/td\u003e\n\u003ctd width=\"33%\"\u003e\n\n**👥 People \u0026 Orgs**\n- Researchers on problems\n- Organizations implementing\n- Projects with outcomes\n\n**📏 Metrics**\n- Success criteria\n- Measurement frameworks\n- Progress indicators\n\n**🎯 Values**\n- Guiding principles\n- Evaluation criteria\n\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\n### **How to Submit**\n\n1. **Fork the repository** on GitHub\n2. **Add your component** in the appropriate directory (`Problems/`, `Solutions/`, etc.)\n3. **Follow the format** in that directory's README\n4. **Submit a Pull Request**\n\n\u003e [!NOTE]\n\u003e We're building a **web interface** to make this easier for non-technical contributors!\n\n**[→ Contribution Guidelines](./GETTING_STARTED.md#contributing)**\n\n---\n\n## 📚 Documentation\n\n\u003ctable\u003e\n\u003ctr\u003e\n\u003ctd width=\"50%\"\u003e\n\n### **Getting Started**\n\n- 📖 [**Getting Started Guide**](./GETTING_STARTED.md) - Complete setup walkthrough\n- ⚡ [**Quick Reference**](./QUICK_REFERENCE.md) - Command cheatsheet\n- 📊 [**Data Directory**](./Data/README.md) - Data philosophy \u0026 standards\n- 🎯 [**Wellbeing Data Guide**](./Data-Sources/WELLBEING_DATA_SOURCES.md) - Implementation details\n\n\u003c/td\u003e\n\u003ctd width=\"50%\"\u003e\n\n### **Technical**\n\n- 🏗️ [**Project Summary**](./PROJECT_SUMMARY.md) - Architecture overview\n- 📚 [**Library Science Framework**](./Data/README-LIBRARY-SCIENCE.md) - 8-dimension methodology\n- 🔄 [**Migration Guide**](./Data/MIGRATION-GUIDE.md) - Structure changes\n- 📝 [**UPDATES.md**](./UPDATES.md) - Complete changelog\n\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\n---\n\n## 🗺️ Roadmap\n\n### ✅ **Completed**\n\n\u003cdetails\u003e\n\u003csummary\u003e\u003cstrong\u003ePhase 1: Foundation (July 2024)\u003c/strong\u003e\u003c/summary\u003e\n\n- ✅ Single-repo structure with 17+ object types\n- ✅ Core framework and documentation\n- ✅ Public launch with initial datasets\n- ✅ Community contribution framework\n\n\u003c/details\u003e\n\n\u003cdetails\u003e\n\u003csummary\u003e\u003cstrong\u003ePhase 2: Community (Aug-Sep 2024)\u003c/strong\u003e\u003c/summary\u003e\n\n- ✅ Claims, Arguments, and Values frameworks\n- ✅ 6+ community contributors\n- ✅ 10+ merged pull requests\n- ✅ TELOS integration\n\n\u003c/details\u003e\n\n\u003cdetails open\u003e\n\u003csummary\u003e\u003cstrong\u003ePhase 3: Data Infrastructure (Oct 2025) 🔥\u003c/strong\u003e\u003c/summary\u003e\n\n- ✅ **13 authoritative data sources** (5 core + 8 wellbeing)\n- ✅ **Library science methodology** (8-dimension evaluation)\n- ✅ **TypeScript automation system** with Bun runtime\n- ✅ **6,000+ lines of documentation** across all sources\n- ✅ **Comprehensive wellbeing indicators** (economic, health, social, labor, environmental)\n- ✅ **Free API access** with rate limiting and retry logic\n\n\u003c/details\u003e\n\n### 🚧 **Planned**\n\n**Phase 4: Enhanced Access** (Q4 2025 - Q1 2026)\n- 🎨 Web-based contribution interface (no coding required)\n- 📊 Interactive data visualizations\n- 🔌 RESTful API for programmatic access\n- 📱 Mobile-friendly exploration\n\n**Phase 5: Dataset Expansion** (2026)\n- 🌍 Additional international sources (UNICEF, OECD, IHME)\n- ⚡ Real-time data feeds integration\n- 🗳️ Community-driven dataset requests\n- 🤝 Partnerships with research institutions\n\n**Phase 6: Intelligence Layer** (2026+)\n- 🤖 Automated relationship discovery\n- 📈 Confidence scoring for AI-suggested links\n- 🎯 Pattern detection algorithms\n- 🔔 Email/Slack notifications for data updates\n- 📚 Machine-readable catalog (DCAT/CKAN compliance)\n\n---\n\n## 🔗 Integration with TELOS\n\n\u003e **Substrate** provides evidence. **[TELOS](https://github.com/danielmiessler/Telos)** provides intention.\n\n\u003ctable\u003e\n\u003ctr\u003e\n\u003cth width=\"50%\"\u003eTELOS (Goals \u0026 Strategy)\u003c/th\u003e\n\u003cth width=\"50%\"\u003eSubstrate (Evidence \u0026 Solutions)\u003c/th\u003e\n\u003c/tr\u003e\n\u003ctr\u003e\n\u003ctd\u003e\n\n- **Goals** - What you want to achieve\n- **Strategies** - How you'll pursue it\n- **Challenges** - Obstacles you face\n- **Metrics** - Progress tracking\n\n\u003c/td\u003e\n\u003ctd\u003e\n\n- **Problems** - What stands in the way\n- **Solutions** - Proven approaches\n- **Data** - Measured evidence\n- **Plans** - Implementation roadmaps\n\n\u003c/td\u003e\n\u003c/tr\u003e\n\u003c/table\u003e\n\n**Together:** Complete system for intention + evidence-based action.\n\n---\n\n## 🙏 Credits\n\n### **Created By**\n\n**[Daniel Miessler](https://danielmiessler.com)** • July 2024\n\n[![Twitter Follow](https://img.shields.io/twitter/follow/danielmiessler?style=social)](https://twitter.com/danielmiessler)\n[![Newsletter](https://img.shields.io/badge/Newsletter-Subscribe-blue)](https://danielmiessler.com/subscribe)\n\n### **Special Thanks**\n\n**Inspiration \u0026 Contributions:**\n- **Jonathan Dunn** [@xssdoctor](https://github.com/xssdoctor) - Similar vision and collaboration\n- **Joel Parish** - Structure wisdom and guidance\n- **Joseph Thacker** - Continuous flow of innovative ideas\n\n**Community Contributors:**\n\n[@ThatNateGuy](https://github.com/ThatNateGuy) • [@JaymanW](https://github.com/JaymanW) • [@karai114](https://github.com/karai114) • [@DesertEaglePWN](https://github.com/DesertEaglePWN) • [@ktfth](https://github.com/ktfth)\n\n---\n\n## 📄 License\n\nMIT License - see the [LICENSE](LICENSE) file for details.\n\n---\n\n\u003cdiv align=\"center\"\u003e\n\n### **📊 Repository Stats**\n\n**Data:** 13 sources • 1,700+ data points • 107-year span (1918-2025)\n\n**Code:** TypeScript automation • 6,000+ lines documentation • GitHub Actions\n\n**Community:** 6+ contributors • 10+ PRs merged • 17 object types\n\n---\n\n**[⬆ Back to Top](#substrate)**\n\n\u003csub\u003eBuilt with ❤️ for human understanding and progress\u003c/sub\u003e\n\n\u003csub\u003ePowered by [TypeScript](https://www.typescriptlang.org/) • [Bun](https://bun.sh) • Open Data\u003c/sub\u003e\n\n---\n\n## Star History\n\n[![Star History Chart](https://api.star-history.com/svg?repos=danielmiessler/Substrate\u0026type=Date)](https://star-history.com/#danielmiessler/Substrate\u0026Date)\n\n\u003c/div\u003e\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdanielmiessler%2Fsubstrate","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdanielmiessler%2Fsubstrate","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdanielmiessler%2Fsubstrate/lists"}