{"id":24143849,"url":"https://github.com/dnbaker/diskmat","last_synced_at":"2026-05-13T15:32:56.667Z","repository":{"id":94818381,"uuid":"261546669","full_name":"dnbaker/diskmat","owner":"dnbaker","description":"mmap-backed blaze matrices","archived":false,"fork":false,"pushed_at":"2020-09-18T20:26:02.000Z","size":8,"stargazers_count":1,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-11-28T03:48:24.706Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"C++","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dnbaker.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-05-05T18:02:25.000Z","updated_at":"2020-09-18T20:26:04.000Z","dependencies_parsed_at":"2023-04-24T06:01:43.357Z","dependency_job_id":null,"html_url":"https://github.com/dnbaker/diskmat","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/dnbaker/diskmat","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dnbaker%2Fdiskmat","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dnbaker%2Fdiskmat/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dnbaker%2Fdiskmat/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dnbaker%2Fdiskmat/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dnbaker","download_url":"https://codeload.github.com/dnbaker/diskmat/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dnbaker%2Fdiskmat/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32988787,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-13T13:14:54.681Z","status":"ssl_error","status_checked_at":"2026-05-13T13:14:51.610Z","response_time":115,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2025-01-12T05:45:42.797Z","updated_at":"2026-05-13T15:32:56.662Z","avatar_url":"https://github.com/dnbaker.png","language":"C++","funding_links":[],"categories":[],"sub_categories":[],"readme":"### diskmat\n\ndiskmat is a simple, header-only tool for providing a generic front-end to matrices that may not fit into memory.\n\nIt consists of two structures: `diskmat::DiskMat`, which uses mmap to store the matrix, and `diskmat::PolymorphicMat`,\nwhich defaults to in-memory if the space consumed is below a threshold and falls back to disk-based management afterward.\n\n### Example\n\n```c++\n#include \u003cdiskmat/diskmat.h\u003e\n\nint main() {\n    diskmat::PolymorphicMat\u003cfloat\u003e pmat(100000, 1000000);\n    // pmat is now a 4 terabyte matrix on disk\n    // Initializing\n    std::uniform_real_distribution\u003cfloat\u003e urd;\n    for(size_t i = 0; i \u003c (~pmat).rows(); ++i) {\n        auto r = row(~pmat, i);\n        r = blaze::generate(1000000, [\u0026urd](auto x){std::mt19937_64 mt(x); return urd(mt);});\n    }\n    // Next, we can perform our math over the mmap'd data transparently\n    // This includes reductions:\n    blaze::DynamicVector\u003cfloat\u003e meanvec = trans(blaze::mean\u003cblaze::columnwise\u003e(~pmat));\n    // Matrix multiplications, inc. via BLAS bindings\n    // blaze::DynamicVector\u003cfloat\u003e mvp = (~pmat) * meanvec;\n    // and most other techniques\n    diskmat::PolymorphicMat\u003cfloat\u003e smallermat(1000, 40000); // This is allocated on the heap\n}\n\n```\n\nThis can be simplified, as desired, by simply getting a reference to the base matrix (`auto \u0026matr = ~pmat`).\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdnbaker%2Fdiskmat","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdnbaker%2Fdiskmat","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdnbaker%2Fdiskmat/lists"}