{"id":41679414,"url":"https://github.com/osoken/sqlitecollections","last_synced_at":"2026-01-24T18:19:05.225Z","repository":{"id":39920360,"uuid":"398555842","full_name":"osoken/sqlitecollections","owner":"osoken","description":"Python collections that are backended by sqlite3 DB and are compatible with the built-in collections","archived":false,"fork":false,"pushed_at":"2023-01-26T14:02:32.000Z","size":3048,"stargazers_count":13,"open_issues_count":10,"forks_count":3,"subscribers_count":3,"default_branch":"main","last_synced_at":"2025-09-26T07:39:25.885Z","etag":null,"topics":["dict","list","python","set","sqlite3"],"latest_commit_sha":null,"homepage":"https://osoken.github.io/sqlitecollections/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/osoken.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":"SECURITY.md","support":null}},"created_at":"2021-08-21T12:46:52.000Z","updated_at":"2025-04-17T15:33:50.000Z","dependencies_parsed_at":"2023-02-16T18:40:18.468Z","dependency_job_id":null,"html_url":"https://github.com/osoken/sqlitecollections","commit_stats":null,"previous_names":[],"tags_count":36,"template":false,"template_full_name":null,"purl":"pkg:github/osoken/sqlitecollections","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/osoken%2Fsqlitecollections","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/osoken%2Fsqlitecollections/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/osoken%2Fsqlitecollections/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/osoken%2Fsqlitecollections/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/osoken","download_url":"https://codeload.github.com/osoken/sqlitecollections/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/osoken%2Fsqlitecollections/sbom","scorecard":{"id":713785,"data":{"date":"2025-08-11","repo":{"name":"github.com/osoken/sqlitecollections","commit":"033dc3d2ec9d1f715f8a69cc17c73d0b6e745195"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":4.1,"checks":[{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Code-Review","score":0,"reason":"Found 0/6 approved changesets -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Security-Policy","score":10,"reason":"security policy file detected","details":["Info: security policy file detected: SECURITY.md:1","Info: Found linked content: SECURITY.md:1","Info: Found disclosure, vulnerability, and/or timelines in security policy: SECURITY.md:1","Info: Found text in security policy: SECURITY.md:1"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Token-Permissions","score":0,"reason":"detected GitHub workflow tokens with excessive permissions","details":["Warn: no topLevel permission defined: .github/workflows/ci.yml:1","Warn: no topLevel permission defined: .github/workflows/release.yml:1","Info: no jobLevel write permissions found"],"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"Dangerous-Workflow","score":10,"reason":"no dangerous workflow patterns detected","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Pinned-Dependencies","score":0,"reason":"dependency not pinned by hash detected -- score normalized to 0","details":["Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/ci.yml:16: update your workflow using https://app.stepsecurity.io/secureworkflow/osoken/sqlitecollections/ci.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/ci.yml:19: update your workflow using https://app.stepsecurity.io/secureworkflow/osoken/sqlitecollections/ci.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/ci.yml:47: update your workflow using https://app.stepsecurity.io/secureworkflow/osoken/sqlitecollections/ci.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/ci.yml:49: update your workflow using https://app.stepsecurity.io/secureworkflow/osoken/sqlitecollections/ci.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/release.yml:65: update your workflow using https://app.stepsecurity.io/secureworkflow/osoken/sqlitecollections/release.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/release.yml:67: update your workflow using https://app.stepsecurity.io/secureworkflow/osoken/sqlitecollections/release.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/release.yml:75: update your workflow using https://app.stepsecurity.io/secureworkflow/osoken/sqlitecollections/release.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/release.yml:85: update your workflow using https://app.stepsecurity.io/secureworkflow/osoken/sqlitecollections/release.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/release.yml:88: update your workflow using https://app.stepsecurity.io/secureworkflow/osoken/sqlitecollections/release.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/release.yml:93: update your workflow using https://app.stepsecurity.io/secureworkflow/osoken/sqlitecollections/release.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/release.yml:13: update your workflow using https://app.stepsecurity.io/secureworkflow/osoken/sqlitecollections/release.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/release.yml:38: update your workflow using https://app.stepsecurity.io/secureworkflow/osoken/sqlitecollections/release.yml/main?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/release.yml:46: update your workflow using https://app.stepsecurity.io/secureworkflow/osoken/sqlitecollections/release.yml/main?enable=pin","Warn: pipCommand not pinned by hash: .github/workflows/ci.yml:25","Warn: pipCommand not pinned by hash: .github/workflows/ci.yml:54","Warn: pipCommand not pinned by hash: .github/workflows/release.yml:52","Warn: pipCommand not pinned by hash: .github/workflows/release.yml:72","Warn: pipCommand not pinned by hash: .github/workflows/release.yml:102","Info:   0 out of  13 GitHub-owned GitHubAction dependencies pinned","Info:   0 out of   5 pipCommand dependencies pinned"],"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"Vulnerabilities","score":10,"reason":"0 existing vulnerabilities detected","details":null,"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: MIT License: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Branch-Protection","score":0,"reason":"branch protection not enabled on development/release branches","details":["Warn: branch protection not enabled for branch 'main'"],"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 28 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}}]},"last_synced_at":"2025-08-22T08:54:22.525Z","repository_id":39920360,"created_at":"2025-08-22T08:54:22.525Z","updated_at":"2025-08-22T08:54:22.525Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28733897,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-24T17:51:25.893Z","status":"ssl_error","status_checked_at":"2026-01-24T17:50:48.377Z","response_time":89,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["dict","list","python","set","sqlite3"],"created_at":"2026-01-24T18:19:04.518Z","updated_at":"2026-01-24T18:19:05.216Z","avatar_url":"https://github.com/osoken.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# sqlitecollections\n\n`sqlitecollections` is a sort of containers that are backended by sqlite3 DB and are compatible with corresponding built-in collections. Since containers consume disk space instead of RAM, they can handle large amounts of data even in environments with limited RAM. Migrating from existing code using the built-in container is as simple as importing the library and changing the constructor.\n\nThe elements of the container are automatically serialized and stored in the sqlite3 database, and are automatically read from the sqlite3 database and deserialized when accessed. Current version supports List (mutable sequence), Dict (mutable mapping) and Set (mutable set) and almost all methods are compatible with list, dict and set respectively.\n\n## Installation\n\n```shell\npip install sqlitecollections\n```\n\n## Example\n\n```python\nimport sqlitecollections as sc\n\nl = sc.List[str]([\"Alice\", \"Bob\", \"Carol\"])\nprint(l[2])\n#\u003e Carol\nprint(len(l))\n#\u003e 3\nl.append(\"Dave\")\nprint(l.index(\"Bob\"))\n#\u003e 1\nprint(l.index(\"Dave\"))\n#\u003e 3\n\nd = sc.Dict[str, str]({\"a\": \"Alice\", \"b\": \"Bob\"})\nprint(d[\"a\"])\n#\u003e Alice\nd[\"c\"] = \"Carol\"\nprint(list(d.keys()))\n#\u003e ['a', 'b', 'c']\nprint(list(d.values()))\n#\u003e ['Alice', 'Bob', 'Carol']\n\ns = sc.Set[str]([\"Alice\", \"Bob\", \"Carol\", \"Dave\"])\nprint(\"Ellen\" in s)\n#\u003e False\nprint(\"Alice\" in s)\n#\u003e True\nprint(list(s.intersection([\"Alice\", \"Carol\"])))\n#\u003e ['Alice', 'Carol']\n```\n\nIn the above example, a temporary file is created every time a container is created, and the elements are written to the sqlite3 database created on the file, thus consuming very little RAM.\n\nIf you want to reuse the container you created, you can create it by specifying the file path and table name of the sqlite3 database.\n\n```python\nimport sqlitecollections as sc\n\nl = sc.List[str]([\"Alice\", \"Bob\", \"Carol\"], connection=\"path/to/file.db\", table_name=\"list_example\")\nl.append(\"Dave\")\nexit()\n```\n\nWhen you load it, you can restore the previous state by specifying the same file path and table name.\n\n```python\nimport sqlitecollections as sc\n\nl = sc.List[str](connection=\"path/to/file.db\", table_name=\"list_example\")\nprint(len(l))\n#\u003e 4\nprint(list(l))\n#\u003e ['Alice', 'Bob', 'Carol', 'Dave']\n```\n\n## Pros and cons for built-in containers\n\n### Pros\n\n- Save memory usage.\n- Once the database is built, loading time is almost zero, even for huge data.\n\n### Cons\n\n- Each operation has the overhead of serialize/deserialize.\n- Some operations are incompatible and unavailable. For example, directly rewriting the mutable elements of a container.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fosoken%2Fsqlitecollections","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fosoken%2Fsqlitecollections","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fosoken%2Fsqlitecollections/lists"}