{"id":39281488,"url":"https://github.com/portugueslab/arrayqueues","last_synced_at":"2026-01-18T01:02:41.831Z","repository":{"id":54448239,"uuid":"133976381","full_name":"portugueslab/arrayqueues","owner":"portugueslab","description":"Multiprocessing queues for numpy arrays using shared memory","archived":false,"fork":false,"pushed_at":"2023-08-02T14:06:45.000Z","size":69,"stargazers_count":59,"open_issues_count":3,"forks_count":7,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-09-26T08:24:05.087Z","etag":null,"topics":["numpy-arrays"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/portugueslab.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE.txt","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-05-18T16:03:02.000Z","updated_at":"2025-02-28T03:34:41.000Z","dependencies_parsed_at":"2024-06-21T20:24:58.634Z","dependency_job_id":"b5697323-9691-4467-8d47-92c6d57207ae","html_url":"https://github.com/portugueslab/arrayqueues","commit_stats":{"total_commits":56,"total_committers":5,"mean_commits":11.2,"dds":0.5357142857142857,"last_synced_commit":"84b096419463eae3feb0b7d36dd860b542d10325"},"previous_names":[],"tags_count":4,"template":false,"template_full_name":null,"purl":"pkg:github/portugueslab/arrayqueues","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/portugueslab%2Farrayqueues","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/portugueslab%2Farrayqueues/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/portugueslab%2Farrayqueues/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/portugueslab%2Farrayqueues/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/portugueslab","download_url":"https://codeload.github.com/portugueslab/arrayqueues/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/portugueslab%2Farrayqueues/sbom","scorecard":{"id":741528,"data":{"date":"2025-08-11","repo":{"name":"github.com/portugueslab/arrayqueues","commit":"047d1139d28a4d93a3f6e27377ec66912ed2af14"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":2.5,"checks":[{"name":"Code-Review","score":0,"reason":"Found 0/27 approved changesets -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"Dangerous-Workflow","score":10,"reason":"no dangerous workflow patterns detected","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Pinned-Dependencies","score":0,"reason":"dependency not pinned by hash detected -- score normalized to 0","details":["Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/main.yml:9: update your workflow using https://app.stepsecurity.io/secureworkflow/portugueslab/arrayqueues/main.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/main.yml:11: update your workflow using https://app.stepsecurity.io/secureworkflow/portugueslab/arrayqueues/main.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/main.yml:37: update your workflow using https://app.stepsecurity.io/secureworkflow/portugueslab/arrayqueues/main.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/main.yml:39: update your workflow using https://app.stepsecurity.io/secureworkflow/portugueslab/arrayqueues/main.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/main.yml:59: update your workflow using https://app.stepsecurity.io/secureworkflow/portugueslab/arrayqueues/main.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/main.yml:61: update your workflow using https://app.stepsecurity.io/secureworkflow/portugueslab/arrayqueues/main.yml/master?enable=pin","Warn: pipCommand not pinned by hash: .github/workflows/main.yml:17","Warn: pipCommand not pinned by hash: .github/workflows/main.yml:18","Warn: pipCommand not pinned by hash: .github/workflows/main.yml:44","Warn: pipCommand not pinned by hash: .github/workflows/main.yml:45","Warn: pipCommand not pinned by hash: .github/workflows/main.yml:52","Warn: pipCommand not pinned by hash: .github/workflows/main.yml:66","Warn: pipCommand not pinned by hash: .github/workflows/main.yml:67","Info:   0 out of   6 GitHub-owned GitHubAction dependencies pinned","Info:   0 out of   7 pipCommand dependencies pinned"],"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"Token-Permissions","score":0,"reason":"detected GitHub workflow tokens with excessive permissions","details":["Warn: no topLevel permission defined: .github/workflows/main.yml:1","Info: no jobLevel write permissions found"],"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE.txt:0","Info: FSF or OSI recognized license: MIT License: LICENSE.txt:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Branch-Protection","score":0,"reason":"branch protection not enabled on development/release branches","details":["Warn: branch protection not enabled for branch 'master'"],"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 4 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}},{"name":"Vulnerabilities","score":0,"reason":"13 existing vulnerabilities detected","details":["Warn: Project is vulnerable to: PYSEC-2018-34 / GHSA-2fc2-6r4j-p65h","Warn: Project is vulnerable to: PYSEC-2021-856 / GHSA-5545-2q6w-2gh6","Warn: Project is vulnerable to: PYSEC-2019-108 / GHSA-9fq2-x9r6-wfmf","Warn: Project is vulnerable to: PYSEC-2018-33 / GHSA-cw6w-4rcx-xphc","Warn: Project is vulnerable to: PYSEC-2021-857 / GHSA-f7c7-j99h-c22f","Warn: Project is vulnerable to: GHSA-fpfv-jqm9-f5jm","Warn: Project is vulnerable to: PYSEC-2017-1 / GHSA-frgw-fgh6-9g52","Warn: Project is vulnerable to: PYSEC-2024-48 / GHSA-fj7x-q9j7-g6q6","Warn: Project is vulnerable to: PYSEC-2024-4 / GHSA-2mqj-m65w-jghx","Warn: Project is vulnerable to: PYSEC-2023-165 / GHSA-cwvm-v4w8-q58c","Warn: Project is vulnerable to: PYSEC-2022-42992 / GHSA-hcpj-qp55-gfph","Warn: Project is vulnerable to: PYSEC-2023-137 / GHSA-pr76-5cm5-w9cj","Warn: Project is vulnerable to: PYSEC-2023-161 / GHSA-wfm5-v35h-vwf4"],"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}}]},"last_synced_at":"2025-08-22T17:35:31.534Z","repository_id":54448239,"created_at":"2025-08-22T17:35:31.534Z","updated_at":"2025-08-22T17:35:31.534Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28525441,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-18T00:39:45.795Z","status":"ssl_error","status_checked_at":"2026-01-18T00:39:39.467Z","response_time":85,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["numpy-arrays"],"created_at":"2026-01-18T01:02:41.532Z","updated_at":"2026-01-18T01:02:41.750Z","avatar_url":"https://github.com/portugueslab.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# ArrayQueues\n\n[![Python Version](https://img.shields.io/pypi/pyversions/arrayqueues.svg)](https://pypi.org/project/arrayqueues)\n[![Tests](https://img.shields.io/github/workflow/status/portugueslab/arrayqueues/tests)](\n    https://github.com/portugueslab/arrayqueues/actions)\n[![Coverage Status](https://coveralls.io/repos/github/portugueslab/arrayqueues/badge.svg?branch=master)](https://coveralls.io/github/portugueslab/arrayqueues?branch=master)\n[![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/python/black)\n[![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)\n[![PyPI version](https://badge.fury.io/py/arrayqueues.svg)](https://badge.fury.io/py/arrayqueues)\n\nThis package provides a drop-in replacement for the Python multiprocessing Queue class which handles transport of large numpy arrays.\nIt avoids pickling and uses the multiprocessing Array class in the background.\nThe major difference between this implementation and the normal queue is that the maximal amount of memory that the queue can have must be specified beforehand.\n\nAttempting to send an array of a different shape or datatype of the previously inserted one resets the queue.\nOnly passing of numpy arrays is supported, optionally annotated with timestamps if using the TimestampedArrayQueue class,\nbut other object types can be supported by extending the class.\n\nThe package has been tested on Python 3.6/3/7 on Windows and MacOS and Linux with Travis. Python 2.7 is not supported.\n\n# Usage example\n```python\nfrom arrayqueues.shared_arrays import ArrayQueue\nfrom multiprocessing import Process\nimport numpy as np\n\nclass ReadProcess(Process):\n    def __init__(self, source_queue):\n        super().__init__()\n        self.source_queue = source_queue\n      \n    def run(self):\n        print(self.source_queue.get())\n\nif __name__ == \"__main__\":\n    q = ArrayQueue(1) # intitialises an ArrayQueue which can hold 1MB of data\n    n = np.full((5,5), 5)\n    q.put(n)\n    r = ReadProcess(q)\n    r.start()\n    r.join()\n    \n```\n\nFurther examples can be found in tests.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fportugueslab%2Farrayqueues","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fportugueslab%2Farrayqueues","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fportugueslab%2Farrayqueues/lists"}