{"id":37074007,"url":"https://github.com/tektronix/syphon","last_synced_at":"2026-01-14T08:43:00.644Z","repository":{"id":57472953,"uuid":"171717182","full_name":"tektronix/syphon","owner":"tektronix","description":"A storage and management engine for CSV data.","archived":true,"fork":true,"pushed_at":"2021-10-12T15:00:47.000Z","size":348,"stargazers_count":5,"open_issues_count":3,"forks_count":1,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-11-28T02:24:37.190Z","etag":null,"topics":["csv","pandas","python","python3","storage-engine"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":"ethall/syphon","license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/tektronix.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":null,"support":null}},"created_at":"2019-02-20T17:17:40.000Z","updated_at":"2023-02-12T04:49:32.000Z","dependencies_parsed_at":null,"dependency_job_id":null,"html_url":"https://github.com/tektronix/syphon","commit_stats":null,"previous_names":[],"tags_count":11,"template":false,"template_full_name":null,"purl":"pkg:github/tektronix/syphon","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tektronix%2Fsyphon","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tektronix%2Fsyphon/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tektronix%2Fsyphon/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tektronix%2Fsyphon/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/tektronix","download_url":"https://codeload.github.com/tektronix/syphon/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/tektronix%2Fsyphon/sbom","scorecard":{"id":872948,"data":{"date":"2025-08-11","repo":{"name":"github.com/tektronix/syphon","commit":"04460a1196c3e5a211d01cd1f02ab307b46d5932"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":3.9,"checks":[{"name":"Maintained","score":0,"reason":"project is archived","details":["Warn: Repository is archived."],"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Token-Permissions","score":0,"reason":"detected GitHub workflow tokens with excessive permissions","details":["Warn: no topLevel permission defined: .github/workflows/initialstate-kpis.yml:1","Info: no jobLevel write permissions found"],"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Code-Review","score":1,"reason":"Found 2/14 approved changesets -- score normalized to 1","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Dangerous-Workflow","score":10,"reason":"no dangerous workflow patterns detected","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"Pinned-Dependencies","score":0,"reason":"dependency not pinned by hash detected -- score normalized to 0","details":["Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/initialstate-kpis.yml:14: update your workflow using https://app.stepsecurity.io/secureworkflow/tektronix/syphon/initialstate-kpis.yml/master?enable=pin","Warn: pipCommand not pinned by hash: .github/workflows/initialstate-kpis.yml:22","Info:   0 out of   1 GitHub-owned GitHubAction dependencies pinned","Info:   0 out of   1 pipCommand dependencies pinned"],"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"Vulnerabilities","score":10,"reason":"0 existing vulnerabilities detected","details":null,"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: MIT License: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Branch-Protection","score":-1,"reason":"internal error: error during branchesHandler.setup: internal error: githubv4.Query: Resource not accessible by integration","details":null,"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 26 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}}]},"last_synced_at":"2025-08-24T04:52:42.160Z","repository_id":57472953,"created_at":"2025-08-24T04:52:42.160Z","updated_at":"2025-08-24T04:52:42.160Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28414690,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-14T08:38:59.149Z","status":"ssl_error","status_checked_at":"2026-01-14T08:38:43.588Z","response_time":107,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.6:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["csv","pandas","python","python3","storage-engine"],"created_at":"2026-01-14T08:43:00.007Z","updated_at":"2026-01-14T08:43:00.628Z","avatar_url":"https://github.com/tektronix.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Syphon\n\n\u003e A CSV data storage and management engine.\n\n[![build](https://api.travis-ci.com/tektronix/syphon.svg?branch=master)](https://travis-ci.com/tektronix/syphon) [![codecov](https://codecov.io/gh/tektronix/syphon/branch/master/graph/badge.svg)](https://codecov.io/gh/tektronix/syphon) [![CodeFactor](https://www.codefactor.io/repository/github/tektronix/syphon/badge)](https://www.codefactor.io/repository/github/tektronix/syphon) [![PyPI](https://img.shields.io/pypi/v/syphon)](https://pypi.org/project/syphon/) [![PyPI - License](https://img.shields.io/pypi/l/syphon.svg)](https://pypi.org/project/syphon/)\n\n[![Checked with mypy](http://www.mypy-lang.org/static/mypy_badge.svg)](http://mypy-lang.org/) [![Code style: black](https://img.shields.io/badge/code%20style-black-000000.svg)](https://github.com/ambv/black)\n\n[![Keithley](https://tektronix.github.io/media/Keithley-opensource_badge-flat.svg)](https://github.com/tektronix)\n\nSyphon is a Python package that provides a simple interface to perform common tasks on labelled data.  Its aim is to fit seamlessly into any automation pipeline that requires organization and collation of large datasets.\n\n\n## Features\n\n* Archive file(s) into a data storage directory.\n  * Automatic archive organization based on the value of a data column (if a `.schema.json` file is present).\n  * Quickly append new archive files onto a previously built data file.\n* Build a single data file from the contents of the archive directory.\n* Initialize new archive directories by creating a storage schema (`.schema.json`) file.\n\n\n## Basic Usage\n\nInitialize an archive directory:\n```\npython -m syphon init ./storage/folder some_column_header \"another column header\"\n```\n\nArchive one or more files with direct paths, wildcard patterns, or a combination of both:\n```\npython -m syphon archive /path/to/data.csv ./storage/folder\n\npython -m syphon archive /path/to/data.csv /path/to/more/*.csv ./storage/folder\n```\n\nBuild a single data file from an archive directory:\n```\npython -m syphon build ./storage/folder all_data.csv\n```\n\nArchive additional data and append it to a previously built data file:\n```\npython -m syphon archive /path/to/still/more/*.csv ./storage/folder -i all_data.csv\n```\n\nGeneral command line documentation and subcommand documentation can be accessed via\n```\n python -m syphon --help\n\n python -m syphon SUBCOMMAND --help\n```\n\n\n## Contribute\n\nSee a typo? Know how to fix an issue? Implement a requested feature?\n\nWe'd love to accept your patches and contributions! The [Contributing](CONTRIBUTING.md) document guides you through checkout, unit testing, and building.\n\n\n## Maintainer\n\n* [Evan Hall](https://github.com/ethall)\n\n\n## Disclaimer\n\nThis is not an officially supported Tektronix product. It is maintained by a small group of employees in their spare time. We lack the resources typical of most Tektronix products, so please bear with us! We will do our best to address your issues and answer any questions directly related to this extension in a timely manner.\n\n\n## License\n\nCopyright Keithley Instruments, LLC. All rights reserved.\n\nLicensed under the [MIT](LICENSE) License.\n\u003cbr/\u003e\n\u003cbr/\u003e\n\u003cbr/\u003e\nMade with \u0026#10084; at Keithley Instruments\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftektronix%2Fsyphon","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftektronix%2Fsyphon","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftektronix%2Fsyphon/lists"}