{"id":20531061,"url":"https://github.com/klirichek/sphtool","last_synced_at":"2026-05-16T18:07:36.575Z","repository":{"id":62866284,"uuid":"307898694","full_name":"klirichek/sphtool","owner":"klirichek","description":"Tool for converting index headers used by manticore search","archived":false,"fork":false,"pushed_at":"2021-06-29T06:58:00.000Z","size":13,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-09-08T14:47:14.720Z","etag":null,"topics":["json","manticore","sph"],"latest_commit_sha":null,"homepage":"","language":"Go","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/klirichek.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2020-10-28T03:41:41.000Z","updated_at":"2023-11-07T12:56:01.000Z","dependencies_parsed_at":"2022-11-08T06:15:18.749Z","dependency_job_id":null,"html_url":"https://github.com/klirichek/sphtool","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/klirichek/sphtool","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/klirichek%2Fsphtool","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/klirichek%2Fsphtool/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/klirichek%2Fsphtool/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/klirichek%2Fsphtool/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/klirichek","download_url":"https://codeload.github.com/klirichek/sphtool/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/klirichek%2Fsphtool/sbom","scorecard":{"id":563503,"data":{"date":"2025-08-11","repo":{"name":"github.com/klirichek/sphtool","commit":"7bc9f23e32766c1c28b74f916ecf354c17f3a129"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":3,"checks":[{"name":"SAST","score":0,"reason":"no SAST tool detected","details":["Warn: no pull requests merged into dev branch"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}},{"name":"Dangerous-Workflow","score":-1,"reason":"no workflows found","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Pinned-Dependencies","score":-1,"reason":"no dependencies found","details":null,"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"Code-Review","score":0,"reason":"Found 0/4 approved changesets -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Token-Permissions","score":-1,"reason":"No tokens found","details":null,"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"Vulnerabilities","score":10,"reason":"0 existing vulnerabilities detected","details":null,"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: MIT License: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Branch-Protection","score":0,"reason":"branch protection not enabled on development/release branches","details":["Warn: branch protection not enabled for branch 'master'"],"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}}]},"last_synced_at":"2025-08-20T14:19:08.705Z","repository_id":62866284,"created_at":"2025-08-20T14:19:08.706Z","updated_at":"2025-08-20T14:19:08.706Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":33113509,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-16T04:41:52.686Z","status":"ssl_error","status_checked_at":"2026-05-16T04:41:52.009Z","response_time":115,"last_error":"SSL_connect returned=1 errno=0 peeraddr=140.82.121.5:443 state=error: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["json","manticore","sph"],"created_at":"2024-11-15T23:42:14.876Z","updated_at":"2026-05-16T18:07:36.544Z","avatar_url":"https://github.com/klirichek.png","language":"Go","funding_links":[],"categories":[],"sub_categories":[],"readme":"# SPHtool - render/parse sph/meta files\n\nManticore search indexes consists from huge datafiles (as dictionaries, attributes, etc) and small headers containing\nbasic meta info as index settings, paths, etc. That is binary internal format and usually not capable to be edited from\noutside (so consider it as 'black box').\n\nThis tool renders whole header to json (which is obviously much more human-friendly).\nAlso it performs opposite operation - parses json back to header. \n \n    ./sphtool -i index.sph\n    ./sphtool -i index.meta\n    \nparses `index.sph` and produce `index.sph.json` as output. The same way works with 'meta' headers (both from realtime\nand percolate indexes). File extension (`.sph` or `.meta`) right now used to determine file format and is mandatory\n(I know, file fingerprint is enouth go determine format, however right now extension is used). By default target file is\noriginal one plus `.json` extension.\n\n    ./sphtool -i index.sph.json\n    \nrenders `index.sph.json` and produce `index.sph` as output. File extension `.json` is mandatory. Internal flavour (sph,\nmeta from rt or saved percolate queries) is determined from magic field in json. By default target file is original one\nwithout `.json` extension.\n\nOptionally target file may be provided with `-o` option, as:\n\n    ./sphtool -i pqindex.json -o pqindex.meta\n    ./sphtool -i plainindex.json -o plainindex.sph\n\nSupported versions of headers are visible in banner:\n\n    SPHtool v $Format:%h$ - sph and meta files converter\n    Copyright (c) 2020 Alexey N. Vinogradov (a.n.vinogradov@gmail.com)\n    Supports sph v. 60, meta v. 17, pq meta v. 8\n    Usage of ./sphtool:\n      -i string\n        \tpath to sph, meta, sph.json or meta.json file\n      -o string\n        \tpath to target file (optional)\n        \t\nTool may convert to json and back following headers:\n * `.sph` - which is 'sphinx header' - main file containing plain index params as schema, tokenenizer settings, etc.\n That is both part of standalone plain  indexes and rt disk chunks. In json you may change, say, path to files \n (wordforms, stopwords, whatever) if they changed.  Or fixup timestamps of the files, as they used to check files \n consistency.\n * `.meta` of rt - is header of realtime index. It has similar sense as sph file of plain index, but in aggregate\n meaning over all index chunks.\n * `.meta` of pq - is actually whole pq index (it has nothing else apart this meta). Apart general settings (like schema)\n and embedded files/hashes it includes stored queries.\n \n ## Building\n \n Use\n \n    go get github.com/klirichek/sphtool\n    \nor (if you have clone sources):\n\n    cd /src/of/sphtool\n    go build -o sphtool . \n\n## Caveats\n\nIt might look useful to format json if you want to edit it.\nMany sources advice to use 'jq' tool for it, like:\n\n    cat index.meta.json | jq . \u003e index_formatted.meta.json\n    \nHowever that `jq` corrupts some numbers when reformat, so that final file became unusable. Look at this live\nexample (one and same file first printed, then passed to jq). Note the difference! BEWARE! \n\n    $ cat ex.json\n    {\n      \"numbers\": [\n        623237308590442816,\n        2696721519739033356,\n        15902905282948881040\n      ]\n    }\n    \n    $ cat ex.json | jq .\n    {\n      \"numbers\": [\n        623237308590442800,\n        2696721519739033600,\n        15902905282948880000\n      ]\n    }\n    \n\n ","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fklirichek%2Fsphtool","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fklirichek%2Fsphtool","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fklirichek%2Fsphtool/lists"}