{"id":13480824,"url":"https://github.com/rueckstiess/mtools","last_synced_at":"2025-11-11T22:26:55.549Z","repository":{"id":4660149,"uuid":"5806020","full_name":"rueckstiess/mtools","owner":"rueckstiess","description":"A collection of scripts to set up MongoDB test environments and parse and visualize MongoDB log files.","archived":false,"fork":false,"pushed_at":"2024-06-24T10:22:20.000Z","size":21522,"stargazers_count":1923,"open_issues_count":77,"forks_count":407,"subscribers_count":113,"default_branch":"develop","last_synced_at":"2025-09-25T09:31:27.369Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/rueckstiess.png","metadata":{"files":{"readme":"README.rst","changelog":"CHANGES.rst","contributing":".github/CONTRIBUTING.md","funding":null,"license":"LICENSE.md","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2012-09-14T07:28:16.000Z","updated_at":"2025-09-22T14:33:00.000Z","dependencies_parsed_at":"2024-10-14T23:00:36.139Z","dependency_job_id":"e4cd7069-a4d3-4318-92fa-4e2c4c7874c2","html_url":"https://github.com/rueckstiess/mtools","commit_stats":{"total_commits":1328,"total_committers":76,"mean_commits":"17.473684210526315","dds":0.6716867469879518,"last_synced_commit":"a5e45ef7aebeeb459a2162d3399faf631222cd9a"},"previous_names":[],"tags_count":35,"template":false,"template_full_name":null,"purl":"pkg:github/rueckstiess/mtools","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rueckstiess%2Fmtools","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rueckstiess%2Fmtools/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rueckstiess%2Fmtools/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rueckstiess%2Fmtools/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/rueckstiess","download_url":"https://codeload.github.com/rueckstiess/mtools/tar.gz/refs/heads/develop","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/rueckstiess%2Fmtools/sbom","scorecard":{"id":789242,"data":{"date":"2025-08-11","repo":{"name":"github.com/rueckstiess/mtools","commit":"a5e45ef7aebeeb459a2162d3399faf631222cd9a"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":3.5,"checks":[{"name":"Code-Review","score":1,"reason":"Found 4/29 approved changesets -- score normalized to 1","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Token-Permissions","score":0,"reason":"detected GitHub workflow tokens with excessive permissions","details":["Warn: no topLevel permission defined: .github/workflows/test.yml:1","Info: no jobLevel write permissions found"],"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Dangerous-Workflow","score":10,"reason":"no dangerous workflow patterns detected","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Security-Policy","score":0,"reason":"security policy file not detected","details":["Warn: no security policy file detected","Warn: no security file to analyze","Warn: no security file to analyze","Warn: no security file to analyze"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE.md:0","Info: FSF or OSI recognized license: Apache License 2.0: LICENSE.md:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"Pinned-Dependencies","score":0,"reason":"dependency not pinned by hash detected -- score normalized to 0","details":["Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/test.yml:16: update your workflow using https://app.stepsecurity.io/secureworkflow/rueckstiess/mtools/test.yml/develop?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/test.yml:18: update your workflow using https://app.stepsecurity.io/secureworkflow/rueckstiess/mtools/test.yml/develop?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/test.yml:21: update your workflow using https://app.stepsecurity.io/secureworkflow/rueckstiess/mtools/test.yml/develop?enable=pin","Warn: third-party GitHubAction not pinned by hash: .github/workflows/test.yml:28: update your workflow using https://app.stepsecurity.io/secureworkflow/rueckstiess/mtools/test.yml/develop?enable=pin","Warn: pipCommand not pinned by hash: .github/workflows/test.yml:33","Warn: pipCommand not pinned by hash: .github/workflows/test.yml:36","Info:   0 out of   3 GitHub-owned GitHubAction dependencies pinned","Info:   0 out of   1 third-party GitHubAction dependencies pinned","Info:   0 out of   2 pipCommand dependencies pinned"],"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Branch-Protection","score":-1,"reason":"internal error: error during branchesHandler.setup: internal error: githubv4.Query: Resource not accessible by integration","details":null,"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"Vulnerabilities","score":6,"reason":"4 existing vulnerabilities detected","details":["Warn: Project is vulnerable to: GHSA-fpfv-jqm9-f5jm","Warn: Project is vulnerable to: PYSEC-2019-41 / GHSA-qfc5-mcwq-26q8","Warn: Project is vulnerable to: GHSA-m87m-mmvp-v9qm","Warn: Project is vulnerable to: PYSEC-2013-30 / GHSA-x33v-f3gp-gw2c"],"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 6 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}}]},"last_synced_at":"2025-08-23T06:59:27.414Z","repository_id":4660149,"created_at":"2025-08-23T06:59:27.414Z","updated_at":"2025-08-23T06:59:27.414Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":283942985,"owners_count":26920568,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-11-11T02:00:06.610Z","response_time":65,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-07-31T17:00:45.487Z","updated_at":"2025-11-11T22:26:55.530Z","avatar_url":"https://github.com/rueckstiess.png","language":"Python","funding_links":[],"categories":["Python","Optimization and Monitoring","Tools"],"sub_categories":["Administration"],"readme":"======\nmtools\n======\n\n|PyPI version| |PyPI pyversions| |PyPI license|\n\n**mtools** is a collection of helper scripts to parse, filter, and visualize\nMongoDB log files (``mongod``, ``mongos``). mtools also includes ``mlaunch``, a\nutility to quickly set up complex MongoDB test environments on a local machine,\nand ``mtransfer``, a tool for transferring databases between MongoDB instances.\n\n.. figure:: https://raw.githubusercontent.com/rueckstiess/mtools/develop/mtools.png\n   :alt: mtools box\n\nWhat's in the box?\n------------------\n\nThe following tools are in the mtools collection:\n\n`mlogfilter \u003chttps://rueckstiess.github.io/mtools/mlogfilter.html\u003e`__\n   slices log files by time, merges log files, filters slow queries, finds\n   table scans, shortens log lines, filters by other attributes, convert to\n   JSON\n\n`mloginfo \u003chttps://rueckstiess.github.io/mtools/mloginfo.html\u003e`__\n   returns info about log file, like start and end time, version, binary,\n   special sections like restarts, connections, distinct view\n   (requires ``numpy``)\n\n`mplotqueries \u003chttps://rueckstiess.github.io/mtools/mplotqueries.html\u003e`__\n   visualize log files with different types of plots (requires ``matplotlib``)\n\n`mlaunch \u003chttps://rueckstiess.github.io/mtools/mlaunch.html\u003e`__\n   a script to quickly spin up local test environments, including replica sets\n   and sharded systems (requires ``pymongo``, ``psutil``, ``packaging``)\n\n`mtransfer \u003chttps://rueckstiess.github.io/mtools/mtransfer.html\u003e`__\n   an experimental script to transfer databases between MongoDB instances by\n   copying WiredTiger data files (requires ``pymongo`` and ``wiredtiger``)\n\nFor more information, see the `mtools documentation\n\u003chttps://rueckstiess.github.io/mtools\u003e`__.\n\nRequirements and Installation Instructions\n------------------------------------------\n\nThe mtools collection is written in Python, and most of the tools only use the\nstandard packages shipped with Python. The tools are currently tested with\nPython 3.8, 3.9, 3.10, and 3.11.\n\nSome of the tools have additional dependencies, which are listed under the\nspecific tool's section. See the `installation instructions\n\u003chttps://rueckstiess.github.io/mtools/install.html\u003e`__ for more information.\n\nThe mtools suite is only tested with\n`actively supported \u003chttps://www.mongodb.com/support-policy/lifecycles\u003e`\n(non End-of-Life) versions of the MongoDB server. As of September 2023,\nthat includes MongoDB 4.4 or newer.\n\nRecent Changes\n--------------\n\nSee `Changes to mtools \u003chttps://rueckstiess.github.io/mtools/changelog.html\u003e`__\nfor a list of changes from previous versions of mtools.\n\nContribute to mtools\n--------------------\n\nIf you'd like to contribute to mtools, please read the `contributor page\n\u003chttps://rueckstiess.github.io/mtools/contributing.html\u003e`__ for instructions.\n\nDisclaimer\n----------\n\nThis software is not supported by `MongoDB, Inc. \u003chttps://www.mongodb.com\u003e`__\nunder any of their commercial support subscriptions or otherwise. Any usage of\nmtools is at your own risk. Bug reports, feature requests and questions can be\nposted in the `Issues\n\u003chttps://github.com/rueckstiess/mtools/issues?state=open\u003e`__ section on GitHub.\n\n.. |PyPI version| image:: https://img.shields.io/pypi/v/mtools.svg\n   :target: https://pypi.python.org/pypi/mtools/\n.. |PyPI pyversions| image:: https://img.shields.io/pypi/pyversions/mtools.svg\n   :target: https://pypi.python.org/pypi/mtools/\n.. |PyPI license| image:: https://img.shields.io/pypi/l/mtools.svg\n   :target: https://pypi.python.org/pypi/mtools/\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frueckstiess%2Fmtools","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Frueckstiess%2Fmtools","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Frueckstiess%2Fmtools/lists"}