{"id":19270363,"url":"https://github.com/netdata/netdata-pandas","last_synced_at":"2025-09-09T19:30:20.398Z","repository":{"id":37198913,"uuid":"272524252","full_name":"netdata/netdata-pandas","owner":"netdata","description":"A helper library to pull data from the netdata rest api into a pandas dataframe.","archived":false,"fork":false,"pushed_at":"2023-04-18T16:02:13.000Z","size":1695,"stargazers_count":8,"open_issues_count":13,"forks_count":4,"subscribers_count":8,"default_branch":"master","last_synced_at":"2025-08-28T17:02:35.773Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":"https://netdata.github.io/netdata-pandas/","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/netdata.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-06-15T19:19:04.000Z","updated_at":"2025-01-16T02:36:08.000Z","dependencies_parsed_at":"2024-11-09T20:26:34.428Z","dependency_job_id":null,"html_url":"https://github.com/netdata/netdata-pandas","commit_stats":{"total_commits":119,"total_committers":6,"mean_commits":"19.833333333333332","dds":0.2941176470588235,"last_synced_commit":"b257e500a009f861219c5c454575f13c8a1b6935"},"previous_names":[],"tags_count":1,"template":false,"template_full_name":"fastai/nbdev_template","purl":"pkg:github/netdata/netdata-pandas","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/netdata%2Fnetdata-pandas","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/netdata%2Fnetdata-pandas/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/netdata%2Fnetdata-pandas/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/netdata%2Fnetdata-pandas/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/netdata","download_url":"https://codeload.github.com/netdata/netdata-pandas/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/netdata%2Fnetdata-pandas/sbom","scorecard":{"id":680682,"data":{"date":"2025-08-11","repo":{"name":"github.com/netdata/netdata-pandas","commit":"c9bb8176a0b8705d23ab4ef857c579b8e5434893"},"scorecard":{"version":"v5.2.1-40-gf6ed084d","commit":"f6ed084d17c9236477efd66e5b258b9d4cc7b389"},"score":3.4,"checks":[{"name":"Maintained","score":0,"reason":"0 commit(s) and 0 issue activity found in the last 90 days -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project is \"actively maintained\".","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#maintained"}},{"name":"Dangerous-Workflow","score":10,"reason":"no dangerous workflow patterns detected","details":null,"documentation":{"short":"Determines if the project's GitHub Action workflows avoid dangerous patterns.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#dangerous-workflow"}},{"name":"Code-Review","score":0,"reason":"Found 0/5 approved changesets -- score normalized to 0","details":null,"documentation":{"short":"Determines if the project requires human code review before pull requests (aka merge requests) are merged.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#code-review"}},{"name":"Packaging","score":-1,"reason":"packaging workflow not detected","details":["Warn: no GitHub/GitLab publishing workflow detected."],"documentation":{"short":"Determines if the project is published as a package that others can easily download, install, easily update, and uninstall.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#packaging"}},{"name":"Token-Permissions","score":0,"reason":"detected GitHub workflow tokens with excessive permissions","details":["Warn: no topLevel permission defined: .github/workflows/main.yml:1","Warn: no topLevel permission defined: .github/workflows/pypi.yml:1","Info: no jobLevel write permissions found"],"documentation":{"short":"Determines if the project's workflows follow the principle of least privilege.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#token-permissions"}},{"name":"Binary-Artifacts","score":10,"reason":"no binaries found in the repo","details":null,"documentation":{"short":"Determines if the project has generated executable (binary) artifacts in the source repository.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#binary-artifacts"}},{"name":"Pinned-Dependencies","score":0,"reason":"dependency not pinned by hash detected -- score normalized to 0","details":["Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/main.yml:37: update your workflow using https://app.stepsecurity.io/secureworkflow/netdata/netdata-pandas/main.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/main.yml:38: update your workflow using https://app.stepsecurity.io/secureworkflow/netdata/netdata-pandas/main.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/main.yml:7: update your workflow using https://app.stepsecurity.io/secureworkflow/netdata/netdata-pandas/main.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/main.yml:8: update your workflow using https://app.stepsecurity.io/secureworkflow/netdata/netdata-pandas/main.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/pypi.yml:13: update your workflow using https://app.stepsecurity.io/secureworkflow/netdata/netdata-pandas/pypi.yml/master?enable=pin","Warn: GitHub-owned GitHubAction not pinned by hash: .github/workflows/pypi.yml:15: update your workflow using https://app.stepsecurity.io/secureworkflow/netdata/netdata-pandas/pypi.yml/master?enable=pin","Warn: pipCommand not pinned by hash: .github/workflows/main.yml:14","Warn: pipCommand not pinned by hash: .github/workflows/main.yml:15","Warn: pipCommand not pinned by hash: .github/workflows/main.yml:44","Warn: pipCommand not pinned by hash: .github/workflows/pypi.yml:20","Warn: pipCommand not pinned by hash: .github/workflows/pypi.yml:21","Info:   0 out of   6 GitHub-owned GitHubAction dependencies pinned","Info:   0 out of   5 pipCommand dependencies pinned"],"documentation":{"short":"Determines if the project has declared and pinned the dependencies of its build process.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#pinned-dependencies"}},{"name":"CII-Best-Practices","score":0,"reason":"no effort to earn an OpenSSF best practices badge detected","details":null,"documentation":{"short":"Determines if the project has an OpenSSF (formerly CII) Best Practices Badge.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#cii-best-practices"}},{"name":"Fuzzing","score":0,"reason":"project is not fuzzed","details":["Warn: no fuzzer integrations found"],"documentation":{"short":"Determines if the project uses fuzzing.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#fuzzing"}},{"name":"License","score":10,"reason":"license file detected","details":["Info: project has a license file: LICENSE:0","Info: FSF or OSI recognized license: Apache License 2.0: LICENSE:0"],"documentation":{"short":"Determines if the project has defined a license.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#license"}},{"name":"Signed-Releases","score":-1,"reason":"no releases found","details":null,"documentation":{"short":"Determines if the project cryptographically signs release artifacts.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#signed-releases"}},{"name":"Branch-Protection","score":-1,"reason":"internal error: error during branchesHandler.setup: internal error: githubv4.Query: Resource not accessible by integration","details":null,"documentation":{"short":"Determines if the default and release branches are protected with GitHub's branch protection settings.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#branch-protection"}},{"name":"Security-Policy","score":10,"reason":"security policy file detected","details":["Info: security policy file detected: github.com/netdata/.github/SECURITY.md:1","Info: Found linked content: github.com/netdata/.github/SECURITY.md:1","Info: Found disclosure, vulnerability, and/or timelines in security policy: github.com/netdata/.github/SECURITY.md:1","Info: Found text in security policy: github.com/netdata/.github/SECURITY.md:1"],"documentation":{"short":"Determines if the project has published a security policy.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#security-policy"}},{"name":"SAST","score":0,"reason":"SAST tool is not run on all commits -- score normalized to 0","details":["Warn: 0 commits out of 30 are checked with a SAST tool"],"documentation":{"short":"Determines if the project uses static code analysis.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#sast"}},{"name":"Vulnerabilities","score":0,"reason":"52 existing vulnerabilities detected","details":["Warn: Project is vulnerable to: PYSEC-2024-230 / GHSA-248v-346w-9cwc","Warn: Project is vulnerable to: PYSEC-2022-42986 / GHSA-43fp-rhv2-5gv8","Warn: Project is vulnerable to: PYSEC-2023-135 / GHSA-xqr8-7jwr-rhp7","Warn: Project is vulnerable to: GHSA-39hc-v87j-747x","Warn: Project is vulnerable to: GHSA-3ww4-gg4f-jr7f","Warn: Project is vulnerable to: GHSA-5cpq-8wj7-hf2v","Warn: Project is vulnerable to: GHSA-9v9h-cgj8-h64p","Warn: Project is vulnerable to: GHSA-h4gh-qq45-vh27","Warn: Project is vulnerable to: PYSEC-2023-254 / GHSA-jfhm-5ghh-2f97","Warn: Project is vulnerable to: GHSA-jm77-qphf-c4w8","Warn: Project is vulnerable to: GHSA-v8gr-m533-ghj9","Warn: Project is vulnerable to: GHSA-w7pp-m8wf-vj6r","Warn: Project is vulnerable to: GHSA-x4qr-2fvf-3mr5","Warn: Project is vulnerable to: GHSA-vqfr-h8mv-ghfj","Warn: Project is vulnerable to: PYSEC-2024-60 / GHSA-jjg7-2v4v-x38h","Warn: Project is vulnerable to: GHSA-29gw-9793-fvw7","Warn: Project is vulnerable to: GHSA-cpwx-vrp4-4pq7","Warn: Project is vulnerable to: GHSA-gmj6-6f8f-6699","Warn: Project is vulnerable to: GHSA-h5c8-rqwp-cp95","Warn: Project is vulnerable to: GHSA-h75v-3vvj-5mfj","Warn: Project is vulnerable to: GHSA-q2x7-8rv6-6q7h","Warn: Project is vulnerable to: GHSA-33p9-3p43-82vq","Warn: Project is vulnerable to: PYSEC-2022-42974 / GHSA-m678-f26j-3hrp","Warn: Project is vulnerable to: PYSEC-2023-157 / GHSA-64x5-55rw-9974","Warn: Project is vulnerable to: PYSEC-2023-272 / GHSA-h56g-gq9v-vc8r","Warn: Project is vulnerable to: PYSEC-2024-165 / GHSA-hrw6-wg82-cm62","Warn: Project is vulnerable to: GHSA-q874-g24w-4q9g","Warn: Project is vulnerable to: PYSEC-2023-155 / GHSA-r726-vmfq-j9j3","Warn: Project is vulnerable to: GHSA-44cc-43rp-5947","Warn: Project is vulnerable to: GHSA-9q39-rmj3-p4r2","Warn: Project is vulnerable to: GHSA-9jmq-rx5f-8jwq","Warn: Project is vulnerable to: PYSEC-2022-212 / GHSA-v7vq-3x77-87vg","Warn: Project is vulnerable to: PYSEC-2023-228 / GHSA-mq26-g339-26xf","Warn: Project is vulnerable to: PYSEC-2023-117 / GHSA-mrwq-x4v8-fh7p","Warn: Project is vulnerable to: GHSA-9hjg-9r4m-mvj7","Warn: Project is vulnerable to: GHSA-9wx4-h78v-vm56","Warn: Project is vulnerable to: PYSEC-2023-74 / GHSA-j8r2-6x86-q33q","Warn: Project is vulnerable to: PYSEC-2025-49 / GHSA-5rjg-fvgr-3xxf","Warn: Project is vulnerable to: GHSA-cx63-2mw6-8hw5","Warn: Project is vulnerable to: PYSEC-2022-43012 / GHSA-r9hx-vwmv-q579","Warn: Project is vulnerable to: GHSA-753j-mpmx-qq6g","Warn: Project is vulnerable to: GHSA-7cx3-6m66-7c5m","Warn: Project is vulnerable to: GHSA-8w49-h785-mj3c","Warn: Project is vulnerable to: PYSEC-2023-75 / GHSA-hj3f-6gcp-jg8j","Warn: Project is vulnerable to: GHSA-qppv-j76h-2rpx","Warn: Project is vulnerable to: GHSA-w235-7p84-xx57","Warn: Project is vulnerable to: GHSA-34jh-p97f-mpxf","Warn: Project is vulnerable to: PYSEC-2023-212 / GHSA-g4mx-q9vg-27p4","Warn: Project is vulnerable to: GHSA-pq67-6m6q-mj2v","Warn: Project is vulnerable to: PYSEC-2023-192 / GHSA-v845-jxx5-vc9f","Warn: Project is vulnerable to: GHSA-jfmj-5v4g-7637","Warn: Project is vulnerable to: PYSEC-2021-130 / GHSA-4952-p58q-6crx"],"documentation":{"short":"Determines if the project has open, known unfixed vulnerabilities.","url":"https://github.com/ossf/scorecard/blob/f6ed084d17c9236477efd66e5b258b9d4cc7b389/docs/checks.md#vulnerabilities"}}]},"last_synced_at":"2025-08-21T23:02:42.189Z","repository_id":37198913,"created_at":"2025-08-21T23:02:42.189Z","updated_at":"2025-08-21T23:02:42.189Z"},"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":274348951,"owners_count":25268974,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","status":"online","status_checked_at":"2025-09-09T02:00:10.223Z","response_time":80,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-09T20:24:29.528Z","updated_at":"2025-09-09T19:30:20.356Z","avatar_url":"https://github.com/netdata.png","language":"Jupyter Notebook","readme":"# netdata-pandas\n\u003e A helper library to pull data from netdata api into a pandas dataframe.\n\n\n[![pypi package](https://img.shields.io/pypi/v/netdata-pandas.svg)](https://pypi.python.org/pypi/netdata-pandas/) \n[![CI](https://github.com/netdata/netdata-pandas/workflows/CI/badge.svg)](https://github.com/netdata/netdata-pandas/actions?query=workflow%3ACI)\n\n## Install\n\n`pip install netdata-pandas`\n\n## Documentation\n\nMore detailed documentation can be found at https://netdata.github.io/netdata-pandas\n\n## Quickstart\n\nGet some data into a pandas dataframe.\n\n```python\nfrom netdata_pandas.data import get_data\n\ndf = get_data('london.my-netdata.io', ['system.cpu','system.load'], after=-60, before=0)\nprint(df.shape)\nprint(df.head())\n```\n\n    (60, 12)\n                system.cpu|guest  system.cpu|guest_nice  system.cpu|iowait  \\\n    time_idx                                                                 \n    1604928205               0.0                    0.0                0.0   \n    1604928206               0.0                    0.0                0.0   \n    1604928207               0.0                    0.0                0.0   \n    1604928208               0.0                    0.0                0.0   \n    1604928209               0.0                    0.0                0.0   \n    \n                system.cpu|irq  system.cpu|nice  system.cpu|softirq  \\\n    time_idx                                                          \n    1604928205             0.0              0.0                 0.0   \n    1604928206             0.0              0.0                 0.0   \n    1604928207             0.0              0.0                 0.0   \n    1604928208             0.0              0.0                 0.0   \n    1604928209             0.0              0.0                 0.0   \n    \n                system.cpu|steal  system.cpu|system  system.cpu|user  \\\n    time_idx                                                           \n    1604928205          0.000000           0.501253         0.501253   \n    1604928206          0.000000           0.753769         0.502513   \n    1604928207          0.000000           0.505050         0.505050   \n    1604928208          0.000000           0.751880         0.501253   \n    1604928209          0.251256           0.251256         0.502513   \n    \n                system.load|load1  system.load|load15  system.load|load5  \n    time_idx                                                              \n    1604928205               0.03                 0.0               0.04  \n    1604928206               0.03                 0.0               0.04  \n    1604928207               0.03                 0.0               0.04  \n    1604928208               0.03                 0.0               0.04  \n    1604928209               0.03                 0.0               0.04  \n\n\nAn alternative way to call `get_data()` is to define what hosts and charts you want via the `host_charts_dict` param:\n\n```python\n# define list of charts for each host you want data for\nhost_charts_dict = {\n    \"london.my-netdata.io\" : ['system.io','system.ip'],\n    \"newyork.my-netdata.io\" : ['system.io','system.net'],\n}\ndf = get_data(host_charts_dict=host_charts_dict, host_prefix=True)\nprint(df.shape)\nprint(df.head())\n```\n\n    (61, 8)\n                london.my-netdata.io::system.io|in  \\\n    time_idx                                         \n    1604928340                                 NaN   \n    1604928341                                 0.0   \n    1604928342                                 0.0   \n    1604928343                                 0.0   \n    1604928344                                 0.0   \n    \n                london.my-netdata.io::system.io|out  \\\n    time_idx                                          \n    1604928340                                  NaN   \n    1604928341                            -53.89722   \n    1604928342                            -26.10278   \n    1604928343                              0.00000   \n    1604928344                              0.00000   \n    \n                london.my-netdata.io::system.ip|received  \\\n    time_idx                                               \n    1604928340                                       NaN   \n    1604928341                                  49.25227   \n    1604928342                                 227.22840   \n    1604928343                                 123.56787   \n    1604928344                                  31.99060   \n    \n                london.my-netdata.io::system.ip|sent  \\\n    time_idx                                           \n    1604928340                                   NaN   \n    1604928341                             -51.85469   \n    1604928342                             -85.22854   \n    1604928343                             -43.00154   \n    1604928344                             -19.55536   \n    \n                newyork.my-netdata.io::system.io|in  \\\n    time_idx                                          \n    1604928340                                  0.0   \n    1604928341                                  0.0   \n    1604928342                                  0.0   \n    1604928343                                  0.0   \n    1604928344                                  0.0   \n    \n                newyork.my-netdata.io::system.io|out  \\\n    time_idx                                           \n    1604928340                              0.000000   \n    1604928341                             -6.545929   \n    1604928342                             -9.454071   \n    1604928343                              0.000000   \n    1604928344                              0.000000   \n    \n                newyork.my-netdata.io::system.net|received  \\\n    time_idx                                                 \n    1604928340                                   13.778033   \n    1604928341                                   18.281470   \n    1604928342                                   24.811770   \n    1604928343                                   26.406000   \n    1604928344                                   26.457510   \n    \n                newyork.my-netdata.io::system.net|sent  \n    time_idx                                            \n    1604928340                               -16.97193  \n    1604928341                               -19.23857  \n    1604928342                               -76.86994  \n    1604928343                              -165.55492  \n    1604928344                              -115.83034  \n\n\n## Examples\n\nYou can find some more examples in the [examples](https://github.com/netdata/netdata-pandas/tree/master/examples) folder. \n\nOr if you just want to play with it right now you can use [this Google Colab notebook](https://colab.research.google.com/drive/1SGF3Ij1r8gNJOwdk-3cVhCvyUGwGiTnc?usp=sharing) to quickly get started.\n","funding_links":[],"categories":[],"sub_categories":[],"project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnetdata%2Fnetdata-pandas","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fnetdata%2Fnetdata-pandas","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fnetdata%2Fnetdata-pandas/lists"}