{"id":19888872,"url":"https://github.com/paypal/nnanalytics","last_synced_at":"2025-05-09T00:07:49.420Z","repository":{"id":33690773,"uuid":"134898804","full_name":"paypal/NNAnalytics","owner":"paypal","description":"NameNodeAnalytics is a self-help utility for scouting and maintaining the namespace of an HDFS instance.","archived":false,"fork":false,"pushed_at":"2024-07-30T18:14:23.000Z","size":2767,"stargazers_count":116,"open_issues_count":18,"forks_count":72,"subscribers_count":23,"default_branch":"master","last_synced_at":"2025-05-09T00:07:41.073Z","etag":null,"topics":["fsimage","hadoop","hdfs","metadata","namespace","scanner","utility"],"latest_commit_sha":null,"homepage":"","language":"Java","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/paypal.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-05-25T19:51:45.000Z","updated_at":"2025-04-18T08:51:55.000Z","dependencies_parsed_at":"2022-08-07T23:00:23.476Z","dependency_job_id":"4be9b8c0-112f-462f-adc9-8dd03b893d52","html_url":"https://github.com/paypal/NNAnalytics","commit_stats":null,"previous_names":[],"tags_count":14,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/paypal%2FNNAnalytics","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/paypal%2FNNAnalytics/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/paypal%2FNNAnalytics/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/paypal%2FNNAnalytics/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/paypal","download_url":"https://codeload.github.com/paypal/NNAnalytics/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":253166520,"owners_count":21864482,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["fsimage","hadoop","hdfs","metadata","namespace","scanner","utility"],"created_at":"2024-11-12T18:08:31.732Z","updated_at":"2025-05-09T00:07:49.362Z","avatar_url":"https://github.com/paypal.png","language":"Java","funding_links":[],"categories":[],"sub_categories":[],"readme":"[![License](http://img.shields.io/:license-Apache%202-blue.svg)](http://www.apache.org/licenses/LICENSE-2.0.txt)\n[![Build Status](https://travis-ci.com/paypal/NNAnalytics.svg?branch=master)](https://travis-ci.com/paypal/NNAnalytics)\n[![Documentation Status](https://readthedocs.org/projects/nnanalytics/badge/?version=latest)](https://nnanalytics.readthedocs.io/en/latest/)\n[![codecov](https://codecov.io/gh/paypal/NNAnalytics/branch/master/graph/badge.svg)](https://codecov.io/gh/paypal/NNAnalytics)\n[![Codacy Badge](https://api.codacy.com/project/badge/Grade/acc8afc858ff485ea67653b23c8ea82b)](https://github.com/paypal/NNAnalytics/pulls) \n[![Join the chat at https://gitter.im/NNAnalytics/Lobby](https://badges.gitter.im/NNAnalytics/Lobby.svg)](https://gitter.im/NNAnalytics/Lobby?utm_source=badge\u0026utm_medium=badge\u0026utm_campaign=pr-badge\u0026utm_content=badge)\n\n# \u003cimg src=\"docs/images/NNA-logo.png\" width=\"174\" height=\"120\" /\u003e\n\n\"A Standby read-only HDFS NameNode, with no RPC server, that services clients over a REST API, utilizes Java 8 Stream API, all for the purpose of performing large and complicated scans of the entire file system metadata for end users.\"\n\nRun a demo locally and instantly! Just run the following command on a workspace directory:\n```\ngit clone https://github.com/paypal/NNAnalytics.git nna \u0026\u0026 cd ./nna \u0026\u0026 ./gradlew -PmainClass=org.apache.hadoop.hdfs.server.namenode.analytics.TestWithMiniClusterWithStreamEngine execute\n```\nThen go to http://localhost:4567 and you will have an NNA instance complete with a mini HA-enabled HDFS instance all updating in real time on your local machine!\n\n__________________________________________________________________________________________________________________\n\n# Architecture: Legacy vs NNA\n\n\u003cimg src=\"docs/images/NNA-arch-1.png\" width=\"917\" height=\"478\" /\u003e\n\u003cimg src=\"docs/images/NNA-arch-2.png\" width=\"861\" height=\"526\" /\u003e\n\n__________________________________________________________________________________________________________________\n\n# Documentation \u0026 Getting Started\n\n  * [Click here to read the docs](http://nnanalytics.readthedocs.io/)\n\n__________________________________________________________________________________________________________________\n\n# Presentations\n\n  * [SlideShare](https://www2.slideshare.net/PlamenJeliazkov/namenode-analytics-querying-hdfs-namespace-in-real-time)\n  * [DataWorks Summit](https://www.youtube.com/watch?v=9xlB5C88tbk)\n\n__________________________________________________________________________________________________________________\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpaypal%2Fnnanalytics","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fpaypal%2Fnnanalytics","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fpaypal%2Fnnanalytics/lists"}