{"id":34737274,"url":"https://github.com/khalidmammadov/single_node_hadoop_docker","last_synced_at":"2026-04-28T16:33:35.731Z","repository":{"id":192401522,"uuid":"112097515","full_name":"khalidmammadov/single_node_hadoop_docker","owner":"khalidmammadov","description":"Single node HADOOP on docker container","archived":false,"fork":false,"pushed_at":"2019-12-08T14:45:32.000Z","size":11,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"master","last_synced_at":"2023-09-04T17:45:27.288Z","etag":null,"topics":["docker","hadoop","openjdk","ubuntu"],"latest_commit_sha":null,"homepage":null,"language":"Shell","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/khalidmammadov.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null}},"created_at":"2017-11-26T16:17:17.000Z","updated_at":"2023-09-04T17:45:30.575Z","dependencies_parsed_at":"2023-09-04T17:45:30.011Z","dependency_job_id":"4dfe87b2-dc2a-40bd-819e-15fcf7b64514","html_url":"https://github.com/khalidmammadov/single_node_hadoop_docker","commit_stats":null,"previous_names":["khalidmammadov/single_node_hadoop_docker"],"tags_count":null,"template":null,"template_full_name":null,"purl":"pkg:github/khalidmammadov/single_node_hadoop_docker","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/khalidmammadov%2Fsingle_node_hadoop_docker","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/khalidmammadov%2Fsingle_node_hadoop_docker/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/khalidmammadov%2Fsingle_node_hadoop_docker/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/khalidmammadov%2Fsingle_node_hadoop_docker/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/khalidmammadov","download_url":"https://codeload.github.com/khalidmammadov/single_node_hadoop_docker/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/khalidmammadov%2Fsingle_node_hadoop_docker/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":32390012,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-04-28T14:34:11.604Z","status":"ssl_error","status_checked_at":"2026-04-28T14:32:37.009Z","response_time":56,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["docker","hadoop","openjdk","ubuntu"],"created_at":"2025-12-25T03:43:24.963Z","updated_at":"2026-04-28T16:33:35.726Z","avatar_url":"https://github.com/khalidmammadov.png","language":"Shell","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Setting up Single node HADOOP on docker container\n\n\n## This Dockerfile builds Hadoop Docker image using Ubuntu image and OpenJDK jvm on single node.\n\nNOTE: I have not included hadoop instalation file as it big (too big for image rebuilds). But you can download it from Apache web site.\n\nDowload and save hadoop to the same folder (e.g. hadoop-2.8.2.tar.gz).\n\nI am using 2.8.2 version but feel free to download the other version and don’t forget to update Dockerfile respectevely.\n\nFor connectivity and web interface access I am using here BRIDGE network. It allows me to access the container and Hadoop web interfaces easily.\n\nYou can build image with following command:\n```\nsudo docker build -t hadoop:1 .\n```\nAnd start a container:\n```\ndocker run -dit --name h1 hadoop:1\n```\nNow Hadoop should be up and running. Lets do some tests and access to the HDFS and create a folder and add some file.\n\nFirst connect to the container:\n```\nkhalid@ubuntu:~/docker/hadoop.img$ docker attach h1\nroot@8d63c87c6c97:~#\n\nroot@8d63c87c6c97:~# hdfs dfs -ls /\n\nroot@8d63c87c6c97:~# hdfs dfs -mkdir /data\n\nroot@8d63c87c6c97:~# echo \"Hello world\" \u003e file.txt\nroot@8d63c87c6c97:~# hdfs dfs -copyFromLocal file.txt /data/\nroot@8d63c87c6c97:~# hdfs dfs -ls /\nFound 1 items\ndrwxr-xr-x   - root supergroup          0 2019-12-08 14:01 /data\nroot@8d63c87c6c97:~# hdfs dfs -ls /data/\nFound 1 items\n-rw-r--r--   1 root supergroup         12 2019-12-08 14:01 /data/file.txt\nroot@8d63c87c6c97:~#\n```\nNow  disconnect from the container by pressing Ctrl+P+Q\n\nWe are going to access it from external host. For that we will need to find out IP address it’s running on, so run below docker command and look for our container named “h1” as per below:\n```\nkhalid@ubuntu:~/docker/hadoop.img$ docker network inspect bridge \n\n...\"Containers\": {\n\"8d63c87c6c971304bc32997523bbeb06c81ebaedef2f988b605f276c77cc0971\": {\n\"Name\": \"h1\",\n\"EndpointID\": \"a26bc5df1fab8d2df150fc7a59bf6e3b8cbf369ad8ad6dfc93e3a66e1a0e51b1\",\n\"MacAddress\": \"02:42:ac:11:00:02\",\n\"IPv4Address\": \"172.17.0.2/16\",\n\"IPv6Address\": \"\"\n}\n},\n```\nThen you can query it again like so:\n```\nkhalid@ubuntu:~/docker/hadoop.img$ hdfs dfs -cat hdfs://172.17.0.2:9000/data/file.txt\nHello world\nkhalid@ubuntu:~/docker/hadoop.img$\n```\nThen you can also access NameNode info on\n```\nhttp://172.17.0.2:50070\n```\nAnd Yarn (Resource Manager) on\n```\nhttp://172.17.0.2:8088/cluster\n```\n\n\nEnjoy!\n\n\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkhalidmammadov%2Fsingle_node_hadoop_docker","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkhalidmammadov%2Fsingle_node_hadoop_docker","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkhalidmammadov%2Fsingle_node_hadoop_docker/lists"}