{"id":51030966,"url":"https://github.com/dreamfactorysoftware/df-hadoop","last_synced_at":"2026-06-22T00:30:51.350Z","repository":{"id":47159003,"uuid":"321701076","full_name":"dreamfactorysoftware/df-hadoop","owner":"dreamfactorysoftware","description":null,"archived":false,"fork":false,"pushed_at":"2026-05-13T00:51:31.000Z","size":69,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2026-05-13T02:35:13.240Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"PHP","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/dreamfactorysoftware.png","metadata":{"files":{"readme":"README.md","changelog":"CHANGELOG.md","contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null,"notice":null,"maintainers":null,"copyright":null,"agents":null,"dco":null,"cla":null}},"created_at":"2020-12-15T14:59:19.000Z","updated_at":"2023-02-28T14:13:41.000Z","dependencies_parsed_at":"2023-02-16T18:02:07.450Z","dependency_job_id":null,"html_url":"https://github.com/dreamfactorysoftware/df-hadoop","commit_stats":null,"previous_names":[],"tags_count":5,"template":false,"template_full_name":null,"purl":"pkg:github/dreamfactorysoftware/df-hadoop","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dreamfactorysoftware%2Fdf-hadoop","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dreamfactorysoftware%2Fdf-hadoop/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dreamfactorysoftware%2Fdf-hadoop/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dreamfactorysoftware%2Fdf-hadoop/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/dreamfactorysoftware","download_url":"https://codeload.github.com/dreamfactorysoftware/df-hadoop/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/dreamfactorysoftware%2Fdf-hadoop/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":34630753,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-05-26T15:22:16.424Z","status":"online","status_checked_at":"2026-06-21T02:00:05.568Z","response_time":54,"last_error":null,"robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":true,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2026-06-22T00:30:50.902Z","updated_at":"2026-06-22T00:30:51.342Z","avatar_url":"https://github.com/dreamfactorysoftware.png","language":"PHP","funding_links":[],"categories":[],"sub_categories":[],"readme":"## DreamFactory Hadoop\n\n### How to develop when package not released\n\n1. Run `docker-compose up -d`\n\n2. Login to web container: `docker exec web bash`\n\n3. Add this package as repository\n```json\n{\n  \"type\": \"path\",\n  \"url\": \"../dev/df-hadoop\"\n}\n```\n\n4. Run composer upgrade: `composer upgrade`\n\n### API Doc\n\n[Link](API_DOC.md)\n\n### Connecting to Hadoop HDFS\n\nTo create a service for connecting to Hadoop HDFS storage, follow these steps.\n\n1. Go to the Services tab in the admin console.\n2. Click Create.\n3. Set the Service Type to File \u003e Hadoop HDFS.\n4. Enter a name and label for the service. Name will be part of the URL for accessing the service via the REST API.\n5. Go to the Config tab for the new service.\n6. Enter your Hadoop Cluster Hostname\n7. Check 'Use SSL?', if your cluster use SSL.\n8. Enter your WebHDFS Server Port. Usually it is 50070.\n9. Enter the username you want to use when connecting to HDFS. DreamFactory does not support Kerberos yet.\n10. (Optional) Enter Namenode RPC Host and Port. Allows you to specify servers for write.\n11. Enter Container. The container points to the root directory for this service. Can be just '/'.\n12. Click Create Service to save your new service.\n13. Go to the API Docs tab in the admin console to test your new service.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdreamfactorysoftware%2Fdf-hadoop","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fdreamfactorysoftware%2Fdf-hadoop","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fdreamfactorysoftware%2Fdf-hadoop/lists"}