{"id":18490453,"url":"https://github.com/axsaucedo/hadoop-overview","last_synced_at":"2025-10-19T19:16:48.367Z","repository":{"id":150594484,"uuid":"92505385","full_name":"axsaucedo/hadoop-overview","owner":"axsaucedo","description":"Hands on Hadoop, services, installation","archived":false,"fork":false,"pushed_at":"2017-06-10T19:31:40.000Z","size":1838,"stargazers_count":6,"open_issues_count":0,"forks_count":10,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-03-23T18:11:19.276Z","etag":null,"topics":["ambari","hadoop","hdfs","hive","mapreduce","mesos","notes","pig","spark","yarn"],"latest_commit_sha":null,"homepage":"https://axsauze.github.io/hadoop-overview","language":"HTML","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/axsaucedo.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2017-05-26T11:43:49.000Z","updated_at":"2022-03-11T08:05:48.000Z","dependencies_parsed_at":"2023-06-11T14:31:05.977Z","dependency_job_id":null,"html_url":"https://github.com/axsaucedo/hadoop-overview","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/axsaucedo%2Fhadoop-overview","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/axsaucedo%2Fhadoop-overview/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/axsaucedo%2Fhadoop-overview/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/axsaucedo%2Fhadoop-overview/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/axsaucedo","download_url":"https://codeload.github.com/axsaucedo/hadoop-overview/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247931134,"owners_count":21020174,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ambari","hadoop","hdfs","hive","mapreduce","mesos","notes","pig","spark","yarn"],"created_at":"2024-11-06T12:59:42.706Z","updated_at":"2025-10-19T19:16:48.298Z","avatar_url":"https://github.com/axsaucedo.png","language":"HTML","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Introduction\n\nThese are complete notes on Hands on practice, exercises and installation of hadoop related services based on the [Hands on Hadoop Course](https://www.udemy.com/the-ultimate-hands-on-hadoop-tame-your-big-data) including: HDFS, YARN, MapReduce, Pig, Hive, Ambari, Spark, Mesos, TEZ, HBase, Storm, Oozie, Flink, Scoop, Flume, Kafka, MySQL, Cassandra, MongoDB, Drill, Hue, Phoenix, Presto and Zeppelin.\n\nThe live notebook can be found at: [axsauze.github.io/hadoop-overview](https://axsauze.github.io/hadoop-overview/) \n\nList of contents: \n\n* Section 1\n    - [1-1 - Hortonworks Installation](section-1/1-1.md) \n    - [1-2 - The Hadoop Ecosystem](section-1/1-2.md) \n    - [1-3 - Hadoop Ecosystem and Technologies](section-1/1-3.md) \n* Section 2\n    - [2-1 - HDFS: What is it and how it works](section-2/2-1.md) \n    - [2-2 - Install Movielens dataset](section-2/2-2.md) \n    - [2-3 - HDFS: Command line interface ](section-2/2-3.md) \n    - [2-4 - MapReduce Fundamental Concepts](section-2/2-4.md) \n    - [2-5 - MapReduce on a Cluster - How MR Scales](section-2/2-5.md) \n    - [2-6 - MapReduce: A Real Life Example](section-2/2-6.md) \n    - [2-7 - Running MapReduce with MRJOB](section-2/2-7.md) \n    - [2-8 - Running with MRJob](section-2/2-8.md) \n    - [2-9 - Hadoop Your Challenge](section-2/2-9.md) \n    - [2-10 - Check your results](section-2/2-10.md) \n* Section 3\n    - [3-1 - Introducing Ambari](section-3/3-1.md)\n    - [3-2 - Introducing Pig](section-3/3-2.md)\n    - [3-3 - PIG Example](section-3/3-3.md)\n    - [3-4 - Runing Pig Script](section-3/3-4.md)\n    - [3-5 - PigLatin: Diving Deeper](section-3/3-5.md)\n    - [3-6 - PIG Challenge](section-3/3-6.md)\n* Section 4\n    - [4-1 - SPARK](section-4/4-1.md)\n    - [4-2 - Introducing RDDs](section-4/4-2.md)\n    - [4-3 - Example RDD in Spark](section-4/4-3.md)\n    - [4-4 - Spark2.0 way of DataFrames and DataSets](section-4/4-4.md)\n    - [4-5 - Spark2 Finding movies!](section-4/4-5.md)\n    - [4-6 - Using MLLib in Spark](section-4/4-6.md)\n    - [4-7 - Spark2 Challenge](section-4/4-7.md)\n* Section 5\n    - [5-1 - What is HIVE?](section-5/5-1.md)\n    - [5-2 - Hive Example](section-5/5-2.md)\n    - [5-3 - How Hive Works](section-5/5-3.md)\n    - [5-4 - Hive Challenge](section-5/5-4.md)\n    - [5-5 - Integrating MySQL \u0026 Hadoop](section-5/5-5.md)\n    - [5-6 - Install MySQL and Run Stuff](section-5/5-6.md)\n    - [5-7 - Using Sqoop to extract data from MySQL](section-5/5-7.md)\n    - [5-8 - Sqoop export data to MySQL](section-5/5-8.md)\n* Section 6\n    - [6-1 - Why NoSQL](section-6/6-1.md)\n    - [6-2 - HBase](section-6/6-2.md)\n    - [6-3 - Let's play with HBase](section-6/6-3.md)\n    - [6-4 - HBase / Pig Integration](section-6/6-4.md)\n    - [6-5 - Cassandra Overview](section-6/6-5.md)\n    - [6-6 - Installing Cassandra](section-6/6-6.md)\n    - [6-7 - Write Spark to Cassandra](section-6/6-7.md)\n    - [6-8 - MongoDB](section-6/6-8.md)\n    - [6-9 - Installing MongoDB](section-6/6-9.md)\n    - [6-10 - MongoDB Shell](section-6/6-10.md)\n    - [6-11 - Choosing your database](section-6/6-11.md)\n    - [6-12 - Exercise](section-6/6-12.md)\n* Section 7\n    - [7-1 - External query engiens](section-7/7-1.md)\n    - [7-2 - Setting up drill](section-7/7-2.md)\n    - [7-3 - Querying with Drill](section-7/7-3.md)\n    - [7-4 - Apache Phoenix](section-7/7-4.md)\n    - [7-5 - Installing Phoenix](section-7/7-5.md)\n    - [7-6 - Using Phoenix](section-7/7-6.md)\n    - [7-7 - What is presto?](section-7/7-7.md)\n    - [7-8 - Installing PRESTO!](section-7/7-8.md)\n    - [7-9 - Presto Cassandra integration](section-7/7-9.md)\n* Section 8\n    - [8-1 - Hadoop under the hood](section-8/8-1.md)\n    - [8-2 - TEZ Explained](section-8/8-2.md)\n    - [8-3 - Configure and run hive](section-8/8-3.md)\n    - [8-4 - Apache Mesos](section-8/8-4.md)\n    - [8-5 - Zookeeper Overview](section-8/8-5.md)\n    - [8-6 - Simulating Zookeeper Master Failure](section-8/8-6.md)\n    - [8-7 - Oozie](section-8/8-7.md)\n    - [8-8 - Workflow in Oozie](section-8/8-8.md)\n    - [8-9 - Zeppelin Overview](section-8/8-9.md)\n    - [8-10 - Playing with Zepplin](section-8/8-10.md)\n    - [8-11 - Zeppelin Advanced ](section-8/8-11.md)\n    - [8-12 - HUE](section-8/8-12.md)\n    - [8-13 - Other Admin Technologies](section-8/8-13.md)\n* Section 9\n    - [9-1 - Streaming with Kafka](section-9/9-1.md)\n    - [9-2 - Setting up Kafka](section-9/9-2.md)\n    - [9-3 - Advanced Kafka](section-9/9-3.md)\n    - [9-4 - Apache Flume](section-9/9-4.md)\n    - [9-5 - Setup Flume](section-9/9-5.md)\n    - [9-6 - Setup Flume Flow](section-9/9-6.md)\n* Section 10\n    - [10-1 - Spark STREAMING](section-10/10-1.md)\n    - [10-2 - Spark Streaming Example](section-10/10-2.md)\n    - [10-3 - Python Challenge](section-10/10-3.md)\n    - [10-4 - Apache Storm](section-10/10-4.md)\n    - [10-5 - Apache Storm Example](section-10/10-5.md)\n    - [10-6 - What is Flink](section-10/10-6.md)\n    - [10-7 - Counting words with Flink](section-10/10-7.md)\n* Section 11\n    - [11-1 - All the other services](section-11/11-1.md)\n    - [11-2 - How pieces fit together](section-11/11-2.md)\n    - [11-3 - Understanding your requirements](section-11/11-3.md)\n    - [11-4 - Example Top Sellers](section-11/11-4.md)\n    - [11-5 - Example: Movie Recommendations](section-11/11-5.md)\n    - [11-6 - Challenge: System report](section-11/11-6.md)\n* Section 12\n    - [12-1 - Books and Online Courses](section-12/12-1.md)\n\n\n\n\n[Image]: https://www.udemy.com/the-ultimate-hands-on-hadoop-tame-your-big-data\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faxsaucedo%2Fhadoop-overview","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Faxsaucedo%2Fhadoop-overview","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Faxsaucedo%2Fhadoop-overview/lists"}