An open API service indexing awesome lists of open source software.

https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo

Ankara Cloud Meetup Big Data Demo
https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo

Last synced: 7 months ago
JSON representation

Ankara Cloud Meetup Big Data Demo

Awesome Lists containing this project

README

          

# Ankara Cloud Meetup Big Data Demo

1. What is this demo?
-------------
This demo was prepared for the **July, 2016 - Ankara Cloud Meetup - Big Data on AWS** talk
to show big data services and their usages on AWS.

You can access the presentation from [here](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/presentation/Big Data on AWS.pdf).

To run demo yourself, please follow steps below.

2. Steps
-------------
1. Open `pom.xml`.
* Write your AWS account id as value of `` tag under `properties` tag.
2. Go to [Storing - Firehose](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-storing-firehose) module
and follow [instructions](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-storing-firehose/README.md).
3. Go to [Storing - Crawler](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-storing-crawler) module
and follow [instructions](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-storing-crawler/README.md).
4. Go to [Searching - Elasticsearch](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-searching-elasticsearch) module
and follow [instructions](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-searching-elasticsearch/README.md).
5. Go to [Searching - Lambda](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-searching-lambda) module
and follow [instructions](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-searching-lambda/README.md).
6. Go to [Batch Processing - EMR](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-batchprocessing-emr) module
and follow [instructions](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-batchprocessing-emr/README.md).
7. Go to [Batch Processing - DynamoDB](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-batchprocessing-dynamodb) module
and follow [instructions](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-batchprocessing-dynamodb/README.md).
8. Go to [Batch Processing - Hadoop](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-batchprocessing-hadoop) module
and follow [instructions](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-batchprocessing-hadoop/README.md).
9. Go to [Batch Processing - Hive](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-batchprocessing-hive) module
and follow [instructions](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-batchprocessing-hive/README.md).
10. Go to [Batch Processing - Data Pipeline](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-batchprocessing-datapipeline) module
and follow [instructions](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-batchprocessing-datapipeline/README.md).
11. Go to [Stream Processing - Kinesis](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-streamprocessing-kinesis) module
and follow [instructions](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-streamprocessing-kinesis/README.md).
12. Go to [Stream Processing - Kinesis Producer](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-streamprocessing-kinesis-producer) module
and follow [instructions](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-streamprocessing-kinesis-producer/README.md).
13. Go to [Stream Processing - DynamoDB](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-streamprocessing-dynamodb) module
and follow [instructions](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-streamprocessing-dynamodb/README.md).
14. Go to [Stream Processing - Kinesis Consumer](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-streamprocessing-kinesis-consumer) module
and follow [instructions](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/tree/master/bigdata-demo-streamprocessing-kinesis-consumer/README.md).
15. Congratulations!!! You have completed **Ankara Cloud Meetup - Big Data Demo**

3. Demo Architecture
-------------
![bigdata-demo-architecture](https://github.com/serkan-ozal/ankaracloudmeetup-bigdata-demo/blob/master/images/bigdata-demo-architecture.png)