https://github.com/patw/storm-sample
Sample code for building storm topologies in Hortonworks HDP
https://github.com/patw/storm-sample
Last synced: 4 months ago
JSON representation
Sample code for building storm topologies in Hortonworks HDP
- Host: GitHub
- URL: https://github.com/patw/storm-sample
- Owner: patw
- License: apache-2.0
- Created: 2014-12-16T13:40:46.000Z (over 10 years ago)
- Default Branch: master
- Last Pushed: 2014-12-16T14:26:08.000Z (over 10 years ago)
- Last Synced: 2025-01-27T06:43:39.582Z (6 months ago)
- Language: Java
- Size: 152 KB
- Stars: 1
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
storm-sample
============
Sample code for building storm topologies in Hortonworks HDP.
This is not a complete or working solution but provides all the necessary sample bits to get a storm project started.
Getting started:
- Look under src/main/java/com/hortonworks/streaming/impl
- In the topologies directory we can see the Storm topology (base class and implemented class)
- Under bolts you can see bolts for HDFS (with rotation), hive and solr
- The StormKafka scheme is under the kafka directory
- All items in this topology are optional, you can disable everything but the Kafka spout to start,
and add bolts as needed.
- Look under src/main/resources
- Modify everything in config.properties and hbase-site.xml to match your environment
Compile:
mvn compile
Build:
mvn package
Deploy Example script:
scp target/.jar :
scp src/main/resources/config.properties :
ssh <<'ENDSSH'
storm jar .jar config.properties
ENDSSH
would be something like com.hortonworks.streaming.impl.topologies.BellStormKafkaTopology
Any questions about the code can be directed to pwendorf AT hortonworks DOT com