https://github.com/patw/storm-sample

Sample code for building storm topologies in Hortonworks HDP
https://github.com/patw/storm-sample

Last synced: 29 days ago
JSON representation

Sample code for building storm topologies in Hortonworks HDP

• Host: GitHub
• URL: https://github.com/patw/storm-sample
• Owner: patw
• License: apache-2.0
• Created: 2014-12-16T13:40:46.000Z (about 10 years ago)
• Default Branch: master
• Last Pushed: 2014-12-16T14:26:08.000Z (about 10 years ago)
• Last Synced: 2024-05-07T18:23:07.345Z (8 months ago)
• Language: Java
• Size: 152 KB
• Stars: 1
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
storm-sample

============

Sample code for building storm topologies in Hortonworks HDP.

This is not a complete or working solution but provides all the necessary sample bits to get a storm project started.

Getting started:

- Look under src/main/java/com/hortonworks/streaming/impl

- In the topologies directory we can see the Storm topology (base class and implemented class)

- Under bolts you can see bolts for HDFS (with rotation), hive and solr

- The StormKafka scheme is under the kafka directory

  - All items in this topology are optional, you can disable everything but the Kafka spout to start,

    and add bolts as needed.

- Look under src/main/resources

- Modify everything in config.properties and hbase-site.xml to match your environment

Compile:

mvn compile

Build:

mvn package

Deploy Example script:

scp target/.jar :

scp src/main/resources/config.properties :

ssh  <<'ENDSSH'

storm jar .jar  config.properties

ENDSSH

 would be something like com.hortonworks.streaming.impl.topologies.BellStormKafkaTopology

Any questions about the code can be directed to pwendorf AT hortonworks DOT com