Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/infosys/realtimestreams

Realtime streams repo
https://github.com/infosys/realtimestreams

Last synced: about 23 hours ago
JSON representation

Realtime streams repo

Awesome Lists containing this project

README

        

## Infosys Realtime Streams Community Edition ( Lite Version ) Repository

**Infosys Real time Streams** is a horizontal framework which makes management, monitoring, real-time analytics and visualization of live streaming data a cinch and provides a visual code free interface, allowing the user to create pipelines of real time streams at ease and also depict their visualizations as a presentation layer

The Realtime Streams visual code free interface can be classified into two.

Realtime Streams : An interface for the Realtime pipeline Management
Stream Studio : An interface for the Business Stream Portal Management

Using the Realtime Streams login page we can login to the Realtime pipeline Management user interface with the credentials realtimeuser/realtimeuser



Realtime Streams core modules deals with creation of data pipeline, configuration of its components, its execution and visualization and granting exceptional access to users.

The landing page will have the pipeline management screens

Following are the core modules

* User Access Manager
* Configuration
* Pipeline
* Execution
* Visualizations
* Stream Studio
* Operational UI Wizard

The user interface has a guided wizard for the users to understand the process flow.



The configuration screen will have the configuration related functionalities

Using the pipeline creation screen we can create the realtime pipelines

**Realtime Streams Installation and deployment**

Following are the setup steps that needs to be followed for Realtime Streams Installation and deployment.

**Prerequisites used in the setup**

* Mysql version 5.1.31
* Hadoop
* Sources like Kafka/Flume
* Processing engine like Spark
* Sink like Elassandra
* Livy
* Grafana
* Java 1.8
* Tomcat 8.5.2
* Maven 3.3.3

**Installation and deployment**

* Download the latest code from Git repository.
* Change the mysql user id and password in the persistence.properties file available in the dss-stream-api\src\main\resources\ and dss-portal-api\src\main\resources\
* Change the required properties in the dss-stream-api\src\main\resources\commonconfig.properties
* Open the mysql prompt and run the script schema.sql in the dss-scripts folder which will create the database .Tables will be created by hibernate internally.
* Build the code using Maven and get the war file for the deployment from the dss-builder(parent pom) . We will have realtimestreams.war and streamportal.war in dss-stream-api and dss-portal-api target folders respectively.
* If we are using Tomcat container (added the Jetty plugin as well), copy the war files in the webapps and start the application. Verify whether the mysql tables are created by hibernate internally.
* Connect to the mysql data base (realtimestreams) and run all the remaining scripts in dss-scripts config and template folder.
* Restart the tomcat after applying all the mysql scripts.
* The application will be available from the following URLs,
Realtime Streams URL : http://:/realtimestreams/login.html (OR http://:/dss-stream-api/login.html)
Stream Portal URL : http://:/streamportal/login.html ( OR http://:/dss-portal-api/login.html)

**Overview on the Community and Enterprise versions of Realtime Streams**

HortonWorks + Cloudera Link -

https://2xbbhjxc6wk3v21p62t8n4d4-wpengine.netdna-ssl.com/wp-content/uploads/2016/11/Infosys-Real-Time-Streams-Extract-your-business-value-in-real-time-from-data-in-motion.pdf

**Eager to know more on Realtime Streams**

Visit the official Page - https://www.infosys.com/data-analytics/insights/Documents/realtime-streams.pdf