https://github.com/nextbreakpoint/flink-workshop

Example of Flink jobs for workshop (work in progress)
https://github.com/nextbreakpoint/flink-workshop

flink java stream-processing

Last synced: 14 days ago
JSON representation

Example of Flink jobs for workshop (work in progress)

• Host: GitHub
• URL: https://github.com/nextbreakpoint/flink-workshop
• Owner: nextbreakpoint
• License: bsd-3-clause
• Created: 2019-02-17T18:32:24.000Z (almost 6 years ago)
• Default Branch: master
• Last Pushed: 2023-09-05T22:02:44.000Z (over 1 year ago)
• Last Synced: 2024-11-17T20:52:53.362Z (3 months ago)
• Topics: flink, java, stream-processing
• Language: Java
• Homepage:
• Size: 7.04 MB
• Stars: 2
• Watchers: 2
• Forks: 1
• Open Issues: 4
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

        
# flink-workshop (work in progress)

Example of Flink jobs for workshop. It contains code of Flink jobs and scripts for creating Docker containers.

## License

The project is distributed under the terms of BSD 3-Clause License.

    Copyright (c) 2019, Andrea Medeghini

    All rights reserved.

    Redistribution and use in source and binary forms, with or without

    modification, are permitted provided that the following conditions are met:

    * Redistributions of source code must retain the above copyright notice, this

      list of conditions and the following disclaimer.

    * Redistributions in binary form must reproduce the above copyright notice,

      this list of conditions and the following disclaimer in the documentation

      and/or other materials provided with the distribution.

    * Neither the name of the project nor the names of its

      contributors may be used to endorse or promote products derived from

      this software without specific prior written permission.

    THIS SOFTWARE IS PROVIDED BY THE COPYRIGHT HOLDERS AND CONTRIBUTORS "AS IS"

    AND ANY EXPRESS OR IMPLIED WARRANTIES, INCLUDING, BUT NOT LIMITED TO, THE

    IMPLIED WARRANTIES OF MERCHANTABILITY AND FITNESS FOR A PARTICULAR PURPOSE ARE

    DISCLAIMED. IN NO EVENT SHALL THE COPYRIGHT HOLDER OR CONTRIBUTORS BE LIABLE

    FOR ANY DIRECT, INDIRECT, INCIDENTAL, SPECIAL, EXEMPLARY, OR CONSEQUENTIAL

    DAMAGES (INCLUDING, BUT NOT LIMITED TO, PROCUREMENT OF SUBSTITUTE GOODS OR

    SERVICES; LOSS OF USE, DATA, OR PROFITS; OR BUSINESS INTERRUPTION) HOWEVER

    CAUSED AND ON ANY THEORY OF LIABILITY, WHETHER IN CONTRACT, STRICT LIABILITY,

    OR TORT (INCLUDING NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE

    OF THIS SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

## Package Flink jobs

Create JAR file with command:

    mvn clean package

## Create Docker network

    docker network create workshop

## Build Docker images

Create Docker images with command:

    ./setup.sh

## Start containers

Start Docker containers with command:

    ./start.sh

## Start Flink jobs

Start Flink jobs with command:

    ./jobs-run.sh

## Cancel Flink jobs (with savepoint)

Cancel Flink jobs with command:

    ./jobs-cancel.sh

## Stop Flink jobs (when finished)

Stop Flink jobs with command:

    ./jobs-stop.sh

## Stop containers (when finished)

Stop Docker containers with command:

    ./stop.sh

## Monitor Flink jobs

Access Grafana dashboard at http://localhost:3000 (user: admin, password: admin)

Access Prometheus at http://localhost:9090

Access Flink UI at http://localhost:8081