Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/muhanedyahya/javastack

Java Project with automated stack
https://github.com/muhanedyahya/javastack

aws bash-scripting docker ec2 iam java loadbalancer memcached mysql nginx rabbitmq route53 s3 tomcat vagrant virtualbox

Last synced: about 1 month ago
JSON representation

Java Project with automated stack

Awesome Lists containing this project

README 

        
## JavaStack

### Automated Setup of A Multi Tier Web App



# Prerequisite



To complete this project you should have your lab set-up with the appropriate tools.



 - Git, Bash or any Code editor of choice

 - Oracle VirtualBox

 - Install Vagrant, and Vagrant Plugins.



# Project Architecture



![Stack](Stack.png)



This is a follow up project on the my last project: Multi Tier Web Application Stack Setup Locally but this time we will be automating 

the entire process with bash scripts and vagrant to bring up our VMs and provision the services with just one command.



Write your own bash script or inspect the script as contained in the project repo and explained in detail below. 

The Order of execution are also detailed in the vagrantfile



# Bash Script for the DataBase



All of the commands ran manually will now be scripted in an executable file called `mysql.sh` to provision the database service. 

Each line of script are command executed within the `db01` VM created through vagrant.



    #!/bin/bash

    DATABASE_PASS='admin123'

    sudo yum update -y

    sudo yum install epel-release -y

    sudo yum install git zip unzip -y

    sudo yum install mariadb-server -y



## Starting & Enabling mariadb-server



    sudo systemctl start mariadb

    sudo systemctl enable mariadb

    

    cd /tmp/

    git clone -b local-setup https://github.com/MuhanedYahya/JavaStack.git



## Restore the dump file for the application



    sudo mysqladmin -u root password "$DATABASE_PASS"

    sudo mysql -u root -p"$DATABASE_PASS" -e "UPDATE mysql.user SET Password=PASSWORD('$DATABASE_PASS') WHERE User='root'"

    sudo mysql -u root -p"$DATABASE_PASS" -e "DELETE FROM mysql.user WHERE User='root' AND Host NOT IN ('localhost', '127.0.0.1', '::1')"

    sudo mysql -u root -p"$DATABASE_PASS" -e "DELETE FROM mysql.user WHERE User=''"

    sudo mysql -u root -p"$DATABASE_PASS" -e "DELETE FROM mysql.db WHERE Db='test' OR Db='test\_%'"

    sudo mysql -u root -p"$DATABASE_PASS" -e "FLUSH PRIVILEGES"

    sudo mysql -u root -p"$DATABASE_PASS" -e "create database accounts"

    sudo mysql -u root -p"$DATABASE_PASS" -e "grant all privileges on accounts.* TO 'admin'@'localhost' identified by 'admin123'"

    sudo mysql -u root -p"$DATABASE_PASS" -e "grant all privileges on accounts.* TO 'admin'@'%' identified by 'admin123'"

    sudo mysql -u root -p"$DATABASE_PASS" accounts < /tmp/vprofile-project/src/main/resources/db_backup.sql

    sudo mysql -u root -p"$DATABASE_PASS" -e "FLUSH PRIVILEGES"



## Restart mariadb-server



    sudo systemctl restart mariadb



## Starting the firewall and allowing the mariadb to access from port no. 3306



    sudo systemctl start firewalld

    sudo systemctl enable firewalld

    sudo firewall-cmd --get-active-zones

    sudo firewall-cmd --zone=public --add-port=3306/tcp --permanent

    sudo firewall-cmd --reload

    sudo systemctl restart mariadbBash Script for Memcached



# Bash Script for memcached service



This bash script named `memcache.sh` will provision the memcached service executed by vagrant when the `mc01 server` is created. 

All of the instructions are also contained in the Vagrantfile.



    #!/bin/bash

    sudo yum install epel-release -y

    sudo yum install memcached -y

    sudo systemctl start memcached

    sudo systemctl enable memcached

    sudo systemctl status memcached

    sudo memcached -p 11211 -U 11111 -u memcached -d



# Bash Script for Rabbitmq



Create a file named `rabbitmq.sh` . The below bash script will create the rabbitMQ service.



    #!/bin/bash

    sudo yum install epel-release -y

    sudo yum update -y

    sudo yum install wget -y

    cd /tmp/

    wget http://packages.erlang-solutions.com/erlang-solutions-2.0-1.noarch.rpm

    sudo rpm -Uvh erlang-solutions-2.0-1.noarch.rpm

    sudo yum -y install erlang socat

    curl -s https://packagecloud.io/install/repositories/rabbitmq/rabbitmq-server/script.rpm.sh | sudo bash

    sudo yum install rabbitmq-server -y

    sudo systemctl start rabbitmq-server

    sudo systemctl enable rabbitmq-server

    sudo systemctl status rabbitmq-server

    sudo sh -c 'echo "[{rabbit, [{loopback_users, []}]}]." > /etc/rabbitmq/rabbitmq.config'

    sudo rabbitmqctl add_user test test

    sudo rabbitmqctl set_user_tags test administrator

    sudo systemctl restart rabbitmq-server



# Bash Script for Tomcat



Create a file named `tomcat.sh`, the bash script will provision Tomcat service and will build and deploy in the `app01` server for our application.



    TOMURL="https://archive.apache.org/dist/tomcat/tomcat-8/v8.5.37/bin/apache-tomcat-8.5.37.tar.gz"

    yum install java-1.8.0-openjdk -y

    yum install git maven wget -y

    cd /tmp/

    wget $TOMURL -O tomcatbin.tar.gz

    EXTOUT=`tar xzvf tomcatbin.tar.gz`

    TOMDIR=`echo $EXTOUT | cut -d '/' -f1`

    useradd --shell /sbin/nologin tomcat

    rsync -avzh /tmp/$TOMDIR/ /usr/local/tomcat8/

    chown -R tomcat.tomcat /usr/local/tomcat8



    rm -rf /etc/systemd/system/tomcat.service



    cat <> /etc/systemd/system/tomcat.service

    [Unit]

    Description=Tomcat

    After=network.target



    [Service]



    User=tomcat

    Group=tomcat



    WorkingDirectory=/usr/local/tomcat8



    #Environment=JRE_HOME=/usr/lib/jvm/jre

    Environment=JAVA_HOME=/usr/lib/jvm/jre



    Environment=CATALINA_PID=/var/tomcat/%i/run/tomcat.pid

    Environment=CATALINA_HOME=/usr/local/tomcat8

    Environment=CATALINE_BASE=/usr/local/tomcat8



    ExecStart=/usr/local/tomcat8/bin/catalina.sh run

    ExecStop=/usr/local/tomcat8/bin/shutdown.sh



    RestartSec=10

    Restart=always



    [Install]

    WantedBy=multi-user.target



    EOT



    systemctl daemon-reload

    systemctl start tomcat

    systemctl enable tomcat



## Clone source code 



    git clone -b local-setup https://github.com/MuhanedYahya/JavaStack.git

    cd vprofile-project



## Build the application



    mvn install

    systemctl stop tomcat

    sleep 60



## Remove default tomcat

    rm -rf /usr/local/tomcat8/webapps/ROOT*



## Copy the artifact

    cp target/vprofile-v2.war /usr/local/tomcat8/webapps/ROOT.war



## Resarting tomcat

    systemctl start tomcat

    sleep 120



    cp /vagrant/application.properties /usr/local/tomcat8/webapps/ROOT/WEB-INF/classes/application.properties

    systemctl restart tomcat



# Bash Script for Nginx



Again, create a file named `nginx.sh` for the `web server` (web01). The bash script will provision nginx service which serves both as our web 

frontend interface and load balancer that will forward requests to our backend application.



## Adding repository and installing nginx  



    apt update

    apt install nginx -y



    cat < vproapp

    upstream vproapp {



     server app01:8080;



    }



    server {



      listen 80;



    location / {



      proxy_pass http://vproapp;



    }



    }



    EOT



    mv vproapp /etc/nginx/sites-available/vproapp

    rm -rf /etc/nginx/sites-enabled/default

    ln -s /etc/nginx/sites-available/vproapp /etc/nginx/sites-enabled/vproapp



## Starting nginx service and firewall



    systemctl start nginx

    systemctl enable nginx

    systemctl restart nginx



Now that we have all the services completely scripted we will proceed to automate all the process



Edit `application.properties` File



Ensure to edit the `properties.application` file with the right details used to set up all the services in the bash scripts



    #JDBC Configutation for Database Connection

    jdbc.driverClassName=com.mysql.jdbc.Driver

    jdbc.url=jdbc:mysql://db01:3306/accounts?useUnicode=true&characterEncoding=UTF-8&zeroDateTimeBehavior=convertToNull

    jdbc.username=admin

    jdbc.password=admin123



    #Memcached Configuration For Active and StandBy Host

    #For Active Host

    memcached.active.host=mc01

    memcached.active.port=11211

    #For StandBy Host

    memcached.standBy.host=127.0.0.2

    memcached.standBy.port=11211



    #RabbitMq Configuration

    rabbitmq.address=rmq01

    rabbitmq.port=5672

    rabbitmq.username=test

    rabbitmq.password=test



    #Elasticesearch Configuration

    elasticsearch.host =192.168.1.85

    elasticsearch.port =9300

    elasticsearch.cluster=vprofile

    elasticsearch.node=vprofilenode



Procceding, clone the repository



    git clone https://github.com/MuhanedYahya/JavaStack.git



Change directory to the automation_provisioning directory. 

Then run the vagrant up command



    vagrant up



To stop the Stack, run the command on your terminal in the working directory where the vagrantfile is located



    vagrant halt



To check status of the VMs , run the command



    vagrant status



To re-start the VMs again, run the command



    vagrant up



Finally to destroy the VMs, run the command



    vagrant destroy