An open API service indexing awesome lists of open source software.

https://github.com/anistaluqdar/daadvisor

Using web scraping techniques, I extracted data from DAAD international course website and performed data analysis and visualization to discover useful insights and patterns.
https://github.com/anistaluqdar/daadvisor

python selenium tableau visualization

Last synced: 2 months ago
JSON representation

Using web scraping techniques, I extracted data from DAAD international course website and performed data analysis and visualization to discover useful insights and patterns.

Awesome Lists containing this project

README

          

# DAADvisor

In this project, I collected data from daad.de through web scraping techniques and utilized it to create visualizations that offer valuable insights. The aim is to facilitate easier access to information on this site for international students seeking relevant details.

## Dashboard 1

![alt text](screenshot/sheet1.png)
![alt text](screenshot/sheet2.png)
![alt text](screenshot/sheet3.png)
![alt text](screenshot/sheet4.png)
![alt text](screenshot/sheet5.png)
![alt text](screenshot/sheet6.png)
![alt text](screenshot/sheet7.png)
![alt text](screenshot/sheet8.png)
![alt text](screenshot/sheet9.png)

## Dashboard 2

You can visit the public dashboard [here](https://public.tableau.com/views/DAADvisor/Dashboard3?:language=en-US&:display_count=n&:origin=viz_share_link).

## Findings and Observations from the [Dashboard](https://public.tableau.com/views/DAADvisor/Dashboard3?:language=en-US&:display_count=n&:origin=viz_share_link)

# Build From Sources and Run the Selenium Scraper

1. Clone the repo
~~~bash
git clone https://github.com/AnisTaluqdar/DAADvisor.git
~~~
2. Initialize and activate virtual environment (for linux)
~~~bash
python -m venv venv

cd venv

bin/activate
~~~

3. Install dependencies
~~~bash
python -m pip install -r requirements.txt
~~~

4. Run for scrap the data from website
~~~bash
python Daad_Scraper/main.py
~~~

5. Run for data preprocessing
~~~bash
python Daad_Scraper/data_preprocessing.py
~~~