https://github.com/abhash-rai/aus_sol_report_generator

This is a pretty basic script aimed for mostly learning purposes. The project uses git, github, python & its libraries such as BeautifulSoup4, selenium, ast, datetime, regex, fpdf, tqdm and other default libraries. The script web scrapes data from 'https://immi.homeaffairs.gov.au/visas/working-in-australia/skill-occupation-list' to store or generate reports about occupations in Skilled Occupation List of Australia as pdf files. Project started at June of 2022.
https://github.com/abhash-rai/aus_sol_report_generator

automation beautifulsoup4 bs4 pdf-generation selenium tqdm webscraping

Last synced: 7 months ago
JSON representation

This is a pretty basic script aimed for mostly learning purposes. The project uses git, github, python & its libraries such as BeautifulSoup4, selenium, ast, datetime, regex, fpdf, tqdm and other default libraries. The script web scrapes data from 'https://immi.homeaffairs.gov.au/visas/working-in-australia/skill-occupation-list' to store or generate reports about occupations in Skilled Occupation List of Australia as pdf files. Project started at June of 2022.

• Host: GitHub
• URL: https://github.com/abhash-rai/aus_sol_report_generator
• Owner: abhash-rai
• Created: 2022-06-08T09:19:32.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2022-06-15T13:47:12.000Z (over 3 years ago)
• Last Synced: 2025-01-16T07:29:12.867Z (9 months ago)
• Topics: automation, beautifulsoup4, bs4, pdf-generation, selenium, tqdm, webscraping
• Language: Python
• Homepage:
• Size: 58.5 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# **Australia's Skilled Occupation List report generator - v2.1**

* First of all, go to the 'Scripts' directory in the terminal.

* Secondly, run "del_reports.py" to remove any existing report files.

* Finally, run the command "aussol.py help" and follow the instructions.

> **NOTE:**

All scripts are inside **'Scripts'** folder and the database directory of the script is **'Data/Records'**.\

If you want to see the project's default directory tree then, open 'aussol.py' in a code editor or IDE and scroll just below the import section.


FORMAT:

$ ausso.py{space}{attributtes}

                        |

			---------> store (Refer to action no. 1)

			|

			---------> reportALL (Refer to action no. 2)

			|

			---------> reportIT (Refer to action no. 3)



## You can request the script to perform the following (three actions):


#### 1. ***(REQUIRES INTERNET)*** To store the latest copy of the Skilled Occupation List (SOL) of Australia in the script's database(Data/Records):

	

> ***$ aussol.py store***

    

After running above command the script automatically stores latest Skilled Occupation List of current date into its database only if there is an internet connection and current date's Skilled Occupation List entry is not stored in the database yet.

#### 2. ***(INTERNET NOT REQUIRED)*** To generate Skilled Occupation List report (all occupations) from the script's database:

> ***$ aussol.py reportALL***

    

Running the above command will generate an Skilled Occupation List report of all occupations between two desired dates from script's database as a pdf report file.

    

If in case, the script's database does not have Skilled Occupation List of the entered dates then, it will automatically choose dates nearest to it in its database to generate a report file.

	

    

Depending on the information stored in the entered date's Skilled Occupation List entry, the script will create a report file which could include any of the following details:\

* No changes with all the current occupation present in the latest Skilled Occupation List.

* Added occupations with its total number and other remaining occupations present in the latest entry of Skilled Occupation List in the databse.

* Removed occupations with its total number and other remaining occupations present in the latest entry of Skilled Occupation List in the databse.

* Both added as well as removed occupations with its total number and other remaining occupations present in the latest entry of Skilled Occupation List in the databse.

#### 3. ***(INTERNET NOT REQUIRED)*** To generate latest Skilled Occupation List report (IT related occupations only) from the script's database:

> ***$ aussol.py reportIT***

		

    

Running the above command will generate IT occupations report from Skilled Occupation List of Australia and the script will ask whether user wants to recieve the report on the terminal or as a pdf report file.

### This script has two modes:

	

	1. When internet connectivity is available:

	

		All three above actions can be performed.

		

	2. When there is no internet connection:

	

		Only the second and the third action can be performed.	

### If you want only the latest information:

	

	First, perform action no. 1 then, either of 2nd, 3rd or both action s(one after another).