https://github.com/iomarmochtar/gitlab-release-page-scrapper

simple script for fetching list of points in Gitlab release page
https://github.com/iomarmochtar/gitlab-release-page-scrapper

Last synced: 1 day ago
JSON representation

simple script for fetching list of points in Gitlab release page

• Host: GitHub
• URL: https://github.com/iomarmochtar/gitlab-release-page-scrapper
• Owner: iomarmochtar
• Created: 2021-09-27T07:35:22.000Z (about 3 years ago)
• Default Branch: main
• Last Pushed: 2021-09-30T13:45:57.000Z (about 3 years ago)
• Last Synced: 2023-03-11T09:07:04.120Z (over 1 year ago)
• Language: Python
• Size: 137 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Gitlab Release Scrapper

Just a simple script for scrapping some points in Gitlab release page, the script it self created as module in mind so then can be included to other one such as a [bot application](https://github.com/iomarmochtar/cakap).

## Requirements

- `make`

- `python` >= 3.6

- `venv` module

if you are using Ubuntu simply run following commands

```bash

sudo apt install make python3-venv

```

### Install

```bash

make setup

```

## Using the Scripts

make sure to activate virtual env before execute script.

```

source virtenv/bin/activate

```

- `scrap_features.py` is for scrapping list of features in major or minor release page. eg:

```bash

python scrap_features.py -u https://about.gitlab.com/releases/2021/09/22/gitlab-14-3-released/ 

```

- `scrap_table.py` is for scrap list of security release table, it's sorted by severity score from critical to low.

```bash

python scrap_table.py -u https://about.gitlab.com/releases/2021/04/28/security-release-gitlab-13-11-2-released

```

- `scrap_patch_release.py` is for scrap list of patch release page.

```bash

python scrap_patch_release.py -u https://about.gitlab.com/releases/2021/09/02/gitlab-13-12-11-released/ 

```

## Development

### Install Dependencies

```bash

make dev

```

### Running Tests

It will do unit test and python typing checks

```bash

make tests

```