An open API service indexing awesome lists of open source software.

https://github.com/yuu-eguci/mkmkhelp

๐Ÿ Python 3.10 + Selenium + BeautifulSoup + ใŠๅŠฉใ‘่ฆชๅˆ‡ๅฟƒ
https://github.com/yuu-eguci/mkmkhelp

beautifulsoup python3 selenium

Last synced: about 2 months ago
JSON representation

๐Ÿ Python 3.10 + Selenium + BeautifulSoup + ใŠๅŠฉใ‘่ฆชๅˆ‡ๅฟƒ

Awesome Lists containing this project

README

          

MkMkHelp
===

![](./doc/readme.png)

๏พ๏ฝถ๏พ๏ฝถ๏พ๏พ™๏พŒ๏พŸ!

## Install

```powershell
Set-ExecutionPolicy Bypass -Scope Process -Force
[System.Net.ServicePointManager]::SecurityProtocol = "Tls12"
iex ((New-Object System.Net.WebClient).DownloadString('https://chocolatey.org/install.ps1'))

choco install python --version=3.10 -y

choco install googlechrome --ignore-checksums -y

choco install vscode -y

choco install git -y

# ใ“ใ“ใง gitbash ้–‹ใใŸใ„ใ€‚

git clone https://github.com/yuu-eguci/MkMkHelp.git

pip install pipenv
```

```bash
# pipenv + Python 3.10 ใ‚ใ‚‹ๅ‰ๆ
pipenv sync

# mkmk_help total_row ใ‚’็ทจ้›†ใ€‚

# LEVEL1 ๅฎŸ่กŒใ€‚ๆœฌ็‰ฉใฎ URL ใฎๆŽฒ่ผ‰ใ‚’้ฟใ‘ใฆใ„ใพใ™ใ€‚ URL ใฏ้ฉๅˆ‡ใซๅค‰ใˆใ‚‹ใ“ใจใ€‚
time pipenv run python mkmk_help.py --base-url https://WWW.JAV.OR.JP --total-row 1 --output-csv mkmk_help_1.csv

# LEVEL2 ๅฎŸ่กŒใ€‚
time pipenv run python mkmk_help_2.py --jn-base-url https://WWW.JN.COM --csv mkmk_help_1.csv --output-csv mkmk_help_2.csv

# ๅฟ…่ฆใซๅฟœใ˜ใฆ csv ใ‚’ xlsx ใซๅค‰ๆ›
pipenv run python csv_to_xlsx.py --csv ./mkmk_help_2.csv --xlsx ./mkmk.xlsx

# ไพฟๅˆฉๆฉŸ่ƒฝ
pipenv run python xlsx_to_csv.py --xlsx ./mkmk.xlsx --csv ./mkmk.csv
```

## Room for improvement

- ใƒญใ‚ฎใƒณใ‚ฐใŒ่ค‡ๆ•ฐ่กŒใซๆธกใ‚‹ใจใใŒใ‚ใ‚‹ใ‹ใ‚‰ใ€ organization name ใฏๆœ€ๅˆใฎๆ•ฐๆ–‡ๅญ—ใ ใ‘ใงใ„ใ„ใ‹ใ‚‚
- for ใฎๆœ€ไธญใซใ‚จใƒฉใƒผใซใชใ‚‹ใจใƒ‘ใ‚กใ ใ‹ใ‚‰ใ€ csv ใซ append ใ—ใฆใ„ใใ‹ try - except - finally ใŒใ„ใ„ใ‹ใ‚‚