https://github.com/minsgy/likelion_apply_crawling
π¦λ©μμ΄μ¬μμ²λΌ μ§μμ ν¬λ‘€λ§ νλ‘μ νΈ
https://github.com/minsgy/likelion_apply_crawling
crawling-python opensource-apps selenium
Last synced: about 2 months ago
JSON representation
π¦λ©μμ΄μ¬μμ²λΌ μ§μμ ν¬λ‘€λ§ νλ‘μ νΈ
- Host: GitHub
- URL: https://github.com/minsgy/likelion_apply_crawling
- Owner: minsgy
- License: mit
- Created: 2021-02-22T05:43:36.000Z (over 4 years ago)
- Default Branch: main
- Last Pushed: 2021-07-24T13:42:57.000Z (almost 4 years ago)
- Last Synced: 2025-05-04T23:22:35.712Z (about 2 months ago)
- Topics: crawling-python, opensource-apps, selenium
- Language: Python
- Homepage:
- Size: 8.64 MB
- Stars: 1
- Watchers: 1
- Forks: 2
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# LIKELION_Apply_Crawling
π¦ 9th LikeLion at SCH apply page Selenium crawling
## μ μμ
- μμ²ν₯λνκ΅ 16νλ² μ»΄ν¨ν°μννΈμ¨μ΄κ³΅ν [μ΅λ―Όμ](https://github.com/minsgy)
## DEMO GIF
## π¨π»βπ» κ°μ
- λ©μμ΄μ¬μμ²λΌ μ§μμ μ 보 μλ μΆν© ν¬λ‘€λ§(Crawling) νλ‘κ·Έλ¨
- λ©μμ΄μ¬μμ²λΌ 9κΈ° λͺ¨μ§ νμ΄μ§λ₯Ό μ΄μ© νλ©΄μ, μ§μμλ€μ μ 보λ₯Ό λͺ¨μΌκ³ νν° ν λ§ν μλ¨μ΄ μλ μνμ΄λ€.
- "μ§μμλ€μ μ΄λ¦/μ ν λ²νΈ/ν©λΆ μ¬λΆλ₯Ό λ€λ£¨κΈ° μ¬μ΄ `CSV` νμΌλ‘ μλ μ μ₯ν΄μ£Όλ μμ€ν " μ ꡬμ±νμ΅λλ€.## π¨κΈ°μ μ€ν
- Selenium
- Pandas## μ¬μ© μ , νκ²½ μΈν
1. Chrome λ²μ νμΈ : μ£Όμ μ°½μ μ λ ₯ - `chrome://version` 
2. Chrome λ²μ Όκ³Ό Chrome λλΌμ΄λ² λ²μ λ§μΆκΈ°.[ChromeDriver λ€μ΄ λ§ν¬](https://chromedriver.chromium.org/downloads) 
3. λ€μ΄λ°μ `ChromeDriver` νμΌμ ν΄λ‘ λ°μ `Root` ν΄λμ μ μ₯.
## μ¬μ©λ²
### 1. κΉ ν΄λ‘
`git clone https://github.com/minsgy/LIKELION_Apply_Crawling.git`
### 2. κ°μ νκ²½ μμ± λ° μ€ν ν, μ’ μμ± λ€μ΄λ‘λ
- `python -m venv <κ°μνκ²½ μ΄λ¦>`
- `. <κ°μνκ²½ μ΄λ¦>/script/activate`, mac:`. <κ°μνκ²½ μ΄λ¦>/bin/activate`
- `pip install -r requirements.txt`### 3.κΈ°λ³Έ μΈν
νκ΅ λ³ μμ΄λ. λΉλ°λ²νΈ μ€μ νμ
1. λ£¨νΈ λλ ν 리μ `secret.json` νμΌ μμ±
2. `json` ννλ‘ μμ±ν¨.
3. μ§μμ μ΄μμ§ μμ΄λ : `APPLY_ID`, μ§μμ μ΄μμ§ λΉλ°λ²νΈ : `APPLY_PW` μμ±β» μμ
- 
### 4. μ€ν κ³Όμ
- `python made_find.py` μ€ν
- ν¬λ‘¬μ΄ μΌμ§λ©΄μ, ν¬λ‘€λ§ κ³Όμ μ κ±°μΉκ³ Chrome μ’ λ£.
- `UserList.csv` νμΌ μμ± (μ΄λ¦/μ νλ²νΈ/ν©λΆ μ¬λΆ)### 5. λμ μ£Όμ λΆλ€