https://github.com/shubhamdutta2000/containerized-scrapping-with-selenium-fastapi

Building and Running a Docker Container and Scrapping data using Selenium and with Fast API
https://github.com/shubhamdutta2000/containerized-scrapping-with-selenium-fastapi

containers continuous-integration docker fastapi pipenv python scrapping selenium

Last synced: 3 months ago
JSON representation

Building and Running a Docker Container and Scrapping data using Selenium and with Fast API

• Host: GitHub
• URL: https://github.com/shubhamdutta2000/containerized-scrapping-with-selenium-fastapi
• Owner: Shubhamdutta2000
• License: mit
• Created: 2021-08-26T08:01:45.000Z (over 3 years ago)
• Default Branch: main
• Last Pushed: 2023-02-08T02:26:34.000Z (almost 2 years ago)
• Last Synced: 2024-10-09T23:02:46.823Z (3 months ago)
• Topics: containers, continuous-integration, docker, fastapi, pipenv, python, scrapping, selenium
• Language: Python
• Homepage:
• Size: 79.9 MB
• Stars: 8
• Watchers: 2
• Forks: 0
• Open Issues: 5
• Metadata Files:
  • Readme: README.md
  • License: LICENSE
  • Code of conduct: CODE_OF_CONDUCT.md
  • Security: SECURITY.md

Awesome Lists containing this project

README

        
# Containerized-Scrapping-with-Selenium-FastAPI

Building and Running a Docker Container and Scrapping data using Selenium and with Fast API

The main goal of this repository is to deploy a Docker container with both, FastAPI and Selenium, to check the possibilities when we try to use FastAPI to receive parameters, and run a selenium process in the background to gather and parse data.

This example uses Selenium to make google search and scrap the links

## Build Setup

```

# Clone repo and cd into directory

git clone https://github.com/Shubhamdutta2000/Containerized-Scrapping-with-Selenium-FastAPI.git

cd Containerized-Scrapping-with-Selenium-FastAPI

```

```

# Install dependencies locally

pip install pipenv

pipenv shell

pipenv install

```

# How to Start

```

uvicorn main:app --reload

```

# Start with Docker Locally

```

# Docker build

docker build  Containerized-Scrapping-with-Selenium-FastAPI

# Docker Run

docker run -d  -p 8000:8000  Containerized-Scrapping-with-Selenium-FastAPI

OR

# Docker compose

docker-compose up --build

```

## Details

Contributing

Pull requests and stars are always welcome. For bugs and feature requests, [please create an issue](../../issues/new).

### License

Released under the [MIT License](LICENSE).

---