https://github.com/m3shovon/web-scrapping-api

Scraps Website Pages and Query on that website
https://github.com/m3shovon/web-scrapping-api

scrapper webscraping

Last synced: 5 months ago
JSON representation

Scraps Website Pages and Query on that website

• Host: GitHub
• URL: https://github.com/m3shovon/web-scrapping-api
• Owner: m3shovon
• License: mit
• Created: 2024-11-28T11:18:16.000Z (about 1 year ago)
• Default Branch: main
• Last Pushed: 2025-01-06T13:28:18.000Z (12 months ago)
• Last Synced: 2025-02-09T12:31:55.566Z (11 months ago)
• Topics: scrapper, webscraping
• Language: Python
• Homepage:
• Size: 249 KB
• Stars: 1
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# Web-Scrapping-API

Virtual Environment Set Up

```

python -m venv venv

```

Virtual Activation[Linux]

```

source venv/bin/activate

```

Virtual Activation With Git Bash[Windows]

```

source venv/scripts/activate

```

Install Files

```

pip install -r requirements.txt

```

Migrate

```

python manage.py migrate

```

Migrations

```

python manage.py makemigrations

```

Run Project

```

python manage.py runserver

```

++++++++++++++++++++ API ++++++++++++++++++++++++

Scrape Endpoint:

URL: POST /api/scrape/

```

http://127.0.0.1:8000/api/scrape/

```

```

{

    "url": "https://theicthub.com/"

}

```

Search Endpoint:

URL: POST /api/search/

```

http://127.0.0.1:8000/api/search/

```

```

{

    "query": "Address in theicthub?",

}

```