Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/shubhammate013/news-aggregator1

Django project to scrape a news website using Beautiful soup and display in our template.
https://github.com/shubhammate013/news-aggregator1

beautifulsoup4 bootstrap django-framework html-css python3 requests sqlite3

Last synced: about 1 month ago
JSON representation

Django project to scrape a news website using Beautiful soup and display in our template.

Awesome Lists containing this project

README

        

News Aggregator




[![](https://img.shields.io/badge/Made_with-Python3-blue?style=for-the-badge&logo=python)](https://www.python.org "Python3")[![](https://img.shields.io/badge/Made_with-Django-blue?style=for-the-badge&logo=django)](https://www.djangoproject.com/ "Django")

## Description

News aggregator is a Django project to scrape a news website using Beautiful soup and request module and hence combination of web crawlers and web applications.
Both of these technologies have their implementation in Python.

## Features

Our news aggregator works in 3 steps:

1.It scrapes the news website for the articles.In this Django project, we are scraping a website 'www.theonion.com'

(We have scraped news articles from 'latest' section of 'www.theonion.com' for demonstration)

2.Then it stores the article’s images, links, and title.

3.The stored objects in the database are served to the client. The client gets information in a nice template by clicking the 'Load news' button and select the different options available to you.The options are: Latest,Entertainment,Sports,Politics,Opinion,Breaking-News

----------------------------------------------------------------------------------------
### Screenshots ###
## Latest
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/latest_light_mode.PNG)
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/latest_night_mode.PNG)
## Entertainment
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/entertainment_light_mode.PNG)
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/entertainment_night_mode.PNG)
## Sports
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/sports_light_mode.PNG)
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/sports_night_mode.PNG)
## Politics
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/polititcs_light_mode.PNG)
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/polititcs_night_mode.PNG)
## Breaking News
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/breaking_light_mode.PNG)
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/breaking_night_mode.PNG)
## Opinion News
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/opinion_light_mode.PNG)
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/opinion_night_mode.PNG)
## Facebook share
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/facebook_share.PNG)
## Whatsapp share
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/whatsapp_share.PNG)
## Telegram share
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/telegram_share.PNG)
## Copy to clipboard
![](https://github.com/shubhammate013/News-Aggregator1/blob/3711706d64d3a0e1fbd14ec9dc9eb3dcdedc76b7/screenshots/copy_to_clipboard.PNG)
---------------------------------------------------------------------------------------

## How To Use

#### Software Requirements

Python3

#### Installation

Install the dependencies by running:
```html
pip install bs4
pip install requests
pip install django-social-share
```

#### Run using Command Prompt

Navigate to the News-Aggregator folder which has manage.py file then run the following command on cmd

```html
python manage.py runserver
```

### Tech stack

`Backend` : Python3,Beautiful soup

`Framework` : Django

`Database` : Sqlite3

`Frontend` : Html,CSS,Bootstrap