https://github.com/bayunova28/pararius
This repository contains about group final exam of data engineering course at my college
https://github.com/bayunova28/pararius
data-engineering sentiment-analysis twitter web-scraping website
Last synced: 3 months ago
JSON representation
This repository contains about group final exam of data engineering course at my college
- Host: GitHub
- URL: https://github.com/bayunova28/pararius
- Owner: Bayunova28
- Created: 2021-12-28T11:42:19.000Z (almost 4 years ago)
- Default Branch: main
- Last Pushed: 2023-08-18T08:13:39.000Z (about 2 years ago)
- Last Synced: 2025-02-17T20:42:17.305Z (8 months ago)
- Topics: data-engineering, sentiment-analysis, twitter, web-scraping, website
- Language: Jupyter Notebook
- Homepage:
- Size: 7.46 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Rental Apartment on Den Haag
## Table of Contents
* [Background](#background)
* [Requirement](#requirement)
* [Twitter API](#twitter-api)
* [Web Scrapping](#web-scrapping)
* [Inspiration](#inspiration)
* [Creator](#creator)
## Background
Pararius is the largest independent website for rental properties in the Netherlands. Pararius brings together tenants and landlords. Hundreds of professional organisations offer
their available rental properties on Pararius. These organisations consist of real estate brokers, property management companies, developers and housing associations throughout
the Netherlands. Visitors of Pararius can easily search the large selection of rental properties and then contact them by email or simply just by calling. Pararius was developed
by real estate brokers that are expat rental specialists. Pararius is very convenient for both tenant and landlord. Pararius is Latin for Real Estate broker or Intermediate.
Pararius is derived from the verb parare. Parare means prepare, to complete, to organise, to equip. The English word prepared is derived from Pararius. It is a wonderful metaphor
for a property for rent in any category. The accommodation is ready to move in to. After signing the agreement (in most cases) the tenant will be able to move in without too much
hassle of improving the house. Pararius wants to create a place on the internet where the rental market is transparent and where offer and demand will meet each other.
## Requirement
* **Python 3.5+**
* **Tweepy (`$ pip install tweepy`)**
* **NumPy (`$ pip install numpy`)**
* **Pandas (`$ pip install pandas`)**
* **Deep-Translator (`$ pip install deep-translator`)**
* **requests (`$ pip install requests`)**
* **BeautifulSoup4 (`$ pip install beautifulsoup4`)**
* **MatplotLib (`$ pip install matplotlib`)**
## Twitter API
To start using the Twitter API, you need to [register your application with Twitter](https://developer.twitter.com/en/products/twitter-api). Registration requires you to answer some questions about your application and agree to the [Twitter API Terms of Use](https://developer.twitter.com/en/developer-terms/agreement-and-policy).
Your new application will be assigned a consumer key/secret pair that identifies your application to Twitter. This is all you need to configure your client for application-only authentication.
```python
#generate twitter API
api_key = "YOUR API KEY"
api_secret_key = "YOUR API SECRET KEY"
access_token = "YOUR ACCESS TOKEN"
access_token_secret = "YOUR ACCESS TOKEN SECRET"
```
If you have been generate the twitter API, authentication it.
```python
#authentication twitter API
auth = tweepy.OAuthHandler(api_key, api_secret_key)
auth.set_access_token(access_token, access_token_secret)
api = tweepy.API(auth)
```
## Web Scrapping
### [Twitter](https://twitter.com/Pararius)
* **ID :** the id of the tweet
* **Datetime :** the date of the tweet
* **Tweet :** the text of user tweet
### [Website](https://www.pararius.com/apartments/den-haag)
* **Name :** the name of apartment
* **Location :** the location of apartment
* **Area :** space area of apartment
* **Price :** the price of apartment
## Inspiration
* What is the most sentiment from user tweet at Pararius?
* What is the most expensive apartment at Den Haag on Pararius website?
## Creator
* Christofer Miko Lee
* Lexand Silaban
* Nicholas Tjayadi
* Thendy Rhenaldy
* Willibrordus Bayu