https://github.com/brittojo7n/totemtribe2-userdetails
Totem Tribe 2 Jotun User details (ids and account names) dataset and script for scraping and updating the dataset.
https://github.com/brittojo7n/totemtribe2-userdetails
datascience dataset games jotun programming programming-languages scrape scraping-python scraping-websites totem totem-tribe totem-tribe-2 totem-tribe-2-jotun totem-tribe-jotun totemtribe tribe userdetails web webscraper webscraping
Last synced: 3 months ago
JSON representation
Totem Tribe 2 Jotun User details (ids and account names) dataset and script for scraping and updating the dataset.
- Host: GitHub
- URL: https://github.com/brittojo7n/totemtribe2-userdetails
- Owner: brittojo7n
- License: mit
- Created: 2024-03-12T04:55:32.000Z (about 1 year ago)
- Default Branch: main
- Last Pushed: 2024-10-16T19:11:42.000Z (8 months ago)
- Last Synced: 2024-10-18T18:08:48.650Z (7 months ago)
- Topics: datascience, dataset, games, jotun, programming, programming-languages, scrape, scraping-python, scraping-websites, totem, totem-tribe, totem-tribe-2, totem-tribe-2-jotun, totem-tribe-jotun, totemtribe, tribe, userdetails, web, webscraper, webscraping
- Language: Python
- Homepage: https://youtube.com/@level_tuber
- Size: 16.2 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Totem Tribe 2 UserDetails Scraping
## Overview
This repository contains a Python script (`index.py`) designed for scraping user details from the Totem Tribe 2 website. The scraped data is then stored in a CSV file (`tt2_players.csv`). The dataset includes user IDs, account names, and registration dates and times.
Additionally, a self-hosted web application (`app.py`) is provided to allow users to view specific user details. By accessing `localhost:80` in a web browser and entering the account name, users can retrieve detailed information about the user from the scraped dataset. **You may also change the host and port within the `app.py` file.**
**Note:** This project is purely educational and serves as an example of web scraping techniques. The creator of this script and dataset is not affiliated with Enkord, Ltd., the company behind Totem Tribe 2. Please be aware that web scraping may violate a website's Terms of Service.
## Usage
1. Clone this repository to your local machine:
```
git clone https://github.com/brittojo7n/TotemTribe2-UserDetails.git
```
2. Navigate to the project directory:
```
cd TotemTribe2-UserDetails
```
3. Install the required Python packages:
```
pip install requests
pip install beautifulsoup4
```
4. Run the `index.py` script to update the `tt2_players.csv` file with newer user entries:
```
python index.py
```
5. Optionally, customize the range of user IDs being checked and appended to `tt2_players.csv` by editing the `index.py` file.
## Dataset
The `tt2_players.csv` file contains the following columns:
- `User ID`: Unique identifier for each user.
- `Enkord account full name`: Account name associated with the user.
- `Registered`: Date and time when the account was registered.
## Disclaimer
This project is for educational purposes only. The creator of this script and dataset is not responsible for any misuse or violation of website Terms of Service resulting from the use of this script.
**Warning:** Web scraping can lead to legal issues if not used responsibly and in compliance with a website's Terms of Service.