https://github.com/yuji1702/valorant-data-scrapper

The Valorant Data Collector is a Python-based tool that scrapes and collects detailed player statistics from VLR.gg. It allows users to search for players, extract their performance data, and export the results into a CSV file. With support for multithreaded scraping, it efficiently gathers data on agents used, key performance metrics, and more.
https://github.com/yuji1702/valorant-data-scrapper

beautifulsoup concurrent-scraping csv-export data-collection game-analytics machine-learning multithreading player-statistics python requests valorant vlrgg web-scraping

Last synced: about 1 month ago
JSON representation

The Valorant Data Collector is a Python-based tool that scrapes and collects detailed player statistics from VLR.gg. It allows users to search for players, extract their performance data, and export the results into a CSV file. With support for multithreaded scraping, it efficiently gathers data on agents used, key performance metrics, and more.

• Host: GitHub
• URL: https://github.com/yuji1702/valorant-data-scrapper
• Owner: Yuji1702
• Created: 2024-10-21T05:51:32.000Z (2 months ago)
• Default Branch: main
• Last Pushed: 2024-11-20T10:29:33.000Z (about 1 month ago)
• Last Synced: 2024-11-20T12:11:19.823Z (about 1 month ago)
• Topics: beautifulsoup, concurrent-scraping, csv-export, data-collection, game-analytics, machine-learning, multithreading, player-statistics, python, requests, valorant, vlrgg, web-scraping
• Language: Python
• Homepage:
• Size: 11.7 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# Valorant Data Collector

This Python project scrapes and collects Valorant player statistics from [VLR.gg](https://www.vlr.gg) using web scraping techniques. The data is exported to a CSV file for analysis, including detailed player performance data, such as agents used, rounds played, ACS, K/D ratio, and more.

## Features

- **Player Search**: Search for a Valorant player by name and retrieve their profile.

- **Data Extraction**: Extract detailed stats for each agent a player has used, including key performance metrics.

- **Multithreading Support**: Option to scrape player stats concurrently using multiple threads.

- **Data Export**: Export player stats to a CSV file for easy analysis.

## Technologies

- `requests`: For sending HTTP requests to retrieve data from the web.

- `BeautifulSoup`: For parsing and scraping the HTML content of web pages.

- `pandas`: For data manipulation and export (optional).

- `csv`: To export the player stats into a CSV format.

- `logging`: For detailed logging of the scraping process.

- `ThreadPoolExecutor`: For concurrent scraping to speed up data collection.

## Installation

**Download the requiremnets.txt from the repository.**

To use this project, clone the repository and install the required dependencies:

```bash

git clone https://github.com/your-username/valorant-data-collector.git

cd valorant-data-collector

pip install -r requirements.txt