https://github.com/skidoodle/ncore-leaderboard
📁 Scrape and sort profiles from nCore
https://github.com/skidoodle/ncore-leaderboard
ncore ncore-leaderboard
Last synced: 6 months ago
JSON representation
📁 Scrape and sort profiles from nCore
- Host: GitHub
- URL: https://github.com/skidoodle/ncore-leaderboard
- Owner: skidoodle
- License: gpl-3.0
- Created: 2024-12-31T00:51:18.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2025-03-18T12:52:16.000Z (over 1 year ago)
- Last Synced: 2025-03-18T13:46:27.446Z (over 1 year ago)
- Topics: ncore, ncore-leaderboard
- Language: Go
- Homepage:
- Size: 29.3 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: readme.md
- License: license
Awesome Lists containing this project
README
# nCore Profile Scraper
This is a Go program for scraping and sorting user profile data from [nCore](https://ncore.pro/), saving results to a CSV file.
## Key Features
- **Concurrent Scraping:** Fast, parallel processing of profiles.
- **Quicksort Algorithm:** Efficient sorting by attributes.
- **Batch Writing:** Saves data incrementally to reduce memory usage.
## Setup
1. Clone the repository and install dependencies:
```bash
git clone https://github.com/skidoodle/ncore-leaderboard
cd ncore-leaderboard
go mod tidy
```
2. Create a .env file with your credentials:
```env
NICK=your_username
PASS=your_pass
```
## Usage
Run the scraper:
```bash
go run main.go
```
- Scrapes profiles from the configured range.
- Outputs sorted data to output.log in CSV format.
## Configuration
Edit these parameters in `main.go` as needed:
`startProfile`, `endProfile`: Profile ID range.
`concurrency`: Number of concurrent requests.
`outputFile`: Output file name.
`writeBatch`: Profiles processed per save.
## Output Format
The CSV file `output.log` contains:
1. Profile URL
2. Attribute Value (e.g., rank)
## License
This project is licensed under the GPL-3.0 License.