An open API service indexing awesome lists of open source software.

https://github.com/carlaiau/ebay-api-retrieval


https://github.com/carlaiau/ebay-api-retrieval

Last synced: 21 days ago
JSON representation

Awesome Lists containing this project

README

        

# Ebay Play
Basic scraper that takes a tsv file of titles and categories as input.
The scraper queries the Ebay API for each product title.
Upon recieveing a response, we concatenate the product title and category coming out of the API and compare that to the title and category from the TSV file. If these match, then we conclude that the product is correctly identified.

### Prerequisities
Go
Ebay Production API ID

### Usage
```
go get github.com/valyala/tsvreader
cd ebay-api-retrieval
go build .
./ebay-api-retrieval
```

### CLI arguments
app_id required
```
Usage of ./ebay-play:
-a
String: Application ID from Ebay
-i
String: Path to TSV Input File (default "data/in.tsv")
-o
String: Path to XML Output File (default "out/dump.xml")
-r
Boolean, whether to remove Header from Input (default true)
```

### To Do
Better management of fails. Retries.
Add Channels, multi thread scraping