https://github.com/sshh12/trade-srv

A client for distributed financial news webscraping.
https://github.com/sshh12/trade-srv

financial-data webscraping

Last synced: about 2 months ago
JSON representation

A client for distributed financial news webscraping.

• Host: GitHub
• URL: https://github.com/sshh12/trade-srv
• Owner: sshh12
• License: mit
• Created: 2020-10-04T00:04:20.000Z (about 5 years ago)
• Default Branch: main
• Last Pushed: 2021-03-01T18:50:40.000Z (over 4 years ago)
• Last Synced: 2025-07-23T05:44:23.205Z (3 months ago)
• Topics: financial-data, webscraping
• Language: Go
• Homepage:
• Size: 97.7 KB
• Stars: 12
• Watchers: 5
• Forks: 2
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

README

          
# trade-srv

> A client for distributed financial news webscraping.

![img](https://user-images.githubusercontent.com/6625384/102290101-ebe56d80-3f05-11eb-88e1-1801c3383cd5.png)

## Features

- [Several](https://github.com/sshh12/trade-srv/tree/main/indexers) financial news sites

- Plug-and-Play webscraping

- Request optimizations

- Increase timestamp accuracy by running more clients

## Usage

1. Download the [latest release](https://github.com/sshh12/trade-srv/releases).

2. Have a fresh PostgreSQL database.

3. Register symbols using `$ ./trade-srv-index -pg_url postgres://username:password@127.0.0.1:5432/tradesrv -add_sym TSLA,AAPL,AMZN`

4. Run:

```bash

$ ./trade-srv-index -h

$ ./trade-srv-index -pg_url postgres://username:password@127.0.0.1:5432/tradesrv -run_all_events -log info

```