https://github.com/valamidev/DataSynchronizer

Cryptocurrency Exchange and Sentiment data fetcher and syncronizer.
https://github.com/valamidev/DataSynchronizer

binance candlesticks ccxt cryptocurrency cryptocurrency-exchange exchanges kucoin mysql nodejs orderbook-snapshots sentiment symbols trades trending-symbols

Last synced: 25 days ago
JSON representation

Cryptocurrency Exchange and Sentiment data fetcher and syncronizer.

• Host: GitHub
• URL: https://github.com/valamidev/DataSynchronizer
• Owner: valamidev
• License: mit
• Archived: true
• Created: 2019-07-08T14:54:15.000Z (over 5 years ago)
• Default Branch: master
• Last Pushed: 2021-06-12T18:07:08.000Z (over 3 years ago)
• Last Synced: 2024-05-18T21:41:57.555Z (7 months ago)
• Topics: binance, candlesticks, ccxt, cryptocurrency, cryptocurrency-exchange, exchanges, kucoin, mysql, nodejs, orderbook-snapshots, sentiment, symbols, trades, trending-symbols
• Language: TypeScript
• Homepage:
• Size: 396 KB
• Stars: 68
• Watchers: 5
• Forks: 24
• Open Issues: 20
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-ccxt - DataSynchronizer

README

        
# DataSynchronizer

[![DeepScan grade](https://deepscan.io/api/teams/6761/projects/8873/branches/113558/badge/grade.svg)](https://deepscan.io/dashboard#view=project&tid=6761&pid=8873&bid=113558)

DataSynchronizer is a powerful NodeJS written Cryptocurrency exchange / Sentiment data aggregator tool.







**Capabilities**

- Fetch up to 100 Symbol(Kucoin API limitation) Candlestick, Trades, Orderbook from Binance & Kucoin.

- Semi-automated seeking after new symbols or trending symbols.

- Auto convert MarketLvl2 datas (trades) into Candlesticks 1m

- Moderated fault tolerance, only auto-reconnecting Websockets are used.

**Supported exchanges:**

- **Binance:** Candlestick, Trades, Orderbook Snapshots

- **Kucoin:** Trades, Orderbook Snapshots (Candlesticks can be calculated)

- **Other exchanges:** CCXT support for PriceTickers and MarketDatas

**Supported Sentiment sources:**

- Twitter

- Reddit

**Modules:**

- MarketData: Collect information about available tradepairs and their informations.

- Sentiment: Twitter/Reddit API fetcher.

- Livefeed: Websocket manager for real-time data sources.

- PriceTicker: All symbol price information from exchanges.

- Warden: Automated manager looking after newly added symbols and trending symbols.

**TODO:**

- Add Docker friendly deployment solution.

- Add PostgreSQL database for Exchange datas Candlestick,MarketDepth...

**Install:**

**Requirements:**

- Reddis 5.0+ (https://www.digitalocean.com/community/tutorials/how-to-install-and-secure-redis-on-ubuntu-18-04)

- MySQL (5.7+) or MariaDB (10.1.34+)

- NodeJS 12+

- ~ 1Gb storage / day @ 150 Symbols

1. Run NPM install:

```

npm install

```

2. Load/Run SQL from

```

SQL/install.sql

```

3. Setup the .env file

```

Rename .sample_env to .env

Configure the API keys for Binance,Twitter and Reddit

```