https://github.com/liuyq-617/TD-Spark

https://github.com/liuyq-617/TD-Spark

Last synced: 14 days ago
JSON representation

• Host: GitHub
• URL: https://github.com/liuyq-617/TD-Spark
• Owner: liuyq-617
• License: mit
• Created: 2022-03-30T09:20:33.000Z (over 2 years ago)
• Default Branch: master
• Last Pushed: 2022-03-30T09:30:20.000Z (over 2 years ago)
• Last Synced: 2024-08-02T07:10:51.267Z (4 months ago)
• Language: Java
• Size: 8.79 KB
• Stars: 0
• Watchers: 1
• Forks: 1
• Open Issues: 0
• Metadata Files:
  • Readme: README.md
  • License: LICENSE

Awesome Lists containing this project

• awesome-tdengine - TD-Spark - A java project, read from TDengine and write to TDengine on Spark. (Data)

README

        
# What is TD-Flink

a java project,read from TDengine and write to TDengine on Spark.

# Building 

## Install build dependencies

To install openjdk-8 and maven:

```

sudo apt-get install -y openjdk-8-jdk maven 

```

To install Spark:

```

wget https://www.apache.org/dyn/closer.lua/spark/spark-3.2.1/spark-3.2.1-bin-hadoop3.2.tgz

tar zxf spark-3.2.1-bin-hadoop3.2.tgz -C /usr/local

```

## Build

```

mvn clean package

```

# Run

* run the job

```

spark-submit --master local --name TDenginetest --class com.taosdata.java.SparkTest /testSpark-1.0-SNAPSHOT-dist.jar

```