https://github.com/lishagoel/clickhouseingestion

The ClickHouse Ingestion Tool is a full-stack application designed to facilitate bidirectional data ingestion between ClickHouse (a fast, columnar database) and flat files (such as CSV and TSV). This tool offers a simple and secure way for users to upload data from flat files into ClickHouse or export data from ClickHouse to flat files.
https://github.com/lishagoel/clickhouseingestion

clickhouse-client jwt-token maven react spring-boot

Last synced: 3 months ago
JSON representation

The ClickHouse Ingestion Tool is a full-stack application designed to facilitate bidirectional data ingestion between ClickHouse (a fast, columnar database) and flat files (such as CSV and TSV). This tool offers a simple and secure way for users to upload data from flat files into ClickHouse or export data from ClickHouse to flat files.

• Host: GitHub
• URL: https://github.com/lishagoel/clickhouseingestion
• Owner: Lishagoel
• Created: 2025-04-14T21:42:40.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2025-04-14T21:50:25.000Z (6 months ago)
• Last Synced: 2025-04-19T19:51:45.767Z (6 months ago)
• Topics: clickhouse-client, jwt-token, maven, react, spring-boot
• Language: Java
• Homepage:
• Size: 724 KB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# ClickHouse Ingestion Tool

## Overview

The **ClickHouse Ingestion Tool** is a full-stack application designed to facilitate **bidirectional data ingestion** between **ClickHouse** and **flat files** (e.g., CSV, TSV) using a **Spring Boot** backend and a **React** frontend. It supports features such as **schema discovery**, **column selection**, **JWT-based authentication**, and **data export**.

---

## Features

- **Bidirectional Data Ingestion**: Ingest data from flat files into ClickHouse and vice versa.

- **Schema Discovery**: Dynamically fetch and display the schema of ClickHouse tables.

- **Column Selection**: Allow users to select specific columns for ingestion.

- **JWT Authentication**: Secure the application with JWT tokens for authorization.

- **File Export**: Export data from ClickHouse to flat files (CSV).

---

## Tech Stack

- **Backend**: Spring Boot (Java)

- **Frontend**: React

- **Database**: ClickHouse

- **Authentication**: JWT (JSON Web Tokens)

- **UI Framework**: Bootstrap/Material UI (choose whichever you use)

- **Build Tool**: Maven

---

## Screenshots

### 1. ClickHouse

![click](images/ClickHouse.png)

### 2. mvn Success

![mvn](images/mvnSuccess.png)

### 3. Spring-Boot Init

![spring](images/SpringBootInit.png)

### 4. Spring-Boot Success

![spring](images/SpringBootSuccess.png)