https://github.com/royluonanjing/csv-mutithread-reader
A user-friendly tool for Excel users to efficiently process separate data in different files using a primary key ID.
https://github.com/royluonanjing/csv-mutithread-reader
java mutilthread
Last synced: 7 months ago
JSON representation
A user-friendly tool for Excel users to efficiently process separate data in different files using a primary key ID.
- Host: GitHub
- URL: https://github.com/royluonanjing/csv-mutithread-reader
- Owner: RoyLuoNanjing
- Created: 2023-07-05T11:49:51.000Z (over 2 years ago)
- Default Branch: master
- Last Pushed: 2023-07-05T12:30:14.000Z (over 2 years ago)
- Last Synced: 2025-01-28T23:29:36.577Z (about 1 year ago)
- Topics: java, mutilthread
- Language: Java
- Homepage:
- Size: 22 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# csv-mutithread-reader
This Java program is designed to merge multiple CSV files into a single file based on a unique identifier (User ID). It utilizes a multithreaded approach to enhance the reading speed. Measures have been taken to handle concurrency issues and prevent conflicts during the writing process. The program also incorporates the Inversion of Control design pattern and Dependency Injection.
## Tech Stack:
Java 8
## Instructions:
To run the program, navigate to src/Solution.java.
## Test Samples:
To set the test CSV files, go to src/data.
Sample CSV files stored in the dev folder contain a small amount of data (100 records each).
Sample CSV files stored in the live folder contain a larger amount of data (250,000 records each).
To add your own files (more than 5), please add a new entity into src/dao/entity.
## Result:
To find the resulting merged file, navigate to src/data/result.csv.