Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/808vita/data_processing_code
data_processing_code was here
https://github.com/808vita/data_processing_code
Last synced: 14 days ago
JSON representation
data_processing_code was here
- Host: GitHub
- URL: https://github.com/808vita/data_processing_code
- Owner: 808vita
- Created: 2024-10-15T18:41:33.000Z (3 months ago)
- Default Branch: main
- Last Pushed: 2024-10-15T18:43:22.000Z (3 months ago)
- Last Synced: 2024-11-07T12:34:03.460Z (2 months ago)
- Size: 1.95 KB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# CDAWGG:
## Data processor code - processing CSV files into JSON
![v2 cover image cdawgg](https://github.com/user-attachments/assets/169b2b21-db46-419a-81e5-c72839a3520b)
[`CDAWGG Demo Video`](https://drive.google.com/file/d/1scRXFMOxK1mjKi938ZdaijKhMRynr_5P/view?usp=sharing)
[`Phase 2 Improvements`](https://cdawgg.oofdev.com/embed_phase2_cdawgg_trimmed.mp4)
### Deployed link : [`Live Site`](https://cdawgg.oofdev.com/)
## Getting Started
Needs Python to be installed in your system. (conda or mini-conda env recommened).
Please run `pip install -r requirements.txt` to install all project required dependencies.
```bashpip install -r requirements.txt
```
- After installation - run the `1_combine_data_files.py` first.
- Once it completes , run `2_process_data_files.py` .This would generate JSON files for CDAWGG.
- Reviews are pre-processed using gemini api using Review Processor module within CDAWGG.
(this was done to save time & keep writing code in JavaScript - which greatly did help out.)