https://github.com/flagro/projecttextagent
Updater of text contents of project files for ProjectTextSuite
https://github.com/flagro/projecttextagent
docker fsnotify go gochannels golang gorm gorm-orm goroutine postgres postgresql texttablescoop vecmetaq
Last synced: 6 months ago
JSON representation
Updater of text contents of project files for ProjectTextSuite
- Host: GitHub
- URL: https://github.com/flagro/projecttextagent
- Owner: Flagro
- License: mit
- Created: 2023-11-30T01:25:20.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2024-01-13T17:50:29.000Z (about 2 years ago)
- Last Synced: 2025-09-21T09:35:10.210Z (6 months ago)
- Topics: docker, fsnotify, go, gochannels, golang, gorm, gorm-orm, goroutine, postgres, postgresql, texttablescoop, vecmetaq
- Language: Go
- Homepage: https://flagrotown.com
- Size: 54.7 KB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# 🚀 **ProjectTextAgent**
Part of a [`ProjectText Suite`](https://github.com/Flagro/ProjectTextSuite). ProjectTextAgent is an observer for your project directory for updating the Text and Table databases for future question-answering pipelines.
## 🌟 **Features**
- Implements concurrent Goroutines watchers to send updates when files are modified/deleted/created
- On events extracts text/tables from files with TextTableSpoon
- Updates the data in Vector database (VecMetaQ) and simple relational database (PostgreSQL) with new texts
## 🚀 **Getting Started**
Make sure to have docker installed on your system and then simply copy and initialize the .env file and do a docker compose up:
```bash
mv .env-example .env
docker compose up
```
## 📘 **Usage**
Running the image makes VecMetaQ and PostgreSQL databases available at the hosts you specified in the .env file and updates these databases with text contents of files in directory you specified to enable Question-Answering pipelines over these texts with LLMs (check out https://github.com/Flagro/ProjectTextQnA).
## 🤝 **Collaboration & Issues**
Open for collaboration; check the [issues page](https://github.com/Flagro/ProjectTextAgent/issues) for discussions.
## 🌟 **Shoutout to the dependencies**
This project uses:
- https://github.com/fsnotify/fsnotify for file update events handling
- https://gorm.io - orm to connect ProjectTextAgent with postgres for for the flat tables manipulations
- https://github.com/Flagro/VecMetaQ - wrapper over vector database for easy sever-like interface for text embeddings
- https://github.com/Flagro/TextTableScoop - CLI file-to-text parser