https://github.com/kevinknights29/airflow_docs_llm_app
This is an application built with LLMs to enable Airflow documentation Q&A, with the intent of facilitating the process of building Airflow DAGs.
https://github.com/kevinknights29/airflow_docs_llm_app
docker jupyter-notebook llms python
Last synced: 7 months ago
JSON representation
This is an application built with LLMs to enable Airflow documentation Q&A, with the intent of facilitating the process of building Airflow DAGs.
- Host: GitHub
- URL: https://github.com/kevinknights29/airflow_docs_llm_app
- Owner: kevinknights29
- License: mit
- Created: 2023-07-01T22:28:21.000Z (over 2 years ago)
- Default Branch: main
- Last Pushed: 2023-08-26T04:10:00.000Z (about 2 years ago)
- Last Synced: 2025-01-27T23:46:58.043Z (9 months ago)
- Topics: docker, jupyter-notebook, llms, python
- Language: Jupyter Notebook
- Homepage:
- Size: 24.9 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 3
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# Airflow_Docs_LLM_App
This is an application built with LLMs to enable Airflow documentation Q&A, with the intent of facilitating the process of building Airflow DAGs.
This project uses CodeLlama Python 7B model to power the code inference.
You can learn more about Llama code models at: [Code Llama](https://ai.meta.com/blog/code-llama-large-language-model-coding/)
## Current Progress
## Usage
This project is build around Docker.
To get started, simply:
- Build the docker images from the different services.
```bash
docker compose build
```
- Start the docker container services required, and have fun.
```bash
docker compose up -d
```
- To shut the services down, run the following:
```bash
docker compose down
```
## Contributing
### Installing pre-commit
Pre-commit is already part of this project dependencies.
If you would like to installed it as standalone run:
```bash
pip install pre-commit
```
To activate pre-commit run the following commands:
- Install Git hooks:
```bash
pre-commit install
```
- Update current hooks:
```bash
pre-commit autoupdate
```
To test your installation of pre-commit run:
```bash
pre-commit run --all-files
```