https://github.com/ziweek/two-armies-chat-once
💼 Work Project - 🤖🪖 A Korean-English bilingual RAG Chatbot for Regulations of US Army and ROK Army, leveraging a PEFT fine-tuned small LLM with 4-bit quantized integration as the translator
https://github.com/ziweek/two-armies-chat-once
huggingface langchain langsmith llama-cpp llama3 ollama quantization retrieval-augmented-generation streamlit transformers
Last synced: 2 months ago
JSON representation
💼 Work Project - 🤖🪖 A Korean-English bilingual RAG Chatbot for Regulations of US Army and ROK Army, leveraging a PEFT fine-tuned small LLM with 4-bit quantized integration as the translator
- Host: GitHub
- URL: https://github.com/ziweek/two-armies-chat-once
- Owner: ziweek
- License: mit
- Created: 2024-11-22T12:49:20.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2024-11-24T10:09:00.000Z (7 months ago)
- Last Synced: 2025-02-10T08:48:40.959Z (4 months ago)
- Topics: huggingface, langchain, langsmith, llama-cpp, llama3, ollama, quantization, retrieval-augmented-generation, streamlit, transformers
- Language: Python
- Homepage:
- Size: 32.2 MB
- Stars: 0
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
# TACO: Two Armies, Chat Once
A Korean-English bilingual RAG Chatbot for Regulations of US and ROK Army
[demo.webm](https://github.com/user-attachments/assets/6b818b4d-6e78-444d-8fed-a73401ebc6d7)
Try below badges
# Introduction
TACO (Two Armies Chat Once) aims to develop a chatbot powered by Retrieval-Augmented Generation (RAG) architecture using LangChain and Streamlit, designed to provide clear and accurate answers in both English and Korean.
What's KATUSA
In South Korea, there is a unique military program known as KATUSA ([Korean Augmentation to the United States Army](https://en.wikipedia.org/wiki/Korean_Augmentation_to_the_United_States_Army)). Although KATUSA soldiers are South Korean citizens, they are assigned to U.S. Army units and operate under U.S. Army command.
Why do KATUSA soldiers need this?
Due to the unique structure of KATUSA program, KATUSA soldiers are required to follow both U.S. Army regulations and ROK Army (Republic of Korea Army) regulations. However, these two sets of regulations are sometimes incompatible, leading to confusion about the cultural and procedural differences between the two military systems.
Korean-English Bilingual Support
# Performance
# Implementation
TACO (Two Armies Chat Once) aims to develop a chatbot powered by Retrieval-Augmented Generation (RAG) architecture using LangChain and Streamlit, designed to provide clear and accurate answers in both English and Korean.
1st Trial > Fail - Used small LLM (llama3.2:1b) for bilingual translation
In South Korea, there is a unique military program known as KATUSA ([Korean Augmentation to the United States Army](https://en.wikipedia.org/wiki/Korean_Augmentation_to_the_United_States_Army)). Although KATUSA soldiers are South Korean citizens, they are assigned to U.S. Army units and operate under U.S. Army command.
2nd Trial > Fail - Used pre-trained LLM (Llama-3-Open-Ko-8B-Q5_K_M) for bilingual translation
Due to the unique structure of KATUSA program, KATUSA soldiers are required to follow both U.S. Army regulations and ROK Army (Republic of Korea Army) regulations. However, these two sets of regulations are sometimes incompatible, leading to confusion about the cultural and procedural differences between the two military systems.
Final Trial > Sucess - Used fine-tuned LLM (Llama-3-Open-Ko-8B-Q5_K_M) for bilingual translation
Due to the unique structure of KATUSA program, KATUSA soldiers are required to follow both U.S. Army regulations and ROK Army (Republic of Korea Army) regulations. However, these two sets of regulations are sometimes incompatible, leading to confusion about the cultural and procedural differences between the two military systems.
Korean-English bilingual Support
# Contribution
