https://github.com/becooq81/pillkaboo-homepage
PillKaBoo, Google Solution Challenge 2024
https://github.com/becooq81/pillkaboo-homepage
google-solution-challenge-2024 medication-management visually-impaired
Last synced: 18 days ago
JSON representation
PillKaBoo, Google Solution Challenge 2024
- Host: GitHub
- URL: https://github.com/becooq81/pillkaboo-homepage
- Owner: becooq81
- Created: 2024-01-24T05:43:41.000Z (over 1 year ago)
- Default Branch: main
- Last Pushed: 2024-03-19T10:23:39.000Z (about 1 year ago)
- Last Synced: 2024-12-25T10:33:18.537Z (5 months ago)
- Topics: google-solution-challenge-2024, medication-management, visually-impaired
- Language: CSS
- Homepage: https://parkourapp.dev/
- Size: 48.6 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 2
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
We are thrilled to present PillKaBoo, an app thoughtfully crafted for blind and visually impaired(VI) parents.
PillKaBoo specifically aims to assist blind/VI parents in safely and independently administering medication to their children.
- PillKaBoo is now available in South Korea as "내약알기" in App Store & Google Play Store
- Currently, our service is only available in Korean and (in the case of medication recognition feature) medicine products registered in South Korea. We plan to expand the service internationally. In the meantime, send us an email if you wish the service in your country sooner!
- Visit our _cool_ **:house: Homepage:** https://parkourapp.dev/
_Refer to the following for our code:_
> + **:house: Homepage:** https://github.com/becooq81/PillKaBoo-Homepage
> + **:iphone: Mobile:** https://github.com/becooq81/PillKaBoo
> + **:globe_with_meridians: Serverless API**: https://github.com/becooq81/PillKaBoo-Backend
*****
📁 Table of Contents
+ [🔍 Problem Statement](#-problem-statement)
+ [🎯 UN SDGs & Targets](#-un-sdgs--targets)
+ [📼 Demo Video](#-demo-video)
+ [✨ Key Functions](#-key-functions)
+ [⚙️ Technology](#%EF%B8%8F-technology)
+ [⚡ Getting Started](#-getting-started)
+ [🏃🏻♀️ Team Parkour](#%EF%B8%8F-team-parkour)
---
## 🔍 Problem Statement
Administering medication to children poses unique challenges for blind parents, encompassing potential safety risks and emotional stress, underscoring the need for accessible medication management solutions and supportive resources.
> Most Common Medication Challenges for the Blind & Visually Impaired(VI)
> ```
> 1. Identifying Medication
> 2. Understanding Medication Information
> 3. Using Liquid Medication
> ```
We learned that bilnd/VI parents struggle with giving medication to their children, especially with identifying and understanding the medication and adjusting the right dosage of liquid medication. They also expressed the desire to independently manage their child’s medication without relying on assistance. They feel anxious when giving medications to their child because of the risk of giving the wrong/expired medication and exceeding the required liquid dosage.
---
## 🎯 UN SDGs & Targets
### 
GDSC Google Solution Challenge 2024
The Google Solution Challenge is designed to encourage participants to develop solutions that address one or more of the United Nations Sustainable Development Goals (SDGs). These 17 goals cover a broad range of social and economic development issues.
### 
UN SDGs
As part of the GDSC Google Solution Challenge, PillKaBoo(Team Parkour) tackles the following UN SDGs.
Our service directly contributes to improving the quality of life for visually impaired individuals, thereby aligning with the broader objectives of the UNSDGs to leave no one behind and to ensure inclusivity and equality. We not only tackle the challenges of medication management for the VI but also contribute to greater goals of health coverage, quality education, and reduced inequalities, fostering a more inclusive society for all.
#### ${\textsf{\color{green}[Target 3.8] Contribution to Accessibility of Healthcare: }}$
> PillKaBoo improves accessibility to information about medication and liquid medication intake so that blind/VI parents can reduce the risks of giving the wrong or expired medication and exceeding the required dosage. PillKaBoo contributes to the good health and well-being of VI parents and their children.
#### ${\textsf{\color{red}[Target 4.5] Educated Medication Information: }}$
> PillKaBoo provides information in audio guidance through screen readers (`Google Talk Back`) helping blind/VI parents make educated choices for their children’s medication.
#### ${\textsf{\color{magenta}[Target 10.2] Enhancing Independency of Parenting: }}$
> PillKaBoo reduces inequalities of inconveniences regard to medication due to visual impairments and empowers blind/VI parents with the independence to care for their children by themselves, regardless of their visual abilities.
---
## 📼 Demo Video
[](https://youtu.be/22VUkDcbuaw?si=BbDLXNQvpYAJmj70)
> **Video Link**: _[YouTube @parkour.official](https://youtu.be/22VUkDcbuaw?si=BbDLXNQvpYAJmj70)_
---
## ✨ Key Functions
Introducing a practical service tailored specifically for blind or visually impaired parents, aimed at simplifying the task of giving medications to their child. With accessibility at its core, our service ensures that anyone, regardless of visual ability, can manage the medications for their children safely and independently.
PillKaBoo presents in a **user-friendly interface for blind and VI parents** by utilizing semantic labels, imitating the user interactions of screen readers in the application interface, and providing customizable and noticeable interface components.
> [!IMPORTANT]
> 📢 All features will work appropriately with `Talk Back`. Please **turn on** this accessibility feature!
-----------------------------
### 🔑 Key Features
**:one: Medication Recognition & Information**
: Assists blind/VI users by identifying medication(s) through visual input, and provides essential details.
- In real time, Pillkaboo’s built-in camera **recognizes the packaging** of the medication.
- PillKaBoo provides various informations such as **precautions for your child, potential allergic reactions you registered in setting, expiration date**, and of course all the basics as well.
- Just **swipe** to learn accurate medication information!
**:two: Recognition of Prescription Labels**
: Assists blind/VI users to optimize the effectiveness of the prescribed treatment by promoting timely and consistent prescription medication intake.
- In real time, PillKaBoo's built-in camera **recognizes the text labels printed on the prescription packet**.
- PillKaBoo will let you know which part of day (morning, noon, or evening) for which this packet is assigned, and the date of prescription.
**:three: Accurate Liquid Medication Intake**
: Assists the process of pouring the desired amount of liquid medication in real time.
- To **select the amount**, adjust the slider by swiping up and down the screen.
- While you **pour** the liquid medication into the container, PillKaBoo's built-in camera will let you know if you are close to, or done pouring with **varying audio feedback**.
**:four: Remaining Liquid Medication**
: Checks the remaining amount of liquid medication.
- **Double check** whether you poured the right amount,or **keep track** of how much medicine you have left for **future usage**.
- PillKaBoo tells you how much liquid medication is left in the container.
**:five: Settings**
: Personalizes the settings for users' convenience.
- **Register child’s allergies** that will be used to check potential risks of allergic reactions when scanning medicine.
- Customize the colors that better suit personal **color visibility**.
### 👀 In-app Screen
|**Medication Recognition**|**Medication Information**|**Recognition of Prescription Time Label**|
|:---:|:---:|:---:|
| |  |  |
|**Accurate Liquid Medication Intake**|**Remaining Liquid Medication**|
|:---:|:---:|
| 
| 
|
|**Settings - Register Allergies**|**Settings - Customize Colors**|**Settings - Guide**|
|:---:|:--:|:--:|
|  | ||
---
## ⚙️ Technology
### 👨🏻💻 Technology Stack
`Flutter` | `Android` | `Go` | `TensorFlow Lite` | `Google Cloud Function` | `SQLite`
### 🏛️ Application Architecture
#### Mobile Layer
Users of PillKaBoo directly interact with Mobile Layer through `Google Talk Back` (screen reader). Mobile Layer built with `Flutter` building the application’s user interface and handling logical operations. The user interface implements accessibility features using `Google Talk Back`, enhancing the app’s usability for VI users, and is responsible for providing a better user experience.
For Machine Learning, `TensorFlow Lite` and `Google’s ML Kit for Flutter` are integrated into the `Flutter` mobile application. Using `TensorFlow Lite` for a YOLO model (trained with hand-crafted dataset) for bottle detection used when identifying the liquid amount in the container while using`Google’s ML Kit for Flutter` Text Recognition and Barcode Detection for identifing the medication packaging.
> For more Mobile information 👉🏻 https://github.com/becooq81/PillKaBoo
#### Data Layer
All the data are managed in local storage with `SQLite` integration for providing software that doesn’t require an Internet connection. All the features of PillKaBoo can be used in anternet environment.
#### Back-End Layer
Connected to the frontend component through an `HTTP` request, the `Google Cloud Function`, written in `Go`, updates the latest database of medication information when Internet connection is available.
> For more Back-End information 👉🏻 https://github.com/becooq81/PillKaBoo-Backend
#### CI/CD
For developers, PillKaBoo uses `GitHub Action` for the CI/CD pipeline to automate and streamline the process of building, testing, and deploying applications.
---
## ⚡ Getting Started
### Meet PillKaBoo in App Store & Google Play Store in South Korea!
---
## 🏃🏻♀️ Team Parkour
Kang Heejin
Mobile BE
Kim Jihoon
ML
Yu Yeong Hyeon
Design
---
## 📩 Contact us
Email: [email protected]