https://github.com/xxazvdxx/live2d-chat-ios

https://github.com/xxazvdxx/live2d-chat-ios

arkit chatgpt ios-app live2d sherpa-onnx speech-to-text stable-diffusion stable-diffusion-ai text-to-speech vits waifu

Last synced: 2 months ago
JSON representation

• Host: GitHub
• URL: https://github.com/xxazvdxx/live2d-chat-ios
• Owner: XxAZVDxX
• Created: 2024-11-11T20:25:28.000Z (11 months ago)
• Default Branch: main
• Last Pushed: 2025-01-16T18:53:58.000Z (9 months ago)
• Last Synced: 2025-03-11T02:46:39.621Z (7 months ago)
• Topics: arkit, chatgpt, ios-app, live2d, sherpa-onnx, speech-to-text, stable-diffusion, stable-diffusion-ai, text-to-speech, vits, waifu
• Homepage:
• Size: 17.4 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Live2D Chat Application [iOS version] / [MacOS version](https://github.com/XxAZVDxX/Live2D-Chat-iOS/blob/main/README(Mac).md)

## App Icon

![App Icon](https://github.com/user-attachments/assets/3fb87af4-6799-463b-ae5e-18784567d57f)

## Arms

This app arms to provide user a personal AI assistant just like Apple intelligence

## Demo Video

[Watch the demo video here [Youtube]](https://youtu.be/waKwxTZiP9w)

[Watch the demo video here [Bilibili]](https://www.bilibili.com/video/BV1iq9hY4EtQ/?spm_id_from=333.337.search-card.all.click)

## Live2D Models(Hiyori, Hura, Mao)



## ChatAI Model

- **Azure OpenAI Studio**: 

  - (ChatGPT 4.0)

  

![ChatAI Model Screenshot](https://github.com/user-attachments/assets/615ddaee-8779-497d-9017-e3bc1047380b)

## ChatAI Model(Local)

- **DeepSeek R1 distill qwen 1.5b 4bit(built-in)**:

- **Or download other LLM model,(depends your device)**: 



## Stable Diffusion





## Supported Languages

- **App Languages**: 

  - [English], [Japanese], [Cantonese], [Chinese, Simplified], [Chinese, Traditional], [Korean]



## Text-to-Speech (TTS) Modules

- **Sherpa-onnx**: Supports English  

- **Apple TTS**: Supports English  

## Interactive Features

You can message and interact with characters:



You can also talk with characters:



Set keywords to start a conversation with a character, like saying "Hey" or your own custom words



## Customized UI Chat Room

Add a PNG, GIF, or performance widget 



Change Background



Background music



## Chat Log

The app can save and modify messages using SwiftData.



## PiP (Picture in Picture) windows

  - You can talk with your assistant anytime, shake the phone to start talk

    



## App Widgets

### Medium Widget

![Medium Widget](https://github.com/user-attachments/assets/5066078f-4945-46a1-b386-7b6eec6d203e)

### Small Widget

![Small Widget](https://github.com/user-attachments/assets/05cec581-4c51-4a89-8146-1b806d1aa4ab)

## Future Features

- **AR Integration**: Display the Live2D model using AR technology in camera view.

## SDK

The project SDK is for iOS, allowing installation and usage on iPhone, iPad, and Mac(Designed for iPad).

WatchOS

MacOS version (under development, coming soon)

## Installation

## Issues