https://github.com/code-matt/gabby_voice_assistant
iOS voice assistant app
https://github.com/code-matt/gabby_voice_assistant
Last synced: about 1 year ago
JSON representation
iOS voice assistant app
- Host: GitHub
- URL: https://github.com/code-matt/gabby_voice_assistant
- Owner: code-matt
- Created: 2016-04-06T23:33:55.000Z (about 10 years ago)
- Default Branch: master
- Last Pushed: 2016-04-09T08:36:14.000Z (about 10 years ago)
- Last Synced: 2024-10-19T05:21:08.640Z (over 1 year ago)
- Language: Ruby
- Homepage:
- Size: 1.8 MB
- Stars: 0
- Watchers: 2
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# Gabby - iOS voice assistant
### RedPotion(RubyMotion) - Rails | v0.1
Interesting parts so far are:
- gabby_ios_rubymotion_client/app/models/apiAIvoiceController.rb
- gabby_ios_rubymotion_client/app/screens/home_screen.rb
Gabby uses an api.ai agent to process voice requests and then if there
are parameters for further action in the response, she contacts her rails server to
find out what to do with them. Sending back customized speech most the time.
Gabby's RubyMotion side is using a variety of Objective-C cocoa pods:
- pod 'AFSoundManager'
- pod 'ApiAI', '~> 0.4'
- pod 'MVSpeechSynthesizer'
- pod 'CircleProgressBar', '~> 0.3'
This is the first conversion of the ApiAI Objective-C pod to RubyMotion(RMQ/Redpotion) from
what I can tell. I crash trying to use VAD(voice auto detect) for commit so
that needs some help. As well as it needs helper methods for contexts and
lots of other things that she currently does not use.
My idea is to expand this and use IBM Cognitive Cloud image recognition as well
as knowledge,Wolfram Alpha etc etc... The idea is that a user logs
in and over time as they ask questions and tell Gabby things, their database grows and builds
connections personalized to that user. Also started experimenting with
personalized actions.. right now Gabby can click a mouse lol.
I would like to switch rails to using MongoDB/Mongoid for the dynamicness
allowed by NoSQL. Gabby needs to be able to learn new tables on the fly.