https://github.com/ellache/llama-out-loud

AR (Augmented Reading) for the meta llama 3 h4ckathon 🦙
https://github.com/ellache/llama-out-loud

brave groq llama3 vapi

Last synced: 27 days ago
JSON representation

AR (Augmented Reading) for the meta llama 3 h4ckathon 🦙

• Host: GitHub
• URL: https://github.com/ellache/llama-out-loud
• Owner: EllAchE
• Created: 2024-05-11T19:00:15.000Z (6 months ago)
• Default Branch: main
• Last Pushed: 2024-05-13T05:04:14.000Z (6 months ago)
• Last Synced: 2024-10-10T06:04:28.267Z (28 days ago)
• Topics: brave, groq, llama3, vapi
• Language: Python
• Homepage:
• Size: 6.46 MB
• Stars: 28
• Watchers: 4
• Forks: 4
• Open Issues: 1
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# llama-out-loud

This is a POC built for the Meta LLama3 h4ckathon! You'll see some shortcuts made to get this working in 24 hours 😁

Because Meta Raybans don't expose an SDK, we got creative to pass the input into our system. If recreating on iOS:

- Start a live stream from your glasses to your phone

- Create a shortcut that takes screenshots on a 5s interval and hits a post endpoint (matching the IP & port of your flask server on the same network)

- Run the shortcut in the background

Image data will then be posted to an endpoint you can consume from! The image data will be stored and then applied when voice activation/gestures (gestures not supported in MVP) trigger actions.

Thanks to the organizers of the meta llama 3 h4ckathon!