An open API service indexing awesome lists of open source software.

https://github.com/neural-maze/ai-companion

Meet Ava, the WhatsApp Agent
https://github.com/neural-maze/ai-companion

agent agent-based agentic-workflow agents stt tts vector-database

Last synced: 7 months ago
JSON representation

Meet Ava, the WhatsApp Agent

Awesome Lists containing this project

README

          


logo

📱 Ava 📱


Turning the Turing Test into a WhatsApp Agent


logo

## Table of Contents

- [Table of Contents](#table-of-contents)
- [Course Overview](#course-overview)
- [The tech stack](#the-tech-stack)
- [Course Outline](#course-outline)
- [🛠️ Lesson 0: Before we begin](#️-lesson-0-before-we-begin)
- [Written Lessons](#written-lessons)
- [Video Lessons](#video-lessons)
- [Contributors](#contributors)
- [License](#license)

## Course Overview


logo

What happens when [two ML Engineers](#contributors) with a love for sci-fi movies team up? 🤔

You get **Ava**, a Whatsapp agent that can engage with users in a "realistic" way, inspired by the great film [Ex Machina](https://www.imdb.com/es-es/title/tt0470752/). Ok, you won't find a fully sentient robot here, but you **will** have some pretty interesting Whatsapp conversations.

>You can think of it as a modern reinterpretation of the Turing Test 🤣

By the end of this course, you'll have built your own Ava too, capable of:

* Receiving and sending Whatsapp messages 📲
* Understanding your voice 🗣️
* Recognizing your images 🖼️
* Sending voice notes back 🎤
* Sharing updates about its "daily activities" 🚣
* Sending you images of its current activities 🖼️

Excited? Let's get started!

## The tech stack


Technology
Description


Groq Logo
Powering the project with Llama 3.3, Llama 3.2 Vision, and Whisper. Groq models are awesome (and fast!!)


Qdrant Logo
Serving as the long-term database, enabling our agent to recall details you shared months ago.


Cloud Run Logo
Deploying your containers easily to Google Cloud Platform


LangGraph Logo
Learn how to build production-ready LangGraph workflows


ElevenLabs Logo
Amazing TTS models


Together AI Logo
Behind Ava's image generation process

## Course Outline

This course is divided into 6 lessons. Each lesson is a step forward in building Ava, and it has a written and video version. These two versions are complementary, so we recommend you to go through both, as it will improve your learning experience. Don't forget to check the [Before we start](#before-we-start) section to get everything ready for the course.

---

### Written Lessons

| Lesson | Article Link |
|--------|--------------|
| [Lesson 1: Project overview](https://theneuralmaze.substack.com/p/meet-ava-the-whatsapp-agent) | Read the article |
| [Lesson 2: Dissecting Ava's brain](https://theneuralmaze.substack.com/p/dissecting-avas-brain) | Read the article |
| [Lesson 3: Unlocking Ava's memories](https://theneuralmaze.substack.com/p/can-agents-get-nostalgic-about-the) | Read the article |
| [Lesson 4: Giving Ava a Voice](https://theneuralmaze.substack.com/p/the-ultimate-ai-voice-pipeline) | Read the article |
| [Lesson 5: Ava learns to see](https://theneuralmaze.substack.com/p/reading-images-drawing-dreams-vlms) | Read the article |
| [Lesson 6: Ava installs Whatsapp](https://theneuralmaze.substack.com/p/connecting-an-ai-agent-to-whatsap) | Read the article |

---

### Video Lessons

| Lesson | Video Link |
|--------|------------|
| [Lesson 1: Project overview](https://youtu.be/u5y06cFK2WA?si=RCx__sJNtr2DYf0U) | Watch the video |
| [Lesson 2: Dissecting Ava's brain](https://youtu.be/nTsLL3htkCU?si=aSmSkpL-U3rzw9Za) | Watch the video |
| [Lesson 3: Unlocking Ava's memories](https://youtu.be/oTHqYEpdFXg?si=MXEvjUJ8Xbc6h9l2) | Watch the video |
| [Lesson 4: Giving Ava a Voice](https://youtu.be/RNmwvMjtIt0) | Watch the video |
| [Lesson 5: Ava learns to see](https://youtu.be/LS7k-XFBbeo) | Watch the video |
| [Lesson 6: Ava installs Whatsapp](https://youtu.be/dFsI4lnUkKo) | Watch the video |

---

## Contributors




Miguel Otero Pedrido | Senior ML / AI Engineer

Founder of The Neural Maze. Rick and Morty fan.


LinkedIn

YouTube

The Neural Maze Newsletter





Jesús Copado | Senior ML / AI Engineer

Equal parts cinema fan and AI enthusiast.


YouTube

LinkedIn


## License

This project is licensed under the MIT License - see the [LICENSE](LICENSE) file for details.