https://github.com/bsorrentino/mapifyai
From a Audio or Transcription to Mind-Map Diagram with this AI-powered tool
https://github.com/bsorrentino/mapifyai
agentic-workflow assemblyai langgraph-js mermaid-diagrams openai
Last synced: 3 months ago
JSON representation
From a Audio or Transcription to Mind-Map Diagram with this AI-powered tool
- Host: GitHub
- URL: https://github.com/bsorrentino/mapifyai
- Owner: bsorrentino
- License: mit
- Created: 2024-11-20T19:21:29.000Z (7 months ago)
- Default Branch: main
- Last Pushed: 2024-12-08T16:51:37.000Z (7 months ago)
- Last Synced: 2025-02-04T20:42:16.389Z (5 months ago)
- Topics: agentic-workflow, assemblyai, langgraph-js, mermaid-diagrams, openai
- Homepage: https://bsorrentino.github.io/MapifyAI/
- Size: 15.7 MB
- Stars: 1
- Watchers: 1
- Forks: 0
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
- License: LICENSE
Awesome Lists containing this project
README
[
# MapifyAI
From a Audio or Transcription to Mind-Map Diagram with this AI-powered tool
*This project has been submitted to [AssemblyAI Challenge ](https://dev.to/challenges/assemblyai): Sophisticated Speech-to-Text.*
## What I Built
An Application that allow from an Audio concerning a discussion, a meeting, etc ... to generate a "_meaningful mind-map diagram_", that represent the touched key points.
This representation joined with summary provide a more complete and understandable informations
## Demo
The application in available [here](https://bsorrentino.github.io/MapifyAI/) for access to full functionality you need both an [AssemblyAI] Api Key and a [OpenAI] Api Key.
Below there are some representative screenshots
### Settings
### Upload Audio
### Transcribe Audio
### Generate Mindmap Diagram
## Journey
To implement process from audio to diagram I have create several skilled agents described below:
1. **transcribe-from-audio**: this agent _use AssemblyAI transcripts API_ to transcribe the provided audio.
1. **keypoints-from-transcript**: this Agent use OpenAI (_got-4o-mini_) to extract the Keypoints inside the given transcription
1. **summary-to-mindmap**: this agent use OpenAI (_got-4o-mini_) to arrange the key points in a kind of ontology providing a hierarchical representation of information
1. **mindmap-to-mermaid**: last agent transform the mind-map representation in a [mermaid](https://mermaid.js.org) syntax ready for the visualization
### Diagram of Agentic Architecture
```mermaid
graph TD;
__start__([
__start__
]):::first
__end__([__end__
]):::last
transcribe-from-audio(transcribe-from-audio)
keypoints-from-transcript(keypoints-from-transcript)
%%keypoints-from-audio-transcript(keypoints-from-audio-transcript)
summary-to-mindmap(summary-to-mindmap)
mindmap-to-mermaid(mindmap-to-mermaid)
keypoints-from-transcript -->|Keypoints summary | summary-to-mindmap;
mindmap-to-mermaid -->|Mermaid script| __end__;
summary-to-mindmap -->|Mindmap structure| mindmap-to-mermaid;
transcribe-from-audio -->|Transcription| keypoints-from-transcript;
__start__ -.->|Audio| transcribe-from-audio;
__start__ -.->|Transcription| keypoints-from-transcript;
%%__start__ -.-> keypoints-from-audio-transcript;
%%__start__ -.-> summary-to-mindmap;
%%__start__ -.-> mindmap-to-mermaid;
%%__start__ -.-> __end__;
classDef default fill:purple,line-height:1.2;
classDef first fill-opacity:0;
classDef last fill-opacity:0;
```
[AssemblyAI]: https://www.assemblyai.com
[OpenAI]: https://openai.com/api/