{"id":22887980,"url":"https://github.com/shivendrra/ava","last_synced_at":"2025-03-31T19:17:07.493Z","repository":{"id":228077782,"uuid":"769470488","full_name":"shivendrra/ava","owner":"shivendrra","description":"building AVA from ex-machina; a lightweight multi-modal system from scratch, just for learning \u0026 experimentation","archived":false,"fork":false,"pushed_at":"2024-07-31T06:46:03.000Z","size":12369,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":3,"default_branch":"main","last_synced_at":"2024-12-13T20:43:03.580Z","etag":null,"topics":["audio-classification","audio-engine","audio-transformers","large-language-models","llm","machine-learning","swin-transformer","transformer","vision","vision-engine","vision-models","vision-transformer"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/shivendrra.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2024-03-09T06:55:15.000Z","updated_at":"2024-12-11T19:07:00.000Z","dependencies_parsed_at":"2024-04-22T06:26:56.030Z","dependency_job_id":"128ba177-9930-4396-bc6a-f49c84f54cf4","html_url":"https://github.com/shivendrra/ava","commit_stats":null,"previous_names":["shivendrra/aiva-4x500m","shivendrra/ava"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shivendrra%2Fava","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shivendrra%2Fava/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shivendrra%2Fava/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/shivendrra%2Fava/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/shivendrra","download_url":"https://codeload.github.com/shivendrra/ava/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":246523847,"owners_count":20791444,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["audio-classification","audio-engine","audio-transformers","large-language-models","llm","machine-learning","swin-transformer","transformer","vision","vision-engine","vision-models","vision-transformer"],"created_at":"2024-12-13T20:43:14.536Z","updated_at":"2025-03-31T19:17:07.457Z","avatar_url":"https://github.com/shivendrra.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# AVA\n\n![ava](https://liketowatchblog.files.wordpress.com/2015/10/ex-machina-ava-dress.jpg)\n\n## Introduction\n\nBuilding Ava from Ex-Machina using Language model paired audio engine to generate speech along with a vision model capabale of understanding human emotions \u0026  . Using MoE to generated and understand speech, and then using vision models to identify and see physical things.\n\nTrained models can be downloaded from: [huggingface/ava-v1](https://huggingface.co/shivendrra/ava-v1)\n\n## Audio-Language Model\n\nA transformer based language MoE model fused with an audio engine, that could directly be trained on audio lanugage rather than on written data without even need of text data in any way. Still experimenting, will see what happens.\n\n## Vision Model\n\nNot yet decided, but I'll soon.\n\n## Contribution\n\nPull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.\n\nPlease make sure to update tests as appropriate.\n\n## License\n\nMIT\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshivendrra%2Fava","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fshivendrra%2Fava","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fshivendrra%2Fava/lists"}