An open API service indexing awesome lists of open source software.

https://github.com/achronus/ai-experiments

A repository for simple model implementations of research papers
https://github.com/achronus/ai-experiments

ai-experiments deep-learning open-source-code pytorch

Last synced: 10 months ago
JSON representation

A repository for simple model implementations of research papers

Awesome Lists containing this project

README

          

# AI Experiments

The field of AI continues to grow at an exponential rate, with hundreds of new developments happening daily, making it extremely difficult to keep up with everything! There has also been a growing trend of reduced explainability and open-source models.

This repository is a step towards countering that. It houses a collection of important developments over the years with simple code implementations that are free to use and explore. Each one is accompanied by a Medium article that explains the development's fundamental details and code implementations.

Each item is separated into a folder with a set of respective Python files. Some utility methods, such as activation functions, are stored in the root of the experiments folder for easier access to all individual experiments. Each folder has a corresponding `README.md` file highlighting a brief description of the development and structure.

My goal is to help push development for more efficient, high-performing, autonomous systems that improve the way we live our lives. All code will remain open-source and hopefully be an asset to the AI community.

Happy reading and exploring! 😄

## Experiments

| Item | Project Link | Article Link |
|---------------|--------------|--------------|
| GLU Feed-Forward Networks | [![Project](https://img.shields.io/badge/Project-blue?style=for-the-badge&logo=python&logoColor=white)](/experiments/glu/) | [![Medium](https://img.shields.io/badge/Medium-12100E?style=for-the-badge&logo=medium&logoColor=white)](https://medium.com/@achronus/glu-a-simple-transformer-improvement-504e31c4252a) |
| Titans | - | [![Medium](https://img.shields.io/badge/Medium-12100E?style=for-the-badge&logo=medium&logoColor=white)](https://medium.com/@achronus/titans-where-tokens-almost-live-forever-c995d9a84e0e) |
| Liquid Neural Networks | [![Project](https://img.shields.io/badge/Project-blue?style=for-the-badge&logo=python&logoColor=white)](/experiments/lnn/) | [![Medium](https://img.shields.io/badge/Medium-12100E?style=for-the-badge&logo=medium&logoColor=white)](https://medium.com/@achronus/ltcs-with-ncps-an-alternative-to-large-ai-models-6c71729bd3d6) |