https://github.com/aisuko/generative-ai

The notebooks for generative AI by using PyTorch, Huggingface/diffusers, transforms. And the implementing of the algorithms in paper
https://github.com/aisuko/generative-ai
applemetal collaborate convolutional-neural-networks diffusers github hacktoberfest2023 kaggle mps neural-network pytorch
Last synced: 6 months ago
JSON representation
The notebooks for generative AI by using PyTorch, Huggingface/diffusers, transforms. And the implementing of the algorithms in paper
Host: GitHub
URL: https://github.com/aisuko/generative-ai
Owner: Aisuko
License: apache-2.0
Created: 2023-06-26T05:10:01.000Z (over 2 years ago)
Default Branch: main
Last Pushed: 2024-09-18T07:36:25.000Z (about 1 year ago)
Last Synced: 2025-03-29T08:51:09.005Z (6 months ago)
Topics: applemetal, collaborate, convolutional-neural-networks, diffusers, github, hacktoberfest2023, kaggle, mps, neural-network, pytorch
Language: Jupyter Notebook
Homepage: https://www.kaggle.com/aisuko/code
Size: 17.4 MB
Stars: 13
Watchers: 0
Forks: 5
Open Issues: 2
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Awesome Lists containing this project

README

          # PyTorch Fundamentals

Learn the fundamentals of deep learning with PyTorch! This beginner friendly learning path will introduce key concepts to building machine learning models in multiple domains include speech, vision, and natural language processing.

* Basic Python knowledge

* Basic knowledge about how to use Jupyter Notebooks

* Basic understanding of machine learning

And if you are interested to know more, please check another repo [Implementation for the different ML tasks on Kaggle platform with GPUs](https://github.com/Aisuko/notebooks).

NOTE: There do have many bugs due to the different version of dependencies, please open new issue to discuss it.

# Introduce to PyTorch

|No|Title|Open in Sagemaker|Open in Kaggle|

|---|---|---|---|

|1|[What are Tensors?](pytorch/what_are_tensors.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/what_are_tensors.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/what_are_tensors.ipynb)|

|2|[Loading and normalizing datasets](pytorch/loading_and_normalizing_datasets.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/loading_and_normalizing_datasets.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/loading_and_normalizing_datasets.ipynb)|

|3|[Building the model layers](pytorch/building_the_model_layer.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/building_the_model_layer.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/building_the_model_layer.ipynb)|

|4|[Automatic differentiation](pytorch/automatic_differentiation.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/automatic_differentiation.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/automatic_differentiation.ipynb)|

|5|[About the optimization loop](pytorch/about_the_optimization_loop.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/about_the_optimization_loop.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/about_the_optimization_loop.ipynb)|

|6|[Load and run model predictions](pytorch/load_and_run_model_predictions.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/load_and_run_model_predictions.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/load_and_run_model_predictions.ipynb)|

|7|[The full model building process](pytorch/the_full_model_building_process.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/the_full_model_building_process.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/the_full_model_building_process.ipynb)|

## Audio classification with PyTorch

|No|Title|Open in SageMaker|Open in Kaggle|

|---|---|---|---|

|1|[Understand audio data and concepts](pytorch/audio_classification/understand_audio_data_and_concepts.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/audio_classification/understand_audio_data_and_concepts.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/audio_classification/understand_audio_data_and_concepts.ipynb)|

|2|[Audio transforms and visualizations](pytorch/audio_classification/audio_transforms_and_visualizations.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/audio_classification/audio_transforms_and_visualizations.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/audio_classification/audio_transforms_and_visualizations.ipynb)|

## Natural language processing with PyTorch

|No|Title|Open in SageMaker|Open in Kaggle|

|---|---|---|---|

|1|[Representing text as Tensors](pytorch/natural_language_processing/representing_text_as_tensors.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/natural_language_processing/representing_text_as_tensors.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/natural_language_processing/representing_text_as_tensors.ipynb)|

|2|[Represent words with embeddings](pytorch/natural_language_processing/represent_words_with_embeddings.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/natural_language_processing/represent_words_with_embeddings.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/natural_language_processing/represent_words_with_embeddings.ipynb)|

|3|[Capture patterns with RNN](pytorch/natural_language_processing/capture_patterns_with_recurrent_neural_networks.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/natural_language_processing/capture_patterns_with_recurrent_neural_networks.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/natural_language_processing/capture_patterns_with_recurrent_neural_networks.ipynb)|

|4|[Generate text with RNN](pytorch/natural_language_processing/generate_text_with_recurrent_networks.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/natural_language_processing/generate_text_with_recurrent_networks.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/natural_language_processing/generate_text_with_recurrent_networks.ipynb)|

## Computer vision with PyTorch

|No|Title|Open in SageMaker|Open in Kaggle|

|---|---|---|---|

|1|[Introduction to CV with PyTorch](pytorch/computer_vision/introduction_to_cv_with_pytorch.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/computer_vision/introduction_to_cv_with_pytorch.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/computer_vision/introduction_to_cv_with_pytorch.ipynb)|

|2|[Training a simple sense neural network](pytorch/computer_vision/training_a_simple_cnn.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/computer_vision/training_a_simple_cnn.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/computer_vision/training_a_simple_cnn.ipynb)|

|3|[Convolutional Neural Networks](pytorch/computer_vision/use_a_convolutional_neural_network.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/computer_vision/use_a_convolutional_neural_network.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/computer_vision/use_a_convolutional_neural_network.ipynb)|

|4|[Multilayer Dense Neural Network](pytorch/computer_vision/training_multi_layer_convolutional_neural_network.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/computer_vision/training_multi_layer_convolutional_neural_network.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/computer_vision/training_multi_layer_convolutional_neural_network.ipynb)|

|5|[Pre-trained models and transfer learning](pytorch/computer_vision/pre_trained_models_and_transfer_learning.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/computer_vision/pre_trained_models_and_transfer_learning.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/computer_vision/pre_trained_models_and_transfer_learning.ipynb)|

|6|[Lightweight Networks and MobileNet](pytorch/computer_vision/lightweight_networks_and_mobileNet.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github/Aisuko/generative-ai/blob/main/pytorch/computer_vision/lightweight_networks_and_mobileNet.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/pytorch/computer_vision/lightweight_networks_and_mobileNet.ipynb)|

# Diffusion

|No|Title|Open in SageMaker|Open in Kaggle|Open in Colab|

|---|---|---|---|---|

|1|[Deconstruct the Stable Diffusion pipeline](diffusion/diffusers/deconstruct_the_stable_diffusion_pipline.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/deconstruct_the_stable_diffusion_pipline.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/deconstruct_the_stable_diffusion_pipline.ipynb)|[![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/Aisuko/generative-ai/blob/main/diffusion/diffusers/deconstruct_the_stable_diffusion_pipline.ipynb)|

|2|[Basic training model](diffusion/diffusers/basic_training_model.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/basic_training_model.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/basic_training_model.ipynb)|[![Colab](https://colab.research.google.com/assets/colab-badge.svg)](https://colab.research.google.com/github/Aisuko/generative-ai//main/diffusion/diffusers/basic_training_model.ipynb)|

|3|[Deconstruct the basic pipeline](diffusion/diffusers/deconstruct_basic_pipeline.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/deconstruct_basic_pipeline.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/deconstruct_basic_pipeline.ipynb)||

|4|[Details for models and schedulers](diffusion/diffusers/details_for_models_scheduler.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/details_for_models_scheduler.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/details_for_models_scheduler.ipynb)||

|5|[Effective and Efficient diffusion](diffusion/diffusers/effective_and_efficient_diffusion.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/effective_and_efficient_diffusion.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/effective_and_efficient_diffusion.ipynb)||

|6|[Generting by using float16(sppeding up)](diffusion/diffusers/generating_by_fp16.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/generating_by_fp16.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/generating_by_fp16.ipynb)||

|7|[Stable Diffusion v1.5 demo](diffusion/diffusers/stable_diffusion_v1_5_demo.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/stable_diffusion_v1_5_demo.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/stable_diffusion_v1_5_demo.ipynb)||

|8|[Load checkpoints models and schedulers](diffusion/diffusers/load_checkpoints_models_schedulers.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/load_checkpoints_models_schedulers.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/load_checkpoints_models_schedulers.ipynb)||

|9|[Schedulers Performance](diffusion/diffusers/schedulers_performance.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/schedulers_performance.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/schedulers_performance.ipynb)||

|10|[Stable diffusion with diffusers](diffusion/diffusers/stable_diffusion_with_diffusers.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/stable_diffusion_with_diffusers.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/stable_diffusion_with_diffusers.ipynb)||

# Paper implementation

|No|Title|Open in SageMaker|Open in Kaggle|Open in Colab|Paper|

|---|---|---|---|---|---|

|1|[The annotated diffusion model](implementation/the_annotated_diffusion_model.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/the_annotated_diffusion_model.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/implementation/the_annotated_diffusion_model.ipynb)||[1503.03585](https://arxiv.org/abs/1503.03585)
[1907.05600](https://arxiv.org/abs/1907.05600)
[2006.11239](https://arxiv.org/abs/2006.11239)|

|2|[QLoRA Fine-tuning for Falcon-7B with PEFT](implementation/qlora_for_ft_falcon_7b.ipynb)|[![Open in SageMaker](https://studiolab.sagemaker.aws/studiolab.svg)](https://studiolab.sagemaker.aws/import/github.com/Aisuko/generative-ai/blob/main/diffusion/diffusers/deconstruct_the_stable_diffusion_pipline.ipynb)|[![Kaggle](https://kaggle.com/static/images/open-in-kaggle.svg)](https://kaggle.com/kernels/welcome?src=https://github.com/Aisuko/generative-ai/blob/main/implementation/the_annotated_diffusion_model.ipynb)|||

# On macOS

All the notebooks are support [mps](https://aisuko.gitbook.io/wiki/ai-techniques/large-language-model/metal), except if the notebooks import fp16 speeding up:

* [The kernel crashed](https://github.com/microsoft/vscode-jupyter/issues/13828)

![mps](images/image.png)

# Contributing

Warm welcome for any contributions, please follow the [contributing guidelines](CONTRIBUTING.md).

# Acknowledgement

- [Huggingface diffusers](https://github.com/huggingface/diffusers)

- [Microsoft learning](https://learn.microsoft.com/en-au/training/modules/intro-machine-learning-pytorch/)
ecosyste.ms

Data

Tools

Indexes

Applications

Experiments

Awesome

https://github.com/aisuko/generative-ai

Awesome Lists containing this project

README
