https://github.com/ahmetfurkandemir/deep-learning-6-optimization

Deep Learning(6) - Gradient Descent With Momentum , RMSprop, Adam optimization
https://github.com/ahmetfurkandemir/deep-learning-6-optimization

Last synced: 6 months ago
JSON representation

Deep Learning(6) - Gradient Descent With Momentum , RMSprop, Adam optimization

• Host: GitHub
• URL: https://github.com/ahmetfurkandemir/deep-learning-6-optimization
• Owner: AhmetFurkanDEMIR
• Created: 2020-08-09T07:20:41.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2020-08-09T07:38:02.000Z (about 5 years ago)
• Last Synced: 2025-04-15T21:52:18.502Z (6 months ago)
• Language: Jupyter Notebook
• Size: 2.9 MB
• Stars: 15
• Watchers: 2
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

          
# Optimization

* Sizi minimum maliyete götürmek için kullanabileceğiniz birçok farklı optimizasyon algoritması vardır. Benzer şekilde, bu tepeden en alçak noktaya birçok farklı patika vardır.

![cost](https://user-images.githubusercontent.com/54184905/89727117-aaf6bd00-da2a-11ea-96dd-41a5c2231bdf.jpg)

# Adımlar

* Gradient Descent (Dereceli alçalma)

![Screenshot_2020-08-09_10-29-41](https://user-images.githubusercontent.com/54184905/89727276-b5fe1d00-da2b-11ea-83e8-cc9160a23ade.png)

* Mini-Batch Gradient descent (Mini Toplu Gradyan inişi)

![Screenshot_2020-08-09_10-35-09](https://user-images.githubusercontent.com/54184905/89727318-13926980-da2c-11ea-8fe5-c704e09b5a5b.png)

* Momentum

![Screenshot_2020-08-09_10-30-22](https://user-images.githubusercontent.com/54184905/89727275-b4ccf000-da2b-11ea-90ac-466e20896712.png)

* Adam Optimization

![Screenshot_2020-08-09_10-30-39](https://user-images.githubusercontent.com/54184905/89727277-b696b380-da2b-11ea-9c89-444507c71303.png)

# Çıkarımlar

* Adam ve RMS prop arasındaki sezgiyi anlamak

* Mini toplu gradyan inişinin önemini öğrenmek

* Momentumun modelinizin genel performansı üzerindeki etkilerini görmek

![Screenshot_2020-08-09_10-32-15](https://user-images.githubusercontent.com/54184905/89727279-b72f4a00-da2b-11ea-9a00-b546e00e6b06.png)

* Kaynak : Improving Deep Neural Networks: Hyperparameter tuning, Regularization and Optimization (Coursera) - https://www.coursera.org/learn/deep-neural-network