https://github.com/camdavidsonpilon/tf-examples
my tf examples for now
https://github.com/camdavidsonpilon/tf-examples
Last synced: 4 months ago
JSON representation
my tf examples for now
- Host: GitHub
- URL: https://github.com/camdavidsonpilon/tf-examples
- Owner: CamDavidsonPilon
- Created: 2017-01-09T02:23:14.000Z (over 9 years ago)
- Default Branch: master
- Last Pushed: 2017-01-25T22:48:22.000Z (over 9 years ago)
- Last Synced: 2025-09-09T22:03:03.905Z (9 months ago)
- Language: Python
- Size: 5.86 KB
- Stars: 2
- Watchers: 2
- Forks: 3
- Open Issues: 0
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# README
### Lessons learned
1. If you see oscillating training loss, likely the descent steps are bouncing between two "valleys" - try using MomentumOptimizer.
2. Playing around with the step_size can help avoid non-covergence to nan
3. The std of the random_normal of the initial weights should be quite small (ex: `stddev=0.01`)
4. Also using RMSPropOptimizer really seems to help decrease the obj function (at least, better than the GradientDescent)