{"id":13578660,"url":"https://github.com/CyberZHG/keras-radam","last_synced_at":"2025-04-05T19:33:26.635Z","repository":{"id":52597262,"uuid":"202687282","full_name":"CyberZHG/keras-radam","owner":"CyberZHG","description":"RAdam implemented in Keras \u0026 TensorFlow","archived":true,"fork":false,"pushed_at":"2022-01-22T10:40:58.000Z","size":56,"stargazers_count":325,"open_issues_count":0,"forks_count":46,"subscribers_count":14,"default_branch":"master","last_synced_at":"2025-03-17T09:15:30.319Z","etag":null,"topics":["adam","keras","optimizers","radam","rectified-adam","tensorflow"],"latest_commit_sha":null,"homepage":"https://pypi.org/project/keras-rectified-adam/","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/CyberZHG.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2019-08-16T08:14:46.000Z","updated_at":"2024-09-20T18:54:26.000Z","dependencies_parsed_at":"2022-08-29T14:30:15.446Z","dependency_job_id":null,"html_url":"https://github.com/CyberZHG/keras-radam","commit_stats":null,"previous_names":["lwislvislie/keras-radam","cyberzhg/keras-radam"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CyberZHG%2Fkeras-radam","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CyberZHG%2Fkeras-radam/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CyberZHG%2Fkeras-radam/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/CyberZHG%2Fkeras-radam/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/CyberZHG","download_url":"https://codeload.github.com/CyberZHG/keras-radam/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":247393095,"owners_count":20931804,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["adam","keras","optimizers","radam","rectified-adam","tensorflow"],"created_at":"2024-08-01T15:01:32.652Z","updated_at":"2025-04-05T19:33:24.812Z","avatar_url":"https://github.com/CyberZHG.png","language":"Python","funding_links":[],"categories":["Python"],"sub_categories":[],"readme":"# Keras RAdam\n\n[![Version](https://img.shields.io/pypi/v/keras-rectified-adam.svg)](https://pypi.org/project/keras-rectified-adam/)\n![License](https://img.shields.io/pypi/l/keras-rectified-adam.svg)\n\n\\[[中文](https://github.com/CyberZHG/keras-radam/blob/master/README.zh-CN.md)|[English](https://github.com/CyberZHG/keras-radam/blob/master/README.md)\\]\n\nUnofficial implementation of [RAdam](https://arxiv.org/pdf/1908.03265v1.pdf) in Keras. \n\n## Install\n\n```bash\npip install keras-rectified-adam\n```\n\n## External Link\n\n- [tensorflow/addons:RectifiedAdam](https://github.com/tensorflow/addons/blob/master/tensorflow_addons/optimizers/rectified_adam.py)\n\n## Usage\n\n```python\nfrom tensorflow import keras\nimport numpy as np\nfrom keras_radam import RAdam\n\n# Build toy model with RAdam optimizer\nmodel = keras.models.Sequential()\nmodel.add(keras.layers.Dense(input_shape=(17,), units=3))\nmodel.compile(RAdam(), loss='mse')\n\n# Generate toy data\nx = np.random.standard_normal((4096 * 30, 17))\nw = np.random.standard_normal((17, 3))\ny = np.dot(x, w)\n\n# Fit\nmodel.fit(x, y, epochs=5)\n```\n\n### Use Warmup\n\n```python\nfrom keras_radam import RAdam\n\nRAdam(total_steps=10000, warmup_proportion=0.1, min_lr=1e-5)\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FCyberZHG%2Fkeras-radam","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FCyberZHG%2Fkeras-radam","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FCyberZHG%2Fkeras-radam/lists"}