{"id":24483164,"url":"https://github.com/sukiboo/smoothing_based_optimization","last_synced_at":"2025-03-14T19:47:07.564Z","repository":{"id":194080472,"uuid":"588736553","full_name":"sukiboo/smoothing_based_optimization","owner":"sukiboo","description":"Implementation of smoothing-based optimization algorithms","archived":false,"fork":false,"pushed_at":"2023-11-03T15:09:00.000Z","size":5239,"stargazers_count":2,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-01-21T12:35:52.163Z","etag":null,"topics":["gaussian-smoothing","gradient-free-optimization","optimization","smoothing-methods"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/sukiboo.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2023-01-13T21:34:54.000Z","updated_at":"2024-11-15T17:00:46.000Z","dependencies_parsed_at":"2025-01-21T12:41:49.704Z","dependency_job_id":null,"html_url":"https://github.com/sukiboo/smoothing_based_optimization","commit_stats":null,"previous_names":["sukiboo/smoothing_based_optimization"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sukiboo%2Fsmoothing_based_optimization","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sukiboo%2Fsmoothing_based_optimization/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sukiboo%2Fsmoothing_based_optimization/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/sukiboo%2Fsmoothing_based_optimization/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/sukiboo","download_url":"https://codeload.github.com/sukiboo/smoothing_based_optimization/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243639406,"owners_count":20323505,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["gaussian-smoothing","gradient-free-optimization","optimization","smoothing-methods"],"created_at":"2025-01-21T12:31:10.873Z","updated_at":"2025-03-14T19:47:07.540Z","avatar_url":"https://github.com/sukiboo.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Smoothing Based Optimization\n\nSource code for the numerical results presented in the paper \"[Gaussian smoothing gradient descent for minimizing high-dimensional non-convex functions](https://arxiv.org/abs/2311.00521)\".\n\nBenchmark different types of optimization algorithms on various test functions.\nExperiment results will be saved to the `./images/` folder that will be created.\n\n![opt](https://github.com/sukiboo/smoothing_based_optimization/assets/38059493/21bbdf76-3242-4c4f-9a48-03d1aa87b46d)\n\n### File Organization\n\nCurrently includes the following files:\n* `target_functions.py` -- set up a target function and sample an initial guess\n* `benchmark_algorithms.py` -- compare optimization algoritms on series of tests\n* `hyperparameter_search.py` -- test different hyperparameters for each function and algorithm\n* `visualization.py` -- plot optimization values from the logged data\n\nImplemented algorithms (in `./algorithms/`):\n* `adam.py` -- Adam optimizer\n* `rmsprop.py` -- RMSProp optimizer\n* `nag.py` -- Nesterov's Accelerated Gradient Descent\n* `dgs.py` -- Directional Gaussian Smoothing\n* `adgs.py` -- DGS with exponential decay on sigma\n* `lsgd.py` -- Laplacian Smooth Gradient Descent\n* `mcgs.py` -- Monte Carlo Gaussian Smoothing\n* `slgh.py` -- Single Loop Gaussian Homotopy\n\nOld files that are now in `./extra_scripts/`:\n* `main.py` -- use to launch numerical optimization\n* `main_tf.py` -- use to launch network training (very slow)\n* `bfgs_dgs.py` -- define BFGS+DGS algorithm\n* `sbfgs.py` -- define Smoothed BFGS (it doesn't really work though)\n* `smoothing_visualization.py` -- create interactive smoothing plot\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsukiboo%2Fsmoothing_based_optimization","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fsukiboo%2Fsmoothing_based_optimization","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fsukiboo%2Fsmoothing_based_optimization/lists"}