{"id":16130098,"url":"https://github.com/chao1224/badglobalminima","last_synced_at":"2025-03-18T14:30:54.410Z","repository":{"id":133802883,"uuid":"190451584","full_name":"chao1224/BadGlobalMinima","owner":"chao1224","description":"Bad Global Minima Exist and SGD Can Reach Them, NeurIPS'20 (https://arxiv.org/abs/1906.02613)","archived":false,"fork":false,"pushed_at":"2020-12-10T19:27:39.000Z","size":972,"stargazers_count":9,"open_issues_count":0,"forks_count":2,"subscribers_count":1,"default_branch":"master","last_synced_at":"2025-02-28T10:04:18.197Z","etag":null,"topics":["adversarial","global-minimum","optimization","robustness"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/chao1224.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2019-06-05T18:56:09.000Z","updated_at":"2022-12-17T07:57:45.000Z","dependencies_parsed_at":null,"dependency_job_id":"16b65e50-0271-4d72-be23-a47f59cd2807","html_url":"https://github.com/chao1224/BadGlobalMinima","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chao1224%2FBadGlobalMinima","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chao1224%2FBadGlobalMinima/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chao1224%2FBadGlobalMinima/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/chao1224%2FBadGlobalMinima/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/chao1224","download_url":"https://codeload.github.com/chao1224/BadGlobalMinima/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":243933419,"owners_count":20370986,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["adversarial","global-minimum","optimization","robustness"],"created_at":"2024-10-09T22:14:29.652Z","updated_at":"2025-03-18T14:30:54.404Z","avatar_url":"https://github.com/chao1224.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Bad Global Minima Exist and SGD Can Reach Them\r\n\r\n#### Authors: [Shengchao Liu](https://chao1224.github.io/), [Dimitris Papailiopoulos](http://papail.io/), [Dimitris Achlioptas](http://cgi.di.uoa.gr/~optas/)\r\n\r\nIn this project, we answer two main questions:\r\n\r\n1. Bad global minimum do exist (here we refer the bad minimum as the model that can perfectly fit the training data, yet it generatizes poorly).\r\n2. We can construct such bad global minimum using unlabeled training data **only**, without the knowledge of the loss-landscape.\r\n\r\nA toy example is given as follows, for the complete results, feel free to check out the [full paper](https://arxiv.org/abs/1906.02613).\r\n\r\n![A Toy Example](figs/toy_example.png)\r\n\r\n## Environments\r\n\r\n```\r\nwget -q –retry-connrefused –waitretry=10 https://repo.continuum.io/archive/Anaconda2-4.3.1-Linux-x86_64.sh\r\nchmod 777 *\r\n./Anaconda2-4.3.1-Linux-x86_64.sh -b -p ./anaconda \u003e /dev/null\r\nchmod 777 *\r\n\r\nconda install --yes pyyaml \u003e /dev/null\r\nconda install --yes HDF5 \u003e /dev/null\r\nconda install --yes h5py \u003e /dev/null\r\nconda install --yes -c rdonnelly libgpuarray \u003e /dev/null\r\nconda install --yes -c rdonnelly pygpu \u003e /dev/null\r\nconda install --yes pytorch=0.3.1 torchvision -c soumith \u003e /dev/null\r\nchmod 777 -R ./anaconda\r\n```\r\n\r\n## Cite Us\r\n\r\n```\r\n@article{liu2020bad,\r\n  title={Bad global minima exist and sgd can reach them},\r\n  author={Liu, Shengchao and Papailiopoulos, Dimitris and Achlioptas, Dimitris},\r\n  journal={Advances in Neural Information Processing Systems},\r\n  volume={33},\r\n  year={2020}\r\n}\r\n```","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchao1224%2Fbadglobalminima","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fchao1224%2Fbadglobalminima","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fchao1224%2Fbadglobalminima/lists"}