{"id":19767401,"url":"https://github.com/tusimple/neuron-selectivity-transfer","last_synced_at":"2025-04-30T15:33:10.737Z","repository":{"id":68971722,"uuid":"128517939","full_name":"TuSimple/neuron-selectivity-transfer","owner":"TuSimple","description":null,"archived":false,"fork":false,"pushed_at":"2018-10-22T05:16:52.000Z","size":371,"stargazers_count":135,"open_issues_count":4,"forks_count":19,"subscribers_count":9,"default_branch":"master","last_synced_at":"2025-04-17T03:05:15.202Z","etag":null,"topics":[],"latest_commit_sha":null,"homepage":null,"language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/TuSimple.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2018-04-07T10:27:05.000Z","updated_at":"2025-03-26T05:47:42.000Z","dependencies_parsed_at":"2024-01-14T08:06:12.351Z","dependency_job_id":null,"html_url":"https://github.com/TuSimple/neuron-selectivity-transfer","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/TuSimple%2Fneuron-selectivity-transfer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/TuSimple%2Fneuron-selectivity-transfer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/TuSimple%2Fneuron-selectivity-transfer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/TuSimple%2Fneuron-selectivity-transfer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/TuSimple","download_url":"https://codeload.github.com/TuSimple/neuron-selectivity-transfer/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":251732376,"owners_count":21634768,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":[],"created_at":"2024-11-12T04:29:36.649Z","updated_at":"2025-04-30T15:33:10.450Z","avatar_url":"https://github.com/TuSimple.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# neuron-selectivity-transfer\n\nThis code is a re-implementation of the imagenet classification experiments in the paper [Like What You Like: Knowledge Distill via Neuron Selectivity Transfer\n](https://arxiv.org/abs/1707.01219).\n\n\u003cdiv align=\"center\"\u003e\n  \u003cimg src=\"docs/transfer.png\" width=\"700px\" /\u003e\n\u003c/div\u003e\n\n## Citation\nIf you use our code in your research or wish to refer to the baseline results, please use the following BibTeX entry.\n```\n@article{NST2017\n  author =   {Zehao Huang and Naiyan Wang},\n  title =    {Like What You Like: Knowledge Distill via Neuron Selectivity Transfer},\n  journal =  {arXiv preprint arXiv:1707.01219},\n  year =     {2017}\n}\n```\n\n## Implementation\nThis code is implemented by a modified [MXNet](https://github.com/huangzehao/incubator-mxnet-bk) which supports [ResNeXt-like](https://github.com/facebookresearch/ResNeXt) augmentation. (This version of MXNet does not support cudnn7)\n\n## ImageNet data preparation\nDownload the [ImageNet](http://image-net.org/download-images) dataset and create pass through rec (following [tornadomeet's repository](https://github.com/tornadomeet/ResNet#imagenet) but using unchange mode)\n\n## Run\n- ```bash init.sh```\n- modify ```config/cfgs.py```\n- ```python train.py```\n\n## Results on ImageNet-1k\n**Single Model, Single Crop Validation Error:**\n\n| Method            | Model          | Top-1 | Top-5| Download |\n| :-------------     |:-------------| :-----:| :-----:| :-----:|\n| Student           | Inception-BN | 25.74     | 8.07 | [Dropbox](https://www.dropbox.com/sh/ggwngonbes5lo15/AAA94k7zgO9yCQQtLavHcdtia?dl=0) |\n| NST (Poly kernel) | Inception-BN | 24.81      | 7.55 | [Dropbox](https://www.dropbox.com/sh/carpuv04frzc5hx/AAAQxVUuS_WFJEC3RIDdqh7Ma?dl=0) |\n| NST (Poly kernel) + KD    | Inception-BN | 24.34      | 7.11 | [Dropbox](https://www.dropbox.com/sh/ekqs25qyp9sjcg3/AABTtywMobR8WSIjuf_OyXs-a?dl=0) |\n| NST (Poly kernel) + KD | A modified ResNet-50 | 21.05 | 5.56 | [Dropbox](https://www.dropbox.com/sh/jhnokzbvv8s17ng/AABGgKvzZCgl_U1dU14cmQmka?dl=0) \n\u003e Note:\n\u003e The symbol of our modified ResNet-50 (following [SENet](https://arxiv.org/pdf/1709.01507.pdf) Appendix B) is available in [Dropbox](https://www.dropbox.com/sh/jhnokzbvv8s17ng/AABGgKvzZCgl_U1dU14cmQmka?dl=0).\n\u003e The mean RGB for our modified ResNet-50 is [123.68, 116.28, 103.53], std is [58.395, 57.12, 57.375]. \n\u003e For Inception-BN, we don't need to do data pre-processing since we add a BN layer in the beginning of the network. ","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftusimple%2Fneuron-selectivity-transfer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Ftusimple%2Fneuron-selectivity-transfer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Ftusimple%2Fneuron-selectivity-transfer/lists"}