{"id":14958943,"url":"https://github.com/varunagarwal97/deep-network-compression","last_synced_at":"2026-02-26T06:12:58.790Z","repository":{"id":86208790,"uuid":"128596114","full_name":"varunagarwal97/Deep-Network-Compression","owner":"varunagarwal97","description":"Compressing Deep Neural Network using Singular Value Decomposition","archived":false,"fork":false,"pushed_at":"2019-04-23T04:29:28.000Z","size":71,"stargazers_count":7,"open_issues_count":0,"forks_count":0,"subscribers_count":2,"default_branch":"master","last_synced_at":"2025-04-07T01:53:16.276Z","etag":null,"topics":["compression","deep-neural-networks","mnist-dataset","singular-value-decomposition","tensorflow-experiments"],"latest_commit_sha":null,"homepage":null,"language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/varunagarwal97.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2018-04-08T04:05:58.000Z","updated_at":"2021-11-17T11:40:13.000Z","dependencies_parsed_at":null,"dependency_job_id":"9cf7586a-d177-4585-a232-dec85ab4a7ac","html_url":"https://github.com/varunagarwal97/Deep-Network-Compression","commit_stats":{"total_commits":7,"total_committers":1,"mean_commits":7.0,"dds":0.0,"last_synced_commit":"a93b941679d22c6c692b6ddd0277545540928a1d"},"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/varunagarwal97/Deep-Network-Compression","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/varunagarwal97%2FDeep-Network-Compression","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/varunagarwal97%2FDeep-Network-Compression/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/varunagarwal97%2FDeep-Network-Compression/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/varunagarwal97%2FDeep-Network-Compression/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/varunagarwal97","download_url":"https://codeload.github.com/varunagarwal97/Deep-Network-Compression/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/varunagarwal97%2FDeep-Network-Compression/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":264545172,"owners_count":23625404,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["compression","deep-neural-networks","mnist-dataset","singular-value-decomposition","tensorflow-experiments"],"created_at":"2024-09-24T13:18:34.114Z","updated_at":"2026-02-26T06:12:58.743Z","avatar_url":"https://github.com/varunagarwal97.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Deep-Network-Compression\n## Compressing Deep Neural Networks using Singular Value Decomposiiton\n\nThis work presents an approach to compress deep neural networks by performing singular value decomposition on the weights of the trained network. The compression that we finally achieve reduces the network size by almost 96%. We test this approach on the MNIST dataset, in order to prove its validity. This approach can be taken to much deeper networks, too. \n\nWe start off by training a deep neural network with five fully connected hidden layers with 1024 units each, to classify the MNIST dataset with a 98% accuracy. Thereafter, we test the accuracy of the same network after performing SVD on its weights, trying out many low-rank approximations of the trained weight matrices. \n\nFinally, we obtain a D=20 rank approximation of each of the weight matrices, and fine tune the network to achieve almost the same accuracy as that of the original network. \n\nHope that you find this interesting!\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvarunagarwal97%2Fdeep-network-compression","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fvarunagarwal97%2Fdeep-network-compression","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvarunagarwal97%2Fdeep-network-compression/lists"}