{"id":17209254,"url":"https://github.com/raphael-jin/edfs","last_synced_at":"2025-03-25T11:42:02.069Z","repository":{"id":64408678,"uuid":"575599276","full_name":"Raphael-Jin/EDFS","owner":"Raphael-Jin","description":"Emulation-based System for Distributed File storage and Parallel Computation","archived":false,"fork":false,"pushed_at":"2022-12-07T23:07:01.000Z","size":6068,"stargazers_count":1,"open_issues_count":1,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-30T10:41:47.318Z","etag":null,"topics":["distributed-computing","distributed-systems","mapreduce-python","servrless"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Raphael-Jin.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-12-07T21:57:38.000Z","updated_at":"2023-06-27T23:52:17.000Z","dependencies_parsed_at":"2022-12-17T19:04:38.169Z","dependency_job_id":null,"html_url":"https://github.com/Raphael-Jin/EDFS","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Raphael-Jin%2FEDFS","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Raphael-Jin%2FEDFS/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Raphael-Jin%2FEDFS/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Raphael-Jin%2FEDFS/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Raphael-Jin","download_url":"https://codeload.github.com/Raphael-Jin/EDFS/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245458048,"owners_count":20618693,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["distributed-computing","distributed-systems","mapreduce-python","servrless"],"created_at":"2024-10-15T02:51:08.681Z","updated_at":"2025-03-25T11:42:02.034Z","avatar_url":"https://github.com/Raphael-Jin.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Emulation-based System for Distributed File storage and Parallel Computation\n\n#### Architecture:\n\u003cdiv align=center\u003e\n\u003cimg src=\"./tutorial/architecture.png\" width=40% align=center /\u003e\n\u003c/div\u003e\n\n#### Home page:\n\u003cdiv align=center\u003e\n\u003cimg src=\"./tutorial/mainpage.png\" width=70% align=center /\u003e\n\u003c/div\u003e\n\n#### Distributed file system dashboard\n\u003cdiv align=center\u003e\n\u003cimg src=\"./tutorial/filesystem.png\" width=70% align=center /\u003e\n\u003c/div\u003e\n\n#### Trending Movie Computation using MapReduce\n\u003cdiv align=center\u003e\n\u003cimg src=\"./tutorial/trending.png\" width=70% align=center /\u003e\n\u003cimg src=\"./tutorial/trending_mapreduce.png\" width=70% align=center /\u003e\n\u003c/div\u003e\n\n#### Data Retrieval using MapReduce\n\u003cdiv align=center\u003e\n\u003cimg src=\"./tutorial/search.png\" width=70% align=center /\u003e\n\u003cimg src=\"./tutorial/search_mapreduce.png\" width=70% align=center /\u003e\n\u003c/div\u003e\n\n#### Item-based collaborative filtering recommendation using MapReduce\n\u003cdiv align=center\u003e\n\u003cimg src=\"./tutorial/recommend.png\" width=60% align=center /\u003e\n\u003cimg src=\"./tutorial/recommend_mapreduce.jpg\" width=70% align=center /\u003e\n\u003c/div\u003e\n\n#### Prerequisite:\n\n```bash\npip install streamlit-aggrid\n\npip install wordcloud\n\npip install streamlit\n\npip install pandas\n```\n\n#### How to start in command line:\n\n```python\nstreamlit run Main.py \n```\n\n#### Username \u0026 Password for demo:\n\u003cdiv align=center\u003e\n\u003cimg src=\"./tutorial/login.png\" width=70% align=center /\u003e\n\u003c/div\u003e\n\n```markdown\nusername: admin \n\npassword: abc123\n\nusername: demo_user\n\npassword: 123123\n```\n\n#### File description:\n\n```markdown\n  pages: Front-end directory\n  kaggle_data_sources: Original data source\n  command: Back-end implementation code\n  pre_stored_matrix: Item_CF training result\n  firebase.py: Initialization of firebase\n```\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fraphael-jin%2Fedfs","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fraphael-jin%2Fedfs","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fraphael-jin%2Fedfs/lists"}