{"id":28231801,"url":"https://github.com/mohammadzainabbas/bdm","last_synced_at":"2026-05-09T09:02:40.943Z","repository":{"id":37027378,"uuid":"475652972","full_name":"mohammadzainabbas/BDM","owner":"mohammadzainabbas","description":"Big Data Management ✨","archived":false,"fork":false,"pushed_at":"2023-12-15T02:59:43.000Z","size":801,"stargazers_count":0,"open_issues_count":1,"forks_count":0,"subscribers_count":2,"default_branch":"main","last_synced_at":"2025-06-15T00:36:35.198Z","etag":null,"topics":["apache-hadoop","apache-hbase","apache-spark","distributed-systems","hdfs","mongodb"],"latest_commit_sha":null,"homepage":"","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/mohammadzainabbas.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null}},"created_at":"2022-03-29T23:36:09.000Z","updated_at":"2022-06-12T11:56:23.000Z","dependencies_parsed_at":"2022-06-29T08:03:38.980Z","dependency_job_id":null,"html_url":"https://github.com/mohammadzainabbas/BDM","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/mohammadzainabbas/BDM","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mohammadzainabbas%2FBDM","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mohammadzainabbas%2FBDM/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mohammadzainabbas%2FBDM/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mohammadzainabbas%2FBDM/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/mohammadzainabbas","download_url":"https://codeload.github.com/mohammadzainabbas/BDM/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/mohammadzainabbas%2FBDM/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":260967875,"owners_count":23090106,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["apache-hadoop","apache-hbase","apache-spark","distributed-systems","hdfs","mongodb"],"created_at":"2025-05-18T19:10:52.525Z","updated_at":"2026-05-09T09:02:40.935Z","avatar_url":"https://github.com/mohammadzainabbas.png","language":"Jupyter Notebook","funding_links":[],"categories":[],"sub_categories":[],"readme":"## BDM @ UPC 👨🏻‍💻\n\n\u003c/br\u003e\n\n\u003cdiv\u003e\n  \u003ca href=\"https://open.vscode.dev/mohammadzainabbas/BDM\" target=\"_blank\" style=\"cursor: pointer;\"\u003e \n    \u003csvg width='256' height='256' fill='none' xmlns='http://www.w3.org/2000/svg'\u003e\u003cmask id='a' maskUnits='userSpaceOnUse' x='0' y='0' width='256' height='256'\u003e\u003cpath fill-rule='evenodd' clip-rule='evenodd' d='M181.534 254.252a15.934 15.934 0 0012.7-.488l52.706-25.361a16.002 16.002 0 009.06-14.42V42.018c0-6.15-3.522-11.754-9.06-14.42L194.234 2.238a15.939 15.939 0 00-18.185 3.097l-100.9 92.052-43.95-33.361a10.655 10.655 0 00-13.614.605L3.49 77.453c-4.648 4.227-4.653 11.54-.011 15.774L41.593 128 3.478 162.773c-4.642 4.235-4.637 11.547.011 15.775l14.097 12.822a10.655 10.655 0 0013.613.606l43.95-33.362 100.9 92.053a15.915 15.915 0 005.485 3.585zm10.505-184.367L115.479 128l76.56 58.115V69.885z' fill='#fff'/\u003e\u003c/mask\u003e\u003cg mask='url(#a)'\u003e\u003cpath d='M246.94 27.638L194.193 2.241a15.947 15.947 0 00-18.194 3.092L3.324 162.773c-4.645 4.235-4.64 11.547.011 15.775L17.44 191.37a10.667 10.667 0 0013.622.606l207.941-157.75c6.976-5.291 16.996-.316 16.996 8.44v-.612a16 16 0 00-9.059-14.416z' fill='#0065A9'/\u003e\u003cg filter='url(#filter0_d)'\u003e\u003cpath d='M246.94 228.362l-52.747 25.397a15.95 15.95 0 01-18.194-3.092L3.324 93.227c-4.645-4.234-4.64-11.547.011-15.775L17.44 64.63a10.667 10.667 0 0113.622-.605l207.941 157.748c6.976 5.292 16.996.317 16.996-8.44v.613a16.001 16.001 0 01-9.059 14.416z' fill='#007ACC'/\u003e\u003c/g\u003e\u003cg filter='url(#filter1_d)'\u003e\u003cpath d='M194.196 253.763A15.955 15.955 0 01176 250.667c5.904 5.904 16 1.722 16-6.628V11.961c0-8.35-10.096-12.532-16-6.628a15.955 15.955 0 0118.196-3.097L246.934 27.6A16 16 0 01256 42.017v171.965a16 16 0 01-9.066 14.419l-52.738 25.361z' fill='#1F9CF0'/\u003e\u003c/g\u003e\u003cpath fill-rule='evenodd' clip-rule='evenodd' d='M181.378 254.252a15.936 15.936 0 0012.699-.488l52.706-25.362a16 16 0 009.061-14.419V42.018c0-6.15-3.522-11.754-9.06-14.42L194.077 2.238a15.939 15.939 0 00-18.185 3.096l-100.9 92.053-43.95-33.361a10.655 10.655 0 00-13.613.605L3.333 77.452c-4.648 4.228-4.653 11.54-.011 15.775L41.436 128 3.322 162.773c-4.642 4.235-4.637 11.547.011 15.775L17.43 191.37a10.655 10.655 0 0013.614.606l43.95-33.362 100.899 92.053a15.919 15.919 0 005.486 3.585zm10.505-184.367L115.323 128l76.56 58.115V69.885z' fill='url(#paint0_linear)' opacity='.25'/\u003e\u003c/g\u003e\u003cdefs\u003e\u003cfilter id='filter0_d' x='-21.49' y='40.523' width='298.822' height='236.149' filterUnits='userSpaceOnUse' color-interpolation-filters='sRGB'\u003e\u003cfeFlood flood-opacity='0' result='BackgroundImageFix'/\u003e\u003cfeColorMatrix in='SourceAlpha' values='0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 127 0'/\u003e\u003cfeOffset/\u003e\u003cfeGaussianBlur stdDeviation='10.667'/\u003e\u003cfeColorMatrix values='0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0.25 0'/\u003e\u003cfeBlend mode='overlay' in2='BackgroundImageFix' result='effect1_dropShadow'/\u003e\u003cfeBlend in='SourceGraphic' in2='effect1_dropShadow' result='shape'/\u003e\u003c/filter\u003e\u003cfilter id='filter1_d' x='154.667' y='-20.674' width='122.667' height='297.347' filterUnits='userSpaceOnUse' color-interpolation-filters='sRGB'\u003e\u003cfeFlood flood-opacity='0' result='BackgroundImageFix'/\u003e\u003cfeColorMatrix in='SourceAlpha' values='0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 127 0'/\u003e\u003cfeOffset/\u003e\u003cfeGaussianBlur stdDeviation='10.667'/\u003e\u003cfeColorMatrix values='0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0 0.25 0'/\u003e\u003cfeBlend mode='overlay' in2='BackgroundImageFix' result='effect1_dropShadow'/\u003e\u003cfeBlend in='SourceGraphic' in2='effect1_dropShadow' result='shape'/\u003e\u003c/filter\u003e\u003clinearGradient id='paint0_linear' x1='127.844' y1='.66' x2='127.844' y2='255.34' gradientUnits='userSpaceOnUse'\u003e\u003cstop stop-color='#fff'/\u003e\u003cstop offset='1' stop-color='#fff' stop-opacity='0'/\u003e\u003c/linearGradient\u003e\u003c/defs\u003e\u003c/svg\u003e\n  \u003c/a\u003e\n\u003c/div\u003e\n\n\u003c/br\u003e\n\n### Table of contents\n\n- [Introduction](#introduction)\n- [About the Data](#about-the-data)\n- [Guides](#guide)\n\n---\n\n\u003ca id=\"introduction\" /\u003e\n\n#### 1. Introduction\n\nThis repo is all about what we have done in Big Data Management (BDM) during our semester at UPC. As a BDMA student, we really need to know how to manage big data.\n\n---\n\n\n\u003ca id=\"about-the-data\" /\u003e\n\n#### 2. About the Data\n\nSince, the aim of this project is to develop a proof of concept (aka a prototype) for our startup `TripHawk` and to get a hands-on practice on typical workflows usually seen in any big data project, we had decided to go with _events_ data in Barcelona. List below is the external data sources which we are using right now:\n\n- [_Cultural Agenda in the city of Barcelona_](https://opendata-ajuntament.barcelona.cat/data/en/dataset/agenda-cultural)\n- [_Tourist points of interest in the city of Barcelona_](https://opendata-ajuntament.barcelona.cat/data/en/dataset/punts-informacio-turistica)\n- [_Agenda of events and activities of the city of Barcelona_](https://opendata-ajuntament.barcelona.cat/data/en/dataset/agenda-diaria)\n\n---\n\n\u003ca id=\"guide\" /\u003e\n\n#### 3. Guide\n\nYou can find some helpful guides [here](https://github.com/mohammadzainabbas/BDM/blob/main/doc/GUIDE.md)\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmohammadzainabbas%2Fbdm","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fmohammadzainabbas%2Fbdm","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fmohammadzainabbas%2Fbdm/lists"}