{"id":21500758,"url":"https://github.com/vikentiosvitalis/advanced_topics_in_database_systems","last_synced_at":"2026-05-13T23:31:03.174Z","repository":{"id":223690660,"uuid":"735090144","full_name":"VikentiosVitalis/advanced_topics_in_database_systems","owner":"VikentiosVitalis","description":"Data Science Project - for 'Advanced Topics in Database Systems' M.Sc. Course ECE @ntua","archived":false,"fork":false,"pushed_at":"2024-01-17T15:38:37.000Z","size":11162,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-01-23T22:46:57.756Z","etag":null,"topics":["apache-hadoop","apache-spark","big-data","data-science","pyspark","python"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/VikentiosVitalis.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2023-12-23T16:19:19.000Z","updated_at":"2024-02-21T13:36:44.000Z","dependencies_parsed_at":"2024-02-21T16:22:45.629Z","dependency_job_id":null,"html_url":"https://github.com/VikentiosVitalis/advanced_topics_in_database_systems","commit_stats":null,"previous_names":["vikentiosvitalis/advanced_topics_in_database_systems"],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VikentiosVitalis%2Fadvanced_topics_in_database_systems","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VikentiosVitalis%2Fadvanced_topics_in_database_systems/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VikentiosVitalis%2Fadvanced_topics_in_database_systems/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/VikentiosVitalis%2Fadvanced_topics_in_database_systems/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/VikentiosVitalis","download_url":"https://codeload.github.com/VikentiosVitalis/advanced_topics_in_database_systems/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":244039231,"owners_count":20387835,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["apache-hadoop","apache-spark","big-data","data-science","pyspark","python"],"created_at":"2024-11-23T17:44:05.270Z","updated_at":"2025-10-28T08:40:27.606Z","avatar_url":"https://github.com/VikentiosVitalis.png","language":"Python","funding_links":[],"categories":[],"sub_categories":[],"readme":"## [ECE @NTUA](https://www.ece.ntua.gr/en/undergraduate/info) [Advanced Topics in Database Systems](https://www.ece.ntua.gr/en/undergraduate/courses/3189)\n\n\u003cp align=\"center\"\u003e\n  \u003cimg src=\"/files/photos/atds.png\" alt=\"ATDS's Custom Image\" width=\"270\" height=\"200\" /\u003e\n\u003c/p\u003e\n\n### Data Science Project\nThis project focuses on data analysis using Apache Hadoop and Apache Spark. \n\nThe goal is to familiarize working with distributed systems and modern data science techniques. \n\nThe project utilizes large datasets related to crime data in Los Angeles.\n\n### Tools Used\n- [Apache Hadoop 3.3.6](https://hadoop.apache.org/) \nThe Apache Hadoop project develops open-source software for reliable, scalable, distributed computing.\n\nDistributed processing of large datasets across clusters of computers using simple programming models.\n\n- [Apache Spark 3.5.0](https://spark.apache.org/)\n\nApache Spark is a multi-language engine for executing data engineering, data science, and machine learning on single-node machines or clusters.\n\nBatch/streaming data\n\nSQL analytics\n\nData science at scale\n\nMachine learning\n\n- [~Okeanos-knossos](https://okeanos-knossos.grnet.gr/home/)\n\nThe project uses virtual machines from the public cloud `~Okeanos-knossos`.\n\nA detailed `setup` guide for the installation of the tools used is available in the `files/documents` folder.\n\n### Results\nA detailed report with the execution and the interpretation of queries is also available in the `files/documents` folder.\n\n### Contributors\n\u003cp align=\"center\"\u003e\n    \u003ca href=\"https://github.com/VikentiosVitalis\"\u003e\n      \u003cimg src=\"/files/photos/vikentios.png\" width=\"10%\"\u003e\n    \u003c/a\u003e  \n    \u003ca href=\"https://github.com/korinaak\"\u003e\n      \u003cimg src=\"/files/photos/korina.png\" width=\"10%\"\u003e\n    \u003c/a\u003e  \n\u003cp\u003e","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvikentiosvitalis%2Fadvanced_topics_in_database_systems","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fvikentiosvitalis%2Fadvanced_topics_in_database_systems","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fvikentiosvitalis%2Fadvanced_topics_in_database_systems/lists"}