{"id":28478801,"url":"https://github.com/asterinos1/movie-preference-analyzer","last_synced_at":"2025-07-03T07:30:41.444Z","repository":{"id":295772635,"uuid":"971386798","full_name":"Asterinos1/Movie-Preference-Analyzer","owner":"Asterinos1","description":"INF424 Project 2025: Movie Preference Analyzer. Big Data analytics tool using Apache Spark, developed in Scala. adhering to functional programming rules.","archived":false,"fork":false,"pushed_at":"2025-05-27T09:07:27.000Z","size":4241,"stargazers_count":0,"open_issues_count":0,"forks_count":0,"subscribers_count":1,"default_branch":"main","last_synced_at":"2025-06-07T18:01:47.710Z","etag":null,"topics":["analytics","functional-programming","hadoop-hdfs","scala","spark"],"latest_commit_sha":null,"homepage":"","language":"Scala","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":null,"status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/Asterinos1.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":null,"code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null,"zenodo":null}},"created_at":"2025-04-23T12:53:54.000Z","updated_at":"2025-05-27T09:07:31.000Z","dependencies_parsed_at":"2025-05-27T10:34:27.019Z","dependency_job_id":null,"html_url":"https://github.com/Asterinos1/Movie-Preference-Analyzer","commit_stats":null,"previous_names":["asterinos1/movie-preference-analyzer"],"tags_count":0,"template":false,"template_full_name":null,"purl":"pkg:github/Asterinos1/Movie-Preference-Analyzer","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Asterinos1%2FMovie-Preference-Analyzer","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Asterinos1%2FMovie-Preference-Analyzer/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Asterinos1%2FMovie-Preference-Analyzer/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Asterinos1%2FMovie-Preference-Analyzer/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/Asterinos1","download_url":"https://codeload.github.com/Asterinos1/Movie-Preference-Analyzer/tar.gz/refs/heads/main","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/Asterinos1%2FMovie-Preference-Analyzer/sbom","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":263282471,"owners_count":23442179,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["analytics","functional-programming","hadoop-hdfs","scala","spark"],"created_at":"2025-06-07T18:00:39.299Z","updated_at":"2025-07-03T07:30:41.432Z","avatar_url":"https://github.com/Asterinos1.png","language":"Scala","funding_links":[],"categories":[],"sub_categories":[],"readme":"# Movie Preference Analyzer\n\nA Scala + Apache Spark project for **functional big data analytics** on the [MovieLens](https://grouplens.org/datasets/movielens/) dataset, developed as part of the INF424 course: *Functional Programming, Analytics and Applications* at the **Technical University of Crete** (Spring Semester 2024–2025).\n\nThis project implements a variety of advanced queries using both **Spark RDDs** and **DataFrames**, with all code written in Scala and tested on the SoftNet Cluster of TUC.\n\nAuthors:\n- @Asterinos1\n- @eNiaro\n\n## Deployment Modes\n\nThe tool supports two execution environments:\n\n- **Cluster Mode** – Optimized for execution on the **SoftNet Cluster**.\n- **Local Mode** – Designed for development and testing on a local machine, using local file paths and standalone Spark execution. Requires a local installation of **Apache Spark**, **Hadoop**, and **Java JDK** (to support Scala execution).\n\n## Dataset\n\nDataset used: [ml-latest.zip](https://files.grouplens.org/datasets/movielens/ml-latest.zip)\n\nCSV files used:\n- `movies.csv` – movie metadata (movieId, title, genres)\n- `ratings.csv` – user ratings (userId, movieId, rating)\n- `tags.csv` – user-assigned tags\n- `genome-scores.csv` – tag relevance scores per movie\n- `genome-tags.csv` – textual tag labels\n\n\n\n## Technologies\n- Scala\n- Apache Spark\n- HDFS (SoftNet Cluster)\n\n## Build Configuration\n\nThis project uses **SBT** for managing dependencies and building the application. Below is the configuration from `build.sbt`:\n\n```scala\nThisBuild / version := \"0.1.0-SNAPSHOT\"\n\nThisBuild / scalaVersion := \"2.11.8\"\n\nlazy val root = (project in file(\".\"))\n  .settings(\n    name := \"ScalaAnalyticsProject\"\n  )\n\nlibraryDependencies ++= Seq(\n  \"org.apache.spark\" %% \"spark-core\" % \"2.3.1\",\n  \"org.apache.spark\" %% \"spark-sql\" % \"2.3.1\",\n  \"org.apache.hadoop\" % \"hadoop-client\" % \"3.1.1\"\n)\n```\n\n**Check out `project_doc.pdf` for the full documentation of this project.**\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fasterinos1%2Fmovie-preference-analyzer","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fasterinos1%2Fmovie-preference-analyzer","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fasterinos1%2Fmovie-preference-analyzer/lists"}