Data

Tools

Indexes

Applications

Experiments

Awesome

An open API service indexing awesome lists of open source software.

Projects in Awesome Lists tagged with mllib

A curated list of projects in awesome lists tagged with mllib .

https://github.com/jadianes/spark-py-notebooks

Apache Spark & Python (pySpark) tutorials for Big Data Analysis and Machine Learning as IPython / Jupyter notebooks

big-data bigdata data-analysis data-science ipython ipython-notebook machine-learning mllib notebook pyspark python spark

Last synced: 15 May 2025

https://github.com/databricks/learningsparkv2

This is the github repo for Learning Spark: Lightning-Fast Data Analytics [2nd Edition]

apache-spark delta-lake mlflow mllib spark spark-mllib spark-sql structured-streaming

Last synced: 14 May 2025

https://github.com/ognis1205/spark-tda

SparkTDA is a package for Apache Spark providing Topological Data Analysis Functionalities.

apache-spark machine-learning ml mllib spark tda topological-data-analysis

Last synced: 20 Nov 2025

https://github.com/flipkart-incubator/spark-transformers

Spark-Transformers: Library for exporting Apache Spark MLLIB models to use them in any Java application with no other dependencies.

apache-spark data-pipelines export java machine-learning machine-learning-algorithms machine-learning-library mllib scala spark transformers

Last synced: 29 Oct 2025

https://github.com/java-edge/spark-mllib-tutorial

大数据框架 Spark MLlib 机器学习库基础算法全面讲解,附带齐全的测试文件

bigdata machine-learning mllib spark

Last synced: 21 Mar 2025

https://github.com/hexnn/stark

基于Spark+SparkMLlib+Debezium+Deequ打造的简单易用、超高性能大数据治理引擎。适用于批流一体的数据集成和数据分析，支持CDC实时数据采集、机器学习算法模型、数据质量校验、数据标注、敏感数据识别、数据建模、算法建模和OLAP数据分析

cdc dataworks datax debezium deequ etl flink hadoop kettle mllib seatunnel spark sparkml sparkmllib

Last synced: 22 Feb 2026

https://github.com/lewuathe/dllib

dllib is a distributed deep learning library running on Apache Spark

deep-learning mllib scala spark

Last synced: 02 May 2025

https://github.com/minishlink/mllib

[2009] Code apps and games easily on Nintendo Wii !

mllib nintendo-wii wii

Last synced: 27 Oct 2025

https://github.com/anujdutt9/bigdata-and-machine-learning

Basics of Big Data and Machine Learning using Apache Spark and Scala

apache-spark atom-editor bigdata machine-learning mllib scala

Last synced: 04 May 2025

https://github.com/aiwithqasim/pyspark_bigdata

Getting started with PySpark for Big data analysis

graphx mllib pyspark python rdds

Last synced: 17 Mar 2025

https://github.com/aikuyun/spark-all

Spark core sql streaming mllib

ml mllib scala spark

Last synced: 28 Apr 2026

https://github.com/kriss024/Spark

Spark for Data Science and ETL process.

data-science jupiter-notebook machine-learning mllib pyspark spark spark-sql

Last synced: 17 Jul 2025

https://github.com/jabhij/crimerate_classification

Developing a system that could classify crime descriptions into different categories which would help the authorities to assign officers to crimes based on the report.

classification crime-analysis crime-classification crime-rates machine-learning mllib pyspark python spark tensorflow

Last synced: 26 Sep 2025

https://github.com/santiagxf/portable-sparkml

This repository shows how to create containerized versions of models trained with spark MLLib

containers machine-learning mllib mlops sparkml

Last synced: 24 Apr 2025

https://github.com/rbhatia46/end-to-end-pyspark

And end-to-end Machine Learning pipeline with PySpark-ML for the famous Telco Customer Churn dataset

churn-prediction machine-learning ml-pipeline mllib pyspark

Last synced: 25 Jul 2026

https://github.com/nthaihoc/rfm-segmentation-ml

An automatic machine learning based customer segmentation model with RFM analysis at ICTA conference 2024

customer-segmentation hadoop kmeans-clustering-algorithm machine-learning mllib rfm-analysis spark

Last synced: 28 Apr 2026

https://github.com/snehadharne/bigdataanalytics-mvcollisions

Leveraging NYC Open Data, this repository contains Databricks notebooks for analyzing motor vehicle collisions. We perform EDA, spatial clustering, and predictive modeling on collision, vehicle, and person datasets to understand accident trends and predict potential risks.

data-wrangling eda gcp-dataproc mllib predictive-modeling pyspark pyspark-notebook scale-out scale-up spatial-data-analysis

Last synced: 08 Jun 2026

https://github.com/xlisp/jim-emacs-kungfu-sparkling-lisp

Clojure Sparkling & statistics, machine learning, kungfu

clojure machine-learning mllib spark-streaming sparkling statistics

Last synced: 15 May 2026

https://github.com/saru2020/rentpredictor

#MachineLearning project for predicting the house rent demonstrating MLOps

apache-airflow data-science kaggle-dataset machine-learning-algorithms machinelearning mllib mlops pyspark python spark

Last synced: 14 Feb 2026

https://github.com/hendhamdi/sentiment-analysis-spark-nlp

This project uses a Spark pipeline (PySpark) to analyze the sentiment of user reviews.

apache-spark hadoop matplotlib mllib pandas pyspark python

Last synced: 07 May 2026

https://github.com/lupusruber/rnmp_homework2

A recommendation system project that uses the Spark MLlib's ALS model to train and evaluate on the MovieLens dataset. Includes Dockerized setup, hyperparameter tuning, and evaluation metrics (RMSE, Precision@K, Recall@K, NDCG) for performance insights.

docker mllib recommender-system spark

Last synced: 07 May 2026

https://github.com/minishlink/mllib-twiitter

[2009] A Twitter client for the Wii built with MLlib

mllib wii

Last synced: 10 Jun 2026

https://github.com/melinamoraiti/spark-text-analyzer

An Apache Spark application to analyze word frequencies and compute TF-IDF weights across multiple text file sets using Spark's MLlib library.

apache-spark apachespark-rdd max-word-frequency mllib tf-idf

Last synced: 10 Mar 2026

https://github.com/minishlink/mllib-tictactoe

[2009] A TicTacToe game for the Wii built with MLlib

mllib wii

Last synced: 15 Jul 2025

https://github.com/aishwaryahastak/ipl_analysis

Analysis of IPL dataset using PySpark

data-analysis mllib pyspark

Last synced: 18 Jul 2026

https://github.com/amirhosseinazami1373/book-genre-classifier

Have you ever tried to guess the genre of a book by reading its title? Well, in this project, I was trying to do it using a massive database of Books (their titles and genres), MLLib Spark, and the use of three different ML models, including: 1- Support Vector Machine (SVM) 2- Logistic Regression 3- Neural Networks

apache-spark big-data classification logistic-regression mllib neural-networks svm

Last synced: 30 Jan 2026

https://github.com/jabhij/apple_dataanalyis_apachespark

Analyzed Apple's dataset to check how many people bought Airpods after buying Mac or iPhone. Thereafter, using ML and predictive analytics to check future outcomes.

apache-spark databricks mllib pyspark python sql

Last synced: 08 Feb 2026

https://github.com/lucaspadoni/scala-spark-stellar-classification

Classification of astronomical objects using Scala-Spark and its ML library "spark.ml", based on the Stellar Classification Dataset (SDSS17).

celestial-bodies classification machine-learning mllib scala space spark sparkml supervised-learning

Last synced: 17 Apr 2026

https://github.com/parag000/nyc-taxi-fare-prediction-using-pyspark

Processed 13.2M records, conducted EDA, feature engineering, and built Linear regression model for fare prediction. Tackled big data challenges with efficient preprocessing and visualizations

hive mllib pyspark python

Last synced: 26 Apr 2026

https://github.com/pierrekieffer/genericunsupervisedmachinelearning

Generic Clustering algorithm for Apache Spark deployment

kmeans machine-learning mllib silhouette spark

Last synced: 02 May 2026

https://github.com/minishlink/mllib-plop

[2009] A silly game with blobs for the Wii built with MLlib

mllib wii

Last synced: 27 Jul 2026

https://github.com/ychaaby/real-time-coursecompass

A real-time course recommendation system powered by Apache Spark and Kafka for scalable big data processing. It uses content-based filtering and AI-generated keywords to deliver personalized learning suggestions, all orchestrated with Docker for seamless deployment.

data-engineering docker gemini kafka mllib oracle pyspark recommender-system selenium spark-streaming streaming streamlit tfidf

Last synced: 05 May 2026