Ecosyste.ms: Awesome

https://github.com/datatalksclub/mlops-zoomcamp

Free MLOps course from DataTalks.Club

machine-learning mlops model-deployment model-monitoring workflow-orchestration

Last synced: 16 Dec 2024

https://github.com/DataTalksClub/mlops-zoomcamp

Free MLOps course from DataTalks.Club

machine-learning mlops model-deployment model-monitoring workflow-orchestration

Last synced: 29 Oct 2024

https://github.com/evidentlyai/evidently

Evidently is ​​an open-source ML and LLM observability framework. Evaluate, test, and monitor any AI-powered system or data pipeline. From tabular data to Gen AI. 100+ metrics.

data-drift data-quality data-science data-validation generative-ai hacktoberfest html-report jupyter-notebook llm llmops machine-learning mlops model-monitoring pandas-dataframe

Last synced: 16 Dec 2024

https://github.com/deepchecks/deepchecks

Deepchecks: Tests for Continuous Validation of ML Models & Data. Deepchecks is a holistic open-source solution for all of your AI & ML validation needs, enabling to thoroughly test your data and models from research to production.

data-drift data-science data-validation deep-learning html-report jupyter-notebook machine-learning ml mlops model-monitoring model-validation pandas-dataframe python pytorch

Last synced: 16 Dec 2024

https://github.com/traceloop/openllmetry

Open-source observability for your LLM application, based on OpenTelemetry

artifical-intelligence datascience generative-ai good-first-issue good-first-issues help-wanted llm llmops metrics ml model-monitoring monitoring observability open-source open-telemetry opentelemetry opentelemetry-python python

Last synced: 16 Dec 2024

https://github.com/NannyML/nannyml

nannyml: post-deployment data science in python

data-analysis data-drift data-science deep-learning jupyter-notebook machine-learning machinelearning ml mlops model-monitoring monitoring performance-estimation performance-monitoring postdeploymentdatascience python visualization

Last synced: 13 Nov 2024

https://github.com/nannyml/nannyml

nannyml: post-deployment data science in python

data-analysis data-drift data-science deep-learning jupyter-notebook machine-learning machinelearning ml mlops model-monitoring monitoring performance-estimation performance-monitoring postdeploymentdatascience python visualization

Last synced: 17 Dec 2024

https://github.com/traceloop/openllmetry-js

Sister project to OpenLLMetry, but in Typescript. Open-source observability for your LLM application, based on OpenTelemetry

datascience generative-ai javascript llmops metrics ml model-monitoring monitoring nextjs observability open-source opentelemetry opentelemetry-javascript typescript

Last synced: 20 Dec 2024

https://github.com/maif/eurybia

⚓ Eurybia monitors model drift over time and securizes model deployment with data validation

data-drift data-validation datadrift-classifier domain-classifier drift drift-detection html-report machine-learning model-drift model-monitoring production-machine-learning python

Last synced: 15 Dec 2024

https://github.com/VectorInstitute/cyclops

Toolkit for evaluating and monitoring AI models in clinical settings

clinical-data clinical-decision-support clinical-research data-drift deep-learning drift-detection eicu-crd electronic-health-record electronic-medical-record evaluation healthcare machine-learning mimic-iii mimic-iv model-monitoring omop-cdm physionet

Last synced: 28 Oct 2024

https://github.com/rstudio/vetiver-python

Version, share, deploy, and monitor models.

mlops model-deploy model-monitoring model-versioning python

Last synced: 15 Dec 2024

https://github.com/arize-ai/client_python

A python library to send data to Arize AI!

ai-monitoring ai-observability ai-roi data-quality-monitoring drift-monitoring ml-monitoring ml-observability model-explainability model-monitoring model-performance-management performance-monitoring

Last synced: 19 Dec 2024

https://github.com/prabhuomkar/bitbeast

Experiments with Model Training, Deployment & Monitoring

machine-learning model-deployment model-monitoring model-training

Last synced: 16 Nov 2024

https://github.com/fiddler-labs/fiddler-examples

ai-observability explainable-ai model-monitoring

Last synced: 10 Nov 2024

https://github.com/evidentlyai/tracely

LLM application tracing based on OpenTelemetry

lllmops model-monitoring observability open-telemetry tracing

Last synced: 09 Nov 2024

https://github.com/arize-ai/client_java

Java client to interact with Arize API

ai-monitoring ai-observability ai-roi data-quality-monitoring drift-monitoring ml-monitoring ml-observability model-explainability model-monitoring model-observability model-performance-management performance-monitoring

Last synced: 05 Nov 2024

https://github.com/traceloop/hub

High-scale LLM gateway, written in Rust. OpenTelemetry-based observability included

artificial-intelligence datascience generative-ai llm llmops ml model-monitoring observability open-source opentelemetry rust

Last synced: 14 Nov 2024

https://github.com/newronai/newron-sdk

Newron is a data-centric ML platform to easily build, manage, deploy and continuously improve models through data driven development.

data-science data-versioning deep-learning experiment-tracking hyperparameter-optimization hyperparameter-search hyperparameter-tuning keras machine-learning ml-platform mlops model-monitoring model-registry model-reproducibility model-versioning python3 pytorch tensorflow

Last synced: 03 Nov 2024

https://github.com/pyladiesams/model-drift-beginner-dec2022

Learn how to handle model drift and perform test-based model monitoring

cd4ml data-drift evidently mlops model-drift model-monitoring python target-drift workshop

Last synced: 09 Nov 2024

https://github.com/md-emon-hasan/evidently-ai

Evidently AI in tracking, analyzing, and visualizing machine learning model performance and data drift ensure their reliability over time.

evidently evidentlyai model-evaluation model-monitoring monitoring-tool tracking tracking-system

Last synced: 13 Nov 2024

https://github.com/codex-0915/mlops-zoomcamp

This repository contains the notes, practice and sample outputs, homeworks, etc, from DataTalks.Club's MLOps Zoomcamp 2024 Cohort

machine-learning mlops model-deployment model-monitoring workflow-orchestration

Last synced: 06 Nov 2024