{"id":15159381,"url":"https://github.com/produvia/ai-platform","last_synced_at":"2025-09-30T09:30:39.897Z","repository":{"id":100512373,"uuid":"191092226","full_name":"produvia/ai-platform","owner":"produvia","description":"An open-source platform for automating tasks using machine learning models","archived":true,"fork":false,"pushed_at":"2020-03-03T04:10:06.000Z","size":4174,"stargazers_count":79,"open_issues_count":0,"forks_count":130,"subscribers_count":10,"default_branch":"master","last_synced_at":"2024-09-27T21:20:58.333Z","etag":null,"topics":["artificial-intelligence","automation","data-science","deep-learning","java","keras-models","machine-learning","model-zoo","neural-networks","python","pytorch-models","r","task","tasks","tensorflow-models"],"latest_commit_sha":null,"homepage":"","language":"Python","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"mit","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/produvia.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":null,"funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null}},"created_at":"2019-06-10T03:44:00.000Z","updated_at":"2024-08-28T19:18:20.000Z","dependencies_parsed_at":null,"dependency_job_id":"8a49f714-afc0-4be7-b252-3427195ae4f8","html_url":"https://github.com/produvia/ai-platform","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/produvia%2Fai-platform","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/produvia%2Fai-platform/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/produvia%2Fai-platform/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/produvia%2Fai-platform/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/produvia","download_url":"https://codeload.github.com/produvia/ai-platform/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":234722055,"owners_count":18876896,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["artificial-intelligence","automation","data-science","deep-learning","java","keras-models","machine-learning","model-zoo","neural-networks","python","pytorch-models","r","task","tasks","tensorflow-models"],"created_at":"2024-09-26T21:20:28.471Z","updated_at":"2025-09-30T09:30:34.432Z","avatar_url":"https://github.com/produvia.png","language":"Python","funding_links":[],"categories":["Python","Libraries"],"sub_categories":[],"readme":"# AI Platform\n\n## Background\n\nArtificial intelligence (AI) gig economy is here. Many companies including Uber, DoorDash, Fiverr built economies by relying on contingent workers, available on-demand. The great paradox of on-demand services is that they can be easily automated using AI technologies.\n\n- Where do AI systems come from? Research and development (R\u0026D)\n- What do AI systems do today? Perform tasks (i.e. provide services)\n- What will AI systems be able to do? Automate human tasks (and more)\n- What is R\u0026D? Tasks to automate\n- Where does AI R\u0026D automation lead? Recursive technology improvement\n- Where does that lead? AI services, which includes the service of developing new services\n\n\u003e \"The AI explosion will be enabled by AI-driven AI developments. As AI technologies are being recursively improved, new AI services and new AI tasks will be solved.\"\n\u003e\n\u003e -- Slava Kurilyak, Founder / CEO at Produvia\n\n## About\n\n![ai-platform](ai-platform.jpg)\n\n**AI Platform** aims to automate AI R\u0026D tasks. Our vision is to create machine learning models to solve various computer science tasks. Our mission is to achieve automation of AI technologies.\n\n\u003e \"We need to standarize AI solutions by focusing on solving AI R\u0026D tasks while developing machine learning models that are reusable and easily accessible by all.\"\n\u003e\n\u003e -- Slava Kurilyak, Founder / CEO at Produvia\n\n**What is our approach?**\n\nWe are developing service-centered or task-focused machine learning models. These models, or AI services, solve distinct tasks or functions.\n\nExamples of AI tasks include:\n\n- semantic segmentation (computer visions)\n- machine translation (natural language processing)\n- word embeddings (methodology)\n- recommendation systems (miscellaneous)\n- speech recognition (speech)\n- atari games (playing games)\n- link prediction (graphs)\n- time series classification (time series)\n- audio generation (audio)\n- visual odometry (robots)\n- music information retrieval (music)\n- dimensionality reduction (computer code)\n- decision making (reasoning)\n- knowledge graphs (knowledge base)\n- adversarial attack (adversarial)\n\n**Proposed Folder Structure:**\n\nWe store machine learning models using the following folder structure:\n\n`/tasks/area/task`\n\nFor example:\n\n`/tasks/computer-vision/image-classification`\n\n## Installation\n\nTo get the entire project up and running locally:\n\nClone the repo:\n\n```\n$ git clone https://github.com/produvia/ai-platform.git\n$ cd ai-platform\n```\n\n## Running Locally\n\nThis is an example of how to run `object detection` on the picture containing zebra:\n\n```\n$ cd tasks/computer-vision/object-detection/\n$ mlflow run . -P photo_name=zebra.jpg\n```\n\n## Project Components\n\nFor more information, check out documentation for the different services:\n\n- [/tasks](https://github.com/produvia/ai-platform/tree/master/tasks) - for compilation of AI tasks\n\n## Supported Programming Languages\n\nAI Platform supports various programming languages:\n\n\u003ca href=\"https://www.python.org/\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/python.png\" width=\"125px\" alt=\"Python\" title=\"Python\"\u003e\u003c/a\u003e \u003ca href=\"https://www.r-project.org/\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/r.png\" width=\"125px\" alt=\"R\" title=\"R\"\u003e\u003c/a\u003e \u003ca href=\"https://en.wikipedia.org/wiki/Java_(programming_language)\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/java.png\" height=\"80px\" alt=\"Java\" title=\"Java\"\u003e\u003c/a\u003e\n\n## Supported ML Development Frameworks\n\nAI Platform supports various machine learning frameworks and libraries:\n\n\u003ca href=\"https://tensorflow.org/\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/tensorflow.png\" width=\"125px\" alt=\"Tensorflow\" title=\"Tensorflow\"\u003e\u003c/a\u003e \u003ca href=\"https://pytorch.org/\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/pytorch.png\" width=\"125px\" alt=\"Pytorch\" title=\"Pytorch\"\u003e\u003c/a\u003e \u003ca href=\"https://keras.io/\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/keras.png\" width=\"125px\" alt=\"Keras\" title=\"Keras\"\u003e\u003c/a\u003e \u003ca href=\"https://spark.apache.org/\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/apache-spark.png\" width=\"125px\" alt=\"Apache Spark\" title=\"Apache Spark\"\u003e\u003c/a\u003e \u003ca href=\"https://scikit-learn.org/\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/scikit-learn.png\" width=\"125px\" alt=\"Scikit Learn\" title=\"Scikit Learn\"\u003e\u003c/a\u003e \u003ca href=\"https://www.h2o.ai/\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/h2o.png\" height=\"80px\" alt=\"H2O\" title=\"H2O\"\u003e\u003c/a\u003e\n\n## Supported ML Deployment Frameworks\n\nAI Platform supports various machine learning deployment frameworks and libraries:\n\n\u003ca href=\"https://conda.io\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/conda.png\" width=\"125px\" alt=\"Conda\" title=\"Conda\"\u003e\u003c/a\u003e \u003ca href=\"https://www.docker.com/\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/docker.png\" width=\"125px\" alt=\"Docker\" title=\"Docker\"\u003e\u003c/a\u003e \u003ca href=\"http://mleap-docs.combust.ml/\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/mleap.png\" width=\"125px\" alt=\"MLeap\" title=\"Mleap\"\u003e\u003c/a\u003e \u003ca href=\"https://aws.amazon.com/sagemaker/\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/sagemaker.jpg\" width=\"125px\" alt=\"SageMaker\" title=\"SageMaker\"\u003e\u003c/a\u003e \u003ca href=\"https://azure.microsoft.com/en-ca/services/machine-learning-service/\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/azure-ml.png\" width=\"125px\" alt=\"Azure ML\" title=\"Azure ML\"\u003e\u003c/a\u003e \u003ca href=\"https://cloud.google.com/\"\u003e\u003cimg src=\"https://mlflow.org/images/integration-logos/google-cloud.png\" height=\"80px\" alt=\"Google Cloud\" title=\"Google Cloud\"\u003e\u003c/a\u003e\n\n## Common Questions\n\n### What is the difference between AI Platform and MLflow?\n\nAI Platform is an open source platform for automating machine learning models (aka tasks) while MLflow is open source platform for the machine learning lifecycle. AI Platform focuses on automating tasks while MLflow focuses on managing and deploying models. AI Platform focuses on automating model building. MLflow focuses on automating post-modeling. AI Platform is dependent on MLflow. MLflow is not dependent on AI Platform.\n\nAI Platform:\n\n\u003e AI Platform Tasks: Automate computer science tasks using AI, machine learning, deep learning and data science.\n\nMLflow:\n\n\u003e MLflow Tracking: Log parameters, code, and results in machine learning experiments and compare them using an interactive UI.\n\u003e\n\u003e MLflow Projects: A code packaging format for reproducible runs using Conda and Docker, so you can share your ML code with others.\n\u003e\n\u003e MLflow Models: A model packaging format and tools that let you easily deploy the same model (from any ML library) to batch and real-time scoring on platforms such as Docker, Apache Spark, Azure ML and AWS SageMaker.\n\n### What is the difference between AI Platform and AutoML?\n\nAI Platform aims to make machine learning models reusable and easily accessible by all.\n\nAutomated machine learning (autoML) is a computer science methodology which aims to make machine learning more accessible. AutoML automatically generates data analysis pipelines, performs neural architecture search, hyperparameter optimization and automated feature engineering.\n\n### What is the difference between AI tasks and human tasks?\n\nAI tasks are computer tasks solved using AI and machine learning. Unautomated AI R\u0026D tasks are human tasks. Advances in AI will enable incremental speedup and automation of human tasks.\n\n## Datasets\n\n### Uploading Your Own Dataset\n\nDo you have your own data? We recommend that you upload your own dataset onto a public bucket via [AWS S3](https://aws.amazon.com/s3), or [Google Drive](https://drive.google.com) and include a `LICENSE` file which describes usage rights (commercial or non-commercial).\n\n### Finding an Existing Dataset\n\nAre you looking for a dataset? We recommend that you check out [DataSetList.com](https://www.datasetlist.com/) which includes the biggest machine learning datasets for computer vision (CV), natural language processing (NLP), question answer (QA), audio, and medical industries. You can also search for particular datasets using [Google Dataset Search](https://toolbox.google.com/datasetsearch).\n\n## Contributing\n\n### Code\n\nDo you want to contribute towards **AI Platform**?\n\n1. Fork this repo ([how to guide](https://help.github.com/en/articles/fork-a-repo)).\n2. Develop a new machine learning model or improve an existing one. Review existing [tasks](https://github.com/produvia/ai-platform/tree/master/tasks) and outstanding [issues](https://github.com/produvia/ai-platform/issues) and [pull requests](https://github.com/produvia/ai-platform/pulls).\n3. Integrate [MLflow](https://github.com/mlflow/mlflow) into your code.\n4. Create a pull request from your fork ([how to guide](https://help.github.com/en/articles/creating-a-pull-request-from-a-fork)).\n\n### Ideas\n\nDo you have an idea, feature request, or task request for **AI Platform**?\n\n1. Create a [new issue](https://github.com/produvia/ai-platform/issues/new/choose)\n2. Email the Produvia team at [hello@produvia.com](mailto:hello@produvia.com)\n\n## Project Dependencies\n\n![ai-platform-mlflow](ai-platform-mlflow.jpg)\n\n- At **AI Platform**, we use [MLflow](https://github.com/mlflow/mlflow) for model tracking and model deployment. MLflow is an open source platform for machine learning lifecycle. Familiarize yourself with MLflow by going through the following resources:\n\t1. Review [MLflow examples](https://github.com/mlflow/mlflow/tree/master/examples) hosted on Github.\n\t2. Watch [MLflow intro video on YouTube](https://www.youtube.com/watch?v=QJW_kkRWAUs) by Matei Zaharia, Co-founder and Chief Technologist at Databricks.\n\t3. Watch [MLflow videos on YouTube](https://www.youtube.com/playlist?list=PLTPXxbhUt-YVstcW1-OrYoRiAipXRManO)\n\n## About Produvia\n\nSince 2013, [Produvia](http://produvia.com) has partnered with companies from all industries to accelerate the adoption of AI and machine learning technologies.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fproduvia%2Fai-platform","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fproduvia%2Fai-platform","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fproduvia%2Fai-platform/lists"}