{"id":13601356,"url":"https://github.com/intel/ai-workflows","last_synced_at":"2025-04-11T04:30:54.741Z","repository":{"id":143101941,"uuid":"545852943","full_name":"intel/ai-workflows","owner":"intel","description":"A repository of Dockerfiles, scripts, yaml files, Helm Charts, etc. used to build and scale the sample AI workflows with python, kubernetes, kubeflow, cnvrg.io, and other frameworks on Intel platforms in the cloud and on-premise.","archived":true,"fork":false,"pushed_at":"2024-02-22T21:41:08.000Z","size":4862,"stargazers_count":11,"open_issues_count":0,"forks_count":6,"subscribers_count":5,"default_branch":"main","last_synced_at":"2024-08-09T00:28:13.611Z","etag":null,"topics":["ai","ai-workflows","cnvrg","containerization","containers","docker","docker-compose","kubernetes","one-api","pipelines"],"latest_commit_sha":null,"homepage":"","language":"Makefile","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/intel.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":"CODE_OF_CONDUCT.md","threat_model":null,"audit":null,"citation":null,"codeowners":".github/CODEOWNERS","security":"SECURITY.md","support":null,"governance":null,"roadmap":null,"authors":null,"dei":null}},"created_at":"2022-10-05T04:51:34.000Z","updated_at":"2024-08-05T06:56:21.000Z","dependencies_parsed_at":"2024-01-16T21:54:07.437Z","dependency_job_id":"af50f4e5-3ed8-47ba-84a4-dc4de1b16554","html_url":"https://github.com/intel/ai-workflows","commit_stats":null,"previous_names":[],"tags_count":6,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/intel%2Fai-workflows","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/intel%2Fai-workflows/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/intel%2Fai-workflows/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/intel%2Fai-workflows/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/intel","download_url":"https://codeload.github.com/intel/ai-workflows/tar.gz/refs/heads/main","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":223458283,"owners_count":17148444,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["ai","ai-workflows","cnvrg","containerization","containers","docker","docker-compose","kubernetes","one-api","pipelines"],"created_at":"2024-08-01T18:01:01.190Z","updated_at":"2024-11-07T04:30:44.709Z","avatar_url":"https://github.com/intel.png","language":"Makefile","funding_links":[],"categories":["ai"],"sub_categories":[],"readme":"PROJECT NOT UNDER ACTIVE MANAGEMENT\n\nThis project will no longer be maintained by Intel.\n\nIntel has ceased development and contributions including, but not limited to, maintenance, bug fixes, new releases, or updates, to this project.  \n\nIntel no longer accepts patches to this project.\n\nIf you have an ongoing need to use this project, are interested in independently developing it, or would like to maintain patches for the open source software community, please create your own fork of this project.  \n\nContact: webadmin@linux.intel.com\n# AI Workflows Infrastructure for Intel® Architecture\n\n## Description\nOn this page you will find details and instructions on how to set up an environment that supports Intel's AI Pipelines container build and test infrastructure.\n\n## Dependency Requirements\nOnly Linux systems are currently supported. Please make sure the following are installed in your package manager of choice:\n- `make`\n- `docker.io`\n\nA full installation of [docker engine](https://docs.docker.com/engine/install/) with docker CLI is required. The recommended docker engine version is `19.03.0+`.\n\n- `docker-compose`\n\nThe Docker Compose CLI can be [installed](https://docs.docker.com/compose/install/compose-plugin/#installing-compose-on-linux-systems) both manually and via package manager.\n\n```\n$ DOCKER_CONFIG=${DOCKER_CONFIG:-$HOME/.docker}\n$ mkdir -p $DOCKER_CONFIG/cli-plugins\n$ curl -SL https://github.com/docker/compose/releases/download/v2.7.0/docker-compose-linux-x86_64 -o $DOCKER_CONFIG/cli-plugins/docker-compose\n$ chmod +x $DOCKER_CONFIG/cli-plugins/docker-compose\n\n$ docker compose version\nDocker Compose version v2.7.0\n```\n\n## Build and Run Workflows\nEach pipeline will contain specific requirements and instructions for how to provide its specific dependencies and what customization options are possible. Generally, pipelines are run with the following format:\n\n```git submodule update --init --recursive```\n\nThis will pull the dependent repo containing the scripts to run the end2end pipeline's inference and/or training.\n\n```\u003cKEY\u003e=\u003cVALUE\u003e ... \u003cKEY\u003e=\u003cVALUE\u003e make \u003cPIPELINE_NAME\u003e```\n\nWhere `KEY` and `VALUE` pairs are environment variables that can be used to customize both the pipeline's script options and the resulting container. For more information about the valid `KEY` and `VALUE` pairs, see the README.md file in the folder for each workflow container:\n\n|AI Workflow|Framework/Tool|Mode|\n|-|-|-|\n|Chronos Time Series Forecasting|Chronos and PyTorch*|[Training](./big-data/chronos/DEVCATALOG.md)\n|Document-Level Sentiment Analysis|PyTorch*|[Training](./language_modeling/pytorch/bert_large/training/)|\n|Friesian Recommendation System|Spark with TensorFlow|[Training](./big-data/friesian/training/) \\| [Inference](./big-data/friesian/DEVCATALOG.md)|\n|Habana® Gaudi® Processor Training and Inference using OpenVINO™ Toolkit for U-Net 2D Model|OpenVINO™|[Training and Inference](https://github.com/intel/cv-training-and-inference-openvino/tree/v1.0.0/gaudi-segmentation-unet-ptq)|\n|Privacy Preservation|Spark with TensorFlow and PyTorch*|[Training and Inference](./big-data/ppml/DEVCATALOG.md)|\n|NLP workflow for AWS Sagemaker|TensorFlow and Jupyter|[Inference](./classification/tensorflow/bert_base/inference/)|\n|NLP workflow for Azure ML|PyTorch* and Jupyter|[Training](./language_modeling/pytorch/bert_base/training/) \\| [Inference](./language_modeling/pytorch/bert_base/inference/)|\n|Protein Structure Prediction|PyTorch*|[Inference](./protein-folding/pytorch/alphafold2/inference/)\n|Quantization Aware Training and Inference|OpenVINO™|[Quantization Aware Training(QAT)](https://github.com/intel/nlp-training-and-inference-openvino/tree/v1.0/question-answering-bert-qat)|\n|Ray Recommendation System|Ray with PyTorch*|[Training](./big-data/aiok-ray/training/) \\| [Inference](./big-data/aiok-ray/inference)|\n|RecSys Challenge Analytics With Python|Hadoop and Spark|[Training](./analytics/classical-ml/recsys/training/)|\n|Video Streamer|TensorFlow|[Inference](./analytics/tensorflow/ssd_resnet34/inference/)|\n|Vision Based Transfer Learning|TensorFlow|[Training](./transfer_learning/tensorflow/resnet50/training/) \\| [Inference](./transfer_learning/tensorflow/resnet50/inference/)|\n|Wafer Insights|SKLearn|[Inference](./analytics/classical-ml/synthetic/inference/)|\n\n\n### Cleanup\nEach pipeline can remove all resources allocated by executing `make clean`.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fintel%2Fai-workflows","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fintel%2Fai-workflows","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fintel%2Fai-workflows/lists"}