{"id":13471794,"url":"https://github.com/SkyAPM/aiops-engine-for-skywalking","last_synced_at":"2025-03-26T14:32:31.937Z","repository":{"id":37417046,"uuid":"487076006","full_name":"SkyAPM/aiops-engine-for-skywalking","owner":"SkyAPM","description":"This is an incubating repository of the Apache SkyWalking AIOps Engine","archived":false,"fork":false,"pushed_at":"2023-11-01T00:39:01.000Z","size":2156,"stargazers_count":38,"open_issues_count":10,"forks_count":7,"subscribers_count":10,"default_branch":"master","last_synced_at":"2025-03-17T17:56:58.453Z","etag":null,"topics":["aiops","machine-learning","metrics","monitoring","observability","skywalking"],"latest_commit_sha":null,"homepage":"https://github.com/apache/skywalking/discussions/8883","language":"Jupyter Notebook","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/SkyAPM.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2022-04-29T18:38:06.000Z","updated_at":"2025-02-01T08:32:23.000Z","dependencies_parsed_at":"2024-10-30T02:30:30.339Z","dependency_job_id":null,"html_url":"https://github.com/SkyAPM/aiops-engine-for-skywalking","commit_stats":null,"previous_names":[],"tags_count":0,"template":false,"template_full_name":null,"repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SkyAPM%2Faiops-engine-for-skywalking","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SkyAPM%2Faiops-engine-for-skywalking/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SkyAPM%2Faiops-engine-for-skywalking/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/SkyAPM%2Faiops-engine-for-skywalking/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/SkyAPM","download_url":"https://codeload.github.com/SkyAPM/aiops-engine-for-skywalking/tar.gz/refs/heads/master","host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":245671014,"owners_count":20653468,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2022-07-04T15:15:14.044Z","host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["aiops","machine-learning","metrics","monitoring","observability","skywalking"],"created_at":"2024-07-31T16:00:49.322Z","updated_at":"2025-03-26T14:32:30.847Z","avatar_url":"https://github.com/SkyAPM.png","language":"Jupyter Notebook","funding_links":[],"categories":["Jupyter Notebook"],"sub_categories":[],"readme":"# SkyWalking AIOps Engine\n\n*A practical open-source AIOps engine for the\nera of cloud computing.*\n\n## Why do we build this project?\n\n**We strongly believe that this project will bring value\nto AIOps practitioners and researchers.**\n\u003cdetails\u003e\n  \u003csummary\u003eTowards better Observability\u003c/summary\u003e\nWe could reason this from the following progressive questions:\n\n1. Are there existing algorithms for telemetry data?\n   - **Abundant.**\n\n\n2. Are the existing algorithms empirically verified?\n\n   - **Most algorithms are not verified in production**\n\n\n3. Are there practical AIOps frameworks?\n   - **Limited, often out of maintenance or commercialized.**\n\n\n4. Are there open-source AIOps solutions that offers Out-of-Box integrations?\n   - **Hardly any.**\n\n\n5. Why would I need that?\n   1. For developers \u0026 organizations curious for AIOps:\n      - a. Just install and start using it, saves budget, prevents head-scratching.\n      - b. Treat this project as a good (or bad) reference for your own AIOps pipeline.\n   2. For researchers in the AIOps domain:\n      - a. For software engineering researchers - sample for AIOps evolution and empirical study.\n      - b. For algorithm researchers - playground for new algorithms, solid case studies.\n\n\u003c/details\u003e\n\n\nClick the above section to find out where we place the value of this project,\nthough our current aim is to become the official AIOps engine\nof [Apache SkyWalking](https://github.com/apache/skywalking),\neach component could be easily swapped, extended and scaled to fit your own needs.\n\n### Current Goal\n\nAt the current stage, it targets at Logs and Metrics analysis,\nin the future, we will also explore root cause analysis and\nautomatic problem recovery based on Traces.\n\nThis is also the repository for\nOSPP 2022 and GSOC 2022 student research outcomes.\n\n1. `Exploration of Advanced Metrics Anomaly Detection \u0026 Alerts with Machine Learning in Apache SkyWalking`\n\n2. `Log Outlier Detection in Apache SkyWalking`\n\n### Architecture\n\n**Log Clustering and Log Trend Analysis**\n\n![img.png](docs/static/log-clustering-arch.png)\n\n![img_1.png](docs/static/log-trend-analysis-arch.png)\n\n**Metric Anomaly Detection and Visualizations**\n\nTBD - Soon to be added\n\n### Roadmap\n\nFor the details of our progress, please refer to our project dashboard\n[Here](https://github.com/SkyAPM/aiops-engine-for-skywalking/projects?query=is%3Aopen).\n\nPhase Current (fall -\u003e end of 2022)\n\n0. [ ] Finish POC stage and start implementing dashboards for first stage users. (demo purposes)\n1. [ ] Real-world data testing and chaos engineering benchmark experiments.\n2. [ ] Join Apache Software Foundation as an Apache SkyWalking subproject.\n3. [ ] Integrate with SkyWalking Backend (Export analytics results to SkyWalking)\n4. [ ] Propose and request SkyWalking UI-side changes.\n5. [ ] First release for SkyWalking end-user testing.\n\nPhase Next\n\n1.[ ] Towards production-ready.\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FSkyAPM%2Faiops-engine-for-skywalking","html_url":"https://awesome.ecosyste.ms/projects/github.com%2FSkyAPM%2Faiops-engine-for-skywalking","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2FSkyAPM%2Faiops-engine-for-skywalking/lists"}