{"id":18743087,"url":"https://github.com/kxsystems/automl","last_synced_at":"2026-01-25T14:34:34.474Z","repository":{"id":48108815,"uuid":"244696467","full_name":"KxSystems/automl","owner":"KxSystems","description":"Automated Machine Learning Framework for kdb+","archived":false,"fork":false,"pushed_at":"2024-10-10T16:03:05.000Z","size":2500,"stargazers_count":26,"open_issues_count":2,"forks_count":20,"subscribers_count":3,"default_branch":"master","last_synced_at":"2025-11-20T14:11:07.608Z","etag":null,"topics":["automated-machine-learning","kdb","machine-learning","q"],"latest_commit_sha":null,"homepage":"","language":"q","has_issues":true,"has_wiki":null,"has_pages":null,"mirror_url":null,"source_name":null,"license":"apache-2.0","status":null,"scm":"git","pull_requests_enabled":true,"icon_url":"https://github.com/KxSystems.png","metadata":{"files":{"readme":"README.md","changelog":null,"contributing":"CONTRIBUTING.md","funding":null,"license":"LICENSE","code_of_conduct":null,"threat_model":null,"audit":null,"citation":null,"codeowners":null,"security":null,"support":null,"governance":null,"roadmap":null,"authors":null,"dei":null,"publiccode":null,"codemeta":null}},"created_at":"2020-03-03T17:15:58.000Z","updated_at":"2024-10-10T16:03:10.000Z","dependencies_parsed_at":"2024-12-28T19:33:11.827Z","dependency_job_id":"8d247436-e26f-4c76-8335-863208e07131","html_url":"https://github.com/KxSystems/automl","commit_stats":null,"previous_names":[],"tags_count":5,"template":false,"template_full_name":null,"purl":"pkg:github/KxSystems/automl","repository_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KxSystems%2Fautoml","tags_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KxSystems%2Fautoml/tags","releases_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KxSystems%2Fautoml/releases","manifests_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KxSystems%2Fautoml/manifests","owner_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners/KxSystems","download_url":"https://codeload.github.com/KxSystems/automl/tar.gz/refs/heads/master","sbom_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories/KxSystems%2Fautoml/sbom","scorecard":null,"host":{"name":"GitHub","url":"https://github.com","kind":"github","repositories_count":286080680,"owners_count":28754241,"icon_url":"https://github.com/github.png","version":null,"created_at":"2022-05-30T11:31:42.601Z","updated_at":"2026-01-25T13:59:49.818Z","status":"ssl_error","status_checked_at":"2026-01-25T13:59:33.728Z","response_time":113,"last_error":"SSL_read: unexpected eof while reading","robots_txt_status":"success","robots_txt_updated_at":"2025-07-24T06:49:26.215Z","robots_txt_url":"https://github.com/robots.txt","online":false,"can_crawl_api":true,"host_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub","repositories_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repositories","repository_names_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/repository_names","owners_url":"https://repos.ecosyste.ms/api/v1/hosts/GitHub/owners"}},"keywords":["automated-machine-learning","kdb","machine-learning","q"],"created_at":"2024-11-07T16:09:58.696Z","updated_at":"2026-01-25T14:34:34.452Z","avatar_url":"https://github.com/KxSystems.png","language":"q","funding_links":[],"categories":[],"sub_categories":[],"readme":"# ⚠️ **This repository is outdated!** ⚠️\n\n---\n\nSince 9th October 2024 (the 4.0.0 release of the ML Toolkit), this project has been merged into the ml toolkit mono-repo. For the latest updates and active development, please visit [https://github.com/KxSystems/ml](https://github.com/KxSystems/ml). \n\nThis repository is preserved only to maintain old links and project history but will no longer be actively maintained.\n\n---\n\n# Automated machine learning in kdb+\n\n[![GitHub release (latest by date)](https://img.shields.io/github/v/release/kxsystems/automl)](https://github.com/kxsystems/automl/releases) [![Build Status](https://travis-ci.com/KxSystems/automl.svg?branch=master)](https://travis-ci.com/KxSystems/automl)\n\n\nThe automated machine learning library described here is built largely on the tools available within the [Machine Learning Toolkit](https://github.com/kxsystems/ml). The purpose of this framework is help you automate the process of applying machine learning techniques to real-world problems. In the absence of expert machine-learning engineers this handles the following processes within a traditional workflow.\n\n- Data preprocessing\n- Feature engineering and feature selection\n- Model selection\n- Hyperparameter Tuning\n- Report generation and model persistence\n\nEach of these steps is outlined in depth within the [documentation](docs).\nThis allows you to understand how decisions are being made and the transformations which their data undergo during the production of the output models.\n\nAt present the machine learning frameworks supported for this are based on:\n\n1. One-to-one feature to target non time-series\n2. FRESH based feature extraction and model production\n3. NLP-based feature creation and word2vec transformation.\n\nThe problems which can be solved by this framework will be expanded over time as will the available functionality.\n\n## Requirements\n\nThe following requirements cover all those needed to run the libraries in the current build of the toolkit.\n\n- [embedPy](https://github.com/KxSystems/embedPy)\n- ML-Toolkit ≥ 3.0.0\n\nA number of Python dependencies also exist for the running of embedPy functions within both the the machine-learning utilities and FRESH libraries. Install  as follows:\n\npip:\n```bash\npip install -r requirements.txt\n```\n\nor via conda:\n```bash\nconda install --file requirements.txt\n```\n\n### Optional requirements for advanced modules\n\nThe above requirements allow you to access the base functionality of AutoML. Additional modules are available – including Sobol sequence hyperparameter search, LaTeX report generation and Keras, PyTorch and NLP models. However, given the large memory requirement for the dependencies of these modules, they are not included in the base functionality and must be installed if required.\n\n**Sobol search** - via pip (see package details [here](https://pypi.org/project/sobol-seq/)):\n```bash\nsobol-seq\n```\n\n**LaTeX** - via conda or pip:\n```bash\npylatex\n```\n\n**Keras** - via conda or pip:\n```bash\nkeras\ntensorflow\n```\n\n**PyTorch** - via conda or pip:\n```bash\ntorch\n```\n\n**Theano** - via conda or pip:\n```bash\ntheano\n```\n\n**NLP**\n\nThe NLP functionality in AutoML requires the [KX NLP library](https://github.com/KxSystems/nlp) along with `gensim` which can be installed using conda or pip.\n\n\n## Installation\n\nPlace the library file in `$QHOME` and load into a q instance using `automl/automl.q`\n\nThis will load all the functions contained within the `.ml` namespace  \n```q\n$q automl/automl.q\nq).automl.loadfile`:init.q\n```\n\n## Documentation\n\n:open_file_folder: [`docs`](docs)\n\n## Status\n\nAutomated machine learning in kdb+ is still in development and is available here as a beta release, further functionality and improvements will be made to the library in the coming months.\n\nAny issues with the framework should be raised in the issues section of this repository. Functionality suggestions or more general questions should be submitted via email to ai@kx.com\n\n","project_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkxsystems%2Fautoml","html_url":"https://awesome.ecosyste.ms/projects/github.com%2Fkxsystems%2Fautoml","lists_url":"https://awesome.ecosyste.ms/api/v1/projects/github.com%2Fkxsystems%2Fautoml/lists"}