Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/DataCanvasIO/Hypernets

A General Automated Machine Learning framework to simplify the development of End-to-end AutoML toolkits in specific domains.
https://github.com/DataCanvasIO/Hypernets

autodl automl enas evolutionary-algorithms hyperparameter-optimization hyperparameter-tuning keras mcts monte-carlo-tree-search nas nasnet neural-architecture-search reinforcement-learning

Last synced: 3 months ago
JSON representation

A General Automated Machine Learning framework to simplify the development of End-to-end AutoML toolkits in specific domains.

Awesome Lists containing this project

README 

        





[![Python Versions](https://img.shields.io/pypi/pyversions/hypernets.svg)](https://pypi.org/project/hypernets)

[![Downloads](https://pepy.tech/badge/hypernets)](https://pepy.tech/project/hypernets)

[![PyPI Version](https://img.shields.io/pypi/v/hypernets.svg)](https://pypi.org/project/hypernets)



## We Are Hiring！

Dear folks, we are offering challenging opportunities located in Beijing for both professionals and students who are keen on AutoML/NAS. Come be a part of DataCanvas! Please send your CV to [email protected]. (Application deadline: TBD.)  



## Hypernets: A General Automated Machine Learning Framework

Hypernets is a general AutoML framework, based on which it can implement automatic optimization tools for various machine learning frameworks and libraries, including deep learning frameworks such as tensorflow, keras, pytorch, and machine learning libraries like sklearn, lightgbm, xgboost, etc.

It also adopted various state-of-the-art optimization algorithms, including but not limited to evolution algorithm, monte carlo tree search for single objective optimization and multi-objective optimization algorithms such as MOEA/D,NSGA-II,R-NSGA-II.

We introduced an abstract search space representation, taking into account the requirements of hyperparameter optimization and neural architecture search(NAS), making Hypernets a general framework that can adapt to various automated machine learning needs. As an abstraction computing layer, tabular toolbox, has successfully implemented in various tabular data types: pandas, dask, cudf, etc.  



## Overview

### Conceptual Model








### Illustration of the Search Space 








## What's NEW !



- **New feature:** [Multi-objectives optimization support](https://hypernets.readthedocs.io/en/latest/searchers.html#multi-objective-optimization)

- **New feature:** [Performance and model complexity measurement metrics](https://github.com/DataCanvasIO/HyperGBM/blob/main/hypergbm/examples/66.Objectives_example.ipynb)

- **New feature:** [Distributed computing](https://hypergbm.readthedocs.io/en/latest/example_dask.html) and [GPU acceleration](https://hypergbm.readthedocs.io/en/latest/example_cuml.html) base on computational abstraction layer



## Installation



### Conda



Install Hypernets with `conda` from the channel *conda-forge*:



```bash

conda install -c conda-forge hypernets

```



### Pip

Install Hypernets with different options:



* Typical installation:

```bash

pip install hypernets

```



* To run Hypernets in JupyterLab/Jupyter notebook, install with command:

```bash

pip install hypernets[notebook]

```



* To run Hypernets in distributed Dask cluster, install with command:

```bash

pip install hypernets[dask]

```



* To support dataset with simplified Chinese in feature generation, 

  * Install `jieba` package before running Hypernets.

  * OR install Hypernets with command:

```bash

pip install hypernets[zhcn]

```



* Install all above with one command:

```bash

pip install hypernets[all]

```



To ***Verify*** your installation:

```bash

python -m hypernets.examples.smoke_testing

```



## Related Links



* [A Brief Tutorial for Developing AutoML Tools with Hypernets](https://github.com/BochenLv/knn_toy_model/blob/main/Introduction.md)



## Documents

* [Overview](https://hypernets.readthedocs.io/en/latest/overview.html)

* [QuickStart](https://hypernets.readthedocs.io/en/latest/quick_start.html)

* [Search Space](https://hypernets.readthedocs.io/en/latest/search_space.html)

* [Searcher](https://hypernets.readthedocs.io/en/latest/searchers.html)

* [HyperModel](https://hypernets.readthedocs.io/en/latest/hypermodels.html)

* [Experiment](https://hypernets.readthedocs.io/en/latest/experiment.html)

## Neural Architecture Search

* [Define A DNN Search Space](https://hypernets.readthedocs.io/en/latest/nas.html#define-a-dnn-search-space)

* [Define A CNN Search Space](https://hypernets.readthedocs.io/en/latest/nas.html#define-a-cnn-search-space)

* [Define An ENAS Micro Search Space](https://hypernets.readthedocs.io/en/latest/nas.html#define-an-enas-micro-search-space)



## Hypernets related projects

* [Hypernets](https://github.com/DataCanvasIO/Hypernets): A general automated machine learning (AutoML) framework.

* [HyperGBM](https://github.com/DataCanvasIO/HyperGBM): A full pipeline AutoML tool integrated various GBM models.

* [HyperDT/DeepTables](https://github.com/DataCanvasIO/DeepTables): An AutoDL tool for tabular data.

* [HyperTS](https://github.com/DataCanvasIO/HyperTS): A full pipeline AutoML&AutoDL tool for time series datasets.

* [HyperKeras](https://github.com/DataCanvasIO/HyperKeras): An AutoDL tool for Neural Architecture Search and Hyperparameter Optimization on Tensorflow and Keras.

* [HyperBoard](https://github.com/DataCanvasIO/HyperBoard): A visualization tool for Hypernets.

* [Cooka](https://github.com/DataCanvasIO/Cooka): Lightweight interactive AutoML system.



![DataCanvas AutoML Toolkit](https://raw.githubusercontent.com/DataCanvasIO/Hypernets/master/docs/source/images/DAT_latest.png)



## Citation



If you use Hypernets in your research, please cite us as follows:



   Jian Yang, Xuefeng Li, Haifeng Wu. 

   **Hypernets: A General Automated Machine Learning Framework.** https://github.com/DataCanvasIO/Hypernets. 2020. Version 0.2.x.



BibTex:



```

@misc{hypernets,

  author={Jian Yang, Xuefeng Li, Haifeng Wu},

  title={{Hypernets}: { A General Automated Machine Learning Framework}},

  howpublished={https://github.com/DataCanvasIO/Hypernets},

  note={Version 0.2.x},

  year={2020}

}

```



## DataCanvas

Hypernets is an open source project created by [DataCanvas](https://www.datacanvas.com/).