Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/kingfengji/gcForest
This is the official implementation for the paper 'Deep forest: Towards an alternative to deep neural networks'
https://github.com/kingfengji/gcForest
deep-forest ensemble-learning machine-learning random-forest
Last synced: about 1 month ago
JSON representation
This is the official implementation for the paper 'Deep forest: Towards an alternative to deep neural networks'
- Host: GitHub
- URL: https://github.com/kingfengji/gcForest
- Owner: kingfengji
- Created: 2017-06-01T06:23:57.000Z (over 7 years ago)
- Default Branch: master
- Last Pushed: 2021-02-04T05:10:47.000Z (almost 4 years ago)
- Last Synced: 2024-04-27T23:58:17.142Z (8 months ago)
- Topics: deep-forest, ensemble-learning, machine-learning, random-forest
- Language: Python
- Homepage: http://lamda.nju.edu.cn/code_gcForest.ashx
- Size: 116 KB
- Stars: 1,309
- Watchers: 89
- Forks: 430
- Open Issues: 36
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
- StarryDivineSky - kingfengji/gcForest
README
Update (Feb 1, 2021)
====================
ATTENTION!
This repository will no longer be maintained, please check our new repository for Deep Forest with GREAT improvements on efficiency.
Details at:
* Repository: https://github.com/LAMDA-NJU/Deep-Forest
* Documentation: https://deep-forest.readthedocs.io/
* Package on PyPI: https://pypi.org/project/deep-forest/
* * *
You can install the newer version of gcForest via pip
```
pip install deep-forest
```
The older version (gcForest v1.1.1) in this repo will only be served as an illustration of the algorithm.
* * *
gcForest v1.1.1 Is Here!
========
This is the official clone for the implementation of gcForest.(The University's webserver is unstable sometimes, therefore we put the official clone here at github)
Package Official Website: http://lamda.nju.edu.cn/code_gcForest.ashx
This package is provided "AS IS" and free for academic usage. You can run it at your own risk. For other purposes, please contact Prof. Zhi-Hua Zhou ([email protected]).
Description: A python 2.7 implementation of gcForest proposed in [1].
A demo implementation of gcForest library as well as some demo client scripts to demostrate how to use the code.
The implementation is flexible enough for modifying the model or fit your own datasets.
Reference: [1] Z.-H. Zhou and J. Feng. Deep Forest: Towards an Alternative to Deep Neural Networks.
In IJCAI-2017. (https://arxiv.org/abs/1702.08835v2 )
Requirements: This package is developed with Python 2.7, please make sure all the dependencies are installed,
which is specified in requirements.txt
ATTN: This package was developed and maintained by Mr.Ji Feng(http://lamda.nju.edu.cn/fengj/) .For any problem concerning the codes, please feel free to contact Mr.Feng.（[email protected]) or open some issues here.
What's NEW:
========
* Scikit-Learn style API
* Some more detailed examples
* GPU support if you want to use xgboost as base estimators
* Support Python 3.5(v1.1.1)
v1.1.1 Python 3.5 Compatibility: The package should work for Python 3.5. Haven't check everything for now but it seems OK.
v1.1.1 Bug Fixed : When doing multiple predictions for the same model, the result will be consistant if you are using pooling layer. The bug only occurs for the scikit-learn APIs and now it is OK for the new api also.
Quick start
=====================
### The simplest way of using the library is as follows:
```
from gcforest.gcforest import GCForest
gc = GCForest(config) # should be a dict
X_train_enc = gc.fit_transform(X_train, y_train)
y_pred = gc.predict(X_test)
```
And that's it. Please see ```/examples/demo_mnist.py``` for a detailed useage.
For order versons AND some more model configs reported in the original paper, please refer:
* [v1.0](https://github.com/kingfengji/gcforest/tree/v1.0)
Supported Based Classifier
=====================
The based classifiers inside gcForest can be any classifiers. This library support the following ones:
* RandomForestClassifier
* XGBClassifier
* ExtraTreesClassifier
* LogisticRegression
* SGDClassifier
To add any classifiers, you could manually add them from ```lib/gcforest/estimators/__init__.py```
Define your own structure
=====================
### Define your model with a single json file.
* IF you only need cascading forest structure. You only need to write one json file. see /examples/demo_mnist-ca.json for a reference.(here -ca is for cascading)
* IF you need both fine grained and cascading forests, you will need to specifying the Finegraind structure of your model also.See /examples/demo_mnist-gc.json for a reference.
* Then, use gcforest.utils.config_utils.load_json to load your json file.
```
config = load_json(your_json_file)
gc = GCForest(config) # that's it
```
and run ```python examples/demo_mnist.py --model examples/yourmodel.json```
### Define your model inside your python scripts.
- You can also define the model structure inside your python script. The model config should be a python dictionary, see the ```get_toy_config``` in ```/examples/demo_mnist.py``` as a reference.
Supported APIs
=====================
* ```fit_transform(X_train,y_train)```
* ```fit_transform(X_train,y_train, X_test=X_test, y_test=y_test)```, this allows you to evaluate your model during training.
* ```set_keep_model_in_mem(False)```. If your RAM is not enough, set this to false. (default is True). IF you set this to False, you would have to use ```fit_transform(X_train,y_train, X_test=X_test, y_test=y_test)``` to evaluate your model.
* ```predict(X_test)```
* ```transform(X_test)```
Supported Data Types
=====================
### If you wish to use Cascade Layer only, the legal data type for X_train, X_test can be:
* 2-D numpy array of shape (n_sampels, n_features).
* 3-D or 4-D numpy array are also acceptable. For example, passing X_train of shape (60000, 28, 28) or (60000,3,28,28) will be automatically be reshape into (60000, 784)/(60000,2352).
### If you need to use Finegraind Layer, X_train, X_test MUST be a 4-D numpy array
* for image-like data. the dimension should be (n_sampels, n_channels, n_height, n_width)
* for sequence-like data. the dimension should be (n_sampels, n_features, seq_len, 1). e.g. For IMDB data, n_features is 1. For music MFCC data, n_features is 13.
Others
=====================
Please read ```examples/demo_mnist.py``` for a detailed walk-through.
package dependencies
========
The package is developed in python 2.7, higher version of python is not suggested for the current version.
run the following command to install dependencies before running the code:
```pip install -r requirements.txt```
Order Versions
=====================
For order versons, please refer:
* [v1.0](https://github.com/kingfengji/gcforest/tree/v1.0)
Happy Hacking.