Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

Awesome Lists | Featured Topics | Projects

https://github.com/tushar-ml/darkneuron

This Library will deal with the implementation of Automatic Deep Learning which can reduce the time and Complexity for non-technical users and Specialists in this field to train their own networks with significant accuracies and can perform Image Classification, Object Detection and hybridization of Models.
https://github.com/tushar-ml/darkneuron

automation-framework classification-model keras keras-tensorflow object-detection python yolov4

Last synced: 9 days ago
JSON representation

This Library will deal with the implementation of Automatic Deep Learning which can reduce the time and Complexity for non-technical users and Specialists in this field to train their own networks with significant accuracies and can perform Image Classification, Object Detection and hybridization of Models.

Awesome Lists containing this project

README 

        
# Welcome to DarkNeuron !



**Dark Neuron**  will deal with implementation of Automatic Deep Learning  which can reduce the time and Complexity for non-technical users to train their own netwroks without Comprimising Accuracies for Classification of Images and Object Detection, most demanding tecniques for **Autonomous Systems** and **Medical Fields**.



> " By augmenting human performance, **AI** has the potential to markedly improve productivity, efficiency, workflow, accuracy and speed, both for physicians and for patients … What I’m most excited about is using the future to bring back the past: to restore the care in healthcare. " -  Eric Topol 



## CONTENTS :



	



 



 -  Classification of Images 

	  

	 - Initialization

	 - Preparation of Data

	 -  Model Creation

	 -  Training

	 -  Prediction

	 -  Visualization of Prediction and Metrics

	

 -  Object Detection (YOLOv4)

	 -  Initialization

	 -  Preparation of Data

	 -  Model Training

	 - Detection 

 -   Further Release 

 -   License 



# Installation 

		



    pip install DarkNeurons



## DarkNeuron Target Audience:

**DarkNeuron** is an Open Source Library . Target Audience  are:



 - All Experienced Data Scientists who wants to increase productivity with reduction in complexities and time.

 -  Professionals in Autonomous and Healthcare Industries to implement high accuracy models for the Production use.

 - Students of Data Science.



Classification of Images



**DarkNeuron Classification** has feature of implementing Pretrained Models on ImageNet Data. Users can directly  train pretrained models or can retrain their own models.  Models provided are:

				



 - InceptionV3

 - Xception

 - ResNet50

 - VGG16

 - VGG19

Further will be added on upcoming releases.



Initialization of Classification Model



Initialization of Classification Model of DarkNeuron requires **working_directory**

as a main argument. It should have models and Raw_Data in it.

It can be Initialized as below:



    from DarkNeurons import Classify_Images

    classify = Classify_Images(working_directory = "Working Directory")

   

Preparation of Data


Preparation of Data for Classification takes place in terms of whether the user wants to Train the Model or Predict from the Model and the Method of Importing Images:



 - **Directory** : To Import the whole folder with Images distributed in respective class folders.

 - **DataFrame** : Having a Dataframe containing Image filenames and corresponding Labels.

 - **Point** : To provide input as an array like :  X_train , Y_train .

 - **Image** : To provide Single Image as an Input (suggested for Prediction Phase)

Let's See each of them with their necessary arguments



 Method: Directory


 Code Syntax: (Continue from above....)



    train,val,labels = classify.Preprocess_the_Image(method = 'directory', train =True,

				num_classes = 2, batch_size = 32, #Default

				target_image_size = (224,224,3) #Default

				model_name = 'InceptionV3',

				user_model = None, #Default,

				training_image_directory = 'Directory_Path

				validation_image_directory = None,

				)



Let's See each argument and their default values:



 - **train**: **False** (for Prediction) and **True** (Training)

 - **num_classes** : No of classes in user data     (Default: 2)

 - **batch_size** : Batch Size of Training Data      (Default:32)

 - **target_image_size** :  Image Input Size used for Creation and Preprocessing of the Input

 - **model_name**: Name of Pretrained Model , **not required when provide user_model name** (Default: None)(**Same for all Method**)

 - **user_model**: user pretrained model , input taken as an model means Load the model using `classify.load_model(user_model_name)(**Same for all Method**)

 - **training_image_directory**: Full Path of Training Image Directory (Must for Training )		(Default: None)

 - **validation_image_directory**: Full Path of Validation Image Directory (Default=None)

 - **test_image_directory**: Test Image Directory path, **only used when train = False**

 

Method: DataFrame


Code Syntax:



    train,val,labels = classify.Preprocess_the_Image(method = 'dataframe', train = True,

				num_classes = 2,batch_size = 32,

				dataframe = df ,

				x_col_name = 'filename',

				y_col_name = 'label',

				image_directory = None,

				split = 0.1 )



Let's Understand the above arguments:



 - **dataframe**: Loaded Dataframe variable ( refer Pandas for defining DataFrame)

 - **x_col_name**: name of Image file names containing column name

 - **y_col_name**: name of Labels containing column name

 - **image_directory**: **Only required if x_col_name has relative path for images**

 - **split**: Spliting of data automatically for validation and Training puroses

 

 
Method: Point


 Code Example....

 



    train,val,labels = classify.Preprocess_the_Image(method = 'point',train = True,

				x_train = x_train,y_train = y_train,

				x_test = x_test,y_test = y_test)



Let's Understand each argument:



 - **x_train**:  Input X variable for Training

 - **y_train**: Target Y variable for Training

 - **x_test**: Input X variable for Testing and Validation

 - **y_test**: Target Y variable for Testing and Validation



Method: Image


Code Syntax:



    test = classify.Preprocess_the_Image(method='image',train = False,

				image_path = 'Path of the Image',

				grayscale=False

				)



 - **image_path**: Path of the Image to predicted

 - **grayscale**: To load the image with grayscale feature



 Model Creation


This Feature takes no argument , but necessary when user provide model_name  .




It will create the full structure of the model  based on the data provided in Prepare the Data function call.



    model = classify.Create_the_Model()



That's it. Model will be created and Generated.

**If you have PreDownloaded weights, then must sure the following:**



 - Put the model in working_directory

 - If Training is **False**: (Names of the model to be save)

	 - InceptionV3 : 'inceptionv3_model.h5'

	 - ResNet50 : 'resnet50_model.h5'

	 - VGG16: 'vgg16_model.h5'

	 - VGG19: 'vgg19_model.h5'

	 - Xception: 'xception_model.h5'

  - If Training is **True**: (Names of the model to be save)

	 - InceptionV3 : 'inceptionv3_notop_model.h5'

	 - ResNet50 : 'resnet50_notop_model.h5'

	 - VGG16: 'vgg16_notop_model.h5'

	 - VGG19: 'vgg19_notop_model.h5'

	 - Xception: 'xception_notop_model.h5'



**Otherwise, it will automatically Download the weights.**



 Model Training



This Feature will be used for Model Training purposes .

 Code Syntax:

	



    model = classify.Train_the_Model(model = model,

				    rebuild = False,

				    train_data_object = train,

				    validation_data_object = train,

				    epochs = 10,

				    optimizers = 'adam',

				    loss = 'binary_crossentropy',

				    fine_tuning = False,

				    layers = 20,

				    metrics = ['accuracy'],

				    validation_steps = 80,

				    steps_per_epoch = 50,

				    callbacks = None

				    )



 - **model**: model created from previous step.

 - **rebuild**: **only**, when model_name provided, set to **True**

 - **train_data_object**: generators get from Prepare the Data function

 - **epochs**: No of Steps for training

 - **optimizer**: Suitable Optimizer for model

 - **loss**: Loss function for model

 - **fine_tuning**: To do Fine_tuning or not 

 - **layers**: **Only required when Fine Tuning set to True**, number of layers from bottom to be trained or to train all layers provide **'all'** argument

 - **metrics**: To be provided as **list**.

 - **callbacks**: To be provided as **list** by the user for early_stopping or Checkpoint.



 Prediction 


This Feature will be used for Prediction from the model on the Test Dataset.


To do this step, First Prepare the Data with train argument set to False and obtain test object from it.



Code Syntax:



    classify.Predict_from_the_Model(labels = labels,

					model = model,

					img = None,

					generator = None,

					top = 5

					)



 - **labels**: Labels provided as List or provided from generated labels in Prepare the data function during training.  (See Above)

 - **model**: Model generated by Training or due to loading user own model.

 - **img**: only if method: image

 - **generator**: Test Data Object generated from Prepare the Data Function call.

 - **top**: Top k predictions for image.



Visualization of Predictions and Metrics



 Metrics Visualization



    classify.Visualize_the_Metrics()



 Prediction Visualization



    classify.Visualize_the_Predictions(number = 20)



 - **number**: No of Images or Predictions to Visualize



 Here Comes the Ending to Classification Part


 Let's move on to Object Detection Part



Object Detection (YOLOv4)



Initialization of Object Detection Model


This Function will take working directory as an argument where the training data is present and weights be present . If no weights are there then it will be downloaded.


If you have predefined yolov4 weights : Named it as --> 'yolov4.weights'

If you have predefined yolov4 model: Named it as --> 'yolov4.h5'



    from DarkNeuron import YOLOv4

    yolo = YOLOv4( working_directory , output_directory)



 Preparation of Data



For this Function, All Images and corressponding labels should be in working_Directory within no sub folder.( For Simplicity, Train directory = Working directory).

This Function take file in three formats and converted them into YOLO Format Automatically:



 - csv

 - xml

 - text files

 

 Code Syntax:

 



    yolo.Prepare_the_Data(file_type,file_path,

			    dataframe_name = None,

			    class_file_name = None

			    )



 - **file_type**: This contain file_type: whether csv, xml, or text_files

 - **file_path**: This contain the path to data directory

 - **dataframe_name**: This should be given as name of csv file in working_directory

 - **class_file_name**: provide name of the  class list as text file in working directory



 Model Training


This Function will be used to Train the model on user custom data set.




There are two process involved :



 - Process_1 : Simple Training

 - Process_2 : After Process_1, Fine tuning (Highly Recommended)



Code Syntax:



    yolo.Train_the_Yolo(model_name = 'yolov4.h5',

			    input_shape = (608,608) #Multiple of 32 required

			    score = 0.5,

			    iou = 0.5,

			    epochs1 = 50, #For Process 1

			    epochs2 = 51, #For Process 2

			    batch_size1 = 32,

			    batch_size2 = 4,

			    validation_split = 0.1,

			    process1 = True,

			    process2 = True

			   )



 - **model_name**: If user have predefine model, can provide the name.

 - **input_shape**: Input Shape for the model .

 - **score**: Score Threshold.

 - **iou**: Intersection Over Union thresholf over training (must change for better accuracy)

 - **epochs1, epochs2**: Epochs for Different Processes described above.

 - **batch_size1, batch_size2**: Batch Size for Differn Purposes

 - **process1, process2**: Process to be Done (Default: True)



 
 Detection 


This Function will be used to detect objects from video and Images.

This Function has following features:



 - **Web Cam Detection** --> It will Detect using webcams and can also be used by Mobile Phone Cameras ( see IPWebCam )

 - **Choose Class** --> You can choose your own prediction classes , means which object to predict which to not. For Example, on COCO dataset , it has 80 labels, then you should pass person to the function, it will detect only person, leave everthing else as it is.

 

 

  Code Synatax:

 



    yolo.Detect(test_folder_name = 'test',

		    model_name = None,

		    cam = False,

		    videopath = 0,

		    classes = [],

		    score = 0.5,

		    tracking = False

		    )



 - **test_folder_name**: Test folder name in working directory ( images and video both, it will detect automatically and take actions according to it)

 - **model_name**: Model name saved in working_directory by Training, otherwise it will take yolov4.h5 by default.

 - **cam**: To enable Web Cam Detection

 - **videopath**: Path to the video to detect

 - **classes**: Selelctive choosing of Classes for Detections (**Provide as List**)

 - **score**:  Threshold of Score for Prediction

 - **tracking**: DeepSort Tracking to be enable or not



 Further Release



 - [ ] Improvement in Tracking 

 - [ ] Artificial Neural Networks user friendly implementation

 - [ ] Visualization of Neural Networks

 

 
License


 MIT  License



**Copyright  (c)  2020  DarkNeuron  Tushar-ml**



Permission  is  hereby  granted,  free  of  charge,  to  any  person  obtaining  a  copy



of  this  software  and  associated  documentation  files  (the  "Software"),  to  deal



in  the  Software  without  restriction,  including  without  limitation  the  rights



to  use,  copy,  modify,  merge,  publish,  distribute,  sublicense,  and/or  sell



copies  of  the  Software,  and  to  permit  persons  to  whom  the  Software  is



furnished  to  do  so,  subject  to  the  following  conditions:



The  above  copyright  notice  and  this  permission  notice  shall  be  included  in  all



copies  or  substantial  portions  of  the  Software.



THE  SOFTWARE  IS  PROVIDED  "AS  IS",  WITHOUT  WARRANTY  OF  ANY  KIND,  EXPRESS  OR



IMPLIED,  INCLUDING  BUT  NOT  LIMITED  TO  THE  WARRANTIES  OF  MERCHANTABILITY,



FITNESS  FOR  A  PARTICULAR  PURPOSE  AND  NONINFRINGEMENT.  IN  NO  EVENT  SHALL  THE



AUTHORS  OR  COPYRIGHT  HOLDERS  BE  LIABLE  FOR  ANY  CLAIM,  DAMAGES  OR  OTHER



LIABILITY,  WHETHER  IN  AN  ACTION  OF  CONTRACT,  TORT  OR  OTHERWISE,  ARISING  FROM,



OUT  OF  OR  IN  CONNECTION  WITH  THE  SOFTWARE  OR  THE  USE  OR  OTHER  DEALINGS  IN  THE SOFTWARE.