Ecosyste.ms: Awesome

An open API service indexing awesome lists of open source software.

https://github.com/njcpe/neurosurgeon

Last synced: 2 months ago
JSON representation

Host: GitHub
URL: https://github.com/njcpe/neurosurgeon
Owner: njcpe
Created: 2019-10-10T00:41:25.000Z (over 4 years ago)
Default Branch: multiImageAdapted
Last Pushed: 2019-10-10T01:27:03.000Z (over 4 years ago)
Last Synced: 2024-01-28T00:35:43.031Z (5 months ago)
Language: Jupyter Notebook
Size: 83.4 MB
Stars: 12
Watchers: 1
Forks: 5
Open Issues: 0
Metadata Files:
- Readme: README.md

Lists

awesome-edge-computing - Neurosurgeon

README

        ## Neurosurgeon Implementation (Single Image Adaptation)

We aim to use UDP socket programming as well as the Tensorflow API to measure the composite end-to-end delay of offloading Image Classification. 

## Motivation

This testbench is being used as part of ongoing research into Machine Learning Task Partitioning by Noah Johnson, Xiangqi Kong, and Dr. Bin Li of the University of Rhode Island Smart Networking and Computing Lab.

## Tech/framework used

Built with

- [TensorFlow](https://www.tensorflow.org/)

## To Do List

- [ ] Adapt to use UDP instead of TCP (TCP is too slow)

## Environment Installation / Setup - TensorFlow CPU

  #### Windows

  - Install [Anaconda](https://www.anaconda.com/distribution/) and add it to `$PATH` if you dont already have it. 

  - Install Tensorflow CPU and all dependencies:

    ```

    conda create --name tf python=3.5

    activate tf

    conda install scipy

    pip install tensorflow

    ```

  - If everything is installed correctly then this test code

    ```Python

    >> import tensorflow as tf

    >> hello = tf.constant('Hello, TensorFlow!')

    >> sess = tf.Session()

    >> print(sess.run(hello))

    ```

    Should return

    ```Python

    Hello, TensorFlow!

    ```

  #### Linux

  - Install [Anaconda](https://www.anaconda.com/distribution/) and add it to `$PATH` if you dont already have it. 

  - Install Tensorflow CPU and all dependencies:

    ```

    conda create --name tf python=3.5

    source activate tf

    conda install scipy

    pip install tensorflow

    ```

  - If everything is installed correctly then this test code

    ```Python

    >> import tensorflow as tf

    >> hello = tf.constant('Hello, TensorFlow!')

    >> sess = tf.Session()

    >> print(sess.run(hello))

    ```

    Should return

    ```Python

    Hello, TensorFlow!

    ```

## Environment Installation / Setup - TensorFlow + NVIDIA GPU

  #### Disclaimer

  Setting Up TensorFlow GPU will take a long time, and there are no guarantees. The code will run much better on the GPU Version, however installation of TF-GPU on Windows is tedious at best and maddening at worst. **Use this guide at your own risk.** 

  

  #### Windows

  - Ensure you have [Microsoft C/C++ Build Tools 2015](https://www.microsoft.com/en-us/download/details.aspx?id=48159) installed. If you have Visual Studio 2017 installed, these tools *are not* installed by default. Make sure these are in your `$PATH` as well. 

  - Ensure that your [NVIDIA Base Drivers](http://www.nvidia.com/Download/index.aspx) are up to date. At time of writing, the current driver set is Release 390. Reboot after this step.

  - Install the [NVIDIA Cuda Toolkit](https://developer.nvidia.com/cuda-90-download-archive?target_os=Windows&target_arch=x86_64). **This must be version 9.0, version 9.1 is not yet supported.** Add the bin folder and enclosing CUDA folder to `$PATH`.

  - Install [CuDNN](https://developer.nvidia.com/cudnn) **version 7.0** and add that to `$PATH`. 

  - Reboot. If you got all of this installed correctly, the tedious part is over.

  - Install [Anaconda](https://www.anaconda.com/distribution/) and add it to `$PATH` if you dont already have it. 

  - Install Tensorflow GPU and all dependencies:

    ```

    conda create --name tf-gpu python=3.5

    activate tf-gpu

    conda install scipy

    pip install tensorflow-gpu

    ```

  - If everything is installed correctly then this test code

    ```Python

    >> import tensorflow as tf

    >> hello = tf.constant('Hello, TensorFlow!')

    >> sess = tf.Session()

    >> print(sess.run(hello))

    ```

    Should return

    ```Python

    Hello, TensorFlow!

    ```

  - Go take a walk because you're done and you deserve it.

  

  #### Linux

  

  - See [this](https://medium.com/codezillas/step-by-step-guide-to-install-tensorflow-gpu-on-ubuntu-18-04-lts-6feceb0df5c0) guide, it does a great job of explaining the protocol for installing.

   

  

## Project Dependencies (Need to update this part still)

A full list of dependencies can be found in [env.yml](https://github.com/njohnsoncpe/facialRecognition/blob/master/env.yml). [Anaconda maintains](https://conda.io/docs/commands/env/conda-env-create.html) that an equivalent enviroment to mine can be built using: 

```

conda env create -f env.yml -n tf-gpu 

```

I have been unable to independenly verifiy this functionality. If anyone finds success with this method, let me know and I will update this to reflect any new information.

## Credits

Inspired by [TensorFlow Model Zoo](https://github.com/tensorflow/models/blob/master/research/object_detection/g3doc/detection_model_zoo.md)

## License

MIT License. Provided AS IS.

MIT © [Noah Johnson](https://njohnsoncpe.github.io)