Ecosyste.ms: Awesome
An open API service indexing awesome lists of open source software.
https://github.com/cbovar/ConvNetSharp
Deep Learning in C#
https://github.com/cbovar/ConvNetSharp
ai convolution csharp machine-learning neural-network
Last synced: 23 days ago
JSON representation
Deep Learning in C#
- Host: GitHub
- URL: https://github.com/cbovar/ConvNetSharp
- Owner: cbovar
- License: mit
- Created: 2015-05-29T13:53:47.000Z (about 9 years ago)
- Default Branch: master
- Last Pushed: 2022-12-08T03:44:20.000Z (over 1 year ago)
- Last Synced: 2024-05-30T05:30:33.070Z (24 days ago)
- Topics: ai, convolution, csharp, machine-learning, neural-network
- Language: C#
- Homepage:
- Size: 15.7 MB
- Stars: 462
- Watchers: 49
- Forks: 110
- Open Issues: 23
-
Metadata Files:
- Readme: README.md
- Contributing: CONTRIBUTING.md
- License: LICENSE
Lists
- awesome - cbovar/ConvNetSharp - Deep Learning in C# (C\#)
- awesome-stars - cbovar/ConvNetSharp - Deep Learning in C# (C# #)
- awesome-dotnet-machine-learning - ConvNetSharp
- awesome-csharp - ConvNetSharp - C# port of ConvNetJS. You can use ConvNetSharp to train and evaluate convolutional neural networks (CNN). (Cheat sheets / Libraries)
README
-----------------
[](https://ci.appveyor.com/project/cbovar/convnetsharp) [](https://www.nuget.org/packages/Cognitio.ConvNetSharp.Core/) [](https://www.nuget.org/packages/Cognitio.ConvNetSharp.Core/)
# ConvNetSharp
Started initially as C# port of [ConvNetJS](https://github.com/karpathy/convnetjs). You can use ConvNetSharp to train and evaluate convolutional neural networks (CNN).
Thank you very much to the original author of ConvNetJS (Andrej Karpathy) and to all the contributors!
ConvNetSharp relies on [ManagedCuda](https://github.com/kunzmi/managedCuda) library to acces NVidia's CUDA
### 3 ways to create neural network
| Core.Layers | Flow.Layers | Computation graph |
| ------------- | ------------- | ------------- |
| No computation graph | Layers that create a computation graph behind the scene | 'Pure flow' |
| Network organised by stacking layers | Network organised by stacking layers | 'Ops' connected to each others. Can implement more complex networks |
|  |  |  |
| E.g. [MnistDemo](https://github.com/cbovar/ConvNetSharp/tree/master/Examples/MnistFlowGPUDemo) | E.g. [MnistFlowGPUDemo](https://github.com/cbovar/ConvNetSharp/tree/master/Examples/MnistDemo.Flow.GPU) or [Flow version of Classify2DDemo ](https://github.com/cbovar/ConvNetSharp/blob/master/Examples/FlowDemo/Classify2DDemo.cs) | E.g. [ExampleCpuSingle](https://github.com/cbovar/ConvNetSharp/blob/master/Examples/FlowDemo/ExampleCPUSingle.cs) |
## Example Code
Here's a minimum example of defining a **2-layer neural network** and training
it on a single data point:
```c#
using System;
using ConvNetSharp.Core;
using ConvNetSharp.Core.Layers.Double;
using ConvNetSharp.Core.Training.Double;
using ConvNetSharp.Volume;
using ConvNetSharp.Volume.Double;
namespace MinimalExample
{
internal class Program
{
private static void Main()
{
// specifies a 2-layer neural network with one hidden layer of 20 neurons
var net = new Net();
// input layer declares size of input. here: 2-D data
// ConvNetJS works on 3-Dimensional volumes (width, height, depth), but if you're not dealing with images
// then the first two dimensions (width, height) will always be kept at size 1
net.AddLayer(new InputLayer(1, 1, 2));
// declare 20 neurons
net.AddLayer(new FullyConnLayer(20));
// declare a ReLU (rectified linear unit non-linearity)
net.AddLayer(new ReluLayer());
// declare a fully connected layer that will be used by the softmax layer
net.AddLayer(new FullyConnLayer(10));
// declare the linear classifier on top of the previous hidden layer
net.AddLayer(new SoftmaxLayer(10));
// forward a random data point through the network
var x = BuilderInstance.Volume.From(new[] { 0.3, -0.5 }, new Shape(2));
var prob = net.Forward(x);
// prob is a Volume. Volumes have a property Weights that stores the raw data, and WeightGradients that stores gradients
Console.WriteLine("probability that x is class 0: " + prob.Get(0)); // prints e.g. 0.50101
var trainer = new SgdTrainer(net) { LearningRate = 0.01, L2Decay = 0.001 };
trainer.Train(x, BuilderInstance.Volume.From(new[] { 1.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0, 0.0 }, new Shape(1, 1, 10, 1))); // train the network, specifying that x is class zero
var prob2 = net.Forward(x);
Console.WriteLine("probability that x is class 0: " + prob2.Get(0));
// now prints 0.50374, slightly higher than previous 0.50101: the networks
// weights have been adjusted by the Trainer to give a higher probability to
// the class we trained the network with (zero)
}
}
}
```
## Fluent API (see [FluentMnistDemo](https://github.com/cbovar/ConvNetSharp/tree/master/Examples/FluentMnistDemo))
```c#
var net = FluentNet.Create(24, 24, 1)
.Conv(5, 5, 8).Stride(1).Pad(2)
.Relu()
.Pool(2, 2).Stride(2)
.Conv(5, 5, 16).Stride(1).Pad(2)
.Relu()
.Pool(3, 3).Stride(3)
.FullyConn(10)
.Softmax(10)
.Build();
```
## GPU
To switch to GPU mode:
* add '`GPU`' in the namespace: `using ConvNetSharp.Volume.`**GPU**`.Single;` or `using ConvNetSharp.Volume.`**GPU**`.Double;`
* add `BuilderInstance.Volume = new ConvNetSharp.Volume.GPU.Single.VolumeBuilder();` or `BuilderInstance.Volume = new ConvNetSharp.Volume.GPU.Double.VolumeBuilder();` at the beggining of your code
You must have [CUDA version 10.0](https://developer.nvidia.com/cuda-91-download-archivehttps://developer.nvidia.com/cuda-10.0-download-archive?target_os=Windows&target_arch=x86_64&target_version=10) and [cuDNN v7.6.4 (September 27, 2019), for CUDA 10.0](https://developer.nvidia.com/rdp/cudnn-archive) installed.
cuDNN bin path should be referenced in the PATH environment variable.
Mnist GPU demo [here](https://github.com/cbovar/ConvNetSharp/tree/master/Examples/MnistDemo.GPU)
## Save and Load Network
### Serialization in ConvNetSharp.Core
```c#
using ConvNetSharp.Core.Serialization;
[...]
// Serialize to json
var json = net.ToJson();
// Deserialize from json
Net deserialized = SerializationExtensions.FromJson(json);
```
### Serialization in ConvNetSharp.Flow
```c#
using ConvNetSharp.Flow.Serialization;
[...]
// Serialize to two files: MyNetwork.graphml (graph structure) / MyNetwork.json (volume data)
net.Save("MyNetwork");
// Deserialize from files
var deserialized = SerializationExtensions.Load("MyNetwork", false)[0]; // first element is the network (second element is the cost if it was saved along)
```