https://github.com/tomgeorge1234/whatmakesneuronspicky

Here I use pytorch to understand what drives neuronal selective in deep neural networks trained to perform multiple tasks simultaneously
https://github.com/tomgeorge1234/whatmakesneuronspicky

Last synced: about 2 months ago
JSON representation

Here I use pytorch to understand what drives neuronal selective in deep neural networks trained to perform multiple tasks simultaneously

• Host: GitHub
• URL: https://github.com/tomgeorge1234/whatmakesneuronspicky
• Owner: TomGeorge1234
• Created: 2020-04-26T20:59:20.000Z (about 5 years ago)
• Default Branch: master
• Last Pushed: 2021-04-11T15:05:47.000Z (about 4 years ago)
• Last Synced: 2025-02-13T23:34:55.797Z (4 months ago)
• Language: Jupyter Notebook
• Size: 30.4 MB
• Stars: 0
• Watchers: 1
• Forks: 0
• Open Issues: 0
• Metadata Files:
  • Readme: README.md

Awesome Lists containing this project

README

        
# WhatMakesNeuronsPicky

An important question in neuroscience is what determines whether neurons to learn "selective" representations (where they are important to one and only one task aspect, for example visual cortex) over "mixed-selective" ones (where they are important to multiple tasks or tasks aspects, for example PFC). 

Is it architecture, learning algorithm, or task structure which matters most? 

In this project I approach this question computationally by training artificial neural networks to learn multiple tasks an analysing neuronal selectivity. I find all three factors play a roll in determining whether neurons eventually become selective or mixed-selective.

Full report takes the form of [WhatMakeNeuronsPicky.ipynb](./WhatMakeNeuronsPicky.ipynb), or see also  [finalPresetationSlides.pdf](./finalPresentationSlides.pdf)

## Selected figures: 

Figure 1: 

![](./Figures/readme1.png)

Figure 2: 

![](./Figures/readme2.png)

Figure 3: 

![](./Figures/readme3.png)

## Conclusions: 

* Networks exploit task similarity, learning mixed-selective representation when the tasks are slight variants of each other (figure 1b).

* In the absence of other constraints, networks divide into distinct subnetworks (of selective neurons) when the tasks they must learn are highly dissimilar. Each subnetwork is responsible for one of the tasks (figure 1a).  

* When networks must learn many different tasks, learning selective representations is an optimal policy however this is unstable against overwriting when tasks are learned sequentially (figure 3). 

## List of experiments performs: 

* A network learning two dissimilar tasks (figure 1a)

* A network learns to similar tasks (figure 1b)

* A neuronally-constrained network learns two different tasks

* Which-task context info isn't provided until the penultimate layer

* A network learns two tasks sequentially vs simultaneously

* A Network learns two tasks but training biased towards one of the tasks (this is interesting!)

* A large CNN learns 4 overlapping MNIST-based tasks (figures 2 and 3)