https://github.com/shlizee/NeuroAI
NeuroAI-UW seminar, a regular weekly seminar for the UW community, organized by NeuroAI Shlizerman Lab.
https://github.com/shlizee/NeuroAI
ai cvpr data-science deep-learning eccv icml neural-networks neurips neuroscience-methods recurrent-neural-networks sfn
Last synced: about 1 month ago
JSON representation
NeuroAI-UW seminar, a regular weekly seminar for the UW community, organized by NeuroAI Shlizerman Lab.
- Host: GitHub
- URL: https://github.com/shlizee/NeuroAI
- Owner: shlizee
- Created: 2020-08-07T16:29:29.000Z (almost 5 years ago)
- Default Branch: master
- Last Pushed: 2025-03-07T18:42:28.000Z (3 months ago)
- Last Synced: 2025-03-07T19:32:00.414Z (3 months ago)
- Topics: ai, cvpr, data-science, deep-learning, eccv, icml, neural-networks, neurips, neuroscience-methods, recurrent-neural-networks, sfn
- Homepage:
- Size: 254 KB
- Stars: 53
- Watchers: 7
- Forks: 4
- Open Issues: 1
-
Metadata Files:
- Readme: README.md
Awesome Lists containing this project
README
# University of Washington NeuroAI Seminar
Welcome to NeuroAI-UW seminar, a regular weekly seminar for UW community organized by [NeuroAI Shlizerman Lab](http://faculty.washington.edu/shlizee/).
Meetings are currently held hybridly (Summer \& Fall 2020, Winter \& Spring \& Fall 2021-2023, Winter 2024). Contact us if you would like to join!
UW students can enroll into designated courses: AMATH 500L or EE 598F to participate in the seminarial activities.
New: We will be positing some of the invited visitors talks in NeuroAI YouTube playlist.
## 2025 Winter Schedule
This quarter, our lab is focusing on two Hackathon projects in AI and Neuroscience. Inspired by papers we've studied in previous quarters, these projects aim to bridge the gap between theoretical knowledge and practical implementation.
We host a weekly seminar to discuss relevant research and share progress updates from each group.
- **Time:** Every Friday, 11:00 AM - 12:00 PM PDT
- **Format:** Presentations and discussions led by members of each group
Hackathon projects leads:
- **AI:** Xiulong Liu, Yang Zheng
- **Neuroscience:** Trung Le, Jimin Kim
| Date | Paper/Activity | Student Presenter |
|-------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------------------|
| 01/24/2025
01/31/2025 | Hackathon project brainstorming:
1. Benchmarking Performance of existing Audio-Visual LLMs
2. NeuroCodec | All members |
| 02/07/2025 | 1. [AV LLM: VideoLLaMA 2 Advancing Spatial-Temporal Modeling and Audio Understanding in Video-LLMs](https://arxiv.org/pdf/2406.07476)
2. [High Fidelity Neural Audio Compression](https://arxiv.org/abs/2210.13438) | 1. Xiulong Liu, Yang Zheng, Zijun Cui, Jinlin Xiang, James Hazelden, Mingfei Chen, Hao Fang
2. Trung Le, Brian Deng, Saba Heravi, Jimin Kim, Bailey Hall, Jingyuan Li |
| 02/14/2025 | 1. [Thinking in Space: How Multimodal LLMs see, Remember, and Recall Spaces](https://arxiv.org/abs/2412.14171)
2. [Towards a “universal translator” for neural dynamics at single-cell, single-spike resolution](https://arxiv.org/pdf/2407.14668) | 1. Xiulong Liu, Yang Zheng, Zijun Cui, Jinlin Xiang, James Hazelden, Mingfei Chen, Hao Fang
2. Trung Le, Brian Deng, Saba Heravi, Jimin Kim, Bailey Hall, Jingyuan Li |
| 02/21/2025 | Hackathon Preparation Meeting | All members |
| 02/28/2025 | One-day Hackathon | All members |
| 03/07/2025 | Guest Speaker [Alexandre Défossez](https://ai.honu.io) (Chief Exploration Officer at Kyutai)
| |
| 03/14/2025 | Guest Speaker [Jihan Yang](https://jihanyang.github.io) (postdoctoral associate at NYU Courant) 
| |
## 2024 Fall Schedule
This quarter focuses on exploring and advancing research in three interconnected domains: AI, NeuroAI, and Neuroscience. We are passionate about understanding intelligence from both artificial and biological perspectives, bridging the gap between technology and science.
We host a weekly seminar where we discuss cutting-edge research from these fields.
We host a weekly seminar to discuss cutting-edge research and foster collaboration.
- **Time:** Every Friday, 11:00 AM - 12:00 PM PDT
- **Format:** Presentations and discussions led by domain experts or lab members
Domain Leads
- **AI:** Yang Zheng
- **NeuroAI:** Trung Le
- **Neuroscience:** Jimin Kim
| Date | Paper/Activity | Student Presenter |
|-------------------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|--------------------------------------------------------------------------------------------|
| 10/25/2024 | [Brain-to-text Decoding with Context-aware Neural Representations and Large Language Models](https://arxiv.org/abs/2411.10657) | Eric Martin, Jinlin Xiang, Mingfei Chen, Ted Zhong, Xiulong Liu, Yang Zheng, Yuan Gao |
| 11/01/2024 | [The FlyWire connectome: neuronal wiring diagram of a complete fly brain](https://www.nature.com/immersive/d42859-024-00053-4/index.html) | Trung Le, Jingyuan Li, Hao Fang, James Hazelden, Keith Phou, Bailey Hall |
| 11/08/2024 & 11/15/2024 | [Tell What You Hear From What You See - Video to Audio Generation Through Text](https://arxiv.org/abs/2411.05679) | Jimin Kim, Saba Heravi, Victoria Pierce, Weijun Liu, Jiawen Liu, Deeksha Prabhu, Dongyi Yang |
| 11/22/2024 | Guest Speaker [Sven Dorkenwald](https://alleninstitute.org/person/sven-dorkenwald/) (Allen Institute)
| |
| 11/29/2024 | Thanksgiving Break | |
| 12/06/2024 | Guest Speaker [Xiulong Liu](https://dragonliu1995.github.io) (UW NeuroAI) 
| |
| 12/06/2024 | Guest Speaker [Francis Robert Willett](https://www.braingate.org/team/frank-willet-2/) (Neural Prosthetics Translational Laboratory at Stanford University) 
| |
## 2024 Spring Schedule
This quarter, we review impactful alternative architectures recently proposed in the NeuroAI literature. The seminar is held every Friday from 11:00 am - noon PDT in a hybrid manner.
| Date | Paper/Activity | Student Presenter|
|----------------|---------------------|----------|
| 03/29/2024 | Brainstorming Meeting & Final Presentations on NeuroAI and LLMs (Team 1, 2) | Mingfei Chen, Jingyuan Li, Frenda Lin, Trung Le, Kun Su, Yang Zheng, Jinlin Xiang, Jimin Kim, Xiulong Liu, Eunki Chung, Rahul Biswas |
| 04/05/2024 | Organizational & Intro Meeting & Final Presentations on NeuroAI and LLMs (Team 3) | Saba Heravi, James Hazelden, Ari Asarch, Yoonseo Orite, Kavya Balasubramanian|
| 04/12/2024 | [Energy Transformer](https://proceedings.neurips.cc/paper_files/paper/2023/hash/57a9b97477b67936298489e3c1417b0a-Abstract-Conference.html) | James Hazelden, Saba Heravi, Yang Zheng |
| 04/19/2024 | State Space Models: [Mamba: Linear-Time Sequence Modeling with Selective State Spaces](https://arxiv.org/abs/2312.00752) & [Efficiently Modeling Long Sequences with Structured State Spaces](https://arxiv.org/abs/2111.00396) | Victoria Pierce, Mingfei Chen, and Xiulong Liu |
| 04/26/2024 | RNN Alternatives: [RWKV: Reinventing RNNs for the Transformer Era](https://arxiv.org/abs/2305.13048) & [Hierarchically Gated Recurrent Neural Network for Sequence Modeling](https://arxiv.org/abs/2311.04823)| Jinlin Xiang, Jesse Owens, and Jimin Kim |
| 05/03/2024 | [MLP Mixer: An All MLP Architecture for Vision](https://arxiv.org/abs/2105.01601) & [The Forward-Forward Algorithm](https://arxiv.org/abs/2212.13345) | Adithya Gowda Baragur, Seb Schwab, and Trung Le |
| 05/10/2024 | [Building transformers from neurons and astrocytes](https://www.pnas.org/doi/epdf/10.1073/pnas.2219150120) & [NISQ QNN: Classification with Quantum Neural Networks on Near Term Processors](https://arxiv.org/abs/1802.06002) | Ian Quah, Sean Robert Gamer, and Jingyuan Li |
## 2024 Winter Schedule
Thanks Jinlin, Mingfei and Saba for being Student Organizers.
In this quarter, we will prepare seminars on 3 critical topics related to NeuroAI and LLMs (Large Language Models). The seminar will be held every Friday 11:00am - 12:00pm (PST) hybridly.
| Topic | Student Presenter |
|----------------|----------|
| LLM-Enhanced Neural Decoding |Mingfei Chen, Jingyuan Li, Frenda Lin, Trung Le, Kun Su, Yang Zheng |
| Domain Adaptation of Pre-trained LLM for Research |Jinlin Xiang, Jimin Kim, Xiulong Liu, Eunki Chung, Rahul Biswas |
| Interpretation of Neural Networks in LLMs | Saba Heravi, James Hazelden, Ari Asarch, Yoonseo Orite, Kavya Balasubramanian|
| Date | Paper/Activity | Student Presenter|
|----------------|---------------------|----------|
| 1/12/2024 | Organizational & Intro Meeting on NeuroAI and LLMs | |
| 1/19/2024 |[Decoding Speech Perception from Non-Invasive Brain Recordings](https://www.nature.com/articles/s42256-023-00714-5) |Mingfei Chen, Jingyuan Li, Frenda Lin, Trung Le, Kun Su, Yang Zheng |
| 1/26/2024 |[Large Language Models Struggle to Learn Long-Tail Knowledge]( https://proceedings.mlr.press/v202/kandpal23a/kandpal23a.pdf) |Jinlin Xiang, Jimin Kim, Xiulong Liu, Eunki Chung, Rahul Biswas |
| 2/02/2024 |[Hopfield Networks is All You Needs](https://arxiv.org/abs/2008.02217) | Saba Heravi, James Hazelden, Ari Asarch, Yoonseo Orite, Kavya Balasubramanian|
| 2/09/2024 |**Guest Speaker** [Jean-Rémi King](https://kingjr.github.io/) (École Normale Supérieure / Meta AI)
| |
| 2/16/2024 |**Guest Speaker** [Nikhil Kandpal](https://nkandpa2.github.io/) (University of Toronto)
| |
| 2/23/2024 | Guest Speaker: TBA | |
## 2023 Fall Schedule
In this quarter, we will continue to present tutorials and organize discussions on 6 critical topics related to NeuroAI.
| Topic | Student Presenter |
|----------------|----------|
| Deep Learning Programming Tools for NeuroAI |Yang Zheng, Jazlin Taylor |
| Design, Programing and Publishing OpenSource Code for NeuroAI |Jinlin Xiang, Trung Le, Jimin Kim |
| Data and Benchmarking Practices in NeuroAI |Amisha Himanshu Somaiya, Trung Le |
| Neuro, AI and NeuroAI Ethics |Rahul Biswas, Jingyuan Li |
| Hardware Acceleration for DL and NeuroAI|Saba Heravi, James Hazelden |
| LLMs and Their Relation to NeuroAI |Mingfei Chen, Xiulong Liu, Pavan Kumar Anand |
## 2023 Spring Schedule
In this quarter, we will prepare and present tutorials on 6 critical topics related to NeuroAI.
| Topic | Student Presenter |
|----------------|----------|
| Deep Learning Programming Tools for NeuroAI |Astitwas S. Lathe, Yang Zheng, Wenxuan Hu |
| Design, Programing and Publishing OpenSource Code for NeuroAI |Jimin Kim, Jinlin Xiang, Trung Le |
| Data and Benchmarking Practices in NeuroAI | Ayush Singh, Chunqing Cao |
| Neuro, AI and NeuroAI Ethics |Rahul Biswas, Atharva Mattam, James Hazelden |
| Hardware Acceleration for DL and NeuroAI| Saba Heravi, Ruihong Yin, Carter Rowell |
| LLMs and Their Relation to NeuroAI | Xiulong Liu, Mingfei Chen, Jingyuan Li |
## 2023 Winter Schedule
In this quarter, we will prepare and present tutorials on 5 critical topics related to NeuroAI.
| Topic | Student Presenter |
|----------------|----------|
| Deep Learning Programming Tools for NeuroAI |Sadjyot Gangolli, Mingfei Chen, Xiulong Liu, Hanna Lee |
| Design, Programing and Publishing OpenSource Code for NeuroAI |Jimin Kim, Kun Su, Pranav Kamath, Jingyuan Li|
| Data and Benchmarking Practices in NeuroAI |Jinlin Xiang, Trung Le, Ayush Singh |
| Neuro, AI and NeuroAI Ethics |Rahul Biswas, Ryan Vogt, Xinwen Liu |
| Hardware Acceleration for DL and NeuroAI| Yang Zheng, James Hazelden, Saba Heravi |
## 2022 Fall Schedule
Thanks Mingfei and Jingyuan for being Student Organizer.
| Date | Paper/Activity | Student Presenter |
|----------------|-----------|----------|
| 10/07/2022 | Organizational & Intro Meeting on Energy Based Models | |
| 10/14/2022 |[A Path Towards Autonomous Machine Intelligence](https://openreview.net/pdf?id=BZ5a1r-kVsf) | James Hazelden, Saba Heravi, Andrew Line, Yang Zheng. |
| 10/21/2022 |[The surprising effectiveness of representation learning for visual imitation](https://arxiv.org/abs/2112.01511) | Hanna Lee, Jimin Kim |
| 10/28/2022 |[Self-supervised learning of pretext-invariant representations](https://arxiv.org/abs/1912.01991) | Jinlin Xiang, Trung Le |
| |[Barlow twins: Self-supervised learning via redundancy reduction](https://arxiv.org/abs/2103.03230) |Raphael Bechtold, Ryan V |
| 11/04/2022 |[Understanding the world through action](https://arxiv.org/abs/2110.12543) | Ze Xia (Lucas) Wang, Saba Heravi |
| |[Deep hierarchical planning from pixels](https://arxiv.org/abs/2206.04114 ) | Ruihong Yin, Pinyi Wang, Xiulong Liu |
| 11/11/2022 |Break Veterans Day | |
| 11/18/2022 |**Guest Speaker** [Yubei Chen](https://redwood.berkeley.edu/people/yubei-chen/) (New York University)
| |
| 11/25/2022 |Break Thanksgiving | |
| 12/02/2022 |Break NeurIPS | |
| 12/09/2022 |NeurIPS Updates | |
| 12/16/2022 |**Guest Speaker** [Kuan Fang](http://kuanfang.github.io/) (UC Berkeley)
| |
## 2022 Spring Schedule
Thanks [Ryan Vogt](https://amath.washington.edu/people/ryan-vogt) and Jingyuan Li for being the Student Organizers.
| Date | Paper/Activity | Student Presenter |
|----------------|-----------|----------|
| 04/01/2022 | Organizational & Intro Meeting | |
| 04/08/2022 | [VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning](https://arxiv.org/abs/2105.04906) | Kun Su, Mingfei Chen, Harsha Vardhan |
| | [The Causal-Neural Connection: Expressiveness, Learnability, and Inference](https://arxiv.org/abs/2107.00793) | Rahul Biswas, Shirui Chen, Xiulong Liu |
| 04/15/2022 | [ILQR-VAE : Control-base Learning of Input Driven Dynamics with Application To Neural Data](https://www.google.com/url?q=https://openreview.net/pdf?id%3DwRODLDHaAiW&sa=D&source=editors&ust=1649180753528118&usg=AOvVaw0JX_E5TNtKgSp882GqQfot) | Pamel Kang, Trung Le, Jingyuan Li |
| | [Neural Active Learning with Performance Guarantees](https://www.google.com/url?q=https://proceedings.neurips.cc/paper/2021/file/3dcaf04c357c577a857f3ffadc555f9b-Paper.pdf&sa=D&source=editors&ust=1649180753528261&usg=AOvVaw0ZeJ91Ndgrq4dqjGBRazlb) | Zhuochun Liu, Zhongshu Meng, Jinlin Xiang |
| 04/22/2022 | [Inferring Latent Dynamics Underlying Neural Population aCTIVITY VIA neural Differential Equations](http://proceedings.mlr.press/v139/kim21h.html) | Michael Nolan, Saba H, Destiny Alvarado |
| | [Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph](https://arxiv.org/abs/2202.12307) | Yang Zheng, Anoop Mysore Nataraja, Malek Itani |
| 04/29/2022 | **Guest Speaker** [Kevin Xia](https://springo.github.io/) (Columbia University)
| |
| 05/06/2022 | [Towards Biologically Plausible Convolutional Networks](https://arxiv.org/abs/2106.13031) | Xiangyu Gao, Yujia Liu, Xinyue Sun |
| | [Deep Reinforcement Learning with Spiking Q-Learning](https://arxiv.org/abs/2201.09754) | Jingwei Xu, Miranda Anderson, Jimin Kim |
| 05/13/2022 | A3D3 Speakers | |
| 05/20/2022 | TBA | |
| 05/27/2022 | **Guest Speaker** [Claudio Gentile](https://sites.google.com/view/cgentile) (Google)
| |
| 06/03/2022 | A3D3 Speakers | |
| 06/10/2022 | **Guest Speaker** [Marine Schimel](https://hennequin-lab.github.io/people/schimel/) (Cambridge)
| |
## 2022 Winter Schedule
| Date | Paper/Activity | Student Presenter |
|----------------|-----------|----------|
| 01/14/2022 | Organizational Meeting | |
| 01/21/2022 | [Where is all the nonlinearity: flexible nonlinear modeling of behaviorally relevant neural dynamics using recurrent neural networks](https://www.biorxiv.org/content/biorxiv/early/2021/09/06/2021.09.03.458628.full.pdf?__cf_chl_jschl_tk__=9y9bBSKDp3wPH6C_ZfnTHiVED4A5wU6TyMCal9VgQeI-1642564872-0-gaNycGzNCP0) | Michael Nolan, Saba Heravi, Ryan Vogt, Zekun Chen |
| | [Drop, Swap, and Generate: A Self-Supervised Approach for Generating Neural Activity](https://arxiv.org/pdf/2111.02338.pdf) | Kun Su, Xiangyu Gang, Pamel Kang, Jingyuan Li |
| 01/28/2022 | [Neural Active Learning with Performance Guarantees](https://arxiv.org/pdf/2106.03243.pdf) | Xiulong Liu, James Hazelden, Jinlin Xiang, Liem Vu |
| | [Dynamic Causal Modelling Revisited](https://www.sciencedirect.com/science/article/pii/S1053811917301568) | Rahul Biswas, Astitwa Sarthak Lathe, Trung Le |
| 02/04/2022 | **A3D3 NeuroAI**| |
| |OpenLabCluster Demo |Jingyuan Li (UW ECE), Moishe Kesselman (UW CSE)|
| |Detection of Sleep Spindles with FPGA| Xiaohan Liu (UW ECE), Aidan Yokuda (UW ECE)|
| |Somatotopic representation of texture sensation in the primary somatosensory and motor cortices of mice| Megan Lipton (Purdue Neurobiology)|
| 02/11/2022 | **Guest Speaker** [Eva L. Dyer](https://dyerlab.gatech.edu/people/pi-profile/) (Gatech)
| |
| 02/18/2022 |[Stabilizing Dynamical Systems via Policy Gradient Methods](https://arxiv.org/abs/2110.06418) |Jimin Kim, Mingfei Chen, Aidan Yokuda |
| | [AugMax: Adversarial Composition of Random Augmentations for Robust Training](https://arxiv.org/abs/2110.13771) | Yang Zheng, Xiaohan Liu, Yujia Liu, Xinyue Sun|
| 02/25/2022 | **Guest Speaker** [Max Simchowitz](https://msimchowitz.github.io/) (MIT)
| |
| 03/04/2022 | **A3D3 NeuroAI** | |
| | Optimizing brain stimulation using deep learning | Seungbin Park (Purdue) |
| | Quantifying the effect of stimulation protocols on rapid network connectivity inference | Tomohiro Ouchi (UW) |
| | Modeling Neural Population Activity with Spatiotemporal Transformer | Trung Le (UW) |
| 03/11/2022 | **Guest Speaker**: [Omid G. Sani](https://omidsani.com/) (USC)
| |
## 2021 Fall Schedule
| Date | Paper/Activity | Student Presenter |
|----------------|-----------|----------|
| 10/08/2021 | Organizational Meeting | |
| 10/15/2021 | [Representation learning for neural population activity with Neural Data Transformers](https://arxiv.org/pdf/2108.01210.pdf) | Rahul Biswas, Jimin kim |
| | [Deep Reinforcement Learning for Neural Control](https://arxiv.org/abs/2006.07352) | Ryan Vogt, Jinlin Xiang|
| 10/22/2021 | [A unified framework of online learning algorithms for training recurrent neural networks](https://arxiv.org/pdf/1907.02649.pdf) | Harsha Vardhan, James Hazelden |
| | [Lyapunov-Guided Embedding for Hyper-parameter Selection in Recurrent Neural Networks]() | Kun Su, Michael Nolan |
| 10/29/2021 | [AL-SAR: Active Learning for Skeleton-based Action Recognition]() | Xiulong Liu, Syed M. Aun Haider |
| | [How does it sound?]() | Jingyuan Li, Trung Le |
| 11/05/2021 | **Guest Speaker** [Xiulong liu](https://scholar.google.com/citations?user=e5GPhrMAAAAJ&hl=zh-CN) (UW)
| |
| | **Guest Speaker** [Jingyuan Li](https://scholar.google.com/citations?user=BEhp15IAAAAJ&hl=zh-CN) (UW)
| |
| 11/12/2021 | **Guest Speaker**: [Chethan Pandarinath](https://bme.gatech.edu/bme/faculty/Chethan-Pandarinath) (Georgia Tech)
| |
| | **Guest Speaker**: [Joel Ye](https://joel99.github.io/) (CMU)
| |
| 11/19/2021 | [Local Plasticity rules can learn deep representations using self-supervised contrastive predictions](https://arxiv.org/abs/2010.08262) | Yang Zheng, Saba Heravi | |
| | [AI Choreographer: Music Conditioned 3D Dance Generation with AIST++](https://arxiv.org/abs/2101.08779) | Xiangyu Gao, Yonghun Lee | |
| 11/26/2021 | Thanksgiving Break | |
| 12/03/2021 | **Guest Speaker**: [Cristina Savin](https://as.nyu.edu/content/nyu-as/as/faculty/cristina-savin.html) (NYU)
| |
| | **Guest Speaker**: Owen Marschall (NYU) 
| |
## 2021 Spring Schedule
| Date | Paper/Activity | Student Presenter |
|----------------|-----------|----------|
| 04/02/2021 | [Deep Graph Pose: a semi-supervised deep graphical model for improved animal pose tracking](https://www.biorxiv.org/content/10.1101/2020.08.20.259705v1.full.pdf) | Chuanmudi Qin, Xiulong Liu, Kun Su |
| | [Backpropagation and the brain](https://www.nature.com/articles/s41583-020-0277-3) | Ben Francis, Felix Tse, Trung Le |
| 04/09/2021 | [Understanding self-supervised Learning Dynamics without Contrastive Pairs](https://arxiv.org/pdf/2102.06810.pdf) | Jingyuan Li, Ayesha Ghaffar, Zidan Luo |
| | [Closed-Form Factorization of Latent Semantics in GANs](https://arxiv.org/pdf/2007.06600.pdf) | Jingxi Yu, Xiangyu Gao, Yang Zheng |
| 04/16/2021 | **Guest Speaker**: [Anqi Wu](https://sites.google.com/site/anqiwuresearch/) (Columbia University)
| |
| 04/23/2021 | [Non-reversible Gaussian processes for identifying latent dynamical structure in neural data](https://proceedings.neurips.cc/paper/2020/file/6d79e030371e47e6231337805a7a2685-Paper.pdf) | Rahul Biswas, Ryan Vogt, Michael Nolan |
| | [Modeling behaviorally relevant neural dynamics with a novel preferential subspace identification](https://www.nature.com/articles/s41593-020-00733-0) | Saba Heravi, Astitwa Lathe, Yiren Wang, Jimin Kim |
| 04/30/2021 | **Guest Speaker**: [Bolei Zhou](http://bzhou.ie.cuhk.edu.hk/) (The Chinese University of Hong Kong)
| |
| 05/07/2021 | New Papers Discussion | |
| 05/14/2021 | ICLR Paper Presentation | |
| 05/21/2021 | No Meeting | |
| 05/28/2021 | **Guest Speaker**: [Omid G. Sani](https://omidsani.com/) (USC)
| |
| 06/04/2021 | **Guest Speaker**: [Yuandong Tian](https://yuandong-tian.com/) (Facebook)
| |
## 2021 Winter Schedule
| Date | Paper/Activity | Student Presenter |
|----------------|-----------|----------|
| 01/08/2021 | Organizational Meeting | |
| 01/15/2021 | [Graph Convolutional Reinforcement Learning](https://arxiv.org/pdf/1810.09202.pdf) | Jinlin Xiang, Trung Le |
| | [When Counterpoint Meets Chinese Folk Melody](https://papers.nips.cc/paper/2020/file/bae876e53dab654a3d9d9768b1b7b91a-Paper.pdf) | Haobo Zhang, Xiulong Liu, Kun Su |
| 01/22/2021 |[Gradient Starvation: A Learning Proclivity in Neural Networks](https://arxiv.org/pdf/2011.09468.pdf) | Ryan Vogt, Yang Zheng |
| |[Cliques of Neurons Bound into Cavities Provide a Missing Link between Structure and Function](https://www.frontiersin.org/articles/10.3389/fncom.2017.00048/full) | Michael Nolan, Ben Francis, Rahul Biswas | |
| 01/29/2021 | **Guest Speaker**: [Zhiyao Duan](http://www2.ece.rochester.edu/~zduan/)
| |
| 02/05/2021 |[Temporal Spike Sequence Learning via Backpropagation for Deep Spiking Neural Networks](https://proceedings.neurips.cc/paper/2020/file/8bdb5058376143fa358981954e7626b8-Paper.pdf) | Jingyuan Li, Saba Heravi, Yetao Chen |
| |[Improved protein structure prediction using potentials from deep learning](https://www.nature.com/articles/s41586-019-1923-7) | Chris Yin, Jamie Park, Jimin Kim |
| 02/12/2021 |[Unsupervised Sound Separation Using Mixture Invariant Training](https://proceedings.neurips.cc/paper/2020/file/28538c394c36e4d5ea8ff5ad60562a93-Paper.pdf) | Kun Su, Jinlin Xiang, Zhichao Lei |
| |[Deep Reinforcement Learning and its neuroscientific implications](https://www.sciencedirect.com/science/article/pii/S0896627320304682?casa_token=AglEbspNXSgAAAAA:mVqXGqsAJ2Bo80PBAhkBr2fhExZjtgqfoI2xCREN_4nQHTyovwZc1IoJgDiiLKflL6bETi-n1w) | Ben Francis, Trung Le, Saba Heravi |
| 02/19/2021 | | |
| 02/26/2021 | **Guest Speaker**: [Kathryn Hess Bellwald](https://people.epfl.ch/kathryn.hess) 
| |
| 03/05/2021 | **Guest Speaker**: [Wenrui Zhang](https://scholar.google.com/citations?hl=en&user=Eod1ZQUAAAAJ&view_op=list_works&sortby=pubdate) 
| |
| 03/12/2021 | **Guest Speaker**: [Mohammad Pezeshki](https://mohammadpz.github.io/) 
| |
## 2020 Autumn Schedule
| Date | Paper/Activity | Student Presenter |
|----------------|-----------|----------|
| 10/02/2020 | Organizational Meeting | |
| 10/09/2020 | [Learning a Prior over Intent via Meta-Inverse Reinforcement Learning](http://proceedings.mlr.press/v97/xu19d.html)| Yang Zheng, Rahul Biswas |
| | [Universality and Individuality in recurrent networks](https://arxiv.org/abs/1907.08549) | Michael Nolan, Ben Francis |
| 10/16/2020 | [Unsupervised deep learning identifies semantic disentanglement in single inferotemporal neurons](https://arxiv.org/pdf/2006.14304.pdf) | Jinlin Xiang, Ryan Vogt |
| | [Low-dimensional dynamics for working memory and time encoding](https://www.pnas.org/content/early/2020/08/27/1915984117) | Jimin Kim, Trung Le, David Babin |
| 10/23/2020 | **Guest Speaker**: [Niru Maheswaranathan](https://niru.dev/) 
| |
| 10/30/2020 | [Rotational Dynamics Reduce Interference Between Sensory and Memory Represenatations](https://www.biorxiv.org/content/10.1101/641159v1) | Jingyuan Li, Saba Heravi | |
| | [Foley Music: Learning to Generate Music from Videos](https://arxiv.org/pdf/2007.10984.pdf) | Kun Su, Xiulong Liu |
| 11/06/2020 | **Guest Speaker**: [Christopher Cueva](https://scholar.google.com/citations?user=BxLgolsAAAAJ&hl=en) 
| |
| 11/13/2020 | No meeting | |
| 11/20/2020 | **Guest Speaker**: [Alexandra Libby](https://pni.princeton.edu/directory/alexandra-libby) |
| 11/27/2020 | Thanksgiving Break - No meeting | |
| 12/4/2020 |**Guest Speaker**: [Irina Higgins](https://scholar.google.com/citations?user=YWVuCKUAAAAJ&hl=en) 
| |
| 12/4/2020 | **Guest Speaker**: [Chuang Gan](http://people.csail.mit.edu/ganchuang/) 
| |
| 12/11/2020 | Research Video Updates | |
## 2020 Summer Schedule
We are reading papers published in recent Top AI Conferences (CVPR 2020, ICML 2020)!
| Date | Paper | Keywords | Presenter | Presentation Link |
|----------------|-----------|----------|------------|---------|
| 7/30/2020 | [Improving the Gating Mechanism of Recurrent Neural Networks](https://proceedings.icml.cc/static/paper_files/icml/2020/5650-Paper.pdf) | RNN | [Ryan Vogt](https://amath.washington.edu/people/ryan-vogt) | [Google Slides](https://docs.google.com/presentation/d/196lcrl9bOWiq_usIpaQvHjqE3SAxcAUxs9swZSvs0Ak/edit?usp=sharing) |
| | [Encoding Musical Style with Transformer Autoencoders](https://proceedings.icml.cc/static/paper_files/icml/2020/1363-Paper.pdf) |Music Generation | [Kun Su](https://kun-su.netlify.app) | [Google Slides](https://docs.google.com/presentation/d/1vWzDYE8bvuxjF2o4eUcAd5SSEwIJ98RS-usdbYocMGQ/edit?usp=sharing)|
| 8/6/2020 | [Controllable Orthogonalization in Training DNNs](https://openaccess.thecvf.com/content_CVPR_2020/papers/Huang_Controllable_Orthogonalization_in_Training_DNNs_CVPR_2020_paper.pdf)| Network Optimization | Yang Zheng | [Google Slides](https://docs.google.com/presentation/d/1nM0gH2Tw2MgeU5LGpXNNHIepn0yH_iX-uSx2VmydsOE/edit?usp=sharing) |
| | [Π´nets: Deep Polynomial Neural Networks](https://openaccess.thecvf.com/content_CVPR_2020/papers/Chrysos_P-nets_Deep_Polynomial_Neural_Networks_CVPR_2020_paper.pdf)| Network Design | Jinlin Xiang | [Google Slides](https://docs.google.com/presentation/d/1T7cM-S69C_9NdDWuCKkiKe47UpPxZ6TF5zXgze3PsQI/edit?usp=sharing) |
| 8/13/2020 | [Forecasting Sequential Data Using Consistent Koopman Autoencoders](https://proceedings.icml.cc/static/paper_files/icml/2020/2620-Paper.pdf)| Time Series Prediction | Saba Heravi | [Google Slides](https://docs.google.com/presentation/d/1-IOt_G4fVJS_Kpgy8fcgqqt-uuKhI2EWeaf1ngoM-5U/edit?usp=sharing) |
| | [Learning to Combine Top-Down and Bottom-Up Signals in Recurrent Neural Networks with Attention over Modules](https://proceedings.icml.cc/static/paper_files/icml/2020/1698-Paper.pdf)| RNN | Jingyuan Li | [Google SLides](https://docs.google.com/presentation/d/13ku9LYve8pPqEa8wJd74z5HhQ1aWbfgvfoZPBVnjR1Q/edit?usp=sharing) |
| 8/20/2020 | [Disentangling and Unifying Graph Convolutions for Skeleton-Based Action Recognition](https://openaccess.thecvf.com/content_CVPR_2020/papers/Liu_Disentangling_and_Unifying_Graph_Convolutions_for_Skeleton-Based_Action_Recognition_CVPR_2020_paper.pdf)| Graph, Skeleton | Rahul Biswas | [Google Slides](https://docs.google.com/presentation/d/1VxSEehhLD5xcrnni_xDYx6NYmuUqGe0nQc_lfgcNgao/edit?usp=sharing) |
| | [Do RNN and LSTM have Long Memory](https://proceedings.icml.cc/static/paper_files/icml/2020/956-Paper.pdf)| RNN | Jimin Kim | [Google Slides](https://docs.google.com/presentation/d/15oMIF0ZRSwZJ-yeCWchmAK7ABmCs_LvdMPSBNwJbZsM/edit?usp=sharing) |
| 8/27/2020 | [XtarNet: Learning to Extract Task-Adaptive Representation for Incremental Few-Shot Learning](https://proceedings.icml.cc/static/paper_files/icml/2020/6928-Paper.pdf) | Incremental Learning | [Kun Su](https://kun-su.netlify.app) | [Google Slides](https://docs.google.com/presentation/d/1j5YtunFXH6S8E7mJ5nVZx6taoLTTevGQQVZDe72yEZ8/edit?usp=sharing) |
| | [Approximating Stacked and Bidirectional Recurrent Architectures with the Delayed Recurrent Neural Network](https://proceedings.icml.cc/static/paper_files/icml/2020/5744-Paper.pdf)| RNN | Saba Heravi | [Google Slides](https://docs.google.com/presentation/d/1_Ph4ug07J2JcmyjgMxGN-MlaCbaP_RzXozThG2zgkp0/edit?usp=sharing) |
| 9/3/2020 | [Transformers are RNNs: Fast Autoregressive Transformers with Linear Attention](https://proceedings.icml.cc/static/paper_files/icml/2020/2935-Paper.pdf)| RNN | [Ryan Vogt](https://amath.washington.edu/people/ryan-vogt) | [Google Slides](https://docs.google.com/presentation/d/1DWrUFrQGrBEiMHbWpSExIqWAPPXQQpijFsasdnt8V5M/edit?usp=sharing) |
| | [Deep Isometric Learning for Visual Recognition](https://arxiv.org/pdf/2006.16992.pdf) | Network Design | Jimin | [Google Slides](https://docs.google.com/presentation/d/1-xuQN-RZ29RI7WohFnzAXSy4vRwcRTueTr3zJZV7EVM/edit?usp=sharing) |
| 9/10/2020 | [Self-supervised Equivariant Attention Mechanism for Weakly Supervised Semantic Segmentation](http://openaccess.thecvf.com/content_CVPR_2020/papers/Wang_Self-Supervised_Equivariant_Attention_Mechanism_for_Weakly_Supervised_Semantic_Segmentation_CVPR_2020_paper.pdf)| Weakly Supervised | Jinlin Xiang | [Google Slides](https://docs.google.com/presentation/d/1ecpTsXEBveNnKMWtJYBqFPsiJn5LwpKhAURKvudiV0Y/edit?usp=sharing) |
| | [Towards Global Explanations of Convolutional Neural Networks with Concept Attribution](http://openaccess.thecvf.com/content_CVPR_2020/papers/Wu_Towards_Global_Explanations_of_Convolutional_Neural_Networks_With_Concept_Attribution_CVPR_2020_paper.pdf) | Interpretability | Jingyuan Li | [Google Slides](https://docs.google.com/presentation/d/1t1bH1p8r79Oqnix-YISy1bGWFQUtR-IsH63x5S4wCVw/edit?usp=sharing) |
| 9/17/2020 | [Low-rank Compression of Neural Nets: Learning the Rank of Each Layer](https://openaccess.thecvf.com/content_CVPR_2020/papers/Idelbayev_Low-Rank_Compression_of_Neural_Nets_Learning_the_Rank_of_Each_CVPR_2020_paper.pdf)| Compression | Rahul Biswas | [Google Slides](https://docs.google.com/presentation/d/125nmKFyltUohekqHHGuvN9h_svzr_x7L4ATYRoVYOlQ/edit?usp=sharing) |
| | [Sign Language Transformers: Joint End-to-end Sign Language Recognition and Translation](https://arxiv.org/pdf/2003.13830.pdf) | | Yang Zheng | [Google Slides](https://docs.google.com/presentation/d/1ojCGV8xvls5IXiLvisPX1HKm-vLguC-HR2cbEVBSlPY/edit?usp=sharing) |