PhD Seminar • Artificial Intelligence (Theoretical Neuroscience) — A Biologically Plausible LSTM Cell for Chaotic Time-series PredictionExport this event to calendar

Monday, March 4, 2019 2:00 PM EST

Aaron Voelker, PhD candidate
David R. Cheriton School of Computer Science

LSTM networks address the problem of storing information across long intervals of time by using an explicit memory unit to alleviate the vanishing and exploding gradient problems. However, we find that when given a continuous-time delay task, the performance of a "stacked LSTM" suffers catastrophically in the number of time-steps. This motivates the discovery of a new cell that we derive using modern control theory. An accurate spiking implementation of this cell in Nengo displays a striking resemblance to time cells in the cortex. Applying backpropagation through time enables an equivalently-sized network to store longer windows of time, train faster, and outperform a stacked LSTM on the Mackey-Glass dataset.

Location 
E7 - Engineering 7
6323
200 University Ave West

Waterloo, ON N2L 3G1
Canada

S M T W T F S
27
28
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
1
2
  1. 2024 (100)
    1. April (23)
    2. March (27)
    3. February (25)
    4. January (25)
  2. 2023 (296)
    1. December (20)
    2. November (28)
    3. October (15)
    4. September (25)
    5. August (30)
    6. July (30)
    7. June (22)
    8. May (23)
    9. April (32)
    10. March (31)
    11. February (18)
    12. January (22)
  3. 2022 (245)
  4. 2021 (210)
  5. 2020 (217)
  6. 2019 (255)
  7. 2018 (217)
  8. 2017 (36)
  9. 2016 (21)
  10. 2015 (36)
  11. 2014 (33)
  12. 2013 (23)
  13. 2012 (4)
  14. 2011 (1)
  15. 2010 (1)
  16. 2009 (1)
  17. 2008 (1)