PhD Seminar • Artificial Intelligence • LTI Systems Generating Temporal Bases: Applications to Machine LearningExport this event to calendar

Friday, October 15, 2021 — 3:00 PM EDT

Please note: This PhD seminar will be given online.

Andreas Stöckel, PhD candidate
David R. Cheriton School of Computer Science

Supervisor: Professor Chris Eliasmith

The “Legendre Memory Unit” (LMU) proposed by Voelker, Kajić, and Eliasmith (2019) is a recurrent neural network that substantially outperforms classic architectures such as “reservoir computing” and long short-term memories (LSTMs). At its core, the LMU is based on a linear time-invariant (LTI) system that approximates the windowed Legendre polynomials as its impulse response. We discuss a novel and surprisingly simple derivation of this and similar LTI systems that generate windowed temporal bases. Using these methods, we are able to construct LTI systems that offer a slightly improved memory capacity over the LMU LTI. Using these insights, we can construct feed-forward networks based on sliding-window spectra as an alternative to a feed-forward variant of the LMU with different trade-offs in terms of time- and memory-complexity.


To join this PhD seminar on Zoom, please go to https://uwaterloo.zoom.us/j/95089656133?pwd=bjJTSytQU3plUDFWZmxaMXJMTXdFUT09.

Location 
Online PhD seminar
200 University Avenue West

Waterloo, ON N2L 3G1
Canada
Event tags 

S M T W T F S
26
27
28
29
30
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
1
2
3
4
5
6
  1. 2021 (177)
    1. November (1)
    2. October (12)
    3. September (21)
    4. August (20)
    5. July (17)
    6. June (11)
    7. May (16)
    8. April (27)
    9. March (20)
    10. February (13)
    11. January (19)
  2. 2020 (217)
    1. December (18)
    2. November (12)
    3. October (7)
    4. September (21)
    5. August (28)
    6. July (14)
    7. June (18)
    8. May (16)
    9. April (20)
    10. March (16)
    11. February (25)
    12. January (22)
  3. 2019 (255)
  4. 2018 (217)
  5. 2017 (36)
  6. 2016 (21)
  7. 2015 (36)
  8. 2014 (33)
  9. 2013 (23)
  10. 2012 (4)
  11. 2011 (1)
  12. 2010 (1)
  13. 2009 (1)
  14. 2008 (1)