PhD Seminar • Data Systems • Operator Selection and Ordering in a Pipeline Approach to Efficiency Optimizations for TransformersExport this event to calendar

Wednesday, September 21, 2022 — 12:00 PM to 1:00 PM EDT

Please note: This PhD seminar will take place online.

Ji Xin, PhD candidate
David R. Cheriton School of Computer Science

Supervisors: Professors Jimmy Lin and Yaoliang Yu

There exists a wide variety of efficiency methods for natural language processing (NLP) tasks, such as pruning, distillation, dynamic inference, quantization, etc. We can consider an efficiency method as an operator applied on a model. Naturally, we may construct a pipeline of multiple efficiency methods, i.e., to apply multiple operators on the model sequentially.

In this talk, we discuss the plausibility of this idea, and more importantly, the commutativity and cumulativeness of efficiency operators. We discuss two interesting observations: (1) Efficiency operators are commutative — the order of efficiency methods within the pipeline has little impact on the final results; (2) Efficiency operators are also cumulative — the final results of combining several efficiency methods can be estimated by combining the results of individual methods. These observations deepen our understanding of efficiency operators and provide useful guidelines for building them in real-world applications.


To join this PhD seminar on Zoom, please go to https://uwaterloo.zoom.us/j/94349250988.

Location 
Online PhD seminar
200 University Avenue West

Waterloo, ON N2L 3G1
Canada
Event tags 

S M T W T F S
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
1
2
3
4
  1. 2024 (100)
    1. April (23)
    2. March (27)
    3. February (25)
    4. January (25)
  2. 2023 (296)
    1. December (20)
    2. November (28)
    3. October (15)
    4. September (25)
    5. August (30)
    6. July (30)
    7. June (22)
    8. May (23)
    9. April (32)
    10. March (31)
    11. February (18)
    12. January (22)
  3. 2022 (245)
  4. 2021 (210)
  5. 2020 (217)
  6. 2019 (255)
  7. 2018 (217)
  8. 2017 (36)
  9. 2016 (21)
  10. 2015 (36)
  11. 2014 (33)
  12. 2013 (23)
  13. 2012 (4)
  14. 2011 (1)
  15. 2010 (1)
  16. 2009 (1)
  17. 2008 (1)