CS 854: Advanced Topics in Computer Systems
Experimental Performance Evaluation
News and Other Important Information
NOTE: THAT SOME OF THE LINKS AT THE TOP AND BOTTOM OF THE PAGE
MIGHT NOT WORK FOR A WHILE.
UPDATES WILL BE MADE HERE -- ESPECIALLY BEFORE THE TERM
STARTS AND IN THE EARLY PART OF THE TERM.
Tue Sep 6 15:39:33 EDT 2022 :
I've added a link to a video about this terms class
and have started to fill in some of the details about the class.
There will be a fair bit of similarity between
this and the Fall 2021 offering.
If you want to find out more before I can update
this years web site,
you can find more info about that offering here.
Experimental Performance Evaluation (Fall 2021)
If you send me email please include "CS854" in the Subject line.
I have very aggressive spam filters and I've whitelisted subject lines
that include that string so I will see them.
About the Course
An in-depth study of issues, challenges, techniques, and pitfalls associated
experimental performance evaluations.
The course will
focus on papers related to conducting scientifically sound
experimental performance evaluations and drawing valid
conclusions from the results.
The goal is to help students to critically evaluate performance
experiments in existing papers and to design and carry out experimental
performance evaluations in their own work.
- Obtain background in research related to empirical performance evaluation.
- Learn how to read and critically evaluate research papers.
- Understanding issues, challenges, techniques and pitfalls when conducting experimental performance evaluations.
- Learn how to design and carry out a sound performance evaluation.
Mostly weekly discussion of 2-3 papers but this
format may vary. Some meetings may involve reading and critiquing
the experimental performance evaluation performed in the papers read
that week. We may perform some case studies, especially if students in
the course are planning on conducting performance evaluations for papers
or thesis work. This would involve a short presentation that describes
a problem being studied and the methodology being used to evaluate the
performance and the expected outcomes. The class will then evaluate and
discuss the methodology.
Some of the content may be dictated by the interests of
- good communication skills
- systems programming skills (not stricly required)
- operating systems (not stricly required)
- networking (not stricly required)
The systems and networking background
are not strictly required but many of the papers and
discussion are likely to revolve around computer systems and/or networking
research and their performance
so some background in those areas might be helpful.
Most of the week to week requirements and details
are available via the "Schedule" button and through Piazza.
Fri Oct 21 15:47:22 EDT 2022