CS 854: Advanced Topics in Computer Systems
Experimental Performance Evaluation
Fall 2022
Projects Resources Integrity
News and Other Important Information
NOTE: THAT SOME OF THE LINKS AT THE TOP AND BOTTOM OF THE PAGE MIGHT NOT WORK FOR A WHILE. UPDATES WILL BE MADE HERE -- ESPECIALLY BEFORE THE TERM STARTS AND IN THE EARLY PART OF THE TERM.
Tue Sep 6 15:39:33 EDT 2022 :
I've added a link to a video about this terms class
and have started to fill in some of the details about the class.
August, 2022
There will be a fair bit of similarity between
this and the Fall 2021 offering.
If you want to find out more before I can update
this years web site,
you can find more info about that offering here.
Experimental Performance Evaluation (Fall 2021)
If you send me email please include "CS854" in the Subject line. I have very aggressive spam filters and I've whitelisted subject lines that include that string so I will see them.
About the Course
- Objectives: An in-depth study of issues, challenges, techniques, and pitfalls associated with conducting experimental performance evaluations. The course will focus on papers related to conducting scientifically sound experimental performance evaluations and drawing valid conclusions from the results. The goal is to help students to critically evaluate performance experiments in existing papers and to design and carry out experimental performance evaluations in their own work.
-
Expected Outcomes:
- Obtain background in research related to empirical performance evaluation.
- Learn how to read and critically evaluate research papers.
- Understanding issues, challenges, techniques and pitfalls when conducting experimental performance evaluations.
- Learn how to design and carry out a sound performance evaluation.
- Course Meetings: Mostly weekly discussion of 2-3 papers but this format may vary. Some meetings may involve reading and critiquing the experimental performance evaluation performed in the papers read that week. We may perform some case studies, especially if students in the course are planning on conducting performance evaluations for papers or thesis work. This would involve a short presentation that describes a problem being studied and the methodology being used to evaluate the performance and the expected outcomes. The class will then evaluate and discuss the methodology.
- Content: Some of the content may be dictated by the interests of the students.
Background
- statistics
- good communication skills
- systems programming skills (not stricly required)
- operating systems (not stricly required)
- networking (not stricly required)
The systems and networking background are not strictly required but many of the papers and discussion are likely to revolve around computer systems and/or networking research and their performance so some background in those areas might be helpful.
Schedule
Most of the week to week requirements and details are available via the "Schedule" button and through Piazza.
Projects Resources Integrity
Last modified: Fri Oct 21 15:47:22 EDT 2022