CS 854: Advanced Topics in Computer Systems
Experimental Performance Evaluation
Fall 2021
Projects Resources Integrity
News and Other Important Information
NOTE: THAT SOME OF THE LINKS AT THE TOP AND BOTTOM OF THE PAGE MIGHT NOT WORK FOR A WHILE. UPDATES WILL BE MADE HERE -- ESPECIALLY BEFORE THE TERM STARTS AND IN THE EARLY PART OF THE TERM.
Fri 10 Sep 2021 04:49:21 PM EDT Please also read the information below this (dated earlier). There are currently 12 student enrolled and the current limit is 15. I will be increasing the enrollment limit to 18. At some point after this happens I will contact students at the top of the waitlist and someone in the grad office will send you a permission number that will allow you to enrol. I will probably wait for a while to do this (e.g., Sept 17) because things are often in flux and the grad office is really busy.
Wed 01 Sep 2021 08:33:27 PM EDT
Enrollment: Currently 13 of 15 slots are filled. For some reason people aren't able to sign up for the empty slots. I'm trying to find out why that is. If you've already sent me email about getting into the course I have you on a list (so there is no need to contact me again).
NOTE: that students often sign up for more courses than they intend to take and later drop some courses. So there may be some spots additional spots that open up. If you would like you can attend the course meetings and do the work to see if a spot becomes available. However, I have received email from about 19-20 people asking to get added, so not everyone will be able to get into the course.
This course will be held online synchronously. The course meetings will be recorded but they are not designed to be used instead of attending the course. A good portion of the grade will be from class participation. The course is scheduled for Tuesdays 9:30 - 11:50 am eastern time. Classes start on September 8 so the first course will be September 14.
There will be a fair bit of similarity between
this and the Fall 2020 offering.
If you want to find out more before I can update
this years web site,
you can find more info about that offering here.
Experimental Performance Evaluation (Fall 2020)
If you send me email please include "CS854" in the Subject line. I have very aggressive spam filters and I've whitelisted subject lines that include that string so I will see them.
About the Course
- Objectives: An in-depth study of issues, challenges, techniques, and pitfalls associated with conducting experimental performance evaluations. The course will focus on papers related to conducting scientifically sound experimental performance evaluations and drawing valid conclusions from the results. The goal is to help students to critically evaluate performance experiments in existing papers and to design and carry out experimental performance evaluations in their own work.
- Course Meetings: Mostly weekly discussion of 2-3 papers but this format may vary. Some meetings may involve reading and critiquing the experimental performance evaluation performed in the papers read that week. We may perform some case studies, especially if students in the course are planning on conducting performance evaluations for papers or thesis work. This would involve a short presentation that describes a problem being studied and the methodology being used to evaluate the performance and the expected outcomes. The class will then evaluate and discuss the methodology.
- Content: Some of the content may be dictated by the interests of the students.
Background
- statistics
- good communication skills
- systems programming skills (not stricly required)
- operating systems (not stricly required)
- networking (not stricly required)
The systems and networking background are not strictly required but some of the papers and discussion are likely to revolve around computer systems and/or networking research so a bit of a background in those areas might be helpful.
Projects Resources Integrity
Last modified: Fri Sep 17 19:49:17 EDT 2021