Master’s Thesis Presentation • Software Engineering • Measuring the Performance of Code Produced with GitHub Copilot

Friday, December 16, 2022 11:30 am - 12:30 pm EST (GMT -05:00)

Please note: This master’s thesis presentation will take place online. Please also note that the start time has changed from 11:00 to 11:30 a.m.

Daniel Erhabor, Master’s candidate
David R. Cheriton School of Computer Science

Supervisors: Professors Mei Nagappan, Samer Al-Kiswany

GitHub Copilot is an artificially intelligent programming assistant used by many developers. While a few studies have evaluated the security risks of using Copilot, there has not been any study to show if it aids developers in producing code with better runtime performance.

We evaluate the performance of code produced when developers use GitHub Copilot versus when they do not. To this end, we conducted a user study with 32 participants where each participant solved two C++ programming problems, one with Copilot and the other without it and measured the runtime of the participants’ solutions on our test data. Our results suggest that using Copilot can produce code with a significantly longer runtime.