Note
This paper list is no longer maintained; for current work, please visit my UBC page.
2015
Adriaan Labuschagne and Reid Holmes. Do Onboarding Programs Work? In Proceedings of the Working Conference on Mining Software Repositories (MSR). 2015. TO APPEAR.
Olga Baysal, Oleksii Kononenko, Reid Holmes, and Michael W. Godfrey. Investigating Technical and Non-Technical Factors Influencing Modern Code Review. Journal of Empirical Software Engineering (ESE). 2015. 1-28. [DOI]
Olga Baysal, Oleksii Kononenko, Reid Holmes, and Michael W. Godfrey. Synthesizing Knowledge from Software Development Artifacts. Book chapter in The Art and Science of Analyzing Software Data. Eds. Chris Bird, Tim Menzies, and Thomas Zimmermann. 2015.
2014
René Just, Darioush Jalali, Laura Inozemtseva, Michael D. Ernst, Reid Holmes and Gordon Fraser. Are Mutants a Valid Substitute for Real Faults in Software Testing?. In Proceedings of the International Symposium on the Foundations of Software Engineering (FSE). 2014. 654-665. Awarded ACM SIGSOFT Distinguished Paper Award. [DOI]
Olga Baysal, Reid Holmes, and Mike Godfrey. No Issue Left Behind: Reducing Information Overload in Issue Tracking. In Proceedings of the International Symposium on the Foundations of Software Engineering (FSE). 2014. 666-677. [DOI]
Laura Inozemtseva and Reid Holmes. Coverage Is Not Strongly Correlated With Test Suite Effectiveness. In Proceedings of the International Conference on Software Engineering (ICSE). 2014. 435-445. Awarded ACM SIGSOFT Distinguished Paper Award. [DOI]
Siddharth Subramanian, Laura Inozemtseva, and Reid Holmes. Live API Documentation. In Proceedings of the International Conference on Software Engineering (ICSE). 2014. 643-652. [DOI]
Laura Inozemtseva, Siddharth Subramanian, and Reid Holmes. Integrating Software Project Resources Using Source Code Identifiers. In Proceedings of the International Conference on Software Engineering (ICSE), New Ideas and Emerging Results (NIER) Track. 2014. 400-403. [DOI]
Reid Holmes, Michelle Craig, Karen Reid, and Eleni Stroulia. Lessons Learned Managing Distributed Software Engineering Courses. In Proceedings of the International Conference on Software Engineering (ICSE), Software Engineering Education and Training (SEET) track. 2014. 321-324. [DOI]
Oleksii Kononenko, Olga Baysal, Reid Holmes, and Mike Godfrey. DASHboards: Enhancing Developer Situational Awareness. In Proceedings of the International Conference on Software Engineering (ICSE), Tool Demonstration Track. 2014. 552-555. [DOI]
Quinn Hanam, Lin Tan, Reid Holmes, and Patrick Lam. Finding Patterns in Static Analysis Alerts: Improving Actionable Alert Ranking In Proceedings of the Working Conference on Mining Software Repositories (MSR). 2014. 152-161. [DOI]
Oleksii Kononenko, Olga Baysal, Reid Holmes, and Michael W. Godfrey. Mining Modern Repositories with Elasticsearch. In Proceedings of the Working Conference on Mining Software Repositories (MSR). 2014. 328-331. [DOI]
2013
Yuriy Brun, Reid Holmes, Michael D. Ernst, and David Notkin. Early Detection of Collaboration Conflicts and Risks. IEEE Transactions on Software Engineering (TSE). 39(10):1359-1375. October 2013. [DOI]
Olga Baysal, Reid Holmes, and Michael W. Godfrey. Developer Dashboards: The Need For Qualitative Analytics. IEEE Software. 30(4):46-52. July-August 2013. [DOI]
Laura Inozemtseva, Hadi Hemmati and Reid Holmes. Using Fault History to Improve Mutation Reduction. In Proceedings of the New Ideas Track at the Symposium on the Foundations of Software Engineering (ESEC/FSE). 2013. 639-642. [DOI]
Olga Baysal, Reid Holmes, and Michael W. Godfrey. Situational Awareness: Personalizing Issue Tracking Systems. In Proceedings of the New Ideas and Emerging Results (NIER) Track at the International Conference on Software Engineering. 2013. 1185-1188. [ACM]
Laura Inozemtseva, Reid Holmes, and Robert J. Walker. Recommendations in the Small. Book chapter in Recommendation Systems in Software Engineering. Ed. Martin Robillard, Walid Maalej, Robert J. Walker and Thomas Zimmermann. Springer, 2014. 77-92.
Robert J. Walker and Reid Holmes. Simulation. Book chapter in Recommendation Systems in Software Engineering. Ed. Martin Robillard, Walid Maalej, Robert J. Walker and Thomas Zimmermann. Springer, 2014. 301-327.
Hadi Hemmati, Sarah Nadi, Olga Baysal, Oleksii Kononenko, Wei Wang, Reid Holmes, and Michael W. Godfrey. The MSR cookbook: mining a decade of research. In Proceedings of the Working Conference on Mining Software Repositories (MSR). 2013. 343-353. [ACM]
Olga Baysal, Oleksii Kononenko, Reid Holmes, and Michael W. Godfrey. The Influence of Non-technical Factors on Code Review. In Proceedings of the Working Conference on Reverse Engineering (WCRE). 2013. TO APPEAR. Awarded Distinguished Paper Award.[DOI]
Olga Baysal, Oleksii Kononenko, Reid Holmes, and Michael W. Godfrey. Extracting Artifact Lifecycle Models From Metadata History. In Proceedings of the ICSE Workshop on Data Analysis Patterns in Software Engineering (DAPSE). 2013. 4 pages, TO APPEAR.
Siddharth Subramanian and Reid Holmes. Making Sense of Online Code Snippets. In Proceedings of the Working Conference on Mining Software Repositories (MSR). 2013. 85-88. [ACM]
Siddharth Subramanian, Laura Inozemtseva and Reid Holmes. Live API Documentation. University of Waterloo Technical Report CS-2013-17, 10 pages, 2013.
2012
Reid Holmes and Robert J. Walker. Systematizing Pragmatic Software Reuse ACM Transactions on Software Engineering and Methodology (TOSEM). 21(4):1-44, November 2012. [DOI]
Kıvanç Muşlu, Yuriy Brun, Reid Holmes, Michael D. Ernst, and David Notkin. Speculative Analysis of Integrated Development Environment Recommendations. In Proceedings of the International Conference on Object Oriented Programming Systems Languages and Applications (OOPSLA). 2012. 669-682. [DOI]
Kıvanç Muşlu, Yuriy Brun, Reid Holmes, Michael D. Ernst, and David Notkin. Improving IDE recommendations by considering global implications of existing recommendations. In Proceedings of the New Ideas and Emerging Results Track (NIER) at the International Conference on Software Engineering (ICSE). 2012. 1349-1352. [DOI]
Olga Baysal, Reid Holmes and Michael W. Godfrey. Mining Usage Data and Development Artifacts. In Proceedings of the Working Conference on Mining Software Repositories (MSR). 2012. 98-107. [DOI]
Olga Baysal, Oleksii Kononenko, Reid Holmes, and Michael W. Godfrey. The Secret Life of Patches: A Firefox Case Study. In Proceedings of the Working Conference on Reverse Engineering (WCRE). 2012. 447-455, 2012. [DOI]
Oleksii Kononenko, David Dietrich, Rahul Sharma, and Reid Holmes. Automatically locating relevant programming help online.In Proceedings of the Symposium on Visual Languages and Human-Centric Computing (VLHCC). 2012. 127-134. [DOI]
Yuriy Brun, Kıvanç Muşlu, Reid Holmes, Michael D. Ernst, and David Notkin. Predicting Development Trajectories to Prevent Collaboration Conflicts. In Proceedings of the Future of Collaborative Software Development (FCSD) at the International Conference on Computer Supported Cooperative Work (CSCW). 2012. 4 pages.
Reid Holmes, David Notkin, and Mark Hancock. Industrially Validating Longitudinal Static and Dynamic Analyses. In Proceedings of the User evaluation for Software Engineering Researchers (USER) Workshop at the International Conference on Software Engineering (ICSE). 2012. 43-44. [DOI]
Olga Baysal, Reid Holmes, and Michael W. Godfrey. Revisiting Bug Triage and Resolution Practices. In Proceedings of the User evaluation for Software Engineering Researchers (USER) Workshop at the International Conference on Software Engineering (ICSE). 2012. 29-30. [DOI]
Olga Baysal and Reid Holmes. A Qualitative Study of Mozilla's Process Management Practices. University of Waterloo Technical Report CS-2012-10, 35 pages, 2012.
2011
Yuriy Brun, Reid Holmes, Michael D. Ernst, and David Notkin. Proactive Detection of Collaboration Conflicts. In Proceedings of the Symposium on the Foundations of Software Engineering (ESEC/FSE). 2011. 168-178. Awarded ACM SIGSOFT Distinguished Paper Award. [DOI]
Yuriy Brun, Reid Holmes, Michael D. Ernst, and David Notkin. Crystal: Precise and Unobtrusive Conflict Warnings. In Proceedings of the Symposium on the Foundations of Software Engineering (ESEC/FSE). Research Demonstration. 2011. 444-447. [DOI]
Reid Holmes and David Notkin. Identifying Program, Test, and Environmental Changes That Affect Behaviour. In Proceedings of the International Conference on Software Engineering (ICSE). 2011. 371-380. [DOI]
Reid Holmes and David Notkin. Identifying Opaque Behavioural Changes. In Proceedings of the International Conference on Software Engineering (ICSE). Research Demonstration. 2011. 995-997. [DOI]
2010
Yuriy Brun, Reid Holmes, Michael D. Ernst, and David Notkin. Speculative Analysis: Exploring Future Development States of Software. In Proceedings of the Future of Software Engineering Research at the International Symposium on the Foundations of Software Engineering (FoSER). 2010. 59-64. [DOI]
Reid Holmes and Robert J. Walker. Customized Awareness: Recommending Relevant External Change Events. In Proceedings of the International Conference on Software Engineering (ICSE). 2010. 465-474. [DOI]
Reid Holmes and David Notkin. Enhancing Static Source Code Search With Dynamic Data. In Proceedings of the International Workshop on Search-Driven Development - Users, Infrastructure, Tools and Evaluation (SUITE). 2010. 13-16.[DOI]
2009
Reid Holmes, Tristan Ratchford, Martin P. Robillard, and Robert J. Walker. Automatically Recommending Triage Decisions for Pragmatic Reuse Tasks. In Proceedings of the International Conference on Automated Software Engineering (ASE). 2009. 397-408. [DOI]
Rylan Cottrell, Brina Goyette, Reid Holmes, Robert J. Walker, and Joerg Denzinger. Compare and Contrast: Visual Exploration of Source Code Examples. In Proceedings of the International Workshop on Visualizing Software for Understanding and Analysis (VISSOFT). 2009. 29-32. [DOI]
Reid Holmes, Rylan Cottrell, Robert J. Walker, and Joerg Denzinger. The End-to-End Use of Source Code Examples: An Exploratory Study. In Proceedings of the International Conference on Software Maintenance (ICSM). 2009. 555-558. [DOI]
Reid Holmes, Rylan Cottrell, Robert J. Walker, and Joerg Denzinger. The End-to-End Use of Source Code Examples: An Exploratory Study - Appendix. University of Calgary Technical Report. TR-2009-934-13. 8 pg. [DOI]
Reid Holmes and Robert J. Walker. Developer-Specific Awareness of External Changes. In Proceedings of the International Workshop on Socio-Technical Congruence (STC). 2009. 4pg.
Reid Holmes. Do developers search for source code examples using multiple facts?. In Proceedings of the International Workshop on Search-Driven Development - Users, Infrastructure, Tools and Evaluation (SUITE). 2009. 13-16. [DOI]
2008
Reid Holmes. Pragmatic Software Reuse. Ph.D. Dissertation. 255 pages. 2008. [Print PDF]
Reid Holmes and Robert J. Walker. Semi-Automating Pragmatic Reuse Tasks. In Proceedings of the International on Automating Software Engineering, Research Demonstration, 2008. 481-482. [DOI]
Reid Holmes and Robert J. Walker. Lightweight, Semi-Automated Enactment of Pragmatic-Reuse Plans. In Proceedings of the International Conference on Software Reuse, 2008. 330-342. [DOI]
Reid Holmes and Andrew Begel. Deep Intellisense: A Tool for Rehydrating Evaporated Information. In Proceedings of the Working Conference on Mining Software Repositories, 2008. 23-26. [DOI]
Reid Holmes and Robert J. Walker. Promoting Developer-Specific Awareness. In Proceedings of the Workshop on Cooperative and Human Aspects of Software Engineering at the International Conference on Software Engineering, 2008. 61-64. [DOI]
Reid Holmes and Robert J. Walker. A Newbie's Guide to Eclipse APIs. In Proceedings of the Working Conference on Mining Software Repositories, Challenge Track, 2008. 149-152. Winner of the 2008 MSR Mining Challenge. [DOI]
2007
Reid Holmes and Robert J. Walker. Informing Eclipse API production and consumption. In Proceedings of the Eclipse Technology Exchange (Montreal, Qc, Canada. October 21, 2007). eTX '07. 70-74. Awarded Best Talk. [DOI]Reid Holmes and Robert J. Walker. Supporting task-specific source code dependency investigation. In Proceedings of the 4th IEEE International Workshop on Visualizing Software for Understanding and Analysis (Banff, Ab, Canada. June 26, 2007). VISSOFT '07. 100-108. [DOI]
Reid Holmes and Robert J. Walker. Supporting the investigation and planning of pragmatic reuse tasks. In Proceedings of the International Conference on Software Engineering (Minneapolis, MN, USA. May 25, 2007). ICSE '07. ACM Press, New York, NY, 447-457. [DOI]
2006
Reid Holmes, Robert J. Walker, and Gail C. Murphy. Approximate structural context matching: An approach for recommending relevant examples. IEEE Transactions on Software Engineering, 32(12):952-970, December 2006. [DOI]Reid Holmes. Unanticipated Reuse of Large-Scale Software Features. In Proceedings of the 28th International Conference on Software Engineering (Shanghai, China. May 23, 2006). ICSE '06. ACM Press, New York, NY, 961-964. Doctoral Symposium. [DOI]
Robert J. Walker, Reid Holmes, Ian Hedgeland, Puneet Kapur, and Andrew Smith. A Lightweight Approach to Technical Risk Estimation via Probabilistic Impact Analysis. Proceedings of the 4th International Workshop on Mining Software Repositories at the 28th International Conference on Software Engineering (Shanghai, China. May 22, 2006). MSR '06. ACM Press, New York, NY, 98-104. [DOI]
2005
Holmes, R., Walker, R. J., and Murphy, G. C. 2005. Strathcona example recommendation tool. In Proceedings of the 10th European Software Engineering Conference Held Jointly with 13th ACM SIGSOFT international Symposium on Foundations of Software Engineering (Lisbon, Portugal. September 08, 2005). ESEC/FSE-13. ACM Press, New York, NY, 237-240. Research Demonstration. [DOI]Holmes, R. and Murphy, G. C. 2005. Using structural context to recommend source code examples. In Proceedings of the 27th international Conference on Software Engineering (St. Louis, MO, USA. May 18, 2005). ICSE '05. ACM Press, New York, NY, 117-125. Awarded ACM SIGSOFT Distinguished Paper Award. [DOI]
2004
Holmes, R. Using Structural Context to Recommend Source Code Examples. Masters Thesis. (Vancouver, BC, Canada. Aug 24, 2004).
2003
Cubranic, Holmes, Ying and Murphy. Tools for Light-weight Knowledge Sharing in Open-source Software Development. Position paper for the Workshop on Open Source Software: Taking Stock of the Bazaar at ICSE. (Portland, OR, USA. May 3, 2003). 25-29. ICSE '03.Chan, A., Holmes, R., Murphy, G. C., Ying, A. T. T. Scaling an Object-Oriented System Execution Visualizer through Sampling. 11th International Workshop on Program Comprehension (Portland, OR, USA. May 11, 2003). IWPC-11. 2003. 237-244. [DOI]