Revisiting Software Development Effort Estimation Based on Early Phase Development Activities

Authors -

Masateru, Tsunoda; Koji, Toda; Kyohei, Fushida; Yasutaka, Kamei; Meiyappan, Nagappan and Ubayashi, Naoyasu

Venue -

In Proceedings of the 10th ACM/IEEE Working Conference on Mining Software Repositories (MSR 2013), San Francisco, CA, USA, May 18 19, 2013

Related Tags -

• MSR
• Defect Prediction
• 2013

Abstract -

One of the goals of software engineering research is to achieve generality: Are the phenomena found in a few projects reflective of others? Will a technique perform as well on projects other than the projects it is evaluated on? While it is common sense to select a sample that is representative of a population, the importance of diversity is often overlooked, yet as important. In this paper, we combine ideas from representativeness and diversity and introduce a measure called sample coverage, defined as the percentage of projects in a population that are similar to the given sample. We introduce algorithms to compute the sample coverage for a given set of projects and to select the projects that increase the coverage the most. We demonstrate our technique on research presented over the span of two years at ICSE and FSE with respect to a population of 20,000 active open source projects monitored by Ohloh.net. Knowing the coverage of a sample enhances our ability to reason about the findings of a study. Furthermore, we propose reporting guidelines for research: in addition to coverage scores, papers should discuss the target population of the research (universe) and dimensions that potentially can influence the outcomes of a research (space)

Preprint -

PDF

BibTex -

@article{Tsunoda2013,
 author = {Masateru, Tsunoda and Koji, Toda and Kyohei, Fushida and Yasutaka, Kamei and Meiyappan, Nagappan and Naoyasu Ubayashi},
 keyword = {Defect Prediction},
 title = {Revisiting Software Development Effort Estimation Based on Early Phase Development Activities},
 type = {conference},
 venue = {In Proceedings of the 10th ACM/IEEE Working Conference on Mining Software Repositories (MSR 2013), San Francisco, CA, USA, May 18  19, 2013}
}