Supplementary Information for the study: Capturing Cost Avoidance through Reuse: Systematic Literature Review and Industrial Evaluation Authors Mohsin Irshad ([email protected]) Richard Torkar ([email protected]) Kai Petersen ([email protected]) Wasif Afzal ([email protected])

Capturing Cost Avoidance through Reuse: Systematic Literature Review and Industrial Evaluation

1

SLR Data extraction form. 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28

General information Date of data extraction Article title Authors names No of references Journal/conference/conference proceedings Date of publication Specific information Study context (academia or industry) Research methodology: literature review/systematic review case study/experiment/survey/action research Study subjects Professional/student Specific questions to cover RQs from this study Name of the presented model How was the model presented? Equation/diagrams/description On what grounds model is constructed What were the aims of the article? Is this model an extended form of any other model? Can the model calculate costs avoided through quality improvements? What metrics need to be collected in order to apply the model? Does the model provide guidelines on how to collect the metrics? What is the basic formula used by this model? Can the model calculate costs avoided through artefacts other than software code? How can model calculate costs avoided through artefacts other than code reuse? What different types of software artefacts were considered in the article? Was the model validated in industry? Was the model validated in academia? Does the model provide details of validation in industry? Is the model dependent on organisational, technical or managerial processes in the industry? Is the model dependent on systematic reuse processes? Any assumption which the model makes?

Capturing Cost Avoidance through Reuse: Systematic Literature Review and Industrial Evaluation 2

Phases of search strategy

• ACM Digital Library • IEEE Xplorer • Springer Link • Science Direct • Engineering Village • Willey Inter Science • ISI web of Science

3

Mohsin Irshad et al.

Articles without full text. 1

2

3 4 5

6

7

8 9 10 11 12

13

Baldo Jr., J. (1998). A measurement framework for organizational software reuse attributes. 4th International Conference on Computer Science and Informatics, JCIS 1998, October 23–28, Research Triangle Park, NC, United states, Duke University Press Lamine, S. B. A. B., Jilani, L. L. and Gh´ ezala, H. H. B. (2008). A software cost estimation meta-model for systematic reuse approaches. Proceedings of the 2008 International Conference on Software Engineering Research and Practice, July 14–17, Las Vegas, NV, United states. Bond, S. (1991). The economics of reuse. Bott, F. (1998). Financial models of software component reuse. Proceedings of the European Software Measurement Conference, 6–8 May 1998, Antwerpen, Belgium. Coulange, B. (1993). The economic impact of reuse. Proceedings of Sixth International Conference on Software Engineering and Its Applications, 15–19 Nov. 1993, Nanterre Cedex, France. Cruickshank, R. D. and Gaffney, J. E. (1993). An economics model of software reuse: Analytical methods in software engineering economics. Berlin, Germany, Springer-Verlag: pp. 99–137. de Lucia, A., di Lucca, G. A. and Fasolino, A. R. (1993). Towards the evaluation of reengineering effort to reuse existing software. Proceedings of AQUIS ’93. 2nd International Conference on Achieving Quality in Software, pp. 18–20 Oct. 1993, Pisa, Italy, IEI-CNR. Frakes, W. B. (1991). Software reuse: Payoff and transfer. Proceedings of AIAA Computing in Aerospace 8, pp. 829–831, Baltimore, MD, USA. Gaffney, J. (1989). Economics foundation for software reuse. Proceedings of AIAA Computers in Aerospace 7, Monterey, CA, USA. Hagerfj¨ all, B. (1997). Reuse of software will cut costs. Nordic Steel and Mining Review (3):107–. Henderson-Sellers, B. (1993). The economics of reusing library classes. Journal of ObjectOriented Programming 6(4):43–50. Joiner, H. F. (1990). Economic analysis of software reuse—A model study. Proceedings of Eighth Annual National Conference on Ada Technology, 5–8 March 1990, Fort Monmouth, NJ, USA. Korkmaz, M. and Mili, A. (2007). A product line of software reuse cost models. Proceedings of the 2nd International Conference on Software and Data Technologies, ICSOFT 2007, July 22–25, Barcelona, Spain.

Capturing Cost Avoidance through Reuse: Systematic Literature Review and Industrial Evaluation

4

Initial list of cost models. 1

2 3 4 5 6 7 8 9

10 11 12 13 14 15 16 17 18

19

20 21 22

23 24

25 26 27 28

29

30

Margono, J. and Rhoads, T. E. (1992). Software reuse economics: Cost-benefit analysis on a largescale ada project. In Proceedings of the 14th International Conference on Software Engineering. ACM, New York, NY, USA, 338–348. Schimsky, D. (1992). Software reuse—Some realities. Vitro Tech. Journal 10, 1, 47–57. Malan, R. A. and Wentzel , K. (1993). Economics of software reuse, revisited. Technical Report HPL-93-31, Hewlett Packard Laboratories. Frakes, W. and Terry, C. (1994). Reuse level metrics. In Proceedings of the Third International Conference on Software Reuse: Advances in Software Reusability. 139–148. Kain, J. (1994). Measuring the ROI of reuse. Object Magazine 4, 3, 48–54 Lim , W. (1994). Effects of reuse on quality, productivity, and economics. IEEE Software 11, 5, 23–30. Boehm , B., Clark , B., Horowitz , E., Westlan, C., Madachy, R., and Selby, R. (1995). Cost models for future software life cycle processes: COCOMO 2.0. Annals of Software Engineering 1, 57–94. Mili, R. (1996). Return on investment of reusable components: Analytical and empirical approaches. Technical Report, University of Ottawa, Ottawa, ON, Canada. Devanbu, P., Karstu, S., Melo, W., and Thomas, W. (1996). Analytical and empirical evaluation of software reuse metrics. In Proceedings of the 18th International Conference on Software engineering. IEEE Computer Society, Washington, DC, USA, 189–199. Poulin, J. S. (1997). The economics of software product lines. International Journal of Applied Software Technology 3, 1, 20–34. Favaro, J. M., Favaro, K. R., and Favaro, P. F. (1998). Value based software reuse investment. Annals of Software Engineering 5, 5–52. Center for Software Engineering, (1999). COCOTS. Technical Report. University of Southern California, Los Angeles, CA, USA Gaffney, J. E. and Durek, T. A. (1989). Software reuse key to enhanced productivity: Some quantitative models. Information Software and Technology 31, 258–267. Barnes, B. H. and Bollinger, T. (1991). Making reuse cost-effective. IEEE Software 8, 1, 13–24. Bollinger, T. B. and Pfleeger, S. L. (1990). Economics of reuse: Issues and alternatives. Information Software and Technology. 32, 643–652. Mili, A., Fowler Chmiel, S., Gottumukkalla, R., and Zhang, L. (2001). Managing software reuse economics: An integrated ROI-based model. Annals of Software Engineering 11, 175–218. Balda, D. and Gustafson, D. A. (1990). Cost estimation models for reuse and prototype SW development life-cycles. SIGSOFT Software Engineering Notes 15, 42–50. Tomer, A., Goldin, L., Kuflik, T., Kimchi, E., and Schach, S. R. (2004). Evaluating software reuse alternatives: A model and its application to an industrial case study. IEEE Transactions on Software Engineering 30, 601–612. Noseck , H. (1994). Cost-benefit analysis for software-reuse a decision procedure. In Ada in Europe, M. Toussaint, Ed. Lecture Notes in Computer Science Series, vol. 887. Springer Berlin Heidelberg, 397–405. DISA/JIE/CIM, Software Reuse Metric Plan. version 4.1, 4 August, 1993. Amar, L. and Coffey, J. (2005). Measuring the benefits of software reuse—Examining three different approaches to software reuse. Dr. Dobb’s Journal 30, 73–76. Raymond, G. E. and Hollis, D. M. (1991). Software reuse economics model: Version 1.0. In Proceedings of the 8th Annual Washington Ada Symposium: Summer SIGAda meeting on Ada. ACM, New York, NY, USA, 141–155. Kang, K. and Levy, L. (1989). Software methodology in the harsh light of economics. Information and Software Technology 31, 5, 239–250. Mayobre, G. (1991). Using code reusability analysis to identify reusable components from the software related to an application domain. In Proceedings of the 4th Annual Workshop on Software Reuse. Henderson-Sellers, B. (1993). The economics of reusing library classes. Journal of Object Oriented Programming 6, 43–50. Postmus, D. and Meijler, T. D. (2008). Aligning the economic modeling of software reuse with reuse practices. Information Software and Technology. 50, 753–762. Poulin, J. S. and Caruso, J. M. (1993). A reuse measurement and return on investment model. In Proceedings of the 2nd International Workshop on Software Reusability. 152–166. Jasmine, K. S. and Vasantha, R. (2008). Cost estimation model for reuse based software products. In Proceedings of the International MultiConference of Engineers and Computer Scientists. 19– 21. Favaro, J. (1996). A comparison of approaches to reuse investment analysis. In Proceedings of the 4th International Conference on Software Reuse. IEEE Computer Society, Washington, DC, USA 136–. Poulin, J. S., Caruso, J. M. and Hancock, D. R. (1993). The business case for software reuse. IBM Systems Journal 32(4):567–594.

5

Mohsin Irshad et al.

Table 13 Results of applying quality assessment checklist. √ indicates Yes. indicates No. Quality Assessment Checklist Does the article clearly define the context of study? Is the introduction and background provided in detail? Is this article cited by other articles? Is the research methodology defined in detail? Are the findings closely related to each other? Do the objectives of research and conclusion relate to each other? Is this research useful for Software engineering industry? Does the article report any negative findings?

[16] √

[32] √

[33] √

√

√

√











√

√

√

√

√

√

√

√

√







√

Capturing Cost Avoidance through Reuse: Systematic Literature Review and Industrial Evaluation

Fig. 1 A snapshot of tool

6