S.O.B (Save Our Budget) - A Simulation-Based Method for Prediction of Acquisition Costs of Constituents of a System-of-Systems
DOI:
https://doi.org/10.5753/isys.2019.779Abstract
Software economics, acquisition, and pricing are important con- cerns for Systems-of-Systems (SoS). SoS are alliances of independent software- intensive systems combined to offer holistic functionalities as a result of the con- stituents interoperability. SoS engineering involves separately acquiring con- stituents and combining them to form the SoS. Despite the existence of cost pre- diction techniques, predicting SoS acquisition costs at design-time should also include the analysis of different suppliers of constituents, their respective prices and quality. However, known methods cover only two out of these three param- eters. The main contribution of this article is to present the S.O.B. (Save Our Budget) method, a novel simulation-based method to predict, at design-time, the acquisition cost of constituents, while still considering quality attributes and different suppliers. Results of a case study in the Smart Building domain re- vealed that S.O.B. method supports a precise prediction of acquisition cost of constituents to build a SoS for that domain. Furthermore, it also contributes to estimate the cost based on a pre-established quality attribute (functional suit- ability), as well as to support the selection of coalition that exhibits better results through the analysis of cost-benefit ratio.
Downloads
Download data is not yet available.
References
Acker, D. D. (1983). Defense systems acquisition review process: A history and evalua-tion. Technical report, Defense Systems Management Coll Fort Belvoir Va.
Agner, L. T. W., Soares, I. W., Stadzisz, P. C., and Sim ?ao, J. M. (2013). A BrazilianSurvey on UML and Model-driven Practices for Embedded Software Development.J.Syst. Software, 86(4):997-1005.
Akintoye, A. and Fitzgerald, E. (2000). A survey of current cost estimating practices inthe uk.Construction Management & Economics, 18(2):161-172.
Amorim, S. S., McGregor, J. D., de Almeida, E. S., and von Flach G. Chavez, C. (2017).The architect's role in software ecosystems health. InWASHES, pages 1-4.
Asiedu, Y. and Besant, R. (2000). Simulation-based cost estimation under economicuncertainty using kernel estimators. International Journal of Production Research,38(9):2023-2035.
Axelsson, J. (2018). An initial analysis of operational emergent properties in a platooningsystem-of-systems. In2018 Annual IEEE International Systems Conference (SysCon),pages 1-8.
Basili, V., Caldiera, G., and Rombach, H. D. (1992). Software modeling and measure-ment: the goal/question/metric paradigm. Technical Report CS-TR-2956, UMIACS-TR-92-96, University of Maryland, College Park, Maryland, USA.
Bass, L., Clements, P., and Kazman, R. (2012).Software Architecture in Practice.Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.
Boehm, B., Abts, C., and Chulani, S. (2000). Software development cost estimationapproaches-a survey.Annals of software engineering, 10(1-4):177-205.
Burton, F. R., Paige, R. F., Poulding, S., and Smith, S. (2014). System of systems acqui-sition trade-offs.Procedia Computer Science, 28:11-18.
Burton et al. (2012). Solving acquisition problems using model-driven engineering. InECMFA, volume 7349, pages 428-443, Lyngby, Denmark. Springer.
Cavalcante, E., Batista, T. V., and Oquendo, F. (2015). Supporting dynamic software ar-chitectures: From architectural description to implementation. InWICSA 2015, pages31-40, Montreal, Canada. IEEE.
de Oliveira Neves, V., Bertolino, A., Angelis, G. D., and Garces, L. (2018). Do we neednew strategies for testing systems-of-systems? In6th IEEE/ACM International Work-shop on Software Engineering for Systems-of-Systems, SESoS@ICSE 2018, Gothen-burg, Sweden, May 29, 2018, pages 29-32.
Gassara, A., Bouassida, I., and Jmaiel, M. (2017). A tool for modeling sos architecturesusing bigraphs. In32nd Symposium on Applied Computing (SAC 2017), pages 1787-1792, Marrakech, Morocco. ACM.
Graciano Neto, V. V., Guessi, M., Oliveira, L. B. R., Oquendo, F., and Nakagawa, E. Y.(2014). Investigating the model-driven development for systems-of-systems. In Proceedings of the 2014 European Conference on Software Architecture Workshops, EC-SAW '14, pages 22:1-22:8, Vienna, Austria. ACM.
Graciano Neto, V. V., Horita, F. E. A., Santos, R. P., Viana, D., and Kassab, M. (2018a).How much does it cost? a simulation-based method for cost prediction in systems-of-systems acquisition processes. In WASHES, pages 1-10, Natal, Brazil.
Graciano Neto, V. V., Manzano, W., Kassab, M., and Nakagawa, E. Y. (2018b). Model-based engineering & simulation of software-intensive systems-of-systems: experiencereport and lessons learned. InProceedings of the 12th European Conference on Soft-ware Architecture: Companion Proceedings, ECSA 2018, Madrid, Spain, September24-28, 2018, pages 27:1-27:7.
Graciano Neto, V. V., Oquendo, F., and Nakagawa, E. Y. (2017a).Smart Systems-of-Information Systems: Foundations and an Assessment Model for Research Develop-ment, pages 1-12. Brazilian Computer Society, Porto Alegre, Brazil.
Graciano Neto, V. V., Paes, C. E., Garc ?es, L., Guessi, M., Oquendo, F., and Nakagawa,E. Y. (2017b). Stimuli-SoS: A model-based approach to derive stimuli generators insimulations of software architectures of systems-of-systems.
Graciano Neto, V. V., Rodriguez, L. M. G., Guessi, M., Paes, C., Manzano, W., Oquendo,F., and Nakagawa, E. Y. (2018c). ASAS: an approach to support simulation of smartsystems. In51st Hawaii International Conference on System Sciences - HICSS 2018,pages 5777-5786, Hilton Waikoloa Village, Hawaii, USA. IEEE.
Gregor, S. and Hevner, A. R. (2013). Positioning and presenting design science researchfor maximum impact.MIS quarterly, pages 337-355.
Hachem, J. E., Pang, Z. Y., Chiprianov, V., Babar, A., and Aniort ?e, P. (2016). Modeldriven software security architecture of systems-of-systems. In23rd Asia-Pacific Soft-ware Engineering Conference, pages 89-96, Hamilton, New Zealand. IEEE.ISO (2011). Iso/iec/ieee systems and software engineering - architecture description.
ISO/IEC/IEEE 42010:2011(E) (Revision of ISO/IEC 42010:2007 and IEEE Std 1471-2000), pages 1-46.ISO/IEC (2011).
ISO/IEC 25010 - Systems and software engineering - Systems and soft-ware Quality Requirements and Evaluation (SQuaRE) - System and software qualitymodels. Technical report.
Johnson, S. B. (2015). System health management. In Rainey, L. B. and Tolk, A., editors,Modeling and Simulation Support for System of Systems Engineering Applications,pages 131-144. Wiley, Hoboken, New Jersey, USA.
Lowe, P. N. and Chen, M. W. (2008). System of systems complexity: Modeling andsimulation issues. InProceedings of the 2008 Summer Computer Simulation Confer-ence, SCSC '08, pages 36:1-36:10, Vista, CA. Society for Modeling & SimulationInternational.
Maier, M. W. (1998). Architecting principles for systems-of-systems.Systems Engineer-ing, 1(4):267-284.
Manzano, W., Graciano Neto, V. V., and Nakagawa, E. Y. (2018). Dynamic-SoS: An ap-proach for the simulation of system-of-systems dynamic architectures.The ComputerJournal, X:1-23. Accepted for Publication.
Moløkken-Østvold, K., Jørgensen, M., Tanilkan, S. S., Gallis, H., Lien, A. C., and Hove,S. (2004). A survey on software estimation in the norwegian industry. In10th Inter-national Symposium on Software Metrics, 2004. Proceedings., pages 208-219. IEEE.
Neto, A. A. and Conte, T. (2013). A conceptual model to address threats to validityin controlled experiments. InProceedings of the 17th International Conference onEvaluation and Assessment in Software Engineering, EASE '13, pages 82-85, Portode Galinhas, Brazil. ACM.
Neto, V. V. G., Horita, F. E. A., Cavalcante, E., Rohling, A. J., Hachem, J. E., Santos,D. S., and Nakagawa, E. Y. (2018). A study on goals specification for systems-of-information systems: Design principles and a conceptual model. InProceedings of theXIV Brazilian Symposium on Information Systems, SBSI 2018, Caxias do Sul, Brazil,June 04-08, 2018, pages 21:1-21:8.
Nielsen, C. B., Larsen, P. G., Fitzgerald, J., Woodcock, J., and Peleska, J. (2015). Systemsof Systems Engineering: Basic Concepts, Model-Based Techniques, and Research Di-rections.ACM Comput. Surv., 48(2):18:1-18:41.
Olagbemiro, A., Shing, M.-T., and Mun, J. (2009). Application of real options theory tosoftware-intensive system acquisitions. Technical report, NAVAL POSTGRADUATESCHOOL MONTEREY CA DEPT OF COMPUTER SCIENCE.
Oquendo, F. (2016). Formally Describing the Software Architecture of Systems-of-Systems with SosADL. In11th Annual System of Systems Engineering (SOSE 2016),pages 1-6, Kongsberg, Norway. IEEE.
Ricci, N., Rhodes, D. H., Ross, A. M., and Fitzgerald, M. E. (2013). Considering alterna-tive strategies for value sustainment in systems-of-systems. In2013 IEEE InternationalSystems Conference (SysCon), pages 725-730.
Robbins, W., Lam, S., and Lalancette, C. (2005). Towards a collaborative engineeringenvironment to support capability engineering. InProceedings of the 2005 INCOSEInternational Symposium, pages 211-221, Rochester, NY, USA.
Rodriguez, L. M. G. and Nakagawa, E. Y. (2017). A process to establish, model andvalidate missions of systems-of-systems in reference architectures. InSAC 2017, pages1765-1772, Marrakech, Morocco. ACM.
Runeson, P. and H ?ost, M. (2009). Guidelines for conducting and reporting case studyresearch in software engineering.Empirical Softw. Engg., 14(2):131-164.Seaman, C. B. (1999). Qualitative methods in empirical studies of software engineering.IEEE Transactions on software engineering, 25(4):557-572.
Sharma, N., Bajpai, A., and Litoriya, M. R. (2012). A comparison of software costestimation methods: A survey.The International Journal of Computer Science andApplications (TIJCSA), 1(3).
Silva, E., Batista, T., and Cavalcante, E. (2015). A mission-oriented tool for system-of-systems modeling. InSESoS, pages 31-36, Florence, Italy. IEEE.
Takakuwa, S. (1997). The use of simulation in activity-based costing for flexible manu-facturing systems. InWinter Simulation Conference Proceedings,, pages 793-800.
Urwin, E. N., Pilfold, S. A., and Henshaw, M. (2010). Through life capability man-agement: benefits and behaviours. InInternational Conference on Contemporary Er-gonomics and Human Factors, pages 153-162. CRC Press.
Weinreich, R. and Groher, I. (2016). The architect's role in practice: From decision makerto knowledge manager?IEEE Software, 33(6):63-69.
Wohlin, C., Runeson, P., H ?ost, M., Ohlsson, M. C., Regnell, B., and Wessl ?en, A. (2000).Experimentation in Software Engineering: An Introduction. Kluwer Academic Pub-lishers, Norwell, MA, USA.
Yang, D., Wang, Q., Li, M., Yang, Y., Ye, K., and Du, J. (2008). A survey on software costestimation in the chinese software industry. InProceedings of the Second ACM-IEEE nternational symposium on Empirical software engineering and measurement, pages253-262. ACM.Yang, I.-T. (2005). Simulation-based estimation for correlated cost elements.Interna-tional Journal of Project Management, 23(4):275 - 282.
Yin, R. K. (2017).Case study research and applications: Design and methods. Sagepublications.
Zeigler, B. P., Mittal, S., and Traore, M. K. (2018). Mbse with/out simulation: State ofthe art and way forward.Systems, 6(4).
Zeigler, B. P., Sarjoughian, H. S., Duboz, R., and Souli, J.-C. (2012).Guide to Modelingand Simulation of Systems of Systems. Springer, Berlim, Germany.
Agner, L. T. W., Soares, I. W., Stadzisz, P. C., and Sim ?ao, J. M. (2013). A BrazilianSurvey on UML and Model-driven Practices for Embedded Software Development.J.Syst. Software, 86(4):997-1005.
Akintoye, A. and Fitzgerald, E. (2000). A survey of current cost estimating practices inthe uk.Construction Management & Economics, 18(2):161-172.
Amorim, S. S., McGregor, J. D., de Almeida, E. S., and von Flach G. Chavez, C. (2017).The architect's role in software ecosystems health. InWASHES, pages 1-4.
Asiedu, Y. and Besant, R. (2000). Simulation-based cost estimation under economicuncertainty using kernel estimators. International Journal of Production Research,38(9):2023-2035.
Axelsson, J. (2018). An initial analysis of operational emergent properties in a platooningsystem-of-systems. In2018 Annual IEEE International Systems Conference (SysCon),pages 1-8.
Basili, V., Caldiera, G., and Rombach, H. D. (1992). Software modeling and measure-ment: the goal/question/metric paradigm. Technical Report CS-TR-2956, UMIACS-TR-92-96, University of Maryland, College Park, Maryland, USA.
Bass, L., Clements, P., and Kazman, R. (2012).Software Architecture in Practice.Addison-Wesley Longman Publishing Co., Inc., Boston, MA, USA.
Boehm, B., Abts, C., and Chulani, S. (2000). Software development cost estimationapproaches-a survey.Annals of software engineering, 10(1-4):177-205.
Burton, F. R., Paige, R. F., Poulding, S., and Smith, S. (2014). System of systems acqui-sition trade-offs.Procedia Computer Science, 28:11-18.
Burton et al. (2012). Solving acquisition problems using model-driven engineering. InECMFA, volume 7349, pages 428-443, Lyngby, Denmark. Springer.
Cavalcante, E., Batista, T. V., and Oquendo, F. (2015). Supporting dynamic software ar-chitectures: From architectural description to implementation. InWICSA 2015, pages31-40, Montreal, Canada. IEEE.
de Oliveira Neves, V., Bertolino, A., Angelis, G. D., and Garces, L. (2018). Do we neednew strategies for testing systems-of-systems? In6th IEEE/ACM International Work-shop on Software Engineering for Systems-of-Systems, SESoS@ICSE 2018, Gothen-burg, Sweden, May 29, 2018, pages 29-32.
Gassara, A., Bouassida, I., and Jmaiel, M. (2017). A tool for modeling sos architecturesusing bigraphs. In32nd Symposium on Applied Computing (SAC 2017), pages 1787-1792, Marrakech, Morocco. ACM.
Graciano Neto, V. V., Guessi, M., Oliveira, L. B. R., Oquendo, F., and Nakagawa, E. Y.(2014). Investigating the model-driven development for systems-of-systems. In Proceedings of the 2014 European Conference on Software Architecture Workshops, EC-SAW '14, pages 22:1-22:8, Vienna, Austria. ACM.
Graciano Neto, V. V., Horita, F. E. A., Santos, R. P., Viana, D., and Kassab, M. (2018a).How much does it cost? a simulation-based method for cost prediction in systems-of-systems acquisition processes. In WASHES, pages 1-10, Natal, Brazil.
Graciano Neto, V. V., Manzano, W., Kassab, M., and Nakagawa, E. Y. (2018b). Model-based engineering & simulation of software-intensive systems-of-systems: experiencereport and lessons learned. InProceedings of the 12th European Conference on Soft-ware Architecture: Companion Proceedings, ECSA 2018, Madrid, Spain, September24-28, 2018, pages 27:1-27:7.
Graciano Neto, V. V., Oquendo, F., and Nakagawa, E. Y. (2017a).Smart Systems-of-Information Systems: Foundations and an Assessment Model for Research Develop-ment, pages 1-12. Brazilian Computer Society, Porto Alegre, Brazil.
Graciano Neto, V. V., Paes, C. E., Garc ?es, L., Guessi, M., Oquendo, F., and Nakagawa,E. Y. (2017b). Stimuli-SoS: A model-based approach to derive stimuli generators insimulations of software architectures of systems-of-systems.
Graciano Neto, V. V., Rodriguez, L. M. G., Guessi, M., Paes, C., Manzano, W., Oquendo,F., and Nakagawa, E. Y. (2018c). ASAS: an approach to support simulation of smartsystems. In51st Hawaii International Conference on System Sciences - HICSS 2018,pages 5777-5786, Hilton Waikoloa Village, Hawaii, USA. IEEE.
Gregor, S. and Hevner, A. R. (2013). Positioning and presenting design science researchfor maximum impact.MIS quarterly, pages 337-355.
Hachem, J. E., Pang, Z. Y., Chiprianov, V., Babar, A., and Aniort ?e, P. (2016). Modeldriven software security architecture of systems-of-systems. In23rd Asia-Pacific Soft-ware Engineering Conference, pages 89-96, Hamilton, New Zealand. IEEE.ISO (2011). Iso/iec/ieee systems and software engineering - architecture description.
ISO/IEC/IEEE 42010:2011(E) (Revision of ISO/IEC 42010:2007 and IEEE Std 1471-2000), pages 1-46.ISO/IEC (2011).
ISO/IEC 25010 - Systems and software engineering - Systems and soft-ware Quality Requirements and Evaluation (SQuaRE) - System and software qualitymodels. Technical report.
Johnson, S. B. (2015). System health management. In Rainey, L. B. and Tolk, A., editors,Modeling and Simulation Support for System of Systems Engineering Applications,pages 131-144. Wiley, Hoboken, New Jersey, USA.
Lowe, P. N. and Chen, M. W. (2008). System of systems complexity: Modeling andsimulation issues. InProceedings of the 2008 Summer Computer Simulation Confer-ence, SCSC '08, pages 36:1-36:10, Vista, CA. Society for Modeling & SimulationInternational.
Maier, M. W. (1998). Architecting principles for systems-of-systems.Systems Engineer-ing, 1(4):267-284.
Manzano, W., Graciano Neto, V. V., and Nakagawa, E. Y. (2018). Dynamic-SoS: An ap-proach for the simulation of system-of-systems dynamic architectures.The ComputerJournal, X:1-23. Accepted for Publication.
Moløkken-Østvold, K., Jørgensen, M., Tanilkan, S. S., Gallis, H., Lien, A. C., and Hove,S. (2004). A survey on software estimation in the norwegian industry. In10th Inter-national Symposium on Software Metrics, 2004. Proceedings., pages 208-219. IEEE.
Neto, A. A. and Conte, T. (2013). A conceptual model to address threats to validityin controlled experiments. InProceedings of the 17th International Conference onEvaluation and Assessment in Software Engineering, EASE '13, pages 82-85, Portode Galinhas, Brazil. ACM.
Neto, V. V. G., Horita, F. E. A., Cavalcante, E., Rohling, A. J., Hachem, J. E., Santos,D. S., and Nakagawa, E. Y. (2018). A study on goals specification for systems-of-information systems: Design principles and a conceptual model. InProceedings of theXIV Brazilian Symposium on Information Systems, SBSI 2018, Caxias do Sul, Brazil,June 04-08, 2018, pages 21:1-21:8.
Nielsen, C. B., Larsen, P. G., Fitzgerald, J., Woodcock, J., and Peleska, J. (2015). Systemsof Systems Engineering: Basic Concepts, Model-Based Techniques, and Research Di-rections.ACM Comput. Surv., 48(2):18:1-18:41.
Olagbemiro, A., Shing, M.-T., and Mun, J. (2009). Application of real options theory tosoftware-intensive system acquisitions. Technical report, NAVAL POSTGRADUATESCHOOL MONTEREY CA DEPT OF COMPUTER SCIENCE.
Oquendo, F. (2016). Formally Describing the Software Architecture of Systems-of-Systems with SosADL. In11th Annual System of Systems Engineering (SOSE 2016),pages 1-6, Kongsberg, Norway. IEEE.
Ricci, N., Rhodes, D. H., Ross, A. M., and Fitzgerald, M. E. (2013). Considering alterna-tive strategies for value sustainment in systems-of-systems. In2013 IEEE InternationalSystems Conference (SysCon), pages 725-730.
Robbins, W., Lam, S., and Lalancette, C. (2005). Towards a collaborative engineeringenvironment to support capability engineering. InProceedings of the 2005 INCOSEInternational Symposium, pages 211-221, Rochester, NY, USA.
Rodriguez, L. M. G. and Nakagawa, E. Y. (2017). A process to establish, model andvalidate missions of systems-of-systems in reference architectures. InSAC 2017, pages1765-1772, Marrakech, Morocco. ACM.
Runeson, P. and H ?ost, M. (2009). Guidelines for conducting and reporting case studyresearch in software engineering.Empirical Softw. Engg., 14(2):131-164.Seaman, C. B. (1999). Qualitative methods in empirical studies of software engineering.IEEE Transactions on software engineering, 25(4):557-572.
Sharma, N., Bajpai, A., and Litoriya, M. R. (2012). A comparison of software costestimation methods: A survey.The International Journal of Computer Science andApplications (TIJCSA), 1(3).
Silva, E., Batista, T., and Cavalcante, E. (2015). A mission-oriented tool for system-of-systems modeling. InSESoS, pages 31-36, Florence, Italy. IEEE.
Takakuwa, S. (1997). The use of simulation in activity-based costing for flexible manu-facturing systems. InWinter Simulation Conference Proceedings,, pages 793-800.
Urwin, E. N., Pilfold, S. A., and Henshaw, M. (2010). Through life capability man-agement: benefits and behaviours. InInternational Conference on Contemporary Er-gonomics and Human Factors, pages 153-162. CRC Press.
Weinreich, R. and Groher, I. (2016). The architect's role in practice: From decision makerto knowledge manager?IEEE Software, 33(6):63-69.
Wohlin, C., Runeson, P., H ?ost, M., Ohlsson, M. C., Regnell, B., and Wessl ?en, A. (2000).Experimentation in Software Engineering: An Introduction. Kluwer Academic Pub-lishers, Norwell, MA, USA.
Yang, D., Wang, Q., Li, M., Yang, Y., Ye, K., and Du, J. (2008). A survey on software costestimation in the chinese software industry. InProceedings of the Second ACM-IEEE nternational symposium on Empirical software engineering and measurement, pages253-262. ACM.Yang, I.-T. (2005). Simulation-based estimation for correlated cost elements.Interna-tional Journal of Project Management, 23(4):275 - 282.
Yin, R. K. (2017).Case study research and applications: Design and methods. Sagepublications.
Zeigler, B. P., Mittal, S., and Traore, M. K. (2018). Mbse with/out simulation: State ofthe art and way forward.Systems, 6(4).
Zeigler, B. P., Sarjoughian, H. S., Duboz, R., and Souli, J.-C. (2012).Guide to Modelingand Simulation of Systems of Systems. Springer, Berlim, Germany.
Downloads
Published
2020-04-24
How to Cite
Graciano Neto, V. V., Horita, F. E. A., Santos, R., Viana, D., Kassab, M., Manzano, W., & Nakagawa, E. Y. (2020). S.O.B (Save Our Budget) - A Simulation-Based Method for Prediction of Acquisition Costs of Constituents of a System-of-Systems. ISys - Brazilian Journal of Information Systems, 12(4), 6–35. https://doi.org/10.5753/isys.2019.779
Issue
Section
Special issues articles
