User Tools

Site Tools


mbse:metricreferences

Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
mbse:metricreferences [2015/10/13 15:31]
jcwatson
mbse:metricreferences [2016/05/05 13:23] (current)
jcwatson
Line 5: Line 5:
 |  **[[http://​www.ndia.org/​Divisions/​Divisions/​SystemsEngineering/​Documents/​Committees/​M_S%20Committee/​2011/​February/​NDIA-SE-MS_2011-02-15_Bergenthal.pdf|Final Report- Model Based Engineering (MBE) Subcommittee]]** ​ |  Presentation ​ |Bergenthal,​ Jeff. Final Report- Model Based Engineering (MBE) Subcommittee. NDIA Systems Engineering Division M&S Committee. February 2011.|The presentation provides the final report of the NDIA Model Based Engineering Subcommittee. It provides potential MBE benefits, costs and risks, the current and to-be MBE state and some recommendations for going forward. ​ In addition it provides a large collection of MBE related papers, see slides 33 through 37. On chart 11 it references some of those papers to the acquisition life cycle.| |  **[[http://​www.ndia.org/​Divisions/​Divisions/​SystemsEngineering/​Documents/​Committees/​M_S%20Committee/​2011/​February/​NDIA-SE-MS_2011-02-15_Bergenthal.pdf|Final Report- Model Based Engineering (MBE) Subcommittee]]** ​ |  Presentation ​ |Bergenthal,​ Jeff. Final Report- Model Based Engineering (MBE) Subcommittee. NDIA Systems Engineering Division M&S Committee. February 2011.|The presentation provides the final report of the NDIA Model Based Engineering Subcommittee. It provides potential MBE benefits, costs and risks, the current and to-be MBE state and some recommendations for going forward. ​ In addition it provides a large collection of MBE related papers, see slides 33 through 37. On chart 11 it references some of those papers to the acquisition life cycle.|
 |  **{{:​mbse:​avsis_savi_program_proof_of_concept_demonstrations_don_ward_incose_mbse_workshop.pdf|AVSI’s SAVI Program: Proof of Concept Demonstrations}}** ​ |  Presentation ​ |Ward, Don. AVSI’s System Architecture Virtual Integration Program: Proof of Concept Demonstrations. ​ INCOSE IW 2013 MBSE Workshop. January 2013.|This presentation provides a summary description of the AVSI’s (Aerospace Vehicle Systems Institute) Systems Architecture Virtual Integration (SAVI) Proof of Concept project, it provides actual measured return on investment results of the project and it provides the next set of planned steps for the project.| |  **{{:​mbse:​avsis_savi_program_proof_of_concept_demonstrations_don_ward_incose_mbse_workshop.pdf|AVSI’s SAVI Program: Proof of Concept Demonstrations}}** ​ |  Presentation ​ |Ward, Don. AVSI’s System Architecture Virtual Integration Program: Proof of Concept Demonstrations. ​ INCOSE IW 2013 MBSE Workshop. January 2013.|This presentation provides a summary description of the AVSI’s (Aerospace Vehicle Systems Institute) Systems Architecture Virtual Integration (SAVI) Proof of Concept project, it provides actual measured return on investment results of the project and it provides the next set of planned steps for the project.|
 +|  **{{:​mbse:​how_product_development_organizations_can_achieve_long-term_savings_1_.pdf|How Product Development Organizations can Achieve Long-Term Cost Savings Using Model-Based Systems Engineering (MBSE)}}** ​ |  Paper Reference ​ |Krasner, Jerry. How Product Development Organizations can Achieve Long-Term Cost Savings Using Model-Based Systems Engineering (MBSE). October 2015.|A report by Embedded Market Forecasters (EMF), the market research division of American Technology International,​ Inc., reports measured improvements as a result of MBSE.  Their data set is based on 6 years of survey data totaling more than 4000 developer responses, and claims 95% +/- 3% statistical accuracy of conclusions from their 2015 data set. In summary, (1) MBSE delivers a 55% reduction in total development cost; (2) MBSE enables product-line engineering,​ which delivers a 42% reduction in cost compared to typical SE; (3) MBSE reduces design delays and cancellations,​ improves the relationship between pre-design expectations and final designs, enables faster completion of products, enables easy upgrades to meet new market opportunities,​ results in minimal redesign necessitated by changes in available hardware, minimizes the possibility of product recalls, and makes in-field support more cost effective because support personnel can more clearly understand design models and code.  |
 |  **[[http://​agileelements.wordpress.com/​2008/​04/​22/​cost-of-software-defects/​|Cost of Software Defects]]** ​ |  Web Reference ​ | Strickler,​Jon. Cost of Software Defects. Agile Elements. April 22, 2008.| This web site provides metrics associated with defects found in different phases of the development cycle. ​  | |  **[[http://​agileelements.wordpress.com/​2008/​04/​22/​cost-of-software-defects/​|Cost of Software Defects]]** ​ |  Web Reference ​ | Strickler,​Jon. Cost of Software Defects. Agile Elements. April 22, 2008.| This web site provides metrics associated with defects found in different phases of the development cycle. ​  |
 |  **[[http://​journal.thedacs.com/​issue/​52/​146|Toward Model-Based Embedded System Validation through Virtual Integration]]** ​ |  Web Reference ​ | Feiler, P. H. & Hansson, J. Toward Model-Based Embedded System Validation through Virtual Integration. SoftwareTech. Vol. 12, No.4. 2010.| This paper describes the use of a model-based approach to reduce defects and identify defects earlier. | |  **[[http://​journal.thedacs.com/​issue/​52/​146|Toward Model-Based Embedded System Validation through Virtual Integration]]** ​ |  Web Reference ​ | Feiler, P. H. & Hansson, J. Toward Model-Based Embedded System Validation through Virtual Integration. SoftwareTech. Vol. 12, No.4. 2010.| This paper describes the use of a model-based approach to reduce defects and identify defects earlier. |
 |  **[[http://​journal.thedacs.com/​issue/​52/​146|Toward Model-Based Embedded System Validation through Virtual Integration]]** ​ |  Web Reference ​ |Feiler, P. H. & Hansson, J. Toward Model-Based Embedded System Validation through Virtual Integration. SoftwareTech. Vol. 12, No.4. 2010.| This paper describes the use of a model-based approach to reduce defects and identify defects earlier. | |  **[[http://​journal.thedacs.com/​issue/​52/​146|Toward Model-Based Embedded System Validation through Virtual Integration]]** ​ |  Web Reference ​ |Feiler, P. H. & Hansson, J. Toward Model-Based Embedded System Validation through Virtual Integration. SoftwareTech. Vol. 12, No.4. 2010.| This paper describes the use of a model-based approach to reduce defects and identify defects earlier. |
-|  {{:​mbse:​rhapsody_case_studies_2013.pdf| ​  ​IBM Rhapsody Case Studies}} |  Presentation ​ |Software and Systems Engineering,​ IBM Rational. 2011.| This presentation from IBM provides quantitative ROI information from over 20 companies that use their tools for model based development. Sheets 4 and 5 presents a summary of the Qualified ROI metrics collected from these companies. ​ |+|  {{:​mbse:​rhapsody_case_studies_2013.pdf|IBM Rhapsody Case Studies}} ​ |  Presentation ​ |Software and Systems Engineering,​ IBM Rational. 2011.| This presentation from IBM provides quantitative ROI information from over 20 companies that use their tools for model based development. Sheets 4 and 5 presents a summary of the Qualified ROI metrics collected from these companies. ​ |
 |  **[[http://​www.omgwiki.org/​MBSE/​lib/​exe/​fetch.php?​media=mbse:​analysis-modeling-paper-final4_jpl.pdf|Modeling Approach for Re-designing the Mission Operations System for Human Missions]]** ​ |  Paper Reference ​ |Meshkat, Pennington, Ruszkowski, Scott, Manno.A Modeling Approach for Re-designing the Mission Operations System for Human Missions. NASA JPL. 2010.| This paper describes NASA’s systems engineering approach for re-engineering the Mission Operations System (MOS) using advanced modeling and analysis techniques. This paper explains the efforts undertaken by the NASA team, the challenges faced and the lessons learned to date. | |  **[[http://​www.omgwiki.org/​MBSE/​lib/​exe/​fetch.php?​media=mbse:​analysis-modeling-paper-final4_jpl.pdf|Modeling Approach for Re-designing the Mission Operations System for Human Missions]]** ​ |  Paper Reference ​ |Meshkat, Pennington, Ruszkowski, Scott, Manno.A Modeling Approach for Re-designing the Mission Operations System for Human Missions. NASA JPL. 2010.| This paper describes NASA’s systems engineering approach for re-engineering the Mission Operations System (MOS) using advanced modeling and analysis techniques. This paper explains the efforts undertaken by the NASA team, the challenges faced and the lessons learned to date. |
 |  [[http://​www.youtube.com/​watch?​v=2JebrzemmXY| Ratheon at IMB Innovate 2012]] ​ |  Video  |Wells, Brian. youTube Video, Raytheon at IBM Innovate 2012. June 2012.| This video provides a Raytheon perspective on the benefits of model based engineering | |  [[http://​www.youtube.com/​watch?​v=2JebrzemmXY| Ratheon at IMB Innovate 2012]] ​ |  Video  |Wells, Brian. youTube Video, Raytheon at IBM Innovate 2012. June 2012.| This video provides a Raytheon perspective on the benefits of model based engineering |
Line 16: Line 17:
 |  **[[http://​atlanmod.emn.fr/​www/​papers/​OnTheUnificationPowerOfModels.pdf|On the Unification Power of Models]]** ​ |  Paper Reference ​ |Bézivin,​Jean. On the Unification Power of Models. ATLAS Group. 2003.|This paper proposes a vision of the development of MDE based on some lessons learnt in the past 30 years in the development of object technology. ​ | |  **[[http://​atlanmod.emn.fr/​www/​papers/​OnTheUnificationPowerOfModels.pdf|On the Unification Power of Models]]** ​ |  Paper Reference ​ |Bézivin,​Jean. On the Unification Power of Models. ATLAS Group. 2003.|This paper proposes a vision of the development of MDE based on some lessons learnt in the past 30 years in the development of object technology. ​ |
 |  A Practical Guide to SysML: The Systems Modeling Language ​ |  Book Reference ​ |Friedenthal,​ Sandford, et al. A Practical Guide to SysML: The Systems Modeling Language. Morgan Kaufmann. Chapter 2. Sept. 3, 2009.| This book provides a number of references to the types of metrics that can be collected in a model-based environment,​ and how they can be used to improve the quality and measure progress. Refer to the book’s index under “metrics”.| |  A Practical Guide to SysML: The Systems Modeling Language ​ |  Book Reference ​ |Friedenthal,​ Sandford, et al. A Practical Guide to SysML: The Systems Modeling Language. Morgan Kaufmann. Chapter 2. Sept. 3, 2009.| This book provides a number of references to the types of metrics that can be collected in a model-based environment,​ and how they can be used to improve the quality and measure progress. Refer to the book’s index under “metrics”.|
-|  ** {{:​mbse:​motivation_for_model_driven_development_e.pdf|Motivation for Model Driven Development}} ** |  Paper Reference ​ |Watson, John.  Motivation for Model Driven Development .  June 2008.| This paper provides a list of motivations for using a model driven approach for developing large, complex software intensive systems. This document will attempt to communicate why we need to embrace these techniques across the industry. |+|  ** {{:​mbse:​motivation_for_model_driven_development_e.pdf|Motivation for Model Driven Development}} **  |  Paper Reference ​ |Watson, John.  Motivation for Model Driven Development .  June 2008.| This paper provides a list of motivations for using a model driven approach for developing large, complex software intensive systems. This document will attempt to communicate why we need to embrace these techniques across the industry. |
 |  **{{:​mbse:​m.hause_incose_final_v3.pdf|"​Are We There Yet?" Assessing Quality in Model Based Systems Engineering}}** ​ |  Paper Reference ​ | Matthew Hause. “Are we there yet?” Assessing Quality in Model Based Systems Engineering. INCOSE. 2011.| This paper examines a variety of different criteria for quality in model-based development and demonstrates some of the ways quality can be defined and evaluated in a model. | |  **{{:​mbse:​m.hause_incose_final_v3.pdf|"​Are We There Yet?" Assessing Quality in Model Based Systems Engineering}}** ​ |  Paper Reference ​ | Matthew Hause. “Are we there yet?” Assessing Quality in Model Based Systems Engineering. INCOSE. 2011.| This paper examines a variety of different criteria for quality in model-based development and demonstrates some of the ways quality can be defined and evaluated in a model. |
 |  **[[http://​www.omgwiki.org/​MBSE/​lib/​exe/​fetch.php?​media=mbse:​model_quality_mohagheghi_parastoo.pdf|Existing Model Metrics and Relations to Model Quality]]** ​ |  Paper Reference ​ |Mohagheghi,​ Parastoo, Dehlen, Vegard . Existing Model Metrics and Relations to Model Quality. OMG.| This paper presents quality goals for models and provides a state-of-the-art analysis regarding model metrics. | |  **[[http://​www.omgwiki.org/​MBSE/​lib/​exe/​fetch.php?​media=mbse:​model_quality_mohagheghi_parastoo.pdf|Existing Model Metrics and Relations to Model Quality]]** ​ |  Paper Reference ​ |Mohagheghi,​ Parastoo, Dehlen, Vegard . Existing Model Metrics and Relations to Model Quality. OMG.| This paper presents quality goals for models and provides a state-of-the-art analysis regarding model metrics. |
Line 27: Line 28:
 |  {{:​mbse:​metrics:​06-honour-seroi-project.pdf|A Practical Program of Research to Measure Systems Engineering Return on Investment (SE-ROI)}} ​ |  Paper Reference ​ | Honour, Eric C., A Practical Program of Research to Measure Systems Engineering Return on Investment (SE-ROI), Published and used by INCOSE with permission.| This paper provides insight as to the correct amount of SE effort to apply to a program. An ongoing project, Systems Engineering Return on Investment (SE-ROI), aims to quantify the correlations by gathering data on current and completed programs. This paper describes the practical program of research being used in the SE-ROI project and the current state of that development. | |  {{:​mbse:​metrics:​06-honour-seroi-project.pdf|A Practical Program of Research to Measure Systems Engineering Return on Investment (SE-ROI)}} ​ |  Paper Reference ​ | Honour, Eric C., A Practical Program of Research to Measure Systems Engineering Return on Investment (SE-ROI), Published and used by INCOSE with permission.| This paper provides insight as to the correct amount of SE effort to apply to a program. An ongoing project, Systems Engineering Return on Investment (SE-ROI), aims to quantify the correlations by gathering data on current and completed programs. This paper describes the practical program of research being used in the SE-ROI project and the current state of that development. |
 |  **{{:​mbse:​rex_on_se_approach_implementation_in_alstom.pdf|Return of experience on the implementation of the System Engineering approach in Alstom}}** ​ |  Presentation ​ |Ferrogalini,​ Marco  and Le Bastard, Jean. Presented at the Complex Systems Design & Management 2012, Paris France.|This presentation introduces a more robust system approach for railway systems. It defines system views for a top-down model based approach starting with requirements and using a SysML model to create the various views. The presentation also states the gained benefits and system engineering team feedback (slides 9-11).| |  **{{:​mbse:​rex_on_se_approach_implementation_in_alstom.pdf|Return of experience on the implementation of the System Engineering approach in Alstom}}** ​ |  Presentation ​ |Ferrogalini,​ Marco  and Le Bastard, Jean. Presented at the Complex Systems Design & Management 2012, Paris France.|This presentation introduces a more robust system approach for railway systems. It defines system views for a top-down model based approach starting with requirements and using a SysML model to create the various views. The presentation also states the gained benefits and system engineering team feedback (slides 9-11).|
-  ​|  Presentation ​ | Beihoff, Friedenthal,​ Kemp, Nichols, Oster, Paredis, Stoewer, Wade. A World in Motion – Systems Engineering Vision 2025. Published by the International Council on Systems Engineering 2014.| Vision 2025 is a publication produced by a team of leaders from industry, academia and government with the intent that it will be used by people working in many domains – healthcare, utilities, transportation,​ defense, finance – who will add their unique perspectives to the role systems engineering plays in our serving our world’s many complicated demands. |+ ​{{:​mbse:​metrics:​3_-_systemsengineeringvision_2025_june2014.pdf|A World in Motion – Systems Engineering Vision 2025}}  ​|  Presentation ​ | Beihoff, Friedenthal,​ Kemp, Nichols, Oster, Paredis, Stoewer, Wade. A World in Motion – Systems Engineering Vision 2025. Published by the International Council on Systems Engineering 2014.| Vision 2025 is a publication produced by a team of leaders from industry, academia and government with the intent that it will be used by people working in many domains – healthcare, utilities, transportation,​ defense, finance – who will add their unique perspectives to the role systems engineering plays in our serving our world’s many complicated demands. | 
 +|  [[https://​drive.google.com/​open?​id=0B3hsmXWocH2JZVpTSzdzaUxYQzA&​authuser=0 |  NASA/JPL Symposium & Workshop on Model-Based Systems Engineering ​ ]]  |  Presentation Collection ​ | Jet Propulsion Laboratory, California Institute of Technology, 2015. | NASA/JPL hosted a symposium and workshop on model-based systems engineering (MBSE) on January 28-30, 2015. The theme was “Moving MBSE into Practice”. ​ This link provides a series of excellent presentations about the state of the practice, challenges, recommendations,​ future directions and strategies. |
 |  {{:​mbse:​metrics:​4_-_plenary_-_developing_a_strategy_and_roadmap_for_advancing_mbse_within_your_organization_-_jeff_estefan_-_2010_ic_mbse.pdf|Developing a Strategy and Roadmap for Advancing the State-of-the-Practice of MBSE}} ​ |  Presentation ​ | Estefan, Jeff A., Developing a Strategy and Roadmap for Advancing the State-of-the-Practice of MBSE within Your Organization. Jet Propulsion Laboratory, California Institute of Technology 2010.| Transitioning from the traditional document-based approach to systems engineering to a model-based approach remains difficult for most organizations. This presentation provides insight for how to plan and execute the transition to a model based approach. | |  {{:​mbse:​metrics:​4_-_plenary_-_developing_a_strategy_and_roadmap_for_advancing_mbse_within_your_organization_-_jeff_estefan_-_2010_ic_mbse.pdf|Developing a Strategy and Roadmap for Advancing the State-of-the-Practice of MBSE}} ​ |  Presentation ​ | Estefan, Jeff A., Developing a Strategy and Roadmap for Advancing the State-of-the-Practice of MBSE within Your Organization. Jet Propulsion Laboratory, California Institute of Technology 2010.| Transitioning from the traditional document-based approach to systems engineering to a model-based approach remains difficult for most organizations. This presentation provides insight for how to plan and execute the transition to a model based approach. |
 |  {{:​mbse:​metrics:​5_-_keynote_-_missing_link_in_the_digital_enterprise_-_heinz_stoewer-_2014_mbse_workshop.pdf|Model based Systems Engineering (MBSE) Missing Link in the digital Enterprise Strategy}} ​ |  Presentation ​ | Stoewer, Heinz, Model based Systems Engineering (MBSE) Missing Link in the digital Enterprise Strategy ?. Presented at the MBSE Workshop at the INCOSE Los Angeles International Workshop, January 25, 2014.| Keynote to the MBSE Workshop at the INCOSE Los Angeles International Workshop. The presentation discusses some history of Systems Engineering;​ the emerging digital world; the Systems Engineering World in context; the MBSE status and future; and provides a summary and a few take a ways. | |  {{:​mbse:​metrics:​5_-_keynote_-_missing_link_in_the_digital_enterprise_-_heinz_stoewer-_2014_mbse_workshop.pdf|Model based Systems Engineering (MBSE) Missing Link in the digital Enterprise Strategy}} ​ |  Presentation ​ | Stoewer, Heinz, Model based Systems Engineering (MBSE) Missing Link in the digital Enterprise Strategy ?. Presented at the MBSE Workshop at the INCOSE Los Angeles International Workshop, January 25, 2014.| Keynote to the MBSE Workshop at the INCOSE Los Angeles International Workshop. The presentation discusses some history of Systems Engineering;​ the emerging digital world; the Systems Engineering World in context; the MBSE status and future; and provides a summary and a few take a ways. |
 |  {{:​mbse:​metrics:​6_-_help_for_systems_of_systems_using_updm_and_ras_for_sos_modeling_-_matthew_hause_-_2015_ieee_aerospace_conf.pdf|Help for Systems of Systems Using UPDM and RAS for SoS Modeling}} ​ |  Paper Reference ​ | Hause, Matthew C., Help for Systems of Systems Using UPDM and RAS for SoS Modeling. Published and used by INCOSE with permission, 2013.| Systems of Systems (SoS) modeling is becoming important in both civilian and military systems. This paper shows how combining UPDM and RAS provides a Model of Models approach with the main model specifying assets in various levels of detail. The paper also includes an assessment of the applicability and effectiveness of this approach. The INCOSE System of Systems Working Group has collected a set of “Pain Points on SoS”. This paper provides review these pain points and discusses how the application of a Model of Model approach can help to alleviate them. | |  {{:​mbse:​metrics:​6_-_help_for_systems_of_systems_using_updm_and_ras_for_sos_modeling_-_matthew_hause_-_2015_ieee_aerospace_conf.pdf|Help for Systems of Systems Using UPDM and RAS for SoS Modeling}} ​ |  Paper Reference ​ | Hause, Matthew C., Help for Systems of Systems Using UPDM and RAS for SoS Modeling. Published and used by INCOSE with permission, 2013.| Systems of Systems (SoS) modeling is becoming important in both civilian and military systems. This paper shows how combining UPDM and RAS provides a Model of Models approach with the main model specifying assets in various levels of detail. The paper also includes an assessment of the applicability and effectiveness of this approach. The INCOSE System of Systems Working Group has collected a set of “Pain Points on SoS”. This paper provides review these pain points and discusses how the application of a Model of Model approach can help to alleviate them. |
 +|  {{:​mbse:​metrics:​8_-_buildingfortomorrow_is2015_-_david_long.pdf|Building for Tomorrow: Towards 21st Century Systems Engineering}} ​ |  Presentation ​ | Long, David., ​ Building for Tomorrow: Towards 21st Century Systems Engineering. Published and used by INCOSE with permission, 2015 | This presentation provides insight as to the future of Systems Engineering,​ what some of the challenges we face today and how to overcome some of those challenges. ​ The following link provides a document with a  {{:​mbse:​metrics:​9_-_buildingfortomorrow_is2015_-_david_long_-_timing_index.docx| YouTube link and chart timeline }} of the YouTube recording. |
  
  
mbse/metricreferences.1444764718.txt.gz · Last modified: 2015/10/13 15:31 by jcwatson