User Tools

Site Tools


mbse:metricreferences

This is an old revision of the document!


MBE Metric Papers Realized from Industry

The intent of this wiki page is to provide a set of links to papers, web references, books and summary information documenting quantitative and/or anecdotal metrics realized from industry development efforts.

Title Reference Type Source Type Citation Additional Information
Final Report- Model Based Engineering (MBE) Subcommittee Presentation Anecdotal Bergenthal, Jeff. Final Report- Model Based Engineering (MBE) Subcommittee. NDIA Systems Engineering Division M&S Committee. February 2011.The presentation provides the final report of the NDIA Model Based Engineering Subcommittee. It provides potential MBE benefits, costs and risks, the current and to-be MBE state and some recommendations for going forward. In addition it provides a large collection of MBE related papers, see slides 33 through 37. On chart 11 it references some of those papers to the acquisition life cycle.
Cost of Software Defects Web Reference Quantitative/Anecdotal Strickler,Jon. Cost of Software Defects. Agile Elements. April 22, 2008. This web site provides metrics associated with defects found in different phases of the development cycle.
Toward Model-Based Embedded System Validation through Virtual Integration Web Reference Quantitative/Anecdotal Feiler, P. H. & Hansson, J. Toward Model-Based Embedded System Validation through Virtual Integration. SoftwareTech. Vol. 12, No.4. 2010. This paper describes the use of a model-based approach to reduce defects and identify defects earlier.
Software Intensive Systems Paper Reference Anecdotal Horvitz, Rumpf, Shrobe, Smith, Webber, Williamson,Winston, Wolbarsht. Software Intensive Systems. Naval Research Advisory Committee. 2006. This report is a product of the United States Naval Research Advisory Committee (NRAC) Panel on Software Intensive Systems. This paper identifies costs and issues associated with the production of quality, affordable software. It also presents some recommendations to the DoN and DoD. Parts of those recommendations are utilizing model-based approaches.
Modeling Approach for Re-designing the Mission Operations System for Human Missions Paper Reference Anecdotal Meshkat, Pennington, Ruszkowski, Scott, Manno.A Modeling Approach for Re-designing the Mission Operations System for Human Missions. NASA JPL. 2010. This paper describes NASA’s systems engineering approach for re-engineering the Mission Operations System (MOS) using advanced modeling and analysis techniques. This paper explains the efforts undertaken by the NASA team, the challenges faced and the lessons learned to date.
NDIA Paper:Use of a Model-Based Approach to Minimize System Development Risk and Time-to-Field for New Systems Presentation Quantitative/Anecdotal Wagner, Brockwell, Daniels, Loesh, Gosnell. NDIA Paper:Use of a Model-Based Approach to Minimize System Development Risk and Time-to-Field for New Systems. NDIA. Oct. 9, 2010. This presentation identifies six root problems and describes how an integrated MBSD environment can help. It provides a set of metrics captured from an actual project.
Survey of Model-Based Systems Engineering (MBSE) Methodologies Paper Reference Anecdotal Estefan, Jeff A. Survey of Model-Based Systems Engineering (MBSE) Methodologies. Survey of Model-Based Systems Engineering (MBSE) Methodologies. May 25, 2007. This paper identifies some industry leading methodologies used for MBSE and provides a deciption of each. Some of thes methodology describtions provide anecdotal metrics as to their value added.
Model-Based Development of Neural Prostheses for Movement Paper Reference Quantitative/Anecdotal Davoodi, Rahman., et al. Model-Based Development of Neural Prostheses for Movement. IEEE Transactions on Biomedical Engineering, Vol. 54, No. 11. Nov. 2007.This paper describes an integrated model-based approach to use virtual prototyping to simulate mechanical behavior before manufacturing and discusses the benefits of such an approach.
On the Unification Power of Models Paper Reference Anecdotal Bézivin,Jean. On the Unification Power of Models. ATLAS Group. 2003.This paper proposes a vision of the development of MDE based on some lessons learnt in the past 30 years in the development of object technology.
A Practical Guide to SysML: The Systems Modeling Language Book Reference Anecdotal Friedenthal, Sandford, et al. A Practical Guide to SysML: The Systems Modeling Language. Morgan Kaufmann. Chapter 2. Sept. 3, 2009. This book provides a number of references to the types of metrics that can be collected in a model-based environment, and how they can be used to improve the quality and measure progress. Refer to the book’s index under “metrics”.
Motivation for Model Driven Development Paper Reference Anecdotal Watson, John. Motivation for Model Driven Development . June 2008. This paper provides a list of motivations for using a model driven approach for developing large, complex software intensive systems. This document will attempt to communicate why we need to embrace these techniques across the industry.
"Are We There Yet?" Assessing Quality in Model Based Systems Engineering Paper Reference Anecdotal Matthew Hause. “Are we there yet?” Assessing Quality in Model Based Systems Engineering. INCOSE. 2011. This paper examines a variety of different criteria for quality in model-based development and demonstrates some of the ways quality can be defined and evaluated in a model.
Existing Model Metrics and Relations to Model Quality Paper Reference Anecdotal Mohagheghi, Parastoo, Dehlen, Vegard . Existing Model Metrics and Relations to Model Quality. OMG. This paper presents quality goals for models and provides a state-of-the-art analysis regarding model metrics.
Evaluating Quality in Model-Driven Engineering Paper Reference Anecdotal Mohagheghi, Parastoo, Aagedal, Jan. Evaluating Quality in Model-Driven Engineering. OMG.This paper presents quality goals in MDE and states that the quality of models is affected by the quality of modeling languages, tools, modeling processes, the knowledge and experience of modelers, and the quality assurance techniques applied.
EDS - Concurrent Design Facility Presentation Quantitative/Anecdotal The ESA Concurrent Design Facility: Concurrent Engineering applied to space mission assessments . CDF ESA/ESTEC Noordwijk – NL . 2011. The ESTEC Concurrent Design Facility is an Integrated Design Environment (IDE) available to all ESA programs for interdisciplinary and inter-directorate applications, based on Concurrent Engineering methodology. The intent is to overcome the communication gaps between the “designer” (who produces design information) and the “user” (who utilizes the design information). This presentation provides quantitative and anecdotal metrics for using this MBE review approach.
Making model-based code generation work Paper Reference Anecdotal Tolvanen, Juha-Pekka. Making model-based code generation work. EmbeddedSystems Europe. Aug./Sept. 2004.
Model-Based System Engineering (MBSE) Organizational Panacea or Mirage Presentation Quantitative/Anecdotal Wasson, Charles. Model-Based System Engineering Organizational Panacea or Mirage. INCOSE Great Lakes Conference. Nov. 2011.
Correlating Product And Process Measures Paper Reference Measurement Approaches Carson, Ronald S., Correlating Product and Process Measures as a Model for Systems Engineering Measurement, Proceedings of the International Council on Systems Engineering 2011. The failure to establish product measures and provably correlate them with process measures leads to open-loop management systems that can only measure process compliance, with unknown effect on product quality. In this paper a set of standard categories of measures are applied to various Systems Engineering work products identified as “output” in the INCOSE SE Handbook. Process and product measures for each process output are proposed, along with correlations between them, and associations to the INCOSE SE Leading Indicators where applicable.

Return to MBSE Metrics

mbse/metricreferences.1337008837.txt.gz · Last modified: 2012/05/14 11:20 by jcwatson