Measurement & Analaysis (MA) Category: Support
Notes:
·
The contents of this web page were extracted from
the following document: Capability Maturity Model® Integration
(CMMISM), Version 1.1, Continuous Representation,
CMU/SEI-2002-TR-011, March 2002 (CMMI-SE/SW/IPPD/SS). Copyright 2002 by Carnegie
Mellon University. NO WARRANTY.
·
Ignore the identifiers
in square brackets that appear at the end of paragraphs.
·
The formatting may not
be the same as in the printed CMMI document. The web page is best viewed in
Internet Explorer.
·
In the CMMI, a subset is known as a "Process Area
(PA)" and a requirement is known as a "Practice". The specific practices are
referred to as SPs and the generic practices are referred to as GPs.
· This web page contains the text for SPs and GPs as it appears in Chapter 7 of the CMMI document, in the section corresponding to the process area named in the heading of this page. This web page does not include the detailed description of the GPs that appears in a separate chapter of the CMMI document; the detailed description of the GPs is available in a separate web page. (Note: Using the hyperlink provided here will open that web page in a separate window.)
Purpose The purpose of Measurement and Analysis is to develop and sustain a measurement capability that is used to support management information needs. [PA154
Introductory Notes The Measurement and Analysis process area involves the following: [PA154.N101]
· Specifying the objectives of measurement and analysis such that they are aligned with identified information needs and objectives
· Specifying the measures, data collection and storage mechanisms, analysis techniques, and reporting and feedback mechanisms
· Implementing the collection, storage, analysis, and reporting of the data
· Providing objective results that can be used in making informed decisions, and taking appropriate corrective actions
The integration of measurement and analysis activities
into the processes of the project supports the following: [PA154.N102]
· Objective planning and estimating
· Tracking actual performance against established plans and objectives
· Identifying and resolving process-related issues
· Providing a basis for incorporating measurement into additional processes in the future
The staff required to implement a measurement capability may or may not be employed in a separate organization-wide program. Measurement capability may be integrated into individual projects or other organizational functions (e.g., Quality Assurance). [PA154.N103]
The initial focus for measurement activities is at the project level. However, a measurement capability may prove useful for addressing organization- and/or enterprise-wide information needs. [PA154.N104]
Projects may choose to store project-specific data and
results in a project-specific repository. When data are shared more widely
across projects, the data may reside in the organization’s measurement
repository. [PA154.N105]
For Supplier Sourcing
Measurement and analysis of the product components provided by suppliers is essential for effective management of the quality and costs of the project. It may be possible, with careful management of supplier agreements, to provide insight into the data that support supplier-performance analysis. [PA154.N105.AMP101]
Refer to the Project Planning process area for more information about
estimating project attributes and other planning information needs.
[PA154.R101]
Refer to the Project Monitoring & Control process area for more information
about monitoring project performance information needs.
[PA154.R102]
Refer to the Configuration Management process area for more information
about managing measurement work products. [PA154.R103]
Refer to the Requirements Development process area for more information
about meeting customer requirements and related information needs.
[PA154.R104]
Refer to the Requirements Management process area for more information
about maintaining requirements traceability and related information needs.
[PA154.R105]
Refer to the Organizational Process Definition process area for more
information about establishing the organization’s measurement repository.
[PA154.R106]
Refer to the Quantitative Project Management process area for more
information about understanding variation and the appropriate use of statistical
analysis techniques. [PA154.R107]
Specific Goals
SG 1
Align Measurement and Analysis Activities
[PA154.IG101]
Measurement objectives and activities are aligned with identified information needs and objectives.
SG 2
Provide Measurement Results [PA154.IG102]
Measurement results that address identified information needs and objectives are provided.
Generic Goals
GG 1
Achieve Specific Goals [CL102.GL101]
The process supports and enables achievement of the specific goals of the process area by transforming identifiable input work products to produce identifiable output work products.
GG 2
Institutionalize a Managed Process [CL103.GL101]
The process is institutionalized as a managed process.
GG 3
Institutionalize a Defined Process [CL104.GL101]
The process is institutionalized as a defined process.
GG 4
Institutionalize a Quantitatively Managed Process
[CL105.GL101]
The process is institutionalized as a quantitatively managed process.
GG 5
Institutionalize an Optimizing Process [CL106.GL101]
The process is institutionalized as an optimizing process.
Practice-to-Goal Relationship Table
SG 1 Align Measurement and Analysis Activities [PA154.IG101]
SP 1.1-1 Establish Measurement Objectives
SP 1.2-1 Specify Measures
SP 1.3-1 Specify Data Collection and Storage Procedures
SP 1.4-1 Specify Analysis Procedures
SG 2 Provide Measurement Results
[PA154.IG102]
SP 2.1-1 Collect Measurement Data
SP 2.2-1 Analyze Measurement Data
SP 2.3-1 Store Data and Results
SP 2.4-1 Communicate Results
GG 1 Achieve Specific Goals [CL102.GL101]
GP 1.1 Perform Base Practices
GG 2 Institutionalize a Managed Process [CL103.GL101]
GP 2.1 Establish an Organizational Policy
GP 2.2 Plan the Process
GP 2.3 Provide Resources
GP 2.4 Assign Responsibility
GP 2.5 Train People
GP 2.6 Manage Configurations
GP 2.7 Identify and Involve Relevant Stakeholders
GP 2.8 Monitor and Control the Process
GP 2.9 Objectively Evaluate Adherence
GP 2.10 Review Status with Higher Level Management
GG 3 Institutionalize a Defined Process [CL104.GL101]
GP 3.1 Establish a Defined Process
GP 3.2 Collect Improvement Information
GG 4 Institutionalize a Quantitatively Managed Process [CL105.GL101]
GP 4.1 Establish Quantitative Objectives for the Process
GP 4.2 Stabilize Subprocess Performance
GG 5 Institutionalize an Optimizing Process [CL106.GL101]
GP 5.1 Ensure Continuous Process Improvement
GP 5.2 Correct Root Causes of Problems
Specific Practices by Goal
SG 1 Align Measurement and Analysis Activities
Measurement objectives and activities are aligned with identified information
needs and objectives.
[PA154.IG101]
The specific practices covered under this specific goal
may be addressed concurrently or in any order:
[PA154.IG101.N101]
· When establishing measurement objectives, experts often think ahead about necessary criteria for specifying measures and analysis procedures. They also think concurrently about the constraints imposed by data collection and storage procedures.
· It often is important to specify the essential analyses that will be conducted before attending to details of measurement specification, data collection, or storage.
SP 1.1-1 Establish Measurement Objectives
Establish and maintain measurement objectives that are derived from identified
information needs and objectives.
[PA154.IG101.SP101]
Measurement objectives document the purposes for which
measurement and analysis are done, and specify the kinds of actions that may be
taken based on the results of data analyses.
[PA154.IG101.SP101.N101]
The sources for measurement objectives may be management,
technical, project, product, or process implementation needs. [PA154.IG101.SP101.N102]
The measurement objectives may be constrained by existing
processes, available resources, or other measurement considerations. Judgments
may need to be made about whether the value of the results will be commensurate
with the resources devoted to doing the work.
[PA154.IG101.SP101.N103]
Modifications to identified information needs and
objectives may, in turn, be indicated as a consequence of the process and
results of measurement and analysis.
[PA154.IG101.SP101.N104]
Sources of information needs and objectives may include
the following:
[PA154.IG101.SP101.N105]
· Project plans
· Monitoring of project performance
· Interviews with managers and others who have information needs
· Established management objectives
· Strategic plans
· Business plans
· Formal requirements or contractual obligations
· Recurring or other troublesome management or technical problems
· Experiences of other projects or organizational entities
· External industry benchmarks
· Process-improvement plans
Refer to the Project Planning process area for more information about
estimating project attributes and other planning information needs.
[PA154.IG101.SP101.N105.R101]
Refer to the Project Monitoring and Control process area for more
information about project performance information needs.
[PA154.IG101.SP101.N105.R102]
Refer to the Requirements Development process area for more information
about meeting customer requirements and related information needs.
[PA154.IG101.SP101.N105.R103]
Refer to the Requirements Management process area for more information
about maintaining requirements traceability and related information needs.
[PA154.IG101.SP101.N105.R104]
Typical Work Products
1. Measurement
objectives [PA154.IG101.SP101.W101]
Subpractices
1. Document information needs and
objectives. [PA154.IG101.SP101.SubP101]
Information needs and objectives
are documented to allow traceability to subsequent measurement and analysis
activities.
[PA154.IG101.SP101.SubP101.N101]
2. Prioritize information needs
and objectives. [PA154.IG101.SP101.SubP102]
It may be neither possible nor
desirable to subject all initially identified information needs to measurement
and analysis. Priorities may also need to be set within the limits of available
resources.
[PA154.IG101.SP101.SubP102.N101]
3. Document, review, and update
measurement objectives. [PA154.IG101.SP101.SubP103]
It is important to carefully
consider the purposes and intended uses of measurement and analysis.
[PA154.IG101.SP101.SubP103.N101]
The measurement objectives are
documented, reviewed by management and other relevant stakeholders, and updated
as necessary. Doing so enables traceability to subsequent measurement and
analysis activities, and helps ensure that the analyses will properly address
identified information needs and objectives. [PA154.IG101.SP101.SubP103.N102]
It is important that users of
measurement and analysis results be involved in setting measurement objectives
and deciding on plans of action. It may also be appropriate to involve those who
provide the measurement data. [PA154.IG101.SP101.SubP103.N103]
4. Provide feedback for refining
and clarifying information needs and objectives as necessary.
[PA154.IG101.SP101.SubP104]
Identified information needs and
objectives may need to be refined and clarified as a result of setting
measurement objectives. Initial descriptions of information needs may be unclear
or ambiguous. Conflicts may arise between existing needs and objectives. Precise
targets on an already existing measure may be unrealistic.
[PA154.IG101.SP101.SubP104.N101]
5. Maintain traceability of the
measurement objectives to the identified information needs and objectives. [PA154.IG101.SP101.SubP105]
There must always be a good answer
to the question, “Why are we measuring this?”
[PA154.IG101.SP101.SubP105.N101]
Of course, the measurement
objectives may also change to reflect evolving information needs and objectives.
[PA154.IG101.SP101.SubP105.N102]
Specify measures to address the measurement objectives.
[PA154.IG101.SP102]
Measurement objectives are refined into precise,
quantifiable measures.
[PA154.IG101.SP102.N101]
Measures may be either “base” or “derived.” Data for base
measures are obtained by direct measurement. Data for derived measures come from
other data, typically by combining two or more base measures. [PA154.IG101.SP102.N102]
Examples of
commonly used base measures include the following: [PA154.IG101.SP102.N103]
· Estimates and actual measures of work product size (e.g., number of pages)
· Estimates and actual measures of effort and cost (e.g., number of person hours)
· Quality measures (e.g., number of defects, number of defects by severity)
Examples of
commonly used derived measures include the following: [PA154.IG101.SP102.N104]
· Earned Value
· Schedule Performance Index
· Defect density
· Peer review coverage
· Test or verification coverage
· Reliability measures (e.g., mean time to failure)
· Quality measures (e.g., number of defects by severity/total number of defects)
Derived measures typically are expressed as ratios,
composite indices, or other aggregate summary measures. They are often more
quantitatively reliable and meaningfully interpretable than the base measures
used to generate them.
[PA154.IG101.SP102.N105]
Typical Work Products
1.
Specifications of base and derived measures [PA154.IG101.SP102.W101]
Subpractices
1. Identify candidate measures
based on documented measurement objectives.
[PA154.IG101.SP102.SubP101]
The measurement objectives are
refined into specific measures. The identified candidate measures are
categorized and specified by name and unit of measure.
[PA154.IG101.SP102.SubP101.N101]
2. Identify existing measures
that already address the measurement objectives.
[PA154.IG101.SP102.SubP102]
Specifications for measures may
already exist, perhaps established for other purposes earlier or elsewhere in
the organization.
[PA154.IG101.SP102.SubP102.N101]
3. Specify operational
definitions for the measures. [PA154.IG101.SP102.SubP103]
Operational definitions are stated
in precise and unambiguous terms. They address two important criteria as
follows:
[PA154.IG101.SP102.SubP103.N101]
· Communication: What has been measured, how was it measured, what are the units of measure, and what has been included or excluded?
· Repeatability: Can the measurement be repeated, given the same definition, to get the same results?
4. Prioritize, review, and update
measures. [PA154.IG101.SP102.SubP104]
Proposed specifications of the
measures are reviewed for their appropriateness with potential end users and
other relevant stakeholders. Priorities are set or changed, and specifications
of the measures are updated as necessary. [PA154.IG101.SP102.SubP104.N101]
SP 1.3-1 Specify Data Collection and Storage Procedures
Specify how measurement data will be obtained and stored.
[PA154.IG101.SP103]
Explicit specification of collection methods helps ensure
that the right data are collected properly. It may also aid in further
clarifying information needs and measurement objectives. [PA154.IG101.SP103.N101]
Proper attention to storage and retrieval procedures helps
ensure that data are available and accessible for future use. [PA154.IG101.SP103.N102]
Typical Work Products
1. Data
collection and storage procedures [PA154.IG101.SP103.W101]
2. Data
collection tools [PA154.IG101.SP103.W102]
Subpractices
1. Identify existing sources of
data that are generated from current work products, processes, or transactions. [PA154.IG101.SP103.SubP101]
Existing sources of data may
already have been identified when specifying the measures. Appropriate
collection mechanisms may exist whether or not pertinent data have already been
collected.
[PA154.IG101.SP103.SubP101.N101]
2. Identify measures for which
data are needed, but are not currently available.
[PA154.IG101.SP103.SubP102]
3. Specify how to collect and
store the data for each required measure. [PA154.IG101.SP103.SubP103]
Explicit specifications are made
of how, where, and when the data will be collected. Procedures for collecting
valid data are specified. The data are stored in an accessible manner for
analysis, and it is determined whether they will be saved for possible
reanalysis or documentation purposes. [PA154.IG101.SP103.SubP103.N101]
Questions to be considered
typically include the following:
[PA154.IG101.SP103.SubP103.N102]
· Have the frequency of collection and the points in the process where measurements will be made been determined?
· Has the time line that is required to move measurement results from the points of collection to repositories, other databases, or end users been established?
· Who is responsible for obtaining the data?
· Who is responsible for data storage, retrieval, and security?
· Have necessary supporting tools been developed or acquired?
4. Create data collection
mechanisms and process guidance. [PA154.IG101.SP103.SubP104]
Data collection and storage
mechanisms are well integrated with other normal work processes. Data collection
mechanisms may include manual or automated forms and templates. Clear, concise
guidance on correct procedures is available to those responsible for doing the
work. Training is provided as necessary to clarify the processes necessary for
collection of complete and accurate data and to minimize the burden on those who
must provide and record the data.
[PA154.IG101.SP103.SubP104.N101]
5. Support automatic collection
of the data where appropriate and feasible.
[PA154.IG101.SP103.SubP105]
Automated support can aid in
collecting more complete and accurate data. [PA154.IG101.SP103.SubP105.N101]
Examples of such automated support include the following:
[PA154.IG101.SP103.SubP105.N102]
· Timestamped activity logs
· Static or dynamic analyses of artifacts
However, some data cannot be
collected without human intervention (e.g., customer satisfaction or other human
judgments), and setting up the necessary infrastructure for other automation may
be costly.
[PA154.IG101.SP103.SubP105.N103]
6. Prioritize, review, and update
data collection and storage procedures.
[PA154.IG101.SP103.SubP106]
Proposed procedures are reviewed
for their appropriateness and feasibility with those who are responsible for
providing, collecting, and storing the data. They also may have useful insights
about how to improve existing processes, or be able to suggest other useful
measures or analyses.
[PA154.IG101.SP103.SubP106.N101]
7. Update measures and
measurement objectives as necessary. [PA154.IG101.SP103.SubP107]
Priorities may need to be reset
based on the following:
[PA154.IG101.SP103.SubP107.N101]
· The importance of the measures
· The amount of effort required to obtain the data
Considerations include whether new
forms, tools, or training would be required to obtain the data.
[PA154.IG101.SP103.SubP107.N102]
SP 1.4-1 Specify Analysis Procedures
Specify how measurement data will be analyzed and reported.
[PA154.IG101.SP104]
Specifying the analysis procedures in advance ensures that
appropriate analyses will be conducted and reported to address the documented
measurement objectives (and thereby the information needs and objectives on
which they are based). This approach also provides a check that the necessary
data will in fact be collected.
[PA154.IG101.SP104.N101]
Typical Work Products
1. Analysis
specification and procedures [PA154.IG101.SP104.W101]
2. Data analysis
tools [PA154.IG101.SP104.W102]
Subpractices
1. Specify and prioritize the
analyses that will be conducted and the reports that will be prepared.
[PA154.IG101.SP104.SubP101]
Early attention should be paid to
the analyses that will be conducted and to the manner in which the results will
be reported. These should meet the following criteria:
[PA154.IG101.SP104.SubP101.N101]
· The analyses explicitly address the documented measurement objectives
· Presentation of the results is clearly understandable by the audiences to whom the results are addressed
Priorities may have to be set
within available resources.
[PA154.IG101.SP104.SubP101.N102]
2. Select appropriate data
analysis methods and tools. [PA154.IG101.SP104.SubP102]
Refer to the Select Measures and Analytic Techniques and Apply Statistical
Methods to Understand Variation specific practices of the Quantitative Project
Management process area for more information about the appropriate use of
statistical analysis techniques and understanding variation, respectively. [PA154.IG101.SP104.SubP102.R101]
Issues to be considered typically
include the following:
[PA154.IG101.SP104.SubP102.N101]
· Choice of visual display and other presentation techniques (e.g., pie charts, bar charts, histograms, radar charts, line graphs, scatter plots, or tables)
· Choice of appropriate descriptive statistics (e.g., arithmetic mean, median, or mode)
· Decisions about statistical sampling criteria when it is impossible or unnecessary to examine every data element
· Decisions about how to handle analysis in the presence of missing data elements
· Selection of appropriate analysis tools
Descriptive statistics are
typically used in data analysis to do the following:
[PA154.IG101.SP104.SubP102.N102]
· Examine distributions on the specified measures (e.g., central tendency, extent of variation, data points exhibiting unusual variation)
· Examine the interrelationships among the specified measures (e.g., comparisons of defects by phase of the product’s life cycle or by product component)
· Display changes over time
3. Specify administrative
procedures for analyzing the data and communicating the results.
[PA154.IG101.SP104.SubP103]
Issues to be considered typically
include the following:
[PA154.IG101.SP104.SubP103.N101]
· Identifying the persons and groups responsible for analyzing the data and presenting the results
· Determining the time line to analyze the data and present the results
· Determining the venues for communicating the results (e.g., progress reports, transmittal memos, written reports, or staff meetings)
4. Review and update the proposed
content and format of the specified analyses and reports.
[PA154.IG101.SP104.SubP104]
All of the proposed content and
format are subject to review and revision, including analytic methods and tools,
administrative procedures, and priorities. The relevant stakeholders consulted
should include intended end users, sponsors, data analysts, and data providers.
[PA154.IG101.SP104.SubP104.N101]
5. Update measures and
measurement objectives as necessary. [PA154.IG101.SP104.SubP105]
Just as measurement needs drive
data analysis, clarification of analysis criteria can affect measurement.
Specifications for some measures may be refined further based on the
specifications established for data analysis procedures. Other measures may
prove to be unnecessary, or a need for additional measures may be recognized.
[PA154.IG101.SP104.SubP105.N101]
The exercise of specifying how
measures will be analyzed and reported may also suggest the need for refining
the measurement objectives themselves. [PA154.IG101.SP104.SubP105.N102]
6. Specify criteria for
evaluating the utility of the analysis results, and of the conduct of the
measurement and analysis activities. [PA154.IG101.SP104.SubP106]
Criteria for evaluating the
utility of the analysis might address the extent to which the following apply:
[PA154.IG101.SP104.SubP106.N101]
· The results are (1) provided on a timely basis, (2) understandable, and (3) used for decision making.
· The work does not cost more to perform than is justified by the benefits that it provides.
Criteria for evaluating the
conduct of the measurement and analysis might include the extent to which the
following apply:
[PA154.IG101.SP104.SubP106.N102]
· The amount of missing data or the number of flagged inconsistencies is beyond specified thresholds.
· There is selection bias in sampling (e.g., only satisfied end users are surveyed to evaluate end-user satisfaction, or only unsuccessful projects are evaluated to determine overall productivity).
· The measurement data are repeatable (e.g., statistically reliable).
· Statistical assumptions have been satisfied (e.g., about the distribution of data or about appropriate measurement scales).
SG 2 Provide Measurement Results
Measurement results that address identified information needs and objectives are
provided.
[PA154.IG102]
The primary reason for doing measurement and analysis is
to address identified information needs and objectives. Measurement results
based on objective evidence can help to monitor performance, fulfill contractual
obligations, make informed management and technical decisions, and enable
corrective actions to be taken.
[PA154.IG102.N101]
SP 2.1-1 Collect Measurement Data
Obtain specified measurement data.
[PA154.IG102.SP101]
The data necessary for analysis are obtained and checked
for completeness and integrity.
[PA154.IG102.SP101.N101]
Typical Work Products
1. Base and
derived measurement data sets [PA154.IG102.SP101.W101]
2. Results of
data integrity tests [PA154.IG102.SP101.W102]
Subpractices
1. Obtain the data for base
measures. [PA154.IG102.SP101.SubP101]
Data are collected as necessary
for previously used as well as for newly specified base measures. Existing data
are gathered from project records or from elsewhere in the organization.
[PA154.IG102.SP101.SubP101.N101]
Note that data that were collected
earlier may no longer be available for reuse in existing databases, paper
records, or formal repositories. [PA154.IG102.SP101.SubP101.N102]
2. Generate the data for derived
measures. [PA154.IG102.SP101.SubP102]
Values are newly calculated for
all derived measures.
[PA154.IG102.SP101.SubP102.N101]
3. Perform data integrity checks
as close to the source of the data as possible.
[PA154.IG102.SP101.SubP103]
All measurements are subject to
error in specifying or recording data. It is always better to identify such
errors and to identify sources of missing data early in the measurement and
analysis cycle.
[PA154.IG102.SP101.SubP103.N101]
Checks can include scans for
missing data, out-of-bounds data values, and unusual patterns and correlation
across measures.
[PA154.IG102.SP101.SubP103.N102]
It is particularly important to do
the following:
[PA154.IG102.SP101.SubP103.N103]
· Test and correct for inconsistency of classifications made by human judgment (i.e., to determine how frequently people make differing classification decisions based on the same information, otherwise known as “inter-coder reliability”).
· Empirically examine the relationships among the measures that are used to calculate additional derived measures. Doing so can ensure that important distinctions are not overlooked and that the derived measures convey their intended meanings (otherwise known as “criterion validity”).
SP 2.2-1 Analyze Measurement Data
Analyze and interpret measurement data.
[PA154.IG102.SP102]
The measurement data are analyzed as planned, additional
analyses are conducted as necessary, results are reviewed with relevant
stakeholders, and necessary revisions for future analyses are noted. [PA154.IG102.SP102.N101]
Typical Work Products
1. Analysis
results and draft reports [PA154.IG102.SP102.W101]
Subpractices
1. Conduct initial analyses,
interpret the results, and draw preliminary conclusions.
[PA154.IG102.SP102.SubP101]
The results of data analyses are
rarely self evident. Criteria for interpreting the results and drawing
conclusions should be stated explicitly. [PA154.IG102.SP102.SubP101.N101]
2. Conduct additional measurement
and analysis as necessary, and prepare results for presentation.
[PA154.IG102.SP102.SubP102]
The results of planned analyses
may suggest (or require) additional, unanticipated analyses. In addition, they
may identify needs to refine existing measures, to calculate additional derived
measures, or even to collect data for additional primitive measures to properly
complete the planned analysis. Similarly, preparing the initial results for
presentation may identify the need for additional, unanticipated analyses.
[PA154.IG102.SP102.SubP102.N101]
3. Review the initial results
with relevant stakeholders. [PA154.IG102.SP102.SubP103]
It may be appropriate to review
initial interpretations of the results and the way in which they are presented
before disseminating and communicating them more widely.
[PA154.IG102.SP102.SubP103.N101]
Reviewing the initial results
before their release may prevent needless misunderstandings and lead to
improvements in the data analysis and presentation.
[PA154.IG102.SP102.SubP103.N102]
Relevant stakeholders with whom
reviews may be conducted include intended end users and sponsors, as well as
data analysts and data providers. [PA154.IG102.SP102.SubP103.N103]
4. Refine criteria for future
analyses. [PA154.IG102.SP102.SubP104]
Valuable lessons that can improve
future efforts are often learned from conducting data analyses and preparing
results. Similarly, ways to improve measurement specifications and data
collection procedures may become apparent, as may ideas for refining identified
information needs and objectives. [PA154.IG102.SP102.SubP104.N101]
SP 2.3-1 Store Data and Results
Manage and store measurement data, measurement specifications, and analysis
results. [PA154.IG102.SP103]
Storing measurement-related information enables the timely
and cost-effective future use of historical data and results. The information
also is needed to provide sufficient context for interpretation of the data,
measurement criteria, and analysis results. [PA154.IG102.SP103.N101]
Information stored typically includes the following: [PA154.IG102.SP103.N102]
· Measurement plans
· Specifications of measures
· Sets of data that have been collected
· Analysis reports and presentations
The stored information contains or references the
information needed to understand and interpret the measures and assess them for
reasonableness and applicability (e.g., measurement specifications used on
different projects when comparing across projects). [PA154.IG102.SP103.N103]
Data sets for derived measures typically can be
recalculated and need not be stored. However, it may be appropriate to store
summaries based on derived measures (e.g., charts, tables of results, or report
prose).
[PA154.IG102.SP103.N104]
Interim analysis results need not be stored separately if
they can be efficiently reconstructed.
[PA154.IG102.SP103.N105]
Projects may choose to store project-specific data and
results in a project-specific repository. When data are shared more widely
across projects, the data may reside in the organization’s measurement
repository.
[PA154.IG102.SP103.N106]
Refer to the Establish the Organization’s Measurement Repository specific
practice of the Organizational Process Definition process area for more
information about establishing the organization’s measurement repository.
[PA154.IG102.SP103.N106.R101]
Refer to the Configuration Management process area for information on
managing measurement work products.
[PA154.IG102.SP103.N106.R102]
Typical Work Products
1. Stored data
inventory [PA154.IG102.SP103.W101]
Subpractices
1. Review the data to ensure
their completeness, integrity, accuracy, and currency.
[PA154.IG102.SP103.SubP101]
2. Make the stored contents
available for use only by appropriate groups and personnel.
[PA154.IG102.SP103.SubP102]
3. Prevent the stored information
from being used inappropriately. [PA154.IG102.SP103.SubP103]
Examples of ways to prevent inappropriate use of the data and related
information include controlling access to data and educating people on the
appropriate use of data. [PA154.IG102.SP103.SubP103.N101]
Examples of inappropriate use include the following:
[PA154.IG102.SP103.SubP103.N102]
· Disclosure of information that was provided in confidence
· Faulty interpretations based on incomplete, out-of-context, or otherwise misleading information
· Measures used to improperly evaluate the performance of people or to rank projects
· Impugning the integrity of specific individuals
Report results of measurement and analysis activities to all relevant
stakeholders. [PA154.IG102.SP104]
The results of the measurement and analysis process are
communicated to relevant stakeholders in a timely and usable fashion to support
decision making and assist in taking corrective action. [PA154.IG102.SP104.N101]
Relevant stakeholders include intended users, sponsors,
data analysts, and data providers.
[PA154.IG102.SP104.N102]
Typical Work Products
1. Delivered
reports and related analysis results [PA154.IG102.SP104.W101]
2. Contextual
information or guidance to aid in the interpretation of analysis results [PA154.IG102.SP104.W102]
Subpractices
1. Keep relevant stakeholders
apprised of measurement results on a timely basis.
[PA154.IG102.SP104.SubP101]
Measurement results are
communicated in time to be used for their intended purposes. Reports are
unlikely to be used if they are distributed with little effort to follow up with
those who need to know the results. [PA154.IG102.SP104.SubP101.N101]
To the extent possible and as part
of the normal way they do business, users of measurement results are kept
personally involved in setting objectives and deciding on plans of action for
measurement and analysis. The users are regularly kept apprised of progress and
interim results.
[PA154.IG102.SP104.SubP101.N102]
Refer to the Project Monitoring and Control process area for more information on
the use of measurement results.
[PA154.IG102.SP104.SubP101.N102.R101]
2. Assist relevant stakeholders
in understanding the results. [PA154.IG102.SP104.SubP102]
Results are reported in a clear
and concise manner appropriate to the methodological sophistication of the
relevant stakeholders. They are understandable, easily interpretable, and
clearly tied to identified information needs and objectives.
[PA154.IG102.SP104.SubP102.N101]
The data are often not self
evident to practitioners who are not measurement experts. Measurement choices
should be explicitly clear about the following: [PA154.IG102.SP104.SubP102.N102]
· How and why the base and derived measures were specified
· How the data were obtained
· How to interpret the results based on the data analysis methods that were used
· How the results address their information needs
Examples of actions to assist in understanding of results include the following: [PA154.IG102.SP104.SubP102.N103]
· Discussing the results with the relevant stakeholders
· Providing a transmittal memo that provides background and explanation
· Briefing users on the results
· Providing training on the appropriate use and understanding of measurement results
Generic Practices by Goal
(Note: The detailed description of the GPs is available in a separate web page. Using the hyperlink provided here will open that web page in a separate window. However, the GP elaborations pertinent to the process area of this web page are available below.)
GG 1 Achieve Specific Goals
The process supports and enables achievement of the specific goals of the process area by transforming identifiable input work products to produce identifiable output work products.
Perform the base practices of the measurement and analysis process to develop
work products and provide services to achieve the specific goals of the process
area. [GP102]
GG 2 Institutionalize a Managed Process
The process is institutionalized as a managed process.
GP 2.1 Establish an Organizational Policy
Establish and maintain an organizational policy for planning and performing the
measurement and analysis process. [GP103]
Elaboration:
This policy establishes organizational expectations for
aligning measurement objectives and activities with identified information needs
and objectives and for providing measurement results. [PA154.EL101]
Establish and maintain the plan for performing the measurement and analysis
process. [GP104]
Elaboration:
Typically, this plan for performing the measurement and
analysis process is included in (or referenced by) the project plan, which is
described in the Project Planning process area.
[PA154.EL115]
Provide adequate resources for performing the measurement and analysis process,
developing the work products, and providing the services of the process. [GP105]
Elaboration:
Measurement personnel may be employed full time or part
time. A measurement group may or may not exist to support measurement activities
across multiple projects.
[PA154.EL104]
Examples of
other resources provided include the following tools: [PA154.EL105]
· Statistical packages
· Packages that support data collection over networks
Assign responsibility and authority for performing the process, developing the
work products, and providing the services of the measurement and analysis
process. [GP106]
Train the people performing or supporting the measurement and analysis process
as needed. [GP107]
Elaboration:
Examples of
training topics include the following: [PA154.EL107]
· Statistical techniques
· Data collection, analysis, and reporting processes
· Development of goal-related measurements (e.g., Goal Question Metric)
Place designated work products of the measurement and analysis process under
appropriate levels of configuration management.
[GP109]
Elaboration:
Examples of
work products placed under configuration management include the following: [PA154.EL108]
· Specifications of base and derived measures
· Data collection and storage procedures
· Base and derived measurement data sets
· Analysis results and draft reports
· Data analysis tools
GP 2.7 Identify and Involve Relevant Stakeholders
Identify and involve the relevant stakeholders of the measurement and analysis
process as planned. [GP124]
Elaboration:
Examples of
activities for stakeholder involvement include the following: [PA154.EL114]
· Establishing measurement objectives and procedures
· Assessing measurement data
· Providing meaningful feedback to those responsible for providing the raw data on which the analysis and results depend
GP 2.8 Monitor and Control the Process
Monitor and control the measurement and analysis process against the plan for
performing the process and take appropriate corrective action.
[GP110]
Elaboration:
Examples of
measures used in monitoring and controlling include the following: [PA154.EL111]
· Percentage of projects using progress and performance measures
· Percentage of measurement objectives addressed
GP 2.9 Objectively Evaluate Adherence
Objectively evaluate adherence of the measurement and analysis process against
its process description, standards, and procedures, and address noncompliance. [GP113]
Elaboration:
Examples of
activities reviewed include the following: [PA154.EL112]
· Aligning measurement and analysis activities
· Providing measurement results
Examples of
work products reviewed include the following: [PA154.EL113]
· Specifications of base and derived measures
· Data collection and storage procedures
· Analysis results and draft reports
GP 2.10 Review Status with Higher Level Management
Review the activities, status, and results of the measurement and analysis
process with higher level management and resolve issues.
[GP112]
GG 3 Institutionalize a Defined Process
The process is institutionalized as a defined process.
GP 3.1 Establish a Defined Process
Establish and maintain the description of a defined measurement and analysis
process. [GP114]
GP 3.2 Collect Improvement Information
Collect work products, measures, measurement results, and improvement
information derived from planning and performing the measurement and analysis
process to support the future use and improvement of the organization’s
processes and process assets. [GP117]
GG 4 Institutionalize a Quantitatively Managed Process
The process is institutionalized as a quantitatively managed process.
GP 4.1 Establish Quantitative Objectives for the Process
Establish and maintain quantitative objectives for the measurement and analysis
process that address quality and process performance based on customer needs and
business objectives. [GP118]
GP 4.2 Stabilize Subprocess Performance
Stabilize the performance of one or more subprocesses to determine the ability
of the measurement and analysis process to achieve the established quantitative
quality and process-performance objectives.
[GP119]
GG 5 Institutionalize an Optimizing Process
The process is institutionalized as an optimizing process.
GP 5.1 Ensure Continuous Process Improvement
Ensure continuous improvement of the measurement and analysis process in
fulfilling the relevant business objectives of the organization. [GP125]
GP 5.2 Correct Root Causes of Problems
Identify and correct the root causes of defects and other problems in the
measurement and analysis process. [GP121]