*
unknown
inadequate
acceptable
good
The acquisition
and implementation methodology is established and consistently
applied
*
unknown
inadequate
acceptable
good
Resources
are available to support a separate test environment and sufficient
time is allowed for the test process
*
unknown
inadequate
acceptable
good
Commitment
and involvement of stakeholders is assured in the testing, training
and transition processes
*
unknown
inadequate
acceptable
good
Test data
is available and representative of live data in kind and quantity,
and the test environment reflects as close as possible the live
environment
*
unknown
inadequate
acceptable
good
A feedback
mechanism is implemented for optimising and continuously improving
the process
*
unknown
inadequate
acceptable
good
Stress testing
is performed for new systems before they are rolled out and regression
testing is conducted for existing systems when changes are implemented
*
unknown
inadequate
acceptable
good
Procedures
for formally certifying and accrediting systems for security are
consistently defined and adhered to
*
unknown
inadequate
acceptable
good
There is
clear understanding and verification of operational requirements
*
unknown
inadequate
acceptable
good
*
*
unknown
inadequate
acceptable
good
*
*
unknown
inadequate
acceptable
good
*
KEY
GOAL INDICATORS
*
unknown
inadequate
acceptable
good
Reduced number
of missed installation and accreditation milestones
*
unknown
inadequate
acceptable
good
Time to complete
the installation and accreditation process, from beginning to
the end of the security certification and accreditation process
*
unknown
inadequate
acceptable
good
Reduced number
of operational systems not accredited, in the instance where the
process did not occur
*
unknown
inadequate
acceptable
good
Number of
changes to installed systems needed to optimise operations
*
unknown
inadequate
acceptable
good
Number of
changes required following system acceptance testing
*
unknown
inadequate
acceptable
good
Number of
findings during internal or external audits regarding the installation
and accreditation process
*
unknown
inadequate
acceptable
good
Number of
changes required to correct problems after solutions are put into
production
*
unknown
inadequate
acceptable
good
*
*
unknown
inadequate
acceptable
good
*
KEY
PERFORMANCE INDICATORS
*
unknown
inadequate
acceptable
good
Degree of
stakeholder involvement in the installation and accreditation
process
*
unknown
inadequate
acceptable
good
Number of
automated installation and accreditation processes
*
unknown
inadequate
acceptable
good
Frequency
of reporting of lessons learned
*
unknown
inadequate
acceptable
good
Reported
user satisfaction with the installation and accreditation process
(lessons learned)
*
unknown
inadequate
acceptable
good
Number of
findings during the quality assurance review of installation and
accreditation functions
*
unknown
inadequate
acceptable
good
Reusability
of the test platform
*
unknown
inadequate
acceptable
good
*
*
unknown
inadequate
acceptable
good
*
*
unknown
inadequate
acceptable
good
*
*
unknown
inadequate
acceptable
good
*