ISO/IEC 15504
   HOME

TheInfoList



OR:

ISO/IEC 15504 ''Information technology – Process assessment'', also termed Software Process Improvement and Capability Determination (SPICE), is a set of
technical standard A technical standard is an established norm or requirement for a repeatable technical task which is applied to a common and repeated use of rules, conditions, guidelines or characteristics for products or related processes and production methods, ...
s documents for the computer software development process and related business management functions. It is one of the joint
International Organization for Standardization The International Organization for Standardization (ISO ) is an international standard development organization composed of representatives from the national standards organizations of member countries. Membership requirements are given in Art ...
(ISO) and International Electrotechnical Commission (IEC) standards, which was developed by the ISO and IEC joint subcommittee,
ISO/IEC JTC 1/SC 7 ISO/IEC JTC 1/SC 7 Software and systems engineering is a standardization subcommittee of the Joint Technical Committee ISO/IEC JTC 1 of the International Organization for Standardization (ISO) and the International Electrotechnical Commission (IEC ...
. ISO/IEC 15504 was initially derived from process lifecycle standard ISO/IEC 12207 and from maturity models like Bootstrap,
Trillium ''Trillium'' (trillium, wakerobin, toadshade, tri flower, birthroot, birthwort, and sometimes "wood lily") is a genus of about fifty flowering plant species in the family Melanthiaceae. ''Trillium'' species are native to temperate regions of No ...
and the Capability Maturity Model (CMM). ISO/IEC 15504 has been superseded by '' ISO/IEC 33001:2015 Information technology – Process assessment – Concepts and terminology'' as of March, 2015.


Overview

ISO/IEC 15504 is the reference model for the maturity models (consisting of capability levels which in turn consist of the process attributes and further consist of generic practices) against which the assessors can place the evidence that they collect during their assessment, so that the assessors can give an overall determination of the organization's capabilities for delivering products (software, systems, and IT services).ISO/IEC 15504-2 Clause 5


History

A working group was formed in 1993 to draft the international standard and used the acronym SPICE. SPICE initially stood for ''
Software Software is a set of computer programs and associated software documentation, documentation and data (computing), data. This is in contrast to Computer hardware, hardware, from which the system is built and which actually performs the work. ...
Process Improvement and Capability Evaluation'', but in consideration of French concerns over the meaning of ''evaluation'', SPICE has now been renamed ''Software Process Improvement and Capability Determination''. SPICE is still used for the user group of the standard, and the title for the annual conference. The first SPICE was held in
Limerick Limerick ( ; ga, Luimneach ) is a western city in Ireland situated within County Limerick. It is in the province of Munster and is located in the Mid-West which comprises part of the Southern Region. With a population of 94,192 at the 2016 ...
,
Ireland Ireland ( ; ga, Éire ; Ulster Scots dialect, Ulster-Scots: ) is an island in the Atlantic Ocean, North Atlantic Ocean, in Northwestern Europe, north-western Europe. It is separated from Great Britain to its east by the North Channel (Grea ...
in 2000, ''SPICE 2003'' was hosted by
ESA , owners = , headquarters = Paris, Île-de-France, France , coordinates = , spaceport = Guiana Space Centre , seal = File:ESA emblem seal.png , seal_size = 130px , image = Views in the Main Control Room (120 ...
in the
Netherlands ) , anthem = ( en, "William of Nassau") , image_map = , map_caption = , subdivision_type = Sovereign state , subdivision_name = Kingdom of the Netherlands , established_title = Before independence , established_date = Spanish Netherl ...
, ''SPICE 2004'' was hosted in
Portugal Portugal, officially the Portuguese Republic ( pt, República Portuguesa, links=yes ), is a country whose mainland is located on the Iberian Peninsula of Southwestern Europe, and whose territory also includes the Atlantic archipelagos of ...
, ''SPICE 2005'' in
Austria Austria, , bar, Östareich officially the Republic of Austria, is a country in the southern part of Central Europe, lying in the Eastern Alps. It is a federation of nine states, one of which is the capital, Vienna, the most populous ...
, ''SPICE 2006'' in
Luxembourg Luxembourg ( ; lb, Lëtzebuerg ; french: link=no, Luxembourg; german: link=no, Luxemburg), officially the Grand Duchy of Luxembourg, ; french: link=no, Grand-Duché de Luxembourg ; german: link=no, Großherzogtum Luxemburg is a small lan ...
, ''SPICE 2007'' in
South Korea South Korea, officially the Republic of Korea (ROK), is a country in East Asia, constituting the southern part of the Korean Peninsula and sharing a land border with North Korea. Its western border is formed by the Yellow Sea, while its eas ...
, ''SPICE 2008'' in
Nuremberg Nuremberg ( ; german: link=no, Nürnberg ; in the local East Franconian dialect: ''Nämberch'' ) is the second-largest city of the German state of Bavaria after its capital Munich, and its 518,370 (2019) inhabitants make it the 14th-largest ...
,
Germany Germany,, officially the Federal Republic of Germany, is a country in Central Europe. It is the second most populous country in Europe after Russia, and the most populous member state of the European Union. Germany is situated betwe ...
and ''SPICE 2009'' in
Helsinki Helsinki ( or ; ; sv, Helsingfors, ) is the capital, primate, and most populous city of Finland. Located on the shore of the Gulf of Finland, it is the seat of the region of Uusimaa in southern Finland, and has a population of . The city ...
,
Finland Finland ( fi, Suomi ; sv, Finland ), officially the Republic of Finland (; ), is a Nordic country in Northern Europe. It shares land borders with Sweden to the northwest, Norway to the north, and Russia to the east, with the Gulf of B ...
. The first versions of the standard focused exclusively on software development processes. This was expanded to cover all related processes in a software business, for example
project management Project management is the process of leading the work of a team to achieve all project goals within the given constraints. This information is usually described in project documentation, created at the beginning of the development process. T ...
, configuration management, quality assurance, and so on. The list of processes covered grew to cover six areas: organizational management, engineering, acquisition supply, support, and operations. In a major revision to the draft standard in 2004, the process reference model was removed and is now related to the ISO/IEC 12207 (
Software Lifecycle Processes ISO/IEC/IEEE 12207 ''Systems and software engineering – Software life cycle processes'' is an international standard for software lifecycle processes. First introduced in 1995, it aims to be a primary standard that defines all the processes requ ...
). The issued standard now specifies the measurement framework and can use different process reference models. There are five general and industry models in use. Part 5 specifies software process assessment and part 6 specifies system process assessment. The latest work in the ISO standards working group includes creation of a maturity model, which is planned to become ISO/IEC 15504 part 7.


The standard

The Technical Report (TR) document for ISO/IEC TR 15504 was divided into 9 parts. The initial International Standard was recreated in 5 parts. This was proposed from Japan when the TRs were published at 1997. The International Standard (IS) version of ISO/IEC 15504 now comprises 6 parts. The 7th part is currently in an advanced Final Draft Standard form and work has started on part 8. ''Part 1'' of ISO/IEC TR 15504 explains the concepts and gives an overview of the framework.


Reference model

ISO/IEC 15504 contains a '' reference model''. The reference model defines a ''process dimension'' and a ''capability dimension''. The process dimension in the reference model is not the subject of ''part 2'' of ISO/IEC 15504, but part 2 refers to external process lifecycle standards including ISO/IEC 12207 and ISO/IEC 15288. The standard defines means to verify conformity of reference models.


Processes

The ''process dimension'' defines processes divided into the five process categories of: * customer-supplier * engineering * supporting * management * organization With new parts being published, the process categories will expand, particularly for IT service process categories and enterprise process categories.


Capability levels and process attributes

For each process, ISO/IEC 15504 defines a ''capability level'' on the following scale: The capability of processes is measured using process attributes. The international standard defines nine process attributes: * 1.1 Process performance * 2.1 Performance management * 2.2 Work product management * 3.1 Process definition * 3.2 Process deployment * 4.1 Process measurement * 4.2 Process control * 5.1 Process innovation * 5.2 Process
optimization Mathematical optimization (alternatively spelled ''optimisation'') or mathematical programming is the selection of a best element, with regard to some criterion, from some set of available alternatives. It is generally divided into two subfi ...
Each process attribute consists of one or more generic practices, which are further elaborated into practice indicators to aid assessment performance.


Rating scale of process attributes

Each process attribute is assessed on a four-point (N-P-L-F) rating scale: * Not achieved (0–15%) * Partially achieved (>15–50%) * Largely achieved (>50–85%) * Fully achieved (>85–100%). The rating is based upon evidence collected against the practice indicators, which demonstrate fulfillment of the process attribute.


Assessments

ISO/IEC 15504 provides a guide for ''performing an assessment''. This includes: * the assessment process * the model for the assessment * any tools used in the assessment


Assessment process

Performing assessments is the subject of ''parts 2 and 3'' of ISO/IEC 15504. Part 2 is the normative part and part 3 gives a guidance to fulfill the requirements in part 2. One of the requirements is to use a conformant assessment method for the assessment process. The actual method is not specified in the standard although the standard places requirements on the method, method developers and assessors using the method.van Loon, 2007a The standard provides general guidance to assessors and this must be supplemented by undergoing formal training and detailed guidance during initial assessments. The assessment process can be generalized as the following steps: * initiate an assessment (assessment sponsor) * select assessor and assessment team * plan the assessment, including processes and organizational unit to be assessed (lead assessor and assessment team) * pre-assessment briefing * data collection * data validation * process rating * reporting the assessment result An assessor can collect data on a process by various means, including interviews with persons performing the process, collecting documents and quality records, and collecting statistical process data. The assessor validates this data to ensure it is accurate and completely covers the assessment scope. The assessor assesses this data (using his expert judgment) against a process's base practices and the capability dimension's generic practices in the process rating step. Process rating requires some exercising of expert judgment on the part of the assessor and this is the reason that there are requirements on assessor qualifications and competency. The process rating is then presented as a preliminary finding to the sponsor (and preferably also to the persons assessed) to ensure that they agree that the assessment is accurate. In a few cases, there may be feedback requiring further assessment before a final process rating is made.van Loon, 2007b


Assessment model

The ''process assessment model (PAM)'' is the detailed model used for an actual assessment. This is an elaboration of the process reference model (PRM) provided by the process lifecycle standards. The process assessment model (PAM) in part 5 is based on the process reference model (PRM) for software: ISO/IEC 12207. The process assessment model in part 6 is based on the process reference model for systems: ISO/IEC 15288. The standard allows other models to be used instead, if they meet ISO/IEC 15504's criteria, which include a defined community of interest and meeting the requirements for content (i.e. process purpose, process outcomes and assessment indicators).


Tools used in the assessment

There exist several assessment tools. The simplest comprise paper-based tools. In general, they are laid out to incorporate the assessment model indicators, including the base practice indicators and generic practice indicators. Assessors write down the assessment results and notes supporting the assessment judgment. There are a limited number of computer based tools that present the indicators and allow users to enter the assessment judgment and notes in formatted screens, as well as automate the collated assessment result (i.e. the process attribute ratings) and creating reports.


Assessor qualifications and competency

For a successful assessment, the ''assessor'' must have a suitable level of the relevant skills and experience. These skills include: * personal qualities such as communication skills. * relevant education and training and experience. * specific skills for particular categories, e.g. management skills for the management category. * ISO/IEC 15504 related training and experience in process capability assessments. The competency of assessors is the subject of ''part 3'' of ISO/IEC 15504. In summary, the ISO/IEC 15504 specific training and experience for assessors comprise: * completion of a 5-day lead assessor training course * performing at least one assessment successfully under supervision of a competent lead assessor * performing at least one assessment successfully as a lead assessor under the supervision of a competent lead assessor. The competent lead assessor defines when the assessment is successfully performed. There exist schemes for certifying assessors and guiding lead assessors in making this judgement.


Uses

ISO/IEC 15504 can be used in two ''contexts'': * Process improvement, and * Capability determination (= evaluation of supplier's process capability).


Process improvement

ISO/IEC 15504 can be used to perform process improvement within a technology organization. Process improvement is always difficult, and initiatives often fail, so it is important to understand the initial baseline level (process capability level), and to assess the situation after an improvement project. ISO 15504 provides a standard for assessing the organization's capacity to deliver at each of these stages. In particular, the reference framework of ISO/IEC 15504 provides a structure for defining objectives, which facilitates specific programs to achieve these objectives. Process improvement is the subject of ''part 4'' of ISO/IEC 15504. It specifies requirements for improvement programmes and provides guidance on planning and executing improvements, including a description of an eight step improvement programme. Following this improvement programme is not mandatory and several alternative improvement programmes exist.


Capability determination

An organization considering outsourcing software development needs to have a good understanding of the capability of potential suppliers to deliver. ISO/IEC 15504 (Part 4) can also be used to inform supplier selection decisions. The ISO/IEC 15504 framework provides a framework for assessing proposed suppliers, as assessed either by the organization itself, or by an independent assessor. The organization can determine a ''target capability'' for ''suppliers'', based on the organization's needs, and then assess suppliers against a set of target process profiles that specify this target capability. Part 4 of the ISO/IEC 15504 specifies the high level requirements and an initiative has been started to create an extended part of the standard covering target process profiles. Target process profiles are particularly important in contexts where the organization (for example, a government department) is required to accept the cheapest ''qualifying'' vendor. This also enables suppliers to identify gaps between their current capability and the level required by a potential customer, and to undertake improvement to achieve the contract requirements (i.e. become qualified). Work on extending the value of capability determination includes a method called Practical Process Profiles - which uses risk as the determining factor in setting target process profiles. Combining risk and processes promotes improvement with active risk reduction, hence reducing the likelihood of problems occurring.


Acceptance of ISO/IEC 15504

ISO/IEC 15504 has been successful as: * ISO/IEC 15504 is available through National Standards Bodies. * It has the support of the international community. * Over 4,000 assessments have been performed to date. * Major sectors are leading the pace such as automotive, space and medical systems with industry relevant variants. * Domain-specific models like ''Automotive SPICE'' and ''SPICE 4 SPACE'' can be derived from it. * There have been many international initiatives to support take-up such as SPICE for small and very small entities. On the other hand, ISO/IEC 15504 may not be as popular as CMMI for the following reasons: * ISO/IEC 15504 is not available as free download, but must be purchased from the ISO. (Automotive SPICE, on the other hand, can be freely downloaded from the link supplied below.) CMM, and later CMMI, were originally available as free downloads from the SEI website. However, beginning with CMMI v2.0 a license must now be purchased from SEI. * The CMM, and later CMMI, were originally sponsored by the
US Department of Defense The United States Department of Defense (DoD, USDOD or DOD) is an executive branch department of the federal government charged with coordinating and supervising all agencies and functions of the government directly related to national sec ...
(DoD). Now, however, DoD no longer funds CMMI or mandates its use. * The CMM was created first, and reached critical 'market' share before ISO 15504 became available. * The CMM has subsequently been replaced by the CMMI, which incorporates many of the ideas of ISO/IEC 15504, but also retains the benefits of the CMM. Like the CMM, ISO/IEC 15504 was created in a development context, making it difficult to apply in a service management context. But work has started to develop an
ISO/IEC 20000 ISO/IEC 20000 is the international standard for IT service management. It was developed in 2005 by ISO/IEC JTC1/SC7 and revised in 2011 and 2018. It was originally based on the earlier BS 15000 that was developed by BSI Group. ISO/IEC 20000, lik ...
-based process reference model (ISO/IEC 20000-4) that can serve as a basis for a process assessment model. This is planned to become part 8 to the standard (ISO/IEC 15504-8). In addition there are methods available that adapt its use to various contexts.


See also

*
ISO/IEC JTC 1/SC 7 ISO/IEC JTC 1/SC 7 Software and systems engineering is a standardization subcommittee of the Joint Technical Committee ISO/IEC JTC 1 of the International Organization for Standardization (ISO) and the International Electrotechnical Commission (IEC ...


Further reading

* Cass, A. et al. “SPiCE in Action - Experiences in Tailoring and Extension.” ''Proceedings. 28th Euromicro Conference''. IEEE Comput. Soc, 2003. Print. *Eito-Brun, Ricardo.
Comparing SPiCE for Space (S4S) and CMMI-DEV: Identifying Sources of Risk from Improvement Models.
''Communications in Computer and Information Science''. Berlin, Heidelberg: Springer Berlin Heidelberg, 2013. 84–94. Print.
International Conference on Software Process Improvement and Capability Determination (2011-2018)
*Mesquida, Antoni Lluís, Antònia Mas, and Esperança Amengual. “An ISO/IEC 15504 Security Extension.” ''Communications in Computer and Information Science''. Berlin, Heidelberg: Springer Berlin Heidelberg, 2011. 64–72. Print. *Schlager, Christian et al. “Hardware SPICE Extension for Automotive SPICE 3.1.” ''Communications in Computer and Information Science''. Cham: Springer International Publishing, 2018. 480–491. Print.


External links

* ISO/IEC 33001:2015 - Information technology — Process assessment — Concepts and terminology *VDA QMC Homepage fo
Automotive SPICE


References

{{DEFAULTSORT:ISO IEC 15504 Software engineering standards Software development process #15504