The ISO / IEC / IEEE 29119 series consists of five standards. Its stated purpose is to define an internationally agreed set of standards to support software testing.
Maps, Directions, and Place Reviews
Introduction
Background
ISO/IEC/IEEE 29119 software testing standards are a set of internationally defined documents addressing the software testing concepts, processes, techniques, documents, technologies, and terms..
Currently ISO/IEC/IEEE 29119 has five parts. The set of standards use a layered approach to defining software testing, which is common to many ISO standards. This set of standards presents: test definitions and concepts (part 1); test processes (part 2); test documentation (part 3); test techniques (part 4); and keyword-driven testing (part 5).
The Standards Jigsaw
The ISO/IEC/IEEE 29119 set of standards are being developed by Working Group 26 (WG26) of Sub-Committee 7 (SC7) of Joint Technical Committee 1 (JTC1) of the International Organization for Standardization (ISO) and the International Electrotechnical Commission in cooperation with the Software & Systems Engineering Standards Committee of the Institute of Electrical and Electronics Engineers (IEEE) Computer Society.
Within ISO/IEC JTC 1/SC 7, ISO/IEC/IEEE 29119 is part of a larger body of ISO/IEEE standards made up of 153 standards, including ISO/IEC 12207 software life cycle processes and ISO/IEC 15288 systems engineering.
Members of WG26 are experts and testers from within an international community of testers, who participated and contributed testing concepts during the drafting, review and consensus process.
Development and Consensus
Development of the set of ISO/IEC/IEEE 29119 software testing standards began in May 2007 by WG26; these standards were created and developed by ISO and IEEE using their standard development methods. The development and approval process is by consensus, which means that a majority of the standard development participants (not the whole world of software tests) agrees with the document. Consensus was reached with a variety of countries and professional organizations that are members of SC7/JTC1 and IEEE: within ISO, SC7 member countries approved ISO/IEC/IEEE 29119 by majority, whilst IEEE approved ISO/IEC/IEEE 29119 within its standards association group.
Membership in these are subject to ISO and IEEE rules and is an open process with these organizations, though not every tester in the world can be involved.
Consensus in ISO/IEEE does not mean that all testers in the world would agree with every idea and concept in the standard, but that the organizations and people involved in the standards' production did reach agreement. Further, the consensus process does not imply that all viable and new concepts to develop or provide testing goods and services are defined within the standard.
Publication
The first three parts were published in 2013, with the fourth and fifth following in 2015 and 2016 respectively:
- ISO/IEC/IEEE 29119-1: Concepts & Definitions, published September 2013
- ISO/IEC/IEEE 29119-2: Test Processes, published September 2013
- ISO/IEC/IEEE 29119-3: Test Documentation, published September 2013
- ISO/IEC/IEEE 29119-4: Test Techniques, published December 2015
- ISO/IEC/IEEE 29119-5: Keyword Driven Testing, published November 2016
Replacement of existing standards
The ISO/IEC/IEEE 29119 standards replace a number of existing software testing standards:
- IEEE 829 Test Documentation
- IEEE 1008 Unit Testing
- BS 7925-1 Vocabulary of Terms in Software Testing
- BS 7925-2 Software Component Testing Standard
These standards will be phased out over time.
Purpose and Usage
ISO/IEC/IEEE 29119 software testing standards are intended to be software domain, environment, and organization independent while supporting a variety of software lifecycles and methods. The process approach is fundamentally risk-based testing and can support test planning and strategy development.
Teams implementing the ISO/IEC/IEEE 29119 standards are adopting and following an internationally recognized standard for software testing. The standard is made available throughout the world and thus provides a basis for an international trading language within the scope of ISO and IEEE using organizations.
Intended benefits
The standards were not intended to be state of the art or capture all practices in testing. New concepts and different testing practices will be added in future updates or new parts as ISO/IEC/IEEE 29119 evolves. Finally, future additions to the standard to address other testing concepts and scope are likely, e.g. model-based testing, etc.
Potential users of the standards may include:
- Companies needing common baseline of testing concepts, terms, and ideas (an organization to organization trading language to help promote national and international business);
- Government organizations and regulators needing an ISO/IEC/ISO industry approved baseline;
- Test organization needing an industry based starting point;
- Purchasers and procurers of software products to assess third parties;
- Developers of software, e.g. to support unit level testing;
- Regulatory authorities wishing to provide accreditation services against the standards;
- Professional training course developers and providers;
- University lecturers wishing to teach their students content from the standards;
- University researchers wishing to conduct research and collect data based on the standards;
- Software testing tool vendors wishing to implement concepts from the standards;
- Organizations wishing to gain accreditation to the standard.
Approach and tailoring
ISO/IEC/IEEE 29119 - 1 provides a common set of terms and concepts to support the other parts. The approach basis for ISO/IEC/IEEE 29119-2 is risk-based. In risk-based testing, risks are used to limit and arrange the test effort within project contexts of problem space, cost and schedule. This is done to solve the problem that testing can be viewed as having an infinite problem space (i.e. complete 100% testing is not possible). . ISO/IEC/IEEE 29119-3 provides definition of common test documents, which can be selected via tailoring as needed. ISO/IEC/IEEE 29119-4 provides structural and functional test techniques, which can also be selected as part of a tailoring activity. Finally, ISO/IEC/IEEE 29119-5 provides definition of keyword-driven test approaches and concepts, for use in project needing keywords. By the use of ISO 29119 heuristics, the test problem can be managed and solved within context of a project or organization Use of the standards can be tailored (requirements removed, changed, or added) in support of contracts or projects to fit local context and needs resulting in varying degrees of adoption. For example, users may select only 2 or 3 document outlines from ISO/IEC/IEEE 29119-3. As per common practice, tailoring needs to be agreed to by stakeholders.
Structure and contents of the standards - Overview of each part
The following sections outline the existing parts of standards that are currently published and/or under development.
ISO/IEC/IEEE 29119-1 (Part 1) - Concepts and Definitions
ISO/IEC/IEEE 29119 Software Testing - Concepts and Definitions, facilitates the use of the other parts of the standard by introducing the vocabulary on which the standard is built and provides examples of its application in practice. Part 1 is informative, providing definitions, a description of the concepts of software testing and ways to apply the software testing process defined in the ISO/IEC/IEEE 29119 part 2 standard and guidance for the other ISO/IEC/IEEE 29119 standards.
ISO/IEC/IEEE 29119-2 (Part 2) - Test Processes
ISO/IEC/IEEE 29119 Software Testing - Test Processes, defines a generic process model for software testing that is intended for use by organizations when performing software testing. It comprises test process descriptions that define the software testing processes at the organizational level, test management level and dynamic test levels. . The processes defined in this standard can be used in conjunction with different software development lifecycle model.
ISO/IEC/IEEE 29119-3 (Part 3) - Test Documentation
ISO/IEC/IEEE 29119 Software Testing - Test Documentation, includes templates and examples of test documentation that are produced during the test process. The templates support ISO/IEC/IEEE 29119-2 Test Processes, i.e. by the test process in which they are produced.
ISO/IEC/IEEE 29119-4 (Part 4) - Test Techniques
ISO/IEC/IEEE 29119 Software Testing - Test Techniques, provides standard definitions of software test design techniques (also known as test case design techniques or test methods) that can be used during the test design and implementation process that is defined in ISO/IEC/IEEE 29119-2. Techniques of part 4 are intended to support part 2 or can be used without part 2.
Suggested Test Design Techniques are categorized in Specification-Based Test Design Techniques, Structure-Based Test Design Techniques, and Experience-Based Test Design Techniques.
Specification-Based Test Design Techniques
Specification-Based Test Design Techniques base on the (functional) specification of the system under test. They are also called black-box testing.
Suggested Test Design Techniques in this group are:
- Equivalence Partitioning
- Classification Tree Method
- Boundary Value Analysis
- Syntax Testing
- Combinatorial Test Design Techniques
- Decision Table Testing
- Cause-Effect Graphing
- State Transition Testing
- Scenario Testing
- Random Testing
Structure-Based Test Design Techniques
Structure-Based Test Design Techniques base on the (internal) structure of the system under test. They are also called white-box testing.
Suggested Test Design Techniques in this group are:
- Branch Testing
- Decision Testing
- Branch Condition Testing
- Branch Condition Combination Testing
- Modified Condition Decision Coverage (MCDC) Testing
- Data Flow Testing
Experience-Based Test Design Techniques
Experience-Based Test Design Techniques rely on the experience of the human tester.
Suggested Test Design Techniques in this group are:
- Error Guessing
ISO/IEC/IEEE 29119-5 (Part 5) - Keyword-Driven Testing
This standard covers keyword-driven testing. Keyword-driven testing is an approach to specifying software tests (normally automated) that is already widely used in the software testing industry. This standard is intended for users who want to create keyword-driven test specifications, create corresponding frameworks, or build test automation based on keywords.
Future plans for maintenance of standards
All ISO standards are reviewed, revised, and if necessary retired no later than 5 years after publishing. ISO/IEC/IEEE 29119 naturally follows the same process. Interested parties can provide input to the standard for the systematic review, either via the ISO national standard bodies, or by directly approaching the standard organizations including ISO, IEC or IEEE standards association. The decision about a revision of the standards will be based on the available feedback, comments, input, consensus and voting. The future plans for ISO/IEC/IEEE 29119 parts will attempt to address as many current issues and controversy items as consensus will allow. The impact and proof by use of ISO/IEC/IEEE 29119 parts remain future work. Before the viability of the standard can be determined, the standard had to be developed and made available for use, which has happened. The development represented what participants understood to be common practice in their experience in countries, companies, and organization. These groups will be the initial users of the standard and will provide evidence of success or failure.
Controversy
There is resistance from sections of the testing community towards the standardization of software testing. In particular, the context-driven community and the International Society for Software Testing reject these standards. In short, the reason for opposition is that ISO-29119 effectively excludes Context Driven Testing and at the same time Context Driven Testing won't agree to any simplistic standard based on templates or simple formulae.
Source of the article : Wikipedia
EmoticonEmoticon