BS ISO/IEC 13210:1999

Section 1: General
1.1 Scope
1.2 Normative References
1.3 Conformance criteria
1.4 IUT conformance assessment
Section 2: Terminology and General Requirements
2.1 Conventions
2.2 Definitions
Section 3: Assertion definitions, types, syntax,
           and constructs
3.1 Introduction
3.2 Generic assertion structure
3.3 Assertion types and constructs
3.4 Macros
3.5 Summary
Section 4: Test Result Codes
4.1 Introduction
4.2 Test method implementations
4.3 Test method specifications
Section 5: Test Report
5.1 Test report
5.2 CD audit
Section 6: Profiles
6.1 Definition
6.2 Conformance to a profile
6.3 Conformance assessment
Section 7: Guidelines for Testing and Complexity
           Levels
7.1 Introduction
7.2 Testing levels
7.3 Complexity levels
7.4 Conclusion
Section 8: Guidelines for Writing Assertions
8.1 Introduction
8.2 Identifying preconditions
8.3 Writing the
8.4 Other assertion types
8.5 Macros
Section 9: Comprehensive Examples
9.1 Specification of allowable test result codes
Annex A (informative) Bibliography
A.1 Related Standards
Annex B (informative) Rationale and Notes
B.1 General
B.2 Definitions and general requirements
B.3 Assertion definitions, types, syntax and
      constructs
B.4 Test result codes
B.5 Test report
B.6 Profiles
B.7 Guidelines for testing and complexity levels
B.8 Guidelines for writing assertions
Alphabetic Topical Index
Figures
1-1 Single base standard
3-1 Generic assertion structure
3-2 Assertion types
3-3 Basic assertion structure
3-4 General assertion structure
3-5 Assertion derived from a general assertion
3-6 Reference assertion structure
3-7 Documentation assertion structure
3-8 General documentation assertion structure
3-9 Documentation assertion from a general
      documentation assertion
3-10 Examples of unused assertion identifiers
4-1 Entity versus allowable test result code
6-1 Profile standard from multiple base standards
6-2 Profile standard from multiple profiles
8-1 Terms
9-1 Entity versus allowable test result code
Tables
2-1 Typographical Conventions
8-1 C language limits
8-2 Phrases denoting allowable test result codes
8-3 Features denoting allowable test result codes

Defines general rules for developing test assertions and related test methods for measuring conformance of an implementation to POSIX standards. Coverage includes: complexity levels, method of classification, assertion documentation, assertion constructs, and conformance criteria. Also gives definitions, tables and annexes.

This International Standard is applicable to the development and use of conformance test method specifications for POSIX standards and may be applicable to other application programming interface specifications. This International Standard is intended for developers and users of test method specifications and test method implementations.

The users of this standard include

• Assertion Writers: to format assertions

• Assertion Test Writers: to write assertion tests

• Test Suite or System Procurers: to interpret the results of test suites

The purpose of this standard is to define requirements and guidelines for developing assertions and related test methods for measuring conformance of an implementation under test (IUT) to POSIX standards. Test method implementations may include Conformance Test Software (CTS), POSIX Conformance Test Procedures (CTP), and audits of Conformance Documents (CD).

Testing conformance of an implementation to a standard includes testing the capabilities and behavior of the implementation with respect to the conformance requirements of the standard. Test methods are intended to provide a reasonable, practical assurance that the implementation conforms to the standard. Use of these test methods will not guarantee conformance of an implementation to the standard; that normally would require exhaustive testing (see 7.2.1), which is impractical for both technical and economic reasons.