BS ISO/IEC 19795-4:2008

Foreword
Introduction
1 Scope
2 Conformance
3 Normative references
4 Terms and definitions
5 Abbreviated terms
6 Goals
  6.1 Coverage
  6.2 Target application
      6.2.1 Biometric application
      6.2.2 Interoperable application
  6.3 Purpose
      6.3.1 Interoperability testing
      6.3.2 Sufficiency testing
7 Metrics
  7.1 General
  7.2 Figures of merit
      7.2.1 Recognition performance figure of merit
      7.2.2 Measuring component failure
  7.3 Interoperability matrices
      7.3.1 General
      7.3.2 Interoperability with sBDB generators
      7.3.3 Interoperability with sBDB generators
      7.3.4 Fixed operating point interoperability
      7.3.5 Reporting failure of sBDB generators
  7.4 Proprietary performance
8 Conducting a test
  8.1 Structure of test
  8.2 Sample data
      8.2.1 Acquisition
      8.2.2 Representative data
      8.2.3 Collection of ancillary data
      8.2.4 Corpus size
      8.2.5 Removal of subject-specific metadata
      8.2.6 Removal of unrepresentative metadata
      8.2.7 Origin of samples
      8.2.8 Untainted samples
      8.2.9 Sequestered data
  8.3 Conformance testing
      8.3.1 Conformance
      8.3.2 Executing conformance tests
      8.3.3 Reporting
  8.4 Constraints on the sBDBs
      8.4.1 Optional encodings
      8.4.2 Optional encodings from profile standards
      8.4.3 Deviation from the base standard
      8.4.4 Data encapsulation
  8.5 Components
      8.5.1 Components for sufficiency testing
      8.5.2 Establishing modularity requirements
      8.5.3 Components for interoperability testing
      8.5.4 Underlying algorithms
      8.5.5 Capture device user interfaces
      8.5.6 Multimodal components
      8.5.7 Component variability
      8.5.8 Component reporting requirements
  8.6 Planning decisions
      8.6.1 Computational intensity
      8.6.2 Supplier recruitment
      8.6.3 Provision of samples to suppliers
      8.6.4 Equivalency of generator resources
      8.6.5 Handling violations of test requirements
      8.6.6 Comparison subsystem output data
            encapsulation
      8.6.7 Fundamental generator requirement
      8.6.8 Fundamental comparison subsystem
            requirement
      8.6.9 General requirements on software
            implementations
  8.7 Prevention and detection of gaming
      8.7.1 General aspects
      8.7.2 Modes of gaming
      8.7.3 Prevention and detection of gaming
  8.8 Test procedure
      8.8.1 Primary test
      8.8.2 Uncertainty measurement
      8.8.3 Variance estimation
      8.8.4 Remedial testing
      8.8.5 Survey of configurable parameters
9 Interpretation of the interoperability matrix
  9.1 Determination of interoperable subsystems
      9.1.1 General
      9.1.2 Identifying interoperable combinations
            of subsystems
      9.1.3 Acceptable numbers of interoperable subsystems
      9.1.4 Combinatorial search for maximum
            interoperability-classes
      9.1.5 Multiple interoperable subgroups
      9.1.6 Statistical stability of the test result
  9.2 Interoperability with previously certified products
      9.2.1 Decertification considerations
      9.2.2 Continuity of testing
      9.2.3 Interoperability with previously certified
            generators
      9.2.4 Interoperability with previously certified
            comparison subsystems
      9.2.5 Treatment of systematic effects
      9.2.6 Retroactive exclusion from analysis
  9.3 Overall sufficiency
Annex A (informative) - Procedures for conducting a test
        of sufficiency and/or interoperability
Annex B (informative) - Example Interoperability Test
Bibliography

Describes methods for technology and scenario evaluations of multi-supplier biometric systems that use biometric data conforming to biometric data interchange format standards.

This part of ISO/IEC 19795 prescribes methods for technology and scenario evaluations of multi-supplier biometric systems that use biometric data conforming to biometric data interchange format standards.

It specifies requirements needed to assess

• performance available from samples formatted according to a standard interchange format (SIF),

• performance available when samples formatted according to a SIF are exchanged,

• performance available from samples formatted according to a SIF, relative to proprietary data formats,

• SIF interoperability, by quantifying cross-product performance relative to single-product performance,

• performance available from multi-sample and multimodal data formatted according to one or more SIFs, and

• performance interoperability of biometric capture devices.

In addition, this part of ISO/IEC 19795

• includes procedures for establishing an interoperable set of implementations,

• defines procedures for testing interoperability with previously established sets of implementations, and

• gives testing procedures for the measurement of interoperable performance.

It does not

• establish a conformance test for biometric data interchange formats, or

• provide test procedures for online data collection.