Performance
Building confidence in biometric systems through comprehensive performance assessment.
BixeLab provides independent evaluation of performance characteristics of biometric systems, both algorithmic and system-wide.
Our services assess both whole system ‘scenario-style’ and algorithm components ‘technology-style’, in alignment with ISO/IEC standards and common identity frameworks.
What Is Biometric Performance?
Central to biometric identity systems is the idea of matching – i.e., comparing several pieces of biometric data to assess whether they come from the same person or not. Whether comparing two images of faces to assess whether a new customer is real or fraudulent, searching for a supplied fingerprint in a database of many previously captured, or assessing whether a customer speaking to a contact centre is a match to the correct account holder, all involve biometric processes of matching.
These matching processes have measurable performance characteristics. Like any probabilistic system, these must be determined empirically – through testing with appropriate data sets. Common objectives include checking how often the system correctly matches samples from the same person, and correctly rejects samples from different people – with the reverse cases, where mistakes are made with associated consequences, being of particular interest.
Often, performance characteristics are dependent on the quality of biometric data captured and stored – and this, in turn, relates to capture devices and processes. Critically, performance typically depends on the specific usage scenario in question – performance attained in one context is unlikely to be the same as that in another, even when using the same biometric algorithms and capture devices.
Benefits of Testing for Performance
Operational Readiness
Ensure systems function properly in the actual environments where they are deployed.
Regulatory Assurance
Meet technical standards and framework requirements for performance in key use scenarios.
Build Public Confidence
Deliver public services with independent assurance that identity is being securely managed.
What Can Be Tested for Performance?
All biometric modes, including multi-modal systems
Interaction between capture quality and performance
Rates of correct matching, incorrect matching, correct rejection and incorrect rejection
Both verification (1:1) and searching / identification (1:N) usage
Both on-device and centralised matching
Comparisons of matching algorithms across devices (for example, to manage risk from user-supplied device authentication)
Algorithmic performance (based on previously captured data, often from the BixeLab library – ‘technology-style’)
Whole-of-system performance (based on test crews recruited by BixeLab, often at scale – ‘scenario-style’)
Interaction with demographic characteristics
Capability of human identity resolution personnel in supporting cases not determined by, or needing support of, such personnel
Conformance to ISO/IEC 19795 testing standards
Our Capabilities
As one of only three NVLAP (Lab Code 600301-0) accredited labs in the world, BixeLab offers trusted expertise in real-world testing and assurance relating to vulnerabilities in biometric systems.
Our services include:
-
Environmental and field testing of biometric systems
-
Throughput and user experience assessment
-
Advisory on deployment strategies and failure mitigation
-
Risk assessment for mission-critical systems
-
Wide ranging libraries of biometric data of different types to support algorithmic testing
-
Capacity to recruit test subjects across different demographic groups, regions, ability levels, etc. to support realistic assessment of performance in specific scenarios.
-
Able to test to many identity framework requirements
-
Training support via BixeAcademy
Why Choose BixeLab?
Q: Can you simulate real-world environments for testing?
Yes. We conduct laboratory and field testing under variable lighting, temperature, and usage scenarios to match your deployment conditions.
Q: Do you have data to test algorithms?
Yes, across a wide range of biometric modalities. That said, for some types of biometrics, data capture processes are required to collect new biometric data types. Some algorithms are dependent on specific acquisition processes, and in these cases, we recommend scenario-style testing to properly assess performance.
Q: What types of clients use this service?
Government border agencies, retailers, police agencies, digital identity users, critical infrastructure operators, and system integrators rely on our assurance services.