FRVT Report 2019 10 16 PDF

NISTIR XXXX Draft
Ongoing Face Recognition

Vendor Test (FRVT)
Part 1: Verification
Patrick Grother
Mei Ngan
Kayee Hanaoka
Information Access Division
Information Technology Laboratory
This publication is available free of charge from:

https://www.nist.gov/programs-projects/face-recognition-vendor-test-frvt-ongoing
2019/10/16
FRVT - FACE RECOGNITION VENDOR TEST - VERIFICATION 1
ACKNOWLEDGMENTS
The authors are grateful to Wayne Salamon and Greg Fiumara at NIST for robust software infrastructure,
particularly that which leverages Berkeley DB Btrees for storage of images and templates, and Open MPI for
parallel execution of algorithms across our computers. Thanks also to Brian Cochran at NIST for providing
highly available computers and network-attached storage.
DISCLAIMER
Specific hardware and software products identified in this report were used in order to perform the evalua-
tions described in this document. In no case does identification of any commercial product, trade name, or
vendor, imply recommendation or endorsement by the National Institute of Standards and Technology, nor
does it imply that the products and equipment identified are necessarily the best available for the purpose.
FNMR(T) “False non-match rate”

2019/10/16 12:43:37
FMR(T) “False match rate”
FRVT STATUS
This report is a draft NIST Interagency Report, and is open for comment. It is the sixteenth edition of the
report since the first was published in June 2017. Prior editions of this report are maintained on the FRVT
website, and may contain useful information about older algorithms and datasets no longer used in FRVT.
FRVT remains open: All four tracks of the FRVT remain open to new algorithm submissions indefinitely.
This report will be updated as new algorithms are evaluated, as new datasets are added, and as new analyses
are included. Comments and suggestions should be directed to frvt@nist.gov.
Changes since September 11, 2019:
. The report adds results for five new participants: Awidit Systems (Awiros), Momemtum Digital (Sertis),
Trueface AI, Shanghai Jiao Tong University, and X-Laboratory.
. The reports adds results for five new algorithms from returning developers: Cyberlink, Hengrui AI
Technology, Idemia, Panasonic R+D Singapore, and Tevian. This causes three algorithm, to be de-listed
from the report per policy to list results for two algorithms per developer.
Changes since July 31 2019:
. The HTML table on the FRVT 1:1 homepage has been updated to include a column for cross-domain
Visa-Border verification. Results for this new dataset appeared in the July 29 report under the name
”CrossEV” - these are now renamed ”Visa-Border”.
. The FRVT 1:1 homepage lists algorithms according to lowest mean rank accuracy:
Rank(FNMRVISA at FMR = 0.000001) +
Rank(FNMRVISA - BORDER at FMR = 0.000001) +
Rank(FNMRMUGSHOT at FMR = 0.00001 after 14 years) +
Rank(FNMRWILD at FMR = 0.00001)
This ordering rewards high accuracy across all datasets.
. The main results in Table 8 is now in landscape format to accomodate extra columns for the Visa-Border
set, and mugshot comparisons after at least 12 years.
. The report adds results for nine new participants: Alpha SSTG, Intel Research, ULSee, Chungwa Tele-
con, iSAP Solution, Rokid, Shenzhen EI Networks, CSA Intellicloud, Shenzhen Intellifusion Technolo-
gies.
. The reports adds results for six new algorithms from returning developers: Innovatrics, Dahua Technol-
ogy, Tech5 SA, Intellivision, Nodeflux and Imperial College, London. One algorithm, from Imperial has
been retired, per policy to list results for two algorithms per developer.
. The cross-country false match rate heatmaps starting from Figure 295 have been replotted to reveal more
structure by listing countries by region instead of alphabetically.
. The next version of this report will be posted around October 18, 2019.
Changes since July 3 2019:
. The HTML table on the FRVT 1:1 homepage has been updated to list the 20 most accurate developers
rather than algorithms, choosing the most accurate algorithm from each developer based on visa and
mugshot results. Also, the algorithms are ordered in terms of lowest mean rank across mugshot, visa
and wild datasets, rewarding broad accuracy over a good result on one particular dataset.
. This report includes results for a new dataset - see the column labelled ”crossEV” in Table 5. It compares
a new set of high quality visa portraits with a set webcam photos that exhibit moderately poor pose
variations and background illumination. The two new sets are described in sections 2.3 and 2.5. The

2019/10/16 12:43:37
comparisons are “cross-domain” in that the algorithm must compare “visa” and “wild” images. Results
for other algorithms will be added in future reports as they become available.
. This report adds results for algorithms from 9 developers submitted in early July 2019. These are from
3DiVi, Camvi, EverAI-Paravision, Facesoft, Farbar (F8), Institute of Information Technologies, Shanghai
U. Film Academy, Via Technologies, and Ulucu Electronics Tech. Six of these are new participants.
. Several other algorithms have been submitted and are being evaluated. Results will be released in the
next report, scheduled for September 5. That report will include results for new datasets.
. Older algorithms from Everai, Camvi and 3DiVi, have been retired, per the policy to list only two algo-
rithms per developer.
Changes since June 20 2019:
. This report adds results for algorithms from 18 developers submitted in early June 2019. These are
from CTBC Bank, Deep Glint, Thales Cogent, Ever AI Paravision, Gorilla Technology, Imagus, Incode,
Kneron, N-Tech Lab, Neurotechnology, Notiontag Technologies, Star Hybrid, Videonetics, Vigilant So-
lutions, Winsense, Anke Investments, CEIEC, and DSK. Nine of these are new participants.
. Several other algorithms have been submitted and are being evaluated. Results will be released in the
next report, scheduled for August 1.
. Older algorithms from Everai, Thales Cogent, Gorilla Technology, Incode, Neurotechnology, N-Tech Lab
and Vigilant Solutions have been retired, per the policy to list only two algorithms per developer.
Changes since April 2019:
. This report adds results for nine algorithms from nine developers submitted in early June 2019. These
are from Tencent Deepsea, Hengrui, Kedacom, Moontime, Guangzhou Pixel, Rank One Computing,
Synesis, Sensetime and Vocord.
. Another 23 algorithms have been submitted and are being evaluated. Results will be released in the next
report, scheduled for July 3.
. Older algorithms for Rank One, Synesis, and Vocord have been retired, per the policy to list only two
algorithms per developer.
Changes since February 2019:
. This report adds results for 49 algorithms from 42 developers submitted in early March 2019.
. This report omits results for algorithms that we retired. We retired for three reasons: 1. The developer
submitted a new algorithm, and we only list two. 2. The algorithm needs a GPU, and we no longer
allow GPU-based algorithms. 3. Inoperable algorithms.
. Previous results for retired algorithms are available in older editions of this report linked here.
. The mugshot database used from February 2017 to January 2019 has been replaced with an extract of the
mugshot database documented in NIST Interagency Report 8238, November 2018. The new mugshot
set is described in section 2.4 and is adopted because:
.. It has much better identity label integrity, so that false non-match rates are substantially lower than
those reported in FRVT 1:1 reports to date - see Figure 34.
.. It includes images collected over a 17 year period such that ageing can be much better characterized
- - see Figure 126.
. Using the new mugshot database, Figure 126 shows accuracy for four demographic groups identified
in the biographic metadata that accompanies the data: black females, black males, white females and
white males.

2019/10/16 12:43:37
. The report adds Figure 10 with results for the twenty human-difficult pairs used in the May 2018 paper
Face recognition accuracy of forensic examiners, superrecognizers, and face recognition algorithms by Phillips et
al. [1].
. The report uses an update to the wild image database that corrects some ground truth labels.
. Some results for the child exploitation database are not complete. They are typically updated less fre-
quently than for other image sets.

2019/10/16 12:43:37
Contents
A CKNOWLEDGMENTS 1
D ISCLAIMER 1
1 M ETRICS 27
1.1 C ORE ACCURACY . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 27
2 D ATASETS 28
2.1 C HILD EXPLOITATION IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
2.2 V ISA IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
2.3 V ISA IMAGES II . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 28
2.4 M UGSHOT IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
2.5 W EBCAM IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 29
2.6 W ILD IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
3 R ESULTS 30
3.1 T EST GOALS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
3.2 T EST DESIGN . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
3.3 FAILURE TO ENROLL . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 33
3.4 R ECOGNITION ACCURACY . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 37
3.5 G ENUINE DISTRIBUTION STABILITY . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 138
3.5.1 E FFECT OF BIRTH PLACE ON THE GENUINE DISTRIBUTION . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 138
3.5.2 E FFECT OF AGEING . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 152
3.5.3 E FFECT OF AGE ON GENUINE SUBJECTS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 163
3.6 I MPOSTOR DISTRIBUTION STABILITY . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 178
3.6.1 E FFECT OF BIRTH PLACE ON THE IMPOSTOR DISTRIBUTION . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 178
3.6.2 E FFECT OF AGE ON IMPOSTORS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 485
List of Tables
1 A LGORITHM SUMMARY . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 17
5 FALSE N ON -M ATCH R ATE . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 21
9 FAILURE TO E NROL R ATES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 34
List of Figures
1 PERFORMANCE SUMMARY: FNMR VS . TEMPLATE SIZE TRADEOFF . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 25
2 PERFORMANCE SUMMARY: FNMR VS . TEMPLATE TIME TRADEOFF . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 26
3 EXAMPLE IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
( A ) V ISA . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
(B) M UGSHOT . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30
(C) W ILD . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 30

2019/10/16 12:43:37
4 PERFORMANCE ON 20 HUMAN - DIFFICULT PAIRS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38

11 ERROR TRADEOFF CHARACTERISTIC : VISA IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 45
27 ERROR TRADEOFF CHARACTERISTIC : MUGSHOT IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 61
35 ERROR TRADEOFF CHARACTERISTIC : WILD IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 69
42 ERROR TRADEOFF CHARACTERISTICS : CHILD EXPLOITATION IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . 76
46 CMC CHARACTERISTICS : CHILD EXPLOITATION IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 80
50 FALSE MATCH RATES WITHIN AND ACROSS DEMOGRAPHIC GROUPS . . . . . . . . . . . . . . . . . . . . . . . . . . . . 84
58 SEX AND RACE EFFECTS : MUGSHOT IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 92

2019/10/16 12:43:37

66 SEX EFFECTS : VISA IMAGES . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 100
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 101
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 102
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 103
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 104
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 105
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 106
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 107
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 108
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 109
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 110
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 111
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 112
79 FALSE MATCH RATE CALIBRATION : MUGSHOT IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 113
87 FALSE MATCH RATE CALIBRATION : VISA IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 121
103 FALSE MATCH RATE CONCENTRATION : VISA IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 137
104 EFFECT OF COUNTRY OF BIRTH ON FNMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 139

2019/10/16 12:43:37

127 EFFECT OF SUBJECT AGE ON FNMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 164
140 W ORST CASE REGIONAL EFFECT FNMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 179
141 IMPOSTOR DISTRIBUTION SHIFTS FOR SELECT COUNTRY PAIRS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 181
142 ALGORITHM 3 DIVI -003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 182
143 ALGORITHM 3 DIVI -004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 183
144 ALGORITHM ADERA -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 184
145 ALGORITHM ALCHERA -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 185
146 ALGORITHM ALCHERA -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 186
147 ALGORITHM ALLGOVISION -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 187
148 ALGORITHM ALPHAFACE -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 188
149 ALGORITHM AMPLIFIEDGROUP -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 189
150 ALGORITHM ANKE -003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 190
151 ALGORITHM ANKE -004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 191
152 ALGORITHM ANYVISION -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 192
153 ALGORITHM ANYVISION -004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 193
154 ALGORITHM AWARE -003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 194
155 ALGORITHM AWARE -004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 195
156 ALGORITHM AWIROS -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 196
157 ALGORITHM AYONIX -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 197
158 ALGORITHM BM -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 198
159 ALGORITHM CAMVI -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 199
160 ALGORITHM CAMVI -004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 200
161 ALGORITHM CEIEC -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 201
162 ALGORITHM CEIEC -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 202
163 ALGORITHM CHTFACE -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 203
164 ALGORITHM COGENT-003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 204
165 ALGORITHM COGENT-004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 205
166 ALGORITHM COGNITEC -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 206
167 ALGORITHM COGNITEC -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 207
168 ALGORITHM CTBCBANK -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 208
169 ALGORITHM CYBEREXTRUDER -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 209
170 ALGORITHM CYBEREXTRUDER -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 210
171 ALGORITHM CYBERLINK -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 211
172 ALGORITHM CYBERLINK -003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 212

2019/10/16 12:43:37
173 ALGORITHM DAHUA -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 213

174 ALGORITHM DAHUA -003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 214
175 ALGORITHM DEEPGLINT-001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 215
176 ALGORITHM DEEPSEA -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 216
177 ALGORITHM DERMALOG -005 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 217
178 ALGORITHM DERMALOG -006 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 218
179 ALGORITHM DIGITALBARRIERS -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 219
180 ALGORITHM DSK -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 220
181 ALGORITHM EINETWORKS -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 221
182 ALGORITHM EVERAI -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 222
183 ALGORITHM F 8-001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 223
184 ALGORITHM FACESOFT-000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 224
185 ALGORITHM GLORY-000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 225
186 ALGORITHM GLORY-001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 226
187 ALGORITHM GORILLA -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 227
188 ALGORITHM GORILLA -003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 228
189 ALGORITHM HIK -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 229
190 ALGORITHM HR -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 230
191 ALGORITHM HR -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 231
192 ALGORITHM ID 3-003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 232
193 ALGORITHM ID 3-004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 233
194 ALGORITHM IDEMIA -004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 234
195 ALGORITHM IDEMIA -005 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 235
196 ALGORITHM IIT-000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 236
197 ALGORITHM IIT-001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 237
198 ALGORITHM IMAGUS -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 238
199 ALGORITHM IMPERIAL -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 239
200 ALGORITHM IMPERIAL -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 240
201 ALGORITHM INCODE -003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 241
202 ALGORITHM INCODE -004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 242
203 ALGORITHM INNOVATRICS -004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 243
204 ALGORITHM INNOVATRICS -006 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 244
205 ALGORITHM INTELLICLOUDAI -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 245
206 ALGORITHM INTELLIFUSION -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 246
207 ALGORITHM INTELLIVISION -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 247
208 ALGORITHM INTELLIVISION -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 248
209 ALGORITHM INTELRESEARCH -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 249
210 ALGORITHM INTSYSMSU -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 250
211 ALGORITHM IQFACE -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 251
212 ALGORITHM ISAP -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 252
213 ALGORITHM ISITYOU -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 253
214 ALGORITHM ISYSTEMS -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 254
215 ALGORITHM ISYSTEMS -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 255
216 ALGORITHM ITMO -005 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 256
217 ALGORITHM ITMO -006 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 257
218 ALGORITHM KAKAO -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 258
219 ALGORITHM KAKAO -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 259
220 ALGORITHM KEDACOM -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 260
221 ALGORITHM KNERON -003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 261
222 ALGORITHM LOOKMAN -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 262
223 ALGORITHM LOOKMAN -004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 263
224 ALGORITHM MEGVII -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 264
225 ALGORITHM MEGVII -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 265
226 ALGORITHM MEIYA -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 266
227 ALGORITHM MICROFOCUS -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 267
228 ALGORITHM MICROFOCUS -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 268
229 ALGORITHM MT-000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 269

2019/10/16 12:43:37
230 ALGORITHM NEUROTECHNOLOGY-005 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270

231 ALGORITHM NEUROTECHNOLOGY-006 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 271
232 ALGORITHM NODEFLUX -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 272
233 ALGORITHM NODEFLUX -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 273
234 ALGORITHM NOTIONTAG -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 274
235 ALGORITHM NTECHLAB -006 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 275
236 ALGORITHM NTECHLAB -007 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 276
237 ALGORITHM PIXELALL -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 277
238 ALGORITHM PSL -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 278
239 ALGORITHM PSL -003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 279
240 ALGORITHM RANKONE -006 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 280
241 ALGORITHM RANKONE -007 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 281
242 ALGORITHM REALNETWORKS -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 282
243 ALGORITHM REALNETWORKS -003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 283
244 ALGORITHM REMARKAI -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 284
245 ALGORITHM REMARKAI -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 285
246 ALGORITHM ROKID -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 286
247 ALGORITHM SAFFE -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 287
248 ALGORITHM SAFFE -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 288
249 ALGORITHM SENSETIME -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 289
250 ALGORITHM SENSETIME -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 290
251 ALGORITHM SERTIS -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 291
252 ALGORITHM SHAMAN -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 292
253 ALGORITHM SHAMAN -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 293
254 ALGORITHM SHU -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 294
255 ALGORITHM SIAT-002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 295
256 ALGORITHM SIAT-004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 296
257 ALGORITHM SJTU -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 297
258 ALGORITHM SMILART-002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 298
259 ALGORITHM SMILART-003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 299
260 ALGORITHM STARHYBRID -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 300
261 ALGORITHM SYNESIS -004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 301
262 ALGORITHM SYNESIS -005 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 302
263 ALGORITHM TECH 5-002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 303
264 ALGORITHM TECH 5-003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 304
265 ALGORITHM TEVIAN -004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 305
266 ALGORITHM TEVIAN -005 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 306
267 ALGORITHM TIGER -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 307
268 ALGORITHM TIGER -003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 308
269 ALGORITHM TONGYI -005 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 309
270 ALGORITHM TOSHIBA -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 310
271 ALGORITHM TOSHIBA -003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 311
272 ALGORITHM TRUEFACE -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 312
273 ALGORITHM ULSEE -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 313
274 ALGORITHM ULUFACE -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 314
275 ALGORITHM UPC -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 315
276 ALGORITHM VCOG -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 316
277 ALGORITHM VD -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 317
278 ALGORITHM VERIDAS -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 318
279 ALGORITHM VERIDAS -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 319
280 ALGORITHM VIA -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 320
281 ALGORITHM VIDEONETICS -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 321
282 ALGORITHM VIGILANTSOLUTIONS -006 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 322
283 ALGORITHM VIGILANTSOLUTIONS -007 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 323
284 ALGORITHM VION -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 324
285 ALGORITHM VISIONBOX -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 325
286 ALGORITHM VISIONBOX -001 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 326

2019/10/16 12:43:37
287 ALGORITHM VISIONLABS -006 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 327

288 ALGORITHM VISIONLABS -007 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 328
289 ALGORITHM VOCORD -006 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 329
290 ALGORITHM VOCORD -007 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 330
291 ALGORITHM WINSENSE -000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 331
292 ALGORITHM X - LABORATORY-000 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 332
293 ALGORITHM YISHENG -004 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 333
294 ALGORITHM YITU -003 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 334
295 ALGORITHM 3 DIVI -003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 335
296 ALGORITHM 3 DIVI -004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 336
297 ALGORITHM ADERA -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 337
298 ALGORITHM ALCHERA -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 338
299 ALGORITHM ALCHERA -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 339
300 ALGORITHM ALLGOVISION -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 340
301 ALGORITHM ALPHAFACE -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 341
302 ALGORITHM AMPLIFIEDGROUP -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 342
303 ALGORITHM ANKE -003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 343
304 ALGORITHM ANKE -004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 344
305 ALGORITHM ANYVISION -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 345
306 ALGORITHM ANYVISION -004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 346
307 ALGORITHM AWARE -003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 347
308 ALGORITHM AWARE -004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 348
309 ALGORITHM AWIROS -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 349
310 ALGORITHM AYONIX -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 350
311 ALGORITHM BM -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 351
312 ALGORITHM CAMVI -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 352
313 ALGORITHM CAMVI -004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 353
314 ALGORITHM CEIEC -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 354
315 ALGORITHM CEIEC -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 355
316 ALGORITHM CHTFACE -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 356
317 ALGORITHM COGENT-003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 357
318 ALGORITHM COGENT-004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 358
319 ALGORITHM COGNITEC -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 359
320 ALGORITHM COGNITEC -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 360
321 ALGORITHM CTBCBANK -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 361
322 ALGORITHM CYBEREXTRUDER -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 362
323 ALGORITHM CYBEREXTRUDER -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 363
324 ALGORITHM CYBERLINK -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 364
325 ALGORITHM DAHUA -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 365
326 ALGORITHM DAHUA -003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 366
327 ALGORITHM DEEPGLINT-001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 367
328 ALGORITHM DEEPSEA -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 368
329 ALGORITHM DERMALOG -005 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 369
330 ALGORITHM DERMALOG -006 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 370
331 ALGORITHM DIGITALBARRIERS -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 371
332 ALGORITHM DSK -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 372
333 ALGORITHM EINETWORKS -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 373
334 ALGORITHM EVERAI -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 374
335 ALGORITHM F 8-001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 375
336 ALGORITHM FACESOFT-000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 376
337 ALGORITHM GLORY-000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 377
338 ALGORITHM GLORY-001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 378
339 ALGORITHM GORILLA -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 379
340 ALGORITHM GORILLA -003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 380
341 ALGORITHM HIK -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 381
342 ALGORITHM HR -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 382
343 ALGORITHM HR -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 383

2019/10/16 12:43:37
344 ALGORITHM ID 3-003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 384

345 ALGORITHM ID 3-004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 385
346 ALGORITHM IDEMIA -004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 386
347 ALGORITHM IDEMIA -005 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 387
348 ALGORITHM IIT-000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 388
349 ALGORITHM IIT-001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 389
350 ALGORITHM IMAGUS -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 390
351 ALGORITHM IMPERIAL -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 391
352 ALGORITHM IMPERIAL -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 392
353 ALGORITHM INCODE -003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 393
354 ALGORITHM INCODE -004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 394
355 ALGORITHM INNOVATRICS -004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 395
356 ALGORITHM INNOVATRICS -006 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 396
357 ALGORITHM INTELLICLOUDAI -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 397
358 ALGORITHM INTELLIFUSION -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 398
359 ALGORITHM INTELLIVISION -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 399
360 ALGORITHM INTELLIVISION -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 400
361 ALGORITHM INTELRESEARCH -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 401
362 ALGORITHM INTSYSMSU -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 402
363 ALGORITHM IQFACE -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 403
364 ALGORITHM ISAP -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 404
365 ALGORITHM ISITYOU -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 405
366 ALGORITHM ISYSTEMS -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 406
367 ALGORITHM ISYSTEMS -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 407
368 ALGORITHM ITMO -005 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 408
369 ALGORITHM ITMO -006 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 409
370 ALGORITHM KAKAO -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 410
371 ALGORITHM KAKAO -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 411
372 ALGORITHM KEDACOM -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 412
373 ALGORITHM KNERON -003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 413
374 ALGORITHM LOOKMAN -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 414
375 ALGORITHM LOOKMAN -004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 415
376 ALGORITHM MEGVII -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 416
377 ALGORITHM MEGVII -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 417
378 ALGORITHM MEIYA -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 418
379 ALGORITHM MICROFOCUS -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 419
380 ALGORITHM MICROFOCUS -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 420
381 ALGORITHM MT-000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 421
382 ALGORITHM NEUROTECHNOLOGY-005 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 422
383 ALGORITHM NEUROTECHNOLOGY-006 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 423
384 ALGORITHM NODEFLUX -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 424
385 ALGORITHM NODEFLUX -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 425
386 ALGORITHM NOTIONTAG -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 426
387 ALGORITHM NTECHLAB -006 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 427
388 ALGORITHM NTECHLAB -007 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 428
389 ALGORITHM PIXELALL -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 429
390 ALGORITHM PSL -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 430
391 ALGORITHM RANKONE -006 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 431
392 ALGORITHM RANKONE -007 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 432
393 ALGORITHM REALNETWORKS -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 433
394 ALGORITHM REALNETWORKS -003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 434
395 ALGORITHM REMARKAI -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 435
396 ALGORITHM REMARKAI -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 436
397 ALGORITHM ROKID -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 437
398 ALGORITHM SAFFE -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 438
399 ALGORITHM SAFFE -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 439

2019/10/16 12:43:37
400 ALGORITHM SENSETIME -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 440

401 ALGORITHM SENSETIME -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 441
402 ALGORITHM SHAMAN -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 442
403 ALGORITHM SHAMAN -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 443
404 ALGORITHM SHU -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 444
405 ALGORITHM SIAT-002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 445
406 ALGORITHM SIAT-004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 446
407 ALGORITHM SJTU -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 447
408 ALGORITHM SMILART-002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 448
409 ALGORITHM SMILART-003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 449
410 ALGORITHM STARHYBRID -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 450
411 ALGORITHM SYNESIS -004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 451
412 ALGORITHM SYNESIS -005 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 452
413 ALGORITHM TECH 5-002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 453
414 ALGORITHM TECH 5-003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 454
415 ALGORITHM TEVIAN -004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 455
416 ALGORITHM TIGER -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 456
417 ALGORITHM TIGER -003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 457
418 ALGORITHM TONGYI -005 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 458
419 ALGORITHM TOSHIBA -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 459
420 ALGORITHM TOSHIBA -003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 460
421 ALGORITHM TRUEFACE -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 461
422 ALGORITHM ULSEE -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 462
423 ALGORITHM ULUFACE -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 463
424 ALGORITHM UPC -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 464
425 ALGORITHM VCOG -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 465
426 ALGORITHM VD -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 466
427 ALGORITHM VERIDAS -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 467
428 ALGORITHM VERIDAS -002 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 468
429 ALGORITHM VIA -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 469
430 ALGORITHM VIDEONETICS -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 470
431 ALGORITHM VIGILANTSOLUTIONS -006 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 471
432 ALGORITHM VIGILANTSOLUTIONS -007 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 472
433 ALGORITHM VION -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 473
434 ALGORITHM VISIONBOX -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 474
435 ALGORITHM VISIONBOX -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 475
436 ALGORITHM VISIONLABS -006 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 476
437 ALGORITHM VISIONLABS -007 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 477
438 ALGORITHM VOCORD -006 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 478
439 ALGORITHM VOCORD -007 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 479
440 ALGORITHM WINSENSE -000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 480
441 ALGORITHM X - LABORATORY-000 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 481
442 ALGORITHM YISHENG -004 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 482
443 ALGORITHM YITU -003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 483
444 IMPOSTOR COUNTS FOR CROSS COUNTRY FMR CALCULATIONS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 484
445 ALGORITHM 3 DIVI -003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 486
446 ALGORITHM 3 DIVI -004 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 487
447 ALGORITHM ADERA -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 488
448 ALGORITHM ALCHERA -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 489
449 ALGORITHM ALCHERA -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 490
450 ALGORITHM ALLGOVISION -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 491
451 ALGORITHM ALPHAFACE -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 492
452 ALGORITHM AMPLIFIEDGROUP -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 493
453 ALGORITHM ANKE -003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 494
454 ALGORITHM ANKE -004 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 495
455 ALGORITHM ANYVISION -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 496

2019/10/16 12:43:37
456 ALGORITHM ANYVISION -004 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 497

457 ALGORITHM AWARE -003 CROSS AGE FMR .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 498
458 ALGORITHM AWARE -004 CROSS AGE FMR .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 499
459 ALGORITHM AWIROS -001 CROSS AGE FMR .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 500
460 ALGORITHM AYONIX -000 CROSS AGE FMR .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 501
461 ALGORITHM BM -001 CROSS AGE FMR . . . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 502
462 ALGORITHM CAMVI -002 CROSS AGE FMR . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 503
463 ALGORITHM CAMVI -004 CROSS AGE FMR . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 504
464 ALGORITHM CEIEC -001 CROSS AGE FMR . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 505
465 ALGORITHM CEIEC -002 CROSS AGE FMR . .
. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 506
466 ALGORITHM CHTFACE -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 507
467 ALGORITHM COGENT-003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 508
468 ALGORITHM COGENT-004 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 509
469 ALGORITHM COGNITEC -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 510
470 ALGORITHM COGNITEC -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 511
471 ALGORITHM CTBCBANK -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 512
472 ALGORITHM CYBEREXTRUDER -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 513
473 ALGORITHM CYBEREXTRUDER -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 514
474 ALGORITHM CYBERLINK -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 515
475 ALGORITHM CYBERLINK -003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 516
476 ALGORITHM DAHUA -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 517
477 ALGORITHM DAHUA -003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 518
478 ALGORITHM DEEPGLINT-001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 519
479 ALGORITHM DEEPSEA -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 520
480 ALGORITHM DERMALOG -005 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 521
481 ALGORITHM DERMALOG -006 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 522
482 ALGORITHM DIGITALBARRIERS -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 523
483 ALGORITHM DSK -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 524
484 ALGORITHM EINETWORKS -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 525
485 ALGORITHM EVERAI -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 526
486 ALGORITHM F 8-001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 527
487 ALGORITHM FACESOFT-000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 528
488 ALGORITHM GLORY-000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 529
489 ALGORITHM GLORY-001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 530
490 ALGORITHM GORILLA -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 531
491 ALGORITHM GORILLA -003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 532
492 ALGORITHM HIK -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 533
493 ALGORITHM HR -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 534
494 ALGORITHM HR -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 535
495 ALGORITHM ID 3-003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 536
496 ALGORITHM ID 3-004 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 537
497 ALGORITHM IDEMIA -004 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 538
498 ALGORITHM IDEMIA -005 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 539
499 ALGORITHM IIT-000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 540
500 ALGORITHM IIT-001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 541
501 ALGORITHM IMAGUS -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 542
502 ALGORITHM IMPERIAL -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 543
503 ALGORITHM IMPERIAL -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 544
504 ALGORITHM INCODE -003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 545
505 ALGORITHM INCODE -004 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 546
506 ALGORITHM INNOVATRICS -004 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 547
507 ALGORITHM INNOVATRICS -006 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 548
508 ALGORITHM INTELLICLOUDAI -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 549
509 ALGORITHM INTELLIFUSION -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 550
510 ALGORITHM INTELLIVISION -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 551
511 ALGORITHM INTELLIVISION -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 552
512 ALGORITHM INTELRESEARCH -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 553

2019/10/16 12:43:37
513 ALGORITHM INTSYSMSU -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 554

514 ALGORITHM IQFACE -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 555
515 ALGORITHM ISAP -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 556
516 ALGORITHM ISITYOU -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 557
517 ALGORITHM ISYSTEMS -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 558
518 ALGORITHM ISYSTEMS -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 559
519 ALGORITHM ITMO -005 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 560
520 ALGORITHM ITMO -006 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 561
521 ALGORITHM KAKAO -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 562
522 ALGORITHM KAKAO -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 563
523 ALGORITHM KEDACOM -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 564
524 ALGORITHM KNERON -003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 565
525 ALGORITHM LOOKMAN -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 566
526 ALGORITHM LOOKMAN -004 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 567
527 ALGORITHM MEGVII -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 568
528 ALGORITHM MEGVII -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 569
529 ALGORITHM MEIYA -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 570
530 ALGORITHM MICROFOCUS -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 571
531 ALGORITHM MICROFOCUS -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 572
532 ALGORITHM MT-000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 573
533 ALGORITHM NEUROTECHNOLOGY-005 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 574
534 ALGORITHM NEUROTECHNOLOGY-006 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 575
535 ALGORITHM NODEFLUX -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 576
536 ALGORITHM NODEFLUX -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 577
537 ALGORITHM NOTIONTAG -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 578
538 ALGORITHM NTECHLAB -006 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 579
539 ALGORITHM NTECHLAB -007 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 580
540 ALGORITHM PIXELALL -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 581
541 ALGORITHM PSL -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 582
542 ALGORITHM PSL -003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 583
543 ALGORITHM RANKONE -006 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 584
544 ALGORITHM RANKONE -007 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 585
545 ALGORITHM REALNETWORKS -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 586
546 ALGORITHM REALNETWORKS -003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 587
547 ALGORITHM REMARKAI -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 588
548 ALGORITHM REMARKAI -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 589
549 ALGORITHM ROKID -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 590
550 ALGORITHM SAFFE -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 591
551 ALGORITHM SAFFE -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 592
552 ALGORITHM SENSETIME -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 593
553 ALGORITHM SENSETIME -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 594
554 ALGORITHM SERTIS -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 595
555 ALGORITHM SHAMAN -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 596
556 ALGORITHM SHAMAN -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 597
557 ALGORITHM SHU -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 598
558 ALGORITHM SIAT-002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 599
559 ALGORITHM SIAT-004 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 600
560 ALGORITHM SJTU -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 601
561 ALGORITHM SMILART-002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 602
562 ALGORITHM SMILART-003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 603
563 ALGORITHM STARHYBRID -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 604
564 ALGORITHM SYNESIS -004 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 605
565 ALGORITHM SYNESIS -005 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 606
566 ALGORITHM TECH 5-002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 607
567 ALGORITHM TECH 5-003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 608
568 ALGORITHM TEVIAN -004 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 609
569 ALGORITHM TEVIAN -005 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 610

2019/10/16 12:43:37
570 ALGORITHM TIGER -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 611

571 ALGORITHM TIGER -003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 612
572 ALGORITHM TONGYI -005 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 613
573 ALGORITHM TOSHIBA -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 614
574 ALGORITHM TOSHIBA -003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 615
575 ALGORITHM TRUEFACE -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 616
576 ALGORITHM ULSEE -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 617
577 ALGORITHM ULUFACE -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 618
578 ALGORITHM UPC -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 619
579 ALGORITHM VCOG -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 620
580 ALGORITHM VD -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 621
581 ALGORITHM VERIDAS -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 622
582 ALGORITHM VERIDAS -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 623
583 ALGORITHM VIA -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 624
584 ALGORITHM VIDEONETICS -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 625
585 ALGORITHM VIGILANTSOLUTIONS -006 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 626
586 ALGORITHM VIGILANTSOLUTIONS -007 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 627
587 ALGORITHM VION -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 628
588 ALGORITHM VISIONBOX -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 629
589 ALGORITHM VISIONBOX -001 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 630
590 ALGORITHM VISIONLABS -006 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 631
591 ALGORITHM VISIONLABS -007 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 632
592 ALGORITHM VOCORD -006 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 633
593 ALGORITHM VOCORD -007 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 634
594 ALGORITHM WINSENSE -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 635
595 ALGORITHM X - LABORATORY-000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 636
596 ALGORITHM YISHENG -004 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 637
597 ALGORITHM YITU -003 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 638

2019/10/16 12:43:37
Config1 Comparison Time (ns)3
2019/10/16 12:43:37
Developer Short Seq. Validation Template GPU
2
Name Name Num. Date Data (KB) Size (B) Time (ms) Genuine Impostor
146 97 20 24
1 3DiVi 3divi 003 2018-10-09 191636 4096 ± 0 650 ± 90 No 627 ± 11 623 ± 32
80 154 33 35
2 3DiVi 3divi 004 2019-07-22 263670 2048 ± 0 984 ± 131 No 794 ± 35 801 ± 40
135 4 68 69
3 Adera Global PTE Ltd adera 001 2019-06-17 0 2560 ± 0 97 ± 0 No 1604 ± 71 1649 ± 56
72 85 98 96
4 Alchera alchera 000 2019-03-01 258450 2048 ± 0 587 ± 13 No 3189 ± 32 3031 ± 142
70 91 100 99
5 Alchera alchera 000 2019-03-01 174013 2048 ± 0 627 ± 11 No 3342 ± 81 3243 ± 47
92 54 145 146
6 AllGoVision allgovision 000 2019-03-01 172509 2048 ± 0 384 ± 8 No 29903 ± 406 29735 ± 194
76 88 102 101
7 AlphaSSTG alphaface 001 2019-09-03 259849 2048 ± 0 613 ± 3 No 3482 ± 41 3279 ± 91
29 3 149 149
8 Amplified Group amplifiedgroup 001 2019-03-01 0 866 ± 2 93 ± 0 No 57803 ± 4210 56365 ± 1196
121 131 6 8
9 Anke Investments anke 003 2019-02-27 340160 2056 ± 0 811 ± 23 No 425 ± 28 437 ± 32
119 90 21 26
10 Anke Investments anke 004 2019-06-27 349388 2056 ± 0 625 ± 1 No 633 ± 22 632 ± 34
38 24 150 150
11 AnyVision anyvision 002 2018-01-31 662659 1024 ± 0 248 ± 0 No 74069 ± 188 74019 ± 198
34 47 76 73
12 AnyVision anyvision 004 2018-06-15 401001 1024 ± 0 355 ± 1 No 1891 ± 51 1829 ± 85
138 128 60 62
13 Aware aware 003 2018-10-19 377729 3108 ± 0 783 ± 10 No 1392 ± 42 1334 ± 80
131 147 56 61
14 Aware aware 004 2019-03-01 427829 2084 ± 0 900 ± 10 No 1279 ± 50 1287 ± 100
FRVT
16 5 74 89
15 Awidit Systems awiros 001 2019-09-23 15499 512 ± 0 99 ± 8 No 1868 ± 100 2467 ± 78
39 1 19 23
16 Ayonix ayonix 000 2017-06-22 58505 1036 ± 0 18 ± 2 No 621 ± 23 620 ± 26
-
1 61 75 75
FACE RECOGNITION VENDOR TEST

17 Bitmain bitmain 001 2018-10-17 287734 64 ± 0 444 ± 88 No 1887 ± 31 1877 ± 26
36 110 18 19
18 Camvi Technologies camvitech 002 2018-10-19 236278 1024 ± 0 677 ± 7 No 612 ± 26 603 ± 20
86 124 39 41
19 Camvi Technologies camvitech 004 2019-07-12 280733 2048 ± 0 759 ± 10 No 948 ± 40 963 ± 31
37 40 142 142
20 China Electronics Import-Export Corp ceiec 001 2019-03-01 159618 1024 ± 0 314 ± 3 No 22831 ± 108 22813 ± 120
69 87 84 83
21 China Electronics Import-Export Corp ceiec 002 2019-06-12 269063 2048 ± 0 612 ± 17 No 2188 ± 57 2301 ± 56
88 20 81 80
22 Chunghwa Telecom Co. Ltd chtface 001 2019-08-06 94088 2048 ± 0 218 ± 12 No 2089 ± 45 2087 ± 23
30 152 131 130
23 Gemalto Cogent cogent 003 2019-03-01 698290 973 ± 0 952 ± 0 No 12496 ± 75 11822 ± 163
57 151 134 136
24 Gemalto Cogent cogent 004 2019-06-14 722919 1983 ± 0 941 ± 28 No 14448 ± 56 15882 ± 81
109 21 108 106
25 Cognitec Systems GmbH cognitec 000 2018-10-19 474759 2052 ± 0 224 ± 1 No 3835 ± 108 3782 ± 83
115 36 112 111
26 Cognitec Systems GmbH cognitec 001 2019-03-01 476809 2052 ± 0 297 ± 17 No 4253 ± 59 4102 ± 167
73 82 104 114
27 CTBC Bank Co. Ltd ctbcbank 000 2019-06-28 257208 2048 ± 0 568 ± 43 No 3551 ± 87 4805 ± 209
9 146 46 49
28 Cyberextruder cyberex 001 2017-08-02 121211 256 ± 0 893 ± 25 No 1083 ± 16 1079 ± 19
60 71 73 72
29 Cyberextruder cyberex 002 2018-01-30 168909 2048 ± 0 532 ± 6 No 1803 ± 14 1779 ± 22
111 102 86 93
30 Cyberlink Corp cyberlink 002 2019-06-12 222311 2052 ± 0 656 ± 22 No 2264 ± 71 2649 ± 195
108 59 115 116
31 Cyberlink Corp cyberlink 002 2019-10-07 470949 2052 ± 0 424 ± 1 No 4857 ± 53 5168 ± 69
-
71 92 8 10
32 Dahua Technology Co. Ltd dahua 002 2019-03-01 526452 2048 ± 0 628 ± 7 No 461 ± 23 454 ± 20
VERIFICATION
87 73 24 20
33 Dahua Technology Co. Ltd dahua 003 2019-08-14 605337 2048 ± 0 537 ± 4 No 653 ± 28 606 ± 38
143 115 105 103
34 Deepglint deepglint 001 2019-06-21 569802 4096 ± 0 721 ± 4 No 3680 ± 35 3517 ± 182
31 93 62 65
35 Tencent Deepsea Lab deepsea 001 2019-06-03 147497 1024 ± 0 630 ± 7 No 1401 ± 37 1467 ± 50
2 7 11 13
36 Dermalog dermalog 005 2018-02-02 0 128 ± 0 130 ± 11 No 499 ± 22 500 ± 22
3 70 12 11
37 Dermalog dermalog 006 2018-10-18 0 128 ± 0 532 ± 12 No 506 ± 23 459 ± 23
122 17 133 133
38 Digital Barriers barriers 002 2019-03-01 83002 2056 ± 0 209 ± 11 No 13409 ± 228 13267 ± 206
18 38 125 124
39 DSK dsk 000 2019-06-28 11967 512 ± 0 304 ± 47 No 7152 ± 115 7134 ± 111
126 96 116 115
40 Shenzhen EI Networks Limited einetworks 000 2019-08-13 372608 2056 ± 0 645 ± 3 No 4876 ± 66 5156 ± 77
148 122 23 25
FNMR(T)
41 Ever AI everai 002 2019-03-01 561727 4096 ± 0 758 ± 0 No 644 ± 14 624 ± 35

FMR(T)
142 108 29 30
42 Ever AI Paravision everai paravision 003 2019-07-01 539802 4096 ± 0 674 ± 4 No 699 ± 20 713 ± 47
68 135 135 135
43 FarBar Inc. f8 001 2019-07-11 272977 2048 ± 0 822 ± 39 No 15262 ± 139 15277 ± 212
103 109 85 82
44 FaceSoft Ltd. facesoft 000 2019-07-10 370120 2048 ± 0 675 ± 18 No 2239 ± 28 2277 ± 96
Notes
“False match rate”
“False non-match rate”
1 The configuration size does not capture static data included in libraries. We do not count these because some algorithms include common ancilliary libraries for image
processing (e.g. openCV) or numerical computation (e.g. blas).
2 The median template creation times are measured on Intel Xeon
R CPU
R E5-2630 v4 @ 2.20GHz processors or, for GPU-enabled implementations, NVidia Tesla K40.
3 The comparison durations, in nanoseconds, are estimated using std::chrono::high resolution clock which on the machine in (2) counts 1ns clock ticks. Precision is some-
what worse than that however. The ± value is the median absolute deviation times 1.48 for Normal consistency.
Table 1: Summary of algorithms and properties included in this report. The red superscripts give ranking for the quantity in that column.
17
2019/10/16 12:43:37
Developer Short Seq. Validation Config1 Template GPU Comparison Time (ns)3
Name Name Num. Date Data (KB) Size (B) Time (ms)2 Genuine Impostor
14 9 124 122
45 Glory Ltd glory 000 2018-06-06 0 418 ± 0 165 ± 2 No 7003 ± 84 6978 ± 71
54 56 129 128
46 Glory Ltd glory 001 2018-06-08 0 1726 ± 0 393 ± 2 No 9607 ± 128 9539 ± 182
43 43 93 92
47 Gorilla Technology gorilla 002 2018-10-17 93869 1132 ± 0 322 ± 14 No 2715 ± 68 2585 ± 84
42 45 94 94
48 Gorilla Technology gorilla 003 2019-06-19 94409 1132 ± 0 334 ± 25 No 2840 ± 42 2865 ± 87
47 98 10 12
49 Hikvision hik 001 2019-03-01 667866 1408 ± 0 651 ± 0 No 488 ± 19 477 ± 22
128 103 137 137
50 Hengrui AI Technology Ltd hr 001 2019-06-04 346156 2057 ± 0 665 ± 3 No 17816 ± 260 17878 ± 464
129 149 143 143
51 Hengrui AI Technology Ltd hr 001 2019-10-08 390059 2057 ± 0 904 ± 4 No 24112 ± 766 23859 ± 739
11 41 59 63
52 ID3 Technology id3 003 2018-10-05 265951 264 ± 0 316 ± 19 No 1330 ± 25 1354 ± 28
10 77 47 54
53 ID3 Technology id3 004 2019-03-01 171526 264 ± 0 541 ± 11 No 1135 ± 23 1156 ± 32
13 39 119 119
54 Idemia Idemia 004 2019-03-01 406924 352 ± 0 306 ± 5 No 5592 ± 518 5533 ± 426
27 69 126 129
55 Idemia Idemia 005 2019-10-11 509824 588 ± 0 524 ± 20 No 7543 ± 370 10415 ± 174
35 16 65 60
56 Institute of Information Technologies iitvision 000 2019-03-01 237317 1024 ± 0 197 ± 8 No 1537 ± 81 1282 ± 20
82 112 44 47
57 Institute of Information Technologies iitvision 001 2019-07-05 269176 2048 ± 0 699 ± 4 No 1060 ± 48 1074 ± 54
FRVT
96 60 48 71
58 Imagus Technology Pty Ltd imagus 000 2019-06-19 183453 2048 ± 0 425 ± 24 No 1145 ± 25 1718 ± 63
79 105 82 79
59 Imperial College London imperial 000 2019-03-01 370120 2048 ± 0 669 ± 1 No 2130 ± 32 2052 ± 100
-
62 83 114 112
60 Imperial College London imperial 002 2019-08-28 472327 2048 ± 0 570 ± 2 No 4827 ± 69 4557 ± 160

145 53 78 74
61 Incode Technologies Inc incode 003 2019-03-01 170632 4096 ± 0 384 ± 11 No 1928 ± 44 1876 ± 81
67 63 77 87
62 Incode Technologies Inc incode 004 2019-06-12 260224 2048 ± 0 479 ± 23 No 1913 ± 60 2443 ± 114
41 55 128 126
63 Innovatrics innovatrics 004 2018-10-19 0 1076 ± 0 391 ± 0 No 8573 ± 274 7929 ± 244
23 136 121 120
64 Innovatrics innovatrics 006 2019-08-13 0 538 ± 0 824 ± 10 No 5763 ± 217 5631 ± 824
101 64 42 44
65 CSA IntelliCloud Technology intellicloudai 001 2019-08-13 220831 2048 ± 0 479 ± 18 No 1010 ± 16 1024 ± 31
66 125 107 110
66 Shenzhen Intellifusion Technologies Co. Ltd intellifusion 001 2019-08-22 271872 2048 ± 0 778 ± 61 No 3756 ± 59 3953 ± 126
124 2 89 91
67 Intellivision intellivision 001 2017-10-10 43692 2056 ± 0 62 ± 2 No 2573 ± 91 2544 ± 38
120 46 136 134
68 Intellivision intellivision 002 2019-08-23 43692 2056 ± 0 342 ± 30 No 16049 ± 195 15136 ± 389
63 148 113 113
69 Intel Research Group intelresearch 000 2019-07-08 388229 2048 ± 0 902 ± 6 No 4800 ± 152 4561 ± 97
65 72 16 22
70 Lomonosov Moscow State University intsysmsu 000 2019-06-18 650193 2048 ± 0 535 ± 20 No 610 ± 22 613 ± 31
152 74 153 153
71 iQIYI Inc iqface 000 2019-06-04 268819 4750 ± 32 538 ± 26 No 636433 ± 38446 632654 ± 85615
147 10 130 131
72 iSAP Solution Corporation isap 001 2019-08-07 99049 4096 ± 0 171 ± 12 No 12413 ± 154 12251 ± 382
153 6 151 151
73 Is It You isityou 000 2017-06-26 48010 19200 ± 0 113 ± 5 No 237517 ± 1318 237374 ± 1279
58 34 14 16
74 Innovation Systems isystems 001 2018-06-12 274621 2048 ± 0 291 ± 9 No 557 ± 16 564 ± 22
85 134 31 27
75 Innovation Systems isystems 002 2018-10-18 358984 2048 ± 0 822 ± 8 No 749 ± 31 632 ± 28
-
VERIFICATION
151 123 132 132
76 ITMO University itmo 005 2018-10-19 482155 4173 ± 0 759 ± 1 No 13214 ± 164 12576 ± 257
134 132 144 144
77 ITMO University itmo 006 2019-03-01 599187 2121 ± 0 814 ± 1 No 26154 ± 148 26217 ± 260
33 52 37 40
78 Kakao Corp kakao 001 2019-03-01 107616 1024 ± 0 379 ± 1 No 930 ± 22 948 ± 38
104 119 71 70
79 Kakao Corp kakao 002 2019-06-19 479406 2048 ± 0 747 ± 6 No 1720 ± 62 1715 ± 83
12 67 25 28
80 Kedacom International Pte kedacom 000 2019-06-03 245292 292 ± 0 506 ± 3 No 684 ± 14 682 ± 16
77 32 118 118
81 Kneron Inc kenron 003 2019-07-01 58366 2048 ± 0 281 ± 3 No 5237 ± 63 5274 ± 99
25 11 17 21
82 Lookman Electroplast Industries lookman 002 2018-06-13 138200 548 ± 0 173 ± 1 No 610 ± 19 612 ± 22
24 68 35 39
83 Lookman Electroplast Industries lookman 004 2019-06-03 244775 548 ± 0 507 ± 5 No 871 ± 29 878 ± 29
100 78 117 117
84 Megvii/Face++ megvii 001 2018-06-15 1361523 2048 ± 0 543 ± 0 No 5228 ± 32 5252 ± 60
FNMR(T)
150 95 148 148

4100 ± 0 644 ± 0 50630 ± 183 47591 ± 716
FMR(T)
85 Megvii/Face++ megvii 002 2018-10-19 1809564 No

106 89 127 127
86 Xiamen Meiya Pico Information Co. Ltd meiya 001 2019-03-01 280055 2049 ± 0 622 ± 12 No 8356 ± 615 8134 ± 97
8 28 1 1
87 MicroFocus microfocus 001 2018-06-13 104524 256 ± 0 264 ± 18 No 215 ± 8 217 ± 10
6 26 3 2
88 MicroFocus microfocus 002 2018-10-17 96288 256 ± 0 259 ± 18 No 337 ± 34 230 ± 25
Notes
R CPU
18
2019/10/16 12:43:37
Developer Short Seq. Validation Config1 Template GPU Comparison Time (ns)3
Name Name Num. Date Data (KB) Size (B) Time (ms)2 Genuine Impostor
105 116 70 68
89 Moontime Smart Technology mt 000 2019-06-03 372169 2049 ± 0 724 ± 12 No 1678 ± 47 1614 ± 85
7 58 2 3
90 Neurotechnology neurotech 005 2019-03-01 270450 256 ± 0 399 ± 0 No 238 ± 10 237 ± 7
19 111 13 15
91 Neurotechnology neurotech 006 2019-06-26 525541 512 ± 0 678 ± 56 No 513 ± 14 535 ± 26
84 23 99 100
92 Nodeflux nodeflux 001 2019-03-01 262553 2048 ± 0 247 ± 1 No 3242 ± 81 3255 ± 93
102 114 122 125
93 Nodeflux nodeflux 002 2019-08-13 774668 2048 ± 0 717 ± 16 No 5922 ± 170 7911 ± 367
26 80 147 147
94 NotionTag Technologies Private Limited notiontag 000 2019-06-12 92753 584 ± 0 548 ± 64 No 44672 ± 269 44593 ± 358
137 120 43 38
95 N-Tech Lab ntech 006 2019-03-01 7901590 2600 ± 0 749 ± 1 No 1055 ± 93 844 ± 48
139 129 51 58
96 N-Tech Lab ntech 007 2019-06-25 2509686 3348 ± 0 792 ± 3 No 1209 ± 59 1267 ± 65
136 15 52 56
97 Guangzhou Pixel Solutions Co. Ltd pixelall 002 2019-06-06 0 2560 ± 0 191 ± 1 No 1223 ± 56 1230 ± 47
112 145 67 50
98 Panasonic R+D Center Singapore psl 002 2019-02-28 804934 2052 ± 0 888 ± 9 No 1590 ± 48 1133 ± 78
133 142 110 109
99 Panasonic R+D Center Singapore psl 003 2019-10-01 1159643 2120 ± 0 867 ± 7 No 3915 ± 50 3899 ± 226
5 18 7 6
100 Rank One Computing rankone 006 2019-02-27 0 165 ± 0 210 ± 1 No 443 ± 26 395 ± 22
4 22 26 18
101 Rank One Computing rankone 007 2019-06-03 0 165 ± 0 245 ± 5 No 688 ± 20 601 ± 16
FRVT
56 25 57 57
102 Realnetworks Inc realnetworks 002 2019-02-28 95328 1848 ± 0 250 ± 2 No 1285 ± 17 1247 ± 42
55 13 64 66
103 Realnetworks Inc realnetworks 003 2019-06-12 95334 1848 ± 0 177 ± 10 No 1516 ± 29 1522 ± 60
-
59 137 36 37
104 KanKan Ai remarkai 000 2019-03-01 240152 2048 ± 0 829 ± 7 No 873 ± 4 835 ± 35

114 138 53 36
105 KanKan Ai remarkai 001 2019-03-01 241857 2052 ± 0 831 ± 6 No 1229 ± 20 805 ± 56
125 79 106 105
106 Rokid Corporation Ltd rokid 000 2019-08-01 258612 2056 ± 0 547 ± 2 No 3711 ± 88 3746 ± 209
45 31 55 59
107 Saffe Ltd saffe 001 2018-10-19 85973 1280 ± 0 281 ± 1 No 1274 ± 19 1277 ± 26
94 133 30 31
108 Saffe Ltd saffe 002 2019-03-01 260622 2048 ± 0 817 ± 11 No 717 ± 7 714 ± 29
107 117 88 85
109 Sensetime Group Ltd sensetime 002 2018-10-19 531783 2052 ± 0 725 ± 3 No 2546 ± 102 2371 ± 45
116 130 92 84
110 Sensetime Group Ltd sensetime 002 2018-10-19 531783 2052 ± 0 797 ± 3 No 2713 ± 90 2301 ± 25
64 121 109 108
111 Momentum Digital Co. Ltd sertis 000 2019-10-07 265572 2048 ± 0 755 ± 0 No 3883 ± 44 3884 ± 66
144 100 4 5
112 Shaman Software shaman 000 2017-12-05 0 4096 ± 0 653 ± 16 No 380 ± 25 379 ± 31
141 35 22 9
113 Shaman Software shaman 001 2018-01-13 0 4096 ± 0 294 ± 2 No 635 ± 19 441 ± 25
99 86 91 95
114 Shanghai Universiy - Shanghai Film Academy shu 001 2019-06-17 329513 2048 ± 0 612 ± 5 No 2619 ± 19 2987 ± 143
117 84 32 33
115 Shenzhen Inst. Adv. Integrated Tech. CAS SIAT 002 2018-06-13 486842 2052 ± 0 579 ± 0 No 769 ± 13 750 ± 13
149 106 111 107
116 Shenzhen Inst. Adv. Integrated Tech. CAS SIAT 004 2019-03-01 940063 4100 ± 0 670 ± 0 No 4013 ± 45 3782 ± 173
61 99 154 154
117 Shanghai Jiao Tong University sjtu 001 2019-09-27 347115 2048 ± 0 651 ± 4 No 2674654 ± 64798 2376946 ± 202419
32 12 139 140
118 Smilart smilart 002 2018-02-06 111826 1024 ± 0 176 ± 16 No 18784 ± 136 18795 ± 151
17 14 61 45
119 Smilart smilart 003 2018-06-18 67339 512 ± 0 180 ± 12 No 1395 ± 74 1027 ± 66
-
VERIFICATION
74 49 45 48
120 Star Hybrid Limited starhybrid 001 2019-06-19 100509 2048 ± 0 358 ± 82 No 1075 ± 51 1078 ± 53
98 118 5 7
121 Synesis synesis 004 2019-03-01 270628 2048 ± 0 735 ± 15 No 424 ± 14 430 ± 22
83 19 15 17
122 Synesis synesis 005 2019-06-06 146509 2048 ± 0 211 ± 9 No 599 ± 23 581 ± 32
46 126 63 46
123 Tech5 SA tech5 002 2019-03-01 1150887 1280 ± 0 780 ± 10 No 1406 ± 120 1048 ± 57
48 150 58 64
124 Tech5 SA tech5 003 2019-08-19 1427464 1536 ± 0 937 ± 39 No 1313 ± 35 1360 ± 41
75 66 9 4
125 Tevian tevian 004 2019-03-01 863474 2048 ± 0 506 ± 30 No 474 ± 31 326 ± 20
91 94 96 104
126 Tevian tevian 005 2019-09-21 921043 2048 ± 0 642 ± 32 No 3097 ± 31 3700 ± 278
123 57 83 81
127 TigerIT Americas LLC tiger 002 2018-06-13 341638 2056 ± 0 393 ± 20 No 2135 ± 29 2137 ± 38
118 62 80 78
128 TigerIT Americas LLC tiger 003 2018-10-16 426164 2056 ± 0 458 ± 21 No 2031 ± 35 2029 ± 38
FNMR(T)
132 8 140 141

2089 ± 0 165 ± 1 18924 ± 65 20158 ± 103
FMR(T)
129 TongYi Transportation Technology tongyi 005 2019-06-12 1140701 No

51 76 103 88
130 Toshiba toshiba 002 2018-10-19 813606 1560 ± 0 541 ± 0 No 3521 ± 369 2449 ± 124
52 75 87 86
131 Toshiba toshiba 003 2019-03-01 984125 1560 ± 0 540 ± 0 No 2390 ± 41 2407 ± 81
95 50 95 97
132 Trueface.ai trueface 000 2019-10-08 255123 2048 ± 0 368 ± 11 No 3040 ± 26 3144 ± 51
Notes
R CPU
19
Config1 Comparison Time (ns)3
2019/10/16 12:43:37
Developer Short Seq. Validation Template GPU
2
Name Name Num. Date Data (KB) Size (B) Time (ms) Genuine Impostor
93 101 123 121
133 ULSee Inc ulsee 001 2019-07-31 370519 2048 ± 0 654 ± 2 No 6065 ± 94 6228 ± 77
81 143 141 139
134 Shanghai Ulucu Electronics Technology Co. Ltd uluface 002 2019-07-10 0 2048 ± 0 873 ± 42 No 19207 ± 1114 18501 ± 274
40 81 97 98
135 China University of Petroleum upc 001 2019-06-05 0 1052 ± 0 551 ± 15 No 3114 ± 44 3165 ± 97
154 48 152 152
136 VCognition vcog 002 2017-06-12 3229434 61504 ± 5 357 ± 25 No 296154 ± 3077 296436 ± 4183
110 42 54 52
137 Visidon visidon 001 2019-02-26 170262 2052 ± 0 316 ± 6 No 1258 ± 38 1148 ± 109
78 107 120 123
138 Veridas Digital Authentication Solutions S.L. veridas 001 2019-03-01 196540 2048 ± 0 671 ± 21 No 5748 ± 20 7111 ± 148
22 104 72 76
139 Veridas Digital Authentication Solutions S.L. veridas 000 2019-03-01 193466 512 ± 0 669 ± 20 No 1733 ± 81 1934 ± 44
89 113 41 43
140 Via Technologies Inc. via 000 2019-07-08 124422 2048 ± 0 707 ± 8 No 966 ± 28 1021 ± 44
15 27 49 51
141 Videonetics Technology Pvt Ltd videonetics 001 2019-06-19 30875 512 ± 0 262 ± 3 No 1153 ± 38 1142 ± 65
50 140 38 29
142 Vigilant Solutions vigilant 006 2019-03-01 343048 1548 ± 0 841 ± 8 No 939 ± 32 711 ± 37
49 65 34 34
143 Vigilant Solutions vigilant 007 2019-06-27 255600 1548 ± 0 493 ± 6 No 803 ± 35 800 ± 40
113 44 146 145
144 Beijing Vion Technology Inc vion 000 2018-10-19 228219 2052 ± 0 333 ± 1 No 39839 ± 3561 26830 ± 2241
97 37 69 55
145 Vision-Box visionbox 000 2019-02-26 176501 2048 ± 0 304 ± 7 No 1648 ± 57 1192 ± 42
90 153 50 53
FRVT
146 Vision-Box visionbox 001 2019-03-01 256869 2048 ± 0 983 ± 7 No 1161 ± 22 1154 ± 20
21 29 28 32
147 VisionLabs visionlabs 006 2019-03-01 353044 512 ± 0 270 ± 0 No 698 ± 19 734 ± 28
20 30 40 42
148 VisionLabs visionlabs 007 2019-06-12 357204 512 ± 0 272 ± 0 No 965 ± 41 972 ± 31
-
28 144 79 77

149 Vocord vocord 006 2019-03-01 559457 768 ± 0 886 ± 1 No 2020 ± 72 1969 ± 62
53 127 90 90
150 Vocord vocord 007 2019-06-06 587489 1664 ± 0 780 ± 2 No 2593 ± 83 2526 ± 59
44 33 66 67
151 Winsense Co. Ltd winsense 000 2019-06-17 270819 1280 ± 0 283 ± 1 No 1551 ± 31 1532 ± 42
127 139 101 102
152 X-Laboratory x-laboratory 000 2019-09-03 520020 2056 ± 0 832 ± 38 No 3380 ± 91 3314 ± 253
140 51 27 14
153 Zhuhai Yisheng Electronics Technology yisheng 004 2018-06-12 486351 3704 ± 0 378 ± 12 No 693 ± 137 526 ± 34
130 141 138 138
154 Shanghai Yitu Technology yitu 003 2019-03-01 1525719 2082 ± 0 860 ± 0 No 18305 ± 71 18286 ± 62
Notes
R CPU
-
VERIFICATION
FNMR(T)
FMR(T)
20
2019/10/16 12:43:37
FALSE NON - MATCH RATE ( FNMR )
Algorithm CONSTRAINED , COOPERATIVE LESS CONSTRAINED , NON - COOP.
Name V ISA MC V ISA V ISA M UGSHOT M UGSHOT 12+Y RS V ISA B ORDER W ILD C HILD E XP
FMR 0.0001 1 E -06 0.0001 1 E -05 1 E -05 1 E -06 0.0001 0.01
1 3divi-003 0.0318 109 0.0588 109 0.0097 101 0.0389 108 0.0639 105 0.0619 98 0.0867 105 0.5365 25
2 3divi-004 0.0095 39 0.0153 42 0.0049 58 0.0097 38 0.0145 36 0.0175 46 0.0665 98 -
3 adera-001 0.1021 124 0.1757 122 0.0368 123 0.1823 130 0.2967 128 0.1714 112 0.1965 120 0.7202 53
4 alchera-000 0.0165 80 0.0243 70 0.0086 95 0.0125 68 0.0186 63 0.0204 52 0.0370 65 -
5 alchera-001 0.0183 85 0.0299 83 0.0078 91 0.0142 74 0.0234 77 0.0239 60 0.0372 66 -
6 allgovision-000 0.0346 111 0.0527 105 0.0210 114 0.0232 95 0.0339 84 - 0.0607 95 -
7 alphaface-001 0.0065 21 0.0097 20 0.0025 21 0.0039 3 0.0063 6 0.0083 8 0.0280 9 -
8 amplifiedgroup-001 0.5034 144 0.5848 144 0.2999 146 0.6973 144 0.8316 141 0.7807 125 0.4250 136 -
9 anke-003 0.0131 61 0.0213 60 0.0056 64 0.0094 35 0.0175 56 0.0134 29 0.0302 32 -
10 anke-004 0.0080 32 0.0154 43 0.0031 29 0.0073 19 0.0112 21 0.0102 16 0.0288 20 0.3577 4
11 anyvision-002 0.0660 118 0.0898 115 0.0387 124 0.0928 123 0.1512 119 - 0.2227 122 0.6960 46
12 anyvision-004 0.0267 103 0.0385 98 0.0081 93 0.0258 97 0.0487 100 - 0.0470 82 0.4633 12
13 aware-003 0.0793 120 0.1161 119 0.0288 121 0.1028 124 0.1708 122 0.1698 111 0.3180 133 0.8512 66
FRVT
14 aware-004 0.0690 119 0.0949 117 0.0257 117 0.0837 121 0.1436 117 0.1171 109 0.0516 89 -
15 awiros-001 0.4044 139 0.4622 138 0.2880 145 0.5530 139 0.6518 136 0.2008 113 0.5584 139 -
-
16 ayonix-000 0.4351 141 0.4872 139 0.2299 141 0.6150 141 0.7510 138 0.6557 123 0.3635 134 0.8434 64

17 bm-001 0.7431 150 0.9494 151 0.6188 151 0.9586 148 0.9843 145 0.9049 129 0.9935 141 0.8845 71
18 camvi-002 0.0125 58 0.0221 65 0.0049 59 0.0089 32 0.0145 38 0.0142 30 0.0288 19 0.5760 31
19 camvi-004 0.0171 83 0.0316 87 0.0049 57 0.0042 5 0.0049 2 0.0097 15 0.0284 14 -
20 ceiec-001 0.0328 110 0.0475 102 0.0163 109 0.0295 103 0.0478 99 0.0621 99 0.0847 101 -
21 ceiec-002 0.0161 78 0.0193 55 0.0124 107 0.0122 65 0.0164 52 0.0270 65 0.0465 81 0.5156 22
22 chtface-001 0.9993 153 0.9994 153 0.9993 153 0.9999 150 - 1.0000 131 0.9980 142 -
23 cogent-003 0.0091 35 0.0188 53 0.0032 30 0.0098 40 0.0132 30 0.0187 48 0.0406 72 -
24 cogent-004 0.0064 20 0.0116 30 0.0024 20 0.0096 36 0.0134 31 0.0157 34 0.0379 67 0.7177 52
25 cognitec-000 0.0116 51 0.0177 47 0.0036 35 0.0118 60 0.0167 53 0.0285 69 0.0953 108 0.8365 63
26 cognitec-001 0.0126 59 0.0185 52 0.0047 53 0.0120 63 0.0168 54 0.0270 64 0.0598 94 -
27 ctbcbank-000 0.0168 81 0.0250 76 0.0064 71 0.0146 77 0.0224 72 0.0211 53 1.0000 150 0.8803 69
28 cyberextruder-001 0.1972 132 0.2547 130 0.0755 133 0.4686 138 0.6387 135 - 0.1747 117 0.7804 61
29 cyberextruder-002 0.0811 121 0.1336 121 0.0265 118 0.1465 128 0.2266 126 - 0.1000 110 0.6105 35
30 cyberlink-002 0.0114 50 0.0195 56 0.0044 45 0.0101 44 0.0163 49 0.0160 35 0.0298 29 0.5003 18
31 cyberlink-003 0.0118 53 0.0192 54 0.0042 43 0.0098 41 0.0161 47 0.0153 33 0.0303 34 -
32 dahua-002 0.0129 60 0.0157 44 0.0090 98 0.0116 59 0.0153 41 0.0134 28 0.0323 48 -
-
33 dahua-003 0.0052 12 0.0068 10 0.0023 19 0.0056 10 0.0062 5 0.0113 22 0.0285 15 -
VERIFICATION
34 deepglint-001 0.0040 6 0.0062 7 0.0014 8 0.0047 6 0.0067 7 0.0069 4 0.0278 6 0.4006 7
35 deepsea-001 0.0136 65 0.0215 62 0.0071 87 0.0142 75 0.0214 68 0.0163 39 0.0347 59 0.5606 29
36 dermalog-005 0.1526 130 0.1823 125 0.0658 131 0.2580 133 0.4018 130 - 0.0855 103 0.6842 43
37 dermalog-006 0.0253 100 0.0369 96 0.0172 112 0.0171 83 0.0283 81 - 0.0623 97 0.5852 32
38 digitalbarriers-002 0.3360 137 0.3690 135 0.0968 136 0.0877 122 0.1557 120 0.0971 108 0.0436 76 -
39 dsk-000 0.1526 129 0.2169 127 0.0765 134 0.3787 137 0.5426 134 0.3115 118 0.2201 121 0.7313 55
40 einetworks-000 0.0099 42 0.0180 49 0.0047 52 0.0088 30 0.0140 34 0.0130 26 0.0293 23 -
41 everai-002 0.0104 47 0.0159 45 0.0041 42 0.0063 15 0.0112 22 0.0182 47 0.0294 25 -
42 everai-paravision-003 0.0034 2 0.0050 3 0.0011 3 0.0036 2 0.0052 3 0.0092 12 0.0278 7 0.2669 1
FNMR(T)
43 f8-001 0.0249 99 0.0336 88 0.0182 113 0.0178 85 0.0232 76 0.0303 76 0.0475 83 0.5272 23
FMR(T)
44 facesoft-000 0.0085 34 0.0112 29 0.0032 31 0.0064 16 0.0107 18 0.0091 11 0.0275 3 0.4992 17
Table 5: FNMR is the proportion of mated comparisons below a threshold set to achieve the FMR given in the header on the fourth row. FMR is the proportion of
impostor comparisons at or above that threshold. The light grey values give rank over all algorithms in that column. The pink column uses only same-sex impostors;
others are selected regardless of demographics. The exception, in the green column, uses “matched-covariates” i.e. impostors of the same sex, age group, and country
of birth. The pink column includes effects of extended ageing. Missing entries for border, visa, mugshot and wild images generally mean the algorithm did not run to
completion. For child exploitation, missing entries arise because NIST executes those runs only infrequently.
21
2019/10/16 12:43:37
FMR 0.0001 1 E -06 0.0001 1 E -05 1 E -05 1 E -06 0.0001 0.01
45 glory-000 0.1094 125 0.1286 120 0.0514 128 0.2179 131 0.2656 127 - 0.4762 138 0.8937 72
46 glory-001 0.0902 122 0.1082 118 0.0410 125 0.1642 129 0.2065 125 - 0.4261 137 0.8831 70
47 gorilla-002 0.0256 101 0.0413 99 0.0076 90 0.0478 113 0.0912 111 - 0.0507 87 0.6157 36
48 gorilla-003 0.0165 79 0.0291 81 0.0053 61 0.0205 91 0.0437 92 0.0297 74 0.0359 63 0.9756 77
49 hik-001 0.0096 40 0.0125 32 0.0036 37 0.0093 34 0.0164 51 0.0108 19 0.0271 1 -
50 hr-001 0.0044 9 0.0072 12 0.0019 13 0.0073 21 0.0108 19 0.0125 23 0.0303 33 0.5499 26
51 hr-002 0.0043 7 0.0059 5 0.0017 10 0.0054 7 0.0076 9 0.0076 6 0.0338 57 -
52 id3-003 0.0361 112 0.0757 112 0.0104 105 0.0292 101 0.0476 96 0.0447 90 0.0848 102 0.5865 33
53 id3-004 0.0198 90 0.0344 91 0.0084 94 0.0238 96 0.0423 91 0.0289 71 - -
54 idemia-004 0.0160 77 0.0244 72 0.0065 73 0.0199 90 0.0354 87 0.0268 63 0.0309 41 -
55 idemia-005 0.0132 62 0.0216 63 0.0057 66 0.0121 64 0.0218 71 0.0215 55 0.0294 24 -
56 iit-000 0.1516 128 0.1981 126 0.0620 130 0.0828 120 0.1442 118 0.2214 116 - -
57 iit-001 0.0104 45 0.0179 48 0.0048 56 0.0099 43 0.0142 35 0.1222 110 0.3092 132 0.4836 15
FRVT
58 imagus-000 0.0642 116 0.0882 113 0.0330 122 0.0497 114 0.0905 110 0.0848 104 0.1158 111 0.6936 45
59 imperial-000 0.0067 24 0.0108 27 0.0022 18 0.0080 26 0.0134 32 0.0087 10 0.0281 11 -
-
60 imperial-002 0.0058 16 0.0081 15 0.0027 22 0.0055 9 0.0085 11 0.0083 9 0.0273 2 -

61 incode-003 0.0142 68 0.0249 75 0.0054 62 0.0448 111 0.0869 109 0.0354 81 0.0318 46 -
62 incode-004 0.0077 30 0.0132 34 0.0034 33 0.0096 37 0.0160 45 0.0171 43 0.0313 43 0.5102 19
63 innovatrics-004 0.0194 88 0.0292 82 0.0068 79 0.0344 105 0.0617 104 0.0562 95 0.0454 80 0.4650 13
64 innovatrics-006 0.0058 17 0.0089 17 0.0021 16 0.0061 14 0.0096 16 0.0096 14 0.0281 10 -
65 intellicloudai-001 0.0142 69 0.0234 69 0.0064 72 0.0092 33 0.0145 37 0.0162 37 0.0409 73 -
66 intellifusion-001 0.0072 27 0.0094 19 0.0028 26 0.0056 11 0.0085 12 0.0111 21 0.0289 21 -
67 intellivision-001 0.1335 127 0.2205 128 0.0417 126 0.1090 126 0.1670 121 - 0.2445 124 0.7766 60
68 intellivision-002 0.1000 123 0.1775 123 0.0265 119 0.0610 117 0.1009 112 0.0805 103 0.0768 100 -
69 intelresearch-000 0.0307 106 0.0578 108 0.0093 99 0.0385 107 0.0751 108 0.0409 85 0.0324 49 -
70 intsysmsu-000 0.0135 64 0.0204 57 0.0069 81 0.0112 54 0.0161 46 0.0148 31 0.2330 123 -
71 iqface-000 0.0091 36 0.0143 38 0.0043 44 0.0075 24 0.0110 20 0.0171 44 0.0381 68 0.6490 39
72 isap-001 0.5092 145 0.6588 146 0.2338 143 0.6899 143 0.7978 139 0.7200 124 0.1931 119 -
73 isityou-000 0.5682 147 0.7033 147 0.4145 149 1.0000 151 - - 1.0000 146 1.0000 81
74 isystems-001 0.0149 73 0.0245 73 0.0067 77 0.0138 73 0.0210 67 - 0.0524 92 0.5152 21
75 isystems-002 0.0118 52 0.0182 51 0.0066 74 0.0111 51 0.0162 48 - 0.0516 90 0.4876 16
76 itmo-005 0.0182 84 0.0345 92 0.0067 78 0.0181 86 0.0348 86 - 0.0433 74 0.4808 14
-
77 itmo-006 0.0125 57 0.0220 64 0.0046 48 0.0149 78 0.0266 80 0.0233 57 0.0329 52 -
VERIFICATION
78 kakao-001 0.4553 143 0.5532 143 0.2034 140 0.6580 142 0.8150 140 0.4831 121 1.0000 154 -
79 kakao-002 0.0625 115 0.1779 124 0.0168 111 0.0791 119 0.1381 116 0.0636 100 1.0000 148 1.0000 88
80 kedacom-000 0.0055 14 0.0081 16 0.0027 23 0.0111 53 0.0120 25 0.0415 86 0.2511 126 0.7650 58
81 kneron-003 0.0542 114 0.0902 116 0.0218 115 0.0346 106 0.0562 103 0.0919 106 0.3053 131 0.6962 47
82 lookman-002 0.0297 105 0.0547 107 0.0102 104 0.0339 104 0.0562 102 0.0614 97 0.2640 129 -
83 lookman-004 0.0074 29 0.0099 22 0.0037 38 0.0124 67 0.0149 39 0.0430 89 0.2516 127 0.7664 59
84 megvii-001 0.0157 75 0.0244 71 0.0045 47 0.0392 109 0.0671 106 - 0.0916 107 0.4418 10
85 megvii-002 0.0104 46 0.0145 40 0.0036 36 0.0225 93 0.0345 85 - 0.0692 99 0.3013 2
86 meiya-001 0.0171 82 0.0275 80 0.0066 76 0.0159 82 0.0261 79 0.0311 77 0.0363 64 -
FNMR(T)
87 microfocus-001 0.4482 142 0.5524 142 0.2309 142 0.7256 145 0.8416 142 - 0.2567 128 0.6890 44
FMR(T)
88 microfocus-002 0.3605 138 0.5057 140 0.1566 139 0.5783 140 0.7223 137 - 0.1582 116 0.6517 40
22
2019/10/16 12:43:37
FMR 0.0001 1 E -06 0.0001 1 E -05 1 E -05 1 E -06 0.0001 0.01
89 mt-000 0.0100 43 0.0170 46 0.0047 51 0.0074 23 0.0118 24 0.0127 24 0.0326 51 0.3773 6
90 neurotechnology-005 0.0141 67 0.0300 84 0.0051 60 0.0108 49 0.0163 50 0.0204 51 0.0332 53 -
91 neurotechnology-006 0.0098 41 0.0136 35 0.0040 41 0.0105 47 0.0182 60 0.0164 41 0.0303 35 0.5911 34
92 nodeflux-001 1.0000 154 1.0000 154 1.0000 154 1.0000 154 - 0.5169 122 1.0000 152 -
93 nodeflux-002 0.0186 86 0.0340 89 0.0070 84 0.0261 98 0.0451 95 0.0548 94 0.0299 30 -
94 notiontag-000 0.6669 148 0.7885 148 0.3222 148 0.3715 136 0.4978 133 0.8571 127 0.1807 118 0.6479 38
95 ntechlab-006 0.0078 31 0.0111 28 0.0021 17 0.0112 55 0.0227 75 0.0108 18 0.0275 4 -
96 ntechlab-007 0.0056 15 0.0076 13 0.0018 11 0.0073 22 0.0128 28 0.0079 7 0.0276 5 0.3316 3
97 pixelall-002 0.0193 87 0.0340 90 0.0066 75 0.0127 70 0.0209 66 0.0234 59 0.0342 58 0.8963 73
98 psl-002 0.0107 48 0.0180 50 0.0048 55 0.0089 31 0.0120 26 0.0790 102 0.0295 26 -
99 psl-003 0.0065 22 0.0099 23 0.0028 24 0.0055 8 0.0075 8 1.0000 132 0.0296 28 -
100 rankone-006 0.0242 95 0.0460 101 0.0070 83 0.0119 61 0.0188 64 0.0315 78 0.0538 93 -
101 rankone-007 0.0197 89 0.0366 95 0.0057 67 0.0113 57 0.0177 58 0.0286 70 0.0450 78 0.6686 41
FRVT
102 realnetworks-002 0.0248 97 0.0358 93 0.0099 102 0.0513 115 0.1127 113 0.0371 83 0.0334 54 -
103 realnetworks-003 0.0259 102 0.0372 97 0.0100 103 0.0541 116 0.1208 115 0.0378 84 0.0335 56 0.5152 20
-
104 remarkai-000 0.0147 72 0.0257 78 0.0062 70 0.0102 45 0.0158 43 0.0163 40 0.0304 36 -

105 remarkai-001 0.0144 70 0.0256 77 0.0061 69 0.0102 46 0.0159 44 0.0162 38 0.0308 40 -
106 rokid-000 0.0093 38 0.0145 39 0.0038 39 0.0073 20 0.0102 17 0.0164 42 0.0857 104 -
107 saffe-001 0.4339 140 0.5261 141 0.2340 144 0.7539 147 0.8736 144 0.7977 126 0.3887 135 0.8973 74
108 saffe-002 0.0119 55 0.0206 58 0.0054 63 0.0107 48 0.0177 57 0.0244 61 0.0308 39 -
109 sensetime-001 0.0063 19 0.0092 18 0.0030 27 0.0130 71 - 0.0252 62 1.0000 145 0.6997 48
110 sensetime-002 0.0068 25 0.0098 21 0.0035 34 0.0143 76 - 0.0278 68 0.9999 143 0.5309 24
111 sertis-000 0.0118 54 0.0208 59 0.0047 49 0.0080 25 0.0127 27 0.0110 20 0.0285 16 -
112 shaman-000 0.9297 152 0.9774 152 0.9128 152 0.9990 149 - 0.9999 130 0.9575 140 0.9618 76
113 shaman-001 0.3346 136 0.4616 137 0.1360 138 0.2368 132 0.3723 129 0.3574 119 0.1498 115 0.8990 75
114 shu-001 0.0103 44 0.0140 37 0.0044 46 0.0293 102 0.0688 107 0.0172 45 0.0986 109 0.4590 11
115 siat-002 0.0091 37 0.0126 33 0.0039 40 0.0109 50 0.0190 65 0.0276 67 0.0520 91 0.4277 9
116 siat-004 0.0067 23 0.0099 24 0.0028 25 0.0152 80 - 0.0275 66 1.0000 144 -
117 sjtu-001 0.0051 11 0.0080 14 0.0019 12 0.0211 92 0.0446 94 0.0131 27 0.0289 22 -
118 smilart-002 0.2440 135 0.3532 134 0.0821 135 - - 0.3785 120 - 0.6999 49
119 smilart-003 0.6944 149 0.8836 149 0.1088 137 0.0695 118 0.1193 114 0.0894 105 0.1190 112 -
120 starhybrid-001 0.0108 49 0.0138 36 0.0058 68 0.0081 27 0.0113 23 0.0152 32 0.0350 61 0.5584 27
-
121 synesis-004 0.0310 107 0.0480 103 0.0166 110 0.0476 112 0.0443 93 0.0764 101 0.1319 113 -
VERIFICATION
122 synesis-005 0.0147 71 0.0226 67 0.0073 89 0.0153 81 0.0226 73 0.0213 54 0.0334 55 0.5601 28
123 tech5-002 0.0046 10 0.0063 8 0.0009 2 0.0113 58 0.0216 70 0.0233 58 0.0310 42 -
124 tech5-003 0.0053 13 0.0070 11 0.0014 7 0.0099 42 0.0185 61 0.0095 13 0.0306 37 -
125 tevian-004 0.0228 93 0.0304 85 0.0069 80 0.0226 94 0.0478 97 0.0128 25 0.0394 70 -
126 tevian-005 0.0043 8 0.0062 6 0.0020 15 0.0057 12 0.0085 13 0.0070 5 0.0300 31 -
127 tiger-002 0.0658 117 0.0889 114 0.0227 116 0.1083 125 0.1766 123 0.0952 107 0.0512 88 0.7862 62
128 tiger-003 0.0313 108 0.0602 111 0.0087 96 0.0188 88 0.0359 88 0.0344 79 0.0482 85 0.5610 30
129 tongyi-005 0.0073 28 0.0146 41 0.0019 14 0.0187 87 0.0421 90 0.0161 36 0.0399 71 0.6195 37
130 toshiba-002 0.0134 63 0.0222 66 0.0048 54 0.0097 39 0.0154 42 - 0.0434 75 0.7103 50
131 toshiba-003 0.0125 56 0.0214 61 0.0047 50 0.0085 29 0.0131 29 - 0.0282 12 -
FNMR(T)
FMR(T)
132 trueface-000 0.0249 98 0.4321 136 0.0069 82 0.0119 62 0.0180 59 0.0297 75 0.0614 96 -
23
2019/10/16 12:43:37
FMR 0.0001 1 E -06 0.0001 1 E -05 1 E -05 1 E -06 0.0001 0.01
133 ulsee-001 0.0151 74 0.0246 74 0.0080 92 0.0113 56 0.0185 62 0.0187 49 0.0316 45 -
134 uluface-002 0.0081 33 0.0123 31 0.0033 32 0.0071 18 0.0095 15 0.0107 17 0.0444 77 0.6729 42
135 upc-001 0.0234 94 0.0519 104 0.0071 86 0.0291 100 0.0490 101 0.0294 72 0.0314 44 0.4224 8
136 vcog-002 0.7522 151 0.9033 150 0.5040 150 - - - - 0.7523 56
137 vd-001 0.0243 96 0.0452 100 0.0093 100 0.0271 99 0.0402 89 0.0424 88 0.1389 114 -
138 veridas-001 0.1998 134 0.2724 131 0.0742 132 0.2987 135 0.4587 132 0.2599 117 0.0501 86 -
139 veridas-002 0.1733 131 0.2257 129 0.0528 129 0.2617 134 0.4147 131 0.2073 115 0.0450 79 -
140 via-000 0.0216 92 0.0365 94 0.0088 97 0.0177 84 0.0287 82 0.0296 73 0.0349 60 0.7638 57
141 videonetics-001 0.5483 146 0.6446 145 0.3063 147 0.7517 146 0.8607 143 0.8664 128 0.2986 130 0.7297 54
142 vigilantsolutions-006 0.1264 126 0.3221 132 0.0136 108 0.0150 79 0.0254 78 0.0493 92 0.0321 47 -
143 vigilantsolutions-007 0.0202 91 0.0307 86 0.0070 85 0.0136 72 0.0227 74 0.0356 82 0.0306 38 1.0000 145
144 vion-000 0.0419 113 0.0590 110 0.0288 120 0.0422 110 0.0478 98 0.0581 96 0.2479 125 0.8765 68
145 visionbox-000 0.0293 104 0.0541 106 0.0110 106 0.0197 89 0.0339 83 0.0349 80 0.0476 84 -
FRVT
146 visionbox-001 0.0159 76 0.0270 79 0.0072 88 0.0111 52 0.0173 55 0.0190 50 0.0389 69 -
147 visionlabs-006 0.0037 3 0.0066 9 0.0012 4 0.0041 4 0.0060 4 0.0061 2 0.0285 17 -
-
148 visionlabs-007 0.0038 4 0.0048 2 0.0012 6 0.0036 1 0.0048 1 0.0057 1 0.0286 18 0.3708 5

149 vocord-006 0.0062 18 0.0102 25 0.0016 9 0.0082 28 0.0151 40 0.0475 91 0.0282 13 -
150 vocord-007 0.0039 5 0.0053 4 0.0012 5 0.0061 13 0.0094 14 0.0520 93 0.0280 8 0.8468 65
151 winsense-000 0.0140 66 0.0228 68 0.0056 65 0.0125 69 0.0215 69 0.0226 56 0.0352 62 0.8600 67
152 x-laboratory-000 0.0071 26 0.0106 26 0.0030 28 0.0123 66 0.0138 33 0.0419 87 0.0295 27 -
153 yisheng-004 0.1988 133 0.3329 133 0.0475 127 0.1147 127 0.1849 124 0.2044 114 0.0908 106 0.7152 51
154 yitu-003 0.0015 1 0.0026 1 0.0003 1 0.0066 17 0.0085 10 0.0064 3 0.0325 50 -
-
VERIFICATION
FNMR(T)
FMR(T)
24
0.200
log10(template_millisec)
2019/10/16 12:43:37
1.8 2.1 2.4 2.7

● veridas1
smilart3 ●
dermalo5 ●
veridas2 ●
● glory0
0.100 digital2
● adera1
0.090 ● yisheng4
● ●
glory1
0.080 intelli1
●
0.070 ●
iit0 ●
cyberex2
0.060 aware3
anyvisi2 ●
●
tiger2
0.050 ● aware4
●●
intelli2
0.040 kakao2
●
FRVT
Cooperative images: FNMR at FMR = 0.00003
imagus0
●
● vion0
-
0.030 synesis4 ●

●
kneron3
● realnet3
● vigilan6 ●
ceiec1 gorilla2 ● realnet2
● 3divi3
●
● allgovi0 ●
0.020 ● lookman2
intelre0
● id33
f81 ●
● ●
dermalo6 upc1 ●●●
innovat4 ● vd1
incode3
visionb0 ●
anyvisi4 ●
●
tiger3
● id34
megvii1
● nodeflu2
via0 ●
● ceiec2
tevian4
rankone6 itmo5
idemia4 ● gorilla3 ● alchera1 ●
● ● shu1
● ● synesis5
● isystem1 ● meiya1
0.010 deepsea1 ● ● truefac0
alchera0 ● pixelal2 megvii2
vigilan7 ● dahua2 ●
● rankone7 ● ctbcban0
0.009 visionb1 ●
intsysm0
itmo6 ● ulsee1
isystem2
● ●●
● senseti2 siat4 ●
0.008 ● neurote5
lookman4 ● idemia5 winsens0
● remarka1
● cyberli2 ● remarka0
cognite1 saffe2
●
toshiba2 psl2 ●
intelli1
anke3 ● iit1
3divi4
0.007 neurote6 ●
-
● toshiba3 x−labor0 ● ●● cognite0
● camvi2
cogent3 sertis0 ● cyberli3
VERIFICATION
● einetwo0
starhyb1
senseti1 ●
●
● tongyi5
siat2
●
0.006 kedacom0 ● rokid0 ● ● camvi4
● incode4
iqface0 ●
hik1 sjtu1
mt0
uluface2
● anke4
ntechla6
● ● ●
0.005 cogent4 ● everai2
facesof0
vocord6 ●
●
● imperia0
●● psl3
intelli1
hr1
0.004 ● imperia2 ●
●
● ntechla7
innovat6 ● tech53
dahua3 ●
tech52
● ●
alphafa1 ●
●
hr2 tevian5 deepgli1
0.003 ● vocord7 ●
FNMR(T)
visionl6
FMR(T)
visionl7 ●
● yitu3
●
● everai_3
0.002
100 200 300 400 500 600 700 800 1000 2000 3000 4000 5000
Template size (bytes)
Figure 1: The points show false non-match rates (FNMR) versus the size of the encoded template. FNMR is the geometric mean of FNMR values for visa and mugshot
images (from Figs. 26 and 34) at a false match rate (FMR) of 0.0001. The color of the points encodes template generation time - which spans at least one order of
magnitude. Durations are measured on a single core of a c. 2016 Intel Xeon CPU E5-2630 v4 running at 2.20GHz. Algorithms with poor FNMR are omitted.
25
2019/10/16 12:43:37
0.100
adera1
digital2 ●
0.090 ●
glory1 ● ●
yisheng4
0.080
●
intelli1
iit0 ●
0.070
●
cyberex2
0.060
● aware3
●
anyvisi2
0.050 ● tiger2
aware4
intelli2 ● ●
0.040 ● kakao2
● imagus0
vion0
●
0.030 synesis4
●
● kneron3
FRVT
Cooperative images: FNMR at FMR = 0.00003
vigilan6
●
ceiec1
●
-
realnet3 realnet2 ● ● allgovi0 3divi3
●

gorilla2 ●
● ● intelre0
0.020 ● lookman2 ● id33
●
vd1 ● dermalo6 ● f81
innovat4 ●
● visionb0 ● ●
● megvii1
upc1
tiger3 ●
anyvisi4incode3 ●
● id34
nodeflu2 ●
tevian4 via0
● ceiec2 ●
●
● synesis5 ●
gorilla3 alchera1 itmo5 ●
● idemia4 ●
● meiya1 ●● deepsea1
rankone6
0.010 ● ● truefac0 ● alchera0dahua2
shu1● ctbcban0
●
●
rankone7 ● isystem1 vigilan7●
pixelal2 ● ● visionb1
● intsysm0 megvii2
ulsee1 ●
0.009 winsens0 ● itmo6
● remarka0 ●●
siat4 remarka1
cognite1 ● ● isystem2
●senseti2
0.008 ● ● ●
neurote5 idemia5 ●
cognite0 lookman4 intelli1
● ● saffe2
● cyberli2
● ● ● ● anke3
iit1
3divi4 ●
0.007 ●● ●
● ● cyberli3
toshiba3 toshiba2 senseti1● ●
camvi2
x−labor0
tongyi5 ● ● siat2 ● sertis0
psl2
starhyb1 ● ● ●
neurote6 ●
iqface0 kedacom0 einetwo0 cogent3
● camvi4
0.006 ● rokid0
-
● hik1 ● ● ●mt0
incode4 ● sjtu1 ●
VERIFICATION
uluface2
anke4 ● ●● ●
ntechla6 ●
0.005 cogent4
everai2
imperia0 ●● vocord6
facesof0 ●
intelli1
● ●
0.004 ● imperia2
dahua3 hr1 ● psl3● innovat6
● tech53
●
● ntechla7
tech52
● ●
● ●alphafa1 hr2
tevian5
0.003 ● ●
deepgli1
vocord7
FNMR(T)
visionl6
FMR(T)
● visionl7
● ●
everai_3 yitu3 ●
0.002
log10(template_bytes)
2.4 2.8 3.2 3.6
60 70 80 90 100 200 300 400 500 600 700 800 900 1000
Template generation duration (milliseconds)
Figure 2: The points show false non-match rates (FNMR) versus the duration of the template generation operation. FNMR is the geometric mean of FNMR values for
visa and mugshot images (from Figs. 26 and 34) at a false match rate (FMR) of 0.0001. Template generation time is a median estimated over 640 x 480 pixel portraits.
It is measured on a single core of a c. 2016 Intel Xeon CPU E5-2630 v4 running at 2.20GHz. The color of the points encodes template size - which span two orders of
magnitude. Algorithms with poor FNMR are omitted.
26
1 Metrics
1.1 Core accuracy
Given a vector of N genuine scores, u, the false non-match rate (FNMR) is computed as the proportion below some
threshold, T:
N
1 X
FNMR(T ) = 1 − H(ui − T ) (1)
N i=1
where H(x) is the unit step function, and H(0) taken to be 1.

Similarly, given a vector of N impostor scores, v, the false match rate (FMR) is computed as the proportion above T:
N
1 X
FMR(T ) = H(vi − T ) (2)
N i=1
The threshold, T, can take on any value. We typically generate a set of thresholds from quantiles of the observed impostor
scores, v, as follows. Given some interesting false match rate range, [FMRL , FMRU ], we form a vector of K thresholds
corresponding to FMR measurements evenly spaced on a logarithmic scale
Tk = Qv (1 − FMRk ) (3)
where Q is the quantile function, and FMRk comes from
k
log10 FMRk = log10 FMRL + [log10 FMRU − log10 FMRL ] (4)
K
Error tradeoff characteristics are plots of FNMR(T) vs. FMR(T). These are plotted with FMRU → 1 and FMRL as low
as is sustained by the number of impostor comparisons, N. This is somewhat higher than the “rule of three” limit 3/N
because samples are not independent, due to re-use of images.

2019/10/16 12:43:37
2 Datasets
2.1 Child exploitation images
. The number of images is on the order of 104 .
. The number of subjects is on the order of 103 .
. The number of subjects with two images on the order of 103 .
. The images are operational. They are taken from ongoing investigations of child exploitation crimes. The images
are arbitrarily unconstrained. Pose varies considerably around all three axes, including subject lying down. Res-
olution varies very widely. Faces can be occluded by other objects, including hair and hands. Lighting varies,
although the images are intended for human viewing. Mis-focus is rare. Images are given to the algorithm without
any cropping; faces may occupy widely varying areas.
. The images are usually large from contemporary cameras. The mean interocular distance (IOD) is 70 pixels.
. The images are of subjects from several countries, due to the global production of this imagery.
. The images are of children, from infancy to late adolescence.
. All of the images are live capture, none are scanned. Many have been cropped.
. When these images are input to the algorithm, they are labelled as being of type ”EXPLOITATION” - see Table 4 of
the FRVT API.
2.2 Visa images
. The images have geometry in reasonable conformance with the ISO/IEC 19794-5 Full Frontal image type. Pose is
generally excellent.
. The images are of size 252x300 pixels. The mean interocular distance (IOD) is 69 pixels.
. The images are of subjects from greater than 100 countries, with significant imbalance due to visa issuance patterns.
. The images are of subjects of all ages, including children, again with imbalance due to visa issuance demand.
. Many of the images are live capture. A substantial number of the images are photographs of paper photographs.
. When these images are input to the algorithm, they are labelled as being of type ”ISO” - see Table 4 of the FRVT
API.
2.3 Visa images II

2019/10/16 12:43:37
. The images have geometry in good conformance with the ISO/IEC 19794-5 Full Frontal image type. Pose is gener-
ally excellent.
. The images are of size 300x300 pixels. The mean interocular distance (IOD) is 61 pixels.
. The images are of subjects from greater than 100 countries, with significant imbalance due to population and
immigration patterns.
. The images are of subjects of all ages, including children, again with imbalance due due to population and immi-
gration patterns and demand.
. All of the images are live capture.
. When these images are input to the algorithm, they are labelled as being of type ”ISO” - see Table 4 of the FRVT
API.
2.4 Mugshot images
. The images have geometry in reasonable conformance with the ISO/IEC 19794-5 Full Frontal image type.
. The images are of variable sizes. The median IOD is 105 pixels. The mean IOD is 113 pixels. The 1-st, 5-th, 10-th,
25-th, 75-th, 90-th and 99-th percentiles are 34, 58, 70, 87, 121, 161 and 297 pixels.
. The images are of subjects from the United States.
. The images are of adults.
. The images are all live capture.
. When these images are input to the algorithm, they are labelled as being of type ”mugshot” - see Table 4 of the
FRVT API.
2.5 Webcam images
. All subjects have a webcam image, and a portrait image.
. The portrait images are in poor conformance with the ISO/IEC 19794-5 Full Frontal image type.
. The webcam images are taken with at camera oriented by an attendant toward a cooperating subject. This is done
under time constraints so there are role, pitch and yaw angle variation. Also background illumination is sometimes
strong, so the face is under exposed. There is sometimes perspective distortion due to close range images.
. The images have mean IOD of 38 pixels.
. The images are all live capture.
. When these images are input to the algorithm, they are labelled as being of type ”WILD” - see Table 4 of the FRVT
API.

2019/10/16 12:43:37
(a) Visa (b) Mugshot (c) Wild
Figure 3: The figure gives simulated samples of image types used in this report.
2.6 Wild images
. The images include many photojournalism-style images. Images are given to the algorithm using a variable but
generally tight crop of the head. Resolution varies very widely. The images are very unconstrained, with wide yaw
and pitch pose variation. Faces can be occluded, including hair and hands.
. The images are of adults.
. All of the images are live capture, none are scanned.
. When these images are input to the algorithm, they are labelled as being of type ”WILD” - see Table 4 of the FRVT
API.
3 Results
3.1 Test goals
. To state overall accuracy.
. To compare algorithms.
3.2 Test design
Method: For visa images:
. The comparisons are of visa photos against visa photos.
. The number of genuine comparisons is on the order of 104 .
. The number of impostor comparisons is on the order of 1010 .
. The comparisons are fully zero-effort, meaning impostors are paired without attention to sex, age or other covari-
ates. However, later analysis is conducted on subsets.

2019/10/16 12:43:37
. The number of persons is on the order of 105 .
. The number of images used to make 1 template is 1.
. The number of templates used to make each comparison score is two corresponding to simple one-to-one verifica-
tion.
For mugshot images:
. The comparisons are of mugshot photos against mugshot photos.
. The impostors are paired by sex, but not by age or other covariates.
tion.
Method: For wild images:
. The comparisons are of wild photos against wild photos.
ates.
tion.
For child exploitation images:
. The comparisons are of unconstrained child exploitation photos against others of the same type.
ates.
tion.

2019/10/16 12:43:37
. We produce two performance statements. First, is a DET as used for visa and mugshot images. The second is
a cumulative match characteristic (CMC) summarizing a simulated one-to-many search process. This is done as
follows.
– We regard M enrollment templates as items in a gallery.

– These M templates come from M > N individuals, because multiple images of a subject are present in the
gallery under separate identifiers.
– We regard the verification templates as search templates.
– For each search we compute the rank of the highest scoring mate.
– This process should properly be conducted with a 1:N algorithm, such as those tested in NIST IR 8009. We
use the 1:1 algorithms in a simulated 1:N mode here to a) better reflect what a child exploitation analyst does,
and b) to show algorithm efficacy is better than that revealed in the verification DETs.

2019/10/16 12:43:37
3.3 Failure to enroll

2019/10/16 12:43:37
Algorithm Failure to Enrol Rate1

Name CHILD - EXPLOIT MUGSHOT VISA WILD
1 3divi-003 0.1806 58 0.0007 111 0.0006 105 0.0294 125
2 3divi-004 - 154 0.0008 114 0.0006 107 0.0222 124
3 adera-001 0.1928 61 0.0003 83 0.0005 101 0.0505 136
4 alchera-000 - 154 0.0004 98 0.0014 133 0.0038 94
5 alchera-001 - 154 0.0004 97 0.0014 132 0.0038 93
6 allgovision-000 - 154 0.0026 139 0.0052 151 0.0131 115
7 alphaface-001 - 154 0.0000 48 0.0004 80 0.0004 53
8 amplifiedgroup-001 - 154 0.0189 154 0.0279 156 0.1390 148
9 anke-003 - 154 0.0001 61 0.0004 71 0.0006 64
10 anke-004 0.0944 43 0.0001 62 0.0004 81 0.0006 68
11 anyvision-002 0.4866 81 0.0070 150 0.0090 153 0.1146 144
12 anyvision-004 0.1660 55 0.0001 69 0.0004 77 0.0080 104
13 aware-003 0.3314 75 0.0016 134 0.0013 129 0.0745 141
14 aware-004 - 154 0.0002 73 0.0005 89 0.0014 84
15 awiros-001 - 154 0.0386 155 0.0872 157 0.3415 152
16 ayonix-000 0.0000 3 0.0113 151 0.0137 155 0.1194 145
17 bm-001 0.0000 18 0.0000 36 0.0000 14 0.0000 11
18 camvi-002 0.0000 4 0.0000 21 0.0000 22 0.0000 18
19 camvi-004 - 154 0.0000 25 0.0000 26 0.0000 22
20 ceiec-001 - 154 0.0029 142 0.0023 140 0.0068 101
21 ceiec-002 0.2482 69 0.0036 144 0.0031 146 0.0081 105
22 chtface-001 - 154 0.0000 28 0.0000 29 0.0000 25
23 cogent-003 - 154 0.0001 58 0.0004 74 0.0009 79
24 cogent-004 0.0000 6 0.0000 4 0.0000 4 0.0000 2
25 cognitec-000 0.6342 85 0.0007 112 0.0007 113 0.0388 133
26 cognitec-001 - 154 0.0008 118 0.0010 115 0.0185 120
27 ctbcbank-000 0.3285 74 0.0011 125 0.0019 137 0.0868 143
28 cyberextruder-001 0.5338 83 0.0024 137 0.0029 144 0.0597 139
29 cyberextruder-002 0.2672 72 0.0027 140 0.0028 143 0.0335 130
30 cyberlink-002 0.1463 54 0.0004 91 0.0004 87 0.0007 69
31 cyberlink-003 - 154 0.0001 51 0.0004 62 0.0008 70
32 dahua-002 - 154 0.0024 138 0.0022 139 0.0009 76
33 dahua-003 - 154 0.0002 78 0.0003 43 0.0002 41
34 deepglint-001 0.0000 19 0.0000 14 0.0000 15 0.0000 12
35 deepsea-001 0.0000 8 0.0000 7 0.0000 7 0.0000 5
36 dermalog-005 0.1796 56 0.0013 130 0.0041 148 0.0163 118
37 dermalog-006 0.1797 57 0.0013 129 0.0041 149 0.0163 119
38 digitalbarriers-002 - 154 0.0028 141 0.0027 142 0.0071 102
39 dsk-000 0.0000 14 0.0000 11 0.0000 11 0.0000 8
40 einetworks-000 - 154 0.0002 76 0.0005 99 0.0008 71
41 everai-002 - 154 0.0002 79 0.0004 56 0.0004 59
42 everai-paravision-003 0.0705 39 0.0002 72 0.0004 63 0.0004 57
43 f8-001 0.2026 63 0.0035 143 0.0030 145 0.0087 108
44 facesoft-000 0.0000 23 0.0000 35 0.0000 36 0.0000 30
45 glory-000 0.0000 16 0.0053 148 0.0013 130 0.1565 149
46 glory-001 0.0000 11 0.0051 147 0.0010 116 0.1651 150
47 gorilla-002 0.1347 50 0.0003 90 0.0004 88 0.0117 111
48 gorilla-003 0.1347 49 0.0003 89 0.0004 86 0.0043 96
49 hik-001 - 154 0.0000 29 0.0000 28 0.0000 24
50 hr-001 0.1198 48 0.0001 50 0.0004 65 0.0003 49
51 hr-002 - 154 0.0002 75 0.0004 82 0.0004 52
52 id3-003 0.3032 73 0.0016 135 0.0011 126 0.0317 128
53 id3-004 - 154 0.0015 133 0.0011 125 - 154
54 idemia-004 - 154 0.0000 41 0.0004 59 0.0003 50
55 idemia-005 - 154 0.0000 38 0.0003 48 0.0003 45
56 iit-000 - 154 0.0007 110 0.0011 120 0.0836 142
57 iit-001 0.0843 42 0.0001 71 0.0004 78 0.0104 109
58 imagus-000 0.1107 46 0.0010 124 0.0012 128 0.0347 131
59 imperial-000 - 154 0.0000 16 0.0000 17 0.0000 14
60 imperial-002 - 154 0.0000 6 0.0000 6 0.0000 4
Table 9: FTE is the proportion of failed template generation attempts. Failures can occur because the software throws an exception,
or because the software electively refuses to process the input image. This would typically occur if a face is not detected. FTE is
measured as the number of function calls that give EITHER a non-zero error code OR that give a “small” template. This is defined as
one whose size is less than 0.3 times the median template size for that algorithm. This second rule is needed because some algorithms
incorrectly fail to return a non-zero error code when template generation fails.
1
The effects of FTE are included in the accuracy results of this report by regarding any template comparison involving a failed template
to produce a low similarity score. Thus higher FTE results in higher FNMR and lower FMR.

2019/10/16 12:43:37

61 incode-003 - 154 0.0004 102 0.0007 110 0.0014 83
62 incode-004 0.2202 64 0.0004 101 0.0007 109 0.0014 82
63 innovatrics-004 0.1170 47 0.0000 47 0.0004 79 0.0041 95
64 innovatrics-006 - 154 0.0000 43 0.0004 55 0.0003 51
65 intellicloudai-001 - 154 0.0000 34 0.0000 35 0.0001 38
66 intellifusion-001 - 154 0.0001 55 0.0003 51 0.0005 63
67 intellivision-001 0.5495 84 0.0048 146 0.0042 150 0.1358 146
68 intellivision-002 - 154 0.0012 127 0.0005 103 0.0146 116
69 intelresearch-000 - 154 0.0000 45 0.0003 50 0.0001 39
70 intsysmsu-000 - 154 0.0004 96 0.0012 127 0.0031 92
71 iqface-000 0.0000 9 0.0000 26 0.0000 27 0.0000 23
72 isap-001 - 154 0.0000 24 0.0000 25 0.0000 21
73 isityou-000 0.4714 79 0.0023 136 0.0010 118 0.0663 140
74 isystems-001 0.1421 52 0.0010 122 0.0007 111 0.0128 113
75 isystems-002 0.1421 53 0.0010 123 0.0007 112 0.0128 114
76 itmo-005 0.1353 51 0.0005 104 0.0002 38 0.0075 103
77 itmo-006 - 154 0.0004 100 0.0004 76 0.0006 67
78 kakao-001 - 154 0.0002 80 0.0005 92 0.0310 126
79 kakao-002 0.2494 70 0.0002 81 0.0005 96 0.0310 127
80 kedacom-000 0.0000 17 0.0000 13 0.0000 13 0.0000 10
81 kneron-003 0.4883 82 0.0044 145 0.0016 136 0.1823 151
82 lookman-002 - 154 0.0000 23 0.0000 24 0.0000 20
83 lookman-004 0.0000 1 0.0000 20 0.0000 21 0.0000 17
84 megvii-001 0.0274 28 0.0007 113 0.0004 61 0.0152 117
85 megvii-002 0.0274 27 0.0054 149 0.0004 60 0.0126 112
86 meiya-001 - 154 0.0004 103 0.0010 119 0.0025 89
87 microfocus-001 0.0791 41 0.0008 117 0.0016 135 0.0220 123
88 microfocus-002 0.0791 40 0.0008 116 0.0016 134 0.0220 122
89 mt-000 0.1043 44 0.0002 77 0.0004 83 0.0004 54
90 neurotechnology-005 - 154 0.0004 94 0.0004 67 0.0018 85
91 neurotechnology-006 0.1068 45 0.0004 95 0.0004 68 0.0018 86
92 nodeflux-001 - 154 0.0001 63 0.0002 40 0.0003 44
93 nodeflux-002 - 154 0.0008 115 0.0005 98 0.0008 75
94 notiontag-000 0.0000 21 0.0000 17 0.0000 18 0.0000 15
95 ntechlab-006 - 154 0.0000 37 0.0004 53 0.0003 43
96 ntechlab-007 0.0682 38 0.0001 52 0.0004 57 0.0005 62
97 pixelall-002 0.0001 24 0.0000 10 0.0000 10 0.0001 35
98 psl-002 - 154 0.0000 12 0.0000 12 0.0000 9
99 psl-003 - 154 0.0000 46 0.0004 75 0.0003 48
100 rankone-006 - 154 0.0000 32 0.0000 33 0.0000 27
101 rankone-007 0.3518 77 0.0003 85 0.0004 84 0.0043 97
102 realnetworks-002 - 154 0.0004 93 0.0003 45 0.0004 56
103 realnetworks-003 0.0076 25 0.0004 92 0.0003 44 0.0004 58
104 remarkai-000 - 154 0.0000 2 0.0000 2 0.0000 33
105 remarkai-001 - 154 0.0000 19 0.0000 20 0.0000 34
106 rokid-000 - 154 0.0001 60 0.0005 97 0.0354 132
107 saffe-001 0.0000 20 0.0000 15 0.0000 16 0.0000 13
108 saffe-002 - 154 0.0000 31 0.0000 32 0.0000 26
109 sensetime-001 0.0631 37 0.0000 40 0.0004 70 0.0003 46
110 sensetime-002 0.3345 76 0.0011 126 0.0005 102 0.0218 121
111 sertis-000 - 154 0.0000 49 0.0004 64 0.0004 55
112 shaman-000 0.0000 5 0.0000 22 0.0000 23 0.0000 19
113 shaman-001 0.0000 2 0.0000 1 0.0000 1 0.0000 31
114 shu-001 0.1822 59 0.0010 121 0.0006 104 0.0499 135
115 siat-002 0.0616 34 0.0000 44 0.0004 73 0.0048 99
116 siat-004 - 154 0.0000 42 0.0004 72 0.0003 47
117 sjtu-001 - 154 0.0005 105 0.0004 85 0.0008 73
118 smilart-002 0.2422 67 0.0003 88 0.0011 122 0.0575 138
119 smilart-003 - 154 0.0014 131 0.0013 131 0.0555 137
120 starhybrid-001 0.2340 66 0.0009 120 0.0023 141 0.0044 98
1

2019/10/16 12:43:37

121 synesis-004 - 154 0.0164 153 0.0035 147 0.0485 134
122 synesis-005 0.1862 60 0.0001 59 0.0005 90 0.0021 87
123 tech5-002 - 154 0.0001 57 0.0003 41 0.0000 32
124 tech5-003 - 154 0.0001 56 0.0003 42 0.0002 40
125 tevian-004 - 154 0.0002 74 0.0005 100 0.0057 100
126 tevian-005 - 154 0.0006 109 0.0006 108 0.0012 81
127 tiger-002 0.0619 35 0.0001 66 0.0004 69 0.0082 107
128 tiger-003 0.0619 36 0.0001 64 0.0004 66 0.0082 106
129 tongyi-005 0.0000 7 0.0000 5 0.0000 5 0.0000 3
130 toshiba-002 0.0000 13 0.0000 9 0.0000 9 0.0000 7
131 toshiba-003 - 154 0.0001 67 0.0001 37 0.0002 42
132 trueface-000 - 154 0.0000 33 0.0000 34 0.0000 28
133 ulsee-001 - 154 0.0000 30 0.0000 31 0.0001 36
134 uluface-002 0.0000 22 0.0000 18 0.0000 19 0.0000 16
135 upc-001 0.0450 29 0.0003 82 0.0003 49 0.0011 80
136 vd-001 - 154 0.0004 99 0.0009 114 0.0024 88
137 veridas-001 - 154 0.0001 65 0.0005 93 0.0006 65
138 veridas-002 - 154 0.0001 68 0.0005 95 0.0006 66
139 via-000 0.0000 10 0.0000 27 0.0000 30 0.0001 37
140 videonetics-001 0.4799 80 0.0015 132 0.0010 117 0.0112 110
141 vigilantsolutions-006 - 154 0.0001 54 0.0004 58 0.0005 61
142 vigilantsolutions-007 0.2538 71 0.0001 53 0.0004 54 0.0005 60
143 vion-000 0.6388 86 0.0130 152 0.0078 152 0.1389 147
144 visionbox-000 - 154 0.0005 108 0.0011 124 0.0028 91
145 visionbox-001 - 154 0.0005 107 0.0011 123 0.0028 90
146 visionlabs-006 - 154 0.0003 87 0.0005 94 0.0009 78
147 visionlabs-007 0.1939 62 0.0003 86 0.0005 91 0.0008 74
148 vocord-006 - 154 0.0003 84 0.0003 47 0.0008 72
149 vocord-007 0.0000 15 0.0001 70 0.0004 52 0.0009 77
150 winsense-000 0.0000 12 0.0000 8 0.0000 8 0.0000 6
151 x-laboratory-000 - 154 0.0005 106 0.0002 39 0.0000 29
152 yisheng-004 0.4279 78 0.0013 128 0.0006 106 0.0321 129
153 yitu-003 - 154 0.0009 119 0.0000 3 0.0000 1
1

2019/10/16 12:43:37
3.4 Recognition accuracy
Core algorithm accuracy is stated via:
. Cooperative subjects
– The summary table of Figure 8;

– The visa image DETs of Figure 26;
– The mugshot DETs of Figure 34;
– The mugshot ageing profiles of Figure 126;
– The human-difficult pairs of Figure 10
. Non-cooperative subjects
– The photojournalism DET of Figure 41

– The child-exploitation DET of Figure 45;
– The child-exploitation CMC of Figure 48.
Figure 102 shows dependence of false match rate on algorithm score threshold. This allows a deployer to set a threshold
to target a particular false match rate appropriate to the security objectives of the application.
Figure 86 likewise shows FMR(T) but for mugshots, and specially four subsets of the population.
Note that in both the mugshot and visa sets false match rates vary with the ethnicity, age, and sex, of the enrollee and
impostor - see section 3.6. For example figure 57 summarizes FMR for impostors paired from four groups black females,
black males, white females, white males.

2019/10/16 12:43:37
2019/10/16 12:43:37
template_failed ● FALSE TRUE perfectseparation ● FALSE ● TRUE
3divi_003 3divi_004 adera_001 alchera_000 alchera_001

●
3.5 ●● ●
● ● 0.8 ● ● ● ●
3.2 ●● ● ● ● ● ●●
● ●
● ●●●● 0.8 ● ● ●
● ● ● ● ●●● ● ● ● ●
●
●
● ●
● ● ● ●
●● ● 0.6 ●●
3.0 ● ● ●
2.8 ● 0.7
0.7 ●
● ●
● ●● ● ●
● ●
●
● ● ●
● ●
0.4 ●
● ● ● 0.6 ●
2.4 2.5 ● ● 0.6 ● ●
● ● ●
●● ●
●
● ●
0.2 0.5
●
2.0 ●● ● ● 0.5 ● ●
2.0
allgovision_000 alphaface_001 amplifiedgroup_001 anke_003 anke_004

● ● 0.8 ● ● ● ● ● ●
●●
● ● ● ● ●●
0.6 ● ●● ●
●
●● ●● ●
FRVT
● ● ● ● ●● ●
● ● ● ● 3.50 0.6
●● ● 0.6 ● ●●
0.6 ● ●
● ● ●
● ● ●
0.4 ● ●
● ● ● 0.4
3.25
-
0.4 ●
●
0.4 ●
● ● ● ●

● ● ● ● ●
● ● ● ●●
0.2 ●
● 0.2
● ● 0.2 3.00 ● 0.2 ●● ● ●
● ● ●
● ● ●
● ●
●
●
0.0 ● ● ● ● 0.0 ● ●
0.0
anyvision_002 anyvision_004 aware_003 aware_004 awiros_001

Native Similarity Score
6 8
● ● ● ● ●
● ●
0.80 ●
● ● ● ● ●
●
●
●● ● ●●
1.6 ● ●
● ● ● ●● 6
● 1.5 ●
● ● ● ● 0.79 ● ●
4 ● ● ● ●●
● ●
● ● ●●
● ●
1.4 ● ● ● ● ● 0.78 ●
● ● ● ●● 4 ● ●
1.3 ● ●
● ● ●
● ● ●
● ●● 0.77 ●
● 2 ●
1.2 ●● ●
2 ●●
● ●● ● ●● 0.76 ●
1.1 ●
● ● ●
● ●
● ●●
● ● ● 0.75 ●
0
ayonix_000 bm_001 camvi_002 camvi_004 ceiec_001

● ● 0.5 ● ● ● ● ●● ●
● ● ● ●
● 0.6 ● ●●
● ●
● 0.6 ● 0.5 ●
0.75 0.4 ● ● ● ●●● ●
●● ● ● ● ●●
●
● ● ●● ● ● ● ● ● ●
●
● ● ●
-
● ● 0.3 ● ● ●
● 0.4
VERIFICATION
0.4 0.0
0.50 ●
● 0.2 ●
●● ● ● ●
● ● ● ●● 0.2 ●
● ●
0.25 ● ● 0.1 0.2 ● −0.5
● ● ● ●
● ●
●
● ● ●● ●
● 0.0 ● ●
0.0
0.00 ● ● 0.0 ● ● −1.0 ●● ●
G I
ceiec_002 chtface_001 cogent_003 cogent_004
● ● ● ●
0.6 ● ● 4000
● ●
●● ● ●
● ● ●● ●●
0.6 ● ● ● ●● 3300 ● ● ●●● ●
● ●
●● ● ●
● ● ● ●
● ●
● ●●
● 3500 ●
0.4 ●
0.4 ● 3000 ●
FNMR(T)
● ●
● ● 3000
●
FMR(T)
● ● ●
● ●
0.2 ●●
0.2 ●
● 2700 ●
● ●
● 2500 ●
● ●
●
● 0.0 ●
0.0 ● ● ●● ● ●
2400
G I G I G I G I
Genuine Impostor
Figure 4: The Figure shows, in blue, algorithms that correctly separate the 12 genuine and 8 impostor pairs used in the May 2018 paper Face recognition accuracy of
forensic examiners, superrecognizers, and face recognition algorithms (Phillips et al. [1]). In red are algorithms that are imperfect. Some algorithms fail only because
they failed to make a template e.g. due to face detection failure (shown as a triangle). Others fail because the pairs were selected for that study because they had been
difficult for three leading algorithms used in FRVT 2006. Caution: Given the small sample size (n=20) the figure may change substantially if larger or different sets were
used. The images can be downloaded from the Supplemental Information page provided with that publication.
38
2019/10/16 12:43:37
cognitec_000 cognitec_001 ctbcbank_000 cyberextruder_001 cyberextruder_002

● ●
0.8
● ● ● ● ●
● ●
●● ● ● ● ● ● ● 0.6
● ● ● ● ●● ● ●
● ● ●
0.7 0.7 ●●
●●
●● 3.9 ● ● ●
●
●
● ● ● ● ● ●
●●
● ● ● 0.6 ● ● ●
● ● ● ● ●
0.6 0.4 ●
0.6 3.6 ● ● ●
● ● ●
● ● ● ●
● ● ● ● ●●
0.5 ●
0.4
0.5 ● 3.3 ● ●
●● ●● 0.2 ● ●
● ● ●
●●
0.4 ● ● 0.4 ●● ● ● ●
3.0 0.2
cyberlink_002 cyberlink_003 dahua_002 dahua_003 deepglint_001

1.7 10000 10000 1.8
●● ●● ● ●● ●● ●● ●● ●
● ●● ●
●
● ● ●● ● ● ●
●● ● ●
● ●● ● ●●
FRVT
● ● ● ●●●●
● ● ● ● ●
1.5 1.50 1.6 ● ●
8000 8000 ● ● ●
● ●
●
● ●
● ● ●
1.3 ●
-
● ● 1.4
1.25 6000 ● 6000

● ● ●
● ● ● ●
● ● ● ●
1.1 ● ● ●
● ●
● 4000 ● 1.2
1.00 4000 ● ●
●
0.9 ● ● ● ●● ● ● ●●
deepsea_001 dermalog_005 dermalog_006 digitalbarriers_002 dsk_000

1.7 ● ● ●● ● ● ● ●
●
● ●● ●●●● ●● ● ●
● 80 ● ●●● 1.0 ●●
● ●● ● ● ● ●●●
● ● ●●
● ●
● ● 75 0.6 ● ● ●●● ● ●●
1.5 ●●
● ●●
●● ●● ●
● ● 0.5
●● ● 60
● 0.4 ● ●
●
1.3 50 ● ●
● 0.0
● ●
●
●● ● ●
● ●
●
40 0.2
1.1 ● −0.5
25 ●●
● ● ●
●● ●
●●● ● ● ●
0.0 −1.0
20
einetworks_000 everai_002 everai_paravision_003 f8_001 facesoft_000

●● 3.5 ● 3.5 ●
●
● ●
70 ●
●
● ●● ●
●● ●●
● 0.6 ● ●
●
● ● ●● ●● ● ●● ● ● 1.6
●● ● ●● ●●
● ●●
● ●● ● ●●
● ● ●
-
60 3.0 3.0 ● ●
●
VERIFICATION
● ●●
0.4
● 1.4
50 ●
●● 2.5 ●
● 2.5 ● ●
● 0.2 ● ●●
● ●
● ● ● 1.2 ●
●
40 ●● ●● ● ●
●
● ● ● ● ● ●
● 2.0 ● ● ● ●
● ● ●
0.0
G I
glory_000 glory_001 gorilla_002 gorilla_003
● ● ● 0.8 ●
● ●
●
●
0.6 ● ● ● ●
● ● ● ●● ●
●
0.60 ● ● ●● ●● 0.6 ● ●
0.60 ●●
● ●
● ●
● ● ● ● ● 0.4 ●
● ●
FNMR(T)
● ● ● ●
● ●● 0.4
0.55 ●
●
FMR(T)
0.55 ●
● ●● ● ●
● ● 0.2 0.2 ●
● ●●●
● ●● ●
● ●
0.50 ●
● ●●
●
0.50 ● ●● ● 0.0 ●
0.0
G I G I G I G I
Genuine Impostor
39
2019/10/16 12:43:37
hik_001 hr_001 hr_002 id3_003 id3_004

1.0 40000
● ● 1.00 ●●
● ● ●●
80 ● ● ● ● ● ●
● ● ● ●
●●● ● ●
●● ● ●● ● ●
● ● ● ●
●●●● 0.9 ● ● ● 38000 ●●● ●
● ●● ●
● ●●
● 0.75 38000 ● ●
● ●
70 0.8 ● ● ●
●
36000 ● ●
● ●● 0.7 ●
0.50 ● ●
● ● ● 36000 ●●
60 ●
0.6 ● ● ●
0.25 ● 34000 ●
●
●
● ● ● 34000
0.5 ● ●
50 ●● ●
● ● ● ● ●● ● ● ●
0.00 32000
idemia_004 idemia_005 iit_000 iit_001 imagus_000

● ● ● ● ● ●
● ● 1.2
6000 0.8 ● ● ●
●
●
●●●●
FRVT
● ● ● 0.8 ●
6000 ● ●● ● ● ● ●
●●● ● ●● ●
● ● ● 1.0
● 5000 ● ●●
● ●
● ● ● ● ● ●
●
● ●● ● 0.7 0.7
● ● ●
-
● 4000 ● ● 0.8 ●
4000
● ●

●
●
● ● 3000 ●● ● ●●
● ● 0.6 ●
● ●
0.6 ●
●
0.6 ●
● ● ●
● ● ●
2000 ● 2000 ●
●
● ●
● ● ● ● 0.4 ●
imperial_000 imperial_002 incode_003 incode_004 innovatrics_004

● ● ● 1.8 ● ●
● 1.7 ● ●
● ●
1.6 ● ● ● ●
● ●● ●● ●
● ● ●● ● 60
1.6 ●
● 1.6 ●● ●
● ● ●● ● 1.5 ● ● ● ●
● ●
● ●
● ●
● ●● ● ●●
1.4 1.4 ●
● 1.4 ● 40
● ● ● ●
1.3 ●
● ●
● ●●
●
●● 1.2 ●
● ● ● ●
1.2 1.2 ● ● ● ● 20 ●
● 1.1 ● ●
●
● ●
● ●● 1.0 ● ●
● ● ●
● ●
●
● ● ● ● ● ●
0.9 0
innovatrics_006 intellicloudai_001 intellifusion_001 intellivision_001 intellivision_002

80 ● ● ● ● ●
● ● 50
● ●
● ●
● ● ● 50 ●
● ●● ● ● ● ● ● ●
● ● 0.8 ● ● ● ● ● ● ●
● ● ●●
60 ● ● 40 ●
0.4 ● 40 ●
-
● ●
●● ●
● ● ●
VERIFICATION
● ● ● ●
0.7 ● ● 30 ● ● 30 ●
40 ●● ●
● ●
0.2 ● ● ● 20 ●
20 ● ● ●
●
0.6 ● ● ● ● ●
20 ●● ● ● ●● ●
●● ● 10 10 ●
● ●
● 0.0 ●
●● 0.5 ● ● ● ●
0
G I
intelresearch_000 intsysmsu_000 iqface_000 isap_001
● ● ● ● ●
1.0 ●● ●● ●● ●
● ● ●● ● ● ●
● ● ● ● ● ●
● ● ●
650 ● ● ● ● 1.6 ●
1.5 ● ●● ●
●● ● ● ●
● ●
● ●
0.8 ●
●
●
600 1.4
1.3
FNMR(T)
● ● ●
● ●
●
FMR(T)
● ● ● ● 0.6 ●
●● ●
550 ● 1.2 ●
● ● ●
1.1
● ●
●
●
500 ● ● 0.4
● ● ● 1.0 ● ●
G I G I G I G I
Genuine Impostor
40
2019/10/16 12:43:37
isityou_000 isystems_001 isystems_002 itmo_005 itmo_006

1000 1000
20.0 ● ● ● ● ●
0.8 ● ● ●
●
● 0.8 ●
●
●● ● ● ●● ● ●
17.5 ●● ●
● ● ● ● ●● 750 750 ● ●
●
●
●● 0.7 ● ● ● ● ●
15.0 ● 0.7 ● ● ●
● ●● 500 500 ●
● ● ●
● ● ● ●●
12.5 ● 0.6 ● ● ● ●
● 0.6 ● ● ●
● ● ● 250 ● 250 ●
10.0 ● ● ● ●
● ●
● ● ● ●
0.5 ●
● ● ● 0 ●●● ●●
● ●● 0 ●●●●
● ●
7.5 0.5
kakao_001 kakao_002 kedacom_000 kneron_003 lookman_002

● ● ● ● ● 0.8 ●
● ●● ● 0.7 ● ●
●●
● ●●
FRVT
1.3 ● ● ● ●
● ● ●
● ● ●
● ● 0.8 ● ● ●
● 0.6 ● ●
● ● 1.0 ● ●●● ● ●
1.2 ●● ● ● ●●●
●●
● 0.7 ●
● 0.5
● ● ● ●
● ● 0.7 ●
-
1.1 ● ●
● ● ● ●

0.8 0.4 ●
1.0 ● ●● ● ●
0.6 0.6
● ● ●●
●
● 0.3 ●
0.9 ● ●
0.6 ● ●
●● ● ●● ●
● ● ● ●
0.5 0.2
lookman_004 megvii_001 megvii_002 meiya_001 microfocus_001

0.9 ● 0.7
● ● ● ●●
● ● ●
● ●
●●●
●●
● ● ●●
●●
● ● ●
●
● ●
80 ● 80 ●● ● ●● ●
●
● ●● ● ●
● ● ●● 0.6 ● ●
●● ● ●
0.8 ● ● ● ● ●
● ● ● 0.6 ● ●
60 ● 60 ●
●
0.4 ●
● ● ●
0.7 ● ● ●
● ● ● ●
● ● ● ●
●
40 40 0.2 ● 0.5 ●
● ●
● ● ● ●●
● ● ●
0.6 ●
●
● ● ● ● ●
0.0
microfocus_002 mt_000 neurotechnology_005 neurotechnology_006 nodeflux_001

0.55
●● ●
● ● ● ●
● ●●● ● ●● ● ● ●
●
●● ● ●
● ●
0.6 ● ● 75 ● 3000 ● ● ●
● ●● ● ●● 0.50
1.50 ● ● ●
● ● ●
-
● ●
VERIFICATION
● ● ● 50 ● 0.45 ●
●
● 2000 ●
0.5 ●
● ●● 1.25 ● ●● ● ● ●
● ●
● ● 0.40 ●
● ●
● ● ● ● 25 ● ●
● ● ●
● ● 1000 ●
0.4 ● 1.00 ●● ●● ● 0.35 ● ●
● ●
●
● ● 0 ●
● ● ● ●
G I
nodeflux_002 notiontag_000 ntechlab_006 ntechlab_007
0.6 ●● ● ● 2.00 ●
● ● ●
8 ● ● ●●
●● ● ● ● ● ●
● ● ● ●●●● ●●
● ● 2.2 ● ●●
● ● ● 1.75 ●
● ●
● ● 6 ● ●
0.5 ● ● ● ●
●
● ●
● 2.0 1.50
FNMR(T)
● 4
FMR(T)
●
● ● ● ●●
0.4 ● 1.25 ●
2 1.8
● ●
●
● ●
● ● ●
● 0 ● 1.6 ● 1.00 ● ●
G I G I G I G I
Genuine Impostor
41
2019/10/16 12:43:37
perfectseparation ● FALSE ● TRUE template_failed ● FALSE
pixelall_002 psl_002 psl_003 rankone_006 rankone_007

● ● ● ● 1.00 ● ●● ●
● 1.0 ●
● 0.6 ● ●
● ● ● ●● ●
●● ● ● 0.8 ●
0.6 ● ● ●●● ● ●●●
●● ● ●● ●●
●●
● 0.8
● ● ●● ● 0.75
●
●
● 0.4 ●●
0.7 ●●
0.4
● ● 0.50 0.6 ●
● ● ● ●
● ● ●
● ● ●● ●
0.2 0.6 ● ● ● ●
0.2 ● ● ● ● ● 0.4
● ●●
0.25
● ● ●
● ● ●
●
● ● ●
0.0 ● 0.0 ● 0.5 ● 0.00 ● 0.2 ●
realnetworks_002 realnetworks_003 remarkai_000 remarkai_001 rokid_000

● ● ● ● ●
● ● ● ● ●
1.2 ● ● 1.2 ● ● ● ●
● ● ●
FRVT
● 80 ● ● 80 ●● ●●
●● 0.8 ●
● ● ●● ● ● ●● ● ● ●● ●
● ● ● ●
●
●● ● ● ● ●
● ●
● ● ●
1.0 1.0 70 70 0.7
● ●
-
● ●
●● ●
●● ● ●

●
● 60 60 0.6 ●
● ● ● ●● ●
0.8 0.8 ● ●
● ● ●
● ●
● ● ●
● ● 0.5
● 50 50
● ● ●● ● ● ●
0.6
saffe_001 saffe_002 sensetime_001 sensetime_002 sertis_000

1.0 1.0
0.6 ● ● ●●● ●●
● ●
● ● ●
●● ●●●
● ●
●●
● ● ●
● ● ● ●
● ● 0.6 ● 0.8 ●● ● ● ●
●
●
●
● ● ●
● ● ●
0.5 ● ● ● 0.8 0.8
● ● ●
● ●
● ●
● 0.4 ● 0.7
● ●
0.4 0.6 0.6 ●
● ● ●
● ●
●
● 0.2 0.6
0.3 ● ● ● ●
●
● ● ●
● 0.4 0.4
● ●● ● ●● ●
● ● ●● ● ●● ●
0.2 ● 0.0 ● ●● ● ● 0.5 ●
shaman_000 shaman_001 shu_001 siat_002 siat_004

1.00 0.050 0.8 1.0
● ● ●● ● ●
●● ●●●●
● ●●●●
●●● ● ●
●● ● ● ● ●
● ●
●●●
●
● ● ●
● ●●●
0.75 ● 0.025 0.6 0.8 0.8
-
● ● ●
●
VERIFICATION
0.50 ● 0.000 ●●
●●●
●● ●●●● ● ●● ●
●●●● 0.4 ● ●
● 0.6 0.6
●
● ●
0.25 ● 0.2 ●
−0.025
● 0.4 ●●
0.4 ●
● ●
●
● ● ● ● ● ● ● ●●● ● ● ●
●●
●
0.00 0.0
−0.050
G I
sjtu_001 smilart_002 smilart_003 starhybrid_001
1.6 ● 0.6 ● ●● ●
●●● ● ● ●
● ●●
● ● ● 0.6 ●● ● ●
● ●
● ● ●
1.4 ● 0.5 ●
● ●● ● 0.4 ●
●
● ●
●● ●
● ●●
0.4 ● ● 0.4 ●
● ●
FNMR(T)
1.2 ● ● ●
● ● ●
●
FMR(T)
● ● ● ●
0.3 ● ●
0.2
● 0.2 ●
1.0 ●
● ●
0.2 ● ●
● ●
●
0.8 ● ● ●
● ● ● 0.0 ● ●
0.1 0.0
G I G I G I G I
Genuine Impostor
42
2019/10/16 12:43:37
synesis_004 synesis_005 tech5_002 tech5_003 tevian_004

1.00
● ● ● ● ●● 149 ● 1.00 ●● ● ●●
●● ●
●
● ●
●● ●
● ● 149 ● ● ●●
0.6 ● ● ● ● ● ●
0.75 ●● ● ● ● ● ●
●●
●● ● ●● ● 148 ●
● ●● 0.75 ●
● ●
● 148 ●
● 0.4
0.50 147
● ● ● ●●
0.50
● 147 ●● ●
0.2 ● ● ●
0.25 ● 146 ● ●
●● ●
● ● 0.25
● ● 146 ● ●● ●
0.0 ●
0.00 ●● ● ●
●● ●
● ● ● 145 ● ●
tevian_005 tiger_002 tiger_003 tongyi_005 toshiba_002

1.0 ●
●●●●
●●●
● ●●● ● ● ●●
● ● ● ●
● ● ●
● ● ●●● ● ● ●●● ●
150 ●● ● ● ● ● ● ●● ●
FRVT
● ●● ● 150 ● ● 0.8 ●
●
44.0 ●● ● ●
● ●
0.8 ● ● ●● ● ● ● ● ●
● ● ● ●
●● ●
●
● 100 0.7
100 43.5
●●
-
0.6 ●
● ●

● ● ● ●
●
0.6 ●
50 50 43.0
●
0.4 ● ● ●
●
0.5
●● ● ● 42.5 ● ●
0 0
toshiba_003 trueface_000 ulsee_001 uluface_002 upc_001

● 0.6 ●● ● 1.0 ●● ●●● ●

●●●
● ●
●
● ●● ● ● ●
0.8 ●● ●●
●● ● ● ●●● ●
●
● ●
● ●
● 0.75 ● ● 0.6 ●
●● ●
● ● ●
0.8
0.4 ●
0.7 ● ● ● ● ●
●
0.50 ●●
● ● ●
● 0.4 ●
● ●
● ●
0.6 ●
0.6 ● ●
● 0.2 ●
0.25 ●
● ● ● ●
● ● ● ●
● ● 0.4 ●
● 0.2
●
0.5 ●
● 0.0 ● 0.00 ● ●
●●●● ●● ● ●
vcog_002 vd_001 veridas_001 veridas_002 via_000

● ● ● ● ● 3.25 ●
80 ● ● ●●
● ●●● ●●
●
● ●
● ● ● ●
0.3 ● ● ●
● ● ● ● 3.00 ●
●● ● ● ●
3 ●●
● 3
-
● ●
● 70 ● ● ● ●
● 2.75 ●
VERIFICATION
● ● ● ●
0.2 ● ●
● ● ● ●
● ●●
● ● 2.50 ●●
● ●
60 ● ● ● 2 ● ● ●●
● ●
0.1 ● 2 ●
● ● ● 2.25
● ● ●
● ● ● ● ●
●
● ● ● 50 ● ●● 1 ● ●
0.0 2.00
G I
videonetics_001 vigilantsolutions_006 vigilantsolutions_007 vion_000
● ● ● ● 0.7 ●
● ● ●●
● ● ●
●
●
●
● ● 0.6
0.6 ●●
●● ●
● ● 3.0 ● ● ●
● ●
● ● ● ● ●
3.0
0.5 ●
● ● ●
●
FNMR(T)
● ● ●
0.4 ● ● 0.4
●●
FMR(T)
● ● ● ●
● ● ●
2.5 ●
● 2.5 ● 0.3
0.2 ● ●
● ●
● ● ● 0.2 ●
G I G I G I G I
Genuine Impostor
43
2019/10/16 12:43:37
perfectseparation ● FALSE ● TRUE template_failed ● FALSE
visionbox_000 visionbox_001 visionlabs_006

● ● 1.00 ●●● ● ● ● ●
●● ●
● ●
● ●
● ●
0.6 ● 0.6 ● ● ●
●● ●
● ● ●
● ●
● ●
● 0.75
●
●
●
0.4 0.4
●
0.50
● ●
●
●
● ●
0.2 0.2 ● ●
0.25 ●
FRVT
●
● ●
● ●
● ● ●
● ●
●
-
0.0 ● 0.0 ● ●
0.00

visionlabs_007 winsense_000 x−laboratory_000
1.00 ●● ● ● ●● ●
●● ●
● ● ●
●
●
●
● ●
● ●● ●
● ●
0.6 ● 0.6
●
●
0.75 ● ●
●
0.4
0.4
0.50 ●
●
●
●
● 0.2
0.2 ● ●
●
0.25 ●
● ●
● ●
● ●
● 0.0
●● ● ●
●●
● ● 0.0 ● ●
●●●
0.00
G I
yisheng_004 yitu_003
-
VERIFICATION
● ●
● ●●
38.5 ●
● ● ● ●
● ● ●
● ●
5.50 ●
●
●
●
38.0
●
●
●
5.25
● ●
●
●
● ● ●
● ●
37.5
● ●●
FNMR(T)
5.00 ●
FMR(T)
●
●
● 37.0 ● ●
4.75
G I G I
Genuine Impostor
44
2019/10/16 12:43:37
0.010
0.003
FRVT
-
Dataset: VISA
False non−match rate (FNMR)

Tier: 1
FNMR @ FMR=1e−05
and Algorithm
0.0035 hr_002
0.001 0.0034 tech5_003
0.0034 tevian_005
0.0033 deepglint_001
0.0030 visionlabs_007
0.0027 tech5_002
0.0027 vocord_007
0.0026 everai_paravision_003
0.0012 yitu_003
-
VERIFICATION
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

False match rate (FMR)
Figure 11: For the visa images, detection error tradeoff (DET) characteristics showing false non-match rate vs. false match rate plotted parametrically on threshold, T.
The scales are logarithmic in order to show many decades of FMR.
45
2019/10/16 12:43:37
0.010
0.003
FRVT
-
Dataset: VISA

Tier: 2
FNMR @ FMR=1e−05
and Algorithm
0.0051 sensetime_001
0.0050 imperial_000
0.0050 vocord_006
0.001
0.0049 kedacom_000
0.0048 imperial_002
0.0047 innovatrics_006
0.0042 dahua_003
0.0040 sjtu_001
0.0039 ntechlab_007
0.0036 hr_001
-
VERIFICATION
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

46
1.000
2019/10/16 12:43:37
0.300
0.100
FRVT
0.030
-
Dataset: VISA

Tier: 3
FNMR @ FMR=1e−05
and Algorithm
0.0062 uluface_002
0.010
0.0061 facesoft_000
0.0059 tongyi_005
0.0056 ntechlab_006
0.0054 cogent_004
0.0054 psl_003
0.0054 siat_004
0.003 0.0051 alphaface_001
0.0051 intellifusion_001
0.001
-
VERIFICATION
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

47
2019/10/16 12:43:37
0.030
0.010
FRVT
0.003
-
Dataset: VISA

Tier: 4
FNMR @ FMR=1e−05
and Algorithm
0.0077 megvii_002
0.0075 rokid_000
0.0074 iqface_000
0.0073 neurotechnology_006
0.0067 anke_004
0.001 0.0067 hik_001
0.0067 siat_002
0.0066 incode_004
0.0064 lookman_004
0.0063 x−laboratory_000
-
VERIFICATION
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

48
2019/10/16 12:43:37
0.030
0.010
FRVT
-
0.003 Dataset: VISA

Tier: 5
FNMR @ FMR=1e−05
and Algorithm
0.0088 psl_002
0.0085 iit_001
0.0083 starhybrid_001
0.0083 cognitec_000
0.0083 everai_002
0.0082 mt_000
0.001 0.0082 3divi_004
0.0080 shu_001
0.0078 cogent_003
0.0078 einetworks_000
-
VERIFICATION
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

49
2019/10/16 12:43:37
0.030
0.010
FRVT
-
Dataset: VISA
0.003

Tier: 6
FNMR @ FMR=1e−05
and Algorithm
0.0105 anke_003
0.0104 toshiba_002
0.0102 isystems_002
0.0099 camvi_002
0.0096 sertis_000
0.0096 toshiba_003
0.001 0.0095 saffe_002
0.0094 cyberlink_003
0.0089 cognitec_001
-
VERIFICATION
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

50
2019/10/16 12:43:37
0.030
0.010
FRVT
-
Dataset: VISA

Tier: 7
0.003 FNMR @ FMR=1e−05
and Algorithm
0.0120 megvii_001
0.0120 remarkai_000
0.0117 remarkai_001
0.0117 dahua_002
0.0113 intsysmsu_000
0.0111 winsense_000
0.0109 intellicloudai_001
0.001 0.0108 incode_003
0.0106 idemia_005
0.0106 itmo_006
-
VERIFICATION
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

51
0.100
2019/10/16 12:43:37
0.030
0.010
FRVT
-
Dataset: VISA

Tier: 8
FNMR @ FMR=1e−05
0.003 and Algorithm
0.0138 alchera_000
0.0129 visionbox_001
0.0128 idemia_004
0.0126 gorilla_003
0.0124 ulsee_001
0.0124 ctbcbank_000
0.0123 synesis_005
0.0122 isystems_001
0.001 0.0121 deepsea_001
-
VERIFICATION
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

52
0.100
2019/10/16 12:43:37
0.030
0.010
FRVT
-
Dataset: VISA

Tier: 9
FNMR @ FMR=1e−05
0.003 and Algorithm
0.0153 pixelall_002
0.0153 tevian_004
0.0149 ceiec_002
0.0149 vigilantsolutions_007
0.0147 nodeflux_002
0.0144 itmo_005
0.0143 alchera_001
0.001 0.0141 meiya_001
0.0140 camvi_004
-
VERIFICATION
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

53
2019/10/16 12:43:37 1.000
0.300
0.100
FRVT
0.030
-
Dataset: VISA

Tier: 10
FNMR @ FMR=1e−05
and Algorithm
0.010 0.0206 trueface_000
0.0205 anyvision_004
0.0196 rankone_006
0.0195 gorilla_002
0.0195 realnetworks_003
0.0188 vd_001
0.003 0.0175 via_000
0.0164 rankone_007
0.0160 id3_004
0.001
-
VERIFICATION
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

54
2019/10/16 12:43:37
0.100
0.030
0.010
FRVT
-
Dataset: VISA

Tier: 11
FNMR @ FMR=1e−05
and Algorithm
0.0264 synesis_004
0.003 0.0260 tiger_003
0.0255 ceiec_001
0.0243 3divi_003
0.0243 intelresearch_000
0.0238 lookman_002
0.0231 dermalog_006
0.0226 f8_001
0.001 0.0212 upc_001
-
VERIFICATION
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

55
2019/10/16 12:43:37
0.300
0.100
FRVT
0.030
-
Dataset: VISA

Tier: 12
FNMR @ FMR=1e−05
and Algorithm
0.0623 aware_003
0.010 0.0557 imagus_000
0.0532 aware_004
0.0509 kakao_002
0.0468 tiger_002
0.0459 kneron_003
0.0380 vion_000
0.0306 id3_003
0.0302 allgovision_000
0.003
-
VERIFICATION
0.001
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

56
2019/10/16 12:43:37
0.300
0.100
0.030
FRVT
-
Dataset: VISA

Tier: 13
0.010 FNMR @ FMR=1e−05
and Algorithm
0.1195 veridas_002
0.1188 iit_000
0.1145 dermalog_005
0.1130 intellivision_001
0.0866 adera_001
0.003 0.0843 glory_000
0.0707 glory_001
0.0659 cyberextruder_002
0.001
-
VERIFICATION
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

57
2019/10/16 12:43:37
0.300
0.100
FRVT
-
0.030 Dataset: VISA

Tier: 14
FNMR @ FMR=1e−05
and Algorithm
0.3167 microfocus_002
0.3042 str_000
0.2964 shaman_001
0.2180 digitalbarriers_002
0.1963 smilart_002
0.010
0.1682 umd_000
0.1567 yisheng_004
0.1566 veridas_001
0.1338 dsk_000
0.003
-
VERIFICATION
0.001
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

58
1.000
2019/10/16 12:43:37
0.300
0.100
FRVT
-
Dataset: VISA

Tier: 15
FNMR @ FMR=1e−05
and Algorithm
0.6006 notiontag_000
0.030
0.5410 isityou_000
0.4903 videonetics_001
0.4615 isap_001
0.4477 amplifiedgroup_001
0.3803 saffe_001
0.3738 kakao_001
0.3692 awiros_001
0.010 0.3583 ayonix_000
-
VERIFICATION
0.003
FNMR(T)
0.001
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

59
1.000
2019/10/16 12:43:37
0.300
0.100
FRVT
0.030
-

Dataset: VISA
Tier: 16
FNMR @ FMR=1e−05
0.010 and Algorithm
1.0000 nodeflux_001
0.9994 chtface_001
0.9543 shaman_000
0.7605 bm_001
0.7217 vcog_002
0.7147 smilart_003
0.003
0.001
-
VERIFICATION
FNMR(T)
FMR(T)
1e−07 1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

60
2019/10/16 12:43:37
0.020
0.010 Dataset: MUGSHOT

Tier: 1
FRVT
FNMR @ FMR=1e−05
0.009 and Algorithm
-
0.0073 rokid_000

0.0073 anke_004
0.008 0.0071 uluface_002

0.0066 yitu_003
0.0064 facesoft_000
0.007 0.0063 everai_002
0.0061 vocord_007
0.0057 tevian_005
0.006 0.0056 intellifusion_001
0.0056 dahua_003
0.0055 imperial_002
0.0055 psl_003
0.0054 hr_002
0.005
0.0047 deepglint_001
0.0042 camvi_004
0.0039 alphaface_001
0.004
-
VERIFICATION
0.003
FNMR(T)
FMR(T)
0.002
3e−06 1e−05 3e−05 1e−04 3e−04 1e−03 3e−03 1e−02 3e−02 1e−01 3e−01
Figure 27: For the mugshot images, detection error tradeoff (DET) characteristics showing false non-match rate vs. false match rate plotted parametrically on threshold,
T. The scales are logarithmic in order to show decades of FMR.
61
2019/10/16 12:43:37
0.020

Tier: 2
FRVT
FNMR @ FMR=1e−05
0.009 and Algorithm
-
0.0097 toshiba_002

0.0097 cogent_003
0.008 0.0097 3divi_004

0.0096 incode_004
0.0096 cogent_004
0.007 0.0094 anke_003
0.0093 hik_001
0.0089 camvi_002
0.006 0.0089 psl_002
0.0088 einetworks_000
0.0085 toshiba_003
0.0082 vocord_006
0.0081 starhybrid_001
0.005
0.0080 imperial_000
0.0080 sertis_000
0.0075 iqface_000
0.0074 mt_000
0.0073 ntechlab_007
0.004
-
0.0073 hr_001
VERIFICATION
0.003
FNMR(T)
FMR(T)
0.002
3e−06 1e−05 3e−05 1e−04 3e−04 1e−03 3e−03 1e−02 3e−02 1e−01 3e−01
62
2019/10/16 12:43:37
0.020
Dataset: MUGSHOT
0.010 Tier: 3
FRVT
FNMR @ FMR=1e−05
and Algorithm
0.009
-
0.0117 cognitec_000

0.0116 dahua_002
0.008 0.0113 tech5_002

0.0113 rankone_007
0.0113 ulsee_001
0.0112 ntechlab_006
0.007
0.0112 intsysmsu_000
0.0111 kedacom_000
0.006 0.0111 isystems_002
0.0109 siat_002
0.0107 saffe_002
0.005 0.0102 remarkai_001
0.0102 remarkai_000
0.0099 iit_001
0.0099 tech5_003
-
0.004 0.0098 cyberlink_003
VERIFICATION
0.003
FNMR(T)
FMR(T)
0.002
3e−06 1e−05 3e−05 1e−04 3e−04 1e−03 3e−03 1e−02 3e−02 1e−01 3e−01
63
2019/10/16 12:43:37
0.020
Dataset: MUGSHOT
Tier: 4
FRVT
FNMR @ FMR=1e−05
and Algorithm
0.010
-
0.0152 siat_004

0.009 0.0149 itmo_006

0.0146 ctbcbank_000
0.008 0.0142 deepsea_001
0.0142 alchera_001
0.0138 isystems_001
0.007 0.0136 vigilantsolutions_007
0.0127 pixelall_002
0.006 0.0125 winsense_000
0.0125 alchera_000
0.0124 lookman_004
0.005 0.0121 idemia_005
0.0121 ceiec_002
0.0120 cognitec_001
0.0119 trueface_000
-
0.0119 rankone_006
VERIFICATION
0.004
0.003
FNMR(T)
FMR(T)
0.002
3e−06 1e−05 3e−05 1e−04 3e−04 1e−03 3e−03 1e−02 3e−02 1e−01 3e−01
64
2019/10/16 12:43:37
0.060
0.050
0.040
0.030
Dataset: MUGSHOT
0.020 Tier: 5
FRVT
FNMR @ FMR=1e−05
and Algorithm
-
0.0291 id3_003

0.0271 vd_001
0.0261 nodeflux_002
0.0236 id3_004
0.0232 allgovision_000
0.0226 tevian_004
0.0224 megvii_002
0.0211 sjtu_001
0.010 0.0205 gorilla_003
0.0199 idemia_004
0.009
0.0188 tiger_003
0.008
0.0187 tongyi_005
0.0181 itmo_005
0.007 0.0177 via_000
0.0177 f8_001
0.006 0.0171 dermalog_006
0.0159 meiya_001
-
0.0153 synesis_005
VERIFICATION
0.005
0.004
0.003
FNMR(T)
FMR(T)
0.002
3e−06 1e−05 3e−05 1e−04 3e−04 1e−03 3e−03 1e−02 3e−02 1e−01 3e−01
65
2019/10/16 12:43:37
0.100
0.090
0.080
0.070
0.060
0.050

Tier: 6
FRVT
FNMR @ FMR=1e−05
and Algorithm
0.030
-
0.0828 iit_000

0.0791 kakao_002
0.0695 smilart_003
0.020 0.0513 realnetworks_002
0.0497 imagus_000
0.0478 gorilla_002
0.0475 synesis_004
0.0448 incode_003
0.0422 vion_000
0.0392 megvii_001
0.0389 3divi_003
0.0346 kneron_003
0.010
0.009 0.0338 lookman_002
0.008 0.0294 ceiec_001
0.0293 shu_001
-
0.007 0.0291 upc_001
VERIFICATION
0.006
0.005
0.004
0.003
FNMR(T)
FMR(T)
0.002
3e−06 1e−05 3e−05 1e−04 3e−04 1e−03 3e−03 1e−02 3e−02 1e−01 3e−01
66
0.900
0.800
2019/10/16 12:43:37
0.700
0.600
0.500
0.400
0.300
0.200
Dataset: MUGSHOT
Tier: 7
FRVT
0.100 FNMR @ FMR=1e−05
0.090 and Algorithm
-
0.080 0.5783 microfocus_002

0.5530 awiros_001
0.070
0.060 0.3780 dsk_000
0.3700 notiontag_000
0.050 0.2987 veridas_001
0.2617 veridas_002
0.040 0.2580 dermalog_005
0.2360 shaman_001
0.2179 glory_000
0.030 0.1823 adera_001
0.1642 glory_001
0.1144 yisheng_004
0.020 0.1090 intellivision_001
0.1083 tiger_002
0.1022 aware_003
-
0.0837 aware_004
VERIFICATION
0.010
0.009
0.008
0.007
0.006
0.005
0.004
FNMR(T)
FMR(T)
0.003
0.002
3e−06 1e−05 3e−05 1e−04 3e−04 1e−03 3e−03 1e−02 3e−02 1e−01 3e−01
67
2019/10/16 12:43:37
0.900
0.800
0.700
0.600
0.500
0.400
0.300
0.200
FRVT
-

0.090 Tier: 8
FNMR @ FMR=1e−05
0.080
and Algorithm
0.070
1.0000 nodeflux_001
0.060 0.9999 isityou_000
0.9999 chtface_001
0.050 0.9990 shaman_000
0.9586 bm_001
0.040 0.7539 saffe_001
0.030 0.7256 microfocus_001
0.6973 amplifiedgroup_001
0.6899 isap_001
0.6580 kakao_001
0.020 0.6150 ayonix_000
-
VERIFICATION
0.010
0.009
0.008
0.007
0.006
0.005
0.004
FNMR(T)
FMR(T)
0.003
0.002
3e−06 1e−05 3e−05 1e−04 3e−04 1e−03 3e−03 1e−02 3e−02 1e−01 3e−01
68
0.50
0.40
2019/10/16 12:43:37
0.30
0.20
Dataset:
0.10 Wild single image comparisons
0.09 FNMR @ FMR=1e−04
0.08 0.029 idemia_005
FRVT
0.07 0.029 einetworks_000
0.029 sjtu_001
-
0.06 0.029 intellifusion_001

0.029 anke_004
0.05 0.029 camvi_002
0.04 0.028 sertis_000
0.028 dahua_003
0.028 camvi_004
0.03 0.028 vocord_006
0.028 toshiba_003
0.028 imperial_000
0.028 alphaface_001
0.02 0.028 vocord_007
0.028 deepglint_001
0.028 ntechlab_007
0.028 ntechlab_006
0.027 facesoft_000
-
0.027 imperial_002
VERIFICATION
0.027 hik_001
0.01
FNMR(T)
FMR(T)
1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

Figure 35: For the 2018 wild image comparisons, detection error tradeoff (DET) characteristics showing false non-match rate vs. false match rate plotted parametrically
on threshold, T. The scales are logarithmic in order to show several decades of FMR.
69
0.50
0.40
2019/10/16 12:43:37
0.30
0.20
Dataset:
0.09 FNMR @ FMR=1e−04
0.08 0.032 dahua_002
FRVT
0.07 0.032 vigilantsolutions_006
0.032 incode_003
-
0.06 0.032 ulsee_001

0.031 upc_001
0.05 0.031 incode_004
0.031 tech5_002
0.031 idemia_004
0.04 0.031 remarkai_001
0.031 saffe_002
0.03 0.031 tech5_003
0.030 remarkai_000
0.030 cyberlink_003
0.030 hr_001
0.02 0.030 anke_003
0.030 tevian_005
0.030 nodeflux_002
0.030 cyberlink_002
0.030 psl_003
-
0.030 psl_002
VERIFICATION
0.029 everai_002
0.01
FNMR(T)
FMR(T)
1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

70
0.50
0.40
2019/10/16 12:43:37
0.30
0.20
Dataset:
0.09 FNMR @ FMR=1e−04
0.08 0.041 cogent_003
FRVT
0.07 0.040 tongyi_005
0.039 tevian_004
-
0.06 0.039 visionbox_001

0.038 iqface_000
0.05 0.038 cogent_004
0.037 alchera_001
0.037 alchera_000
0.04 0.036 meiya_001
0.036 gorilla_003
0.035 winsense_000
0.03 0.035 starhybrid_001
0.035 via_000
0.035 deepsea_001
0.034 pixelall_002
0.034 hr_002
0.02 0.033 realnetworks_003
0.033 synesis_005
0.033 itmo_006
0.033 mt_000
-
0.033 yitu_003
VERIFICATION
0.01
FNMR(T)
FMR(T)
1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

71
0.50
0.40
2019/10/16 12:43:37
0.30
0.20
Dataset:
0.09 FNMR @ FMR=1e−04
0.08 0.061 trueface_000
FRVT
0.07 0.061 allgovision_000
0.060 cognitec_001
-
0.06 0.054 rankone_006

0.052 isystems_001
0.05 0.052 siat_002
0.052 isystems_002
0.052 aware_004
0.04 0.051 tiger_002
0.051 gorilla_002
0.050 veridas_001
0.03 0.048 tiger_003
0.048 visionbox_000
0.048 f8_001
0.047 anyvision_004
0.047 ceiec_002
0.02 0.045 innovatrics_004
0.045 veridas_002
0.045 rankone_007
0.044 uluface_002
0.043 toshiba_002
-
0.043 itmo_005
VERIFICATION
0.01
FNMR(T)
FMR(T)
1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

72
0.50
0.40
2019/10/16 12:43:37
0.30
0.20
Dataset:
0.09 FNMR @ FMR=1e−04
0.08 0.196 adera_001
FRVT
0.07 0.193 isap_001
0.181 notiontag_000
-
0.06 0.175 cyberextruder_001

0.05 0.150 shaman_001
0.139 vd_001
0.132 synesis_004
0.04 0.119 smilart_003
0.116 imagus_000
0.03 0.099 shu_001
0.095 cognitec_000
0.092 megvii_001
0.091 yisheng_004
0.087 3divi_003
0.02 0.086 rokid_000
0.085 dermalog_005
0.085 id3_003
0.085 ceiec_001
0.069 megvii_002
-
0.066 3divi_004
VERIFICATION
0.062 dermalog_006
0.01
FNMR(T)
FMR(T)
1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

73
0.50
0.40
2019/10/16 12:43:37
0.30
0.20
Dataset:
0.09 FNMR @ FMR=1e−04
0.08 1.000 siat_004
FRVT
0.07 1.000 sensetime_002
0.998 chtface_001
-
0.06 0.993 bm_001

0.958 shaman_000
0.05 0.558 awiros_001
0.476 glory_000
0.426 glory_001
0.04 0.425 amplifiedgroup_001
0.389 saffe_001
0.363 ayonix_000
0.03 0.318 aware_003
0.309 iit_001
0.305 kneron_003
0.264 lookman_002
0.02 0.257 microfocus_001
0.252 lookman_004
0.251 kedacom_000
0.248 vion_000
0.233 intsysmsu_000
-
0.223 anyvision_002
VERIFICATION
0.220 dsk_000
0.01
FNMR(T)
FMR(T)
1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

74
0.50
0.40
2019/10/16 12:43:37
0.30
0.20
0.10
0.09
0.08
FRVT
0.07
-
0.06

0.05 Dataset:
Wild single image comparisons
FNMR @ FMR=1e−04
0.04
1.000 ctbcbank_000
1.000 isityou_000
0.03 1.000 kakao_001
1.000 kakao_002
1.000 nodeflux_001
1.000 sensetime_001
0.02
-
VERIFICATION
0.01
FNMR(T)
FMR(T)
1e−06 1e−05 1e−04 1e−03 1e−02 1e−01 1e+00

75
2019/10/16 12:43:37
0.8
0.7 Dataset: Child Exploitation

FNMR @ FMR=0.01
and Algorithm
Tier 1
0.52 ceiec_002
FRVT
0.51 isystems_001
-
0.51 incode_004

0.6 0.50 cyberlink_002
0.50 facesoft_000
0.49 isystems_002
0.48 iit_001
0.48 itmo_005
0.46 anyvision_004
0.46 shu_001
0.44 umd_001
0.5 0.44 megvii_001
0.44 umd_3c2_cpu
0.43 siat_002
0.42 upc_001
0.40 deepglint_001
0.38 mt_000
0.37 visionlabs_007
0.36 anke_004
0.33 ntechlab_007
-
0.30 megvii_002
VERIFICATION
0.4
FNMR(T)
FMR(T)
0.3
0.001 0.010 0.100

Figure 42: For child exploitation images, detection error tradeoff (DET) characteristics showing false non-match rate vs. false match rate plotted parametrically on
threshold, T. The scales are logarithmic in order to show many decades of FMR. Accuracy is poor because many images have adverse quality characteristics, and because
detection and enrollment fails.
76
2019/10/16 12:43:37
0.8

FNMR @ FMR=0.01
and Algorithm
Tier 2
0.68 dermalog_005
FRVT
0.67 uluface_002
0.67 rankone_007
-
0.65 microfocus_002

0.6 0.65 iqface_000
0.65 notiontag_000
0.62 tongyi_005
0.61 gorilla_002
0.59 id3_003
0.58 dermalog_006
0.57 camvi_002
0.5 0.56 deepsea_001
0.56 tiger_003
0.56 synesis_005
0.56 starhybrid_001
0.56 str_000
0.56 umd_000
0.55 hr_001
0.54 str_001
0.54 3divi_003
-
0.53 sensetime_002
VERIFICATION
0.53 f8_001
0.4
FNMR(T)
FMR(T)
0.3
0.001 0.010 0.100

77
2019/10/16 12:43:37
0.8

FNMR @ FMR=0.01
and Algorithm
Tier 3
0.86 winsense_000
FRVT
0.85 aware_003
0.85 vocord_007
-
0.84 ayonix_000

0.6 0.84 cognitec_000
0.78 tiger_002
0.77 lookman_004
0.77 kedacom_000
0.76 via_000
0.75 vcog_002
0.73 dsk_000
0.5 0.73 videonetics_001
0.72 adera_001
0.72 cogent_004
0.71 yisheng_004
0.71 toshiba_002
0.70 smilart_002
0.70 kneron_003
0.70 anyvision_002
0.70 sensetime_001
-
0.69 imagus_000
VERIFICATION
0.69 microfocus_001
0.4
FNMR(T)
FMR(T)
0.3
0.001 0.010 0.100

78
2019/10/16 12:43:37
0.8
0.7
FRVT
Dataset: Child Exploitation
FNMR @ FMR=0.01
-
and Algorithm

0.6
Tier 4
1.00 isityou_000
1.00 kakao_002
0.98 gorilla_003
0.96 shaman_000
0.90 shaman_001
0.90 saffe_001
0.90 pixelall_002
0.5
0.89 glory_000
0.88 bm_001
0.88 glory_001
0.88 ctbcbank_000
0.88 vion_000
-
VERIFICATION
0.4
FNMR(T)
FMR(T)
0.3
0.001 0.010 0.100

79
2019/10/16 12:43:37
1.0

0.8 CMC @ Rank=1
and Algorithm
Tier 1
FRVT
True positive identification rate (TPIR) aka "hit rate"
0.72 megvii_002
0.70 ntechlab_007
-
0.69 megvii_001

0.69 deepglint_001
0.67 anke_004
0.66 sensetime_001
0.65 siat_002
0.65 mt_000
0.65 upc_001
0.6 0.65 visionlabs_007
0.64 facesoft_000
0.64 umd_3c2_cpu
0.62 umd_001
0.61 camvi_002
0.60 ctbcbank_000
0.59 shu_001
0.59 umd_000
0.58 iit_001
0.58 str_001
0.58 iqface_000
0.58 itmo_005
-
0.58 str_000
VERIFICATION
0.4 0.57 anyvision_004
0.57 toshiba_002
FNMR(T)
FMR(T)
0.2
1 3 10 30 100
Rank at which highest scoring mate is found
Figure 46: For child exploitation images, cumulative match characteristics (CMC) showing true positive identification rate vs. rank. This is simulation of a one-to-many
search experiment - see discussion in section 3.2. The scales are logarithmic in order to show the effect of long candidate lists. Accuracy is poor but much improved
relative to the 1:1 DETs of Fig. 45 because a search can succeed if any of a subject’s several enrolled images matches the search image with a high score.
80
2019/10/16 12:43:37
1.0

CMC @ Rank=1
and Algorithm
Tier 2
0.8
0.56 pixelall_002
FRVT
0.55 hr_001
-
0.55 tiger_003

0.55 tiger_002
0.55 cyberlink_002
0.54 isystems_002
0.53 isystems_001
0.53 incode_004
0.53 gorilla_002
0.53 via_000
0.6 0.52 starhybrid_001
0.52 ceiec_002
0.52 gorilla_003
0.51 3divi_003
0.51 f8_001
0.51 cogent_004
0.50 synesis_005
0.50 uluface_002
0.50 winsense_000
0.50 deepsea_001
0.50 dermalog_006
-
0.50 kakao_002
VERIFICATION
0.49 sensetime_002
0.4 0.48 imagus_000
0.48 adera_001
0.47 id3_003
FNMR(T)
FMR(T)
0.2
1 3 10 30 100
81
2019/10/16 12:43:37
1.0

CMC @ Rank=1
and Algorithm
Tier 3
0.8
0.47 microfocus_002
0.47 tongyi_005
0.46 microfocus_001
FRVT
0.43 dermalog_005
0.43 notiontag_000
-
0.42 rankone_007

0.42 saffe_001
0.40 dsk_000
0.40 smilart_002
0.38 kneron_003
0.37 aware_003
0.37 yisheng_004
0.37 bm_001
0.6 0.36 anyvision_002
0.31 kedacom_000
0.31 lookman_004
0.26 vocord_007
0.26 cognitec_000
0.24 vcog_002
0.23 ayonix_000
-
0.22 glory_001
VERIFICATION
0.21 glory_000
0.4 0.21 vion_000
0.18 isityou_000
0.17 shaman_001
0.14 shaman_000
FNMR(T)
FMR(T)
0.2
1 3 10 30 100
82
3divi_003 anyvision_002 anyvision_004 aware_003 ayonix_000 bm_001 camvi_002
2019/10/16 12:43:37
0.75
0.50
0.25
Study
cropped
cognitec_000 cyberextruder_001 cyberextruder_002 dermalog_005 dermalog_006 glory_000 glory_001
uncropped
0.75

0.50 CMC @ Rank=1 [cropped | uncropped] (delta improvement)
and Algorithm
0.70 | 0.65 ( 0.05) siat_002
0.25 0.69 | 0.72 (−0.02) megvii_002
0.67 | 0.69 (−0.02) megvii_001
FRVT
0.64 | 0.62 ( 0.01) umd_001
gorilla_002 id3_003 innovatrics_004 intellivision_001 isityou_000 isystems_001 isystems_002

0.62 | 0.61 ( 0.01) camvi_002
0.61 | 0.57 ( 0.04) anyvision_004
-
0.75 0.61 | 0.57 ( 0.05) toshiba_002

0.58 | 0.58 ( 0.01) itmo_005
0.58 | 0.56 ( 0.02) innovatrics_004
0.50
0.57 | 0.55 ( 0.02) tiger_002
0.56 | 0.55 ( 0.01) tiger_003
0.25 0.54 | 0.54 ( 0.00) isystems_002
0.52 | 0.51 ( 0.01) 3divi_003
0.52 | 0.53 (−0.01) isystems_001
itmo_005 megvii_001 megvii_002 microfocus_001 microfocus_002 saffe_001 shaman_000 0.52 | 0.53 (−0.01) gorilla_002
0.51 | 0.50 ( 0.01) dermalog_006
0.75 0.48 | 0.47 ( 0.01) cyberextruder_002
0.47 | 0.47 ( 0.00) microfocus_002
0.47 | 0.47 (−0.01) id3_003
0.50 0.46 | 0.46 ( 0.00) microfocus_001
0.45 | 0.43 ( 0.02) dermalog_005
0.42 | 0.42 ( 0.00) saffe_001
0.25 0.40 | 0.40 ( 0.00) smilart_002
0.39 | 0.37 ( 0.01) aware_003
0.38 | 0.26 ( 0.13) cognitec_000
-
shaman_001 siat_002 smilart_002 tiger_002 tiger_003 toshiba_002 umd_001
0.37 | 0.37 ( 0.00) yisheng_004
VERIFICATION
0.34 | 0.37 (−0.02) bm_001
0.75 0.33 | 0.36 (−0.03) anyvision_002
0.30 | 0.17 ( 0.13) shaman_001
0.29 | 0.21 ( 0.08) vion_000
0.50
0.29 | 0.28 ( 0.01) intellivision_001
0.28 | 0.28 ( 0.00) cyberextruder_001
0.25 0.23 | 0.23 (−0.01) ayonix_000
0.22 | 0.22 ( 0.00) glory_001
0.21 | 0.21 ( 0.00) glory_000
vion_000 yisheng_004 1 3 10 30 100 1 3 10 30 100 1 3 10 30 100 1 3 10 30 100 1 3 10 30 100
0.20 | 0.18 ( 0.03) isityou_000
FNMR(T)
0.15 | 0.14 ( 0.01) shaman_000

FMR(T)
0.75
0.50
0.25
1 3 10 30 100 1 3 10 30 100
Figure 49: For child exploitation images, cumulative match characteristics (CMC) showing true positive identification rate vs. rank for two cases: 1. Whole image
provided to the algorithm; 2. Human annotated rectangular region, cropped and provided to the algorithm. The difference between the traces is associated with
detection of difficult faces, and fine localization.
83
nodeflux_001 ceiec_001 shaman_000 yitu_003 intellifusion_001
2019/10/16 12:43:37
0.0015 0.0010 0.0001 0.0010 0.0011 0.0010 0.0001 0.0010 0.0004 0.0010
MW
0.0020 0.0011 0.0007 0.0001 0.0018 0.0011 0.0013 0.0001 0.0015 0.0004
MB
0.0006 0.0003 0.0000 0.0010 0.0015 0.0015 0.0002 0.0021 0.0006 0.0019
FW
0.0008 0.0004 0.0011 0.0000 0.0023 0.0015 0.0024 0.0002 0.0027 0.0006
FB Dataset: MUGSHOTS
Tier 1
log10 FMR
tongyi_005 realnetworks_003 realnetworks_002 iit_000 glory_000
0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0001 0.0010 0.0005 0.0010
MW
FRVT
0.0023 0.0002 0.0028 0.0002 0.0024 0.0002 0.0015 0.0002 0.0012 0.0005
MB
−1
-
0.0003 0.0030 0.0001 0.0013 0.0001 0.0015 0.0003 0.0027 0.0011 0.0028
FW
Demographics of impostor
0.0028 0.0003 0.0029 0.0001 0.0031 0.0001 0.0035 0.0003 0.0037 0.0012
FB
−2
shaman_001 rankone_006 psl_003 tech5_003 deepsea_001
0.0002 0.0010 0.0001 0.0010 0.0001 0.0010 0.0001 0.0010 0.0003 0.0010
MW
−3
0.0027 0.0002 0.0014 0.0001 0.0008 0.0001 0.0020 0.0001 0.0019 0.0003
MB
0.0002 0.0017 0.0002 0.0030 0.0003 0.0023 0.0002 0.0037 0.0005 0.0022
FW
−4
-
0.0038 0.0002 0.0042 0.0003 0.0045 0.0003 0.0047 0.0003 0.0048 0.0005
VERIFICATION
FB
camvi_004 vocord_007 vigilantsolutions_006 glory_001 rankone_007
−5
0.0004 0.0010 0.0002 0.0010 0.0002 0.0010 0.0004 0.0010 0.0001 0.0010
MW
0.0018 0.0004 0.0014 0.0001 0.0012 0.0002 0.0015 0.0004 0.0022 0.0002
MB
FNMR(T)
FMR(T)
0.0007 0.0020 0.0003 0.0029 0.0004 0.0027 0.0010 0.0026 0.0002 0.0025
FW
0.0049 0.0007 0.0050 0.0004 0.0052 0.0004 0.0053 0.0011 0.0056 0.0003
FB
FB FW MB MW FB FW MB MW FB FW MB MW FB FW MB MW FB FW MB MW
Demographics of enrollee
Figure 50: For the mugshot images, FMR for same-sex impostor pairs of images annotated with codes for black female, black male, white female, white male. The
threshold is set for each algorithm to give FMR = 0.001 for white males which is the demographc that usually gives the lowest FMR. This means the top right box is the
same color in all panels. The panels are sorted over multiple pages in order of FMR on black females, which is the demographc that usually gives the highest FMR.
84
ceiec_002 starhybrid_001 microfocus_001 ntechlab_006 sjtu_001
2019/10/16 12:43:37
0.0002 0.0010 0.0004 0.0010 0.0002 0.0010 0.0003 0.0010 0.0002 0.0010
MW
0.0024 0.0002 0.0017 0.0004 0.0063 0.0002 0.0031 0.0003 0.0023 0.0002
MB
0.0002 0.0024 0.0009 0.0044 0.0001 0.0009 0.0004 0.0030 0.0003 0.0027
FW
0.0057 0.0002 0.0058 0.0009 0.0059 0.0001 0.0060 0.0005 0.0063 0.0003
Tier 2
log10 FMR
hik_001 facesoft_000 adera_001 imperial_002 awiros_001
0.0001 0.0010 0.0002 0.0010 0.0001 0.0010 0.0002 0.0010 0.0001 0.0010
MW
FRVT
0.0017 0.0001 0.0032 0.0002 0.0033 0.0001 0.0026 0.0002 0.0016 0.0001
MB
−1
-
0.0003 0.0030 0.0003 0.0018 0.0001 0.0022 0.0004 0.0019 0.0002 0.0025
FW
0.0064 0.0003 0.0065 0.0003 0.0065 0.0001 0.0065 0.0004 0.0069 0.0002
FB
−2
vigilantsolutions_007 dahua_003 veridas_002 anke_003 imperial_000
0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0001 0.0010 0.0003 0.0010
MW
−3
0.0015 0.0002 0.0019 0.0002 0.0039 0.0001 0.0016 0.0001 0.0041 0.0002
MB
0.0006 0.0032 0.0005 0.0027 0.0002 0.0038 0.0003 0.0025 0.0003 0.0017
FW
−4
-
0.0070 0.0006 0.0071 0.0005 0.0071 0.0002 0.0075 0.0004 0.0077 0.0003
VERIFICATION
FB
cogent_004 toshiba_003 dsk_000 cognitec_001 everai_002
−5
0.0001 0.0010 0.0001 0.0010 0.0002 0.0010 0.0002 0.0010 0.0001 0.0010
MW
0.0014 0.0001 0.0014 0.0001 0.0055 0.0002 0.0016 0.0002 0.0019 0.0001
MB
FNMR(T)
FMR(T)
0.0002 0.0041 0.0005 0.0030 0.0001 0.0014 0.0006 0.0023 0.0002 0.0020
FW
0.0078 0.0002 0.0079 0.0004 0.0080 0.0001 0.0082 0.0006 0.0083 0.0002
FB
85
cognitec_000 shu_001 deepglint_001 cogent_003 ntechlab_007
2019/10/16 12:43:37
0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0001 0.0010 0.0003 0.0010
MW
0.0016 0.0002 0.0027 0.0002 0.0026 0.0002 0.0014 0.0001 0.0029 0.0003
MB
0.0006 0.0023 0.0006 0.0034 0.0005 0.0028 0.0003 0.0045 0.0006 0.0024
FW
0.0083 0.0006 0.0083 0.0007 0.0083 0.0005 0.0085 0.0003 0.0087 0.0006
Tier 3
log10 FMR
dermalog_005 chtface_001 vocord_006 dahua_002 neurotechnology_006
0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0001 0.0010
MW
FRVT
0.0036 0.0001 0.0016 0.0004 0.0027 0.0002 0.0023 0.0002 0.0020 0.0001
MB
−1
-
0.0002 0.0020 0.0005 0.0028 0.0005 0.0029 0.0005 0.0031 0.0003 0.0025
FW
0.0090 0.0002 0.0091 0.0005 0.0091 0.0005 0.0096 0.0005 0.0097 0.0003
FB
−2
dermalog_006 iqface_000 id3_004 alphaface_001 innovatrics_006
0.0002 0.0010 0.0001 0.0010 0.0002 0.0010 0.0001 0.0010 0.0001 0.0010
MW
−3
0.0017 0.0002 0.0020 0.0001 0.0024 0.0002 0.0019 0.0001 0.0018 0.0001
MB
0.0006 0.0029 0.0004 0.0024 0.0004 0.0029 0.0004 0.0024 0.0005 0.0030
FW
−4
-
0.0097 0.0006 0.0098 0.0004 0.0098 0.0004 0.0099 0.0004 0.0099 0.0005
VERIFICATION
FB
sensetime_002 sensetime_001 gorilla_002 uluface_002 microfocus_002
−5
0.0003 0.0010 0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0003 0.0010
MW
0.0028 0.0002 0.0029 0.0002 0.0028 0.0002 0.0021 0.0002 0.0068 0.0002
MB
FNMR(T)
FMR(T)
0.0004 0.0026 0.0004 0.0024 0.0003 0.0024 0.0006 0.0029 0.0002 0.0014
FW
0.0102 0.0004 0.0102 0.0004 0.0103 0.0003 0.0103 0.0006 0.0105 0.0002
FB
86
lookman_004 visionlabs_007 psl_002 rokid_000 3divi_004
2019/10/16 12:43:37
0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0001 0.0010 0.0002 0.0010
MW
0.0019 0.0002 0.0024 0.0002 0.0018 0.0002 0.0017 0.0001 0.0034 0.0002
MB
0.0004 0.0035 0.0005 0.0023 0.0005 0.0032 0.0005 0.0027 0.0004 0.0020
FW
0.0106 0.0004 0.0106 0.0005 0.0106 0.0005 0.0107 0.0005 0.0107 0.0004
Tier 4
log10 FMR
isystems_001 neurotechnology_005 isystems_002 ulsee_001 anyvision_004
0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0002 0.0010
MW
FRVT
0.0022 0.0002 0.0020 0.0002 0.0021 0.0002 0.0022 0.0002 0.0043 0.0002
MB
−1
-
0.0006 0.0030 0.0006 0.0033 0.0006 0.0030 0.0006 0.0032 0.0003 0.0016
FW
0.0107 0.0006 0.0108 0.0005 0.0108 0.0006 0.0110 0.0005 0.0111 0.0003
FB
−2
vd_001 f8_001 mt_000 gorilla_003 itmo_005
0.0002 0.0010 0.0001 0.0010 0.0001 0.0010 0.0002 0.0010 0.0002 0.0010
MW
−3
0.0026 0.0002 0.0019 0.0001 0.0019 0.0001 0.0030 0.0001 0.0037 0.0002
MB
0.0006 0.0035 0.0004 0.0027 0.0005 0.0031 0.0004 0.0033 0.0003 0.0018
FW
−4
-
0.0111 0.0006 0.0112 0.0004 0.0113 0.0005 0.0113 0.0003 0.0114 0.0003
VERIFICATION
FB
itmo_006 cyberlink_003 toshiba_002 via_000 cyberlink_002
−5
0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0002 0.0010
MW
0.0030 0.0002 0.0019 0.0002 0.0017 0.0001 0.0021 0.0002 0.0019 0.0002
MB
FNMR(T)
FMR(T)
0.0004 0.0028 0.0006 0.0032 0.0006 0.0028 0.0006 0.0033 0.0006 0.0032
FW
0.0115 0.0004 0.0117 0.0006 0.0118 0.0005 0.0118 0.0006 0.0118 0.0006
FB
87
winsense_000 synesis_005 nodeflux_002 camvi_002 saffe_002
2019/10/16 12:43:37
0.0002 0.0010 0.0001 0.0010 0.0001 0.0010 0.0002 0.0010 0.0002 0.0010
MW
0.0020 0.0001 0.0019 0.0001 0.0019 0.0001 0.0018 0.0002 0.0018 0.0001
MB
0.0005 0.0029 0.0004 0.0027 0.0005 0.0028 0.0007 0.0033 0.0006 0.0029
FW
0.0118 0.0004 0.0118 0.0004 0.0120 0.0004 0.0121 0.0006 0.0121 0.0005
Tier 5
log10 FMR
tech5_002 synesis_004 trueface_000 iit_001 einetworks_000
0.0003 0.0010 0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0002 0.0010
MW
FRVT
0.0037 0.0002 0.0021 0.0002 0.0019 0.0002 0.0018 0.0001 0.0018 0.0001
MB
−1
-
0.0006 0.0036 0.0007 0.0035 0.0006 0.0032 0.0006 0.0031 0.0006 0.0030
FW
0.0122 0.0006 0.0122 0.0006 0.0122 0.0005 0.0123 0.0006 0.0123 0.0006
FB
−2
vion_000 remarkai_000 remarkai_001 visionbox_001 intellicloudai_001
0.0002 0.0010 0.0001 0.0010 0.0001 0.0010 0.0002 0.0010 0.0002 0.0010
MW
−3
0.0021 0.0002 0.0018 0.0001 0.0018 0.0001 0.0018 0.0001 0.0020 0.0002
MB
0.0007 0.0035 0.0007 0.0033 0.0007 0.0033 0.0006 0.0030 0.0006 0.0030
FW
−4
-
0.0123 0.0006 0.0123 0.0006 0.0123 0.0006 0.0124 0.0006 0.0124 0.0006
VERIFICATION
FB
anke_004 smilart_003 siat_004 intsysmsu_000 ctbcbank_000
−5
0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0001 0.0010
MW
0.0023 0.0002 0.0027 0.0002 0.0033 0.0002 0.0021 0.0002 0.0014 0.0001
MB
FNMR(T)
FMR(T)
0.0006 0.0036 0.0004 0.0026 0.0004 0.0025 0.0006 0.0034 0.0006 0.0032
FW
0.0125 0.0006 0.0129 0.0005 0.0130 0.0004 0.0131 0.0006 0.0132 0.0005
FB
88
idemia_005 visionlabs_006 veridas_001 incode_004 visionbox_000
2019/10/16 12:43:37
0.0002 0.0010 0.0002 0.0010 0.0003 0.0010 0.0001 0.0010 0.0002 0.0010
MW
0.0034 0.0002 0.0029 0.0002 0.0073 0.0002 0.0020 0.0001 0.0024 0.0002
MB
0.0004 0.0034 0.0005 0.0021 0.0003 0.0040 0.0006 0.0034 0.0006 0.0035
FW
0.0132 0.0004 0.0132 0.0005 0.0133 0.0003 0.0134 0.0006 0.0134 0.0006
Tier 6
log10 FMR
x−laboratory_000 allgovision_000 bm_001 imagus_000 notiontag_000
0.0002 0.0010 0.0002 0.0010 0.0020 0.0010 0.0001 0.0010 0.0002 0.0010
MW
FRVT
0.0021 0.0002 0.0023 0.0002 0.0102 0.0020 0.0023 0.0001 0.0031 0.0001
MB
−1
-
0.0007 0.0037 0.0007 0.0037 0.0008 0.0011 0.0003 0.0032 0.0003 0.0030
FW
0.0134 0.0007 0.0135 0.0007 0.0137 0.0009 0.0137 0.0003 0.0137 0.0004
FB
−2
alchera_001 kedacom_000 kneron_003 pixelall_002 tevian_005
0.0001 0.0010 0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0004 0.0010
MW
−3
0.0021 0.0001 0.0024 0.0002 0.0018 0.0002 0.0024 0.0002 0.0080 0.0003
MB
0.0005 0.0031 0.0005 0.0032 0.0008 0.0037 0.0006 0.0034 0.0004 0.0023
FW
−4
-
0.0138 0.0005 0.0139 0.0005 0.0141 0.0007 0.0142 0.0005 0.0144 0.0004
VERIFICATION
FB
alchera_000 hr_001 tiger_003 siat_002 anyvision_002
−5
0.0001 0.0010 0.0002 0.0010 0.0002 0.0010 0.0002 0.0010 0.0002 0.0010
MW
0.0019 0.0001 0.0028 0.0002 0.0035 0.0002 0.0055 0.0002 0.0031 0.0001
MB
FNMR(T)
FMR(T)
0.0007 0.0032 0.0006 0.0032 0.0006 0.0028 0.0004 0.0028 0.0004 0.0025
FW
0.0145 0.0006 0.0147 0.0007 0.0149 0.0006 0.0150 0.0004 0.0155 0.0004
FB
89
everai_paravision_003 intelresearch_000 lookman_002 id3_003 megvii_002
2019/10/16 12:43:37
0.0002 0.0010 0.0001 0.0010 0.0003 0.0010 0.0002 0.0010 0.0002 0.0010
MW
0.0033 0.0002 0.0024 0.0001 0.0057 0.0002 0.0040 0.0002 0.0052 0.0002
MB
0.0007 0.0029 0.0003 0.0044 0.0005 0.0032 0.0005 0.0039 0.0005 0.0067
FW
0.0162 0.0007 0.0163 0.0004 0.0163 0.0005 0.0169 0.0005 0.0170 0.0005
Tier 7
log10 FMR
intellivision_002 isityou_000 tevian_004 hr_002 intellivision_001
0.0002 0.0010 0.0010 0.0010 0.0004 0.0010 0.0003 0.0010 0.0003 0.0010
MW
FRVT
0.0034 0.0002 0.0265 0.0008 0.0114 0.0003 0.0055 0.0003 0.0034 0.0003
MB
−1
-
0.0008 0.0037 0.0003 0.0007 0.0002 0.0021 0.0008 0.0033 0.0010 0.0036
FW
0.0180 0.0008 0.0180 0.0003 0.0183 0.0002 0.0188 0.0008 0.0196 0.0011
FB
−2
meiya_001 sertis_000 3divi_003 cyberextruder_002 digitalbarriers_002
0.0002 0.0010 0.0002 0.0010 0.0003 0.0010 0.0003 0.0010 0.0002 0.0010
MW
−3
0.0035 0.0002 0.0029 0.0001 0.0074 0.0003 0.0052 0.0003 0.0047 0.0002
MB
0.0009 0.0042 0.0006 0.0036 0.0006 0.0029 0.0007 0.0036 0.0005 0.0045
FW
−4
-
0.0197 0.0008 0.0203 0.0006 0.0204 0.0006 0.0208 0.0007 0.0211 0.0005
VERIFICATION
FB
kakao_002 amplifiedgroup_001 innovatrics_004 idemia_004 saffe_001
−5
0.0002 0.0010 0.0028 0.0010 0.0002 0.0010 0.0002 0.0010 0.0008 0.0010
MW
0.0041 0.0002 0.1087 0.0017 0.0041 0.0002 0.0045 0.0002 0.0213 0.0007
MB
FNMR(T)
FMR(T)
0.0004 0.0023 0.0003 0.0036 0.0006 0.0030 0.0005 0.0039 0.0004 0.0013
FW
0.0219 0.0004 0.0221 0.0003 0.0221 0.0006 0.0224 0.0005 0.0233 0.0004
FB
90
cyberextruder_001 tiger_002 upc_001 kakao_001
2019/10/16 12:43:37
0.0005 0.0010 0.0003 0.0010 0.0002 0.0010 0.0006 0.0010

MW
0.0132 0.0004 0.0058 0.0003 0.0057 0.0002 0.0197 0.0004

MB
0.0004 0.0024 0.0007 0.0022 0.0006 0.0039 0.0004 0.0011

FW Dataset: MUGSHOTS
Tier 8
log10 FMR
0.0240 0.0005 0.0259 0.0007 0.0290 0.0006 0.0324 0.0003

FB
FRVT
incode_003 aware_003 ayonix_000 aware_004
−1
-
0.0002 0.0010 0.0005 0.0010 0.0004 0.0010 0.0005 0.0010

MW
0.0037 0.0001 0.0153 0.0004 0.0149 0.0004 0.0149 0.0004

MB −2
0.0006 0.0039 0.0006 0.0033 0.0005 0.0023 0.0008 0.0036

FW
−3
0.0327 0.0006 0.0338 0.0006 0.0347 0.0005 0.0402 0.0007

FB
megvii_001 yisheng_004 videonetics_001 isap_001

−4
-
VERIFICATION
0.0004 0.0010 0.0004 0.0010 0.0038 0.0010 0.0005 0.0010
MW
−5
0.0127 0.0003 0.0109 0.0003 0.1433 0.0025 0.0154 0.0004
MB
0.0009 0.0086 0.0014 0.0082 0.0012 0.0040 0.0014 0.0024

FW
FNMR(T)
FMR(T)
0.0464 0.0008 0.0779 0.0013 0.0903 0.0010 0.0968 0.0013

FB
FB FW MB MW FB FW MB MW FB FW MB MW FB FW MB MW
91
2019/10/16 12:43:37
alphaface_001 anke_004 camvi_004 dahua_003 deepglint_001
0.030
0.020
0.010
0.005
0.003
0.002
everai_002 everai_paravision_003 facesoft_000 hr_002 imperial_002
0.030
FRVT
0.020
-
0.010

0.005
Race
0.003 B
W
0.002
innovatrics_006 intellifusion_001 psl_003 rokid_000 tevian_005
0.030 Sex
F
0.020
M
0.010
0.005
0.003
-
VERIFICATION
0.002
uluface_002 visionlabs_006 visionlabs_007 vocord_007 yitu_003
0.030
0.020
0.010
0.005
FNMR(T)
FMR(T)
0.003
0.002
1e−051e−041e−031e−021e−01 1e−051e−041e−031e−021e−01 1e−051e−041e−031e−021e−01 1e−051e−041e−031e−021e−01 1e−051e−041e−031e−021e−01
Figure 58: For the mugshot images, error tradeoff characteristics for white females, black females, black males and white males. The Z-shaped grey lines correspond to
fixed thresholds, showing both FNMR and FMR vary at one T value. Note: Many of the plots will naively be read as saying women gives worse error rates than men
because the solid traces lie above the dotted ones. However, this is misleading and incomplete: The grey lines show the traces reveal horizontal shifts. Thus for the
cogent-003 algorithm FNMR for men is higher than for women at a fixed threshold but, at the same time, FMR is higher for women - see Figure 86. As access control
systems almost always operate at a fixed threshold, the naive interpretation is incorrect.
92
2019/10/16 12:43:37
3divi_004 anke_003 camvi_002 cogent_003 cogent_004

0.050
0.030
0.020
0.010
0.005
0.003
0.002
einetworks_000 hik_001 hr_001 imperial_000 incode_004
0.050
FRVT
0.030
0.020
-
0.010
0.005
Race
0.003 B
W
0.002
intellicloudai_001 iqface_000 mt_000 ntechlab_007 psl_002
0.050 Sex
0.030 F
M
0.020
0.010
0.005
-
0.003
VERIFICATION
0.002
sertis_000 starhybrid_001 toshiba_002 toshiba_003 vocord_006
0.050
0.030
0.020
0.010
FNMR(T)
0.005
FMR(T)
0.003
0.002
93
2019/10/16 12:43:37
cognitec_000 cyberlink_002 cyberlink_003 dahua_002 iit_001

0.050
0.030
0.020
0.010
0.005
0.003
0.002
intsysmsu_000 isystems_002 kedacom_000 neurotechnology_005 neurotechnology_006
0.050
FRVT
0.030
0.020
-
0.010
0.005 Race
0.003 B
W
0.002
ntechlab_006 rankone_007 remarkai_000 remarkai_001 saffe_002
0.050 Sex
F
0.030
M
0.020
0.010
0.005
-
0.003
VERIFICATION
0.002
siat_002 tech5_002 tech5_003 ulsee_001 visionbox_001
0.050
0.030
0.020
0.010
FNMR(T)
0.005
FMR(T)
0.003
0.002
94
2019/10/16 12:43:37
alchera_000 alchera_001 ceiec_002 cognitec_001 ctbcbank_000
0.100
0.050
0.030
0.020
0.010
0.005
0.003
0.002
deepsea_001 idemia_005 isystems_001 itmo_006 lookman_004
0.100
FRVT
0.050
0.030
-
0.020

0.010
0.005 Race
0.003 B
W
0.002
pixelall_002 rankone_006 sensetime_001 sensetime_002 siat_004
0.100 Sex
F
0.050
M
0.030
0.020
0.010
0.005
-
0.003
VERIFICATION
0.002
trueface_000 vigilantsolutions_006 vigilantsolutions_007 winsense_000 x−laboratory_000
0.100
0.050
0.030
0.020
0.010
FNMR(T)
FMR(T)
0.005
0.003
0.002
95
2019/10/16 12:43:37
allgovision_000 anyvision_004 dermalog_006 f8_001 gorilla_003
0.300
0.200
0.100
0.050
0.030
0.020
0.010
0.005
0.003
0.002
id3_003 id3_004 idemia_004 itmo_005 megvii_002
0.300
FRVT
0.200
0.100
-
0.050

0.030
0.020
0.010
Race
0.005
B
0.003
W
0.002
meiya_001 nodeflux_002 sjtu_001 synesis_005 tevian_004
0.300 Sex
0.200 F
0.100 M
0.050
0.030
0.020
0.010
0.005
-
0.003
VERIFICATION
0.002
tiger_003 tongyi_005 vd_001 via_000 visionbox_000
0.300
0.200
0.100
0.050
0.030
0.020
FNMR(T)
0.010
FMR(T)
0.005
0.003
0.002
96
2019/10/16 12:43:37
3divi_003 ceiec_001 gorilla_002 iit_000 imagus_000

0.300
0.200
0.100
0.050
0.030
0.020
0.010
0.005
0.003
0.002
incode_003 innovatrics_004 intellivision_002 intelresearch_000 kakao_002
0.300
0.200
FRVT
0.100
0.050
-
0.030
0.020
0.010
Race
0.005
B
0.003
W
0.002
kneron_003 lookman_002 megvii_001 realnetworks_002 realnetworks_003
0.300
0.200 Sex
F
0.100 M
0.050
0.030
0.020
0.010
0.005
-
0.003
VERIFICATION
0.002
shu_001 smilart_003 synesis_004 upc_001 vion_000
0.300
0.200
0.100
0.050
0.030
0.020
0.010
FNMR(T)
FMR(T)
0.005
0.003
0.002
97
2019/10/16 12:43:37
adera_001 anyvision_002 aware_003 aware_004 awiros_001
0.500
0.300
0.200
0.100
0.050
0.030
0.020
0.010
0.005
0.003
0.002
cyberextruder_001 cyberextruder_002 dermalog_005 digitalbarriers_002 dsk_000
0.500
FRVT
0.300
0.200
0.100
-
0.050
0.030
0.020
0.010 Race
0.005 B
0.003 W
0.002
glory_000 glory_001 intellivision_001 microfocus_002 notiontag_000
Sex
0.500
0.300 F
0.200 M
0.100
0.050
0.030
0.020
0.010
0.005
-
0.003
VERIFICATION
0.002
shaman_001 tiger_002 veridas_001 veridas_002 yisheng_004
0.500
0.300
0.200
0.100
0.050
0.030
0.020
FNMR(T)
0.010
FMR(T)
0.005
0.003
0.002
98
2019/10/16 12:43:37
amplifiedgroup_001 ayonix_000 bm_001 chtface_001
0.500
0.300
0.200
0.100
0.050
0.030
0.020
0.010
0.005
0.003
FRVT
0.002
isap_001 isityou_000 kakao_001 microfocus_001
-
0.500
0.300
Race
0.200
B
0.100 W
0.050
0.030
0.020 Sex
F
0.010 M
0.005
0.003
0.002
nodeflux_001 saffe_001 shaman_000 videonetics_001
-
VERIFICATION
0.500
0.300
0.200
0.100
0.050
0.030
0.020
0.010
FNMR(T)
FMR(T)
0.005
0.003
0.002
1e−05 1e−04 1e−03 1e−02 1e−01 1e−05 1e−04 1e−03 1e−02 1e−01 1e−05 1e−04 1e−03 1e−02 1e−01 1e−05 1e−04 1e−03 1e−02 1e−01
99
2019/10/16 12:43:37
3divi_003 3divi_004 adera_001 alchera_000

0.600
0.400
0.300
0.200
0.100
0.080 M
0.060 M
0.040 M
M M
0.020
M M M
M
0.010 M
M M M
0.008 M M
M
0.006 M M
M
M
0.004 M
M
M
M
0.002
0.001
FRVT
alchera_001 allgovision_000 alphaface_001 amplifiedgroup_001
0.600
0.400
-
M
M
0.300

M
0.200 M
M
0.100 M
0.080
0.060 fmr_nominal
0.040
M
M
0.00001
M
0.020 M M M 0.00003
M
M 0.00010
0.010 M
0.008 M 0.00030
0.006 M
M M 0.00100
0.004 M
0.00300
M
0.002 M
0.001 M
M
anke_003 anke_004 anyvision_002 aware_003

0.600
0.400
-
0.300
VERIFICATION
0.200
0.100
0.080
0.060 M
M M
0.040 M
M M M
M
M
0.020 M
0.010 M M
0.008 M
M M
0.006 M
M
0.004 M
M M
0.002
FNMR(T)
M
M
FMR(T)
0.001
M
M
1e−04 1e−03 1e−02 1e−01 1e−04 1e−03 1e−02 1e−01 1e−04 1e−03 1e−02 1e−01 1e−04 1e−03 1e−02 1e−01
Figure 66: For the visa images, FNMR and FMR at six operating points along the DET characteristic. At each point a line is drawn between (FMR,FNMR)MALE and
(FMR,FNMR)FEMALE showing how which sex has lower FMR and/or FNMR. The ”M” label denotes male, the other end of the line corresponds to female. The six
operating thresholds are selected to give the nominal false match rates given in the legend, and are computed over all impostor pairs regardless of age, sex, and place
of birth. The plotted FMR values are broadly an order of magnitude larger than the nominal rates because FMR is computed over demographically-matched impostor
100
pairs i.e individuals of the same sex, from the same geographic region (see section 3.6.1), and the same age group (see section 3.6.2).
2019/10/16 12:43:37
aware_004 awiros_001 ayonix_000 bm_001
0.800 M M
0.600 M M
M
0.400 M M
M
0.300 M
M M M
M
M
0.200 M
M
0.100 M
0.080 M
0.060
M
0.040 M
M
0.020 M
0.010 M
0.008
0.006 M
0.004
0.002
0.001
FRVT
camvi_002 camvi_004 ceiec_001 ceiec_002
0.800
-
0.600

0.400
0.300
0.200
0.100 fmr_nominal
0.080
0.060 0.00001
0.040
0.00003
M
0.020 M 0.00010
M M M M
M M M
0.010 M M
M M M M 0.00030
0.008 M 0.00100
0.006 M M
0.004 M
0.00300
M
0.002 M
M M
0.001
chtface_001 cogent_003 cogent_004 cognitec_000

M M M M
0.800
-
0.600
VERIFICATION
0.400
0.300
0.200
0.100
0.080
0.060
0.040
0.020
0.010
0.008 M M
0.006 M M M
0.004 M
M M
M
M
M
0.002
FNMR(T)
M M
M
FMR(T)
M M
0.001 M M
M M
101
2019/10/16 12:43:37
cognitec_001 ctbcbank_000 cyberextruder_001 cyberextruder_002

0.200
M
0.100 M
0.080
0.060 M
M
M
0.040 M
M
M
0.020 M
M
M M
0.010 M M M
0.008 M M
0.006 M M
0.004 M
M M
M
0.002 M
0.001
FRVT
cyberlink_002 cyberlink_003 dahua_002 dahua_003
0.200
-
0.100
0.080
0.060
0.040
fmr_nominal
0.020
0.00001
M
0.010 M
M
M 0.00003
0.008 M
M
M M M
0.006 M 0.00010
M M
0.004 M 0.00030
M M M
M M 0.00100
0.002
M M M 0.00300
0.001 M
M
M
deepglint_001 deepsea_001 dermalog_005 dermalog_006

0.200
-
VERIFICATION
0.100 M
0.080 M
0.060 M
M
0.040 M
M M
0.020 M M M M M
M
0.010 M
0.008 M
0.006 M
M M
0.004 M
M
0.002
M
0.001 M
FNMR(T)
M
FMR(T)
102
2019/10/16 12:43:37
digitalbarriers_002 dsk_000 einetworks_000 everai_002

0.300
0.200 M
M
M
0.100 M
0.080 M
M
0.060 M M
0.040 M
M
M
0.020 M
0.010
0.008 M M
0.006 M
M
M
0.004 M
M M
0.002 M M
0.001 M
M
FRVT
everai_paravision_003 f8_001 facesoft_000 glory_000
0.300
-
0.200

0.100
0.080 M
M
0.060 M
0.040 M
M fmr_nominal
M
0.020 M M M
M
0.00001
M M
0.010 0.00003
0.008 0.00010
0.006 M
0.004 M 0.00030
M
M M 0.00100
0.002 M 0.00300
M
M
0.001 M
M M
M
glory_001 gorilla_002 gorilla_003 hik_001

0.300
0.200
-
VERIFICATION
0.100
0.080
0.060 M
M
0.040 M
M
0.020 M M
M M M
0.010
0.008 M M M
0.006 M M M
0.004 M M M
M
M
0.002 M
M
0.001
FNMR(T)
M
M
FMR(T)
103
2019/10/16 12:43:37
hr_001 hr_002 id3_003 id3_004
0.100
0.080
0.060
0.040
M
0.020 M
M
M M
0.010 M
0.008 M
M
0.006 M M
M
0.004 M M
M
M
M
M M
0.002
M
M M
0.001 M
M
M
FRVT
idemia_004 idemia_005 iit_000 iit_001
-
0.100 M

0.080
M
0.060 M
0.040 M
M
0.020 M
fmr_nominal
M
0.00001
0.010 M
M
0.008 M
M 0.00003
M
0.006 M
M
M 0.00010
M
0.004 M M 0.00030
M
0.002 M 0.00100
M
M 0.00300
0.001 M M
imagus_000 imperial_000 imperial_002 incode_003
-
0.100
VERIFICATION
0.080
0.060 M
M
0.040 M
M M M
0.020
M
0.010
0.008 M
0.006 M
M M
0.004 M
M
M
M
M
0.002 M
M
M
0.001 M
FNMR(T)
M
M
FMR(T)
M
M
104
2019/10/16 12:43:37
incode_004 innovatrics_004 innovatrics_006 intellicloudai_001

0.800
0.600
0.400
0.300
0.200
0.100
0.080
0.060
0.040
0.020
M
0.010 M M
0.008 M
M
M
0.006 M
M
M M
M
0.004 M M M
M M
M
0.002 M
M M M
M
0.001 M
FRVT
intellifusion_001 intellivision_001 intellivision_002 intelresearch_000
0.800
0.600
-
0.400

0.300
0.200
0.100 M
0.080 M
0.060 M fmr_nominal
M
0.040 M 0.00001
M M
0.020 M 0.00003
M
M M
M 0.00010
0.010
0.008 M 0.00030
0.006 M
M
M 0.00100
0.004 M M
M M 0.00300
0.002 M M
M
0.001 M
intsysmsu_000 iqface_000 isap_001 isityou_000

0.800
0.600 M
-
M M
0.400 M
VERIFICATION
M
0.300 M
M
0.200 M M
M
0.100
0.080 M
0.060
0.040 M
0.020
M
0.010 M
0.008 M M
0.006 M M
M M
0.004 M
M
0.002
FNMR(T)
M
M
FMR(T)
0.001
105
2019/10/16 12:43:37
isystems_001 isystems_002 itmo_005 itmo_006

0.600
0.400
0.300
0.200
0.100
0.080
0.060
0.040
0.020
M M
0.010 M M
M M
0.008 M M
M M
0.006 M
M
M M
M
M M
0.004 M M
M
M
0.002 M M
M
0.001
FRVT
kakao_001 kakao_002 kedacom_000 kneron_003
0.600
0.400
-
M
0.300

M
0.200
0.100 M
0.080
0.060 M
fmr_nominal
M
0.040 M
M
M
M 0.00001
M
0.020 M 0.00003
M M
M
0.010 M 0.00010
0.008 M
0.00030
0.006 M
M
0.004 M 0.00100
M M M
M 0.00300
0.002
0.001
lookman_002 lookman_004 megvii_001 megvii_002

0.600
0.400
-
0.300
VERIFICATION
0.200
0.100
0.080
0.060
0.040
M
0.020 M
M
0.010 M
0.008 M M M M
0.006 M
M
M
0.004 M M M
M
M
M M M
M
0.002
FNMR(T)
M
0.001
FMR(T)
M
M
106
2019/10/16 12:43:37
meiya_001 microfocus_001 microfocus_002 mt_000
0.800
0.600
0.400 M
0.300 M M
0.200 M M
M M
0.100
0.080 M M
0.060 M M
0.040
M
0.020
M
0.010
0.008
M
M
M
0.006 M
M
M
0.004 M M
M M
0.002 M
0.001
FRVT
neurotechnology_005 neurotechnology_006 nodeflux_001 nodeflux_002
M M
0.800 M
-
M
0.600

0.400
0.300
0.200
0.100
0.080 fmr_nominal
0.060
0.040 0.00001
0.00003
0.020
M 0.00010
0.010
0.008
M
M
M
0.00030
M M
0.006 M M
0.004 M M M 0.00100
M M
M 0.00300
0.002 M M
M
0.001 M
notiontag_000 ntechlab_006 ntechlab_007 pixelall_002
0.800
-
0.600 M
VERIFICATION
M
0.400
0.300 M
0.200 M
0.100
0.080 M
0.060
M
0.040
0.020
M
0.010
0.008
M
M
0.006 M
0.004 M M M
M M M
0.002 M M M
FNMR(T)
M
0.001 M
FMR(T)
M M
M
107
2019/10/16 12:43:37
psl_002 psl_003 rankone_006 rankone_007
0.400
0.300
0.200
0.100
0.080
0.060
0.040
0.020
M
M
0.010 M
0.008 M
M
M
0.006 M
M
M
M
0.004 M
M M M
M M
0.002 M
M
M
M
M
M
0.001 M
M
FRVT
realnetworks_002 realnetworks_003 remarkai_000 remarkai_001
0.400
-
0.300

0.200
0.100
0.080
0.060 fmr_nominal
0.040
0.00001
0.020 M M
0.00003
M M
M M
0.00010
0.010 M
0.00030
0.008 M
M M
M M
0.006 M M M 0.00100
M
0.004 M M
0.00300
M
M M
M
0.002 M M
0.001
rokid_000 saffe_001 saffe_002 sensetime_001
0.400 M
-
0.300 M
VERIFICATION
0.200 M
M
0.100 M
0.080
0.060 M
0.040
0.020
0.010 M
0.008 M M
0.006 M M M
0.004 M M
M M
M
0.002
FNMR(T)
M M
FMR(T)
M M
0.001 M M
108
2019/10/16 12:43:37
sensetime_002 sertis_000 shaman_000 shaman_001

M M M M
0.800 M M
0.600
0.400
0.300 M
0.200 M
M
0.100
0.080 M
0.060
M
0.040 M
0.020
0.010 M
0.008 M
0.006 M
M M
0.004 M
M
M
0.002 M
M M
0.001
FRVT
shu_001 siat_002 siat_004 sjtu_001
0.800
-
0.600

0.400
0.300
0.200
0.100 fmr_nominal
0.080
0.060 0.00001
0.040
0.00003
0.020 0.00010
0.010 0.00030
0.008 M M 0.00100
0.006 M
M M M
M M
0.004 M M
M M 0.00300
M M M
0.002 M M
M
M M M
0.001 M M
M
smilart_002 smilart_003 starhybrid_001 str_000
0.800
-
M
0.600
VERIFICATION
0.400 M
0.300 M
M
0.200 M M
M M
0.100
0.080 M
M M
0.060 M
0.040 M
M
0.020 M
M
M
0.010
0.008 M M
M
0.006 M
M
0.004 M M
0.002
FNMR(T)
FMR(T)
0.001
109
2019/10/16 12:43:37
synesis_004 synesis_005 tech5_002 tech5_003

0.060
0.040
M
M
0.020 M
M M M
M
0.010 M
0.008 M
0.006 M
0.004 M
M
M M M
0.002
M M
0.001 M M
M
M M
M
FRVT
tevian_004 tevian_005 tiger_002 tiger_003
0.060
-
0.040 M

M
M
0.020 M
M M M
0.010 M fmr_nominal
0.008 M M
0.006 M
M 0.00001
M
0.004 M
M 0.00003
M M M 0.00010
0.002 M M
M
M M 0.00030
M
0.001 0.00100
0.00300
tongyi_005 toshiba_002 toshiba_003 trueface_000

0.060
-
0.040
VERIFICATION
0.020 M
M
0.010 M M
0.008 M M
0.006 M M
M
M M
0.004 M M
M
M M
0.002 M
M
M
M
M M
0.001
M
FNMR(T)
M
FMR(T)
110
2019/10/16 12:43:37
ulsee_001 uluface_002 umd_000 upc_001

0.800
0.600
0.400
0.300
0.200
M
0.100 M
0.080
0.060 M
M
0.040
M
0.020 M
M
M M
0.010 M
0.008 M M
0.006 M
M
M
M
M
0.004 M
M
M
0.002 M
M
0.001 M
M
FRVT
vcog_002 vd_001 veridas_001 veridas_002
0.800 M
-
0.600 M
M

0.400
M
0.300 M
0.200 M
M
0.100 M
M
fmr_nominal
0.080 M
0.060 M
0.00001
M
0.040 M
M 0.00003
0.020 M M 0.00010
M
M 0.00030
0.010
0.008 M M M
0.00100
0.006 M
0.00300
0.004 M
M
0.002
0.001
via_000 videonetics_001 vigilantsolutions_006 vigilantsolutions_007

0.800
0.600
-
M
VERIFICATION
0.400 M
0.300 M
0.200 M
M
0.100 M
0.080
0.060 M
0.040 M
0.020
M
M M
M
0.010 M
0.008 M
M M
0.006 M
M
0.004 M
M
M
FNMR(T)
M
0.002
FMR(T)
M
M
0.001
111
2019/10/16 12:43:37
vion_000 visionbox_000 visionbox_001 visionlabs_006

0.200
0.100
0.080
0.060
0.040 M
M M M M M
M
0.020
M
M
0.010 M M
0.008 M M
0.006 M M
M
0.004 M
M
M
0.002 M
0.001 M
M
M
M
FRVT
visionlabs_007 vocord_006 vocord_007 winsense_000
0.200
-
0.100

0.080
0.060
0.040
0.020 fmr_nominal
0.010 M 0.00001
0.008 M
0.006 M
0.00003
M
0.004 M M
0.00010
M
M M 0.00030
0.002 M M M M
M 0.00100
0.001 M
M 0.00300
M M
M
M
M
M
M M
x−laboratory_000 yisheng_004 yitu_003 1e−04 1e−03 1e−02 1e−01

0.200
-
M
0.100
VERIFICATION
0.080 M
0.060
M
0.040
M
0.020
M
0.010
0.008 M
0.006 M
0.004 M
M
M
0.002
M
M
0.001
M M
FNMR(T)
FMR(T)
M M
M M
1e−04 1e−03 1e−02 1e−01 1e−04 1e−03 1e−02 1e−01 1e−04 1e−03 1e−02 1e−01
112
2019/10/16 12:43:37
alphaface_001 anke_004 camvi_004 dahua_003 deepglint_001

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
0.1 0.2 0.3 0.4 0.5 0.1 0.2 0.3 0.4 0.5 0.1 0.2 0.3 3000 4000 5000 6000 7000 1.1 1.2 1.3 1.4 1.5
everai_002 everai_paravision_003 facesoft_000 hr_002 imperial_002
1e+00
FRVT
1e−01
-
1e−02

1e−03
1e−04 Race
B
1e−05 W
2.00 2.25 2.50 2.75 2.25 2.50 2.75 1.1 1.2 1.3 1.4 1.5 0.0 0.2 0.4 0.6 0.8 1.1 1.2 1.3 1.4
innovatrics_006 intellifusion_001 psl_003 rokid_000 tevian_005
1e+00 Sex
F
1e−01 M
1e−02
1e−03
1e−04
-
VERIFICATION
1e−05
10 20 30 40 0.0 0.1 0.2 0.3 0.55 0.60 0.65 0.70 0.50 0.55 0.60 0.65 0.70 0.25 0.50 0.75 1.00
uluface_002 visionlabs_006 visionlabs_007 vocord_007 yitu_003
1e+00
1e−01
1e−02
1e−03
FNMR(T)
FMR(T)
1e−04
1e−05
0.3 0.4 0.5 0.6 0.7 0.8 0.9 0.25 0.50 0.75 0.25 0.50 0.75 994 995 996 37.00 37.25 37.50 37.75 38.00
Threshold
Figure 79: For the mugshot images, the false match calibration curves show false match rate vs. threshold. Separate curves appear for white females, black females,
113
black males and white males.
2019/10/16 12:43:37
3divi_004 anke_003 camvi_002 cogent_003 cogent_004

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
2.0 2.4 2.8 0.1 0.2 0.3 0.4 0.5 0.1 0.2 0.3 0.4 0.5 2500 2750 3000 2000 2500 3000 3500
einetworks_000 hik_001 hr_001 imperial_000 incode_004
1e+00
FRVT
1e−01
-
1e−02

1e−03
1e−04 Race
B
1e−05 W
40 50 60 55 60 65 70 0.4 0.6 0.8 1.1 1.2 1.3 1.4 1.5 1.0 1.1 1.2 1.3 1.4 1.5
intellicloudai_001 iqface_000 mt_000 ntechlab_007 psl_002
1e+00 Sex
F
1e−01 M
1e−02
1e−03
1e−04
-
VERIFICATION
1e−05
0.6 0.7 1.0 1.1 1.2 1.3 1.4 1.5 1.0 1.1 1.2 1.3 1.4 1.5 1.2 1.4 1.6 0.0 0.1 0.2 0.3 0.4
sertis_000 starhybrid_001 toshiba_002 toshiba_003 vocord_006
1e+00
1e−01
1e−02
1e−03
FNMR(T)
FMR(T)
1e−04
1e−05
0.55 0.60 0.65 0.70 0.75 0.0 0.1 0.2 0.3 0.4 0.50 0.55 0.60 0.65 0.50 0.55 0.60 0.65 993 994 995 996
Threshold
114
2019/10/16 12:43:37
cognitec_000 cyberlink_002 cyberlink_003 dahua_002 iit_001

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
0.3 0.4 0.5 0.6 1.0 1.1 1.2 1.3 1.4 1.5 1.1 1.2 1.3 1.4 1.5 4000 6000 8000 0.50 0.55 0.60 0.65 0.70 0.75
intsysmsu_000 isystems_002 kedacom_000 neurotechnology_005 neurotechnology_006
1e+00
FRVT
1e−01
-
1e−02

1e−03
1e−04 Race
B
1e−05 W
1.0 1.1 1.2 1.3 1.4 1.5 0.50 0.55 0.60 0.65 0.70 0.75 0.5 0.6 0.7 0 20 40 60 500 1000 1500 2000 2500
ntechlab_006 rankone_007 remarkai_000 remarkai_001 saffe_002
1e+00 Sex
F
1e−01 M
1e−02
1e−03
1e−04
-
VERIFICATION
1e−05
1.7 1.8 1.9 2.0 2.1 0.0 0.2 0.4 0.6 50 60 70 50 60 70 0.0 0.1 0.2 0.3 0.4 0.5
siat_002 tech5_002 tech5_003 ulsee_001 visionbox_001
1e+00
1e−01
1e−02
1e−03
FNMR(T)
FMR(T)
1e−04
1e−05
0.3 0.4 0.5 0.6 0.7 146.5 147.0 147.5 148.0 146 147 148 0.0 0.1 0.2 0.3 0.4 0.5 0.0 0.1 0.2 0.3 0.4 0.5
Threshold
115
2019/10/16 12:43:37
alchera_000 alchera_001 ceiec_002 cognitec_001 ctbcbank_000

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
0.50 0.55 0.60 0.65 0.70 0.75 0.5 0.6 0.7 −0.1 0.0 0.1 0.2 0.3 0.4 0.5 0.3 0.4 0.5 0.6 3.00 3.25 3.50 3.75
deepsea_001 idemia_005 isystems_001 itmo_006 lookman_004
1e+00
FRVT
1e−01
-
1e−02

1e−03
1e−04 Race
B
1e−05 W
1.0 1.1 1.2 1.3 1.4 1.52000 3000 4000 0.50 0.55 0.60 0.65 0.70 0.75 0 100 200 300 0.6 0.7
pixelall_002 rankone_006 sensetime_001 sensetime_002 siat_004
1e+00 Sex
F
1e−01 M
1e−02
1e−03
1e−04
-
VERIFICATION
1e−05
0.1 0.2 0.3 0.4 0.5 0.0 0.2 0.4 0.6 0.8 0.3 0.4 0.5 0.6 0.7 0.3 0.4 0.5 0.6 0.7 0.3 0.4 0.5 0.6 0.7 0.8
trueface_000 vigilantsolutions_006 vigilantsolutions_007 winsense_000 x−laboratory_000
1e+00
1e−01
1e−02
1e−03
FNMR(T)
FMR(T)
1e−04
1e−05
0.0 0.1 0.2 0.3 0.4 2.00 2.25 2.50 2.75 3.00 2.00 2.25 2.50 2.75 3.00 0.0 0.2 0.4 0.0 0.2 0.4 0.6
Threshold
116
2019/10/16 12:43:37
allgovision_000 anyvision_004 dermalog_006 f8_001 gorilla_003

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
0.0 0.2 0.4 1.1 1.2 1.3 1.4 1.5 20 40 60 80 0.0 0.2 0.4 0.0 0.2 0.4 0.6
id3_003 id3_004 idemia_004 itmo_005 megvii_002
1e+00
FRVT
1e−01
-
1e−02

1e−03
1e−04 Race
B
1e−05 W
33000 35000 37000 32000 34000 36000 38000 2000 3000 4000 5000 0 100 200 300 20 40 60 80
meiya_001 nodeflux_002 sjtu_001 synesis_005 tevian_004
1e+00 Sex
F
1e−01 M
1e−02
1e−03
1e−04
-
VERIFICATION
1e−05
0.0 0.2 0.4 0.6 0.35 0.40 0.45 0.50 0.8 1.0 1.2 1.4 0.0 0.1 0.2 0.3 0.4 0.50.2 0.4 0.6 0.8 1.0
tiger_003 tongyi_005 vd_001 via_000 visionbox_000
1e+00
1e−01
1e−02
1e−03
FNMR(T)
FMR(T)
1e−04
1e−05
110 120 130 140 150 42.75 43.00 43.25 43.50 43.75 50 60 70 80 2.00 2.25 2.50 2.75 3.00 0.0 0.2 0.4
Threshold
117
2019/10/16 12:43:37
3divi_003 ceiec_001 gorilla_002 iit_000 imagus_000

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
2.00 2.25 2.50 2.75 3.00 0.0 0.2 0.4 0.0 0.2 0.4 0.6 0.5 0.6 0.7 0.5 0.7 0.9 1.1
incode_003 innovatrics_004 intellivision_002 intelresearch_000 kakao_002
1e+00
FRVT
1e−01
-
1e−02

1e−03
1e−04 Race
B
1e−05 W
1.0 1.2 1.4 1.6 0 10 20 30 40 0 10 20 30 40 480 520 560 600 0.7 0.8 0.9 1.0
kneron_003 lookman_002 megvii_001 realnetworks_002 realnetworks_003
1e+00 Sex
F
1e−01 M
1e−02
1e−03
1e−04
-
VERIFICATION
1e−05
0.0 0.2 0.4 0.6 0.5 0.6 0.7 20 40 60 80 0.6 0.7 0.8 0.9 1.0 0.6 0.7 0.8 0.9 1.0
shu_001 smilart_003 synesis_004 upc_001 vion_000
1e+00
1e−01
1e−02
1e−03
FNMR(T)
FMR(T)
1e−04
1e−05
0.0 0.2 0.4 0.6 0.0 0.2 0.4 0.6 0.0 0.2 0.4 0.6 0.8 0.2 0.4 0.6 0.0 0.2 0.4
Threshold
118
2019/10/16 12:43:37
adera_001 anyvision_002 aware_003 aware_004 awiros_001

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
0.2 0.4 0.6 0.8 1.0 1.2 1.4 1.6 0 2 4 0 2 4 6 8 0.74 0.76 0.78 0.80
cyberextruder_001 cyberextruder_002 dermalog_005 digitalbarriers_002 dsk_000
1e+00
FRVT
1e−01
-
1e−02

1e−03
1e−04 Race
B
1e−05 W
0.0 0.2 0.4 0.6 0.8 0.0 0.2 0.4 0.6 20 40 60 80 0.0 0.2 0.4 0.6 0.8 1.0 1.2
glory_000 glory_001 intellivision_001 microfocus_002 notiontag_000
1e+00 Sex
F
1e−01 M
1e−02
1e−03
1e−04
-
VERIFICATION
1e−05
0.50 0.55 0.60 0.65 0.50 0.55 0.60 0.65 0 20 40 0.3 0.4 0.5 0.6 6 8 10 12
shaman_001 tiger_002 veridas_001 veridas_002 yisheng_004
1e+00
1e−01
1e−02
1e−03
FNMR(T)
FMR(T)
1e−04
1e−05
0.2 0.4 0.6 120 140 160 1 2 3 1 2 3 4.4 4.8 5.2 5.6
Threshold
119
2019/10/16 12:43:37
amplifiedgroup_001 ayonix_000 bm_001 chtface_001

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FRVT
2.0 2.5 3.0 3.5 0.00 0.25 0.50 0.75 1.00 0.0 0.2 0.4 0.6 0.8 0 50 100 150 200 250
isap_001 isityou_000 kakao_001 microfocus_001
-
1e+00
1e−01 Race
B
W
1e−02
1e−03 Sex
F
1e−04 M
1e−05
0.00 0.25 0.50 0.75 1.00 10 20 30 40 50 0.9 1.1 1.3 1.5 0.4 0.5 0.6 0.7
nodeflux_001 saffe_001 shaman_000 videonetics_001
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
FNMR(T)
1e−04
FMR(T)
1e−05
0.4 0.6 0.8 0.0 0.2 0.4 0.6 0.8 0.00 0.25 0.50 0.75 1.000.00 0.25 0.50 0.75
Threshold
120
2019/10/16 12:43:37
deepglint_001 everai_paravision_003 hr_002 tech5_002

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
1.1 1.2 1.3 1.4 1.5 2.00 2.25 2.50 2.75 3.00 −1.0 −0.5 0.0 0.5 146 147 148
tech5_003 tevian_005 visionlabs_006 visionlabs_007
-
1e+00
1e−01
1e−02
1e−03 kind
matched−covariates
1e−04 zero−effort
1e−05
1e−06
1e−07
145 146 147 148 −1.0 −0.5 0.0 0.5 1.0 0.25 0.50 0.75 1.00 0.25 0.50 0.75
vocord_007 yitu_003
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
993 994 995 996 37.2 37.5 37.8 38.1
Threshold
Figure 87: For the visa images, the false match calibration curves show FMR vs. threshold, T. The blue (lower) curves are for zero-effort impostors (i.e. comparing all
images against all). The red (upper) curves are for persons of the same-sex, same-age, and same national-origin. This shows that FMR is underestimated (by a factor of
121
10 or more) by using a zero-effort impostor calculation to calibrate T. As shown later (sec. 3.6), FMR is higher for demographic-matched impostors.
2019/10/16 12:43:37
dahua_003 hr_001 imperial_000 imperial_002

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
3000 4000 5000 6000 7000 0.4 0.6 0.8 1.1 1.2 1.3 1.4 1.5 1.1 1.2 1.3 1.4 1.5
innovatrics_006 kedacom_000 ntechlab_007 sensetime_001
-
1e+00
1e−01
1e−02
1e−03 kind
1e−05
1e−06
1e−07
10 20 30 40 50 0.5 0.6 0.7 1.0 1.2 1.4 1.6 0.3 0.4 0.5 0.6 0.7 0.8 0.9
sjtu_001 vocord_006
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
−1.0 −0.5 0.0 0.5 1.0 1.5 993 994 995 996 997
Threshold
122
2019/10/16 12:43:37
alphaface_001 cogent_004 facesoft_000 intellifusion_001

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
0.0 0.2 0.4 0.62000 2500 3000 3500 1.1 1.2 1.3 1.4 1.5 0.0 0.1 0.2 0.3 0.4
ntechlab_006 psl_003 sensetime_002 siat_004
-
1e+00
1e−01
1e−02
1e−03 kind
1e−05
1e−06
1e−07
1.7 1.8 1.9 2.0 2.1 −1.0 −0.5 0.0 0.5 0.3 0.4 0.5 0.6 0.7 0.8 0.9 0.4 0.6 0.8
tongyi_005 uluface_002
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
43.0 43.4 43.8 0.4 0.6 0.8 1.0
Threshold
123
2019/10/16 12:43:37
anke_004 hik_001 incode_004 iqface_000

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
0.0 0.2 0.4 0.6 50 55 60 65 70 75 1.0 1.2 1.4 1.6 1.0 1.2 1.4
lookman_004 megvii_002 neurotechnology_006 rokid_000
-
1e+00
1e−01
1e−02
1e−03 kind
1e−05
1e−06
1e−07
0.60 0.65 0.70 0.75 0.80 20 40 60 80 1000 2000 0.5 0.6 0.7
siat_002 x−laboratory_000
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
0.3 0.4 0.5 0.6 0.7 0.8 −1.0 −0.5 0.0 0.5
Threshold
124
2019/10/16 12:43:37
3divi_004 cogent_003 cognitec_000 einetworks_000

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
2.1 2.4 2.7 3.0 3.32400 2600 2800 3000 3200 0.4 0.5 0.6 40 50 60
everai_002 iit_001 mt_000 psl_002
-
1e+00
1e−01
1e−02
1e−03 kind
1e−05
1e−06
1e−07
2.00 2.25 2.50 2.75 3.00 0.5 0.6 0.7 0.8 1.0 1.2 1.4 1.6 0.0 0.1 0.2 0.3 0.4 0.5
shu_001 starhybrid_001
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
−1.0 −0.5 0.0 0.5 0.0 0.1 0.2 0.3 0.4 0.5
Threshold
125
2019/10/16 12:43:37
anke_003 camvi_002 cognitec_001 cyberlink_002

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
0.0 0.2 0.4 0.6 0.0 0.2 0.4 0.6 0.4 0.5 0.6 1.0 1.2 1.4 1.6
cyberlink_003 isystems_002 saffe_002 sertis_000
-
1e+00
1e−01
1e−02
1e−03 kind
1e−05
1e−06
1e−07
−1 0 1 0.5 0.6 0.7 0.8 0.0 0.2 0.4 0.6 −1.0 −0.5 0.0 0.5
toshiba_002 toshiba_003
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
0.50 0.55 0.60 0.65 0.70 0.50 0.55 0.60 0.65 0.70
Threshold
126
2019/10/16 12:43:37
dahua_002 idemia_005 incode_003 intellicloudai_001

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
3000 4000 5000 6000 7000 8000 9000 0 2000 4000 1.0 1.2 1.4 1.6 0.5 0.6 0.7 0.8
intsysmsu_000 itmo_006 megvii_001 remarkai_000
-
1e+00
1e−01
1e−02
1e−03 kind
1e−05
1e−06
1e−07
1.0 1.2 1.4 1.6 0 200 400 600 20 40 60 80 50 60 70 80
remarkai_001 winsense_000
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
50 60 70 80 0.0 0.2 0.4 0.6
Threshold
127
2019/10/16 12:43:37
alchera_000 ctbcbank_000 deepsea_001 gorilla_003

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
0.6 0.7 0.83.0 3.3 3.6 3.9 1.0 1.1 1.2 1.3 1.4 1.5 0.0 0.2 0.4 0.6
idemia_004 isystems_001 neurotechnology_005 synesis_005
-
1e+00
1e−01
1e−02
1e−03 kind
1e−05
1e−06
1e−07
2000 3000 4000 5000 0.5 0.6 0.7 0.8 0 20 40 60 80 0.0 0.2 0.4
ulsee_001 visionbox_001
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
0.0 0.2 0.4 0.6 0.8 0.0 0.2 0.4 0.6
Threshold
128
2019/10/16 12:43:37
alchera_001 camvi_004 ceiec_002 innovatrics_004

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
0.5 0.6 0.7 0.8 0.0 0.2 0.4 0.6 0.0 0.2 0.4 10 20 30 40 50
itmo_005 meiya_001 nodeflux_002 pixelall_002
-
1e+00
1e−01
1e−02
1e−03 kind
1e−05
1e−06
1e−07
0 200 400 600 0.2 0.4 0.6 0.35 0.40 0.45 0.50 0.55 0.2 0.4 0.6
tevian_004 vigilantsolutions_007
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
0.25 0.50 0.75 1.002.0 2.5 3.0
Threshold
129
2019/10/16 12:43:37
anyvision_004 gorilla_002 id3_004 rankone_006

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
1.0 1.1 1.2 1.3 1.4 1.5 0.2 0.4 0.6 33000 34000 35000 36000 37000 38000 390000.00 0.25 0.50 0.75 1.00
rankone_007 realnetworks_002 realnetworks_003 trueface_000
-
1e+00
1e−01
1e−02
1e−03 kind
1e−05
1e−06
1e−07
0.25 0.50 0.75 0.6 0.7 0.8 0.9 1.0 0.6 0.7 0.8 0.9 1.0 0.00 0.25 0.50 0.75
vd_001 via_000
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
50 60 70 80 1.0 1.5 2.0 2.5 3.0
Threshold
130
2019/10/16 12:43:37
3divi_003 ceiec_001 dermalog_006 f8_001

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
2.1 2.4 2.7 3.0 0.2 0.4 0.6 30 50 70 900.0 0.2 0.4 0.6
intelresearch_000 lookman_002 synesis_004 tiger_003
-
1e+00
1e−01
1e−02
1e−03 kind
1e−05
1e−06
1e−07
0 200 400 600 0.5 0.6 0.7 0.8 0.00 0.25 0.50 0.75 120 140 160
upc_001 visionbox_000
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
0.2 0.4 0.6 0.0 0.2 0.4 0.6
Threshold
131
2019/10/16 12:43:37
allgovision_000 anyvision_002 aware_003 aware_004

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
0.0 0.2 0.4 0.6 1.0 1.2 1.4 1.6 0 2 4 6 0.0 2.5 5.0 7.5
id3_003 imagus_000 kakao_002 kneron_003
-
1e+00
1e−01
1e−02
1e−03 kind
1e−05
1e−06
1e−07
34000 36000 38000 0.6 0.8 1.0 1.2 0.8 1.0 1.2 0.0 0.2 0.4 0.6
tiger_002 vion_000
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
120 140 160 0.0 0.2 0.4 0.6
Threshold
132
2019/10/16 12:43:37
adera_001 cyberextruder_002 dermalog_005 glory_000

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
0.3 0.5 0.7 0.9 0.2 0.4 0.6 25 50 75 0.50 0.55 0.60 0.65
glory_001 iit_000 intellivision_001 intellivision_002
-
1e+00
1e−01
1e−02
1e−03 kind
1e−05
1e−06
1e−07
0.50 0.55 0.60 0.65 0.6 0.7 0.8 0 20 40 60 0 20 40 60
veridas_002 vigilantsolutions_006
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
1 2 3 42.0 2.4 2.8 3.2 3.6
Threshold
133
2019/10/16 12:43:37
cyberextruder_001 digitalbarriers_002 dsk_000 microfocus_002

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
0.3 0.4 0.5 0.6 0.7 0.8 0.2 0.4 0.6 0.8 0.8 1.0 1.2 0.3 0.4 0.5 0.6 0.7
shaman_001 smilart_002 str_000 umd_000
-
1e+00
1e−01
1e−02
1e−03 kind
1e−05
1e−06
1e−07
0.4 0.6 0.8 0.2 0.4 0.6 0.8 0.9 1.1 1.3 8.2 8.4 8.6 8.8
veridas_001 yisheng_004
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
1 2 3 5.0 5.5 6.0
Threshold
134
2019/10/16 12:43:37
amplifiedgroup_001 awiros_001 ayonix_000 isap_001

1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
1e−06
1e−07
FRVT
2.5 3.0 3.5 −1.0 −0.5 0.0 0.5 0.00 0.25 0.50 0.75 1.00 0.25 0.50 0.75 1.00
isityou_000 kakao_001 microfocus_001 notiontag_000
-
1e+00
1e−01
1e−02
1e−03 kind
1e−05
1e−06
1e−07
10 20 30 40 50 0.8 1.0 1.2 1.4 0.5 0.6 0.7 6.55378e+307
saffe_001 videonetics_001
-
VERIFICATION
1e+00
1e−01
1e−02
1e−03
1e−04
1e−05
FNMR(T)
FMR(T)
1e−06
1e−07
0.2 0.4 0.6 0.8 0.25 0.50 0.75
Threshold
135
2019/10/16 12:43:37
bm_001 chtface_001 nodeflux_001
1e+00
1e−01
1e−02
1e−03
1e−04
FRVT
1e−05
-
1e−06
1e−07
kind
0.25 0.50 0.75 0 20000 40000 60000 0.4 0.6 0.8 1.0
shaman_000 smilart_003 vcog_002 zero−effort
1e+00
1e−01
1e−02
-
VERIFICATION
1e−03
1e−04
1e−05
1e−06
FNMR(T)
FMR(T)
1e−07
0.00 0.25 0.50 0.75 1.00 0.00 0.25 0.50 0.75 0.0 0.2 0.4 0.6 0.8
Threshold
136
gorilla_002
3divi_003 3divi_004 adera_001 alchera_000 alchera_001 allgovision_000 alphaface_001amplifiedgroup_001 anke_003 anke_004 anyvision_002 anyvision_004 aware_003 gorilla_003
2019/10/16 12:43:37
1e−04
9e−05
8e−05 hik_001
7e−05
6e−05
5e−05
4e−05
3e−05 hr_001
2e−05 hr_002
1e−05 id3_003
aware_004 awiros_001 ayonix_000 bm_001 camvi_002 camvi_004 ceiec_001 ceiec_002 chtface_001 cogent_003 cogent_004 cognitec_000 cognitec_001 id3_004
1e−04
9e−05
8e−05 idemia_004
7e−05
6e−05
5e−05
4e−05 idemia_005
3e−05
2e−05 iit_000
1e−05 iit_001
ctbcbank_000 cyberextruder_001
cyberextruder_002 cyberlink_002 cyberlink_003 dahua_002 dahua_003 deepglint_001 deepsea_001 dermalog_005 dermalog_006digitalbarriers_002 dsk_000 imagus_000
1e−04
9e−05
8e−05 imperial_000
7e−05
6e−05
5e−05
4e−05 imperial_002
3e−05
2e−05 incode_003
1e−05 incode_004
einetworks_000 everai_002everai_paravision_003 f8_001 facesoft_000 glory_000 glory_001 gorilla_002 gorilla_003 hik_001 hr_001 hr_002 id3_003 innovatrics_004
1e−04
9e−05
8e−05 innovatrics_006
7e−05
6e−05
5e−05
4e−05 intellicloudai_001
3e−05
2e−05 intellifusion_001
1e−05 intellivision_001
FRVT
id3_004 idemia_004 idemia_005 iit_000 iit_001 imagus_000 imperial_000 imperial_002 incode_003 incode_004 innovatrics_004 innovatrics_006intellicloudai_001 intellivision_002
1e−04
9e−05
8e−05 intelresearch_000
7e−05
6e−05
5e−05
4e−05 intsysmsu_000
3e−05
-
2e−05 iqface_000

1e−05 isap_001
intellifusion_001 intellivision_001 intellivision_002intelresearch_000intsysmsu_000 iqface_000 isap_001 isityou_000 isystems_001 isystems_002 itmo_005 itmo_006 kakao_001 isityou_000
1e−04
9e−05
8e−05 isystems_001
FMR after rejection
7e−05
6e−05
5e−05
4e−05 isystems_002
3e−05
2e−05 itmo_005
1e−05 itmo_006
kakao_002 kedacom_000 kneron_003 lookman_002 lookman_004 megvii_001 megvii_002 meiya_001 microfocus_001 microfocus_002 mt_000 neurotechnology_005
neurotechnology_006 kakao_001
1e−04
9e−05
8e−05 kakao_002
7e−05
6e−05
5e−05
4e−05 kedacom_000
3e−05
2e−05 kneron_003
1e−05 lookman_002
nodeflux_001 nodeflux_002 notiontag_000 ntechlab_006 ntechlab_007 pixelall_002 psl_002 psl_003 rankone_006 rankone_007 realnetworks_002
realnetworks_003 remarkai_000 lookman_004
1e−04
9e−05
8e−05 megvii_001
7e−05
6e−05
5e−05
4e−05 megvii_002
3e−05 meiya_001
2e−05
1e−05 microfocus_001
remarkai_001 rokid_000 saffe_001 saffe_002 sensetime_001 sensetime_002 sertis_000 shaman_000 shaman_001 shu_001 siat_002 siat_004 sjtu_001 microfocus_002
1e−04
9e−05 mt_000
8e−05
7e−05
-
6e−05
5e−05 neurotechnology_005
4e−05
VERIFICATION
3e−05 neurotechnology_006
2e−05
1e−05 nodeflux_001
smilart_002 smilart_003 starhybrid_001 str_000 synesis_004 synesis_005 tech5_002 tech5_003 tevian_004 tevian_005 tiger_002 tiger_003 tongyi_005 nodeflux_002
1e−04
9e−05 notiontag_000
8e−05
7e−05
6e−05
5e−05
4e−05 ntechlab_006
3e−05 ntechlab_007
2e−05
1e−05 pixelall_002
psl_002
toshiba_002 toshiba_003 trueface_000 ulsee_001 uluface_002 umd_000 upc_001 vcog_002 vd_001 veridas_001 veridas_002 via_000 videonetics_001
1e−04
9e−05 psl_003
8e−05
7e−05
6e−05
5e−05 rankone_006
4e−05
3e−05 rankone_007
FNMR(T)
2e−05
FMR(T)
1e−05 realnetworks_002
realnetworks_003
vigilantsolutions_006
vigilantsolutions_007 vion_000 visionbox_000 visionbox_001 visionlabs_006 visionlabs_007 vocord_006 vocord_007 winsense_000 x−laboratory_000 yisheng_004 yitu_003
1e−04 remarkai_000
9e−05
8e−05
7e−05
6e−05
5e−05 remarkai_001
4e−05
3e−05
2e−05 rokid_000
1e−05 saffe_001
02500
5000
7500
1000002500
5000
7500
1000002500
5000
7500
1000002500
5000
7500
1000002500
5000
7500
1000002500
5000
7500
1000002500
5000
7500
1000002500
5000
7500
1000002500
5000
7500
1000002500
5000
7500
1000002500
5000
7500
1000002500
5000
7500
1000002500
5000
7500
10000 saffe_002
sensetime_001
Number of worst−false−matching images rejected
sensetime_002
Figure 103: For the visa images, the curves show how false matches are concentrated in certain images. Specifically each line plots FMR(k) with k the number of images
rejected in decreasing order of how many false matches that image was involved in. FMR(0) = 10−4 . In terms of the biometric zoo, the most “wolf-ish” images are
rejected first i.e. those enrollment or verification images most often involved in false matches. A flatter response is considered superior. A steeply descending response
137
indicates that certain kinds of images false match against others, e.g. if hypothetically images of men with particular mustaches would falsely match others.
3.5 Genuine distribution stability
3.5.1 Effect of birth place on the genuine distribution
Background: Both skin tone and bone structure vary geographically. Prior studies have reported variations in FNMR
and FMR.
Goal: To measure false non-match rate (FNMR) variation with country of birth.
Methods: Thresholds are determined that give FMR = {0.001, 0.0001} over the entire impostor set. Then FNMR is mea-
sured over 1000 bootstrap replications of the genuine scores. Only those countries with at least 140 individuals are
included in the analysis.
Results: Figure 116 shows FNMR by country of birth for the two thresholds.

2019/10/16 12:43:37
2019/10/16 12:43:37

VENZ
ECUA
ELSL
NRA
SARB
DOMR
MEX
BRZL
ARG
GRBR
POL
UKR
CUBA
PERU
KOR
JAM
RUS
IND
TWAN
HAT
GUAT
JPN
PHIL
THAI
VTNM
FRVT
CHIN
-
VENZ
ECUA

ELSL
NRA
SARB
DOMR
MEX
BRZL
ARG
Country of birth
GRBR
POL
UKR fmr_nominal
CUBA
PERU 0.0001
KOR 0.001
JAM
RUS
IND
TWAN
HAT
GUAT
JPN
PHIL
THAI
VTNM
CHIN
anke_003 anke_004 anyvision_002 anyvision_004
-
VERIFICATION
VENZ
ECUA
ELSL
NRA
SARB
DOMR
MEX
BRZL
ARG
GRBR
POL
UKR
CUBA
PERU
KOR
JAM
FNMR(T)
RUS
FMR(T)
IND
TWAN
HAT
GUAT
JPN
PHIL
THAI
VTNM
CHIN
0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3
False non−match rate (FNMR) +/− 99% bootstrap CI
Figure 104: For the visa images, the dots show FNMR by country of birth for two globally set operating thresholds corresponding to FMR = {0.001, 0.0001} computed
over all on the order of 1010 impostor scores. The FMR in each bin will vary also - see subsequent impostor heatmaps in sec. 3.6.1. The figures shows an order of
magnitude variation in FNMR across country of birth; these effects are likely due quality variations, then demographics like age and race. The error rates in some cases
139
are zero, and in others the DET is flat so the error rates at the two thresholds are identical. The lines span 1% and 99% of boostrap replicated FNMR estimates.
2019/10/16 12:43:37
aware_003 aware_004 awiros_001 ayonix_000

VENZ
NRA
ECUA
JAM
ELSL
DOMR
GRBR
HAT
CUBA
MEX
BRZL
KOR
POL
ARG
JPN
UKR
SARB
GUAT
RUS
PERU
THAI
IND
PHIL
TWAN
VTNM
FRVT
CHIN
bm_001 camvi_002 camvi_004 ceiec_001
-
VENZ
NRA

ECUA
JAM
ELSL
DOMR
GRBR
HAT
CUBA
Country of birth
MEX
BRZL
KOR fmr_nominal
POL
ARG 0.0001
JPN 0.001
UKR
SARB
GUAT
RUS
PERU
THAI
IND
PHIL
TWAN
VTNM
CHIN
ceiec_002 cogent_003 cogent_004 cognitec_000
-
VERIFICATION
VENZ
NRA
ECUA
JAM
ELSL
DOMR
GRBR
HAT
CUBA
MEX
BRZL
KOR
POL
ARG
JPN
UKR
FNMR(T)
SARB
FMR(T)
GUAT
RUS
PERU
THAI
IND
PHIL
TWAN
VTNM
CHIN
0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3
140
2019/10/16 12:43:37
cognitec_001 ctbcbank_000 cyberextruder_001 cyberextruder_002

VENZ
ECUA
NRA
ELSL
KOR
SARB
MEX
GRBR
JAM
RUS
BRZL
POL
HAT
CUBA
ARG
UKR
TWAN
DOMR
JPN
PHIL
PERU
THAI
IND
CHIN
VTNM
FRVT
GUAT
cyberlink_002 cyberlink_003 dahua_002 dahua_003
-
VENZ
ECUA

NRA
ELSL
KOR
SARB
MEX
GRBR
JAM
Country of birth
RUS
BRZL
POL fmr_nominal
HAT
CUBA 0.0001
ARG 0.001
UKR
TWAN
DOMR
JPN
PHIL
PERU
THAI
IND
CHIN
VTNM
GUAT
deepglint_001 deepsea_001 dermalog_005 dermalog_006
-
VERIFICATION
VENZ
ECUA
NRA
ELSL
KOR
SARB
MEX
GRBR
JAM
RUS
BRZL
POL
HAT
CUBA
ARG
UKR
FNMR(T)
TWAN
FMR(T)
DOMR
JPN
PHIL
PERU
THAI
IND
CHIN
VTNM
GUAT
0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3
141
2019/10/16 12:43:37
digitalbarriers_002 dsk_000 einetworks_000 everai_002

VENZ
ECUA
KOR
ELSL
GRBR
TWAN
SARB
NRA
MEX
JPN
BRZL
POL
RUS
HAT
ARG
JAM
UKR
DOMR
PERU
PHIL
THAI
IND
CUBA
VTNM
GUAT
FRVT
CHIN
everai_paravision_003 f8_001 facesoft_000 glory_000
-
VENZ
ECUA

KOR
ELSL
GRBR
TWAN
SARB
NRA
MEX
Country of birth
JPN
BRZL
POL fmr_nominal
RUS
HAT 0.0001
ARG 0.001
JAM
UKR
DOMR
PERU
PHIL
THAI
IND
CUBA
VTNM
GUAT
CHIN
glory_001 gorilla_002 gorilla_003 hik_001
-
VERIFICATION
VENZ
ECUA
KOR
ELSL
GRBR
TWAN
SARB
NRA
MEX
JPN
BRZL
POL
RUS
HAT
ARG
JAM
FNMR(T)
UKR
FMR(T)
DOMR
PERU
PHIL
THAI
IND
CUBA
VTNM
GUAT
CHIN
0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3
142
2019/10/16 12:43:37
hr_001 hr_002 id3_003 id3_004

VENZ
ECUA
ELSL
POL
SARB
DOMR
KOR
NRA
MEX
JAM
TWAN
BRZL
RUS
ARG
PHIL
UKR
GRBR
THAI
HAT
IND
PERU
JPN
VTNM
GUAT
CUBA
FRVT
CHIN
idemia_004 idemia_005 iit_000 iit_001
-
VENZ
ECUA

ELSL
POL
SARB
DOMR
KOR
NRA
MEX
Country of birth
JAM
TWAN
BRZL fmr_nominal
RUS
ARG 0.0001
PHIL 0.001
UKR
GRBR
THAI
HAT
IND
PERU
JPN
VTNM
GUAT
CUBA
CHIN
imagus_000 imperial_000 imperial_002 incode_003
-
VERIFICATION
VENZ
ECUA
ELSL
POL
SARB
DOMR
KOR
NRA
MEX
JAM
TWAN
BRZL
RUS
ARG
PHIL
UKR
FNMR(T)
GRBR
FMR(T)
THAI
HAT
IND
PERU
JPN
VTNM
GUAT
CUBA
CHIN
0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3
143
2019/10/16 12:43:37
incode_004 innovatrics_004 innovatrics_006 intellicloudai_001

VENZ
ECUA
GRBR
ELSL
KOR
BRZL
ARG
MEX
NRA
POL
JPN
TWAN
DOMR
HAT
THAI
PERU
RUS
UKR
SARB
JAM
PHIL
CUBA
VTNM
IND
CHIN
FRVT
GUAT
intellifusion_001 intellivision_001 intellivision_002 intelresearch_000
-
VENZ
ECUA

GRBR
ELSL
KOR
BRZL
ARG
MEX
NRA
Country of birth
POL
JPN
TWAN fmr_nominal
DOMR
HAT 0.0001
THAI 0.001
PERU
RUS
UKR
SARB
JAM
PHIL
CUBA
VTNM
IND
CHIN
GUAT
intsysmsu_000 iqface_000 isap_001 isityou_000
-
VERIFICATION
VENZ
ECUA
GRBR
ELSL
KOR
BRZL
ARG
MEX
NRA
POL
JPN
TWAN
DOMR
HAT
THAI
PERU
FNMR(T)
RUS
FMR(T)
UKR
SARB
JAM
PHIL
CUBA
VTNM
IND
CHIN
GUAT
0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3
144
2019/10/16 12:43:37
isystems_001 isystems_002 itmo_005 itmo_006

VENZ
ECUA
ELSL
SARB
MEX
ARG
KOR
BRZL
DOMR
GRBR
UKR
PERU
NRA
POL
RUS
TWAN
HAT
IND
JAM
GUAT
THAI
PHIL
JPN
CUBA
VTNM
FRVT
CHIN
kakao_001 kakao_002 kedacom_000 kneron_003
-
VENZ
ECUA

ELSL
SARB
MEX
ARG
KOR
BRZL
DOMR
Country of birth
GRBR
UKR
PERU fmr_nominal
NRA
POL 0.0001
RUS 0.001
TWAN
HAT
IND
JAM
GUAT
THAI
PHIL
JPN
CUBA
VTNM
CHIN
lookman_002 lookman_004 megvii_001 megvii_002
-
VERIFICATION
VENZ
ECUA
ELSL
SARB
MEX
ARG
KOR
BRZL
DOMR
GRBR
UKR
PERU
NRA
POL
RUS
TWAN
FNMR(T)
HAT
FMR(T)
IND
JAM
GUAT
THAI
PHIL
JPN
CUBA
VTNM
CHIN
0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3
145
2019/10/16 12:43:37
meiya_001 microfocus_001 microfocus_002 mt_000

VENZ
ECUA
ELSL
GRBR
KOR
MEX
BRZL
ARG
POL
NRA
UKR
JAM
PERU
SARB
TWAN
JPN
HAT
RUS
DOMR
CUBA
THAI
GUAT
IND
PHIL
VTNM
FRVT
CHIN
neurotechnology_005 neurotechnology_006 nodeflux_002 notiontag_000
-
VENZ
ECUA

ELSL
GRBR
KOR
MEX
BRZL
ARG
POL
Country of birth
NRA
UKR
JAM fmr_nominal
PERU
SARB 0.0001
TWAN 0.001
JPN
HAT
RUS
DOMR
CUBA
THAI
GUAT
IND
PHIL
VTNM
CHIN
ntechlab_006 ntechlab_007 pixelall_002 psl_002
-
VERIFICATION
VENZ
ECUA
ELSL
GRBR
KOR
MEX
BRZL
ARG
POL
NRA
UKR
JAM
PERU
SARB
TWAN
JPN
FNMR(T)
HAT
FMR(T)
RUS
DOMR
CUBA
THAI
GUAT
IND
PHIL
VTNM
CHIN
0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3
146
2019/10/16 12:43:37
psl_003 rankone_006 rankone_007 realnetworks_002

VENZ
ECUA
ELSL
MEX
GRBR
ARG
POL
BRZL
KOR
SARB
UKR
PERU
NRA
JPN
HAT
RUS
TWAN
CUBA
THAI
DOMR
JAM
PHIL
IND
GUAT
CHIN
FRVT
VTNM
realnetworks_003 remarkai_000 remarkai_001 rokid_000
-
VENZ
ECUA

ELSL
MEX
GRBR
ARG
POL
BRZL
KOR
Country of birth
SARB
UKR
PERU fmr_nominal
NRA
JPN 0.0001
HAT 0.001
RUS
TWAN
CUBA
THAI
DOMR
JAM
PHIL
IND
GUAT
CHIN
VTNM
saffe_001 saffe_002 sensetime_001 sensetime_002
-
VERIFICATION
VENZ
ECUA
ELSL
MEX
GRBR
ARG
POL
BRZL
KOR
SARB
UKR
PERU
NRA
JPN
HAT
RUS
FNMR(T)
TWAN
FMR(T)
CUBA
THAI
DOMR
JAM
PHIL
IND
GUAT
CHIN
VTNM
0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3
147
2019/10/16 12:43:37
sertis_000 shaman_001 shu_001 siat_002

VENZ
ECUA
ELSL
KOR
GRBR
NRA
SARB
MEX
POL
BRZL
UKR
ARG
JAM
TWAN
HAT
JPN
RUS
DOMR
THAI
PERU
CUBA
PHIL
CHIN
IND
VTNM
FRVT
GUAT
siat_004 sjtu_001 smilart_002 smilart_003
-
VENZ
ECUA

ELSL
KOR
GRBR
NRA
SARB
MEX
POL
Country of birth
BRZL
UKR
ARG fmr_nominal
JAM
TWAN 0.0001
HAT 0.001
JPN
RUS
DOMR
THAI
PERU
CUBA
PHIL
CHIN
IND
VTNM
GUAT
starhybrid_001 str_000 synesis_004 synesis_005
-
VERIFICATION
VENZ
ECUA
ELSL
KOR
GRBR
NRA
SARB
MEX
POL
BRZL
UKR
ARG
JAM
TWAN
HAT
JPN
FNMR(T)
RUS
FMR(T)
DOMR
THAI
PERU
CUBA
PHIL
CHIN
IND
VTNM
GUAT
0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3
148
2019/10/16 12:43:37
tech5_002 tech5_003 tevian_004 tevian_005

VENZ
ECUA
ELSL
SARB
KOR
MEX
TWAN
POL
BRZL
HAT
DOMR
JAM
ARG
GRBR
NRA
RUS
PHIL
IND
CUBA
PERU
CHIN
JPN
UKR
THAI
VTNM
FRVT
GUAT
tiger_002 tiger_003 tongyi_005 toshiba_002
-
VENZ
ECUA

ELSL
SARB
KOR
MEX
TWAN
POL
BRZL
Country of birth
HAT
DOMR
JAM fmr_nominal
ARG
GRBR 0.0001
NRA 0.001
RUS
PHIL
IND
CUBA
PERU
CHIN
JPN
UKR
THAI
VTNM
GUAT
toshiba_003 trueface_000 ulsee_001 uluface_002
-
VERIFICATION
VENZ
ECUA
ELSL
SARB
KOR
MEX
TWAN
POL
BRZL
HAT
DOMR
JAM
ARG
GRBR
NRA
RUS
FNMR(T)
PHIL
FMR(T)
IND
CUBA
PERU
CHIN
JPN
UKR
THAI
VTNM
GUAT
0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3
149
2019/10/16 12:43:37
umd_000 upc_001 vcog_002 vd_001

VENZ
ECUA
ELSL
GRBR
MEX
ARG
BRZL
NRA
POL
KOR
JPN
PERU
TWAN
UKR
JAM
SARB
RUS
CUBA
DOMR
HAT
THAI
PHIL
IND
GUAT
VTNM
FRVT
CHIN
veridas_001 veridas_002 via_000 videonetics_001
-
VENZ
ECUA

ELSL
GRBR
MEX
ARG
BRZL
NRA
POL
Country of birth
KOR
JPN
PERU fmr_nominal
TWAN
UKR 0.0001
JAM 0.001
SARB
RUS
CUBA
DOMR
HAT
THAI
PHIL
IND
GUAT
VTNM
CHIN
vigilantsolutions_006 vigilantsolutions_007 vion_000 visionbox_000
-
VERIFICATION
VENZ
ECUA
ELSL
GRBR
MEX
ARG
BRZL
NRA
POL
KOR
JPN
PERU
TWAN
UKR
JAM
SARB
FNMR(T)
RUS
FMR(T)
CUBA
DOMR
HAT
THAI
PHIL
IND
GUAT
VTNM
CHIN
0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3
150
2019/10/16 12:43:37
visionbox_001 visionlabs_006 visionlabs_007

VENZ
ECUA
ELSL
SARB
POL
MEX
KOR
BRZL
ARG
GRBR
TWAN
UKR
RUS
HAT
JAM
PERU
NRA
CUBA
PHIL
DOMR
JPN
IND
THAI
GUAT
VTNM
FRVT
CHIN
vocord_006 vocord_007 winsense_000
-
VENZ
ECUA

ELSL
SARB
POL
MEX
KOR
BRZL
ARG
Country of birth
GRBR
TWAN
UKR fmr_nominal
RUS
HAT 0.0001
JAM 0.001
PERU
NRA
CUBA
PHIL
DOMR
JPN
IND
THAI
GUAT
VTNM
CHIN
x−laboratory_000 yisheng_004 yitu_003
-
VERIFICATION
VENZ
ECUA
ELSL
SARB
POL
MEX
KOR
BRZL
ARG
GRBR
TWAN
UKR
RUS
HAT
JAM
PERU
FNMR(T)
NRA
FMR(T)
CUBA
PHIL
DOMR
JPN
IND
THAI
GUAT
VTNM
CHIN
0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3
151
Caveats: The results may not relate to subject-specific properties. Instead they could reflect image-specific quality dif-
ferences, which could occur due to collection protocol or software processing variations.
3.5.2 Effect of ageing
Background: Faces change appearance throughout life. This change gradually reduces similarity of a new image to an
earlier image. Face recognition algorithms give reduced similarity scores and more frequent false rejections.
Goal: To quantify false non-match rates (FNMR) as a function of elapsed time in an adult population.
Methods: Using the mugshot images, a threshold is set to give FMR = 0.00001 over the entire impostor set. Then FNMR
is measured over 1000 bootstrap replications of the genuine scores.
Results: For the visa images, Figure 126 shows how false non-match rates for genuine users, as a function of age group.

2019/10/16 12:43:37
visionlabs_007 everai_paravision_003 camvi_004 alphaface_001
2019/10/16 12:43:37
2e−02
1e−02
7e−03
5e−03
3e−03
2e−03
1e−03
7e−04
5e−04
visionlabs_006 deepglint_001 dahua_003 hr_002

2e−02
1e−02
7e−03
FRVT
5e−03
3e−03
-
2e−03
1e−03 race
7e−04
B
5e−04 W
psl_003 imperial_002 tevian_005 vocord_007

2e−02 sex
F
1e−02 M
7e−03
5e−03
3e−03
2e−03
1e−03
-
VERIFICATION
7e−04
5e−04
intellifusion_001 yitu_003 innovatrics_006 =02 T=04 T=06 T=08 T=10 T=12 T=14 T=16
DT D D D D D D D
2e−02
1e−02
7e−03
5e−03
FNMR(T)
3e−03
FMR(T)
2e−03
1e−03
7e−04
5e−04
=02 =04 =06 =08 =10 =12 =14 =16 =02 T=04 T=06 T=08 T=10 T=12 T=14 T=16 =02 T=04 T=06 T=08 T=10 T=12 T=14 T=16
DT DT DT DT DT DT DT DT DT D D D D D D D DT D D D D D D D
Figure 117: For the mugshot images, FNMR as a function ofTime lapse time
elapsed between first andinitial
between secondenrollment
photo (Years) and second verification images. The panels appear most accurate
first, and vertical scale changes on each page. The four traces correspond to images annotated with codes for black female, black male, white female, white male. The
threshold is fixed for each algorithm to give FMR = 0.00001 over all (1̃08 ) impostor comparisons. For short time-lapses, the most accurate algorithms give very few errors
153
(FNMR < 0.001) so that the uncertainty estimates are high.
facesoft_000 uluface_002 everai_002 anke_004
2019/10/16 12:43:37
0.030
0.020
0.010
0.007
0.005
0.003
0.002
rokid_000 hr_001 iqface_000 mt_000
0.030
0.020
FRVT
0.010
-
0.007

0.005
0.003 race
B
0.002
W
ntechlab_007 sertis_000 starhybrid_001 imperial_000
sex
0.030
F
0.020 M
0.010
0.007
0.005
-
0.003
VERIFICATION
0.002
psl_002 toshiba_003 vocord_006 einetworks_000
0.030
0.020
0.010
FNMR(T)
0.007
FMR(T)
0.005
0.003
0.002
=02 T=04 T=06 T=08 T=10 T=12 T=14 T=16 =02 T=04 T=06 T=08 T=10 T=12 T=14 T=16 =02 T=04 T=06 T=08 T=10 T=12 T=14 T=16 =02 =04 =06 =08 =10 =12 =14 =16
DT D D D D D D D DT D D D D D D D DT D D D D D D D DT DT DT DT DT DT DT DT
elapsed between first and initial
between second enrollment
154
cogent_004 cogent_003 camvi_002 intellicloudai_001
2019/10/16 12:43:37
0.030
0.020
0.010
0.007
0.005
0.003
0.002
hik_001 iit_001 incode_004 3divi_004
0.030
0.020
FRVT
0.010
-
0.007
0.005
race
0.003 B
W
0.002
toshiba_002 cyberlink_003 anke_003 kedacom_000
sex
0.030
F
0.020 M
0.010
0.007
0.005
-
VERIFICATION
0.003
0.002
tech5_003 cyberlink_002 remarkai_000 remarkai_001
0.030
0.020
0.010
FNMR(T)
FMR(T)
0.007
0.005
0.003
0.002
155
intsysmsu_000 neurotechnology_005 dahua_002 isystems_002
2019/10/16 12:43:37
0.030
0.020
0.010
0.007
0.005
0.003
saffe_002 neurotechnology_006 siat_002 ulsee_001
0.030
0.020
FRVT
0.010
-
0.007
0.005
race
0.003 B
W
visionbox_001 x−laboratory_000 cognitec_000 lookman_004
sex
0.030 F
M
0.020
0.010
0.007
0.005
-
VERIFICATION
0.003
cognitec_001 tech5_002 rankone_007 ceiec_002
0.030
0.020
FNMR(T)
0.010
FMR(T)
0.007
0.005
0.003
156
alchera_000 trueface_000 ntechlab_006 rankone_006
2019/10/16 12:43:37
0.050
0.030
0.020
0.010
0.007
0.005
0.003
0.002
idemia_005 pixelall_002 winsense_000 isystems_001
0.050
0.030
FRVT
0.020
-
0.010

0.007
0.005
race
0.003 B
0.002 W
deepsea_001 alchera_001 ctbcbank_000 vigilantsolutions_007
0.050 sex
F
0.030 M
0.020
0.010
0.007
0.005
-
VERIFICATION
0.003
0.002
synesis_005 itmo_006 vigilantsolutions_006 meiya_001
0.050
0.030
0.020
FNMR(T)
0.010
FMR(T)
0.007
0.005
0.003
0.002
157
f8_001 dermalog_006 via_000 itmo_005
2019/10/16 12:43:37
0.100
0.070
0.050
0.030
0.020
0.010
0.007
0.005
0.003
tiger_003 idemia_004 visionbox_000 megvii_002
0.100
0.070
0.050
FRVT
0.030
0.020
-
0.010
0.007
race
0.005
B
0.003 W
tongyi_005 allgovision_000 sjtu_001 gorilla_003
0.100 sex
0.070 F
0.050 M
0.030
0.020
0.010
0.007
-
VERIFICATION
0.005
0.003
id3_004 nodeflux_002 vd_001 tevian_004
0.100
0.070
0.050
0.030
0.020
FNMR(T)
FMR(T)
0.010
0.007
0.005
0.003
158
id3_003 upc_001 anyvision_004 ceiec_001
0.200
2019/10/16 12:43:37
0.100
0.070
0.050
0.030
0.020
0.010
0.007
0.005
lookman_002 shu_001 kneron_003 innovatrics_004

0.200
0.100
0.070
FRVT
0.050
0.030
-
0.020
0.010 race
0.007 B
0.005 W
megvii_001 vion_000 3divi_003 synesis_004

0.200
sex
F
0.100
M
0.070
0.050
0.030
0.020
0.010
-
VERIFICATION
0.007
0.005
intelresearch_000 incode_003 gorilla_002 imagus_000

0.200
0.100
0.070
0.050
FNMR(T)
0.030
FMR(T)
0.020
0.010
0.007
0.005
159
realnetworks_002 intellivision_002 realnetworks_003 smilart_003
2019/10/16 12:43:37
0.500
0.300
0.200
0.100
0.070
0.050
0.030
0.020
0.010
0.007
kakao_002 aware_004 iit_000 digitalbarriers_002

0.500
0.300
0.200
FRVT
0.100
0.070
-
0.050

0.030
0.020
race
0.010 B
0.007 W
anyvision_002 tiger_002 aware_003 intellivision_001

0.500
sex
0.300 F
0.200 M
0.100
0.070
0.050
0.030
0.020
-
VERIFICATION
0.010
0.007
yisheng_004 cyberextruder_002 glory_001 adera_001

0.500
0.300
0.200
0.100
0.070
FNMR(T)
0.050
FMR(T)
0.030
0.020
0.010
0.007
160
glory_000 shaman_001 dermalog_005 veridas_002
2019/10/16 12:43:37
0.70
0.50
0.30
0.20
0.10
0.07
0.05
veridas_001 notiontag_000 dsk_000 cyberextruder_001
0.70
0.50
FRVT
0.30
-
0.20

0.10
race
0.07
B
0.05 W
awiros_001 microfocus_002 ayonix_000 isap_001
sex
0.70 F
0.50 M
0.30
0.20
0.10
-
VERIFICATION
0.07
0.05
kakao_001 amplifiedgroup_001 microfocus_001 videonetics_001
0.70
0.50
0.30
FNMR(T)
0.20
FMR(T)
0.10
0.07
0.05
=02 =04 =06 =08 =10 =12 =14 =16 =02 T=04 T=06 T=08 T=10 T=12 T=14 T=16 =02 T=04 T=06 T=08 T=10 T=12 T=14 T=16 =02 T=04 T=06 T=08 T=10 T=12 T=14 T=16
DT DT DT DT DT DT DT DT DT D D D D D D D DT D D D D D D D DT D D D D D D D
Figure 125: For the mugshot images, FNMR as a function ofTime lapse between
elapsed first and second
time between initial photo (Years) and second verification images. The panels appear most accurate
enrollment
161
saffe_001 bm_001
2019/10/16 12:43:37
FRVT
-
0.7 race
B
W
sex
F
M
-
VERIFICATION
0.5
FNMR(T)
FMR(T)
=02 =04 =06 =08 =10 =12 =14 =16 =02 =04 =06 =08 =10 =12 =14 =16
DT DT DT DT DT DT DT DT DT DT DT DT DT DT DT DT
Figure 126: For the mugshot images, FNMR as a function of Time lapse between
elapsed first and second
time between initialphoto (Years) and second verification images. The panels appear most accurate
enrollment
162
3.5.3 Effect of age on genuine subjects
Background: Faces change appearance throughout life. Face recognition algorithms have previously beeen reported to
give better accuracy on older individuals (See NIST IR 8009).
Goal: To quantify false non-match rates (FNMR) as a function of age, without an ageing component.
Methods: Using the visa images, which span fewer than five years, thresholds are determined that give FMR = 0.001
and 0.0001 over the entire impostor set. Then FNMR is measured over 1000 bootstrap replications of the genuine scores.
Results: For the visa images, Figure 139 shows how false non-match rates for genuine users, as a function of age group.
The notable aspects are:
. Younger subjects give considerably higher FNMR. This is likely due to rapid growth and change in facial appear-
ance.
. FNMR trends down throughout life. The last bin, AGE > 72, contains fewer than 140 mated pairs, and may be
affected by small sample size.

2019/10/16 12:43:37
2019/10/16 12:43:37

(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
FRVT
0.0 0.1 0.2 0.00 0.05 0.10 0.15 0.20 0.0 0.1 0.2 0.3 0.4 0.00 0.05 0.10 0.15 0.20

reorder(agebin, age_order, color = fmr_nominal)
-
(72,120]

(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
fmr_nominal
(32,36]
0.0001
(28,32]
0.001
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.20 0.00 0.05 0.10 0.15 0.20 0.00 0.05 0.10 0.15 0.25 0.50 0.75
-
anke_003 anke_004 anyvision_002 anyvision_004
VERIFICATION
(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
FNMR(T)
FMR(T)
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.0 0.1 0.2 0.00 0.05 0.10 0.0 0.1 0.2 0.3 0.00 0.05 0.10 0.15
Figure 127: For the visa images, the dots show FNMR by age group for two operating thresholds corresponding to FMR = {0.001, 0.0001} computed over all on the
order of 1010 impostor scores. The FMR in each bin will vary also - see subsequent impostor heatmaps in sec. 3.6.2. Given a pair of face images taken at different times,
we assign the comparison to the bin that is the arithmetic average of the subject’s ages. This plot shows only the effect of age, not ageing. The number of comparisons
in each bin is generally in the thousands, however the first and last bins are computed over 149 and 124 respectively. The error rates in some (adult) cases are zero, and
164
in others the DET is flat so the error rates at the two thresholds are identical. The lines span 1% and 99% of boostrap replicated FNMR estimates.
2019/10/16 12:43:37
aware_003 aware_004 awiros_001 ayonix_000

(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
FRVT
0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.25 0.50 0.75 0.2 0.4 0.6
bm_001 camvi_002 camvi_004 ceiec_001

-
(72,120]

(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
fmr_nominal
(32,36]
0.0001
(28,32]
0.001
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.4 0.6 0.8 0.00 0.05 0.10 0.15 0.00 0.05 0.10 0.15 0.00 0.05 0.10 0.15
-
ceiec_002 chtface_001 cogent_003 cogent_004
VERIFICATION
(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
FNMR(T)
FMR(T)
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.00 0.25 0.50 0.75 1.00 0.00 0.02 0.04 0.06 0.08 0.000 0.025 0.050 0.075 0.100
165
2019/10/16 12:43:37
cognitec_000 cognitec_001 ctbcbank_000 cyberextruder_001

(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
FRVT
0.00 0.05 0.10 0.15 0.00 0.05 0.10 0.15 0.00 0.05 0.10 0.15 0.20 0.0 0.2 0.4 0.6
cyberextruder_002 cyberlink_002 cyberlink_003 dahua_002

-
(72,120]

(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
fmr_nominal
(32,36]
0.0001
(28,32]
0.001
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.0 0.1 0.2 0.3 0.00 0.05 0.10 0.15 0.00 0.05 0.10 0.15 0.00 0.05 0.10 0.15
-
dahua_003 deepglint_001 deepsea_001 dermalog_005
VERIFICATION
(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
FNMR(T)
FMR(T)
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.000 0.025 0.050 0.075 0.100 0.00 0.05 0.10 0.15 0.0 0.1 0.2 0.3 0.4 0.5
166
2019/10/16 12:43:37
dermalog_006 digitalbarriers_002 dsk_000 einetworks_000

(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
FRVT
0.0 0.1 0.2 0.0 0.2 0.4 0.6 0.0 0.2 0.4 0.6 0.00 0.05 0.10 0.15 0.20 0.25
everai_002 everai_paravision_003 f8_001 facesoft_000

-
(72,120]

(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
fmr_nominal
(32,36]
0.0001
(28,32]
0.001
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.20 0.00 0.02 0.04 0.06 0.08 0.0 0.1 0.2 0.00 0.05 0.10 0.15 0.20
-
glory_000 glory_001 gorilla_002 gorilla_003
VERIFICATION
(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
FNMR(T)
FMR(T)
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.0 0.2 0.4 0.0 0.2 0.4 0.00 0.05 0.10 0.15 0.20 0.00 0.05 0.10 0.15 0.20
167
2019/10/16 12:43:37
hik_001 hr_001 hr_002 id3_003

(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
FRVT
0.00 0.05 0.10 0.15 0.00 0.02 0.04 0.06 0.08 0.00 0.02 0.04 0.06 0.00 0.05 0.10 0.15 0.20
id3_004 idemia_004 idemia_005 iit_000

-
(72,120]

(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
fmr_nominal
(32,36]
0.0001
(28,32]
0.001
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.20 0.0 0.1 0.2 0.3 0.00 0.05 0.10 0.15 0.20 0.25 0.0 0.2 0.4 0.6
-
iit_001 imagus_000 imperial_000 imperial_002
VERIFICATION
(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
FNMR(T)
FMR(T)
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.20 0.0 0.1 0.2 0.3 0.4 0.5 0.00 0.02 0.04 0.06 0.08 0.00 0.05 0.10 0.15
168
2019/10/16 12:43:37
incode_003 incode_004 innovatrics_004 innovatrics_006

(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
FRVT
0.00 0.05 0.10 0.15 0.20 0.00 0.03 0.06 0.09 0.00 0.05 0.10 0.15 0.20 0.00 0.05 0.10
intellicloudai_001 intellifusion_001 intellivision_001 intellivision_002

-
(72,120]

(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
fmr_nominal
(32,36]
0.0001
(28,32]
0.001
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.20 0.00 0.05 0.10 0.0 0.1 0.2 0.3 0.4 0.0 0.1 0.2
-
intelresearch_000 intsysmsu_000 iqface_000 isap_001
VERIFICATION
(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
FNMR(T)
FMR(T)
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.20 0.25 0.00 0.05 0.10 0.15 0.20 0.00 0.05 0.10 0.15 0.20 0.0 0.2 0.4 0.6
169
2019/10/16 12:43:37
isityou_000 isystems_001 isystems_002 itmo_005

(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
FRVT
0.25 0.50 0.75 0.00 0.05 0.10 0.15 0.20 0.00 0.05 0.10 0.15 0.20 0.0 0.1 0.2
itmo_006 kakao_001 kakao_002 kedacom_000

-
(72,120]

(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
fmr_nominal
(32,36]
0.0001
(28,32]
0.001
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.0 0.2 0.4 0.6 0.8 0.0 0.1 0.2 0.3 0.4 0.000 0.025 0.050 0.075
-
kneron_003 lookman_002 lookman_004 megvii_001
VERIFICATION
(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
FNMR(T)
FMR(T)
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.0 0.1 0.2 0.3 0.00 0.05 0.10 0.15 0.20 0.25 0.00 0.03 0.06 0.09 0.00 0.05 0.10 0.15
170
2019/10/16 12:43:37
megvii_002 meiya_001 microfocus_001 microfocus_002

(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
FRVT
0.00 0.05 0.10 0.15 0.00 0.05 0.10 0.15 0.0 0.2 0.4 0.6 0.0 0.2 0.4
mt_000 neurotechnology_005 neurotechnology_006 nodeflux_001

-
(72,120]

(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
fmr_nominal
(32,36]
0.0001
(28,32]
0.001
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.20 0.00 0.05 0.10 0.15 0.20 0.00 0.05 0.10 0.15 0.80 0.85 0.90 0.95 1.00
-
nodeflux_002 notiontag_000 ntechlab_006 ntechlab_007
VERIFICATION
(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
FNMR(T)
FMR(T)
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.0 0.1 0.2 0.0 0.2 0.4 0.6 0.8 0.000 0.025 0.050 0.075 0.100 0.125 0.00 0.03 0.06 0.09
171
2019/10/16 12:43:37
pixelall_002 psl_002 psl_003 rankone_006

(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
FRVT
0.00 0.05 0.10 0.15 0.20 0.25 0.00 0.05 0.10 0.15 0.00 0.05 0.10 0.00 0.05 0.10 0.15 0.20
rankone_007 realnetworks_002 realnetworks_003 remarkai_000

-
(72,120]

(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
fmr_nominal
(32,36]
0.0001
(28,32]
0.001
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.20 0.0 0.1 0.2 0.3 0.0 0.1 0.2 0.3 0.00 0.05 0.10 0.15 0.20
-
remarkai_001 rokid_000 saffe_001 saffe_002
VERIFICATION
(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
FNMR(T)
FMR(T)
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.20 0.00 0.05 0.10 0.15 0.0 0.2 0.4 0.6 0.8 0.00 0.05 0.10 0.15 0.20
172
2019/10/16 12:43:37
sensetime_001 sensetime_002 sertis_000 shaman_000

(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
FRVT
0.00 0.05 0.10 0.15 0.00 0.05 0.10 0.15 0.00 0.05 0.10 0.15 0.7 0.8 0.9 1.0
shaman_001 shu_001 siat_002 siat_004

-
(72,120]

(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
fmr_nominal
(32,36]
0.0001
(28,32]
0.001
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.0 0.1 0.2 0.3 0.4 0.5 0.000 0.025 0.050 0.075 0.100 0.00 0.05 0.10 0.15 0.00 0.05 0.10 0.15
-
sjtu_001 smilart_002 smilart_003 starhybrid_001
VERIFICATION
(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
FNMR(T)
FMR(T)
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.02 0.04 0.06 0.0 0.2 0.4 0.0 0.2 0.4 0.6 0.00 0.05 0.10
173
2019/10/16 12:43:37
str_000 synesis_004 synesis_005 tech5_002

(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
FRVT
0.0 0.2 0.4 0.6 0.00 0.05 0.10 0.15 0.20 0.0 0.1 0.2 0.3 0.00 0.02 0.04 0.06
tech5_003 tevian_004 tevian_005 tiger_002

-
(72,120]

(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
fmr_nominal
(32,36]
0.0001
(28,32]
0.001
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.000 0.025 0.050 0.075 0.100 0.00 0.05 0.10 0.15 0.20 0.000 0.025 0.050 0.075 0.0 0.1 0.2 0.3 0.4
-
tiger_003 tongyi_005 toshiba_002 toshiba_003
VERIFICATION
(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
FNMR(T)
FMR(T)
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.20 0.00 0.03 0.06 0.09 0.00 0.05 0.10 0.15 0.20 0.00 0.05 0.10 0.15 0.20
174
2019/10/16 12:43:37
trueface_000 ulsee_001 uluface_002 umd_000

(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
FRVT
0.00 0.05 0.10 0.15 0.20 0.00 0.05 0.10 0.15 0.20 0.25 0.00 0.05 0.10 0.15 0.0 0.2 0.4
upc_001 vcog_002 vd_001 veridas_001

-
(72,120]

(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
fmr_nominal
(32,36]
0.0001
(28,32]
0.001
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.25 0.50 0.75 1.00 0.0 0.1 0.2 0.0 0.1 0.2 0.3 0.4 0.5
-
veridas_002 via_000 videonetics_001 vigilantsolutions_006
VERIFICATION
(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
FNMR(T)
FMR(T)
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.0 0.2 0.4 0.0 0.1 0.2 0.2 0.4 0.6 0.0 0.1 0.2 0.3
175
2019/10/16 12:43:37
vigilantsolutions_007 vion_000 visionbox_000 visionbox_001

(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
FRVT
0.0 0.1 0.2 0.0 0.1 0.2 0.00 0.05 0.10 0.15 0.20 0.25 0.00 0.05 0.10 0.15 0.20 0.25
visionlabs_006 visionlabs_007 vocord_006 vocord_007

-
(72,120]

(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
fmr_nominal
(32,36]
0.0001
(28,32]
0.001
(24,28]
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.000 0.025 0.050 0.075 0.100 0.000 0.025 0.050 0.075 0.100 0.00 0.05 0.10 0.00 0.02 0.04 0.06
-
winsense_000 x−laboratory_000 yisheng_004 yitu_003
VERIFICATION
(72,120]
(64,72]
(56,64]
(48,56]
(40,48]
(36,40]
(32,36]
(28,32]
(24,28]
FNMR(T)
FMR(T)
(20,24]
(16,20]
(10,16]
(4,10]
(0,4]
0.00 0.05 0.10 0.15 0.20 0.00 0.03 0.06 0.09 0.0 0.1 0.2 0.3 0.00 0.01 0.02
176
Caveats: None.

2019/10/16 12:43:37
3.6 Impostor distribution stability
3.6.1 Effect of birth place on the impostor distribution
Background: Facial appearance varies geographically, both in terms of skin tone, cranio-facial structure and size. This
section addresses whether false match rates vary intra- and inter-regionally.
Goals:
. To show the effect of birth region of the impostor and enrollee on false match rates.
. To determine whether some algorithms give better impostor distribution stability.
Methods:
. For the visa images, NIST defined 10 regions: Sub-Saharan Africa, South Asia, Polynesia, North Africa, Middle
East, Europe, East Asia, Central and South America, Central Asia, and the Caribbean.
. For the visa images, NIST mapped each country of birth to a region. There is some arbitrariness to this. For exam-
ple, Egypt could reasonably be assigned to the Middle East instead of North Africa. An alternative methodology
could, for example, assign the Philippines to both Polynesia and East Asia.
. FMR is computed for cases where all face images of impostors born in region r2 are compared with enrolled face
images of persons born in region r1 .
PNr1 ,r2
i=1 H(si − T )
FMR(r1 , r2 , T ) = (5)
Nr1 ,r2
where the same threshold, T, is used in all cells, and H is the unit step function. The threshold is set to give FMR(T)
= 0.001 over the entire set of visa image impostor comparisons.
. This analysis is then repeated by country-pair, but only for those country pairs where both have at least 1000 images
available. The countries1 appear in the axes of graphs that follow.
. The mean number of impostor scores in any cross-region bin is 33 million. The smallest number of impostor scores
in any bin is 135000, for Central Asia - North Africa. While these counts are large enough to support reasonable
significance, the number of individual faces is much smaller, on the order of N 0.5 .
. The numbers of impostor scores in any cross-country bin is shown in Figure 444.
Results: Subsequent figures show heatmaps that use color to represent the base-10 logarithm of the false match rate.
Red colors indicate high (bad) false match rates. Dark colors indicate benign false match rates. There are two series of
graphs corresponding to aggregated geographical regions, and to countries. The notable observations are:
. The on-diagonal elements correspond to within-region impostors. FMR is generally above the nominal value of
FMR = 0.001. Particularly there is usually higher FMR in, Sub-Saharan Africa, South Asia, and the Caribbean.
Europe and Central Asia, on the other hand, usually give FMR closer to the nominal value.
. The off-diagonal elements correspond to across-region impostors. The highest FMR is produced between the
Caribbean and Sub-Saharan Africa.
. Algorithms vary.
1 Theseare Argentina, Australia, Brazil, Chile, China, Costa Rica, Cuba, Czech Republic, Dominican Republic, Ecuador, Egypt, El Salvador, Germany,
Ghana, Great Britain, Greece, Guatamala, Haiti, Hong Kong, Honduras, Indonesia, India, Israel, Jamaica, Japan, Kenya, Korea, Lebanon, Mexico,
Malaysia, Nepal, Nigeria, Peru, Philippines, Pakistan, Poland, Romania, Russia, South Africa, Saudi Arabia, Thailand, Trinidad, Turkey, Taiwan,
Ukraine, Venezuela, and Vietnam.

2019/10/16 12:43:37
digitalbarriers_002
kakao_001 ● ●
megvii_001 ●
●●
hik_001
dsk_000
amplifiedgroup_001
notiontag_000 ●
●
●●
veridas_002
innovatrics_004
aware_004
starhybrid_001 ●●
lookman_002
adera_001 ●
●
anyvision_002
siat_002 ●
●
str_000
tevian_004 ●
●
intelresearch_000
iit_000 ●
●
iqface_000
everai_002 ●●
aware_003
intellifusion_001 ●
●
rokid_000
gorilla_002 ●
●
neurotechnology_006
kakao_002 ●
●
veridas_001
ceiec_001 ●
●
videonetics_001
isityou_000 ●●
innovatrics_006
ceiec_002 ●
●
imperial_002
gorilla_003 ●
●
meiya_001
winsense_000 ●
●
cyberextruder_001
alchera_001 ●●
dermalog_005
vigilantsolutions_007 ●
●
facesoft_000
anyvision_004 ●
●
siat_004
idemia_004 ●
●
intellicloudai_001
hr_001 ●
●
f8_001
tiger_002 ●●
alchera_000
tech5_002 ●
●
ayonix_000
synesis_005 ●
●
imagus_000
tevian_005 ●
●
id3_004
isystems_001 ●
●
isystems_002
toshiba_003 ●●
visionlabs_007
ulsee_001 ●
●
cyberextruder_002
yitu_003 ●
●
megvii_002
3divi_003 ●
●
3divi_004
cyberlink_003 ●
●
cyberlink_002
saffe_001 ●
●
toshiba_002
hr_002 ●
●
neurotechnology_005
everai_paravision_003 ●● eregion
yisheng_004
saffe_002 ●
● ●
Algorithm
CSAMERIC
einetworks_000
vigilantsolutions_006 ●
●
mt_000 ● ● EASIA
remarkai_001
iit_001 ●
● ● POLY
remarkai_000
nodeflux_002 ●
● ● SASIA
deepglint_001
cognitec_000 ●
● ● SSAFRICA
upc_001
cognitec_001 ●
●
dermalog_006
sensetime_001 ●
●
visionbox_001
realnetworks_003 ●
●
anke_003
idemia_005 ●
●
intsysmsu_000
id3_003 ●
●
microfocus_001
alphaface_001 ●●
vd_001
psl_002 ●
●
realnetworks_002
incode_004 ●
●
imperial_000
incode_003 ●
●
sensetime_002
smilart_002 ●●
camvi_002
anke_004 ●
●
via_000
tongyi_005 ●
●
itmo_005
camvi_004 ●
●
shu_001
synesis_004 ●
●
cogent_003
awiros_001 ●
●
pixelall_002
vion_000 ●●
vcog_002
vocord_007 ●
●
allgovision_000
trueface_000 ●
●
smilart_003
visionlabs_006 ●
●
tech5_003
visionbox_000 ●
●
glory_001
umd_000 ●
●
ctbcbank_000
itmo_006 ●
●
kneron_003
shaman_001 ●
●
tiger_003
dahua_002 ●
●
lookman_004
kedacom_000 ●
●
isap_001
cogent_004 ●●
sertis_000
microfocus_002 ●
●
psl_003
rankone_006 ●
●
vocord_006
uluface_002 ●●
ntechlab_007
rankone_007 ●
●
glory_000
dahua_003 ● ●
intellivision_002
x−laboratory_000 ●
●
ntechlab_006 ●
●●
intellivision_001
sjtu_001
deepsea_001 ●
●●
chtface_001
bm_001
●●
nodeflux_001
shaman_000
0.001 0.003 0.010 0.030 0.100
Figure 140: For the visa images, the dots show FMR for impostor comparisons of individuals of the same sex and same age group for
the region of the world that gives the worst (highest) FMR when the threshold is set to give FMR = 0.001 (red vertical line) over all on
the order of 1010 impostor scores i.e. zero-effort. The shift of the dots to right shows massive increases in FMR when impostors have
the same sex, age, and region of birth. The color code indicates which region gives the worst case FMR. If the observed variation is
due to the prevalence of one kind of images in the training imagery, then algorithms developed on one kind of data might be expected
to give higher FMR on other kinds.

2019/10/16 12:43:37
. We computed the same quantities for a global FMR = 0.0001. The effects are similar.
Caveats:
. The effects of variable impostor rates on one-to-many identification systems may well differ from what’s implied
by these one-to-one verification results. Two reasons for this are a) the enrollment galleries are usually imbalanced
across countries of birth, age and sex; b) one-to-many identification algorithms often implement techniques aimed
at stabilizing the impostor distribution. Further research is necessary.
. In principle, the effects seen in this subsection could be due to differences in the image capture process. We consider
this unlikely since the effects are maintained across geography - e.g. Caribbean vs. Africa, or Japan vs. China.

2019/10/16 12:43:37
3divi_003 3divi_004 adera_001 alchera_000 alchera_001 allgovision_000 alphaface_001amplifiedgroup_001 anke_003 anke_004 anyvision_002 anyvision_004 aware_003
RUS
POL
PKST
NRA
KOR
KENY
JPN
IND
HAT
GHAN
aware_004 awiros_001 ayonix_000 bm_001 camvi_002 camvi_004 ceiec_001 ceiec_002 chtface_001 cogent_003 cogent_004 cognitec_000 cognitec_001
RUS
POL
PKST
NRA
KOR
KENY
JPN
IND
HAT
GHAN
ctbcbank_000 cyberextruder_001
cyberextruder_002 cyberlink_002 cyberlink_003 dahua_002 dahua_003 deepglint_001 deepsea_001 dermalog_005 dermalog_006 digitalbarriers_002 dsk_000
RUS
2019/10/16 12:43:37
POL
PKST
NRA
KOR
z−score
KENY
JPN
IND
HAT
GHAN 2
einetworks_000 everai_002 everai_paravision_003 f8_001 facesoft_000 glory_000 glory_001 gorilla_002 gorilla_003 hik_001 hr_001 hr_002 id3_003
RUS
POL
PKST
NRA
KOR
KENY
JPN
IND
HAT
GHAN
id3_004 idemia_004 idemia_005 iit_000 iit_001 imagus_000 imperial_000 imperial_002 incode_003 incode_004 innovatrics_004 innovatrics_006 intellicloudai_001
RUS
POL
PKST
NRA
KOR 1
KENY
JPN
IND
FRVT
HAT
GHAN
-
intellifusion_001 intellivision_001 intellivision_002 intelresearch_000 intsysmsu_000 iqface_000 isap_001 isityou_000 isystems_001 isystems_002 itmo_005 itmo_006 kakao_001
RUS
POL
PKST
NRA
KOR
KENY
JPN
IND
HAT
GHAN
kakao_002 kedacom_000 kneron_003 lookman_002 lookman_004 megvii_001 megvii_002 meiya_001 microfocus_001 microfocus_002 mt_000 neurotechnology_005
neurotechnology_006 0
RUS
POL
PKST
NRA
KOR
KENY
JPN
IND
HAT
GHAN
nodeflux_001 nodeflux_002 notiontag_000 ntechlab_006 ntechlab_007 pixelall_002 psl_002 psl_003 rankone_006 rankone_007 realnetworks_002realnetworks_003 remarkai_000
Region of birth of impostor

RUS
POL
PKST
NRA
KOR
KENY
JPN
IND
HAT
GHAN
−1
remarkai_001 rokid_000 saffe_001 saffe_002 sensetime_001 sensetime_002 sertis_000 shaman_000 shaman_001 shu_001 siat_002 siat_004 sjtu_001
RUS
POL
PKST
NRA
KOR
KENY
-
JPN
IND
HAT
GHAN
smilart_002 smilart_003 starhybrid_001 str_000 synesis_004 synesis_005 tech5_002 tech5_003 tevian_004 tevian_005 tiger_002 tiger_003 tongyi_005
RUS
POL
PKST
NRA
KOR
KENY
JPN −2
IND
HAT
GHAN
VERIFICATION
toshiba_002 toshiba_003 trueface_000 ulsee_001 uluface_002 umd_000 upc_001 vcog_002 vd_001 veridas_001 veridas_002 via_000 videonetics_001
RUS
POL
PKST
NRA
KOR
KENY
JPN
IND
HAT
GHAN
vigilantsolutions_006
vigilantsolutions_007 vion_000 visionbox_000 visionbox_001 visionlabs_006 visionlabs_007 vocord_006 vocord_007 winsense_000 x−laboratory_000 yisheng_004 yitu_003
RUS
POL
PKST
NRA
KOR
KENY
FMR(T)
FNMR(T)
JPN
IND
HAT
GHAN
ONRRKASPTO
AHNAITNJDPENNKY LUS ANATNDPNNY
ORRASTOLUS ANATNDPNNY
ORRASTOLUS ANATNDPNNYORRASTOLUS ANATNDPNNYORRASTOLUS ANATNDPNNYORRASTOLUS ANATNDPNNYORRASTOLUS ANATNDPNNYORRASTOLUS
GH K P R GH H I JKE K NPK P R GH H I JKE K NPK P R GH H I JKE K NPK P R GH H I JKE K NPK P R GH H I JKE K NPK P R GH H I JKE K NPK P R GH H I JKE K NPK P R GH H I JKE K NPK P R GH H I JKE K NPK P R GH H I JKE K NPK P R GH H I JKE K NPK P R GH H I JKE K NPK P R
Region of birth of enrollee
Figure 141: For visa images, the heatmap shows how the mean of the impostor distribution for the country pair (a,b) is shifted relative to the mean of the global impostor
distribution, expressed as a number of standard deviations of the global impostor distribution. This statistic is designed to show shifts in the entire impostor distribution,

not just tail effects that manifest as the anomalously high (or low) false match rates that appear in the subsequent figures. The countries are chosen to show that skin

tone alone does not explain impostor distribution shifts. The reduced shift in Asian populations with the Yitu and TongYiTrans algorithms, is accompanied by positive
181
shifts in the European populations. This reversal relative to most other algorithms, may derive from use of nationally weighted training sets. The Visionlabs algorithm
appears most insensitive to country effects. The figure is computed from same-sex and same-age impostor pairs.
Cross region FMR at threshold T = 2.740 for algorithm 3divi_003, giving FMR(T) = 0.0001 globally.
Any impostor pairing (i.e. zero effort) Same age impostor
−3.4 −6.0 −5.2 −6.0 −5.0 −5.3 −5.4 −5.3 −5.0 −3.1 −3.0 −6.0 −4.8 −5.6 −4.5 −4.9 −5.3 −5.3 −4.6 −2.8
SSAFRICA
−4.3 −4.9 −4.2 −4.9 −4.9 −4.3 −4.3 −4.5 −3.3 −4.8 −3.4 −4.1 −3.3 −4.3 −4.1 −3.5 −3.6 −4.0 −2.9 −4.1
SASIA
−4.5 −4.5 −4.3 −3.5 −5.2 −5.1 −5.0 −2.8 −4.4 −5.1 −4.1 −4.2 −3.6 −3.1 −4.6 −4.4 −4.6 −2.5 −4.0 −4.8
POLY
2019/10/16 12:43:37
−4.7 −4.7 −4.5 −6.0 −5.2 −4.5 −4.1 −5.3 −4.4 −5.4 −4.1 −3.9 −3.8 −6.0 −4.6 −4.0 −3.7 −4.6 −3.8 −4.9
NAFRICA log10 FMR
−4.6 −4.6 −4.1 −5.6 −4.7 −3.9 −4.1 −4.9 −4.1 −5.4 −3.6 −4.0 −3.2 −4.8 −3.8 −3.0 −3.2 −4.1 −3.2 −4.7
MEAST
−4.9 −4.8 −4.6 −5.5 −4.7 −4.7 −4.9 −5.3 −5.1 −5.2 −4.2 −4.0 −3.7 −4.6 −4.0 −3.9 −4.4 −4.6 −4.4 −4.6
EURO
−5.2 −3.9 −4.7 −3.1 −5.3 −5.6 −5.7 −3.6 −5.0 −5.7 −4.4 −3.3 −3.9 −2.6 −4.6 −4.8 −4.9 −3.1 −4.5 −5.3 −1
EASIA
−4.3 −4.5 −3.6 −4.7 −4.6 −4.2 −4.3 −4.3 −4.3 −4.9 −3.4 −3.7 −2.8 −3.9 −3.7 −3.3 −3.4 −3.6 −3.5 −4.3
FRVT
CSAMERIC
-
−5.2 −3.8 −4.4 −4.0 −4.6 −4.4 −4.6 −4.7 −5.1 −5.9 −4.5 −3.4 −3.4 −3.6 −3.8 −3.6 −4.2 −4.2 −4.3 −5.2
CASIA −2
−3.3 −5.9 −4.6 −5.4 −4.8 −4.9 −4.8 −4.6 −4.6 −3.3 −2.7 −5.3 −3.9 −4.8 −4.2 −4.2 −4.1 −4.2 −4.1 −2.8
CARIB
Same sex impostor Same sex, same age impostor −3

−3.2 −6.0 −5.0 −5.8 −4.9 −5.1 −5.1 −5.0 −4.8 −2.9 −2.8 −6.0 −4.6 −5.5 −4.4 −4.6 −5.0 −5.1 −4.4 −2.6
SSAFRICA
−4.1 −4.8 −4.1 −4.7 −4.8 −4.2 −4.1 −4.3 −3.1 −4.6 −3.3 −4.0 −3.2 −4.2 −4.0 −3.4 −3.5 −3.9 −2.7 −4.0
SASIA

−4
−4.3 −4.3 −4.1 −3.3 −5.0 −4.9 −4.8 −2.6 −4.2 −4.9 −3.9 −4.1 −3.5 −2.9 −4.4 −4.2 −4.5 −2.3 −3.8 −4.5
POLY
−4.4 −4.4 −4.2 −5.9 −5.0 −4.2 −3.9 −5.0 −4.2 −5.1 −3.8 −3.6 −3.6 −6.0 −4.4 −3.8 −3.5 −4.3 −3.7 −4.6
NAFRICA
-
−4.4 −4.4 −4.0 −5.4 −4.6 −3.8 −3.9 −4.7 −3.9 −5.2 −3.5 −3.7 −3.1 −4.7 −3.7 −2.9 −3.1 −4.0 −3.1 −4.8 −5
MEAST
−4.8 −4.5 −4.5 −5.3 −4.5 −4.6 −4.7 −5.1 −5.0 −5.0 −4.1 −3.8 −3.6 −4.6 −3.9 −3.8 −4.3 −4.5 −4.3 −4.5
EURO
−5.0 −3.7 −4.6 −2.9 −5.1 −5.5 −5.5 −3.3 −4.8 −5.4 −4.3 −3.2 −3.8 −2.4 −4.5 −4.7 −4.8 −2.9 −4.3 −5.0
−6
EASIA
VERIFICATION
−4.1 −4.4 −3.5 −4.6 −4.5 −4.1 −4.1 −4.1 −4.2 −4.8 −3.3 −3.6 −2.7 −3.8 −3.6 −3.2 −3.3 −3.5 −3.4 −4.2
CSAMERIC
−4.9 −3.5 −4.3 −3.7 −4.4 −4.2 −4.3 −4.4 −4.8 −5.9 −4.4 −3.2 −3.4 −3.3 −3.7 −3.4 −3.9 −4.0 −4.2 −6.0
CASIA
−3.2 −5.6 −4.4 −5.2 −4.7 −4.6 −4.5 −4.4 −4.4 −3.1 −2.6 −5.0 −3.8 −4.6 −4.1 −4.1 −3.9 −4.0 −3.9 −2.7
CARIB
FMR(T)
FNMR(T)
B IA IC RO T CA LY IA A B C IA RO T A LY CA
RI S ER SIA AS RI PO S IC RI SIA RI S AS IC PO SIA RI
CA CA M EA EU ME F SA FR CA CA ME EA EU ME AFR SA AF
SA NA SA A N
C S CS SS
Figure 142: For algorithm 3divi-003 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individ-

uals who were born in the given region pair. False matches are counted against a recognition threshold fixed globally to give the target FMR in the plot title, computed

over all on the order of 1010 impostor comparisons. If text appears in each box it give the same quantity as that coded by the color. Grey indicates FMR is at the intended
182
FMR target level. Light red colors present a security vulnerability to, for example, a passport gate. Each +1 increase in log10 FMR corresponds to a factor of 10 increase
in FMR. The matrix is not quite symmetric because images in the enrollment and verification sets are different.
Cross region FMR at threshold T = 2.857 for algorithm 3divi_004, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.2 −5.6 −5.0 −5.3 −5.2 −5.0 −5.0 −3.0 −3.1 −6.0 −4.9 −5.3 −4.6 −5.0 −6.0 −4.7 −4.6 −2.7
SSAFRICA
−4.4 −5.0 −4.4 −4.9 −5.1 −4.5 −4.4 −4.5 −3.3 −4.9 −3.8 −4.3 −3.5 −4.4 −4.3 −3.8 −3.8 −4.1 −2.9 −4.4
SASIA
−4.6 −4.5 −4.3 −3.6 −5.3 −5.2 −5.3 −2.8 −4.4 −5.0 −4.1 −4.3 −3.7 −3.2 −4.6 −4.5 −4.7 −2.5 −4.0 −4.8
POLY
2019/10/16 12:43:37
−4.5 −4.6 −4.4 −6.0 −5.0 −4.2 −3.9 −5.3 −4.4 −5.5 −4.3 −3.7 −3.8 −5.7 −4.5 −3.7 −3.6 −6.0 −3.9 −6.0
NAFRICA log10 FMR
−4.7 −4.6 −4.0 −5.5 −4.6 −3.9 −4.0 −5.1 −4.2 −5.3 −3.8 −4.1 −3.1 −4.8 −3.6 −3.1 −3.2 −4.5 −3.4 −4.6
MEAST
−5.0 −4.7 −4.6 −5.6 −4.6 −4.8 −4.9 −5.6 −5.3 −5.2 −4.3 −4.2 −3.8 −5.0 −4.0 −4.0 −4.3 −5.1 −4.6 −4.5
EURO
−5.3 −4.1 −4.9 −3.2 −5.5 −5.9 −6.0 −3.6 −5.1 −5.5 −4.7 −3.5 −4.2 −2.7 −4.9 −5.1 −5.3 −3.3 −4.7 −5.0 −1
EASIA
−4.4 −4.6 −3.5 −4.9 −4.6 −4.3 −4.3 −4.3 −4.4 −5.0 −3.7 −3.9 −2.8 −4.2 −3.8 −3.4 −3.5 −3.8 −3.7 −4.5
FRVT
CSAMERIC
-
−5.0 −3.7 −4.3 −4.1 −4.5 −4.3 −4.5 −4.7 −5.0 −5.9 −4.1 −3.3 −3.3 −3.8 −3.7 −3.4 −4.0 −4.3 −4.2 −5.2
CASIA −2
−3.4 −5.1 −4.6 −5.5 −4.9 −4.9 −4.8 −4.7 −4.6 −3.4 −2.9 −4.6 −4.1 −4.8 −4.3 −4.4 −4.4 −4.3 −4.2 −3.0
CARIB

−3.2 −6.0 −5.0 −5.3 −4.8 −5.1 −4.9 −4.7 −4.7 −2.8 −2.9 −6.0 −4.7 −5.1 −4.4 −4.8 −6.0 −4.4 −4.3 −2.5
SSAFRICA
−4.2 −4.8 −4.2 −4.7 −4.9 −4.3 −4.2 −4.3 −3.0 −4.6 −3.7 −4.1 −3.4 −4.2 −4.3 −3.7 −3.7 −4.0 −2.7 −4.2
SASIA

−4
−4.3 −4.3 −4.0 −3.3 −5.1 −5.1 −5.0 −2.5 −4.2 −4.8 −3.9 −4.0 −3.5 −3.0 −4.5 −4.5 −4.5 −2.2 −3.8 −4.5
POLY
−4.2 −4.3 −4.2 −5.9 −4.7 −4.0 −3.6 −5.0 −4.1 −5.3 −4.0 −3.4 −3.6 −5.4 −4.2 −3.5 −3.5 −6.0 −3.7 −6.0
NAFRICA
-
−4.5 −4.3 −3.9 −5.4 −4.4 −3.7 −3.8 −4.9 −4.0 −5.1 −3.6 −3.8 −3.0 −4.7 −3.6 −3.0 −3.1 −4.4 −3.3 −4.5 −5
MEAST
−4.8 −4.4 −4.4 −5.4 −4.4 −4.6 −4.7 −5.3 −5.1 −4.9 −4.1 −3.9 −3.7 −5.0 −3.8 −3.9 −4.1 −4.8 −4.5 −4.4
EURO
−5.1 −3.8 −4.7 −2.9 −5.3 −5.7 −5.8 −3.4 −4.8 −5.2 −4.4 −3.3 −4.1 −2.5 −4.7 −5.0 −5.3 −3.0 −4.4 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.4 −3.3 −4.7 −4.4 −4.2 −4.1 −4.0 −4.1 −4.7 −3.5 −3.7 −2.7 −4.1 −3.7 −3.4 −3.4 −3.6 −3.6 −4.3
CSAMERIC
−4.8 −3.5 −4.1 −3.9 −4.3 −4.1 −4.2 −4.4 −4.8 −5.9 −3.9 −3.1 −3.2 −3.5 −3.6 −3.3 −3.8 −4.1 −4.1 −6.0
CASIA
−3.2 −4.9 −4.4 −5.2 −4.7 −4.6 −4.5 −4.4 −4.3 −3.1 −2.7 −4.5 −3.9 −4.7 −4.1 −4.1 −4.1 −4.0 −4.0 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


183
Cross region FMR at threshold T = 0.713 for algorithm adera_001, giving FMR(T) = 0.0001 globally.
−3.2 −6.0 −5.0 −6.0 −4.7 −4.9 −4.8 −5.7 −4.6 −2.8 −2.7 −6.0 −4.3 −5.8 −4.3 −4.3 −4.4 −5.4 −4.2 −2.5
SSAFRICA
−4.0 −4.5 −3.8 −5.2 −4.3 −3.7 −3.9 −4.6 −3.1 −4.4 −3.1 −3.7 −2.8 −4.3 −3.5 −2.9 −3.1 −3.9 −2.7 −3.7
SASIA
−4.8 −5.7 −4.9 −5.5 −5.6 −5.2 −5.5 −5.0 −4.8 −5.2 −4.0 −4.7 −4.0 −4.6 −4.8 −4.5 −5.1 −4.1 −4.1 −4.9
POLY
2019/10/16 12:43:37
−4.6 −4.4 −4.2 −6.0 −4.4 −3.8 −4.0 −6.0 −4.3 −5.1 −3.8 −3.6 −3.4 −5.4 −3.9 −3.2 −3.5 −6.0 −3.6 −6.0
NAFRICA log10 FMR
−4.2 −4.1 −3.6 −5.4 −4.0 −3.4 −3.7 −5.0 −3.7 −4.6 −3.2 −3.4 −2.7 −4.4 −3.2 −2.6 −2.8 −4.1 −2.9 −3.9
MEAST
−4.5 −4.3 −4.0 −5.7 −4.0 −4.0 −4.2 −5.4 −4.5 −4.9 −3.7 −3.7 −3.1 −4.7 −3.4 −3.2 −3.5 −4.5 −3.7 −4.2
EURO
−5.8 −5.4 −5.1 −4.9 −5.7 −5.5 −5.6 −5.1 −5.5 −6.0 −4.8 −4.5 −4.1 −3.9 −4.8 −4.6 −4.7 −4.1 −4.7 −5.5 −1
EASIA
−4.0 −4.2 −3.5 −4.9 −4.0 −3.6 −3.9 −4.6 −4.0 −4.7 −3.1 −3.4 −2.5 −3.9 −3.1 −2.8 −3.0 −3.6 −3.1 −3.9
FRVT
CSAMERIC
-
−5.0 −4.1 −4.2 −5.7 −4.2 −4.1 −4.3 −5.4 −4.8 −5.6 −4.3 −3.6 −3.3 −4.7 −3.5 −3.4 −4.0 −4.4 −3.9 −4.7
CASIA −2
−3.2 −5.2 −4.6 −6.0 −4.6 −4.6 −4.7 −5.4 −4.4 −3.1 −2.6 −4.5 −3.8 −5.3 −3.9 −3.9 −4.2 −4.5 −3.7 −2.6
CARIB

−2.9 −6.0 −4.7 −6.0 −4.5 −4.7 −4.5 −5.4 −4.4 −2.6 −2.5 −6.0 −4.2 −5.7 −4.1 −4.2 −4.2 −5.3 −4.0 −2.3
SSAFRICA
−3.8 −4.4 −3.7 −5.1 −4.2 −3.6 −3.8 −4.5 −2.9 −4.2 −3.0 −3.6 −2.8 −4.2 −3.5 −2.9 −3.1 −3.8 −2.5 −3.6
SASIA

−4
−4.6 −5.7 −4.8 −5.4 −5.5 −5.0 −5.2 −4.8 −4.6 −5.0 −4.0 −4.7 −3.9 −4.6 −4.8 −4.3 −4.8 −4.0 −4.0 −4.7
POLY
−4.4 −4.1 −4.0 −6.0 −4.2 −3.6 −3.8 −6.0 −4.0 −4.8 −3.5 −3.3 −3.2 −5.1 −3.7 −3.0 −3.4 −6.0 −3.4 −6.0
NAFRICA
-
−4.0 −3.9 −3.5 −5.3 −3.8 −3.2 −3.5 −4.8 −3.5 −4.5 −3.2 −3.2 −2.6 −4.4 −3.1 −2.5 −2.7 −3.9 −2.9 −3.7 −5
MEAST
−4.4 −4.1 −3.9 −5.7 −3.8 −3.8 −4.1 −5.3 −4.3 −4.7 −3.6 −3.5 −3.1 −4.7 −3.2 −3.1 −3.5 −4.4 −3.6 −4.1
EURO
−5.8 −5.5 −5.1 −4.8 −5.7 −5.5 −5.5 −5.0 −5.4 −6.0 −4.8 −4.6 −4.1 −3.9 −4.7 −4.5 −4.6 −4.1 −4.7 −5.6
−6
EASIA
VERIFICATION
−4.0 −4.1 −3.4 −4.9 −3.9 −3.6 −3.8 −4.5 −3.9 −4.6 −3.0 −3.3 −2.5 −3.9 −3.1 −2.7 −3.0 −3.6 −3.1 −3.8
CSAMERIC
−4.8 −3.8 −4.1 −5.8 −4.0 −3.8 −4.1 −6.0 −4.6 −5.5 −4.3 −3.3 −3.2 −4.8 −3.4 −3.2 −3.9 −4.9 −3.8 −4.6
CASIA
−3.0 −4.9 −4.4 −6.0 −4.4 −4.3 −4.5 −5.2 −4.1 −2.8 −2.4 −4.3 −3.7 −5.1 −3.8 −3.7 −4.0 −4.5 −3.5 −2.5
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 144: For algorithm adera-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

individuals who were born in the given region pair. False matches are counted against a recognition threshold fixed globally to give the target FMR in the plot title,

computed over all on the order of 1010 impostor comparisons. If text appears in each box it give the same quantity as that coded by the color. Grey indicates FMR is at
184
the intended FMR target level. Light red colors present a security vulnerability to, for example, a passport gate. Each +1 increase in log10 FMR corresponds to a factor
of 10 increase in FMR. The matrix is not quite symmetric because images in the enrollment and verification sets are different.
Cross region FMR at threshold T = 0.702 for algorithm alchera_000, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.3 −6.0 −5.1 −5.4 −5.1 −5.4 −4.9 −3.1 −3.1 −6.0 −4.9 −5.6 −4.6 −5.2 −5.3 −5.3 −4.5 −2.8
SSAFRICA
−4.2 −4.7 −4.0 −4.8 −4.7 −4.1 −4.2 −4.3 −3.1 −4.7 −3.4 −3.9 −3.1 −4.1 −3.8 −3.3 −3.5 −3.7 −2.7 −4.1
SASIA
−4.5 −4.7 −4.3 −3.7 −5.2 −5.0 −5.3 −2.8 −4.3 −5.0 −4.0 −4.4 −3.6 −3.2 −4.5 −4.1 −5.1 −2.5 −3.8 −4.7
POLY
2019/10/16 12:43:37
−4.7 −4.7 −4.4 −5.8 −5.1 −4.3 −3.9 −5.2 −4.3 −5.7 −4.1 −3.7 −3.6 −5.4 −4.3 −3.6 −3.4 −4.6 −3.5 −4.9
NAFRICA log10 FMR
−4.5 −4.5 −3.9 −5.2 −4.5 −3.8 −4.0 −4.6 −3.9 −5.2 −3.6 −3.8 −2.9 −4.3 −3.6 −3.0 −3.1 −3.7 −3.0 −4.5
MEAST
−5.0 −4.7 −4.5 −5.5 −4.6 −4.7 −4.9 −5.2 −4.9 −5.4 −4.3 −4.1 −3.7 −4.7 −3.9 −3.9 −4.2 −4.4 −4.2 −4.8
EURO
−5.2 −4.1 −4.8 −3.3 −5.4 −5.6 −5.6 −3.7 −5.0 −5.6 −4.5 −3.6 −4.0 −2.8 −4.6 −4.7 −4.9 −3.2 −4.5 −4.9 −1
EASIA
−4.3 −4.5 −3.5 −4.8 −4.5 −4.1 −4.2 −4.2 −4.1 −5.1 −3.5 −3.7 −2.7 −4.0 −3.7 −3.3 −3.4 −3.5 −3.3 −4.5
FRVT
CSAMERIC
-
−5.5 −3.7 −4.4 −4.2 −4.5 −4.4 −4.7 −4.8 −5.0 −5.8 −4.5 −3.2 −3.4 −3.9 −3.7 −3.6 −4.7 −4.5 −4.2 −4.9
CASIA −2
−3.4 −5.3 −4.7 −5.5 −4.8 −5.0 −4.8 −4.7 −4.5 −3.4 −2.7 −4.6 −4.1 −4.9 −4.1 −4.4 −4.2 −4.2 −4.1 −2.9
CARIB

−3.3 −6.0 −5.1 −5.7 −4.9 −5.1 −4.8 −5.1 −4.6 −2.8 −2.9 −6.0 −4.7 −5.4 −4.4 −5.0 −5.0 −5.0 −4.3 −2.6
SSAFRICA
−4.0 −4.6 −3.9 −4.7 −4.6 −4.0 −4.1 −4.1 −2.9 −4.5 −3.3 −3.9 −3.0 −4.0 −3.8 −3.3 −3.4 −3.6 −2.5 −3.9
SASIA

−4
−4.3 −4.4 −4.1 −3.5 −5.0 −4.9 −5.1 −2.6 −4.1 −4.7 −3.8 −4.1 −3.4 −3.0 −4.3 −4.0 −4.8 −2.3 −3.6 −4.4
POLY
−4.4 −4.4 −4.2 −5.6 −5.0 −4.1 −3.6 −5.0 −4.1 −5.7 −3.8 −3.4 −3.4 −5.1 −4.2 −3.5 −3.2 −4.3 −3.4 −6.0
NAFRICA
-
−4.4 −4.3 −3.8 −5.1 −4.4 −3.7 −3.8 −4.5 −3.8 −5.0 −3.5 −3.8 −2.9 −4.2 −3.5 −2.9 −3.0 −3.7 −3.0 −4.5 −5
MEAST
−4.9 −4.4 −4.4 −5.4 −4.4 −4.6 −4.8 −5.1 −4.8 −5.2 −4.2 −3.9 −3.6 −4.6 −3.8 −3.8 −4.1 −4.4 −4.1 −4.7
EURO
−5.1 −3.9 −4.7 −3.1 −5.2 −5.5 −5.6 −3.5 −4.8 −5.4 −4.4 −3.4 −3.9 −2.6 −4.5 −4.7 −5.0 −3.1 −4.3 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.7 −4.4 −4.0 −4.0 −4.0 −4.0 −4.9 −3.4 −3.6 −2.6 −3.9 −3.6 −3.2 −3.3 −3.4 −3.2 −4.3
CSAMERIC
−5.4 −3.4 −4.3 −3.9 −4.3 −4.2 −4.4 −4.5 −4.8 −5.6 −4.4 −3.0 −3.3 −3.6 −3.6 −3.4 −6.0 −4.3 −4.1 −4.9
CASIA
−3.2 −5.0 −4.4 −5.3 −4.7 −4.8 −4.6 −4.5 −4.3 −3.1 −2.6 −4.4 −3.8 −4.7 −4.0 −4.2 −4.0 −4.0 −3.8 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 145: For algorithm alchera-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


185
Cross region FMR at threshold T = 0.713 for algorithm alchera_001, giving FMR(T) = 0.0001 globally.
−3.6 −5.8 −5.4 −6.0 −5.1 −5.4 −5.4 −5.4 −5.1 −3.1 −3.1 −5.0 −5.0 −5.8 −4.7 −5.0 −5.3 −5.1 −4.7 −2.8
SSAFRICA
−4.3 −4.7 −4.0 −4.9 −4.7 −4.1 −4.2 −4.4 −3.3 −4.9 −3.5 −3.9 −3.0 −4.1 −3.9 −3.3 −3.4 −3.8 −2.8 −4.2
SASIA
−4.6 −4.7 −4.2 −3.7 −5.1 −5.0 −5.6 −2.9 −4.4 −5.2 −4.1 −4.1 −3.4 −3.2 −4.3 −4.2 −4.7 −2.5 −3.8 −4.7
POLY
2019/10/16 12:43:37
−4.6 −4.5 −4.3 −6.0 −5.0 −4.1 −3.9 −5.6 −4.3 −5.3 −4.0 −3.6 −3.5 −5.7 −4.4 −3.4 −3.4 −6.0 −3.4 −4.6
NAFRICA log10 FMR
−4.5 −4.5 −3.9 −5.3 −4.5 −3.8 −3.9 −4.7 −3.9 −5.3 −3.6 −3.7 −2.9 −4.3 −3.6 −2.9 −3.0 −3.8 −3.0 −4.4
MEAST
−5.0 −4.7 −4.5 −5.6 −4.6 −4.7 −4.7 −5.2 −4.9 −5.4 −4.2 −4.1 −3.6 −4.8 −3.9 −3.8 −4.0 −4.5 −4.1 −4.9
EURO
−5.3 −4.1 −4.7 −3.3 −5.3 −5.5 −5.7 −3.7 −5.1 −5.7 −4.5 −3.5 −3.8 −2.7 −4.5 −4.6 −4.9 −3.2 −4.4 −5.0 −1
EASIA
−4.3 −4.5 −3.5 −4.8 −4.5 −4.1 −4.1 −4.2 −4.1 −5.1 −3.5 −3.7 −2.6 −3.9 −3.6 −3.2 −3.3 −3.4 −3.2 −4.4
FRVT
CSAMERIC
-
−5.5 −3.7 −4.4 −4.3 −4.6 −4.4 −4.4 −4.7 −5.0 −5.8 −4.6 −3.3 −3.5 −3.9 −3.7 −3.6 −3.8 −4.4 −4.2 −4.9
CASIA −2
−3.5 −5.7 −4.7 −5.6 −4.9 −5.0 −4.8 −4.9 −4.7 −3.4 −2.9 −5.3 −4.1 −5.0 −4.3 −4.3 −4.3 −4.5 −4.2 −3.0
CARIB

−3.3 −5.5 −5.1 −5.7 −4.9 −5.1 −5.1 −5.1 −4.8 −2.9 −2.9 −4.7 −4.8 −5.5 −4.5 −4.7 −5.0 −4.9 −4.4 −2.6
SSAFRICA
−4.1 −4.6 −3.9 −4.7 −4.7 −4.1 −4.1 −4.3 −3.1 −4.7 −3.4 −3.9 −2.9 −4.1 −3.8 −3.3 −3.4 −3.7 −2.7 −4.1
SASIA

−4
−4.4 −4.4 −4.0 −3.5 −5.0 −4.8 −5.3 −2.6 −4.2 −4.9 −3.9 −3.8 −3.2 −3.0 −4.2 −4.0 −4.5 −2.3 −3.6 −4.4
POLY
−4.4 −4.2 −4.0 −5.8 −4.8 −3.9 −3.7 −5.3 −4.1 −5.0 −3.8 −3.3 −3.3 −5.4 −4.2 −3.3 −3.2 −6.0 −3.4 −4.3
NAFRICA
-
−4.4 −4.3 −3.8 −5.2 −4.4 −3.7 −3.7 −4.6 −3.8 −5.2 −3.5 −3.6 −2.8 −4.3 −3.5 −2.8 −2.9 −3.7 −3.0 −4.4 −5
MEAST
−4.8 −4.5 −4.3 −5.4 −4.4 −4.5 −4.6 −5.1 −4.8 −5.2 −4.1 −3.9 −3.5 −4.6 −3.8 −3.7 −3.9 −4.3 −4.0 −4.7
EURO
−5.1 −3.9 −4.6 −3.2 −5.2 −5.5 −5.6 −3.5 −4.9 −5.5 −4.4 −3.3 −3.7 −2.6 −4.4 −4.6 −4.8 −3.0 −4.3 −4.8
−6
EASIA
VERIFICATION
−4.2 −4.3 −3.3 −4.7 −4.4 −4.0 −4.0 −4.0 −4.0 −4.9 −3.4 −3.6 −2.5 −3.8 −3.6 −3.1 −3.2 −3.3 −3.2 −4.3
CSAMERIC
−5.2 −3.4 −4.3 −4.1 −4.3 −4.1 −4.2 −4.4 −4.8 −5.9 −4.4 −3.0 −3.4 −3.7 −3.6 −3.4 −3.6 −4.1 −4.1 −4.9
CASIA
−3.3 −5.4 −4.5 −5.4 −4.7 −4.7 −4.6 −4.6 −4.4 −3.2 −2.7 −5.0 −3.9 −4.9 −4.1 −4.1 −4.1 −4.2 −3.9 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


186
Cross region FMR at threshold T = 0.433 for algorithm allgovision_000, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.3 −6.0 −5.1 −5.3 −5.4 −5.5 −5.0 −3.3 −3.1 −6.0 −4.8 −5.8 −4.6 −4.8 −5.3 −5.4 −4.5 −2.9
SSAFRICA
−4.1 −4.6 −3.8 −4.9 −4.6 −4.0 −4.1 −4.4 −3.3 −4.7 −3.3 −3.7 −2.8 −4.1 −3.7 −3.1 −3.2 −3.7 −2.8 −4.1
SASIA
−4.6 −4.9 −4.3 −3.9 −5.2 −5.0 −5.2 −3.1 −4.5 −5.2 −4.0 −4.2 −3.4 −3.4 −4.3 −4.1 −4.4 −2.7 −3.9 −4.6
POLY
2019/10/16 12:43:37
−4.7 −4.4 −4.3 −5.9 −4.9 −4.2 −4.0 −5.4 −4.3 −5.4 −3.9 −3.6 −3.6 −5.7 −4.1 −3.4 −3.6 −4.9 −3.4 −4.6
NAFRICA log10 FMR
−4.3 −4.4 −3.7 −5.2 −4.4 −3.7 −3.9 −4.6 −3.8 −5.1 −3.3 −3.6 −2.7 −4.3 −3.4 −2.8 −3.0 −3.7 −2.9 −4.4
MEAST
−4.8 −4.7 −4.4 −5.6 −4.5 −4.6 −4.7 −5.3 −4.8 −5.4 −4.0 −4.0 −3.5 −4.8 −3.8 −3.7 −3.8 −4.5 −3.9 −4.7
EURO
−5.4 −4.2 −4.7 −3.4 −5.3 −5.5 −5.5 −3.9 −5.1 −5.8 −4.5 −3.5 −3.8 −2.8 −4.5 −4.6 −4.6 −3.3 −4.4 −5.1 −1
EASIA
−4.2 −4.4 −3.4 −4.8 −4.4 −4.0 −4.0 −4.3 −4.0 −5.0 −3.3 −3.5 −2.5 −3.9 −3.5 −3.0 −3.1 −3.4 −3.1 −4.2
FRVT
CSAMERIC
-
−5.5 −3.9 −4.5 −4.5 −4.6 −4.4 −4.6 −5.0 −5.1 −6.0 −4.5 −3.5 −3.5 −4.1 −3.7 −3.6 −4.0 −4.6 −4.2 −5.2
CASIA −2
−3.4 −5.4 −4.7 −5.6 −4.8 −5.0 −4.8 −5.0 −4.7 −3.5 −2.7 −4.8 −4.1 −4.8 −4.1 −4.3 −4.4 −4.5 −4.1 −2.9
CARIB

−3.4 −6.0 −5.1 −5.8 −5.0 −5.0 −5.1 −5.3 −4.8 −3.0 −2.9 −6.0 −4.7 −5.6 −4.5 −4.6 −5.0 −5.1 −4.3 −2.7
SSAFRICA
−4.0 −4.5 −3.7 −4.8 −4.5 −3.9 −4.0 −4.2 −3.1 −4.6 −3.2 −3.7 −2.8 −4.0 −3.7 −3.1 −3.2 −3.6 −2.7 −3.9
SASIA

−4
−4.5 −4.7 −4.1 −3.7 −5.0 −4.9 −5.0 −2.9 −4.2 −4.9 −3.9 −4.0 −3.3 −3.2 −4.2 −4.0 −4.3 −2.5 −3.7 −4.5
POLY
−4.5 −4.1 −4.1 −5.7 −4.7 −4.0 −3.7 −5.1 −4.1 −5.1 −3.8 −3.3 −3.4 −5.4 −4.0 −3.3 −3.4 −4.6 −3.3 −4.3
NAFRICA
-
−4.2 −4.2 −3.6 −5.1 −4.3 −3.6 −3.7 −4.5 −3.7 −5.0 −3.2 −3.5 −2.7 −4.2 −3.3 −2.7 −2.9 −3.6 −2.8 −4.3 −5
MEAST
−4.7 −4.4 −4.3 −5.5 −4.3 −4.5 −4.5 −5.2 −4.7 −5.3 −3.9 −3.8 −3.4 −4.7 −3.7 −3.6 −3.8 −4.4 −3.9 −4.7
EURO
−5.2 −4.1 −4.7 −3.3 −5.2 −5.5 −5.4 −3.7 −4.9 −5.6 −4.4 −3.4 −3.8 −2.7 −4.5 −4.6 −4.5 −3.2 −4.3 −5.0
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.7 −4.3 −3.9 −3.9 −4.1 −3.9 −4.8 −3.3 −3.4 −2.5 −3.8 −3.4 −3.0 −3.0 −3.3 −3.0 −4.1
CSAMERIC
−5.4 −3.6 −4.3 −4.2 −4.4 −4.2 −4.4 −4.7 −4.9 −6.0 −4.4 −3.4 −3.4 −3.9 −3.6 −3.4 −3.9 −4.3 −4.2 −6.0
CASIA
−3.3 −5.2 −4.5 −5.4 −4.7 −4.8 −4.6 −4.7 −4.4 −3.3 −2.6 −4.5 −3.9 −4.7 −4.0 −4.1 −4.1 −4.3 −3.9 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 147: For algorithm allgovision-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


187
Cross region FMR at threshold T = 0.396 for algorithm alphaface_001, giving FMR(T) = 0.0001 globally.
−3.6 −5.6 −5.4 −5.8 −5.1 −5.4 −5.2 −5.3 −5.1 −3.1 −3.2 −5.3 −5.1 −5.6 −4.7 −5.2 −5.0 −5.0 −4.7 −2.8
SSAFRICA
−4.4 −5.0 −4.3 −5.0 −4.9 −4.3 −4.4 −4.6 −3.3 −4.8 −3.7 −4.3 −3.4 −4.5 −4.2 −3.6 −3.7 −4.3 −2.9 −4.3
SASIA
−4.6 −4.6 −4.4 −3.7 −5.4 −5.3 −5.4 −2.9 −4.5 −5.1 −4.1 −4.4 −3.7 −3.3 −4.7 −4.5 −5.1 −2.5 −4.1 −4.9
POLY
2019/10/16 12:43:37
−4.6 −4.7 −4.3 −5.7 −5.1 −4.1 −3.6 −5.7 −4.5 −4.9 −4.1 −3.9 −3.8 −5.4 −4.8 −3.6 −3.0 −6.0 −3.9 −4.6
NAFRICA log10 FMR
−4.6 −4.5 −4.1 −5.4 −4.7 −3.9 −3.8 −5.1 −4.1 −5.2 −3.7 −4.0 −3.2 −4.6 −3.8 −3.1 −3.2 −4.4 −3.3 −4.6
MEAST
−5.1 −4.6 −4.5 −5.7 −4.5 −4.7 −4.8 −5.5 −5.1 −5.2 −4.4 −4.2 −3.8 −5.2 −3.9 −4.0 −4.2 −4.8 −4.3 −4.7
EURO
−5.4 −4.1 −4.9 −3.3 −5.5 −5.8 −5.9 −3.7 −5.1 −5.5 −4.7 −3.7 −4.2 −2.8 −4.9 −5.1 −5.3 −3.3 −4.6 −4.9 −1
EASIA
−4.3 −4.5 −3.4 −5.0 −4.5 −4.3 −4.2 −4.5 −4.4 −5.1 −3.7 −3.9 −2.8 −4.3 −3.9 −3.6 −3.6 −3.9 −3.7 −4.5
FRVT
CSAMERIC
-
−5.5 −3.6 −4.7 −4.1 −4.6 −4.4 −4.5 −4.8 −5.2 −6.0 −5.0 −3.2 −3.9 −3.8 −4.0 −3.8 −4.4 −4.5 −4.6 −6.0
CASIA −2
−3.5 −5.3 −4.6 −5.5 −4.9 −5.0 −4.6 −4.8 −4.7 −3.5 −2.9 −4.5 −4.1 −5.0 −4.3 −4.4 −4.0 −4.4 −4.2 −3.1
CARIB

−3.3 −5.5 −5.1 −5.5 −4.9 −5.2 −4.9 −5.0 −4.8 −2.9 −3.0 −5.0 −4.8 −5.3 −4.5 −4.9 −4.7 −4.8 −4.4 −2.6
SSAFRICA
−4.2 −4.8 −4.1 −4.8 −4.8 −4.2 −4.2 −4.4 −3.0 −4.6 −3.6 −4.2 −3.3 −4.3 −4.1 −3.5 −3.6 −4.1 −2.7 −4.2
SASIA

−4
−4.3 −4.3 −4.1 −3.4 −5.2 −5.1 −5.3 −2.6 −4.2 −4.8 −3.9 −4.1 −3.5 −3.0 −4.6 −4.4 −6.0 −2.3 −3.8 −4.6
POLY
−4.3 −4.4 −4.0 −5.4 −4.8 −3.8 −3.3 −5.4 −4.2 −4.6 −3.7 −3.6 −3.5 −5.1 −4.5 −3.3 −2.7 −6.0 −3.7 −4.3
NAFRICA
-
−4.4 −4.2 −4.0 −5.2 −4.5 −3.6 −3.6 −4.8 −4.0 −5.1 −3.6 −3.8 −3.1 −4.5 −3.7 −3.0 −3.0 −4.2 −3.3 −4.6 −5
MEAST
−4.8 −4.3 −4.3 −5.4 −4.2 −4.5 −4.6 −5.3 −4.9 −5.0 −4.2 −3.9 −3.6 −5.1 −3.7 −3.9 −4.0 −4.7 −4.2 −4.5
EURO
−5.1 −3.9 −4.7 −3.0 −5.3 −5.6 −5.6 −3.5 −4.9 −5.2 −4.5 −3.5 −4.0 −2.6 −4.7 −5.0 −5.1 −3.1 −4.4 −4.7
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.2 −4.7 −4.3 −4.1 −4.0 −4.2 −4.2 −4.8 −3.5 −3.7 −2.6 −4.1 −3.7 −3.4 −3.4 −3.7 −3.6 −4.4
CSAMERIC
−5.2 −3.3 −4.4 −3.9 −4.3 −4.1 −4.2 −4.6 −4.9 −5.9 −5.0 −2.9 −3.7 −3.5 −3.8 −3.5 −4.1 −4.3 −4.4 −6.0
CASIA
−3.3 −5.0 −4.3 −5.3 −4.7 −4.7 −4.4 −4.5 −4.4 −3.3 −2.7 −4.3 −3.8 −4.8 −4.2 −4.1 −3.8 −4.1 −3.9 −2.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 148: For algorithm alphaface-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


188
Cross region FMR at threshold T = 3.640 for algorithm amplifiedgroup_001, giving FMR(T) = 0.0001 globally.
−3.8 −6.0 −6.0 −6.0 −5.5 −5.8 −5.6 −6.0 −6.0 −3.2 −3.5 −6.0 −5.8 −6.0 −5.1 −5.7 −5.3 −6.0 −6.0 −2.9
SSAFRICA
−6.0 −6.0 −6.0 −5.1 −6.0 −6.0 −6.0 −5.8 −5.1 −6.0 −6.0 −5.4 −5.8 −4.6 −6.0 −5.4 −6.0 −5.6 −4.7 −6.0
SASIA
−6.0 −5.1 −6.0 −4.1 −6.0 −6.0 −6.0 −4.0 −6.0 −6.0 −6.0 −6.0 −5.8 −3.8 −6.0 −6.0 −6.0 −3.7 −5.9 −6.0
POLY
2019/10/16 12:43:37
−6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0
NAFRICA log10 FMR
−6.0 −6.0 −6.0 −6.0 −6.0 −5.7 −5.7 −5.9 −6.0 −6.0 −5.7 −6.0 −5.2 −5.6 −5.3 −4.8 −5.1 −5.2 −5.6 −6.0
MEAST
−5.9 −6.0 −6.0 −5.5 −5.9 −6.0 −6.0 −6.0 −6.0 −5.3 −5.2 −5.2 −5.1 −5.2 −4.9 −5.2 −5.7 −6.0 −6.0 −4.9
EURO
−6.0 −3.8 −5.1 −2.7 −5.2 −5.7 −6.0 −4.0 −5.3 −5.8 −6.0 −3.4 −4.7 −2.4 −4.8 −5.5 −6.0 −3.7 −5.0 −5.2 −1
EASIA
−6.0 −6.0 −5.9 −5.4 −6.0 −6.0 −6.0 −6.0 −6.0 −5.9 −5.6 −5.1 −4.8 −4.7 −5.3 −5.2 −6.0 −5.2 −5.9 −5.6
FRVT
CSAMERIC
-
−6.0 −3.9 −5.3 −3.6 −5.1 −5.4 −6.0 −5.0 −6.0 −6.0 −5.3 −3.5 −4.3 −3.4 −4.3 −4.5 −6.0 −5.2 −6.0 −6.0
CASIA −2
−4.2 −6.0 −6.0 −6.0 −5.8 −6.0 −6.0 −6.0 −6.0 −3.7 −3.8 −6.0 −5.5 −6.0 −5.4 −5.6 −5.3 −6.0 −6.0 −3.4
CARIB

−3.5 −6.0 −5.9 −6.0 −5.2 −5.6 −5.3 −6.0 −6.0 −2.9 −3.2 −6.0 −5.6 −6.0 −4.9 −5.7 −5.0 −6.0 −6.0 −2.7
SSAFRICA
−6.0 −5.8 −6.0 −4.9 −6.0 −5.9 −6.0 −5.5 −4.8 −6.0 −6.0 −5.1 −5.8 −4.4 −6.0 −5.2 −6.0 −5.4 −4.4 −6.0
SASIA

−4
−6.0 −4.8 −6.0 −3.8 −6.0 −6.0 −6.0 −3.8 −6.0 −5.9 −6.0 −6.0 −5.6 −3.5 −5.9 −6.0 −6.0 −3.4 −5.6 −6.0
POLY
−6.0 −6.0 −6.0 −6.0 −6.0 −5.9 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0
NAFRICA
-
−6.0 −5.9 −6.0 −6.0 −6.0 −5.5 −5.4 −5.9 −6.0 −6.0 −5.4 −6.0 −5.1 −5.3 −5.3 −4.6 −4.8 −4.9 −5.5 −6.0 −5
MEAST
−5.6 −5.9 −6.0 −5.4 −5.8 −6.0 −6.0 −6.0 −6.0 −5.0 −4.9 −5.1 −5.1 −5.0 −4.9 −5.2 −6.0 −5.7 −6.0 −4.6
EURO
−6.0 −3.6 −4.8 −2.5 −5.0 −5.4 −6.0 −3.8 −5.1 −5.5 −5.9 −3.2 −4.4 −2.1 −4.7 −5.3 −6.0 −3.4 −4.7 −5.0
−6
EASIA
VERIFICATION
−5.9 −5.9 −5.8 −5.2 −6.0 −6.0 −6.0 −5.8 −6.0 −5.6 −5.5 −5.1 −4.8 −4.6 −5.2 −5.2 −6.0 −5.2 −5.8 −5.3
CSAMERIC
−6.0 −3.7 −5.2 −3.3 −5.0 −5.2 −6.0 −4.7 −6.0 −5.9 −6.0 −3.2 −4.3 −3.1 −4.2 −4.4 −6.0 −4.9 −6.0 −6.0
CASIA
−3.9 −6.0 −6.0 −6.0 −5.5 −5.7 −6.0 −6.0 −6.0 −3.4 −3.6 −6.0 −5.3 −6.0 −5.1 −5.2 −5.0 −6.0 −6.0 −3.2
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 149: For algorithm amplifiedgroup-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from

different individuals who were born in the given region pair. False matches are counted against a recognition threshold fixed globally to give the target FMR in the plot

title, computed over all on the order of 1010 impostor comparisons. If text appears in each box it give the same quantity as that coded by the color. Grey indicates FMR
189
is at the intended FMR target level. Light red colors present a security vulnerability to, for example, a passport gate. Each +1 increase in log10 FMR corresponds to a
factor of 10 increase in FMR. The matrix is not quite symmetric because images in the enrollment and verification sets are different.
Cross region FMR at threshold T = 0.397 for algorithm anke_003, giving FMR(T) = 0.0001 globally.
−3.5 −5.8 −5.2 −5.7 −5.1 −5.3 −5.0 −5.2 −4.8 −3.1 −3.1 −5.3 −4.8 −5.5 −4.6 −4.7 −5.0 −5.0 −4.3 −2.8
SSAFRICA
−4.4 −4.8 −4.3 −4.9 −5.0 −4.4 −4.4 −4.5 −3.4 −4.9 −3.7 −4.2 −3.4 −4.4 −4.2 −3.6 −3.7 −4.1 −3.0 −4.4
SASIA
−4.5 −4.6 −4.2 −3.7 −5.2 −5.4 −5.0 −2.9 −4.4 −4.9 −4.0 −4.4 −3.6 −3.3 −4.6 −4.6 −4.3 −2.5 −4.0 −4.9
POLY
2019/10/16 12:43:37
−4.6 −4.5 −4.3 −5.9 −5.0 −4.2 −3.8 −5.6 −4.4 −5.3 −4.1 −3.6 −3.6 −5.7 −4.5 −3.6 −3.4 −4.9 −3.8 −6.0
NAFRICA log10 FMR
−4.6 −4.5 −4.1 −5.5 −4.5 −3.9 −4.0 −5.1 −4.2 −5.4 −3.6 −3.8 −3.2 −4.7 −3.7 −3.1 −3.2 −4.2 −3.3 −4.5
MEAST
−4.9 −4.5 −4.5 −5.5 −4.4 −4.6 −4.7 −5.4 −5.1 −5.2 −4.1 −4.0 −3.7 −4.9 −3.8 −3.9 −4.0 −4.7 −4.4 −4.6
EURO
−5.1 −4.0 −4.8 −3.2 −5.4 −5.8 −5.9 −3.7 −5.0 −5.5 −4.3 −3.5 −4.0 −2.7 −4.7 −4.9 −5.3 −3.2 −4.6 −4.8 −1
EASIA
−4.2 −4.4 −3.4 −4.8 −4.5 −4.2 −4.2 −4.2 −4.3 −4.9 −3.5 −3.8 −2.8 −4.1 −3.8 −3.4 −3.5 −3.6 −3.6 −4.4
FRVT
CSAMERIC
-
−4.9 −3.6 −4.4 −4.1 −4.5 −4.3 −4.3 −4.7 −5.1 −6.0 −4.3 −3.1 −3.6 −3.7 −3.8 −3.6 −3.7 −4.4 −4.4 −6.0
CASIA −2
−3.4 −5.1 −4.5 −5.2 −4.8 −4.8 −4.5 −4.7 −4.6 −3.4 −2.8 −4.7 −3.9 −4.5 −4.2 −4.1 −3.9 −4.2 −4.1 −3.0
CARIB

−3.3 −5.7 −4.9 −5.5 −4.8 −5.1 −4.8 −4.9 −4.6 −2.9 −2.9 −5.0 −4.5 −5.2 −4.4 −4.5 −4.7 −4.7 −4.0 −2.6
SSAFRICA
−4.2 −4.6 −4.2 −4.7 −4.8 −4.3 −4.2 −4.3 −3.2 −4.7 −3.5 −4.0 −3.3 −4.2 −4.1 −3.6 −3.6 −3.9 −2.9 −4.3
SASIA

−4
−4.3 −4.3 −4.0 −3.4 −5.0 −5.1 −4.7 −2.6 −4.1 −4.7 −3.8 −4.1 −3.4 −3.0 −4.4 −4.4 −4.0 −2.3 −3.7 −4.8
POLY
−4.3 −4.2 −4.0 −5.6 −4.7 −3.9 −3.6 −5.3 −4.2 −5.0 −3.7 −3.3 −3.4 −5.4 −4.3 −3.4 −3.2 −4.6 −3.6 −6.0
NAFRICA
-
−4.4 −4.2 −3.9 −5.3 −4.4 −3.7 −3.8 −4.9 −4.1 −5.2 −3.5 −3.6 −3.1 −4.6 −3.5 −3.0 −3.0 −4.1 −3.3 −4.5 −5
MEAST
−4.7 −4.2 −4.3 −5.4 −4.1 −4.4 −4.5 −5.2 −4.9 −5.0 −4.0 −3.7 −3.6 −4.8 −3.6 −3.8 −3.9 −4.5 −4.3 −4.5
EURO
−4.9 −3.8 −4.6 −3.0 −5.2 −5.6 −5.7 −3.4 −4.8 −5.3 −4.2 −3.3 −3.9 −2.5 −4.5 −4.9 −5.0 −3.0 −4.3 −4.6
−6
EASIA
VERIFICATION
−4.0 −4.2 −3.2 −4.6 −4.3 −4.1 −3.9 −4.0 −4.1 −4.7 −3.4 −3.7 −2.6 −4.0 −3.6 −3.3 −3.3 −3.4 −3.5 −4.2
CSAMERIC
−4.6 −3.3 −4.2 −3.9 −4.2 −4.0 −4.0 −4.5 −4.8 −5.9 −4.0 −2.8 −3.5 −3.5 −3.6 −3.4 −3.5 −4.1 −4.2 −6.0
CASIA
−3.2 −4.8 −4.2 −5.1 −4.6 −4.5 −4.2 −4.4 −4.3 −3.2 −2.7 −4.4 −3.6 −4.4 −4.0 −3.9 −3.7 −3.9 −3.8 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 150: For algorithm anke-003 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individ-


190
Cross region FMR at threshold T = 0.397 for algorithm anke_004, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.2 −5.8 −5.0 −5.2 −5.0 −5.3 −4.8 −3.1 −3.0 −6.0 −4.7 −5.5 −4.5 −4.7 −4.7 −5.0 −4.4 −2.8
SSAFRICA
−4.1 −4.7 −3.8 −5.1 −4.6 −4.0 −4.0 −4.5 −3.3 −4.6 −3.3 −3.9 −2.9 −4.4 −3.7 −3.2 −3.2 −4.0 −2.8 −4.0
SASIA
−4.6 −4.9 −4.4 −4.0 −5.3 −5.2 −5.2 −3.0 −4.4 −5.2 −4.1 −4.5 −3.7 −3.6 −4.5 −4.4 −4.7 −2.6 −3.9 −4.8
POLY
2019/10/16 12:43:37
−4.5 −4.4 −4.2 −6.0 −4.7 −4.0 −3.8 −5.7 −4.3 −5.1 −3.9 −3.6 −3.5 −5.7 −4.2 −3.4 −3.3 −6.0 −3.6 −4.9
NAFRICA log10 FMR
−4.3 −4.3 −3.7 −5.5 −4.3 −3.6 −3.8 −5.0 −3.9 −4.9 −3.3 −3.7 −2.8 −4.6 −3.4 −2.8 −2.9 −4.2 −3.0 −4.1
MEAST
−4.8 −4.5 −4.3 −5.8 −4.3 −4.4 −4.5 −5.4 −4.8 −5.2 −4.0 −4.0 −3.4 −5.0 −3.7 −3.6 −3.8 −4.7 −4.0 −4.6
EURO
−5.3 −4.6 −5.0 −3.9 −5.8 −5.7 −5.9 −4.0 −5.3 −5.8 −4.5 −4.0 −4.1 −3.3 −5.0 −4.8 −5.0 −3.6 −4.6 −5.2 −1
EASIA
−4.1 −4.4 −3.4 −5.0 −4.3 −3.9 −3.9 −4.3 −4.0 −4.8 −3.2 −3.6 −2.5 −4.2 −3.4 −3.0 −3.1 −3.6 −3.2 −4.1
FRVT
CSAMERIC
-
−5.3 −3.7 −4.4 −4.6 −4.4 −4.3 −4.4 −5.1 −5.0 −5.8 −4.3 −3.3 −3.6 −4.2 −3.7 −3.6 −3.8 −4.5 −4.4 −4.9
CASIA −2
−3.4 −5.6 −4.5 −5.6 −4.8 −4.8 −4.5 −4.7 −4.5 −3.4 −2.8 −5.0 −3.9 −5.1 −4.2 −4.2 −4.0 −4.4 −4.0 −2.9
CARIB

−3.2 −6.0 −4.9 −5.6 −4.8 −5.0 −4.7 −5.0 −4.6 −2.8 −2.8 −6.0 −4.5 −5.3 −4.3 −4.5 −4.4 −4.7 −4.1 −2.5
SSAFRICA
−4.0 −4.6 −3.8 −5.0 −4.5 −3.9 −3.9 −4.3 −3.1 −4.4 −3.2 −3.9 −2.8 −4.3 −3.7 −3.2 −3.2 −3.9 −2.7 −3.9
SASIA

−4
−4.3 −4.6 −4.1 −3.7 −5.1 −5.0 −5.1 −2.7 −4.1 −4.9 −3.9 −4.4 −3.5 −3.3 −4.4 −4.4 −6.0 −2.4 −3.7 −4.5
POLY
−4.3 −4.1 −3.9 −6.0 −4.5 −3.8 −3.6 −5.4 −4.1 −4.9 −3.7 −3.3 −3.3 −5.4 −4.0 −3.3 −3.1 −6.0 −3.6 −4.6
NAFRICA
-
−4.1 −4.0 −3.6 −5.4 −4.2 −3.5 −3.6 −4.8 −3.8 −4.8 −3.2 −3.5 −2.7 −4.6 −3.3 −2.7 −2.8 −4.0 −3.0 −4.0 −5
MEAST
−4.6 −4.3 −4.1 −5.7 −4.1 −4.3 −4.4 −5.2 −4.7 −5.0 −3.9 −3.8 −3.3 −5.0 −3.5 −3.5 −3.7 −4.6 −4.0 −4.5
EURO
−5.2 −4.4 −4.9 −3.7 −5.6 −5.6 −5.8 −3.7 −5.1 −5.6 −4.4 −3.8 −4.1 −3.1 −4.8 −4.8 −4.9 −3.4 −4.5 −5.0
−6
EASIA
VERIFICATION
−3.9 −4.2 −3.2 −4.9 −4.1 −3.8 −3.8 −4.1 −3.9 −4.6 −3.2 −3.5 −2.5 −4.1 −3.4 −3.0 −3.0 −3.5 −3.1 −4.0
CSAMERIC
−5.1 −3.5 −4.3 −4.4 −4.2 −4.1 −4.1 −4.8 −4.7 −5.6 −4.1 −3.0 −3.5 −3.9 −3.5 −3.4 −3.5 −4.2 −4.2 −4.9
CASIA
−3.2 −5.3 −4.3 −5.4 −4.6 −4.5 −4.2 −4.5 −4.2 −3.2 −2.6 −4.7 −3.7 −4.9 −4.0 −4.0 −3.7 −4.1 −3.8 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


191
Cross region FMR at threshold T = 1.526 for algorithm anyvision_002, giving FMR(T) = 0.0001 globally.
−3.4 −6.0 −5.2 −5.8 −5.0 −5.2 −5.0 −5.1 −4.9 −3.0 −3.0 −6.0 −4.8 −5.6 −4.5 −4.7 −4.7 −4.9 −4.4 −2.7
SSAFRICA
−4.2 −4.9 −4.1 −4.8 −4.7 −4.1 −4.1 −4.3 −3.2 −4.7 −3.3 −4.2 −3.2 −4.2 −4.0 −3.4 −3.4 −3.8 −2.8 −4.1
SASIA
−4.4 −4.4 −4.1 −3.5 −5.2 −5.0 −4.8 −2.7 −4.2 −5.1 −3.9 −4.1 −3.5 −3.1 −4.5 −4.4 −4.3 −2.4 −3.7 −4.7
POLY
2019/10/16 12:43:37
−4.6 −4.6 −4.4 −5.7 −5.0 −4.2 −4.0 −5.1 −4.2 −6.0 −3.9 −3.6 −3.6 −5.4 −4.4 −3.5 −3.5 −4.6 −3.3 −4.9
NAFRICA log10 FMR
−4.5 −4.5 −4.1 −5.3 −4.6 −3.9 −3.9 −4.7 −4.0 −5.2 −3.6 −3.8 −3.1 −4.5 −3.8 −3.0 −3.1 −3.9 −3.1 −4.3
MEAST
−5.0 −4.8 −4.6 −5.6 −4.7 −4.7 −4.8 −5.1 −4.9 −5.4 −4.2 −4.3 −3.8 −4.9 −4.1 −4.0 −4.1 −4.4 −4.1 −4.8
EURO
−5.2 −4.1 −4.8 −3.2 −5.3 −5.7 −5.5 −3.5 −4.9 −5.6 −4.5 −3.5 −4.0 −2.7 −4.7 −4.9 −4.8 −3.1 −4.4 −5.0 −1
EASIA
−4.2 −4.7 −3.6 −4.7 −4.7 −4.3 −4.2 −4.1 −4.1 −4.9 −3.4 −3.9 −2.9 −4.0 −3.9 −3.5 −3.4 −3.5 −3.4 −4.3
FRVT
CSAMERIC
-
−5.1 −3.7 −4.9 −4.1 −4.7 −4.5 −4.5 −4.6 −5.3 −6.0 −4.6 −3.2 −4.4 −3.7 −4.2 −4.0 −4.2 −4.1 −4.7 −6.0
CASIA −2
−3.3 −5.4 −4.5 −5.3 −4.7 −4.7 −4.7 −4.6 −4.5 −3.3 −2.7 −4.7 −3.9 −4.8 −4.1 −4.1 −4.0 −4.2 −4.0 −2.8
CARIB

−3.1 −6.0 −4.9 −5.6 −4.8 −5.0 −4.8 −4.8 −4.6 −2.7 −2.8 −6.0 −4.5 −5.3 −4.4 −4.4 −4.5 −4.6 −4.1 −2.5
SSAFRICA
−4.0 −4.7 −4.0 −4.6 −4.7 −4.0 −4.0 −4.1 −3.0 −4.5 −3.3 −4.1 −3.1 −4.0 −3.9 −3.3 −3.4 −3.7 −2.6 −4.0
SASIA

−4
−4.1 −4.2 −3.9 −3.2 −5.0 −4.9 −4.5 −2.4 −4.0 −4.9 −3.7 −3.9 −3.3 −2.8 −4.3 −4.3 −4.0 −2.1 −3.5 −4.4
POLY
−4.4 −4.3 −4.1 −5.6 −4.8 −4.0 −3.7 −4.9 −4.0 −5.7 −3.7 −3.3 −3.4 −5.1 −4.2 −3.4 −3.3 −4.3 −3.2 −4.6
NAFRICA
-
−4.3 −4.2 −3.9 −5.1 −4.4 −3.7 −3.7 −4.5 −3.8 −5.0 −3.5 −3.5 −3.0 −4.4 −3.7 −2.9 −3.0 −3.8 −3.0 −4.1 −5
MEAST
−4.8 −4.5 −4.4 −5.4 −4.4 −4.6 −4.6 −5.0 −4.8 −5.2 −4.1 −4.1 −3.7 −4.7 −3.9 −3.9 −4.0 −4.3 −4.1 −4.6
EURO
−4.9 −3.8 −4.6 −3.0 −5.1 −5.5 −5.3 −3.3 −4.7 −5.3 −4.3 −3.3 −3.9 −2.5 −4.5 −4.8 −4.8 −2.9 −4.2 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.4 −3.5 −4.5 −4.5 −4.1 −4.0 −3.9 −3.9 −4.7 −3.3 −3.7 −2.7 −3.9 −3.8 −3.4 −3.3 −3.3 −3.3 −4.2
CSAMERIC
−4.9 −3.4 −4.6 −3.8 −4.5 −4.2 −4.2 −4.3 −5.0 −6.0 −4.3 −2.9 −4.1 −3.4 −3.9 −3.7 −3.9 −3.8 −4.5 −6.0
CASIA
−3.1 −5.1 −4.3 −5.1 −4.5 −4.5 −4.4 −4.3 −4.2 −3.0 −2.6 −4.4 −3.7 −4.5 −4.0 −3.9 −3.8 −4.0 −3.7 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 152: For algorithm anyvision-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


192
Cross region FMR at threshold T = 1.375 for algorithm anyvision_004, giving FMR(T) = 0.0001 globally.
−3.2 −6.0 −5.0 −5.8 −4.8 −5.2 −4.9 −5.2 −4.8 −2.8 −2.9 −6.0 −4.7 −5.6 −4.4 −4.9 −4.7 −4.8 −4.3 −2.5
SSAFRICA
−4.2 −4.7 −4.2 −4.9 −4.8 −4.1 −4.1 −4.3 −3.1 −4.6 −3.4 −4.2 −3.4 −4.3 −4.1 −3.5 −3.5 −4.0 −2.7 −4.1
SASIA
−4.5 −4.3 −4.2 −3.6 −5.2 −5.1 −4.9 −2.8 −4.2 −5.2 −4.0 −4.0 −3.8 −3.3 −4.7 −4.6 −4.6 −2.5 −3.8 −4.8
POLY
2019/10/16 12:43:37
−4.4 −4.3 −4.1 −5.4 −4.6 −4.0 −3.7 −4.9 −4.1 −5.1 −3.6 −3.6 −3.5 −4.8 −4.0 −3.3 −3.2 −4.9 −3.4 −4.9
NAFRICA log10 FMR
−4.4 −4.2 −4.1 −5.4 −4.4 −3.7 −3.8 −4.8 −3.9 −5.0 −3.6 −3.7 −3.3 −4.8 −3.8 −3.1 −3.1 −4.3 −3.2 −4.3
MEAST
−4.7 −4.3 −4.4 −5.8 −4.3 −4.5 −4.5 −5.3 −4.9 −5.0 −4.1 −3.8 −3.9 −5.2 −3.8 −4.0 −4.0 −4.7 −4.2 −4.5
EURO
−5.5 −4.1 −5.0 −3.4 −5.6 −5.6 −5.7 −3.7 −5.0 −5.8 −5.0 −3.6 −4.4 −2.9 −5.0 −4.9 −5.4 −3.3 −4.6 −5.1 −1
EASIA
−4.2 −4.4 −3.5 −5.0 −4.5 −4.2 −4.1 −4.2 −4.1 −4.8 −3.5 −3.9 −2.9 −4.4 −3.9 −3.6 −3.5 −3.8 −3.5 −4.3
FRVT
CSAMERIC
-
−4.7 −3.5 −4.4 −4.2 −4.3 −4.1 −4.0 −4.5 −4.7 −6.0 −4.1 −3.0 −4.0 −3.7 −3.8 −3.6 −3.7 −4.0 −4.3 −5.2
CASIA −2
−3.2 −4.9 −4.4 −5.5 −4.6 −4.6 −4.4 −4.7 −4.3 −3.1 −2.6 −4.2 −3.9 −5.0 −3.9 −4.0 −3.8 −4.4 −3.9 −2.7
CARIB

−2.9 −6.0 −4.8 −5.6 −4.6 −4.9 −4.6 −4.9 −4.5 −2.6 −2.6 −6.0 −4.4 −5.3 −4.2 −4.7 −4.5 −4.5 −4.1 −2.3
SSAFRICA
−3.9 −4.5 −4.0 −4.6 −4.6 −3.9 −3.9 −4.1 −2.8 −4.4 −3.3 −4.1 −3.3 −4.1 −4.0 −3.3 −3.4 −3.7 −2.5 −3.9
SASIA

−4
−4.2 −4.0 −4.0 −3.4 −4.9 −4.8 −4.6 −2.5 −3.9 −4.9 −3.8 −3.7 −3.5 −3.0 −4.4 −4.4 −4.3 −2.2 −3.5 −4.5
POLY
−4.1 −4.0 −3.9 −5.2 −4.3 −3.7 −3.4 −4.6 −3.9 −4.9 −3.4 −3.3 −3.3 −4.6 −3.7 −3.1 −2.9 −4.6 −3.3 −6.0
NAFRICA
-
−4.2 −3.9 −3.8 −5.3 −4.2 −3.5 −3.5 −4.6 −3.7 −4.8 −3.5 −3.4 −3.2 −4.7 −3.6 −2.9 −2.9 −4.1 −3.1 −4.3 −5
MEAST
−4.5 −4.0 −4.2 −5.5 −4.0 −4.3 −4.3 −5.1 −4.7 −4.8 −3.9 −3.4 −3.6 −5.0 −3.5 −3.8 −3.8 −4.5 −4.1 −4.4
EURO
−5.3 −3.8 −4.7 −3.1 −5.4 −5.5 −5.4 −3.4 −4.8 −5.5 −4.8 −3.4 −4.2 −2.7 −4.8 −4.8 −5.1 −3.0 −4.4 −4.9
−6
EASIA
VERIFICATION
−4.0 −4.1 −3.3 −4.7 −4.2 −4.0 −3.8 −4.0 −3.9 −4.6 −3.3 −3.6 −2.7 −4.2 −3.7 −3.4 −3.3 −3.5 −3.4 −4.1
CSAMERIC
−4.4 −3.2 −4.2 −3.9 −4.0 −3.8 −3.7 −4.2 −4.4 −5.9 −3.8 −2.7 −3.7 −3.4 −3.5 −3.3 −3.4 −3.7 −4.0 −4.9
CASIA
−3.0 −4.6 −4.1 −5.2 −4.3 −4.3 −4.1 −4.4 −4.1 −2.9 −2.5 −3.9 −3.6 −4.7 −3.8 −3.8 −3.5 −4.1 −3.6 −2.5
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


193
Cross region FMR at threshold T = 3.868 for algorithm aware_003, giving FMR(T) = 0.0001 globally.
−3.7 −6.0 −5.7 −6.0 −5.3 −5.6 −6.0 −6.0 −5.5 −3.2 −3.2 −6.0 −5.3 −6.0 −4.8 −5.2 −6.0 −6.0 −5.1 −2.9
SSAFRICA
−4.5 −5.1 −4.3 −5.0 −5.0 −4.4 −4.6 −4.8 −3.2 −5.0 −3.5 −4.2 −3.3 −4.3 −4.1 −3.5 −3.7 −4.1 −2.8 −4.3
SASIA
−4.9 −4.9 −4.7 −3.8 −5.5 −5.5 −5.8 −3.1 −4.7 −5.8 −4.1 −5.0 −3.9 −3.3 −4.7 −4.6 −6.0 −2.8 −4.2 −5.6
POLY
2019/10/16 12:43:37
−5.6 −5.0 −5.3 −6.0 −6.0 −5.1 −5.0 −6.0 −5.2 −6.0 −4.5 −3.9 −4.4 −6.0 −5.2 −4.4 −6.0 −6.0 −4.4 −6.0
NAFRICA log10 FMR
−4.6 −5.0 −4.1 −5.7 −4.7 −4.0 −4.2 −5.1 −4.1 −5.6 −3.6 −4.2 −3.0 −4.8 −3.7 −3.1 −3.2 −4.2 −3.1 −4.7
MEAST
−5.2 −5.3 −4.8 −5.7 −5.0 −4.9 −5.2 −5.6 −5.3 −5.6 −4.3 −4.6 −3.8 −4.8 −4.1 −4.1 −4.4 −4.7 −4.5 −4.8
EURO
−5.5 −4.1 −5.1 −2.9 −5.4 −6.0 −6.0 −3.8 −5.1 −6.0 −4.8 −3.6 −4.2 −2.5 −4.7 −5.2 −5.4 −3.3 −4.7 −5.2 −1
EASIA
−4.5 −4.9 −3.9 −5.0 −4.7 −4.3 −4.5 −4.6 −4.4 −5.4 −3.5 −3.9 −2.9 −4.1 −3.7 −3.3 −3.5 −3.7 −3.5 −4.5
FRVT
CSAMERIC
-
−5.3 −3.9 −4.4 −4.0 −4.7 −4.7 −5.0 −5.0 −5.2 −6.0 −4.3 −3.2 −3.3 −3.5 −3.7 −3.7 −4.2 −4.6 −4.2 −6.0
CASIA −2
−3.5 −6.0 −5.2 −6.0 −5.0 −5.3 −5.4 −5.5 −5.0 −3.5 −2.8 −5.3 −4.5 −5.3 −4.2 −4.6 −4.5 −5.1 −4.4 −3.0
CARIB

−3.4 −6.0 −5.5 −6.0 −5.2 −5.4 −6.0 −6.0 −5.3 −2.9 −3.1 −6.0 −5.1 −6.0 −4.7 −4.9 −6.0 −6.0 −4.8 −2.6
SSAFRICA
−4.4 −5.0 −4.2 −4.9 −4.9 −4.3 −4.5 −4.6 −2.9 −4.9 −3.5 −4.2 −3.2 −4.2 −4.0 −3.5 −3.7 −4.0 −2.5 −4.2
SASIA

−4
−4.7 −4.7 −4.6 −3.6 −5.4 −5.4 −5.5 −2.8 −4.5 −5.6 −4.0 −4.7 −3.8 −3.1 −4.6 −4.5 −6.0 −2.5 −4.0 −6.0
POLY
−5.4 −4.7 −5.1 −6.0 −6.0 −4.9 −4.9 −6.0 −4.9 −6.0 −4.4 −3.6 −4.2 −6.0 −5.2 −4.3 −6.0 −6.0 −4.2 −6.0
NAFRICA
-
−4.5 −5.0 −4.0 −5.7 −4.6 −3.9 −4.1 −5.0 −4.0 −5.5 −3.5 −4.2 −3.0 −4.8 −3.6 −3.0 −3.2 −4.0 −3.1 −4.6 −5
MEAST
−5.2 −5.1 −4.7 −5.4 −4.9 −4.9 −5.2 −5.5 −5.2 −5.5 −4.3 −4.4 −3.8 −4.6 −4.1 −4.0 −4.4 −4.6 −4.4 −4.8
EURO
−5.3 −3.9 −4.9 −2.7 −5.2 −6.0 −6.0 −3.6 −4.9 −5.8 −4.7 −3.4 −4.1 −2.3 −4.6 −5.2 −5.6 −3.1 −4.5 −5.2
−6
EASIA
VERIFICATION
−4.5 −4.8 −3.8 −4.9 −4.7 −4.3 −4.4 −4.5 −4.4 −5.2 −3.5 −3.9 −2.8 −4.0 −3.7 −3.3 −3.5 −3.7 −3.5 −4.5
CSAMERIC
−5.4 −3.6 −4.3 −3.7 −4.6 −4.6 −4.9 −4.7 −5.1 −6.0 −4.3 −2.9 −3.2 −3.2 −3.6 −3.6 −4.4 −4.3 −4.2 −6.0
CASIA
−3.4 −5.7 −5.0 −5.7 −4.9 −5.1 −5.1 −5.2 −4.8 −3.3 −2.7 −5.0 −4.3 −5.1 −4.2 −4.4 −4.2 −4.8 −4.2 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 154: For algorithm aware-003 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


194
Cross region FMR at threshold T = 5.084 for algorithm aware_004, giving FMR(T) = 0.0001 globally.
−3.8 −6.0 −5.7 −6.0 −5.4 −5.9 −6.0 −6.0 −5.5 −3.3 −3.4 −6.0 −5.5 −6.0 −4.9 −5.4 −5.3 −5.9 −5.1 −3.0
SSAFRICA
−4.7 −5.2 −4.7 −5.1 −5.2 −4.6 −4.8 −4.9 −3.2 −5.2 −3.8 −4.5 −3.7 −4.6 −4.4 −3.8 −3.9 −4.6 −2.8 −4.5
SASIA
−5.2 −4.9 −5.2 −3.7 −5.9 −6.0 −6.0 −2.9 −4.6 −5.8 −4.7 −6.0 −4.6 −3.3 −5.5 −5.5 −6.0 −2.6 −4.1 −5.1
POLY
2019/10/16 12:43:37
−5.9 −5.4 −5.4 −6.0 −6.0 −5.3 −4.8 −6.0 −4.9 −6.0 −5.0 −4.3 −4.5 −6.0 −5.2 −4.5 −4.3 −6.0 −4.2 −4.9
NAFRICA log10 FMR
−4.9 −5.3 −4.4 −6.0 −5.0 −4.2 −4.4 −5.7 −4.3 −6.0 −3.9 −4.6 −3.4 −5.1 −4.0 −3.3 −3.4 −5.2 −3.4 −5.2
MEAST
−5.7 −5.5 −5.3 −5.8 −5.4 −5.4 −5.6 −6.0 −5.7 −5.7 −4.8 −4.9 −4.4 −5.3 −4.6 −4.6 −4.8 −5.5 −5.0 −5.1
EURO
−5.4 −4.0 −5.4 −2.8 −5.5 −6.0 −6.0 −3.7 −5.1 −5.9 −5.1 −3.6 −4.9 −2.4 −5.0 −5.5 −6.0 −3.3 −4.7 −5.5 −1
EASIA
−5.0 −5.3 −4.4 −5.5 −5.2 −4.7 −4.9 −5.0 −4.9 −5.7 −4.1 −4.5 −3.4 −4.9 −4.2 −3.8 −4.0 −4.4 −4.0 −4.9
FRVT
CSAMERIC
-
−5.7 −3.8 −4.8 −3.9 −4.9 −5.0 −5.1 −4.8 −5.6 −6.0 −4.6 −3.2 −3.7 −3.4 −4.0 −4.0 −4.7 −4.6 −4.9 −6.0
CASIA −2
−3.7 −5.9 −5.3 −6.0 −5.3 −5.6 −5.7 −5.3 −5.2 −3.6 −3.1 −5.3 −4.7 −5.5 −4.6 −4.9 −5.3 −5.0 −4.6 −3.2
CARIB

−3.5 −6.0 −5.5 −6.0 −5.2 −5.6 −5.7 −5.9 −5.3 −3.0 −3.2 −6.0 −5.2 −6.0 −4.8 −5.2 −5.0 −5.6 −4.8 −2.7
SSAFRICA
−4.6 −5.0 −4.6 −4.9 −5.2 −4.5 −4.7 −4.7 −2.9 −5.0 −3.8 −4.3 −3.6 −4.4 −4.3 −3.7 −3.9 −4.4 −2.6 −4.3
SASIA

−4
−5.0 −4.6 −4.9 −3.4 −5.6 −5.9 −5.8 −2.6 −4.3 −5.5 −4.5 −6.0 −4.4 −3.1 −5.2 −5.5 −6.0 −2.4 −3.9 −4.8
POLY
−5.6 −5.1 −5.2 −6.0 −6.0 −5.0 −4.6 −6.0 −4.6 −5.7 −4.7 −4.0 −4.3 −6.0 −5.2 −4.2 −4.1 −6.0 −4.0 −4.6
NAFRICA
-
−4.8 −5.2 −4.3 −6.0 −4.9 −4.1 −4.2 −5.5 −4.2 −5.7 −3.8 −4.8 −3.3 −5.1 −3.9 −3.2 −3.3 −5.0 −3.3 −4.9 −5
MEAST
−5.5 −5.3 −5.2 −5.5 −5.3 −5.3 −5.7 −6.0 −5.6 −5.5 −4.8 −4.7 −4.3 −5.1 −4.5 −4.5 −5.0 −5.4 −4.9 −5.0
EURO
−5.2 −3.8 −5.2 −2.6 −5.2 −6.0 −6.0 −3.4 −4.8 −5.7 −4.8 −3.3 −4.6 −2.2 −4.8 −5.3 −6.0 −3.1 −4.4 −5.3
−6
EASIA
VERIFICATION
−4.8 −5.2 −4.2 −5.2 −5.1 −4.7 −4.8 −4.8 −4.8 −5.4 −4.0 −4.4 −3.3 −4.7 −4.2 −3.7 −3.9 −4.3 −3.9 −4.8
CSAMERIC
−5.8 −3.5 −4.7 −3.6 −4.8 −5.0 −4.9 −4.5 −5.5 −6.0 −4.7 −2.9 −3.6 −3.2 −3.9 −3.9 −6.0 −4.3 −5.0 −6.0
CASIA
−3.5 −5.6 −5.1 −5.8 −5.1 −5.3 −5.5 −5.0 −4.9 −3.4 −2.9 −5.0 −4.5 −5.3 −4.5 −4.7 −6.0 −4.7 −4.4 −3.0
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


195
Cross region FMR at threshold T = 0.799 for algorithm awiros_001, giving FMR(T) = 0.0001 globally.
−4.0 −6.0 −5.5 −6.0 −5.5 −5.6 −5.3 −5.2 −4.8 −3.9 −3.6 −6.0 −5.2 −6.0 −5.1 −5.4 −5.0 −4.9 −4.5 −3.6
SSAFRICA
−4.1 −4.5 −4.1 −4.7 −4.8 −4.0 −4.0 −4.0 −3.0 −4.8 −3.7 −4.0 −3.6 −4.4 −4.3 −3.6 −3.7 −3.8 −2.7 −4.5
SASIA
−4.4 −4.1 −4.2 −3.5 −5.0 −4.9 −4.6 −2.8 −4.0 −5.1 −4.1 −3.9 −3.7 −3.2 −4.5 −4.4 −4.0 −2.6 −3.8 −4.7
POLY
2019/10/16 12:43:37
−4.6 −4.2 −4.1 −5.3 −4.7 −4.0 −3.8 −4.4 −3.9 −5.5 −4.3 −3.9 −3.7 −5.4 −4.4 −3.5 −3.1 −4.2 −3.4 −4.9
NAFRICA log10 FMR
−4.5 −4.3 −4.1 −5.4 −4.5 −3.8 −3.9 −4.5 −3.8 −5.2 −3.9 −3.8 −3.4 −4.8 −3.9 −3.3 −3.3 −4.0 −3.4 −4.8
MEAST
−5.0 −4.5 −4.7 −5.5 −4.4 −4.6 −4.7 −5.2 −5.0 −5.4 −4.5 −4.1 −4.1 −4.9 −4.0 −4.1 −4.3 −4.9 −4.6 −5.0
EURO
−5.1 −3.8 −4.8 −3.1 −5.2 −5.3 −5.3 −3.5 −4.6 −5.5 −4.6 −3.5 −4.2 −2.7 −4.7 −4.7 −4.6 −3.2 −4.3 −5.2 −1
EASIA
−4.4 −4.4 −3.9 −4.9 −4.6 −4.2 −4.2 −4.1 −4.1 −5.4 −3.8 −3.8 −3.3 −4.4 −4.0 −3.6 −3.6 −3.7 −3.7 −4.9
FRVT
CSAMERIC
-
−5.2 −3.5 −4.7 −3.7 −4.6 −4.4 −4.5 −4.2 −4.7 −6.0 −4.5 −3.1 −4.3 −3.5 −4.2 −4.0 −4.4 −4.0 −4.2 −6.0
CASIA −2
−3.6 −5.0 −4.6 −5.6 −4.9 −4.8 −4.8 −4.6 −4.3 −3.8 −3.0 −4.6 −4.1 −5.2 −4.5 −4.2 −4.4 −4.3 −4.0 −3.3
CARIB

−3.8 −5.7 −5.3 −5.9 −5.3 −5.4 −5.1 −4.9 −4.6 −3.6 −3.4 −6.0 −4.9 −6.0 −4.9 −5.2 −4.7 −4.6 −4.3 −3.3
SSAFRICA
−3.8 −4.2 −3.9 −4.5 −4.6 −3.8 −3.8 −3.8 −2.7 −4.5 −3.5 −3.8 −3.4 −4.2 −4.2 −3.4 −3.5 −3.6 −2.4 −4.3
SASIA

−4
−4.2 −3.9 −4.0 −3.2 −4.8 −4.6 −4.4 −2.6 −3.7 −4.8 −3.9 −3.7 −3.6 −3.0 −4.3 −4.2 −3.8 −2.3 −3.6 −4.4
POLY
−4.4 −4.0 −3.9 −5.0 −4.5 −3.7 −3.5 −4.2 −3.7 −5.3 −4.1 −3.7 −3.4 −5.1 −4.1 −3.2 −2.9 −3.9 −3.1 −4.6
NAFRICA
-
−4.3 −4.0 −3.9 −5.1 −4.2 −3.6 −3.7 −4.3 −3.6 −5.0 −3.7 −3.6 −3.3 −4.6 −3.7 −3.1 −3.2 −3.8 −3.2 −4.5 −5
MEAST
−4.8 −4.2 −4.4 −5.3 −4.2 −4.3 −4.5 −5.0 −4.7 −5.2 −4.4 −3.8 −3.9 −4.7 −3.7 −3.9 −4.0 −4.7 −4.4 −4.9
EURO
−4.8 −3.6 −4.6 −2.9 −5.0 −5.1 −5.1 −3.2 −4.4 −5.3 −4.4 −3.2 −4.0 −2.5 −4.6 −4.5 −4.4 −3.0 −4.1 −5.0
−6
EASIA
VERIFICATION
−4.2 −4.1 −3.7 −4.7 −4.4 −4.0 −4.0 −3.9 −3.9 −5.2 −3.6 −3.6 −3.1 −4.2 −3.8 −3.4 −3.4 −3.5 −3.5 −4.7
CSAMERIC
−4.9 −3.3 −4.4 −3.4 −4.3 −4.1 −4.3 −3.9 −4.4 −6.0 −4.2 −2.9 −4.1 −3.2 −3.9 −3.7 −4.1 −3.7 −3.9 −6.0
CASIA
−3.4 −4.7 −4.4 −5.3 −4.7 −4.6 −4.5 −4.3 −4.0 −3.5 −2.9 −4.3 −3.9 −4.9 −4.3 −3.9 −4.2 −4.1 −3.7 −3.1
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 156: For algorithm awiros-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


196
Cross region FMR at threshold T = 0.919 for algorithm ayonix_000, giving FMR(T) = 0.0001 globally.
−3.5 −5.8 −5.2 −6.0 −5.0 −5.4 −5.3 −5.5 −4.7 −3.1 −3.0 −5.3 −4.7 −6.0 −4.5 −5.1 −4.8 −5.6 −4.3 −2.9
SSAFRICA
−4.2 −4.7 −4.1 −5.0 −4.7 −3.9 −4.0 −4.4 −2.8 −4.5 −3.4 −4.0 −3.3 −4.4 −4.0 −3.3 −3.4 −4.0 −2.4 −4.1
SASIA
−4.7 −4.8 −4.7 −4.1 −5.5 −5.1 −4.9 −3.5 −4.4 −5.7 −4.1 −4.5 −4.0 −3.7 −4.8 −4.3 −4.4 −3.1 −4.0 −5.1
POLY
2019/10/16 12:43:37
−4.9 −4.8 −4.5 −6.0 −5.0 −4.4 −4.2 −5.2 −4.1 −5.4 −4.7 −4.3 −3.7 −5.4 −4.3 −3.7 −3.7 −4.6 −3.7 −4.9
NAFRICA log10 FMR
−4.6 −4.6 −4.1 −5.5 −4.6 −3.9 −4.0 −4.8 −3.8 −5.2 −3.7 −3.9 −3.2 −4.7 −3.8 −3.1 −3.2 −4.1 −3.1 −4.7
MEAST
−5.0 −4.7 −4.7 −5.7 −4.7 −4.8 −4.8 −5.4 −4.9 −5.4 −4.2 −4.1 −3.9 −5.0 −4.0 −4.1 −4.2 −4.8 −4.4 −4.7
EURO
−5.5 −4.1 −5.1 −3.2 −5.4 −5.7 −6.0 −4.0 −5.1 −6.0 −4.9 −3.6 −4.3 −2.7 −4.8 −5.0 −5.1 −3.5 −4.6 −5.5 −1
EASIA
−4.4 −4.7 −3.9 −5.1 −4.7 −4.3 −4.4 −4.6 −4.2 −5.0 −3.5 −3.9 −3.0 −4.2 −3.8 −3.4 −3.5 −3.8 −3.5 −4.4
FRVT
CSAMERIC
-
−5.0 −3.7 −4.7 −4.1 −4.5 −4.6 −4.5 −4.8 −5.1 −6.0 −4.5 −3.2 −3.9 −3.7 −3.9 −3.8 −4.1 −4.5 −4.6 −6.0
CASIA −2
−3.3 −4.9 −4.8 −5.7 −4.8 −5.0 −4.9 −5.0 −4.3 −3.3 −2.8 −4.3 −4.1 −5.2 −4.3 −4.5 −4.4 −4.6 −3.8 −2.9
CARIB

−3.3 −5.5 −5.0 −6.0 −4.8 −5.2 −5.0 −5.3 −4.5 −2.9 −2.9 −5.0 −4.5 −5.8 −4.4 −5.0 −4.5 −6.0 −4.1 −2.7
SSAFRICA
−4.0 −4.5 −4.0 −4.8 −4.6 −3.8 −3.8 −4.2 −2.5 −4.3 −3.3 −3.8 −3.2 −4.3 −3.9 −3.2 −3.3 −3.8 −2.2 −3.9
SASIA

−4
−4.6 −4.6 −4.5 −3.8 −5.3 −4.9 −4.7 −3.2 −4.2 −5.6 −4.1 −4.2 −3.9 −3.4 −4.9 −4.1 −4.2 −2.8 −3.8 −5.3
POLY
−4.7 −4.5 −4.4 −6.0 −4.9 −4.2 −3.9 −5.0 −3.9 −5.1 −4.4 −4.0 −3.7 −5.1 −4.1 −3.5 −3.8 −4.3 −3.5 −4.6
NAFRICA
-
−4.4 −4.5 −4.0 −5.5 −4.5 −3.7 −3.8 −4.7 −3.6 −4.9 −3.6 −3.9 −3.1 −4.7 −3.7 −3.0 −3.1 −3.9 −3.0 −4.5 −5
MEAST
−4.9 −4.5 −4.6 −5.6 −4.5 −4.7 −4.6 −5.2 −4.8 −5.2 −4.1 −3.9 −3.8 −4.9 −3.9 −4.0 −4.0 −4.7 −4.3 −4.6
EURO
−5.3 −3.8 −4.9 −3.0 −5.2 −5.6 −5.8 −3.8 −4.9 −5.8 −4.7 −3.4 −4.2 −2.5 −4.7 −4.9 −4.8 −3.4 −4.5 −5.3
−6
EASIA
VERIFICATION
−4.3 −4.6 −3.8 −5.0 −4.6 −4.2 −4.3 −4.4 −4.0 −4.8 −3.5 −3.8 −3.0 −4.2 −3.7 −3.3 −3.5 −3.7 −3.4 −4.2
CSAMERIC
−4.8 −3.5 −4.5 −3.8 −4.3 −4.3 −4.2 −4.5 −4.9 −6.0 −4.2 −3.0 −3.8 −3.4 −3.7 −3.6 −3.8 −4.2 −4.4 −6.0
CASIA
−3.2 −4.6 −4.5 −5.5 −4.7 −4.7 −4.6 −4.8 −4.0 −3.1 −2.7 −4.0 −4.0 −5.0 −4.2 −4.3 −4.1 −4.4 −3.6 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 157: For algorithm ayonix-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


197
Cross region FMR at threshold T = 0.731 for algorithm bm_001, giving FMR(T) = 0.0001 globally.
−3.1 −4.3 −3.9 −4.6 −4.2 −4.2 −4.3 −4.1 −4.0 −3.0 −3.0 −4.3 −3.7 −4.6 −4.0 −4.1 −4.1 −4.0 −3.8 −2.9
SSAFRICA
−3.8 −4.5 −4.0 −4.7 −4.4 −4.3 −4.4 −4.3 −3.9 −3.9 −3.7 −4.3 −3.9 −4.6 −4.2 −4.1 −4.1 −4.2 −3.7 −3.8
SASIA
−4.1 −4.4 −4.2 −4.3 −4.5 −4.6 −4.8 −4.1 −4.6 −4.3 −3.9 −4.4 −4.0 −4.1 −4.5 −4.6 −4.6 −3.8 −4.4 −4.2
POLY
2019/10/16 12:43:37
−4.5 −4.8 −4.5 −4.9 −4.5 −4.5 −4.4 −5.1 −4.6 −4.5 −4.4 −6.0 −4.2 −4.9 −4.3 −4.4 −6.0 −6.0 −4.3 −4.4
NAFRICA log10 FMR
−4.4 −4.6 −4.2 −4.6 −4.5 −4.3 −4.4 −4.6 −4.5 −4.5 −4.2 −4.3 −4.0 −4.6 −4.3 −4.1 −4.0 −4.7 −4.4 −4.3
MEAST
−4.1 −4.3 −4.1 −4.6 −4.2 −4.3 −4.5 −4.5 −4.5 −4.2 −3.9 −4.2 −3.8 −4.5 −4.1 −4.2 −4.4 −4.3 −4.3 −4.1
EURO
−4.4 −4.3 −4.3 −3.7 −4.5 −4.5 −4.6 −4.2 −4.6 −4.4 −4.3 −4.0 −4.2 −3.3 −4.4 −4.4 −4.4 −4.0 −4.4 −4.5 −1
EASIA
−3.8 −4.2 −3.6 −4.6 −4.1 −4.2 −4.3 −4.1 −4.2 −3.9 −3.6 −4.0 −3.3 −4.4 −3.9 −3.9 −4.0 −3.9 −4.0 −3.8
FRVT
CSAMERIC
-
−4.3 −3.9 −4.2 −4.1 −4.2 −4.4 −4.5 −4.4 −4.4 −4.5 −4.1 −3.6 −4.1 −4.0 −4.0 −4.0 −6.0 −4.2 −4.2 −4.9
CASIA −2
−3.0 −4.1 −3.6 −4.5 −4.0 −4.1 −4.2 −4.0 −3.9 −3.0 −2.8 −4.2 −3.5 −4.5 −3.9 −4.0 −4.1 −3.8 −3.7 −2.9
CARIB

−3.0 −4.3 −3.8 −4.6 −4.1 −4.2 −4.2 −4.0 −3.9 −2.9 −2.9 −4.1 −3.6 −4.6 −3.9 −4.1 −4.1 −3.9 −3.7 −2.8
SSAFRICA
−3.7 −4.3 −3.9 −4.6 −4.2 −4.2 −4.3 −4.2 −3.8 −3.8 −3.6 −4.1 −3.7 −4.5 −4.1 −4.0 −4.0 −4.1 −3.5 −3.7
SASIA

−4
−4.1 −4.2 −4.1 −4.1 −4.4 −4.5 −4.6 −3.9 −4.4 −4.2 −3.9 −4.1 −3.8 −3.9 −4.3 −4.4 −4.3 −3.6 −4.3 −4.1
POLY
−4.5 −4.5 −4.4 −4.8 −4.4 −4.3 −4.1 −5.0 −4.4 −4.5 −4.2 −6.0 −4.0 −4.6 −4.2 −4.2 −6.0 −6.0 −4.1 −4.3
NAFRICA
-
−4.3 −4.5 −4.1 −4.6 −4.4 −4.2 −4.2 −4.5 −4.4 −4.5 −4.1 −4.2 −3.8 −4.7 −4.2 −4.0 −3.8 −4.6 −4.4 −4.3 −5
MEAST
−4.0 −4.2 −3.9 −4.5 −4.1 −4.2 −4.4 −4.3 −4.4 −4.1 −3.9 −4.0 −3.7 −4.4 −3.9 −4.0 −4.2 −4.2 −4.2 −4.0
EURO
−4.3 −4.1 −4.3 −3.5 −4.4 −4.4 −4.5 −4.1 −4.5 −4.4 −4.3 −3.8 −4.1 −3.2 −4.3 −4.3 −4.3 −3.8 −4.4 −4.4
−6
EASIA
VERIFICATION
−3.7 −4.0 −3.5 −4.5 −4.0 −4.1 −4.2 −4.0 −4.1 −3.8 −3.5 −3.8 −3.2 −4.3 −3.8 −3.8 −3.9 −3.8 −3.9 −3.7
CSAMERIC
−4.1 −3.8 −4.0 −3.9 −4.1 −4.3 −4.4 −4.3 −4.3 −4.4 −3.9 −3.3 −4.0 −3.8 −3.8 −3.9 −6.0 −4.0 −4.1 −4.9
CASIA
−2.9 −4.1 −3.6 −4.5 −3.9 −4.0 −4.2 −3.9 −3.8 −3.0 −2.8 −4.0 −3.4 −4.5 −3.8 −3.9 −3.9 −3.7 −3.6 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 158: For algorithm bm-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals

who were born in the given region pair. False matches are counted against a recognition threshold fixed globally to give the target FMR in the plot title, computed over

all on the order of 1010 impostor comparisons. If text appears in each box it give the same quantity as that coded by the color. Grey indicates FMR is at the intended
198
Cross region FMR at threshold T = 0.388 for algorithm camvi_002, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.3 −5.8 −5.0 −5.3 −5.2 −5.2 −5.0 −3.1 −3.1 −5.3 −4.8 −5.4 −4.5 −5.0 −5.3 −5.0 −4.6 −2.8
SSAFRICA
−4.2 −4.7 −3.9 −4.9 −4.7 −4.1 −4.1 −4.4 −3.3 −4.7 −3.4 −3.9 −3.0 −4.1 −3.9 −3.3 −3.3 −3.7 −2.8 −4.1
SASIA
−4.5 −4.8 −4.2 −3.8 −5.1 −4.9 −4.9 −3.0 −4.3 −5.1 −4.0 −4.3 −3.3 −3.3 −4.3 −4.0 −4.1 −2.6 −3.7 −4.6
POLY
2019/10/16 12:43:37
−4.8 −4.4 −4.3 −6.0 −4.9 −4.3 −4.0 −5.6 −4.5 −5.5 −4.2 −3.7 −3.6 −5.4 −4.4 −3.6 −3.7 −6.0 −3.9 −4.6
NAFRICA log10 FMR
−4.4 −4.3 −3.8 −5.2 −4.5 −3.8 −3.9 −4.6 −3.9 −5.1 −3.4 −3.7 −2.8 −4.3 −3.6 −2.9 −3.0 −3.7 −3.0 −4.2
MEAST
−4.9 −4.5 −4.4 −5.6 −4.5 −4.6 −4.7 −5.2 −4.9 −5.3 −4.1 −4.0 −3.5 −4.9 −3.9 −3.8 −3.9 −4.4 −4.0 −4.7
EURO
−5.2 −4.2 −4.8 −3.4 −5.3 −5.5 −5.6 −3.8 −5.0 −5.6 −4.3 −3.6 −3.9 −2.8 −4.5 −4.7 −4.9 −3.2 −4.4 −4.9 −1
EASIA
−4.2 −4.4 −3.4 −4.9 −4.5 −4.1 −4.1 −4.2 −4.1 −5.0 −3.4 −3.7 −2.6 −4.0 −3.6 −3.2 −3.2 −3.5 −3.3 −4.3
FRVT
CSAMERIC
-
−5.4 −3.8 −4.5 −4.4 −4.6 −4.4 −4.5 −5.0 −5.1 −6.0 −4.6 −3.4 −3.6 −4.1 −3.8 −3.6 −4.1 −4.9 −4.3 −5.2
CASIA −2
−3.4 −5.7 −4.6 −5.5 −4.8 −4.9 −4.6 −4.7 −4.6 −3.4 −2.7 −6.0 −4.0 −4.9 −4.1 −4.2 −4.1 −4.3 −4.2 −2.9
CARIB

−3.3 −5.7 −5.0 −5.6 −4.8 −5.1 −4.9 −5.0 −4.8 −2.8 −2.9 −5.0 −4.6 −5.1 −4.3 −4.7 −6.0 −4.8 −4.3 −2.6
SSAFRICA
−4.1 −4.6 −3.8 −4.7 −4.6 −4.0 −4.0 −4.2 −3.1 −4.5 −3.3 −3.9 −2.9 −4.1 −3.8 −3.2 −3.3 −3.6 −2.6 −4.0
SASIA

−4
−4.3 −4.6 −4.0 −3.6 −5.0 −4.8 −4.7 −2.7 −4.1 −4.8 −3.7 −4.1 −3.2 −3.1 −4.2 −4.0 −4.0 −2.4 −3.6 −4.5
POLY
−4.5 −4.2 −4.1 −5.7 −4.7 −4.1 −3.7 −5.3 −4.2 −5.4 −3.8 −3.4 −3.4 −5.1 −4.2 −3.5 −3.5 −6.0 −3.8 −4.3
NAFRICA
-
−4.2 −4.1 −3.7 −5.1 −4.3 −3.6 −3.7 −4.5 −3.8 −4.9 −3.3 −3.6 −2.7 −4.3 −3.4 −2.8 −2.9 −3.7 −2.9 −4.2 −5
MEAST
−4.8 −4.3 −4.3 −5.4 −4.3 −4.5 −4.5 −5.1 −4.8 −5.1 −4.0 −3.7 −3.5 −4.7 −3.7 −3.7 −3.8 −4.3 −4.0 −4.5
EURO
−5.0 −4.0 −4.6 −3.2 −5.2 −5.4 −5.4 −3.6 −4.9 −5.4 −4.2 −3.4 −3.8 −2.7 −4.4 −4.6 −4.7 −3.1 −4.3 −4.9
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.7 −4.3 −3.9 −3.9 −4.0 −4.0 −4.8 −3.3 −3.6 −2.5 −3.9 −3.5 −3.1 −3.1 −3.4 −3.2 −4.2
CSAMERIC
−5.1 −3.5 −4.3 −4.2 −4.3 −4.1 −4.2 −4.7 −4.8 −5.9 −4.4 −3.2 −3.5 −3.8 −3.6 −3.5 −3.8 −4.6 −4.2 −4.9
CASIA
−3.2 −5.4 −4.4 −5.3 −4.6 −4.7 −4.3 −4.4 −4.3 −3.2 −2.6 −6.0 −3.8 −4.7 −4.0 −4.1 −3.8 −4.0 −3.9 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 159: For algorithm camvi-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


199
Cross region FMR at threshold T = 0.377 for algorithm camvi_004, giving FMR(T) = 0.0001 globally.
−4.1 −6.0 −5.5 −6.0 −5.3 −5.5 −5.6 −6.0 −5.4 −3.9 −3.3 −5.3 −4.5 −5.8 −4.5 −4.7 −4.7 −5.9 −4.6 −3.3
SSAFRICA
−4.0 −4.5 −3.7 −4.8 −4.4 −3.8 −3.9 −4.3 −3.3 −4.6 −3.0 −3.6 −2.7 −3.9 −3.5 −2.9 −3.0 −3.5 −2.7 −3.7
SASIA
−4.9 −4.6 −4.3 −3.9 −5.1 −5.0 −5.4 −3.3 −4.6 −5.5 −4.1 −3.8 −3.3 −3.2 −4.2 −4.0 −5.1 −2.7 −3.8 −4.8
POLY
2019/10/16 12:43:37
−4.7 −4.8 −4.4 −6.0 −5.4 −4.4 −4.1 −5.7 −4.5 −6.0 −4.0 −3.9 −3.5 −5.2 −4.4 −3.6 −3.6 −4.9 −3.6 −6.0
NAFRICA log10 FMR
−4.2 −4.6 −3.7 −5.1 −4.3 −3.7 −3.9 −4.5 −3.7 −4.9 −3.1 −3.7 −2.6 −4.1 −3.3 −2.7 −2.8 −3.6 −2.7 −3.9
MEAST
−4.9 −5.0 −4.4 −5.6 −4.8 −4.6 −4.7 −5.2 −4.7 −5.6 −4.0 −4.1 −3.4 −4.6 −3.9 −3.6 −3.8 −4.3 −3.8 −4.7
EURO
−5.1 −4.3 −4.6 −3.4 −5.2 −5.3 −5.5 −3.9 −5.0 −5.7 −4.1 −3.5 −3.6 −2.7 −4.4 −4.4 −4.6 −3.2 −4.2 −4.8 −1
EASIA
−4.2 −4.4 −3.5 −4.7 −4.4 −3.9 −4.0 −4.3 −3.9 −5.0 −3.1 −3.5 −2.5 −3.8 −3.4 −2.9 −3.0 −3.4 −3.0 −4.0
FRVT
CSAMERIC
-
−5.3 −4.1 −4.4 −4.7 −4.7 −4.5 −4.9 −5.8 −5.0 −6.0 −4.3 −3.7 −3.3 −4.2 −3.7 −3.5 −4.0 −6.0 −4.0 −6.0
CASIA −2
−3.6 −6.0 −4.9 −5.9 −4.9 −5.1 −4.9 −5.3 −4.8 −3.8 −2.8 −5.0 −4.0 −5.1 −4.1 −4.3 −4.2 −4.5 −4.1 −3.1
CARIB

−4.0 −6.0 −5.4 −6.0 −5.2 −5.3 −5.4 −6.0 −5.2 −3.7 −3.2 −5.0 −4.5 −5.8 −4.4 −4.5 −4.5 −6.0 −4.5 −3.1
SSAFRICA
−3.9 −4.5 −3.7 −4.7 −4.4 −3.8 −3.9 −4.3 −3.2 −4.5 −3.0 −3.6 −2.7 −3.8 −3.5 −2.9 −3.1 −3.5 −2.6 −3.7
SASIA

−4
−4.7 −4.6 −4.2 −3.7 −5.1 −4.9 −5.3 −3.1 −4.4 −5.3 −4.0 −3.8 −3.2 −3.0 −4.2 −4.0 −4.8 −2.6 −3.7 −4.6
POLY
−4.5 −4.5 −4.3 −5.8 −5.2 −4.2 −3.8 −5.4 −4.3 −5.7 −3.8 −3.6 −3.4 −5.1 −4.5 −3.5 −3.4 −4.6 −3.4 −6.0
NAFRICA
-
−4.1 −4.5 −3.6 −5.0 −4.3 −3.6 −3.8 −4.5 −3.6 −4.9 −3.0 −3.6 −2.6 −4.0 −3.3 −2.6 −2.8 −3.6 −2.6 −3.9 −5
MEAST
−4.9 −4.8 −4.4 −5.5 −4.7 −4.5 −4.7 −5.1 −4.6 −5.6 −4.0 −4.0 −3.4 −4.6 −3.8 −3.6 −3.8 −4.3 −3.7 −4.6
EURO
−5.0 −4.1 −4.6 −3.3 −5.2 −5.3 −5.5 −3.8 −4.9 −5.7 −4.0 −3.4 −3.6 −2.6 −4.3 −4.3 −4.6 −3.1 −4.1 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.4 −3.4 −4.7 −4.3 −3.8 −4.0 −4.3 −3.9 −4.9 −3.1 −3.4 −2.4 −3.7 −3.3 −2.9 −3.0 −3.3 −2.9 −3.9
CSAMERIC
−5.2 −3.9 −4.4 −4.4 −4.6 −4.3 −5.1 −5.5 −4.9 −6.0 −4.1 −3.4 −3.3 −3.9 −3.6 −3.5 −4.4 −6.0 −3.9 −6.0
CASIA
−3.6 −6.0 −4.8 −5.8 −4.8 −4.9 −4.8 −5.1 −4.7 −3.7 −2.7 −5.0 −3.9 −5.0 −4.1 −4.1 −4.1 −4.3 −4.0 −3.0
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


200
Cross region FMR at threshold T = 0.436 for algorithm ceiec_001, giving FMR(T) = 0.0001 globally.
−4.3 −6.0 −5.9 −6.0 −5.7 −5.6 −5.7 −6.0 −5.2 −3.9 −3.7 −6.0 −5.1 −5.8 −5.0 −4.8 −5.3 −5.6 −4.6 −3.4
SSAFRICA
−4.6 −5.0 −4.4 −4.8 −5.0 −4.4 −4.5 −4.8 −3.6 −5.1 −3.7 −4.2 −3.4 −4.0 −4.1 −3.6 −3.7 −4.1 −3.1 −4.4
SASIA
−5.1 −4.6 −4.8 −3.7 −5.3 −5.3 −6.0 −3.3 −4.8 −5.7 −4.4 −3.9 −3.9 −3.1 −4.5 −4.5 −5.1 −2.8 −4.2 −5.1
POLY
2019/10/16 12:43:37
−5.1 −4.8 −4.8 −6.0 −5.1 −4.5 −4.4 −5.6 −4.7 −5.7 −4.3 −3.9 −4.0 −5.1 −4.5 −3.8 −3.9 −4.9 −3.8 −6.0
NAFRICA log10 FMR
−4.6 −4.6 −4.2 −5.2 −4.6 −3.9 −4.2 −4.9 −4.2 −5.8 −3.6 −3.9 −3.1 −4.5 −3.6 −3.0 −3.2 −4.1 −3.2 −5.1
MEAST
−5.2 −4.5 −4.6 −5.3 −4.2 −4.6 −4.8 −5.4 −5.1 −5.8 −4.3 −3.9 −3.7 −4.5 −3.6 −3.7 −4.0 −4.6 −4.2 −5.0
EURO
−5.2 −3.7 −4.6 −2.9 −4.9 −5.3 −5.7 −3.6 −5.0 −5.5 −4.4 −3.1 −3.7 −2.3 −4.2 −4.5 −4.8 −2.9 −4.4 −4.8 −1
EASIA
−4.6 −4.7 −3.9 −4.7 −4.6 −4.3 −4.5 −4.7 −4.5 −5.5 −3.6 −3.8 −2.9 −3.8 −3.7 −3.3 −3.6 −3.7 −3.6 −4.5
FRVT
CSAMERIC
-
−5.6 −3.6 −4.6 −3.7 −4.4 −4.5 −5.0 −4.7 −5.1 −6.0 −4.8 −3.1 −3.6 −3.4 −3.7 −3.7 −4.7 −4.5 −4.3 −5.2
CASIA −2
−3.9 −5.9 −5.2 −5.8 −5.2 −5.3 −5.0 −5.4 −5.2 −4.1 −3.1 −6.0 −4.3 −4.9 −4.4 −4.4 −4.3 −4.8 −4.5 −3.4
CARIB

−4.1 −6.0 −5.7 −6.0 −5.5 −5.4 −5.4 −5.9 −5.0 −3.6 −3.5 −6.0 −4.9 −5.6 −4.8 −4.6 −5.0 −5.3 −4.4 −3.2
SSAFRICA
−4.5 −4.8 −4.3 −4.6 −4.9 −4.3 −4.4 −4.6 −3.4 −4.9 −3.6 −4.1 −3.3 −3.9 −4.1 −3.5 −3.7 −4.0 −3.0 −4.3
SASIA

−4
−5.0 −4.5 −4.6 −3.5 −5.2 −5.1 −5.8 −3.0 −4.6 −5.4 −4.2 −3.8 −3.8 −2.9 −4.3 −4.3 −4.8 −2.6 −4.0 −4.8
POLY
−4.8 −4.5 −4.5 −5.8 −4.8 −4.3 −4.1 −5.3 −4.5 −5.4 −4.0 −3.6 −3.7 −4.8 −4.2 −3.7 −3.6 −4.6 −3.6 −6.0
NAFRICA
-
−4.5 −4.4 −4.1 −5.1 −4.4 −3.8 −4.0 −4.8 −4.1 −5.6 −3.5 −3.7 −3.1 −4.4 −3.5 −2.9 −3.1 −4.0 −3.2 −4.9 −5
MEAST
−5.1 −4.2 −4.5 −5.1 −4.0 −4.4 −4.6 −5.3 −4.9 −5.6 −4.2 −3.6 −3.6 −4.4 −3.4 −3.6 −3.9 −4.5 −4.1 −4.9
EURO
−5.1 −3.5 −4.5 −2.7 −4.8 −5.2 −5.6 −3.4 −4.8 −5.3 −4.3 −2.9 −3.7 −2.1 −4.1 −4.4 −4.8 −2.8 −4.2 −4.7
−6
EASIA
VERIFICATION
−4.5 −4.6 −3.8 −4.6 −4.5 −4.2 −4.4 −4.6 −4.4 −5.4 −3.6 −3.7 −2.9 −3.7 −3.6 −3.3 −3.5 −3.7 −3.5 −4.5
CSAMERIC
−5.3 −3.3 −4.4 −3.5 −4.2 −4.3 −4.7 −4.4 −4.9 −5.9 −4.5 −2.8 −3.5 −3.1 −3.5 −3.6 −4.4 −4.2 −4.2 −4.9
CASIA
−3.8 −5.6 −5.0 −5.6 −5.1 −5.0 −4.8 −5.2 −4.9 −3.9 −3.0 −6.0 −4.2 −4.8 −4.3 −4.2 −4.1 −4.5 −4.2 −3.3
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 161: For algorithm ceiec-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individ-


201
Cross region FMR at threshold T = 0.325 for algorithm ceiec_002, giving FMR(T) = 0.0001 globally.
−3.4 −5.5 −5.1 −5.6 −4.9 −4.9 −4.8 −5.1 −4.6 −3.0 −3.0 −5.3 −4.7 −5.2 −4.4 −4.5 −4.4 −4.7 −4.1 −2.6
SSAFRICA
−4.1 −4.6 −4.1 −4.9 −4.5 −3.9 −3.9 −4.2 −2.9 −4.4 −3.4 −4.0 −3.2 −4.5 −3.9 −3.3 −3.4 −3.9 −2.5 −4.0
SASIA
−4.5 −4.9 −4.5 −3.8 −5.2 −5.1 −5.0 −2.7 −4.1 −4.9 −4.0 −5.0 −3.9 −3.5 −4.9 −4.5 −4.7 −2.4 −3.7 −4.5
POLY
2019/10/16 12:43:37
−4.3 −4.2 −4.1 −5.4 −4.4 −3.7 −3.5 −5.2 −3.9 −4.8 −3.8 −3.5 −3.4 −5.2 −3.8 −3.2 −3.0 −4.6 −3.4 −4.4
NAFRICA log10 FMR
−4.2 −4.1 −3.8 −5.3 −4.1 −3.4 −3.6 −4.6 −3.7 −4.8 −3.4 −3.5 −2.8 −4.6 −3.4 −2.7 −2.9 −4.1 −3.0 −4.2
MEAST
−4.7 −4.0 −4.3 −5.8 −3.9 −4.2 −4.3 −5.4 −4.7 −5.1 −4.0 −3.6 −3.5 −5.2 −3.4 −3.6 −3.8 −4.7 −4.0 −4.6
EURO
−5.2 −4.6 −5.2 −3.8 −5.7 −5.6 −5.7 −3.8 −5.1 −5.5 −4.6 −4.1 −4.4 −3.3 −5.1 −4.9 −5.1 −3.5 −4.6 −5.2 −1
EASIA
−4.2 −4.4 −3.5 −5.2 −4.3 −3.9 −4.0 −4.5 −4.1 −4.9 −3.4 −3.8 −2.7 −4.5 −3.6 −3.1 −3.2 −3.9 −3.4 −4.4
FRVT
CSAMERIC
-
−4.9 −3.6 −4.4 −4.6 −4.1 −4.0 −4.2 −4.8 −4.8 −5.5 −4.3 −3.2 −3.6 −4.2 −3.5 −3.4 −3.8 −4.6 −4.3 −4.9
CASIA −2
−3.3 −5.3 −4.5 −5.4 −4.6 −4.6 −4.4 −4.6 −4.3 −3.3 −2.7 −5.0 −3.8 −4.9 −4.1 −4.0 −3.8 −4.3 −3.8 −2.8
CARIB

−3.1 −5.3 −4.9 −5.3 −4.7 −4.6 −4.5 −4.8 −4.3 −2.7 −2.7 −6.0 −4.5 −4.9 −4.2 −4.2 −4.1 −4.4 −3.9 −2.4
SSAFRICA
−3.9 −4.3 −3.9 −4.7 −4.4 −3.7 −3.7 −4.0 −2.6 −4.2 −3.3 −3.7 −3.1 −4.3 −3.8 −3.2 −3.2 −3.7 −2.3 −3.8
SASIA

−4
−4.2 −4.6 −4.3 −3.6 −5.1 −4.8 −4.8 −2.4 −3.8 −4.6 −3.7 −4.7 −3.7 −3.2 −4.7 −4.3 −4.8 −2.2 −3.5 −4.3
POLY
−4.0 −4.0 −3.8 −5.2 −4.2 −3.4 −3.2 −4.9 −3.7 −4.6 −3.5 −3.2 −3.2 −5.0 −3.6 −2.9 −2.8 −4.3 −3.2 −4.3
NAFRICA
-
−4.0 −3.8 −3.6 −5.1 −3.9 −3.2 −3.3 −4.4 −3.6 −4.6 −3.2 −3.3 −2.8 −4.5 −3.2 −2.5 −2.7 −3.9 −2.9 −4.1 −5
MEAST
−4.5 −3.8 −4.1 −5.6 −3.6 −4.0 −4.1 −5.2 −4.5 −4.9 −3.9 −3.3 −3.4 −5.1 −3.2 −3.4 −3.6 −4.5 −3.8 −4.4
EURO
−5.0 −4.3 −5.0 −3.6 −5.5 −5.4 −5.5 −3.6 −4.8 −5.2 −4.5 −3.9 −4.2 −3.1 −4.9 −4.8 −4.9 −3.2 −4.4 −5.0
−6
EASIA
VERIFICATION
−4.0 −4.2 −3.4 −4.9 −4.1 −3.8 −3.8 −4.3 −3.9 −4.7 −3.3 −3.6 −2.6 −4.3 −3.4 −3.0 −3.0 −3.7 −3.3 −4.2
CSAMERIC
−4.6 −3.3 −4.2 −4.3 −3.8 −3.8 −3.9 −4.5 −4.6 −5.2 −4.0 −2.9 −3.4 −3.9 −3.2 −3.2 −3.7 −4.4 −4.1 −4.6
CASIA
−3.1 −5.0 −4.2 −5.1 −4.4 −4.3 −4.1 −4.3 −4.0 −3.0 −2.5 −4.7 −3.6 −4.7 −3.9 −3.7 −3.6 −4.0 −3.6 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


202
Cross region FMR at threshold T = 106.748 for algorithm chtface_001, giving FMR(T) = 0.0001 globally.
−3.3 −3.5 −3.6 −3.4 −3.5 −3.5 −3.5 −3.5 −3.6 −3.2 −3.3 −3.7 −3.6 −3.4 −3.6 −3.5 −3.4 −3.4 −3.7 −3.2
SSAFRICA
−4.6 −5.0 −4.4 −4.7 −4.4 −4.3 −5.1 −5.2 −4.7 −4.2 −4.6 −4.4 −4.3 −4.7 −4.4 −4.4 −5.3 −5.3 −4.8 −3.9
SASIA
−4.5 −5.0 −4.3 −4.6 −4.3 −4.4 −5.0 −5.2 −4.6 −4.1 −4.3 −4.5 −4.3 −4.7 −4.3 −4.2 −5.1 −5.6 −4.5 −4.0
POLY
2019/10/16 12:43:37
−4.5 −5.1 −4.2 −4.6 −4.2 −4.1 −4.9 −4.8 −4.4 −4.0 −4.4 −6.0 −4.4 −4.5 −4.4 −4.0 −6.0 −4.9 −4.4 −3.8
NAFRICA log10 FMR
−3.9 −3.8 −3.7 −3.7 −3.8 −3.7 −3.6 −3.9 −3.6 −3.6 −4.0 −4.2 −3.9 −4.1 −4.2 −3.9 −4.0 −4.5 −4.2 −3.8
MEAST
−3.9 −4.0 −3.9 −4.0 −3.8 −3.9 −4.0 −4.3 −4.2 −3.7 −3.8 −3.9 −3.8 −3.9 −3.7 −3.8 −4.1 −4.4 −4.4 −3.7
EURO
−4.2 −4.5 −4.2 −4.0 −4.2 −4.2 −4.7 −4.5 −4.3 −3.9 −4.1 −4.3 −4.1 −3.9 −4.2 −4.1 −4.6 −4.4 −4.3 −3.8 −1
EASIA
−3.9 −4.0 −3.8 −4.1 −3.9 −3.9 −4.0 −4.2 −4.0 −3.9 −3.8 −3.9 −3.7 −4.1 −3.9 −3.8 −3.9 −4.2 −4.0 −3.8
FRVT
CSAMERIC
-
−4.4 −4.9 −4.3 −4.6 −4.3 −4.2 −5.2 −5.3 −4.6 −4.1 −5.3 −4.6 −4.3 −4.6 −4.2 −4.1 −6.0 −6.0 −4.7 −4.0
CASIA −2
−4.2 −4.5 −4.2 −4.5 −4.1 −4.1 −4.5 −4.7 −4.3 −3.9 −4.0 −4.3 −4.2 −4.6 −4.2 −4.1 −4.5 −5.1 −4.3 −3.8
CARIB

−3.2 −3.5 −3.6 −3.3 −3.5 −3.4 −3.5 −3.4 −3.5 −3.0 −3.2 −3.6 −3.5 −3.3 −3.5 −3.4 −3.4 −3.3 −3.6 −3.0
SSAFRICA
−4.5 −4.9 −4.4 −4.6 −4.4 −4.2 −5.2 −5.2 −4.7 −4.1 −4.5 −4.4 −4.2 −4.5 −4.5 −4.3 −5.5 −5.2 −4.8 −3.9
SASIA

−4
−4.4 −5.4 −4.3 −4.6 −4.3 −4.4 −5.3 −5.1 −4.6 −4.0 −4.3 −6.0 −4.3 −4.5 −4.3 −4.2 −6.0 −5.4 −4.4 −3.9
POLY
−4.4 −4.8 −4.2 −4.5 −4.3 −4.1 −5.2 −4.7 −4.3 −4.0 −4.2 −6.0 −4.3 −4.6 −4.3 −3.8 −6.0 −6.0 −4.3 −3.6
NAFRICA
-
−3.8 −3.8 −3.6 −3.6 −3.8 −3.6 −3.5 −3.8 −3.4 −3.5 −3.9 −4.2 −3.9 −4.1 −4.2 −3.8 −3.9 −4.6 −4.1 −3.7 −5
MEAST
−3.9 −4.0 −3.8 −4.0 −3.8 −3.8 −3.9 −4.2 −4.1 −3.7 −3.8 −3.9 −3.8 −3.8 −3.6 −3.7 −4.1 −4.3 −4.3 −3.6
EURO
−4.3 −4.4 −4.2 −3.9 −4.1 −4.1 −4.6 −4.4 −4.3 −3.9 −4.1 −4.2 −4.1 −3.8 −4.1 −4.2 −4.8 −4.3 −4.4 −3.7
−6
EASIA
VERIFICATION
−3.8 −3.9 −3.7 −4.0 −3.9 −3.8 −3.9 −4.1 −4.0 −3.8 −3.6 −3.8 −3.6 −4.0 −3.8 −3.7 −3.8 −4.2 −3.9 −3.7
CSAMERIC
−4.5 −4.8 −4.2 −4.5 −4.3 −4.2 −5.1 −5.2 −4.5 −4.1 −5.0 −4.3 −4.2 −4.4 −4.2 −4.0 −6.0 −6.0 −4.7 −3.9
CASIA
−4.3 −4.4 −4.2 −4.5 −4.1 −4.1 −4.6 −4.7 −4.3 −3.7 −4.0 −4.0 −4.2 −4.5 −4.2 −4.1 −4.7 −5.0 −4.2 −3.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 163: For algorithm chtface-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


203
Cross region FMR at threshold T = 2972.000 for algorithm cogent_003, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.3 −6.0 −5.0 −5.2 −5.1 −5.5 −4.9 −3.2 −3.0 −6.0 −4.6 −5.5 −4.4 −4.6 −4.4 −5.1 −4.3 −2.8
SSAFRICA
−4.0 −4.7 −3.8 −5.1 −4.5 −3.8 −3.9 −4.5 −3.1 −4.5 −3.1 −3.9 −2.9 −4.4 −3.6 −3.0 −3.1 −4.1 −2.6 −3.7
SASIA
−4.8 −5.1 −4.7 −4.0 −5.5 −5.4 −5.0 −3.1 −4.5 −5.4 −4.1 −5.0 −4.1 −3.6 −4.8 −4.9 −4.4 −2.8 −4.0 −4.8
POLY
2019/10/16 12:43:37
−4.6 −4.4 −4.2 −5.9 −4.7 −4.1 −3.8 −5.4 −4.1 −5.0 −3.8 −3.6 −3.3 −5.4 −4.0 −3.4 −3.3 −4.9 −3.3 −4.3
NAFRICA log10 FMR
−4.1 −4.2 −3.6 −5.3 −4.1 −3.5 −3.7 −4.9 −3.7 −4.9 −3.1 −3.5 −2.6 −4.5 −3.2 −2.6 −2.8 −4.1 −2.8 −4.0
MEAST
−4.6 −4.4 −4.2 −5.8 −4.1 −4.1 −4.4 −5.4 −4.7 −5.1 −3.7 −3.8 −3.2 −5.0 −3.4 −3.3 −3.6 −4.7 −3.9 −4.2
EURO
−5.4 −4.5 −5.3 −3.7 −5.8 −5.8 −5.7 −4.1 −5.3 −5.8 −4.6 −4.1 −4.5 −3.2 −5.2 −5.0 −4.9 −3.7 −4.8 −5.0 −1
EASIA
−4.1 −4.4 −3.5 −5.2 −4.2 −3.8 −3.9 −4.6 −4.0 −4.8 −3.1 −3.6 −2.5 −4.4 −3.3 −2.8 −3.0 −3.9 −3.1 −3.9
FRVT
CSAMERIC
-
−5.0 −3.7 −4.2 −4.4 −4.1 −4.0 −4.2 −5.1 −4.8 −6.0 −4.2 −3.4 −3.2 −4.0 −3.3 −3.2 −3.6 −4.9 −4.0 −5.2
CASIA −2
−3.4 −5.3 −4.5 −5.7 −4.6 −4.6 −4.5 −4.9 −4.4 −3.4 −2.6 −4.6 −3.8 −5.0 −3.9 −3.9 −3.8 −4.4 −3.8 −2.8
CARIB

−3.4 −5.7 −5.1 −5.8 −4.9 −5.0 −4.9 −5.2 −4.6 −3.0 −2.9 −6.0 −4.4 −5.3 −4.3 −4.4 −4.3 −4.8 −4.1 −2.6
SSAFRICA
−3.9 −4.6 −3.8 −4.9 −4.4 −3.8 −3.8 −4.3 −2.9 −4.3 −3.0 −3.9 −2.8 −4.3 −3.6 −2.9 −3.1 −3.9 −2.5 −3.7
SASIA

−4
−4.5 −4.9 −4.4 −3.7 −5.3 −5.1 −4.8 −2.8 −4.2 −5.2 −3.9 −4.7 −3.9 −3.4 −4.7 −4.8 −4.3 −2.5 −3.8 −4.7
POLY
−4.4 −4.2 −4.0 −5.6 −4.4 −3.9 −3.5 −5.1 −3.9 −4.7 −3.6 −3.4 −3.2 −5.1 −3.8 −3.2 −3.0 −4.6 −3.2 −4.0
NAFRICA
-
−4.0 −4.0 −3.5 −5.2 −4.0 −3.3 −3.5 −4.7 −3.6 −4.8 −3.0 −3.4 −2.5 −4.4 −3.1 −2.5 −2.6 −4.0 −2.8 −4.0 −5
MEAST
−4.5 −4.1 −4.1 −5.6 −3.9 −4.0 −4.3 −5.3 −4.6 −4.9 −3.7 −3.6 −3.2 −4.9 −3.3 −3.2 −3.5 −4.6 −3.8 −4.2
EURO
−5.3 −4.2 −5.1 −3.4 −5.6 −5.6 −5.5 −3.9 −5.1 −5.6 −4.5 −3.8 −4.4 −3.0 −5.0 −4.8 −4.8 −3.4 −4.5 −4.8
−6
EASIA
VERIFICATION
−4.0 −4.2 −3.4 −5.1 −4.1 −3.7 −3.8 −4.4 −3.9 −4.7 −3.0 −3.5 −2.5 −4.3 −3.2 −2.8 −2.9 −3.7 −3.1 −3.9
CSAMERIC
−4.8 −3.4 −4.0 −4.2 −3.9 −3.8 −4.0 −4.8 −4.5 −6.0 −4.0 −3.1 −3.1 −3.7 −3.2 −3.1 −3.5 −4.6 −3.8 −6.0
CASIA
−3.2 −5.0 −4.3 −5.5 −4.4 −4.4 −4.3 −4.7 −4.2 −3.2 −2.5 −4.3 −3.6 −4.8 −3.8 −3.7 −3.7 −4.1 −3.6 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 164: For algorithm cogent-003 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


204
Cross region FMR at threshold T = 3156.000 for algorithm cogent_004, giving FMR(T) = 0.0001 globally.
−3.4 −5.8 −5.2 −5.7 −5.0 −5.1 −5.0 −5.1 −4.6 −3.0 −3.0 −6.0 −4.6 −5.3 −4.5 −4.6 −4.5 −4.8 −4.1 −2.7
SSAFRICA
−4.0 −4.5 −4.0 −4.9 −4.5 −3.8 −3.9 −4.3 −3.0 −4.4 −3.2 −3.9 −3.1 −4.3 −3.7 −3.1 −3.2 −3.9 −2.6 −3.8
SASIA
−4.4 −4.8 −4.6 −3.9 −5.3 −5.2 −4.8 −3.1 −4.3 −5.1 −3.9 −4.7 −4.0 −3.5 −4.7 −4.6 −4.4 −2.7 −3.8 −4.5
POLY
2019/10/16 12:43:37
−4.3 −4.3 −4.0 −5.4 −4.4 −3.9 −3.7 −5.0 −3.9 −4.7 −3.5 −3.4 −3.2 −5.0 −3.7 −3.1 −3.2 −4.6 −3.0 −4.3
NAFRICA log10 FMR
−4.1 −4.1 −3.7 −5.3 −4.1 −3.5 −3.6 −4.9 −3.7 −4.9 −3.2 −3.5 −2.8 −4.5 −3.2 −2.6 −2.8 −4.1 −2.9 −4.1
MEAST
−4.6 −4.1 −4.2 −5.4 −4.0 −4.2 −4.4 −5.3 −4.6 −5.1 −3.9 −3.6 −3.4 −4.9 −3.4 −3.4 −3.7 −4.7 −3.9 −4.4
EURO
−5.3 −4.3 −5.1 −3.4 −5.4 −5.5 −5.2 −4.0 −5.0 −5.4 −4.6 −3.9 −4.4 −3.0 −4.8 −4.8 −4.7 −3.6 −4.5 −4.8 −1
EASIA
−4.1 −4.4 −3.6 −5.1 −4.3 −3.9 −4.0 −4.5 −4.1 −4.8 −3.3 −3.7 −2.8 −4.5 −3.5 −3.0 −3.1 −3.9 −3.3 −4.2
FRVT
CSAMERIC
-
−4.8 −3.5 −4.2 −4.2 −4.0 −4.0 −4.1 −4.9 −4.7 −5.9 −4.1 −3.1 −3.4 −3.7 −3.4 −3.3 −3.6 −4.3 −4.0 −5.2
CASIA −2
−3.3 −4.9 −4.4 −5.3 −4.5 −4.5 −4.4 −4.7 −4.3 −3.3 −2.6 −4.4 −3.8 −4.7 −3.9 −3.8 −3.7 −4.2 −3.7 −2.8
CARIB

−3.2 −5.5 −4.9 −5.4 −4.8 −4.9 −4.7 −4.8 −4.4 −2.8 −2.8 −6.0 −4.4 −5.1 −4.4 −4.3 −4.3 −4.5 −3.9 −2.4
SSAFRICA
−3.8 −4.4 −3.8 −4.7 −4.4 −3.7 −3.7 −4.1 −2.8 −4.3 −3.1 −3.8 −3.0 −4.2 −3.7 −3.0 −3.1 −3.7 −2.4 −3.7
SASIA

−4
−4.2 −4.6 −4.3 −3.6 −5.0 −4.9 −4.6 −2.8 −4.0 −4.8 −3.7 −4.4 −3.8 −3.2 −4.4 −4.4 −4.2 −2.5 −3.6 −4.2
POLY
−4.0 −4.0 −3.8 −5.2 −4.2 −3.7 −3.4 −4.7 −3.7 −4.4 −3.4 −3.2 −3.1 −4.8 −3.6 −3.0 −3.0 −4.3 −3.0 −4.0
NAFRICA
-
−3.9 −3.8 −3.6 −5.1 −3.9 −3.3 −3.4 −4.6 −3.6 −4.7 −3.1 −3.3 −2.7 −4.4 −3.1 −2.5 −2.6 −3.9 −2.8 −4.0 −5
MEAST
−4.4 −3.9 −4.1 −5.2 −3.7 −4.0 −4.1 −5.1 −4.5 −4.9 −3.7 −3.4 −3.3 −4.6 −3.2 −3.3 −3.5 −4.6 −3.8 −4.3
EURO
−5.0 −4.0 −4.9 −3.2 −5.1 −5.3 −5.0 −3.7 −4.7 −5.2 −4.4 −3.6 −4.2 −2.7 −4.6 −4.6 −4.5 −3.3 −4.3 −4.6
−6
EASIA
VERIFICATION
−4.0 −4.2 −3.5 −4.9 −4.1 −3.8 −3.8 −4.3 −3.9 −4.7 −3.2 −3.6 −2.7 −4.3 −3.4 −2.9 −3.0 −3.7 −3.2 −4.0
CSAMERIC
−4.5 −3.2 −4.1 −4.0 −3.8 −3.7 −3.8 −4.6 −4.4 −5.6 −3.9 −2.8 −3.2 −3.5 −3.2 −3.1 −3.3 −4.0 −3.8 −4.9
CASIA
−3.1 −4.6 −4.2 −5.1 −4.3 −4.2 −4.1 −4.4 −4.0 −3.1 −2.5 −4.1 −3.6 −4.5 −3.7 −3.6 −3.5 −4.0 −3.5 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


205
Cross region FMR at threshold T = 0.565 for algorithm cognitec_000, giving FMR(T) = 0.0001 globally.
−3.5 −5.5 −5.2 −5.8 −5.0 −5.1 −5.0 −5.3 −4.8 −3.1 −3.0 −4.8 −4.8 −5.4 −4.4 −4.7 −4.8 −5.3 −4.4 −2.7
SSAFRICA
−4.2 −4.9 −4.2 −4.9 −4.7 −4.1 −4.2 −4.4 −2.8 −4.6 −3.5 −4.3 −3.4 −4.2 −4.1 −3.5 −3.5 −3.9 −2.5 −4.0
SASIA
−4.6 −4.6 −4.3 −3.9 −5.1 −5.0 −5.0 −3.0 −4.2 −5.1 −4.1 −4.1 −3.6 −3.4 −4.5 −4.3 −4.6 −2.6 −3.8 −4.8
POLY
2019/10/16 12:43:37
−4.7 −4.4 −4.3 −5.5 −5.1 −4.2 −3.9 −4.9 −4.2 −4.9 −3.9 −3.7 −3.6 −4.9 −4.4 −3.6 −3.4 −4.2 −3.7 −4.4
NAFRICA log10 FMR
−4.5 −4.5 −4.2 −5.2 −4.6 −3.9 −4.0 −4.8 −3.9 −5.1 −3.7 −3.9 −3.3 −4.5 −3.8 −3.1 −3.3 −4.2 −3.1 −4.3
MEAST
−5.0 −4.7 −4.7 −5.5 −4.7 −4.8 −4.9 −5.2 −5.0 −5.3 −4.3 −4.2 −3.9 −4.9 −4.1 −4.1 −4.3 −4.5 −4.3 −4.7
EURO
−5.3 −4.1 −4.9 −3.2 −5.3 −5.5 −5.6 −3.9 −5.0 −5.6 −4.7 −3.6 −4.2 −2.7 −4.7 −4.8 −5.0 −3.4 −4.6 −5.1 −1
EASIA
−4.4 −4.6 −3.7 −5.0 −4.7 −4.3 −4.4 −4.4 −4.3 −5.0 −3.6 −3.9 −2.9 −4.3 −3.9 −3.5 −3.6 −3.7 −3.6 −4.3
FRVT
CSAMERIC
-
−5.3 −3.7 −4.9 −4.1 −4.8 −4.7 −4.9 −4.8 −5.1 −5.8 −4.4 −3.2 −4.3 −3.8 −4.2 −4.3 −4.2 −4.7 −4.7 −5.2
CASIA −2
−3.3 −5.3 −4.6 −5.5 −4.7 −4.8 −4.7 −4.7 −4.4 −3.3 −2.7 −4.7 −4.0 −4.9 −4.1 −4.1 −4.1 −4.4 −4.0 −2.8
CARIB

−3.3 −5.3 −5.0 −5.6 −4.8 −5.0 −4.7 −5.1 −4.5 −2.8 −2.9 −4.5 −4.5 −5.1 −4.3 −4.5 −4.5 −5.3 −4.2 −2.5
SSAFRICA
−4.0 −4.7 −4.1 −4.7 −4.6 −3.9 −4.1 −4.2 −2.6 −4.4 −3.4 −4.2 −3.3 −4.1 −4.0 −3.4 −3.5 −3.8 −2.3 −3.9
SASIA

−4
−4.4 −4.3 −4.2 −3.7 −5.0 −4.8 −4.8 −2.8 −4.0 −4.8 −3.9 −3.8 −3.5 −3.2 −4.4 −4.2 −4.3 −2.4 −3.6 −4.6
POLY
−4.4 −4.1 −4.1 −5.2 −4.8 −3.9 −3.7 −4.6 −4.0 −4.6 −3.7 −3.4 −3.4 −4.7 −4.2 −3.4 −3.1 −3.9 −3.5 −4.1
NAFRICA
-
−4.3 −4.3 −4.0 −5.1 −4.4 −3.7 −3.8 −4.6 −3.7 −4.9 −3.6 −3.8 −3.1 −4.4 −3.7 −2.9 −3.2 −4.0 −3.1 −4.2 −5
MEAST
−4.9 −4.4 −4.5 −5.3 −4.4 −4.6 −4.7 −5.0 −4.8 −5.2 −4.2 −3.9 −3.8 −4.7 −3.9 −4.0 −4.2 −4.5 −4.2 −4.7
EURO
−5.1 −3.9 −4.7 −3.0 −5.1 −5.4 −5.3 −3.7 −4.8 −5.4 −4.6 −3.4 −4.0 −2.5 −4.6 −4.7 −4.8 −3.2 −4.4 −5.0
−6
EASIA
VERIFICATION
−4.2 −4.4 −3.5 −4.8 −4.5 −4.2 −4.2 −4.2 −4.1 −4.8 −3.5 −3.8 −2.8 −4.2 −3.8 −3.4 −3.5 −3.6 −3.5 −4.1
CSAMERIC
−5.1 −3.5 −4.7 −3.9 −4.5 −4.4 −4.6 −4.5 −4.8 −5.5 −4.1 −3.0 −4.1 −3.5 −3.9 −4.1 −3.9 −4.4 −4.5 −4.9
CASIA
−3.2 −5.0 −4.4 −5.2 −4.6 −4.6 −4.5 −4.5 −4.2 −3.2 −2.6 −4.4 −3.8 −4.7 −3.9 −3.9 −3.9 −4.1 −3.7 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 166: For algorithm cognitec-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


206
Cross region FMR at threshold T = 0.565 for algorithm cognitec_001, giving FMR(T) = 0.0001 globally.
−3.5 −5.6 −5.2 −5.8 −5.0 −5.1 −4.9 −5.3 −4.7 −3.1 −3.0 −4.8 −4.7 −5.4 −4.4 −4.7 −4.6 −5.1 −4.4 −2.7
SSAFRICA
−4.2 −4.9 −4.2 −4.9 −4.7 −4.1 −4.2 −4.4 −2.8 −4.6 −3.5 −4.3 −3.4 −4.2 −4.1 −3.5 −3.5 −3.9 −2.5 −4.0
SASIA
−4.6 −4.5 −4.3 −3.9 −5.1 −5.1 −5.0 −3.0 −4.2 −5.0 −4.1 −4.2 −3.6 −3.4 −4.5 −4.4 −4.6 −2.6 −3.8 −4.8
POLY
2019/10/16 12:43:37
−4.7 −4.5 −4.3 −5.5 −5.0 −4.2 −3.9 −5.0 −4.2 −4.9 −3.9 −3.9 −3.6 −5.0 −4.4 −3.6 −3.4 −4.3 −3.6 −4.4
NAFRICA log10 FMR
−4.5 −4.5 −4.2 −5.2 −4.6 −3.9 −4.1 −4.8 −3.9 −5.1 −3.7 −3.8 −3.3 −4.5 −3.8 −3.1 −3.3 −4.2 −3.2 −4.4
MEAST
−5.0 −4.7 −4.7 −5.5 −4.7 −4.8 −4.9 −5.1 −4.9 −5.3 −4.3 −4.2 −3.9 −4.9 −4.1 −4.1 −4.3 −4.5 −4.2 −4.6
EURO
−5.3 −4.1 −4.9 −3.2 −5.3 −5.5 −5.6 −3.9 −5.0 −5.6 −4.7 −3.6 −4.2 −2.7 −4.7 −4.8 −5.1 −3.4 −4.6 −5.1 −1
EASIA
−4.4 −4.6 −3.7 −5.0 −4.7 −4.3 −4.4 −4.4 −4.2 −5.0 −3.6 −3.9 −2.9 −4.3 −3.9 −3.5 −3.6 −3.7 −3.6 −4.3
FRVT
CSAMERIC
-
−5.3 −3.7 −4.9 −4.1 −4.8 −4.7 −4.9 −4.7 −5.1 −5.8 −4.3 −3.2 −4.3 −3.8 −4.2 −4.3 −4.2 −4.6 −4.8 −5.2
CASIA −2
−3.3 −5.3 −4.6 −5.5 −4.7 −4.8 −4.7 −4.7 −4.4 −3.3 −2.7 −4.7 −4.0 −4.9 −4.1 −4.1 −4.1 −4.4 −4.0 −2.8
CARIB

−3.3 −5.3 −5.0 −5.6 −4.8 −4.9 −4.6 −5.0 −4.5 −2.9 −2.9 −4.5 −4.5 −5.2 −4.3 −4.5 −4.3 −5.0 −4.2 −2.5
SSAFRICA
−4.0 −4.7 −4.1 −4.7 −4.6 −3.9 −4.1 −4.2 −2.6 −4.4 −3.4 −4.2 −3.3 −4.1 −4.0 −3.4 −3.5 −3.8 −2.3 −3.9
SASIA

−4
−4.4 −4.3 −4.1 −3.7 −5.0 −4.9 −4.8 −2.8 −4.0 −4.8 −3.9 −3.9 −3.5 −3.2 −4.4 −4.2 −4.3 −2.4 −3.6 −4.7
POLY
−4.4 −4.2 −4.1 −5.2 −4.8 −3.9 −3.6 −4.7 −4.0 −4.6 −3.7 −3.6 −3.4 −4.7 −4.2 −3.4 −3.2 −4.0 −3.5 −4.1
NAFRICA
-
−4.3 −4.3 −4.0 −5.1 −4.4 −3.7 −3.9 −4.7 −3.7 −4.9 −3.6 −3.7 −3.1 −4.4 −3.7 −3.0 −3.2 −4.1 −3.1 −4.2 −5
MEAST
−4.9 −4.4 −4.5 −5.2 −4.4 −4.6 −4.7 −5.0 −4.8 −5.2 −4.2 −3.9 −3.8 −4.7 −3.9 −4.0 −4.2 −4.5 −4.2 −4.6
EURO
−5.1 −3.9 −4.7 −3.0 −5.1 −5.4 −5.3 −3.7 −4.8 −5.4 −4.6 −3.4 −4.0 −2.5 −4.6 −4.7 −4.9 −3.2 −4.4 −5.0
−6
EASIA
VERIFICATION
−4.2 −4.4 −3.5 −4.8 −4.5 −4.2 −4.2 −4.2 −4.1 −4.8 −3.5 −3.8 −2.8 −4.2 −3.8 −3.4 −3.5 −3.6 −3.5 −4.2
CSAMERIC
−5.0 −3.5 −4.6 −3.9 −4.5 −4.5 −4.6 −4.4 −4.8 −5.5 −4.1 −3.0 −4.1 −3.5 −3.9 −4.1 −3.9 −4.4 −4.6 −4.9
CASIA
−3.2 −5.0 −4.4 −5.2 −4.6 −4.6 −4.4 −4.5 −4.2 −3.2 −2.6 −4.4 −3.8 −4.7 −4.0 −3.9 −3.9 −4.2 −3.7 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


207
Cross region FMR at threshold T = 3.730 for algorithm ctbcbank_000, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.3 −6.0 −5.1 −5.3 −5.2 −5.5 −5.0 −3.1 −3.0 −5.3 −4.8 −5.8 −4.5 −4.9 −4.8 −5.3 −4.6 −2.8
SSAFRICA
−4.1 −4.8 −4.0 −4.8 −4.7 −4.1 −4.2 −4.4 −3.1 −4.7 −3.4 −4.1 −3.1 −4.1 −3.9 −3.3 −3.5 −3.8 −2.7 −4.1
SASIA
−4.7 −4.8 −4.4 −3.9 −5.3 −5.3 −5.3 −3.1 −4.5 −5.3 −4.3 −4.3 −3.6 −3.4 −4.6 −4.6 −4.4 −2.7 −4.0 −4.7
POLY
2019/10/16 12:43:37
−4.7 −4.5 −4.4 −6.0 −5.1 −4.4 −4.0 −5.3 −4.3 −5.5 −4.0 −3.7 −3.6 −5.7 −4.7 −3.8 −3.6 −4.4 −3.6 −4.9
NAFRICA log10 FMR
−4.4 −4.7 −4.0 −5.5 −4.5 −3.8 −4.0 −4.8 −3.9 −5.3 −3.5 −4.2 −3.0 −4.6 −3.6 −3.0 −3.2 −4.1 −3.0 −4.4
MEAST
−5.0 −4.7 −4.5 −5.6 −4.6 −4.7 −4.8 −5.4 −4.9 −5.3 −4.2 −4.1 −3.6 −4.9 −3.9 −3.9 −4.1 −4.6 −4.1 −4.7
EURO
−5.4 −4.1 −4.8 −3.3 −5.3 −5.6 −5.7 −3.9 −5.0 −5.8 −4.6 −3.5 −4.0 −2.7 −4.6 −4.7 −5.0 −3.4 −4.5 −5.1 −1
EASIA
−4.3 −4.5 −3.5 −4.9 −4.5 −4.2 −4.2 −4.4 −4.1 −4.9 −3.5 −3.8 −2.7 −4.1 −3.7 −3.3 −3.4 −3.6 −3.3 −4.2
FRVT
CSAMERIC
-
−5.4 −3.7 −4.4 −4.3 −4.5 −4.4 −4.7 −4.8 −5.1 −5.9 −4.6 −3.3 −3.4 −3.9 −3.7 −3.6 −4.0 −4.4 −4.4 −5.2
CASIA −2
−3.3 −5.4 −4.6 −5.6 −4.7 −4.9 −4.7 −4.8 −4.5 −3.3 −2.6 −5.0 −4.0 −5.0 −4.0 −4.2 −4.2 −4.5 −3.9 −2.8
CARIB

−3.3 −5.7 −5.0 −5.8 −4.9 −5.1 −4.9 −5.2 −4.7 −2.9 −2.8 −5.0 −4.5 −5.5 −4.4 −4.7 −4.5 −5.0 −4.3 −2.6
SSAFRICA
−4.0 −4.7 −3.9 −4.7 −4.6 −4.0 −4.0 −4.2 −2.9 −4.5 −3.3 −4.0 −3.0 −4.0 −3.9 −3.3 −3.4 −3.7 −2.5 −4.0
SASIA

−4
−4.5 −4.6 −4.2 −3.6 −5.2 −5.1 −5.1 −2.8 −4.2 −5.1 −4.1 −4.1 −3.5 −3.2 −4.5 −4.4 −4.3 −2.5 −3.7 −4.4
POLY
−4.4 −4.2 −4.2 −5.8 −4.8 −4.1 −3.7 −5.0 −4.1 −5.4 −3.7 −3.4 −3.5 −5.4 −4.4 −3.6 −3.5 −4.1 −3.5 −4.6
NAFRICA
-
−4.3 −4.5 −3.9 −5.4 −4.4 −3.7 −3.8 −4.7 −3.8 −5.2 −3.3 −4.0 −3.0 −4.6 −3.5 −2.9 −3.0 −4.1 −3.0 −4.7 −5
MEAST
−4.8 −4.4 −4.4 −5.5 −4.3 −4.5 −4.6 −5.3 −4.8 −5.1 −4.1 −3.8 −3.6 −4.8 −3.7 −3.8 −4.0 −4.5 −4.1 −4.6
EURO
−5.2 −3.9 −4.7 −3.2 −5.2 −5.5 −5.6 −3.7 −4.9 −5.6 −4.4 −3.3 −3.9 −2.6 −4.5 −4.6 −5.0 −3.2 −4.3 −5.0
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.8 −4.3 −4.1 −4.0 −4.2 −4.0 −4.7 −3.4 −3.7 −2.6 −4.0 −3.6 −3.2 −3.3 −3.5 −3.3 −4.1
CSAMERIC
−5.2 −3.5 −4.2 −4.0 −4.3 −4.2 −4.5 −4.5 −4.8 −6.0 −4.5 −3.1 −3.3 −3.7 −3.5 −3.5 −3.9 −4.2 −4.2 −6.0
CASIA
−3.1 −5.1 −4.3 −5.4 −4.6 −4.7 −4.5 −4.5 −4.2 −3.1 −2.5 −4.7 −3.8 −4.9 −3.9 −4.1 −4.0 −4.2 −3.7 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 168: For algorithm ctbcbank-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


208
Cross region FMR at threshold T = 0.762 for algorithm cyberextruder_001, giving FMR(T) = 0.0001 globally.
−3.1 −6.0 −5.1 −5.8 −4.7 −5.0 −4.8 −5.3 −4.6 −2.7 −2.7 −6.0 −4.6 −5.4 −4.3 −4.6 −4.3 −5.1 −4.2 −2.4
SSAFRICA
−4.2 −4.7 −4.2 −4.9 −4.8 −4.0 −4.2 −4.3 −2.8 −4.6 −3.6 −4.3 −3.5 −4.3 −4.2 −3.5 −3.6 −4.0 −2.5 −4.2
SASIA
−4.6 −4.5 −4.5 −3.8 −5.4 −5.1 −5.3 −3.1 −4.3 −5.2 −4.1 −4.0 −3.8 −3.4 −4.8 −4.5 −4.7 −2.8 −4.0 −5.1
POLY
2019/10/16 12:43:37
−5.2 −4.6 −4.5 −5.7 −5.0 −4.2 −4.1 −5.2 −4.3 −5.3 −4.4 −3.7 −3.8 −5.2 −4.4 −3.6 −3.5 −4.6 −3.7 −4.6
NAFRICA log10 FMR
−4.6 −4.5 −4.3 −5.7 −4.7 −3.9 −4.1 −5.0 −3.9 −5.4 −3.7 −3.8 −3.4 −5.0 −3.9 −3.2 −3.4 −4.5 −3.3 −5.1
MEAST
−4.8 −4.8 −4.8 −5.6 −4.7 −4.8 −5.0 −5.5 −5.0 −4.9 −4.1 −4.2 −4.0 −4.9 −4.1 −4.1 −4.4 −4.9 −4.5 −4.3
EURO
−5.4 −4.0 −5.0 −3.2 −5.4 −5.9 −5.9 −3.7 −4.9 −5.7 −4.8 −3.5 −4.3 −2.7 −4.7 −5.2 −5.2 −3.3 −4.5 −5.2 −1
EASIA
−4.4 −4.7 −4.0 −5.1 −4.8 −4.4 −4.4 −4.5 −4.2 −4.8 −3.6 −4.0 −3.1 −4.2 −3.9 −3.6 −3.7 −3.8 −3.6 −4.3
FRVT
CSAMERIC
-
−5.2 −3.8 −4.8 −3.9 −4.6 −4.6 −4.6 −4.5 −5.0 −5.9 −4.5 −3.2 −4.0 −3.5 −3.9 −4.0 −4.2 −4.3 −4.4 −6.0
CASIA −2
−3.0 −5.1 −4.7 −5.6 −4.5 −4.9 −4.8 −4.7 −4.2 −2.9 −2.4 −4.3 −4.1 −5.1 −4.0 −4.2 −4.3 −4.4 −3.7 −2.5
CARIB

−2.8 −6.0 −4.8 −5.7 −4.5 −4.8 −4.5 −5.1 −4.4 −2.5 −2.5 −6.0 −4.4 −5.3 −4.1 −4.4 −4.1 −4.8 −4.0 −2.2
SSAFRICA
−4.0 −4.5 −4.0 −4.7 −4.6 −3.8 −4.0 −4.1 −2.5 −4.4 −3.4 −4.1 −3.4 −4.1 −4.1 −3.4 −3.5 −3.8 −2.2 −3.9
SASIA

−4
−4.4 −4.2 −4.3 −3.5 −5.2 −4.9 −5.0 −2.8 −4.0 −5.0 −4.0 −3.7 −3.7 −3.2 −4.7 −4.3 −4.5 −2.5 −3.8 −5.0
POLY
−5.0 −4.3 −4.3 −5.5 −4.8 −3.9 −3.8 −4.9 −4.0 −5.0 −4.2 −3.4 −3.6 −5.0 −4.2 −3.4 −3.3 −4.3 −3.6 −4.3
NAFRICA
-
−4.5 −4.2 −4.1 −5.5 −4.5 −3.6 −3.8 −4.7 −3.7 −5.1 −3.6 −3.6 −3.3 −4.8 −3.8 −3.0 −3.3 −4.2 −3.1 −4.8 −5
MEAST
−4.7 −4.5 −4.6 −5.5 −4.5 −4.6 −4.8 −5.3 −4.8 −4.7 −4.0 −4.0 −3.9 −4.8 −3.9 −4.0 −4.4 −4.8 −4.4 −4.3
EURO
−5.2 −3.8 −4.9 −3.0 −5.2 −5.7 −5.7 −3.5 −4.7 −5.5 −4.6 −3.3 −4.2 −2.5 −4.5 −5.1 −5.1 −3.1 −4.3 −5.0
−6
EASIA
VERIFICATION
−4.2 −4.5 −3.8 −4.9 −4.6 −4.2 −4.3 −4.3 −4.0 −4.6 −3.5 −3.8 −3.0 −4.1 −3.8 −3.5 −3.6 −3.7 −3.5 −4.2
CSAMERIC
−4.9 −3.5 −4.5 −3.7 −4.4 −4.3 −4.4 −4.2 −4.7 −5.6 −4.3 −3.0 −3.8 −3.3 −3.7 −3.8 −4.1 −4.0 −4.2 −6.0
CASIA
−2.8 −4.8 −4.4 −5.3 −4.4 −4.7 −4.5 −4.4 −3.9 −2.7 −2.3 −4.0 −3.8 −4.8 −3.9 −4.0 −4.0 −4.1 −3.4 −2.3
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 169: For algorithm cyberextruder-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


209
Cross region FMR at threshold T = 0.500 for algorithm cyberextruder_002, giving FMR(T) = 0.0001 globally.
−3.2 −6.0 −5.1 −5.9 −4.7 −5.0 −4.9 −5.3 −4.9 −2.8 −2.7 −6.0 −4.5 −5.3 −4.2 −4.6 −4.6 −5.0 −4.5 −2.5
SSAFRICA
−4.2 −4.7 −4.0 −4.8 −4.6 −4.1 −4.2 −4.4 −3.2 −4.7 −3.3 −3.9 −3.0 −4.0 −3.7 −3.2 −3.4 −3.8 −2.8 −4.0
SASIA
−4.5 −4.5 −4.3 −3.7 −5.0 −5.0 −5.1 −3.0 −4.4 −5.1 −3.8 −3.9 −3.4 −3.2 −4.2 −4.1 −4.3 −2.6 −3.9 −4.8
POLY
2019/10/16 12:43:37
−4.8 −4.8 −4.5 −5.4 −5.0 −4.4 −4.2 −5.1 −4.3 −5.4 −4.0 −4.0 −3.5 −4.9 −4.2 −3.6 −3.4 −4.9 −3.3 −4.9
NAFRICA log10 FMR
−4.4 −4.5 −4.0 −5.3 −4.6 −3.9 −4.1 −4.8 −4.0 −5.1 −3.4 −3.8 −3.0 −4.5 −3.7 −3.1 −3.2 −4.0 −3.1 −4.4
MEAST
−4.8 −4.8 −4.5 −5.5 −4.6 −4.7 −4.8 −5.3 −4.9 −5.1 −3.9 −4.3 −3.6 −4.7 −3.9 −3.8 −4.0 −4.4 −4.1 −4.3
EURO
−5.1 −4.0 −4.7 −3.2 −5.1 −5.4 −5.4 −3.7 −5.0 −5.6 −4.3 −3.3 −3.8 −2.6 −4.3 −4.5 −4.6 −3.2 −4.4 −4.9 −1
EASIA
−4.2 −4.5 −3.7 −4.6 −4.4 −4.1 −4.3 −4.3 −4.2 −4.8 −3.3 −3.6 −2.7 −3.7 −3.5 −3.2 −3.3 −3.5 −3.3 −4.0
FRVT
CSAMERIC
-
−5.5 −3.7 −4.6 −4.1 −4.6 −4.6 −4.7 −4.7 −5.1 −5.9 −4.6 −3.3 −3.7 −3.8 −3.8 −3.8 −4.4 −4.6 −4.3 −4.9
CASIA −2
−3.0 −5.2 −4.6 −5.5 −4.5 −4.7 −4.7 −4.8 −4.6 −3.0 −2.4 −4.5 −3.8 −4.8 −3.9 −4.0 −4.0 −4.4 −3.9 −2.5
CARIB

−3.0 −6.0 −4.9 −5.7 −4.5 −4.9 −4.7 −5.0 −4.7 −2.6 −2.5 −6.0 −4.4 −5.2 −4.2 −4.4 −4.5 −4.7 −4.3 −2.3
SSAFRICA
−4.0 −4.6 −3.9 −4.7 −4.5 −4.0 −4.1 −4.2 −3.0 −4.5 −3.2 −3.8 −3.0 −4.0 −3.7 −3.2 −3.3 −3.7 −2.6 −3.9
SASIA

−4
−4.3 −4.3 −4.1 −3.5 −4.9 −4.8 −4.9 −2.7 −4.2 −4.9 −3.7 −3.6 −3.3 −3.0 −4.2 −4.0 −4.2 −2.4 −3.8 −4.6
POLY
−4.6 −4.5 −4.3 −5.2 −4.8 −4.2 −3.9 −4.8 −4.1 −5.3 −4.0 −3.7 −3.4 −4.6 −4.1 −3.6 −3.3 −4.6 −3.2 −4.6
NAFRICA
-
−4.3 −4.4 −3.9 −5.2 −4.5 −3.8 −3.9 −4.6 −3.9 −5.1 −3.4 −3.7 −3.0 −4.4 −3.6 −2.9 −3.1 −3.8 −3.1 −4.4 −5
MEAST
−4.7 −4.5 −4.4 −5.3 −4.4 −4.6 −4.7 −5.2 −4.8 −5.0 −3.8 −4.1 −3.5 −4.5 −3.8 −3.8 −4.0 −4.4 −4.0 −4.3
EURO
−5.0 −3.8 −4.6 −3.0 −5.0 −5.4 −5.3 −3.5 −4.9 −5.4 −4.2 −3.2 −3.7 −2.5 −4.3 −4.5 −4.5 −3.0 −4.3 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.4 −3.6 −4.6 −4.4 −4.1 −4.2 −4.2 −4.1 −4.7 −3.2 −3.5 −2.7 −3.6 −3.4 −3.1 −3.3 −3.4 −3.2 −4.0
CSAMERIC
−5.4 −3.5 −4.5 −3.9 −4.4 −4.4 −4.5 −4.4 −5.0 −6.0 −4.5 −3.1 −3.6 −3.6 −3.7 −3.7 −4.4 −4.3 −4.2 −6.0
CASIA
−2.9 −5.0 −4.4 −5.3 −4.4 −4.5 −4.5 −4.5 −4.4 −2.9 −2.3 −4.4 −3.7 −4.6 −3.8 −3.9 −3.9 −4.2 −3.7 −2.4
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


210
Cross region FMR at threshold T = 1.409 for algorithm cyberlink_002, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.3 −5.9 −5.1 −5.3 −5.2 −5.3 −5.0 −3.2 −3.1 −6.0 −4.8 −5.6 −4.6 −4.9 −5.0 −5.1 −4.6 −2.9
SSAFRICA
−4.2 −4.7 −4.0 −4.9 −4.7 −4.1 −4.1 −4.4 −3.3 −4.8 −3.4 −3.9 −3.0 −4.2 −3.8 −3.3 −3.3 −3.8 −2.8 −4.1
SASIA
−4.5 −4.6 −4.2 −3.8 −5.1 −4.9 −5.1 −2.9 −4.4 −5.1 −4.0 −4.1 −3.4 −3.3 −4.3 −4.1 −4.7 −2.5 −3.8 −4.6
POLY
2019/10/16 12:43:37
−4.7 −4.4 −4.2 −5.7 −4.9 −4.2 −3.9 −5.2 −4.3 −5.4 −4.1 −3.5 −3.5 −5.7 −4.2 −3.5 −3.3 −4.6 −3.5 −4.9
NAFRICA log10 FMR
−4.4 −4.4 −3.9 −5.3 −4.5 −3.8 −3.9 −4.7 −3.9 −5.2 −3.5 −3.8 −2.9 −4.4 −3.6 −2.9 −3.1 −3.9 −3.0 −4.4
MEAST
−4.8 −4.6 −4.4 −5.6 −4.5 −4.6 −4.8 −5.3 −4.8 −5.3 −4.0 −3.9 −3.5 −4.8 −3.8 −3.8 −4.1 −4.5 −4.0 −4.5
EURO
−5.3 −4.2 −4.8 −3.4 −5.4 −5.5 −5.5 −3.8 −5.0 −5.6 −4.5 −3.5 −3.9 −2.8 −4.6 −4.6 −4.8 −3.3 −4.5 −5.1 −1
EASIA
−4.3 −4.4 −3.4 −4.8 −4.5 −4.1 −4.1 −4.2 −4.1 −5.0 −3.4 −3.6 −2.6 −4.0 −3.6 −3.2 −3.3 −3.5 −3.3 −4.4
FRVT
CSAMERIC
-
−5.3 −3.7 −4.4 −4.4 −4.5 −4.3 −4.3 −4.8 −5.0 −5.9 −4.4 −3.3 −3.4 −4.0 −3.7 −3.5 −3.8 −4.4 −4.2 −4.9
CASIA −2
−3.4 −5.9 −4.6 −5.5 −4.8 −4.9 −4.7 −4.8 −4.6 −3.4 −2.8 −5.3 −3.9 −4.9 −4.1 −4.2 −4.2 −4.4 −4.1 −2.9
CARIB

−3.3 −6.0 −5.1 −5.6 −4.9 −5.1 −4.9 −5.0 −4.7 −2.9 −2.9 −6.0 −4.6 −5.4 −4.4 −4.7 −4.7 −4.8 −4.3 −2.6
SSAFRICA
−4.1 −4.6 −3.9 −4.8 −4.6 −4.0 −4.0 −4.2 −3.1 −4.6 −3.3 −3.9 −3.0 −4.1 −3.8 −3.2 −3.3 −3.7 −2.6 −4.0
SASIA

−4
−4.3 −4.4 −4.0 −3.5 −4.9 −4.7 −4.9 −2.7 −4.1 −4.9 −3.8 −3.9 −3.3 −3.1 −4.1 −3.9 −4.8 −2.3 −3.6 −4.4
POLY
−4.4 −4.1 −4.0 −5.4 −4.6 −4.0 −3.6 −4.9 −4.1 −5.3 −3.7 −3.2 −3.4 −5.4 −4.0 −3.3 −3.1 −4.3 −3.5 −4.6
NAFRICA
-
−4.3 −4.2 −3.8 −5.2 −4.4 −3.6 −3.7 −4.7 −3.8 −5.1 −3.4 −3.6 −2.8 −4.4 −3.5 −2.8 −2.9 −3.9 −2.9 −4.4 −5
MEAST
−4.7 −4.3 −4.3 −5.4 −4.3 −4.5 −4.7 −5.1 −4.7 −5.1 −3.9 −3.7 −3.5 −4.7 −3.7 −3.7 −4.0 −4.4 −4.0 −4.5
EURO
−5.1 −4.0 −4.7 −3.2 −5.2 −5.3 −5.3 −3.6 −4.8 −5.4 −4.3 −3.4 −3.9 −2.7 −4.5 −4.5 −4.7 −3.1 −4.3 −5.0
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.3 −4.7 −4.3 −3.9 −3.9 −4.0 −4.0 −4.8 −3.3 −3.5 −2.5 −3.9 −3.5 −3.1 −3.2 −3.4 −3.2 −4.2
CSAMERIC
−5.0 −3.5 −4.2 −4.1 −4.3 −4.1 −4.0 −4.5 −4.8 −6.0 −4.2 −3.0 −3.3 −3.7 −3.6 −3.4 −3.6 −4.3 −4.1 −6.0
CASIA
−3.3 −5.6 −4.4 −5.3 −4.6 −4.7 −4.5 −4.6 −4.3 −3.2 −2.6 −5.0 −3.7 −4.8 −4.0 −4.0 −3.9 −4.1 −3.8 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 171: For algorithm cyberlink-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


211
Cross region FMR at threshold T = 1.409 for algorithm cyberlink_003, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.3 −5.9 −5.1 −5.3 −5.2 −5.3 −5.0 −3.2 −3.1 −6.0 −4.7 −5.6 −4.5 −4.8 −5.0 −5.0 −4.5 −2.9
SSAFRICA
−4.2 −4.7 −3.9 −4.9 −4.6 −4.1 −4.1 −4.4 −3.3 −4.8 −3.4 −3.9 −3.0 −4.2 −3.8 −3.2 −3.4 −3.8 −2.8 −4.2
SASIA
−4.5 −4.5 −4.2 −3.8 −5.1 −4.8 −5.1 −2.9 −4.3 −5.1 −3.9 −4.1 −3.4 −3.3 −4.3 −4.0 −4.7 −2.5 −3.8 −4.7
POLY
2019/10/16 12:43:37
−4.7 −4.5 −4.2 −5.8 −4.9 −4.2 −3.9 −5.4 −4.3 −5.4 −4.1 −3.5 −3.5 −5.7 −4.2 −3.5 −3.2 −6.0 −3.5 −6.0
NAFRICA log10 FMR
−4.4 −4.4 −3.9 −5.3 −4.5 −3.8 −3.9 −4.7 −3.9 −5.1 −3.5 −3.8 −2.9 −4.4 −3.6 −2.9 −3.1 −3.9 −3.0 −4.3
MEAST
−4.8 −4.6 −4.4 −5.6 −4.5 −4.6 −4.8 −5.2 −4.8 −5.2 −4.0 −4.0 −3.5 −4.8 −3.8 −3.8 −4.0 −4.5 −4.0 −4.4
EURO
−5.3 −4.2 −4.8 −3.4 −5.4 −5.5 −5.5 −3.8 −5.0 −5.6 −4.5 −3.6 −3.9 −2.8 −4.6 −4.7 −4.9 −3.3 −4.5 −4.9 −1
EASIA
−4.3 −4.4 −3.4 −4.8 −4.5 −4.1 −4.1 −4.2 −4.1 −5.0 −3.4 −3.6 −2.6 −4.0 −3.6 −3.2 −3.3 −3.5 −3.3 −4.4
FRVT
CSAMERIC
-
−5.3 −3.7 −4.4 −4.4 −4.5 −4.4 −4.4 −4.7 −5.0 −5.9 −4.6 −3.3 −3.4 −4.0 −3.7 −3.6 −4.0 −4.4 −4.2 −4.9
CASIA −2
−3.4 −5.9 −4.6 −5.5 −4.8 −4.9 −4.8 −4.8 −4.6 −3.4 −2.8 −5.3 −3.9 −4.9 −4.1 −4.2 −4.2 −4.4 −4.1 −2.9
CARIB

−3.4 −6.0 −5.1 −5.6 −4.9 −5.1 −4.9 −5.0 −4.8 −2.9 −2.9 −6.0 −4.6 −5.3 −4.4 −4.6 −4.7 −4.7 −4.3 −2.6
SSAFRICA
−4.0 −4.6 −3.9 −4.8 −4.6 −4.0 −4.0 −4.2 −3.1 −4.6 −3.3 −3.9 −2.9 −4.1 −3.8 −3.2 −3.3 −3.7 −2.6 −4.0
SASIA

−4
−4.3 −4.3 −4.0 −3.5 −4.9 −4.7 −4.9 −2.7 −4.1 −4.9 −3.7 −3.9 −3.2 −3.1 −4.1 −3.8 −4.8 −2.3 −3.6 −4.4
POLY
−4.5 −4.2 −4.0 −5.6 −4.7 −3.9 −3.6 −5.1 −4.1 −5.3 −3.8 −3.2 −3.4 −5.4 −4.0 −3.3 −3.0 −6.0 −3.5 −6.0
NAFRICA
-
−4.3 −4.1 −3.8 −5.2 −4.3 −3.6 −3.7 −4.6 −3.8 −5.0 −3.4 −3.6 −2.8 −4.4 −3.5 −2.8 −3.0 −3.8 −2.9 −4.3 −5
MEAST
−4.7 −4.3 −4.3 −5.4 −4.3 −4.4 −4.6 −5.1 −4.7 −5.0 −3.9 −3.8 −3.5 −4.7 −3.7 −3.7 −4.0 −4.3 −4.0 −4.3
EURO
−5.1 −4.0 −4.7 −3.2 −5.2 −5.4 −5.3 −3.6 −4.8 −5.4 −4.3 −3.4 −3.8 −2.7 −4.5 −4.5 −4.7 −3.1 −4.3 −4.9
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.3 −4.7 −4.3 −3.9 −3.9 −4.1 −4.0 −4.8 −3.3 −3.5 −2.5 −3.9 −3.5 −3.1 −3.2 −3.4 −3.2 −4.3
CSAMERIC
−5.1 −3.5 −4.2 −4.1 −4.3 −4.2 −4.1 −4.5 −4.8 −6.0 −4.4 −3.1 −3.3 −3.7 −3.6 −3.5 −3.8 −4.3 −4.1 −6.0
CASIA
−3.3 −5.6 −4.4 −5.3 −4.6 −4.7 −4.5 −4.6 −4.3 −3.2 −2.6 −5.0 −3.8 −4.7 −4.0 −4.0 −4.1 −4.1 −3.8 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


212
Cross region FMR at threshold T = 6696.000 for algorithm dahua_002, giving FMR(T) = 0.0001 globally.
−3.4 −5.4 −4.8 −5.5 −4.9 −4.9 −4.6 −4.9 −4.5 −3.0 −3.1 −5.0 −4.4 −5.1 −4.6 −4.4 −4.2 −4.8 −4.1 −2.7
SSAFRICA
−4.0 −4.7 −4.1 −5.0 −4.6 −4.0 −3.9 −4.3 −2.9 −4.4 −3.4 −4.2 −3.4 −4.5 −4.0 −3.4 −3.4 −3.9 −2.6 −4.0
SASIA
−4.3 −4.9 −4.2 −4.1 −5.0 −4.9 −4.9 −2.9 −4.2 −4.8 −3.9 −4.5 −3.7 −3.7 −4.6 −4.4 −4.4 −2.6 −3.8 −4.4
POLY
2019/10/16 12:43:37
−4.1 −4.2 −3.9 −5.5 −4.4 −3.7 −3.6 −4.9 −3.9 −4.5 −3.5 −3.6 −3.3 −4.9 −3.9 −3.2 −3.0 −4.6 −3.3 −4.3
NAFRICA log10 FMR
−4.2 −4.0 −3.9 −5.4 −4.3 −3.6 −3.6 −4.9 −3.8 −4.7 −3.5 −3.6 −3.2 −4.7 −3.7 −3.0 −3.0 −4.4 −3.1 −4.1
MEAST
−4.7 −4.1 −4.3 −5.7 −4.0 −4.3 −4.4 −5.2 −4.8 −5.1 −4.1 −3.7 −3.7 −5.2 −3.6 −3.8 −3.9 −4.7 −4.2 −4.7
EURO
−5.2 −4.8 −5.1 −4.2 −5.6 −5.5 −5.4 −4.1 −5.1 −5.5 −4.7 −4.4 −4.5 −3.7 −5.1 −5.0 −4.9 −3.7 −4.7 −5.0 −1
EASIA
−4.1 −4.3 −3.4 −5.0 −4.3 −4.0 −3.9 −4.2 −4.1 −4.8 −3.4 −3.9 −2.9 −4.5 −3.8 −3.4 −3.3 −3.7 −3.5 −4.3
FRVT
CSAMERIC
-
−4.9 −3.7 −4.4 −4.9 −4.2 −4.0 −4.0 −5.0 −4.8 −5.3 −4.4 −3.4 −3.9 −4.4 −3.8 −3.6 −3.6 −4.5 −4.3 −4.9
CASIA −2
−3.3 −4.7 −4.2 −5.3 −4.6 −4.4 −4.2 −4.5 −4.2 −3.4 −2.8 −4.4 −3.8 −4.9 −4.1 −3.9 −3.8 −4.2 −3.8 −3.0
CARIB

−3.1 −5.2 −4.6 −5.2 −4.7 −4.6 −4.3 −4.7 −4.3 −2.7 −2.8 −4.7 −4.2 −4.9 −4.4 −4.2 −3.9 −4.5 −3.9 −2.5
SSAFRICA
−3.8 −4.4 −3.9 −4.7 −4.4 −3.8 −3.7 −4.0 −2.7 −4.2 −3.2 −4.0 −3.3 −4.3 −3.9 −3.3 −3.3 −3.7 −2.4 −3.8
SASIA

−4
−4.1 −4.6 −4.0 −3.8 −4.9 −4.7 −4.6 −2.7 −3.9 −4.6 −3.7 −4.2 −3.5 −3.4 −4.5 −4.2 −4.2 −2.4 −3.5 −4.1
POLY
−3.8 −3.9 −3.7 −5.3 −4.1 −3.5 −3.3 −4.6 −3.7 −4.3 −3.2 −3.3 −3.1 −4.7 −3.6 −3.0 −2.8 −4.3 −3.2 −4.0
NAFRICA
-
−4.0 −3.7 −3.7 −5.2 −4.0 −3.3 −3.4 −4.7 −3.6 −4.5 −3.3 −3.3 −3.0 −4.6 −3.5 −2.7 −2.8 −4.2 −3.0 −4.0 −5
MEAST
−4.5 −3.9 −4.1 −5.5 −3.8 −4.1 −4.1 −5.0 −4.6 −4.8 −3.9 −3.4 −3.5 −5.1 −3.4 −3.6 −3.7 −4.5 −4.1 −4.5
EURO
−5.0 −4.6 −4.9 −3.9 −5.4 −5.4 −5.2 −3.8 −4.9 −5.3 −4.5 −4.1 −4.3 −3.4 −4.9 −4.8 −4.7 −3.5 −4.5 −4.8
−6
EASIA
VERIFICATION
−3.9 −4.1 −3.2 −4.8 −4.0 −3.8 −3.7 −4.0 −3.9 −4.5 −3.3 −3.6 −2.7 −4.3 −3.6 −3.2 −3.1 −3.5 −3.4 −4.1
CSAMERIC
−4.6 −3.5 −4.1 −4.6 −4.0 −3.8 −3.7 −4.7 −4.5 −5.1 −4.1 −3.1 −3.6 −4.2 −3.5 −3.3 −3.3 −4.2 −4.1 −4.6
CASIA
−3.1 −4.4 −4.0 −5.1 −4.4 −4.1 −3.9 −4.2 −3.9 −3.1 −2.6 −4.1 −3.5 −4.8 −3.9 −3.6 −3.5 −3.9 −3.5 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 173: For algorithm dahua-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


213
Cross region FMR at threshold T = 6034.000 for algorithm dahua_003, giving FMR(T) = 0.0001 globally.
−3.5 −5.4 −4.9 −5.4 −5.0 −5.0 −4.7 −5.0 −4.7 −3.1 −3.2 −5.3 −4.6 −5.1 −4.7 −4.6 −4.3 −4.8 −4.4 −2.8
SSAFRICA
−4.2 −4.8 −4.3 −4.9 −4.8 −4.2 −4.1 −4.4 −3.1 −4.6 −3.7 −4.5 −3.7 −4.6 −4.3 −3.7 −3.7 −4.1 −2.7 −4.2
SASIA
−4.5 −4.8 −4.3 −3.9 −5.1 −5.0 −5.0 −3.0 −4.3 −4.9 −4.1 −4.3 −3.8 −3.6 −4.8 −4.6 −5.1 −2.7 −3.9 −4.6
POLY
2019/10/16 12:43:37
−4.2 −4.4 −4.0 −5.2 −4.6 −3.9 −3.5 −5.1 −4.1 −4.6 −3.7 −4.3 −3.5 −4.7 −4.3 −3.4 −2.9 −6.0 −3.6 −4.4
NAFRICA log10 FMR
−4.4 −4.2 −4.1 −5.4 −4.5 −3.7 −3.7 −4.9 −4.0 −4.9 −3.8 −3.8 −3.5 −4.9 −4.0 −3.2 −3.2 −4.5 −3.5 −4.3
MEAST
−4.9 −4.3 −4.4 −5.4 −4.2 −4.5 −4.6 −5.2 −4.9 −5.1 −4.3 −3.9 −3.9 −5.1 −3.8 −4.1 −4.2 −4.7 −4.4 −4.6
EURO
−5.2 −4.5 −5.0 −3.8 −5.4 −5.5 −5.4 −4.0 −5.1 −5.4 −4.9 −4.2 −4.5 −3.3 −5.0 −5.1 −5.2 −3.7 −4.7 −5.0 −1
EASIA
−4.2 −4.3 −3.3 −5.0 −4.4 −4.2 −4.0 −4.2 −4.3 −4.8 −3.6 −3.9 −2.9 −4.5 −3.9 −3.7 −3.5 −3.8 −3.8 −4.4
FRVT
CSAMERIC
-
−5.0 −3.6 −4.4 −4.5 −4.4 −4.2 −4.2 −4.8 −4.8 −5.5 −4.6 −3.3 −4.1 −4.0 −3.9 −3.7 −3.8 −4.4 −4.4 −6.0
CASIA −2
−3.4 −4.8 −4.3 −5.2 −4.8 −4.6 −4.3 −4.5 −4.3 −3.5 −2.9 −4.7 −3.9 −4.9 −4.3 −4.1 −4.1 −4.1 −3.9 −3.1
CARIB

−3.3 −5.1 −4.7 −5.2 −4.8 −4.8 −4.4 −4.8 −4.4 −2.8 −2.9 −5.0 −4.3 −4.8 −4.5 −4.3 −4.1 −4.6 −4.1 −2.5
SSAFRICA
−4.0 −4.5 −4.1 −4.7 −4.6 −4.0 −3.8 −4.1 −2.8 −4.4 −3.5 −4.2 −3.6 −4.4 −4.2 −3.5 −3.5 −3.8 −2.5 −4.0
SASIA

−4
−4.2 −4.6 −4.0 −3.7 −4.9 −4.8 −4.8 −2.7 −4.0 −4.6 −3.9 −4.0 −3.6 −3.3 −4.6 −4.4 −4.8 −2.4 −3.7 −4.4
POLY
−3.9 −4.1 −3.8 −5.0 −4.3 −3.6 −3.3 −4.8 −3.9 −4.3 −3.4 −4.0 −3.2 −4.5 −4.0 −3.1 −2.7 −6.0 −3.4 −4.1
NAFRICA
-
−4.2 −4.0 −3.8 −5.1 −4.2 −3.5 −3.5 −4.7 −3.8 −4.6 −3.6 −3.5 −3.3 −4.6 −3.7 −2.9 −2.9 −4.2 −3.3 −4.1 −5
MEAST
−4.6 −4.0 −4.1 −5.2 −3.9 −4.3 −4.3 −5.0 −4.7 −4.9 −4.1 −3.6 −3.7 −4.9 −3.5 −3.8 −3.9 −4.6 −4.2 −4.4
EURO
−5.0 −4.3 −4.8 −3.5 −5.2 −5.3 −5.2 −3.8 −4.9 −5.2 −4.6 −3.9 −4.3 −3.1 −4.7 −4.8 −5.1 −3.4 −4.5 −4.8
−6
EASIA
VERIFICATION
−3.9 −4.1 −3.1 −4.7 −4.1 −4.0 −3.8 −4.0 −4.0 −4.6 −3.4 −3.7 −2.7 −4.3 −3.7 −3.5 −3.3 −3.6 −3.6 −4.2
CSAMERIC
−4.7 −3.4 −4.2 −4.2 −4.1 −3.9 −3.9 −4.5 −4.5 −5.2 −4.3 −3.0 −3.8 −3.8 −3.6 −3.5 −3.5 −4.1 −4.2 −6.0
CASIA
−3.1 −4.6 −4.0 −5.0 −4.5 −4.3 −4.1 −4.3 −4.1 −3.2 −2.7 −4.5 −3.6 −4.6 −4.1 −3.8 −3.8 −3.9 −3.7 −2.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


214
Cross region FMR at threshold T = 1.359 for algorithm deepglint_001, giving FMR(T) = 0.0001 globally.
−3.4 −5.6 −4.9 −5.5 −4.9 −5.0 −4.7 −5.0 −4.7 −3.0 −3.0 −6.0 −4.6 −5.1 −4.5 −4.6 −4.5 −4.6 −4.3 −2.7
SSAFRICA
−4.2 −4.7 −4.1 −5.0 −4.7 −4.0 −4.0 −4.4 −3.0 −4.5 −3.5 −4.2 −3.3 −4.5 −4.0 −3.4 −3.5 −4.0 −2.7 −4.1
SASIA
−4.3 −4.9 −4.3 −3.9 −5.2 −5.1 −4.9 −2.9 −4.2 −5.0 −3.8 −4.4 −3.8 −3.6 −4.7 −4.6 −4.7 −2.5 −3.7 −4.5
POLY
2019/10/16 12:43:37
−4.3 −4.1 −4.0 −5.4 −4.5 −3.8 −3.5 −4.9 −4.1 −4.7 −3.8 −3.5 −3.4 −4.9 −3.9 −3.3 −3.0 −4.3 −3.4 −4.4
NAFRICA log10 FMR
−4.3 −4.1 −3.9 −5.3 −4.3 −3.6 −3.6 −4.9 −3.8 −4.9 −3.5 −3.7 −3.1 −4.7 −3.6 −2.9 −3.0 −4.4 −3.0 −4.3
MEAST
−4.7 −4.2 −4.3 −5.5 −4.1 −4.4 −4.4 −5.2 −4.8 −5.0 −4.1 −3.7 −3.7 −5.1 −3.6 −3.8 −4.0 −4.7 −4.1 −4.5
EURO
−5.3 −4.8 −5.1 −4.0 −5.6 −5.5 −5.6 −4.0 −5.1 −5.6 −4.7 −4.4 −4.5 −3.5 −5.2 −4.9 −5.1 −3.6 −4.7 −5.2 −1
EASIA
−4.1 −4.3 −3.4 −5.0 −4.3 −4.0 −4.0 −4.3 −4.1 −4.8 −3.5 −3.8 −2.8 −4.5 −3.7 −3.3 −3.3 −3.8 −3.5 −4.3
FRVT
CSAMERIC
-
−4.8 −3.7 −4.3 −4.7 −4.1 −4.0 −4.0 −4.9 −4.8 −5.3 −4.1 −3.4 −3.7 −4.3 −3.7 −3.5 −3.8 −4.7 −4.4 −4.9
CASIA −2
−3.2 −5.0 −4.2 −5.3 −4.6 −4.5 −4.2 −4.5 −4.3 −3.3 −2.7 −4.8 −3.7 −4.8 −4.0 −3.9 −3.7 −4.2 −3.9 −2.9
CARIB

−3.1 −5.4 −4.6 −5.2 −4.7 −4.7 −4.5 −4.7 −4.4 −2.7 −2.7 −6.0 −4.3 −4.9 −4.4 −4.3 −4.2 −4.3 −4.0 −2.4
SSAFRICA
−3.9 −4.5 −3.9 −4.8 −4.5 −3.8 −3.8 −4.1 −2.8 −4.3 −3.4 −4.0 −3.2 −4.4 −3.9 −3.3 −3.3 −3.8 −2.5 −3.9
SASIA

−4
−4.1 −4.6 −4.0 −3.7 −4.9 −4.8 −4.6 −2.6 −3.9 −4.8 −3.6 −4.1 −3.6 −3.3 −4.4 −4.3 −4.5 −2.3 −3.5 −4.3
POLY
−4.0 −3.9 −3.7 −5.1 −4.2 −3.5 −3.3 −4.6 −3.8 −4.4 −3.5 −3.2 −3.2 −4.7 −3.7 −3.1 −2.8 −4.0 −3.3 −4.1
NAFRICA
-
−4.1 −3.8 −3.7 −5.1 −4.1 −3.3 −3.4 −4.7 −3.7 −4.7 −3.4 −3.5 −2.9 −4.6 −3.4 −2.7 −2.8 −4.1 −2.9 −4.3 −5
MEAST
−4.4 −3.9 −4.0 −5.3 −3.8 −4.1 −4.2 −5.0 −4.6 −4.8 −3.9 −3.5 −3.5 −4.9 −3.4 −3.6 −3.8 −4.5 −4.0 −4.4
EURO
−5.0 −4.6 −4.8 −3.7 −5.4 −5.2 −5.3 −3.7 −4.9 −5.3 −4.5 −4.1 −4.2 −3.3 −5.0 −4.7 −4.8 −3.4 −4.5 −5.0
−6
EASIA
VERIFICATION
−3.9 −4.1 −3.2 −4.8 −4.1 −3.8 −3.7 −4.0 −3.9 −4.5 −3.3 −3.6 −2.6 −4.3 −3.5 −3.2 −3.1 −3.6 −3.4 −4.1
CSAMERIC
−4.5 −3.5 −4.1 −4.5 −3.9 −3.7 −3.8 −4.6 −4.5 −5.1 −3.8 −3.1 −3.5 −4.0 −3.4 −3.2 −3.6 −4.4 −4.2 −4.6
CASIA
−3.0 −4.7 −4.0 −5.0 −4.3 −4.2 −4.0 −4.2 −4.0 −3.0 −2.5 −4.5 −3.5 −4.6 −3.8 −3.7 −3.5 −3.9 −3.6 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 175: For algorithm deepglint-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


215
Cross region FMR at threshold T = 1.371 for algorithm deepsea_001, giving FMR(T) = 0.0001 globally.
−3.8 −5.4 −5.0 −5.5 −5.1 −5.0 −4.9 −5.1 −4.7 −3.5 −3.3 −4.8 −4.4 −5.3 −4.6 −4.5 −4.5 −4.7 −4.2 −3.2
SSAFRICA
−4.1 −4.6 −3.9 −4.9 −4.5 −4.0 −4.0 −4.4 −3.3 −4.5 −3.2 −3.8 −3.0 −4.3 −3.8 −3.2 −3.3 −3.8 −2.8 −3.9
SASIA
−4.4 −4.9 −4.3 −4.3 −5.1 −4.8 −4.7 −3.3 −4.3 −4.9 −3.9 −4.4 −3.6 −3.9 −4.5 −4.1 −3.9 −2.9 −3.8 −4.4
POLY
2019/10/16 12:43:37
−4.2 −4.3 −4.0 −5.3 −4.5 −3.9 −3.7 −4.5 −4.1 −4.9 −3.6 −3.7 −3.4 −5.0 −3.9 −3.4 −3.0 −4.3 −3.4 −4.4
NAFRICA log10 FMR
−4.2 −4.2 −3.8 −5.2 −4.2 −3.6 −3.8 −4.8 −3.9 −4.9 −3.3 −3.5 −2.8 −4.4 −3.4 −2.8 −2.9 −4.1 −3.0 −4.1
MEAST
−4.6 −4.2 −4.2 −5.4 −4.1 −4.3 −4.4 −5.0 −4.7 −5.1 −3.8 −3.7 −3.4 −4.8 −3.5 −3.5 −3.8 −4.4 −4.0 −4.5
EURO
−5.0 −4.9 −4.8 −4.3 −5.3 −5.2 −5.1 −4.4 −5.0 −5.4 −4.2 −4.4 −4.0 −3.7 −4.7 −4.5 −4.4 −3.9 −4.4 −4.7 −1
EASIA
−4.0 −4.2 −3.3 −4.9 −4.2 −3.9 −3.9 −4.2 −4.0 −4.7 −3.1 −3.5 −2.5 −4.1 −3.4 −3.0 −3.1 −3.5 −3.2 −4.0
FRVT
CSAMERIC
-
−4.7 −3.9 −4.1 −4.9 −4.1 −4.1 −4.2 −4.8 −4.6 −5.4 −4.0 −3.5 −3.2 −4.5 −3.5 −3.4 −3.6 −4.6 −3.9 −4.6
CASIA −2
−3.4 −4.8 −4.2 −5.2 −4.5 −4.4 −4.3 −4.6 −4.3 −3.7 −2.7 −4.5 −3.6 −4.7 −3.9 −3.8 −3.8 −4.0 −3.7 −3.1
CARIB

−3.6 −5.1 −4.8 −5.4 −4.9 −4.8 −4.6 −4.9 −4.5 −3.3 −3.1 −4.5 −4.3 −5.1 −4.5 −4.3 −4.3 −4.5 −4.0 −2.9
SSAFRICA
−3.9 −4.4 −3.8 −4.8 −4.4 −3.9 −3.9 −4.2 −3.1 −4.4 −3.1 −3.7 −2.9 −4.2 −3.7 −3.1 −3.3 −3.7 −2.7 −3.8
SASIA

−4
−4.2 −4.6 −4.1 −4.1 −4.9 −4.6 −4.5 −3.0 −4.1 −4.6 −3.7 −4.2 −3.5 −3.7 −4.3 −3.9 −3.9 −2.7 −3.7 −4.1
POLY
−3.9 −4.0 −3.8 −5.1 −4.3 −3.7 −3.4 −4.3 −3.9 −4.7 −3.4 −3.4 −3.2 −4.8 −3.8 −3.3 −2.8 −4.0 −3.2 −4.3
NAFRICA
-
−4.0 −4.0 −3.6 −5.0 −4.0 −3.5 −3.6 −4.6 −3.8 −4.7 −3.1 −3.4 −2.7 −4.3 −3.2 −2.7 −2.8 −3.9 −3.0 −4.0 −5
MEAST
−4.4 −3.9 −4.0 −5.2 −3.9 −4.1 −4.2 −4.9 −4.6 −4.9 −3.7 −3.4 −3.3 −4.7 −3.4 −3.5 −3.7 −4.3 −3.9 −4.4
EURO
−4.9 −4.8 −4.7 −4.1 −5.2 −5.1 −4.9 −4.2 −4.8 −5.3 −4.1 −4.2 −3.8 −3.6 −4.6 −4.3 −4.3 −3.7 −4.2 −4.6
−6
EASIA
VERIFICATION
−3.8 −4.0 −3.2 −4.7 −4.0 −3.7 −3.8 −4.0 −3.8 −4.6 −3.0 −3.4 −2.4 −4.0 −3.3 −2.9 −3.0 −3.4 −3.1 −3.9
CSAMERIC
−4.5 −3.7 −4.0 −4.7 −3.9 −3.9 −3.9 −4.6 −4.4 −5.1 −3.8 −3.3 −3.1 −4.3 −3.3 −3.3 −3.4 −4.3 −3.7 −4.3
CASIA
−3.3 −4.6 −4.0 −5.0 −4.3 −4.2 −4.0 −4.3 −4.0 −3.5 −2.6 −4.3 −3.4 −4.5 −3.7 −3.6 −3.5 −3.8 −3.5 −3.0
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 176: For algorithm deepsea-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


216
Cross region FMR at threshold T = 79.344 for algorithm dermalog_005, giving FMR(T) = 0.0001 globally.
−4.0 −5.6 −5.6 −6.0 −5.7 −5.3 −5.4 −5.9 −4.7 −3.5 −3.5 −4.8 −5.1 −6.0 −5.2 −5.0 −4.7 −5.4 −4.3 −3.2
SSAFRICA
−4.3 −4.8 −4.3 −4.9 −4.8 −4.0 −4.1 −4.5 −2.8 −4.6 −3.8 −4.3 −3.8 −4.4 −4.3 −3.6 −3.6 −4.1 −2.4 −4.2
SASIA
−4.9 −4.7 −4.7 −3.9 −5.6 −5.5 −5.2 −3.3 −4.4 −5.8 −4.3 −4.4 −4.1 −3.5 −5.3 −4.9 −4.6 −2.9 −4.0 −5.3
POLY
2019/10/16 12:43:37
−4.8 −4.7 −4.4 −6.0 −4.8 −4.0 −4.0 −5.3 −4.1 −5.7 −4.3 −4.3 −3.7 −5.2 −4.2 −3.4 −3.4 −6.0 −3.6 −6.0
NAFRICA log10 FMR
−4.7 −4.4 −4.3 −5.9 −4.7 −3.9 −4.0 −5.3 −3.9 −5.2 −4.1 −3.8 −3.7 −5.3 −4.1 −3.3 −3.4 −4.9 −3.4 −4.8
MEAST
−5.1 −4.6 −4.8 −5.5 −4.5 −4.7 −4.9 −5.6 −4.9 −5.8 −4.5 −4.1 −4.2 −5.1 −4.0 −4.2 −4.5 −5.2 −4.6 −5.2
EURO
−5.7 −4.0 −5.1 −3.0 −5.4 −5.7 −5.9 −3.9 −5.1 −6.0 −5.3 −3.6 −4.6 −2.6 −4.9 −5.0 −5.9 −3.5 −4.7 −5.5 −1
EASIA
−4.7 −4.7 −4.1 −5.3 −4.9 −4.5 −4.5 −4.7 −4.3 −5.4 −4.1 −4.2 −3.5 −4.8 −4.3 −3.9 −3.9 −4.2 −3.8 −4.8
FRVT
CSAMERIC
-
−4.9 −3.7 −4.7 −4.0 −4.4 −4.4 −4.4 −4.7 −5.0 −5.6 −4.6 −3.2 −4.1 −3.5 −3.9 −3.8 −4.2 −4.4 −4.6 −4.9
CASIA −2
−3.8 −4.9 −4.6 −6.0 −4.8 −4.8 −4.7 −5.1 −4.3 −3.8 −3.2 −4.3 −4.1 −5.4 −4.3 −4.2 −4.2 −4.7 −3.8 −3.4
CARIB

−3.7 −5.3 −5.3 −6.0 −5.5 −5.0 −5.1 −5.7 −4.5 −3.3 −3.3 −4.5 −4.8 −6.0 −5.0 −4.7 −4.4 −5.3 −4.0 −3.0
SSAFRICA
−4.0 −4.5 −4.0 −4.7 −4.6 −3.7 −3.9 −4.2 −2.5 −4.3 −3.6 −4.0 −3.6 −4.2 −4.1 −3.3 −3.4 −3.9 −2.2 −3.9
SASIA

−4
−4.7 −4.4 −4.5 −3.6 −5.3 −5.2 −4.9 −3.0 −4.2 −5.6 −4.2 −4.1 −3.9 −3.3 −5.0 −4.7 −4.3 −2.6 −3.8 −5.3
POLY
−4.5 −4.4 −4.1 −5.9 −4.5 −3.8 −3.7 −5.0 −3.8 −5.4 −4.1 −4.0 −3.4 −5.0 −3.9 −3.2 −3.1 −6.0 −3.3 −6.0
NAFRICA
-
−4.4 −4.1 −4.1 −5.6 −4.4 −3.6 −3.7 −5.0 −3.6 −5.0 −3.8 −3.5 −3.4 −5.2 −3.8 −3.0 −3.2 −4.6 −3.2 −4.5 −5
MEAST
−4.8 −4.3 −4.5 −5.2 −4.2 −4.4 −4.6 −5.4 −4.6 −5.5 −4.2 −3.8 −4.0 −4.9 −3.7 −3.9 −4.2 −5.0 −4.4 −5.0
EURO
−5.5 −3.7 −4.9 −2.8 −5.2 −5.4 −5.6 −3.6 −4.8 −5.8 −5.0 −3.3 −4.3 −2.4 −4.7 −4.8 −5.6 −3.2 −4.4 −5.2
−6
EASIA
VERIFICATION
−4.5 −4.5 −3.8 −5.0 −4.6 −4.3 −4.2 −4.4 −4.0 −5.1 −3.9 −4.0 −3.2 −4.5 −4.1 −3.7 −3.6 −4.0 −3.6 −4.6
CSAMERIC
−4.7 −3.5 −4.4 −3.7 −4.2 −4.1 −4.1 −4.4 −4.7 −5.3 −4.3 −3.0 −3.8 −3.3 −3.6 −3.6 −3.9 −4.1 −4.3 −4.6
CASIA
−3.6 −4.6 −4.3 −5.8 −4.5 −4.5 −4.4 −4.8 −4.0 −3.6 −3.1 −4.0 −3.8 −5.3 −4.0 −3.9 −3.9 −4.5 −3.5 −3.2
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 177: For algorithm dermalog-005 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


217
Cross region FMR at threshold T = 79.670 for algorithm dermalog_006, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.2 −5.5 −5.1 −5.2 −5.2 −5.2 −5.0 −3.2 −3.2 −5.3 −4.9 −5.2 −4.7 −4.9 −5.3 −5.3 −4.6 −2.9
SSAFRICA
−4.2 −4.7 −4.0 −4.9 −4.7 −4.1 −4.1 −4.3 −3.3 −4.8 −3.4 −4.0 −3.0 −4.2 −3.9 −3.3 −3.4 −3.8 −2.8 −4.2
SASIA
−4.5 −4.7 −4.2 −3.8 −5.1 −5.0 −5.2 −2.9 −4.3 −5.0 −4.0 −3.9 −3.5 −3.3 −4.4 −4.2 −4.4 −2.5 −3.9 −4.5
POLY
2019/10/16 12:43:37
−4.5 −4.5 −4.2 −5.6 −4.8 −4.1 −3.9 −5.6 −4.3 −5.3 −4.2 −3.6 −3.6 −5.2 −4.4 −3.5 −3.4 −6.0 −3.7 −4.9
NAFRICA log10 FMR
−4.4 −4.4 −3.9 −5.2 −4.5 −3.8 −3.8 −4.7 −3.9 −5.1 −3.5 −3.8 −2.9 −4.4 −3.6 −2.9 −3.0 −4.0 −3.0 −4.4
MEAST
−4.9 −4.5 −4.4 −5.6 −4.4 −4.5 −4.6 −5.4 −4.8 −5.3 −4.3 −3.9 −3.6 −5.0 −3.8 −3.8 −3.9 −4.7 −4.1 −4.8
EURO
−5.2 −4.2 −4.8 −3.5 −5.4 −5.5 −5.6 −3.8 −5.0 −5.4 −4.6 −3.7 −4.0 −2.9 −4.7 −4.8 −5.0 −3.3 −4.5 −4.9 −1
EASIA
−4.3 −4.3 −3.4 −4.8 −4.4 −4.0 −4.0 −4.2 −4.0 −5.0 −3.5 −3.6 −2.6 −4.0 −3.7 −3.2 −3.2 −3.5 −3.3 −4.4
FRVT
CSAMERIC
-
−5.2 −3.8 −4.3 −4.4 −4.4 −4.2 −4.3 −4.8 −4.9 −5.8 −4.4 −3.3 −3.3 −4.1 −3.6 −3.4 −3.8 −4.5 −4.0 −4.7
CASIA −2
−3.5 −5.6 −4.6 −5.4 −4.8 −4.9 −4.7 −4.8 −4.6 −3.4 −2.9 −5.3 −4.0 −4.9 −4.2 −4.2 −4.0 −4.3 −4.1 −3.0
CARIB

−3.3 −5.7 −5.0 −5.2 −4.9 −5.0 −4.9 −5.0 −4.7 −2.9 −3.0 −5.0 −4.6 −5.0 −4.5 −4.6 −5.0 −5.0 −4.3 −2.6
SSAFRICA
−4.1 −4.6 −3.9 −4.7 −4.6 −4.0 −4.0 −4.2 −3.1 −4.6 −3.3 −4.0 −3.0 −4.1 −3.8 −3.3 −3.3 −3.7 −2.7 −4.1
SASIA

−4
−4.2 −4.4 −4.0 −3.5 −5.0 −4.9 −4.9 −2.6 −4.1 −4.7 −3.9 −3.7 −3.3 −3.1 −4.3 −4.1 −4.2 −2.3 −3.7 −4.2
POLY
−4.3 −4.2 −3.9 −5.4 −4.6 −3.9 −3.7 −5.4 −4.2 −5.0 −3.8 −3.3 −3.3 −5.0 −4.1 −3.3 −3.1 −6.0 −3.6 −4.6
NAFRICA
-
−4.3 −4.1 −3.7 −5.1 −4.3 −3.6 −3.6 −4.6 −3.8 −4.9 −3.4 −3.6 −2.8 −4.3 −3.5 −2.8 −2.9 −3.9 −2.9 −4.3 −5
MEAST
−4.8 −4.2 −4.2 −5.4 −4.2 −4.4 −4.4 −5.2 −4.7 −5.1 −4.1 −3.7 −3.5 −4.9 −3.7 −3.7 −3.8 −4.5 −3.9 −4.7
EURO
−5.0 −4.1 −4.6 −3.3 −5.3 −5.4 −5.5 −3.5 −4.8 −5.1 −4.5 −3.6 −3.9 −2.8 −4.6 −4.8 −4.8 −3.1 −4.3 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.3 −4.6 −4.2 −3.9 −3.8 −4.0 −3.9 −4.8 −3.4 −3.6 −2.5 −3.9 −3.5 −3.1 −3.1 −3.4 −3.2 −4.2
CSAMERIC
−4.9 −3.5 −4.1 −4.2 −4.2 −4.0 −4.1 −4.6 −4.7 −5.9 −4.1 −3.1 −3.2 −3.8 −3.5 −3.2 −3.5 −4.6 −4.0 −4.9
CASIA
−3.3 −5.3 −4.3 −5.2 −4.6 −4.6 −4.5 −4.5 −4.3 −3.2 −2.7 −5.0 −3.8 −4.7 −4.1 −4.1 −3.8 −4.1 −3.9 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


218
Cross region FMR at threshold T = 0.675 for algorithm digitalbarriers_002, giving FMR(T) = 0.0001 globally.
−5.2 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −5.1 −4.5 −6.0 −6.0 −6.0 −5.8 −5.7 −6.0 −6.0 −5.6 −4.3
SSAFRICA
−4.6 −6.0 −5.1 −5.0 −5.5 −4.4 −4.6 −5.1 −2.3 −4.7 −4.1 −5.4 −4.4 −4.8 −4.9 −4.0 −4.2 −4.8 −2.0 −4.2
SASIA
−6.0 −6.0 −6.0 −5.4 −6.0 −6.0 −6.0 −4.4 −5.8 −6.0 −6.0 −6.0 −6.0 −4.9 −5.8 −6.0 −6.0 −4.0 −5.4 −6.0
POLY
2019/10/16 12:43:37
−6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −4.9 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −4.3 −6.0
NAFRICA log10 FMR
−5.8 −6.0 −5.4 −6.0 −5.8 −5.3 −5.4 −6.0 −4.4 −6.0 −4.9 −6.0 −4.4 −6.0 −4.8 −4.2 −4.4 −6.0 −3.9 −5.7
MEAST
−6.0 −6.0 −5.8 −6.0 −5.9 −6.0 −6.0 −6.0 −6.0 −6.0 −5.5 −5.7 −4.7 −6.0 −4.8 −5.0 −5.1 −6.0 −5.7 −6.0
EURO
−6.0 −5.3 −6.0 −3.4 −5.9 −6.0 −6.0 −4.8 −4.9 −6.0 −5.8 −4.6 −5.2 −3.0 −5.4 −6.0 −6.0 −4.4 −4.6 −6.0 −1
EASIA
−5.6 −5.9 −4.8 −5.8 −5.7 −5.3 −5.7 −5.9 −5.3 −6.0 −4.6 −4.9 −3.8 −5.0 −4.7 −4.3 −4.6 −4.9 −4.6 −5.5
FRVT
CSAMERIC
-
−6.0 −5.2 −5.6 −4.8 −5.6 −5.5 −6.0 −6.0 −6.0 −6.0 −6.0 −4.3 −4.5 −4.5 −4.5 −4.4 −6.0 −6.0 −6.0 −6.0
CASIA −2
−4.8 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −4.6 −5.0 −3.8 −6.0 −5.5 −5.9 −5.5 −5.3 −5.3 −5.9 −4.3 −4.2
CARIB

−5.1 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −5.7 −4.9 −4.3 −6.0 −6.0 −6.0 −5.9 −5.7 −6.0 −6.0 −5.3 −4.1
SSAFRICA
−4.4 −6.0 −4.9 −4.8 −5.3 −4.1 −4.3 −4.9 −2.1 −4.4 −3.9 −5.1 −4.2 −4.5 −4.8 −3.7 −3.9 −4.5 −1.8 −4.0
SASIA

−4
−6.0 −6.0 −6.0 −5.1 −6.0 −6.0 −6.0 −4.1 −5.5 −6.0 −6.0 −6.0 −5.9 −4.7 −5.5 −6.0 −6.0 −3.8 −5.2 −6.0
POLY
−6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −4.6 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −4.1 −6.0
NAFRICA
-
−5.7 −6.0 −5.3 −6.0 −5.7 −5.2 −5.3 −6.0 −4.1 −6.0 −5.0 −6.0 −4.2 −5.7 −4.6 −4.1 −4.3 −6.0 −3.6 −5.4 −5
MEAST
−6.0 −6.0 −5.7 −6.0 −5.8 −6.0 −6.0 −6.0 −5.9 −6.0 −5.6 −5.4 −4.6 −6.0 −4.8 −5.0 −5.0 −6.0 −5.6 −6.0
EURO
−6.0 −5.3 −5.9 −3.1 −5.7 −6.0 −6.0 −4.6 −4.6 −6.0 −5.5 −4.6 −5.1 −2.8 −5.1 −6.0 −6.0 −4.2 −4.3 −6.0
−6
EASIA
VERIFICATION
−5.6 −6.0 −4.8 −5.6 −5.7 −5.3 −5.7 −5.8 −5.2 −6.0 −4.5 −5.0 −3.7 −4.9 −4.6 −4.3 −4.6 −4.8 −4.5 −5.5
CSAMERIC
−6.0 −5.4 −5.5 −4.5 −5.4 −5.4 −6.0 −6.0 −6.0 −6.0 −6.0 −4.3 −4.4 −4.2 −4.3 −4.4 −6.0 −6.0 −6.0 −6.0
CASIA
−4.7 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −4.3 −5.0 −3.8 −6.0 −5.5 −5.7 −5.4 −5.1 −5.0 −6.0 −4.0 −4.1
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 179: For algorithm digitalbarriers-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


219
Cross region FMR at threshold T = 1.061 for algorithm dsk_000, giving FMR(T) = 0.0001 globally.
−2.8 −5.5 −4.6 −6.0 −4.4 −4.5 −4.4 −4.8 −4.2 −2.5 −2.5 −6.0 −4.2 −5.6 −4.2 −4.2 −4.1 −4.5 −3.9 −2.2
SSAFRICA
−3.9 −4.4 −4.0 −5.3 −4.4 −3.7 −3.6 −4.6 −2.9 −4.2 −3.3 −3.9 −3.3 −4.7 −3.9 −3.2 −3.2 −4.1 −2.6 −3.8
SASIA
−4.6 −5.4 −4.8 −5.3 −5.4 −5.1 −4.7 −4.1 −4.5 −5.0 −3.9 −4.7 −4.2 −4.8 −5.0 −4.5 −4.2 −3.7 −4.1 −4.5
POLY
2019/10/16 12:43:37
−4.2 −4.0 −4.0 −6.0 −4.2 −3.6 −3.5 −5.0 −3.8 −4.5 −3.6 −3.3 −3.5 −5.7 −3.7 −3.2 −3.1 −4.9 −3.2 −4.0
NAFRICA log10 FMR
−4.2 −3.8 −3.8 −5.6 −3.9 −3.4 −3.4 −5.1 −3.6 −4.5 −3.5 −3.4 −3.1 −5.0 −3.3 −2.8 −2.9 −4.4 −3.1 −4.0
MEAST
−4.3 −3.9 −4.1 −6.0 −3.7 −3.8 −3.9 −5.5 −4.5 −4.5 −3.7 −3.4 −3.4 −5.2 −3.2 −3.3 −3.5 −4.9 −4.0 −4.1
EURO
−5.9 −5.7 −5.5 −5.1 −6.0 −6.0 −6.0 −5.2 −5.6 −6.0 −5.1 −5.1 −4.5 −4.4 −5.3 −5.1 −5.1 −4.5 −5.0 −5.6 −1
EASIA
−4.1 −4.2 −3.7 −5.4 −4.1 −3.8 −3.9 −4.8 −4.0 −4.5 −3.3 −3.6 −2.9 −4.5 −3.4 −3.1 −3.2 −4.0 −3.3 −4.0
FRVT
CSAMERIC
-
−4.5 −3.7 −4.1 −5.7 −3.8 −3.7 −3.7 −5.6 −4.3 −5.2 −3.9 −3.3 −3.4 −5.3 −3.3 −3.2 −3.4 −6.0 −3.9 −4.6
CASIA −2
−2.9 −4.4 −4.2 −6.0 −4.2 −4.2 −4.1 −4.8 −4.1 −2.8 −2.5 −4.1 −3.7 −5.4 −3.7 −3.7 −3.7 −4.7 −3.7 −2.5
CARIB

−2.6 −5.2 −4.4 −5.9 −4.2 −4.3 −4.1 −4.5 −4.0 −2.3 −2.3 −6.0 −4.0 −5.3 −4.0 −4.0 −3.8 −4.2 −3.7 −2.0
SSAFRICA
−3.7 −4.1 −3.8 −5.1 −4.2 −3.4 −3.4 −4.4 −2.7 −3.9 −3.2 −3.7 −3.1 −4.6 −3.7 −3.0 −3.0 −4.0 −2.4 −3.6
SASIA

−4
−4.4 −5.1 −4.5 −5.1 −5.1 −4.8 −4.4 −3.8 −4.3 −4.9 −3.7 −4.4 −4.0 −4.5 −4.7 −4.3 −3.9 −3.4 −3.9 −4.3
POLY
−4.0 −3.7 −3.8 −5.9 −3.9 −3.4 −3.3 −4.7 −3.5 −4.2 −3.4 −3.0 −3.2 −5.4 −3.4 −3.0 −2.9 −4.6 −3.0 −3.7
NAFRICA
-
−3.9 −3.5 −3.6 −5.4 −3.6 −3.1 −3.2 −4.9 −3.3 −4.3 −3.3 −3.1 −2.9 −4.8 −3.1 −2.6 −2.7 −4.2 −2.9 −3.7 −5
MEAST
−4.0 −3.6 −3.8 −5.9 −3.4 −3.6 −3.6 −5.3 −4.2 −4.3 −3.5 −3.1 −3.3 −5.1 −3.0 −3.1 −3.2 −4.7 −3.8 −3.9
EURO
−5.7 −5.5 −5.4 −4.9 −6.0 −5.9 −5.7 −5.0 −5.4 −6.0 −5.0 −5.1 −4.4 −4.2 −5.1 −5.1 −4.8 −4.3 −4.9 −5.5
−6
EASIA
VERIFICATION
−3.9 −3.9 −3.5 −5.3 −3.9 −3.6 −3.6 −4.6 −3.7 −4.3 −3.2 −3.4 −2.8 −4.4 −3.3 −3.0 −3.0 −3.9 −3.2 −3.9
CSAMERIC
−4.2 −3.4 −3.8 −5.4 −3.5 −3.4 −3.5 −5.3 −4.1 −5.0 −3.7 −3.0 −3.2 −5.0 −3.0 −3.0 −3.1 −6.0 −3.7 −4.6
CASIA
−2.7 −4.2 −4.0 −5.8 −3.9 −3.9 −3.8 −4.6 −3.8 −2.6 −2.3 −3.8 −3.4 −5.2 −3.5 −3.4 −3.4 −4.5 −3.4 −2.3
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 180: For algorithm dsk-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


220
Cross region FMR at threshold T = 53.280 for algorithm einetworks_000, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.3 −5.8 −5.0 −5.3 −5.0 −5.3 −5.0 −3.1 −3.0 −6.0 −4.8 −5.5 −4.5 −4.9 −5.3 −5.3 −4.7 −2.8
SSAFRICA
−4.2 −4.7 −3.9 −4.9 −4.6 −4.0 −4.1 −4.4 −3.3 −4.7 −3.3 −3.9 −3.0 −4.1 −3.8 −3.2 −3.3 −3.8 −2.7 −4.1
SASIA
−4.6 −4.7 −4.3 −3.8 −5.2 −5.1 −5.1 −2.9 −4.5 −5.1 −4.0 −4.0 −3.5 −3.3 −4.4 −4.3 −4.4 −2.5 −3.9 −4.6
POLY
2019/10/16 12:43:37
−4.6 −4.6 −4.2 −5.9 −4.9 −4.0 −3.9 −5.6 −4.3 −5.1 −4.2 −3.7 −3.6 −5.2 −4.3 −3.4 −3.4 −6.0 −3.8 −4.6
NAFRICA log10 FMR
−4.4 −4.4 −3.8 −5.2 −4.4 −3.7 −3.8 −4.8 −3.8 −5.1 −3.4 −3.7 −2.9 −4.4 −3.6 −2.8 −2.9 −4.0 −2.9 −4.3
MEAST
−4.9 −4.5 −4.4 −5.6 −4.5 −4.6 −4.7 −5.3 −4.8 −5.3 −4.1 −3.9 −3.6 −4.9 −3.8 −3.7 −3.9 −4.6 −4.0 −4.6
EURO
−5.3 −4.1 −4.7 −3.4 −5.3 −5.5 −5.6 −3.8 −5.1 −5.6 −4.5 −3.5 −3.9 −2.8 −4.5 −4.6 −5.0 −3.3 −4.5 −5.0 −1
EASIA
−4.3 −4.4 −3.5 −4.8 −4.5 −4.0 −4.0 −4.3 −4.1 −5.0 −3.4 −3.6 −2.6 −4.0 −3.6 −3.2 −3.2 −3.6 −3.3 −4.4
FRVT
CSAMERIC
-
−5.4 −3.7 −4.3 −4.4 −4.5 −4.3 −4.5 −4.8 −4.9 −6.0 −4.5 −3.2 −3.3 −4.0 −3.7 −3.5 −3.8 −4.4 −4.0 −6.0
CASIA −2
−3.4 −5.4 −4.6 −5.5 −4.8 −4.9 −4.7 −4.8 −4.6 −3.4 −2.7 −6.0 −4.0 −4.9 −4.1 −4.2 −4.2 −4.4 −4.2 −2.9
CARIB

−3.3 −6.0 −5.0 −5.6 −4.8 −5.1 −4.8 −5.0 −4.8 −2.8 −2.8 −6.0 −4.6 −5.2 −4.3 −4.7 −5.0 −5.0 −4.4 −2.5
SSAFRICA
−4.0 −4.6 −3.8 −4.7 −4.6 −3.9 −4.0 −4.2 −3.1 −4.6 −3.3 −3.9 −2.9 −4.1 −3.8 −3.2 −3.3 −3.8 −2.6 −4.0
SASIA

−4
−4.3 −4.4 −4.1 −3.6 −5.0 −4.9 −4.8 −2.7 −4.2 −4.8 −3.8 −3.8 −3.3 −3.1 −4.3 −4.2 −4.2 −2.3 −3.7 −4.3
POLY
−4.3 −4.4 −4.0 −5.6 −4.7 −3.8 −3.6 −5.3 −4.1 −4.8 −3.9 −3.4 −3.3 −5.0 −4.1 −3.3 −3.2 −6.0 −3.7 −4.3
NAFRICA
-
−4.2 −4.2 −3.7 −5.1 −4.3 −3.6 −3.7 −4.7 −3.7 −4.9 −3.3 −3.5 −2.8 −4.3 −3.5 −2.7 −2.8 −3.9 −2.8 −4.3 −5
MEAST
−4.8 −4.3 −4.3 −5.4 −4.2 −4.4 −4.5 −5.2 −4.7 −5.1 −4.1 −3.7 −3.5 −4.8 −3.7 −3.6 −3.8 −4.5 −3.9 −4.5
EURO
−5.1 −4.0 −4.6 −3.2 −5.2 −5.4 −5.5 −3.6 −4.9 −5.4 −4.3 −3.4 −3.8 −2.6 −4.4 −4.5 −4.8 −3.1 −4.4 −5.0
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.3 −4.7 −4.3 −3.9 −3.9 −4.1 −4.0 −4.8 −3.3 −3.6 −2.5 −3.9 −3.5 −3.1 −3.1 −3.5 −3.2 −4.2
CSAMERIC
−5.1 −3.5 −4.1 −4.1 −4.3 −4.1 −4.3 −4.6 −4.7 −6.0 −4.2 −3.0 −3.2 −3.7 −3.5 −3.3 −3.7 −4.4 −3.9 −6.0
CASIA
−3.2 −5.1 −4.4 −5.3 −4.6 −4.7 −4.5 −4.6 −4.4 −3.2 −2.6 −6.0 −3.8 −4.7 −4.0 −4.0 −4.0 −4.1 −3.9 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 181: For algorithm einetworks-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


221
Cross region FMR at threshold T = 2.589 for algorithm everai_002, giving FMR(T) = 0.0001 globally.
−3.4 −6.0 −5.2 −6.0 −5.0 −5.3 −5.1 −5.4 −5.1 −3.0 −3.1 −6.0 −4.9 −5.6 −4.6 −5.0 −5.0 −4.8 −4.7 −2.7
SSAFRICA
−4.5 −4.8 −4.4 −5.0 −5.1 −4.4 −4.4 −4.5 −3.2 −4.9 −3.9 −4.2 −3.6 −4.5 −4.4 −3.8 −3.8 −4.2 −2.9 −4.4
SASIA
−4.6 −4.5 −4.2 −3.6 −5.3 −5.2 −5.1 −2.6 −4.3 −5.1 −4.1 −4.3 −3.8 −3.2 −4.7 −4.7 −5.1 −2.3 −3.9 −4.8
POLY
2019/10/16 12:43:37
−4.4 −4.7 −4.2 −5.9 −4.8 −4.0 −3.6 −5.3 −4.3 −5.1 −3.9 −4.3 −3.6 −5.4 −4.5 −3.6 −3.3 −6.0 −3.7 −4.9
NAFRICA log10 FMR
−4.6 −4.3 −4.1 −5.5 −4.7 −3.8 −3.9 −5.0 −4.2 −5.3 −3.9 −3.8 −3.2 −4.8 −3.9 −3.2 −3.2 −4.7 −3.5 −4.7
MEAST
−5.0 −4.6 −4.5 −5.7 −4.5 −4.8 −4.8 −5.5 −5.2 −5.2 −4.5 −4.1 −3.9 −5.2 −4.0 −4.2 −4.3 −4.8 −4.5 −4.7
EURO
−5.5 −4.1 −5.0 −3.3 −5.7 −6.0 −5.9 −3.6 −5.1 −5.6 −4.8 −3.7 −4.3 −2.9 −5.0 −5.3 −5.2 −3.2 −4.7 −5.0 −1
EASIA
−4.4 −4.5 −3.4 −5.0 −4.5 −4.4 −4.2 −4.3 −4.4 −5.0 −3.8 −3.9 −2.9 −4.4 −4.0 −3.7 −3.6 −3.8 −3.8 −4.6
FRVT
CSAMERIC
-
−5.1 −3.5 −4.5 −4.0 −4.4 −4.2 −4.4 −4.6 −5.0 −6.0 −4.3 −3.1 −3.8 −3.7 −3.8 −3.6 −4.1 −4.2 −4.4 −6.0
CASIA −2
−3.5 −4.9 −4.6 −5.7 −4.9 −4.9 −4.6 −4.9 −4.7 −3.4 −3.0 −4.3 −4.1 −5.4 −4.4 −4.4 −4.1 −4.7 −4.2 −3.1
CARIB

−3.2 −6.0 −5.0 −5.7 −4.7 −5.0 −4.8 −5.1 −4.8 −2.7 −2.8 −6.0 −4.6 −5.3 −4.4 −4.7 −5.0 −4.6 −4.4 −2.4
SSAFRICA
−4.2 −4.6 −4.2 −4.7 −4.9 −4.2 −4.1 −4.2 −3.0 −4.7 −3.7 −4.0 −3.4 −4.3 −4.3 −3.7 −3.7 −4.0 −2.7 −4.2
SASIA

−4
−4.3 −4.2 −4.0 −3.3 −5.0 −5.0 −4.9 −2.3 −4.1 −4.8 −3.8 −4.0 −3.5 −2.9 −4.5 −4.6 −4.8 −2.1 −3.7 −4.5
POLY
−4.1 −4.4 −3.9 −5.6 −4.5 −3.7 −3.4 −5.0 −4.0 −4.8 −3.6 −4.0 −3.3 −5.1 −4.2 −3.4 −3.0 −6.0 −3.5 −4.6
NAFRICA
-
−4.4 −4.1 −3.9 −5.4 −4.4 −3.6 −3.6 −4.8 −4.0 −5.0 −3.7 −3.5 −3.1 −4.7 −3.7 −3.0 −3.0 −4.6 −3.4 −4.5 −5
MEAST
−4.7 −4.3 −4.3 −5.4 −4.2 −4.5 −4.5 −5.3 −5.0 −4.9 −4.3 −3.8 −3.7 −5.0 −3.7 −4.0 −4.1 −4.6 −4.4 −4.5
EURO
−5.2 −3.8 −4.7 −3.0 −5.4 −5.8 −5.6 −3.3 −4.8 −5.3 −4.5 −3.5 −4.1 −2.6 −4.8 −5.2 −4.9 −3.0 −4.5 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.2 −4.7 −4.3 −4.1 −3.9 −4.0 −4.2 −4.7 −3.5 −3.7 −2.7 −4.2 −3.8 −3.5 −3.4 −3.6 −3.6 −4.4
CSAMERIC
−4.8 −3.2 −4.2 −3.8 −4.1 −4.0 −4.1 −4.3 −4.8 −6.0 −4.1 −2.8 −3.6 −3.4 −3.5 −3.4 −3.9 −3.9 −4.2 −6.0
CASIA
−3.2 −4.6 −4.3 −5.4 −4.6 −4.6 −4.3 −4.5 −4.4 −3.1 −2.8 −4.0 −3.8 −5.2 −4.2 −4.2 −3.9 −4.3 −3.9 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 182: For algorithm everai-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


222
Cross region FMR at threshold T = 0.400 for algorithm f8_001, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.3 −5.9 −5.0 −5.2 −5.0 −5.5 −4.9 −3.1 −3.1 −6.0 −4.8 −5.6 −4.6 −4.7 −4.7 −5.0 −4.5 −2.8
SSAFRICA
−4.2 −4.8 −4.0 −4.9 −4.6 −4.1 −4.1 −4.4 −3.3 −4.7 −3.4 −4.0 −3.1 −4.2 −3.8 −3.3 −3.4 −3.9 −2.8 −4.1
SASIA
−4.7 −4.8 −4.4 −3.7 −5.3 −5.1 −5.1 −2.8 −4.4 −5.1 −4.1 −4.0 −3.7 −3.2 −4.7 −4.6 −4.6 −2.5 −4.0 −4.5
POLY
2019/10/16 12:43:37
−4.6 −4.4 −4.2 −5.9 −4.9 −4.1 −3.8 −5.3 −4.1 −5.0 −4.1 −3.7 −3.5 −5.7 −4.2 −3.4 −3.3 −6.0 −3.4 −4.4
NAFRICA log10 FMR
−4.5 −4.5 −3.9 −5.3 −4.5 −3.8 −4.0 −4.7 −3.9 −5.1 −3.6 −3.9 −2.9 −4.4 −3.6 −3.0 −3.1 −3.9 −3.0 −4.4
MEAST
−5.0 −4.7 −4.5 −5.7 −4.5 −4.7 −4.8 −5.4 −4.9 −5.3 −4.2 −4.1 −3.7 −4.9 −3.9 −3.9 −4.0 −4.6 −4.1 −4.7
EURO
−5.4 −4.1 −4.8 −3.4 −5.3 −5.5 −5.6 −3.7 −5.0 −5.6 −4.6 −3.5 −4.0 −2.8 −4.6 −4.7 −4.9 −3.2 −4.4 −5.0 −1
EASIA
−4.3 −4.5 −3.4 −4.9 −4.5 −4.1 −4.1 −4.3 −4.1 −5.0 −3.6 −3.7 −2.7 −4.1 −3.7 −3.3 −3.4 −3.6 −3.4 −4.4
FRVT
CSAMERIC
-
−5.6 −3.7 −4.4 −4.3 −4.5 −4.4 −4.6 −4.8 −4.9 −6.0 −4.7 −3.3 −3.4 −3.8 −3.7 −3.6 −3.8 −4.4 −4.0 −5.2
CASIA −2
−3.5 −5.9 −4.7 −5.5 −4.8 −4.9 −4.7 −4.9 −4.6 −3.4 −2.9 −5.3 −4.0 −5.0 −4.2 −4.3 −4.1 −4.4 −4.2 −3.0
CARIB

−3.3 −6.0 −5.0 −5.7 −4.8 −5.0 −4.8 −5.2 −4.7 −2.9 −2.9 −6.0 −4.6 −5.4 −4.4 −4.5 −4.4 −4.7 −4.2 −2.6
SSAFRICA
−4.0 −4.7 −3.9 −4.7 −4.6 −4.0 −4.0 −4.2 −3.1 −4.5 −3.3 −4.0 −3.1 −4.1 −3.8 −3.3 −3.3 −3.8 −2.6 −4.0
SASIA

−4
−4.4 −4.6 −4.1 −3.5 −5.1 −4.9 −4.9 −2.6 −4.2 −4.9 −4.0 −3.9 −3.5 −3.0 −4.5 −4.4 −4.5 −2.3 −3.8 −4.2
POLY
−4.4 −4.2 −4.0 −5.6 −4.7 −3.9 −3.5 −5.0 −4.0 −4.7 −3.8 −3.4 −3.3 −5.4 −4.0 −3.2 −3.1 −6.0 −3.3 −4.1
NAFRICA
-
−4.3 −4.3 −3.8 −5.1 −4.4 −3.6 −3.8 −4.6 −3.8 −5.0 −3.4 −3.8 −2.9 −4.3 −3.5 −2.9 −3.0 −3.9 −2.9 −4.3 −5
MEAST
−4.8 −4.4 −4.3 −5.5 −4.3 −4.6 −4.6 −5.2 −4.8 −5.1 −4.1 −3.8 −3.6 −4.8 −3.7 −3.9 −3.9 −4.5 −4.0 −4.5
EURO
−5.2 −3.9 −4.7 −3.2 −5.2 −5.4 −5.5 −3.5 −4.8 −5.5 −4.5 −3.4 −3.9 −2.6 −4.5 −4.6 −4.8 −3.1 −4.3 −4.9
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.7 −4.3 −4.0 −3.9 −4.0 −4.0 −4.8 −3.4 −3.6 −2.5 −4.0 −3.6 −3.2 −3.2 −3.4 −3.3 −4.3
CSAMERIC
−5.4 −3.5 −4.2 −4.0 −4.3 −4.2 −4.4 −4.5 −4.7 −6.0 −4.5 −3.1 −3.3 −3.6 −3.6 −3.5 −3.7 −4.2 −3.9 −6.0
CASIA
−3.3 −5.6 −4.4 −5.3 −4.7 −4.7 −4.5 −4.6 −4.4 −3.2 −2.7 −5.0 −3.8 −4.8 −4.1 −4.1 −3.9 −4.2 −4.0 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 183: For algorithm f8-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


223
Cross region FMR at threshold T = 1.375 for algorithm facesoft_000, giving FMR(T) = 0.0001 globally.
−3.8 −6.0 −5.4 −5.6 −5.3 −5.5 −5.4 −5.1 −5.1 −3.4 −3.3 −5.3 −4.9 −5.2 −4.7 −5.0 −5.3 −5.0 −4.6 −3.0
SSAFRICA
−4.5 −4.8 −4.4 −4.8 −5.0 −4.3 −4.4 −4.5 −3.4 −5.0 −3.7 −4.3 −3.5 −4.3 −4.2 −3.6 −3.8 −4.1 −3.0 −4.4
SASIA
−4.5 −4.5 −4.3 −3.6 −5.2 −5.2 −5.2 −2.9 −4.5 −5.0 −3.9 −4.2 −3.7 −3.1 −4.7 −4.6 −4.7 −2.5 −4.0 −4.6
POLY
2019/10/16 12:43:37
−4.5 −4.4 −4.3 −5.6 −4.9 −4.1 −3.7 −5.4 −4.5 −5.2 −3.9 −3.6 −3.6 −5.2 −4.5 −3.4 −3.2 −4.9 −3.8 −4.9
NAFRICA log10 FMR
−4.6 −4.5 −4.1 −5.6 −4.7 −3.9 −4.0 −5.1 −4.2 −5.3 −3.7 −3.9 −3.2 −4.9 −3.9 −3.1 −3.2 −4.4 −3.4 −4.6
MEAST
−5.0 −4.6 −4.6 −5.5 −4.6 −4.8 −4.9 −5.4 −5.2 −5.6 −4.3 −4.0 −3.9 −5.0 −4.0 −4.0 −4.2 −4.7 −4.5 −5.1
EURO
−5.2 −3.9 −4.8 −3.0 −5.3 −5.6 −5.5 −3.7 −5.0 −5.4 −4.6 −3.4 −4.1 −2.5 −4.6 −4.8 −5.0 −3.2 −4.5 −4.8 −1
EASIA
−4.3 −4.6 −3.6 −4.9 −4.6 −4.3 −4.2 −4.4 −4.4 −5.1 −3.5 −3.9 −2.9 −4.2 −3.9 −3.5 −3.4 −3.7 −3.7 −4.5
FRVT
CSAMERIC
-
−5.3 −3.5 −4.7 −3.9 −4.6 −4.5 −4.5 −4.6 −5.1 −6.0 −4.7 −3.1 −4.0 −3.5 −4.0 −3.9 −4.2 −4.3 −4.6 −6.0
CASIA −2
−3.6 −5.6 −4.6 −5.3 −4.9 −4.8 −4.6 −4.7 −4.7 −3.7 −2.9 −5.3 −3.9 −4.8 −4.3 −4.2 −4.0 −4.2 −4.2 −3.2
CARIB

−3.6 −6.0 −5.2 −5.3 −5.2 −5.3 −5.1 −4.9 −4.9 −3.2 −3.1 −5.0 −4.6 −5.0 −4.5 −4.8 −5.0 −4.8 −4.3 −2.8
SSAFRICA
−4.3 −4.6 −4.2 −4.6 −4.9 −4.2 −4.2 −4.3 −3.2 −4.7 −3.6 −4.1 −3.4 −4.1 −4.2 −3.5 −3.7 −3.9 −2.8 −4.2
SASIA

−4
−4.2 −4.2 −4.1 −3.3 −5.0 −5.0 −4.9 −2.6 −4.3 −4.7 −3.7 −4.0 −3.5 −2.9 −4.4 −4.4 −4.5 −2.2 −3.8 −4.4
POLY
−4.3 −4.1 −4.1 −5.3 −4.7 −3.8 −3.5 −5.1 −4.2 −4.9 −3.5 −3.3 −3.4 −5.0 −4.3 −3.2 −2.9 −4.6 −3.6 −4.6
NAFRICA
-
−4.4 −4.3 −4.0 −5.5 −4.5 −3.7 −3.8 −4.9 −4.0 −5.1 −3.5 −3.7 −3.1 −4.8 −3.7 −2.9 −3.1 −4.3 −3.3 −4.5 −5
MEAST
−4.8 −4.4 −4.4 −5.2 −4.3 −4.6 −4.6 −5.2 −5.1 −5.4 −4.2 −3.7 −3.7 −4.7 −3.8 −3.9 −4.0 −4.5 −4.4 −5.0
EURO
−5.0 −3.6 −4.5 −2.8 −5.1 −5.4 −5.3 −3.4 −4.8 −5.2 −4.4 −3.2 −3.9 −2.3 −4.4 −4.6 −4.8 −2.9 −4.3 −4.6
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.4 −4.6 −4.4 −4.1 −4.0 −4.1 −4.2 −4.9 −3.4 −3.7 −2.7 −4.0 −3.8 −3.3 −3.3 −3.5 −3.6 −4.4
CSAMERIC
−5.0 −3.3 −4.5 −3.6 −4.3 −4.2 −4.2 −4.3 −4.8 −6.0 −4.4 −2.8 −3.8 −3.2 −3.7 −3.6 −3.9 −4.1 −4.3 −6.0
CASIA
−3.4 −5.3 −4.3 −5.1 −4.7 −4.6 −4.4 −4.4 −4.4 −3.5 −2.7 −5.0 −3.7 −4.6 −4.1 −4.0 −3.7 −3.9 −3.9 −3.0
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 184: For algorithm facesoft-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


224
Cross region FMR at threshold T = 0.611 for algorithm glory_000, giving FMR(T) = 0.0001 globally.
−3.5 −4.8 −4.5 −4.9 −4.6 −4.4 −4.3 −4.4 −4.2 −3.2 −3.2 −4.4 −4.2 −4.7 −4.3 −4.2 −3.9 −4.2 −4.0 −3.0
SSAFRICA
−3.9 −4.2 −4.1 −4.6 −4.3 −3.8 −3.8 −4.1 −2.8 −4.2 −3.7 −3.9 −3.8 −4.3 −4.1 −3.5 −3.5 −4.0 −2.5 −4.0
SASIA
−4.3 −4.4 −4.3 −4.3 −4.5 −4.4 −4.2 −3.8 −4.0 −4.4 −4.0 −4.2 −4.0 −4.0 −4.3 −4.1 −3.9 −3.5 −3.8 −4.1
POLY
2019/10/16 12:43:37
−4.3 −4.1 −4.1 −4.7 −4.2 −3.9 −3.7 −4.5 −3.8 −4.4 −3.9 −3.9 −3.7 −4.5 −3.8 −3.5 −3.4 −4.0 −3.5 −3.9
NAFRICA log10 FMR
−4.2 −4.0 −4.1 −4.7 −4.1 −3.7 −3.7 −4.5 −3.7 −4.4 −3.8 −3.7 −3.7 −4.5 −3.7 −3.3 −3.4 −4.2 −3.4 −4.0
MEAST
−4.3 −3.9 −4.1 −4.7 −3.8 −4.0 −4.0 −4.6 −4.3 −4.6 −4.0 −3.5 −3.8 −4.4 −3.5 −3.7 −3.8 −4.4 −4.0 −4.3
EURO
−4.7 −4.3 −4.7 −3.9 −4.7 −4.7 −4.6 −4.3 −4.5 −4.9 −4.5 −4.1 −4.4 −3.5 −4.5 −4.5 −4.4 −4.0 −4.3 −4.7 −1
EASIA
−4.2 −4.2 −3.8 −4.8 −4.2 −4.1 −4.1 −4.3 −4.1 −4.5 −3.9 −3.9 −3.4 −4.5 −3.9 −3.7 −3.7 −4.0 −3.8 −4.3
FRVT
CSAMERIC
-
−4.3 −3.7 −4.1 −4.3 −3.8 −3.9 −3.9 −4.4 −4.1 −4.5 −3.9 −3.2 −3.7 −4.0 −3.4 −3.4 −3.5 −4.2 −3.7 −4.3
CASIA −2
−3.4 −4.3 −4.2 −4.8 −4.2 −4.1 −4.0 −4.3 −4.0 −3.4 −3.0 −4.0 −3.8 −4.6 −4.0 −3.8 −3.7 −4.1 −3.6 −3.1
CARIB

−3.3 −4.6 −4.3 −4.8 −4.4 −4.2 −4.1 −4.4 −4.1 −3.0 −3.0 −4.2 −4.0 −4.6 −4.1 −4.0 −3.7 −4.1 −3.8 −2.8
SSAFRICA
−3.7 −4.0 −3.9 −4.4 −4.1 −3.6 −3.6 −4.0 −2.5 −4.0 −3.4 −3.7 −3.6 −4.2 −3.9 −3.3 −3.4 −3.8 −2.3 −3.8
SASIA

−4
−4.2 −4.2 −4.1 −4.1 −4.4 −4.2 −4.0 −3.6 −3.8 −4.3 −3.9 −4.0 −3.8 −3.8 −4.1 −3.9 −3.7 −3.4 −3.6 −3.9
POLY
−4.1 −3.8 −3.9 −4.6 −4.0 −3.7 −3.5 −4.2 −3.7 −4.2 −3.7 −3.6 −3.5 −4.3 −3.6 −3.3 −3.2 −3.8 −3.3 −3.7
NAFRICA
-
−4.0 −3.8 −3.9 −4.6 −3.9 −3.5 −3.5 −4.3 −3.5 −4.2 −3.6 −3.4 −3.5 −4.4 −3.5 −3.1 −3.1 −4.1 −3.2 −3.8 −5
MEAST
−4.1 −3.6 −3.9 −4.6 −3.6 −3.8 −3.8 −4.4 −4.1 −4.4 −3.8 −3.3 −3.5 −4.3 −3.2 −3.5 −3.6 −4.2 −3.8 −4.2
EURO
−4.6 −4.2 −4.6 −3.7 −4.6 −4.6 −4.5 −4.1 −4.4 −4.8 −4.4 −3.9 −4.3 −3.3 −4.3 −4.4 −4.4 −3.8 −4.1 −4.5
−6
EASIA
VERIFICATION
−4.0 −4.0 −3.6 −4.6 −4.0 −3.9 −3.9 −4.2 −3.9 −4.3 −3.6 −3.6 −3.2 −4.4 −3.6 −3.5 −3.5 −3.9 −3.6 −4.1
CSAMERIC
−4.1 −3.4 −3.8 −4.2 −3.6 −3.6 −3.7 −4.2 −3.9 −4.3 −3.7 −2.9 −3.4 −3.8 −3.2 −3.1 −3.4 −3.9 −3.5 −4.1
CASIA
−3.1 −4.0 −4.0 −4.7 −4.0 −3.9 −3.8 −4.2 −3.7 −3.2 −2.8 −3.7 −3.5 −4.4 −3.7 −3.5 −3.4 −4.0 −3.4 −2.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 185: For algorithm glory-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


225
Cross region FMR at threshold T = 0.618 for algorithm glory_001, giving FMR(T) = 0.0001 globally.
−3.2 −4.7 −4.5 −5.1 −4.7 −4.5 −4.3 −4.6 −4.2 −2.9 −2.9 −4.3 −4.2 −4.9 −4.4 −4.3 −4.0 −4.4 −4.0 −2.7
SSAFRICA
−3.9 −4.3 −4.1 −4.8 −4.4 −3.8 −3.8 −4.2 −2.8 −4.1 −3.6 −4.0 −3.8 −4.5 −4.2 −3.5 −3.5 −4.0 −2.5 −3.9
SASIA
−4.4 −4.7 −4.4 −4.3 −4.8 −4.6 −4.5 −3.7 −4.1 −4.5 −4.0 −4.3 −4.0 −4.1 −4.5 −4.2 −4.4 −3.4 −3.9 −4.4
POLY
2019/10/16 12:43:37
−4.3 −4.2 −4.1 −4.8 −4.2 −3.8 −3.7 −4.4 −3.8 −4.4 −4.0 −4.0 −3.6 −4.5 −3.9 −3.5 −3.2 −4.0 −3.4 −4.1
NAFRICA log10 FMR
−4.2 −4.0 −4.2 −5.0 −4.1 −3.7 −3.7 −4.7 −3.7 −4.5 −3.7 −3.6 −3.7 −4.6 −3.7 −3.2 −3.2 −4.3 −3.4 −4.2
MEAST
−4.5 −4.0 −4.2 −5.0 −3.9 −4.1 −4.2 −4.8 −4.4 −4.7 −4.1 −3.6 −3.8 −4.8 −3.5 −3.8 −3.8 −4.7 −4.1 −4.4
EURO
−4.9 −4.5 −4.9 −3.9 −5.0 −4.9 −4.9 −4.3 −4.7 −5.0 −4.5 −4.2 −4.6 −3.5 −4.7 −4.6 −4.8 −4.0 −4.4 −4.9 −1
EASIA
−4.2 −4.3 −3.7 −4.9 −4.3 −4.1 −4.1 −4.4 −4.1 −4.5 −3.8 −3.9 −3.3 −4.6 −3.9 −3.8 −3.8 −4.0 −3.8 −4.2
FRVT
CSAMERIC
-
−4.4 −3.7 −4.1 −4.4 −3.9 −3.9 −4.0 −4.5 −4.2 −4.8 −3.9 −3.2 −3.7 −4.0 −3.5 −3.5 −3.6 −4.1 −3.8 −4.4
CASIA −2
−3.0 −4.3 −4.2 −4.9 −4.3 −4.2 −4.0 −4.3 −3.9 −3.1 −2.7 −3.9 −3.7 −4.6 −3.9 −3.8 −3.6 −4.1 −3.6 −2.8
CARIB

−3.0 −4.5 −4.3 −4.9 −4.5 −4.3 −4.1 −4.4 −4.0 −2.7 −2.7 −4.1 −3.9 −4.7 −4.2 −4.1 −3.9 −4.3 −3.7 −2.5
SSAFRICA
−3.7 −4.1 −3.9 −4.6 −4.2 −3.6 −3.6 −4.0 −2.5 −3.9 −3.4 −3.8 −3.6 −4.4 −4.0 −3.3 −3.3 −3.8 −2.3 −3.7
SASIA

−4
−4.2 −4.5 −4.2 −4.1 −4.6 −4.4 −4.3 −3.5 −3.9 −4.3 −3.9 −4.0 −3.8 −3.8 −4.3 −4.0 −4.3 −3.2 −3.7 −4.2
POLY
−4.1 −3.9 −3.9 −4.6 −4.0 −3.7 −3.5 −4.2 −3.6 −4.2 −3.7 −3.7 −3.4 −4.3 −3.7 −3.3 −3.0 −4.0 −3.2 −4.0
NAFRICA
-
−4.0 −3.8 −3.9 −4.8 −3.9 −3.4 −3.5 −4.5 −3.4 −4.3 −3.5 −3.3 −3.5 −4.4 −3.5 −3.0 −3.0 −4.0 −3.2 −4.0 −5
MEAST
−4.2 −3.7 −4.0 −4.8 −3.7 −3.9 −3.9 −4.6 −4.2 −4.5 −3.9 −3.4 −3.6 −4.6 −3.3 −3.5 −3.6 −4.5 −3.9 −4.2
EURO
−4.7 −4.3 −4.8 −3.7 −4.9 −4.7 −4.8 −4.1 −4.5 −4.9 −4.4 −3.9 −4.4 −3.3 −4.6 −4.4 −4.5 −3.8 −4.2 −4.8
−6
EASIA
VERIFICATION
−4.0 −4.1 −3.5 −4.8 −4.1 −3.9 −3.9 −4.2 −3.9 −4.3 −3.5 −3.6 −3.1 −4.4 −3.7 −3.6 −3.6 −3.8 −3.6 −4.0
CSAMERIC
−4.1 −3.4 −3.9 −4.2 −3.7 −3.6 −3.7 −4.3 −4.0 −4.6 −3.7 −3.0 −3.5 −3.8 −3.2 −3.2 −3.4 −3.8 −3.6 −4.3
CASIA
−2.8 −4.0 −3.9 −4.8 −4.1 −3.9 −3.8 −4.2 −3.7 −2.9 −2.5 −3.7 −3.5 −4.5 −3.7 −3.5 −3.3 −3.9 −3.3 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


226
Cross region FMR at threshold T = 0.483 for algorithm gorilla_002, giving FMR(T) = 0.0001 globally.
−3.2 −5.8 −5.0 −5.8 −4.8 −5.0 −4.8 −5.1 −4.8 −2.7 −2.8 −5.0 −4.5 −5.3 −4.4 −4.7 −4.6 −4.9 −4.3 −2.4
SSAFRICA
−4.1 −4.8 −4.1 −5.0 −4.8 −4.2 −4.2 −4.5 −3.2 −4.7 −3.3 −4.2 −3.2 −4.4 −4.0 −3.4 −3.5 −4.0 −2.8 −4.0
SASIA
−4.3 −4.4 −4.3 −3.6 −5.2 −5.1 −4.9 −2.7 −4.2 −4.9 −3.9 −4.1 −3.7 −3.2 −4.7 −4.4 −4.4 −2.4 −3.8 −4.4
POLY
2019/10/16 12:43:37
−4.5 −4.7 −4.4 −5.8 −5.0 −4.1 −3.8 −4.9 −4.2 −5.2 −3.8 −4.3 −3.7 −5.7 −4.4 −3.5 −3.4 −6.0 −3.5 −4.9
NAFRICA log10 FMR
−4.4 −4.3 −4.0 −5.5 −4.4 −3.8 −3.9 −4.9 −4.0 −5.2 −3.5 −3.8 −3.1 −4.6 −3.6 −3.0 −3.1 −4.3 −3.1 −4.4
MEAST
−4.8 −4.4 −4.5 −5.6 −4.4 −4.5 −4.7 −5.3 −5.0 −5.2 −4.0 −3.9 −3.7 −5.0 −3.8 −3.8 −4.1 −4.8 −4.2 −4.5
EURO
−5.1 −4.1 −4.9 −3.3 −5.5 −5.7 −5.7 −3.6 −5.0 −5.5 −4.3 −3.6 −4.1 −2.8 −4.8 −4.9 −5.1 −3.2 −4.6 −4.9 −1
EASIA
−4.2 −4.5 −3.6 −4.9 −4.5 −4.2 −4.2 −4.2 −4.2 −4.7 −3.3 −3.8 −2.8 −4.2 −3.7 −3.3 −3.4 −3.7 −3.4 −4.1
FRVT
CSAMERIC
-
−5.0 −3.6 −4.5 −4.3 −4.4 −4.3 −4.1 −4.6 −4.9 −5.6 −4.4 −3.2 −3.7 −3.9 −3.7 −3.7 −3.8 −4.4 −4.4 −4.7
CASIA −2
−3.2 −4.9 −4.4 −5.2 −4.6 −4.6 −4.4 −4.4 −4.4 −3.1 −2.6 −4.4 −3.7 −4.6 −4.0 −3.9 −3.9 −4.1 −3.9 −2.7
CARIB

−2.9 −5.7 −4.7 −5.5 −4.6 −4.7 −4.6 −4.9 −4.6 −2.5 −2.5 −5.0 −4.3 −5.1 −4.2 −4.4 −4.4 −4.6 −4.1 −2.2
SSAFRICA
−4.0 −4.6 −4.0 −4.7 −4.6 −4.0 −4.0 −4.2 −3.0 −4.5 −3.2 −4.0 −3.2 −4.3 −3.9 −3.3 −3.5 −3.8 −2.6 −3.9
SASIA

−4
−4.1 −4.1 −4.0 −3.3 −5.0 −4.8 −4.6 −2.4 −4.0 −4.7 −3.6 −3.8 −3.5 −3.0 −4.6 −4.3 −4.1 −2.2 −3.6 −4.1
POLY
−4.3 −4.4 −4.1 −5.5 −4.7 −3.8 −3.5 −4.7 −4.0 −4.9 −3.5 −4.0 −3.5 −5.4 −4.2 −3.3 −3.1 −6.0 −3.4 −4.6
NAFRICA
-
−4.2 −4.0 −3.8 −5.3 −4.2 −3.6 −3.6 −4.7 −3.9 −4.9 −3.3 −3.5 −3.0 −4.5 −3.5 −2.9 −2.9 −4.1 −3.1 −4.2 −5
MEAST
−4.6 −4.1 −4.3 −5.4 −4.1 −4.3 −4.5 −5.1 −4.8 −5.0 −3.9 −3.6 −3.6 −4.8 −3.6 −3.7 −4.0 −4.7 −4.1 −4.4
EURO
−4.9 −3.9 −4.7 −3.0 −5.3 −5.6 −5.5 −3.3 −4.8 −5.2 −4.2 −3.4 −4.0 −2.6 −4.7 −4.8 −5.1 −3.0 −4.3 −4.7
−6
EASIA
VERIFICATION
−4.0 −4.3 −3.4 −4.7 −4.3 −4.0 −4.0 −4.0 −4.0 −4.5 −3.2 −3.7 −2.7 −4.1 −3.6 −3.2 −3.3 −3.5 −3.3 −4.0
CSAMERIC
−4.7 −3.4 −4.2 −4.0 −4.1 −4.0 −3.8 −4.3 −4.6 −5.5 −4.1 −2.9 −3.6 −3.7 −3.5 −3.6 −3.5 −4.1 −4.1 −4.6
CASIA
−2.9 −4.6 −4.1 −5.0 −4.4 −4.3 −4.2 −4.2 −4.2 −2.9 −2.4 −4.2 −3.5 −4.5 −3.8 −3.7 −3.7 −3.8 −3.7 −2.5
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 187: For algorithm gorilla-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


227
Cross region FMR at threshold T = 0.454 for algorithm gorilla_003, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.3 −5.9 −5.0 −5.2 −5.0 −5.5 −5.0 −3.1 −3.0 −6.0 −4.7 −5.5 −4.5 −4.7 −4.5 −5.6 −4.5 −2.7
SSAFRICA
−4.3 −4.8 −4.1 −5.0 −4.8 −4.1 −4.2 −4.6 −3.2 −4.7 −3.4 −4.1 −3.2 −4.5 −4.0 −3.4 −3.5 −4.1 −2.8 −4.1
SASIA
−4.6 −4.6 −4.3 −3.6 −5.3 −5.1 −6.0 −2.8 −4.4 −5.3 −4.1 −4.2 −3.7 −3.2 −4.7 −4.4 −6.0 −2.5 −3.9 −4.8
POLY
2019/10/16 12:43:37
−4.6 −4.7 −4.3 −5.8 −4.9 −4.1 −3.9 −5.3 −4.3 −5.4 −4.3 −3.9 −3.6 −5.1 −4.4 −3.4 −3.4 −6.0 −3.7 −4.9
NAFRICA log10 FMR
−4.3 −4.5 −3.9 −5.5 −4.5 −3.8 −4.0 −4.8 −4.0 −5.1 −3.4 −3.9 −3.0 −4.6 −3.6 −2.9 −3.1 −4.1 −3.1 −4.2
MEAST
−4.8 −4.5 −4.5 −5.6 −4.4 −4.6 −4.7 −5.4 −5.0 −5.2 −4.0 −4.0 −3.7 −5.1 −3.8 −3.8 −4.1 −4.7 −4.2 −4.5
EURO
−5.3 −4.0 −4.9 −3.2 −5.4 −5.9 −6.0 −3.7 −5.1 −5.6 −4.5 −3.5 −4.2 −2.7 −4.8 −5.1 −5.3 −3.3 −4.6 −5.0 −1
EASIA
−4.2 −4.6 −3.6 −4.9 −4.5 −4.1 −4.2 −4.3 −4.2 −5.0 −3.4 −3.9 −2.8 −4.2 −3.8 −3.3 −3.4 −3.7 −3.4 −4.3
FRVT
CSAMERIC
-
−5.2 −3.7 −4.6 −4.0 −4.5 −4.4 −4.5 −4.7 −5.1 −6.0 −4.5 −3.4 −3.8 −3.7 −3.8 −3.8 −4.7 −4.2 −4.5 −5.2
CASIA −2
−3.4 −5.2 −4.5 −5.5 −4.7 −4.7 −4.6 −4.8 −4.6 −3.4 −2.7 −4.5 −3.9 −4.8 −4.0 −4.0 −3.9 −4.4 −4.0 −2.9
CARIB

−3.2 −6.0 −5.1 −5.6 −4.8 −5.0 −4.8 −5.2 −4.7 −2.9 −2.8 −6.0 −4.5 −5.2 −4.3 −4.4 −4.4 −5.3 −4.2 −2.5
SSAFRICA
−4.1 −4.6 −4.0 −4.8 −4.7 −4.0 −4.0 −4.4 −3.0 −4.5 −3.3 −4.0 −3.1 −4.3 −4.0 −3.3 −3.4 −3.9 −2.6 −4.0
SASIA

−4
−4.3 −4.3 −4.0 −3.3 −5.1 −5.0 −5.8 −2.5 −4.1 −5.0 −3.8 −4.0 −3.5 −3.0 −4.6 −4.3 −6.0 −2.2 −3.7 −4.7
POLY
−4.4 −4.4 −4.1 −5.6 −4.6 −3.8 −3.7 −5.0 −4.1 −5.1 −4.1 −3.6 −3.4 −4.8 −4.1 −3.2 −3.2 −6.0 −3.5 −4.6
NAFRICA
-
−4.2 −4.3 −3.8 −5.3 −4.3 −3.6 −3.7 −4.6 −3.8 −4.9 −3.3 −3.6 −2.9 −4.5 −3.4 −2.8 −3.0 −3.9 −3.0 −4.1 −5
MEAST
−4.6 −4.3 −4.3 −5.4 −4.2 −4.4 −4.4 −5.3 −4.8 −5.0 −3.9 −3.7 −3.6 −4.9 −3.6 −3.7 −4.0 −4.7 −4.1 −4.4
EURO
−5.1 −3.7 −4.6 −2.9 −5.2 −5.8 −6.0 −3.4 −4.8 −5.4 −4.3 −3.3 −4.0 −2.5 −4.6 −5.0 −5.1 −3.0 −4.4 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.4 −4.6 −4.3 −4.0 −4.0 −4.0 −4.0 −4.8 −3.3 −3.7 −2.7 −4.0 −3.6 −3.2 −3.3 −3.5 −3.3 −4.2
CSAMERIC
−4.9 −3.4 −4.3 −3.8 −4.2 −4.1 −4.2 −4.4 −4.9 −6.0 −4.2 −3.1 −3.7 −3.4 −3.7 −3.6 −4.4 −3.9 −4.2 −6.0
CASIA
−3.2 −4.9 −4.3 −5.2 −4.5 −4.4 −4.3 −4.6 −4.3 −3.2 −2.6 −4.3 −3.7 −4.7 −3.9 −3.8 −3.7 −4.2 −3.8 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


228
Cross region FMR at threshold T = 66.565 for algorithm hik_001, giving FMR(T) = 0.0001 globally.
−3.5 −5.7 −5.0 −6.0 −5.0 −4.9 −4.7 −5.4 −4.5 −3.0 −3.1 −5.0 −4.4 −5.6 −4.5 −4.4 −4.5 −4.9 −4.1 −2.7
SSAFRICA
−4.0 −4.6 −4.1 −5.1 −4.6 −3.9 −3.9 −4.3 −2.6 −4.4 −3.5 −4.0 −3.4 −4.6 −4.0 −3.3 −3.4 −3.9 −2.2 −3.9
SASIA
−4.6 −5.6 −4.6 −4.6 −5.4 −5.2 −5.2 −3.3 −4.1 −5.5 −4.0 −5.0 −3.9 −4.1 −4.8 −4.6 −4.6 −2.9 −3.6 −4.8
POLY
2019/10/16 12:43:37
−4.3 −4.4 −4.1 −5.8 −4.5 −3.9 −3.6 −5.1 −3.9 −4.9 −3.7 −3.5 −3.4 −5.2 −4.0 −3.2 −3.1 −4.6 −3.3 −4.9
NAFRICA log10 FMR
−4.4 −4.2 −4.0 −5.6 −4.3 −3.6 −3.7 −5.0 −3.8 −4.9 −3.6 −3.6 −3.2 −4.9 −3.6 −2.9 −3.0 −4.4 −3.1 −4.4
MEAST
−4.7 −4.2 −4.4 −6.0 −4.0 −4.3 −4.4 −5.4 −4.7 −5.2 −4.1 −3.7 −3.7 −5.6 −3.5 −3.8 −3.9 −4.8 −4.2 −4.7
EURO
−5.7 −5.4 −5.5 −4.6 −6.0 −5.9 −5.9 −4.6 −5.1 −6.0 −4.9 −4.8 −4.7 −4.0 −5.4 −5.1 −5.1 −4.1 −4.7 −5.6 −1
EASIA
−4.2 −4.6 −3.7 −5.5 −4.5 −4.2 −4.2 −4.6 −4.1 −5.0 −3.5 −4.0 −3.0 −4.8 −3.8 −3.4 −3.5 −3.9 −3.6 −4.4
FRVT
CSAMERIC
-
−4.8 −3.8 −4.5 −5.3 −4.1 −4.1 −4.1 −5.6 −4.6 −5.9 −4.2 −3.3 −3.9 −4.8 −3.6 −3.6 −3.7 −6.0 −4.0 −5.2
CASIA −2
−3.4 −4.7 −4.3 −5.8 −4.6 −4.5 −4.4 −4.9 −4.1 −3.4 −2.8 −4.1 −3.7 −5.2 −4.0 −3.8 −3.8 −4.5 −3.7 −3.0
CARIB

−3.3 −5.4 −4.8 −5.9 −4.8 −4.6 −4.4 −5.1 −4.3 −2.7 −2.8 −4.7 −4.2 −5.3 −4.4 −4.1 −4.3 −4.7 −3.8 −2.4
SSAFRICA
−3.8 −4.3 −3.9 −4.9 −4.4 −3.7 −3.7 −4.1 −2.3 −4.1 −3.2 −3.8 −3.3 −4.4 −3.9 −3.1 −3.2 −3.7 −2.0 −3.7
SASIA

−4
−4.3 −5.3 −4.3 −4.3 −5.1 −4.9 −4.9 −3.0 −3.8 −5.2 −3.8 −4.7 −3.7 −3.8 −4.6 −4.4 −4.3 −2.7 −3.3 −4.5
POLY
−4.0 −4.1 −3.9 −5.7 −4.3 −3.6 −3.4 −4.8 −3.6 −4.6 −3.4 −3.2 −3.2 −5.1 −3.7 −3.0 −2.8 −4.3 −3.1 −4.6
NAFRICA
-
−4.1 −3.9 −3.8 −5.5 −4.0 −3.3 −3.4 −4.7 −3.5 −4.7 −3.4 −3.3 −3.1 −4.8 −3.4 −2.7 −2.8 −4.1 −3.0 −4.2 −5
MEAST
−4.5 −3.9 −4.1 −5.9 −3.8 −4.1 −4.1 −5.2 −4.5 −4.9 −3.9 −3.4 −3.5 −5.4 −3.3 −3.5 −3.6 −4.6 −4.0 −4.5
EURO
−5.5 −5.1 −5.2 −4.3 −5.9 −5.7 −5.7 −4.3 −4.9 −5.9 −4.6 −4.5 −4.5 −3.8 −5.3 −4.9 −4.8 −3.8 −4.4 −5.4
−6
EASIA
VERIFICATION
−4.0 −4.4 −3.4 −5.2 −4.2 −3.9 −3.9 −4.3 −3.9 −4.7 −3.3 −3.8 −2.8 −4.6 −3.6 −3.3 −3.3 −3.7 −3.3 −4.2
CSAMERIC
−4.5 −3.5 −4.2 −5.0 −3.8 −3.8 −3.8 −5.4 −4.3 −5.6 −3.9 −3.0 −3.6 −4.5 −3.3 −3.4 −3.5 −6.0 −3.8 −4.9
CASIA
−3.1 −4.4 −4.1 −5.5 −4.3 −4.2 −4.1 −4.6 −3.9 −3.2 −2.6 −3.8 −3.5 −5.0 −3.8 −3.6 −3.5 −4.3 −3.4 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 189: For algorithm hik-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


229
Cross region FMR at threshold T = 0.823 for algorithm hr_001, giving FMR(T) = 0.0001 globally.
−3.3 −6.0 −4.9 −5.4 −4.9 −5.0 −4.7 −4.7 −4.6 −2.9 −3.0 −6.0 −4.6 −5.0 −4.6 −4.6 −4.3 −4.6 −4.2 −2.7
SSAFRICA
−4.1 −4.6 −4.0 −4.9 −4.6 −4.0 −4.0 −4.2 −3.1 −4.5 −3.5 −4.0 −3.3 −4.5 −4.0 −3.4 −3.5 −3.9 −2.8 −4.1
SASIA
−4.2 −4.4 −4.1 −3.7 −5.1 −4.9 −4.7 −2.7 −4.1 −4.6 −3.9 −4.1 −3.7 −3.3 −4.6 −4.5 −4.3 −2.4 −3.7 −4.1
POLY
2019/10/16 12:43:37
−4.3 −4.5 −4.1 −5.5 −4.6 −3.9 −3.8 −5.1 −4.0 −4.6 −3.8 −3.7 −3.5 −5.0 −4.1 −3.4 −3.6 −4.6 −3.4 −4.6
NAFRICA log10 FMR
−4.3 −4.2 −3.9 −5.3 −4.4 −3.7 −3.7 −4.5 −3.8 −5.0 −3.5 −3.6 −3.2 −4.5 −3.7 −3.0 −3.0 −4.1 −3.1 −4.2
MEAST
−4.8 −4.4 −4.4 −5.7 −4.3 −4.4 −4.5 −5.1 −4.7 −5.0 −4.2 −3.9 −3.7 −5.1 −3.8 −3.8 −4.0 −4.5 −4.1 −4.5
EURO
−5.2 −4.4 −4.9 −3.7 −5.7 −5.7 −5.5 −3.7 −5.1 −5.5 −4.7 −4.1 −4.4 −3.2 −5.1 −5.1 −5.2 −3.4 −4.7 −4.9 −1
EASIA
−4.2 −4.3 −3.5 −4.9 −4.4 −4.1 −4.0 −4.1 −4.0 −4.7 −3.5 −3.8 −2.9 −4.4 −3.8 −3.4 −3.4 −3.7 −3.5 −4.2
FRVT
CSAMERIC
-
−5.0 −3.7 −4.4 −4.4 −4.4 −4.1 −4.2 −4.6 −4.6 −5.5 −4.5 −3.4 −3.9 −4.0 −3.9 −3.6 −3.8 −4.4 −4.3 −4.7
CASIA −2
−3.3 −4.9 −4.3 −5.3 −4.7 −4.6 −4.4 −4.4 −4.3 −3.3 −2.8 −4.4 −3.9 −4.9 −4.3 −4.1 −3.7 −4.1 −3.9 −2.9
CARIB

−3.0 −5.7 −4.7 −5.1 −4.6 −4.7 −4.5 −4.4 −4.3 −2.7 −2.7 −6.0 −4.3 −4.8 −4.4 −4.3 −4.0 −4.3 −4.0 −2.4
SSAFRICA
−3.8 −4.4 −3.8 −4.7 −4.5 −3.8 −3.8 −4.0 −2.9 −4.3 −3.3 −3.8 −3.1 −4.3 −3.9 −3.3 −3.3 −3.7 −2.6 −3.9
SASIA

−4
−3.9 −4.2 −3.8 −3.4 −4.8 −4.6 −4.4 −2.4 −3.8 −4.3 −3.7 −3.9 −3.4 −3.0 −4.4 −4.2 −4.0 −2.2 −3.4 −3.9
POLY
−4.0 −4.2 −3.8 −5.3 −4.3 −3.7 −3.5 −4.8 −3.8 −4.3 −3.5 −3.4 −3.2 −4.7 −3.9 −3.2 −3.3 −4.3 −3.3 −4.3
NAFRICA
-
−4.2 −3.9 −3.7 −5.1 −4.2 −3.5 −3.5 −4.3 −3.7 −4.7 −3.4 −3.4 −3.0 −4.4 −3.5 −2.8 −2.9 −3.9 −3.0 −4.0 −5
MEAST
−4.5 −4.1 −4.1 −5.5 −4.0 −4.2 −4.2 −4.9 −4.5 −4.8 −4.0 −3.6 −3.5 −4.9 −3.5 −3.6 −3.8 −4.4 −3.9 −4.4
EURO
−5.0 −4.1 −4.7 −3.4 −5.5 −5.5 −5.3 −3.4 −4.9 −5.2 −4.5 −3.8 −4.2 −3.0 −4.9 −4.9 −5.0 −3.2 −4.5 −4.6
−6
EASIA
VERIFICATION
−3.9 −4.1 −3.2 −4.6 −4.2 −3.9 −3.8 −3.8 −3.8 −4.5 −3.3 −3.6 −2.7 −4.2 −3.6 −3.3 −3.2 −3.4 −3.3 −4.0
CSAMERIC
−4.7 −3.5 −4.2 −4.1 −4.1 −3.9 −3.9 −4.3 −4.3 −5.3 −4.2 −3.1 −3.7 −3.7 −3.6 −3.4 −3.5 −4.1 −4.0 −4.6
CASIA
−3.0 −4.6 −4.1 −5.0 −4.5 −4.4 −4.1 −4.1 −4.0 −3.0 −2.6 −4.1 −3.6 −4.6 −4.1 −3.8 −3.5 −3.9 −3.6 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 190: For algorithm hr-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


230
Cross region FMR at threshold T = 0.285 for algorithm hr_002, giving FMR(T) = 0.0001 globally.
−3.2 −6.0 −4.8 −5.3 −4.7 −4.9 −4.6 −4.5 −4.5 −2.9 −2.9 −6.0 −4.4 −5.0 −4.3 −4.6 −4.1 −4.2 −4.1 −2.6
SSAFRICA
−4.0 −4.5 −4.0 −4.9 −4.6 −4.0 −3.9 −4.2 −3.1 −4.4 −3.5 −4.0 −3.3 −4.5 −4.0 −3.4 −3.4 −3.9 −2.7 −4.0
SASIA
−4.1 −4.5 −4.2 −3.7 −5.1 −4.9 −4.8 −2.7 −4.1 −4.5 −3.7 −4.3 −3.8 −3.4 −4.6 −4.4 −4.7 −2.5 −3.7 −4.0
POLY
2019/10/16 12:43:37
−4.2 −4.4 −4.1 −5.6 −4.5 −3.9 −3.6 −5.0 −4.0 −4.5 −3.8 −3.9 −3.5 −5.1 −4.1 −3.5 −3.3 −4.4 −3.4 −4.6
NAFRICA log10 FMR
−4.3 −4.1 −3.9 −5.2 −4.3 −3.7 −3.7 −4.5 −3.8 −4.8 −3.5 −3.6 −3.2 −4.6 −3.7 −3.0 −3.0 −4.2 −3.1 −4.2
MEAST
−4.7 −4.2 −4.3 −5.7 −4.2 −4.4 −4.4 −5.1 −4.7 −4.9 −4.1 −3.8 −3.7 −5.2 −3.7 −3.8 −3.9 −4.6 −4.0 −4.4
EURO
−5.2 −4.5 −5.1 −3.8 −5.7 −5.6 −5.8 −3.8 −5.1 −5.4 −4.7 −4.2 −4.5 −3.3 −5.3 −5.1 −5.4 −3.5 −4.8 −4.9 −1
EASIA
−4.1 −4.3 −3.5 −5.0 −4.4 −4.1 −4.0 −4.2 −4.0 −4.7 −3.5 −3.9 −2.9 −4.5 −3.8 −3.4 −3.5 −3.7 −3.5 −4.2
FRVT
CSAMERIC
-
−4.8 −3.7 −4.4 −4.5 −4.3 −4.1 −4.1 −4.8 −4.6 −5.9 −4.4 −3.4 −4.0 −4.1 −3.8 −3.7 −3.8 −4.6 −4.2 −5.2
CASIA −2
−3.2 −4.9 −4.3 −5.2 −4.6 −4.6 −4.4 −4.3 −4.2 −3.2 −2.7 −4.3 −3.9 −4.8 −4.1 −4.0 −3.8 −4.0 −3.8 −2.8
CARIB

−3.0 −5.7 −4.5 −5.1 −4.5 −4.6 −4.4 −4.2 −4.2 −2.6 −2.6 −6.0 −4.2 −4.8 −4.2 −4.4 −3.9 −4.0 −3.9 −2.4
SSAFRICA
−3.8 −4.3 −3.8 −4.7 −4.4 −3.8 −3.7 −3.9 −2.8 −4.1 −3.3 −3.8 −3.2 −4.3 −3.9 −3.2 −3.3 −3.7 −2.5 −3.8
SASIA

−4
−3.8 −4.3 −3.9 −3.5 −4.8 −4.6 −4.5 −2.5 −3.8 −4.2 −3.5 −4.0 −3.5 −3.1 −4.3 −4.2 −4.5 −2.2 −3.5 −3.8
POLY
−4.0 −4.2 −3.8 −5.4 −4.2 −3.7 −3.3 −4.8 −3.8 −4.3 −3.5 −3.6 −3.3 −5.0 −3.9 −3.3 −3.0 −4.1 −3.3 −4.3
NAFRICA
-
−4.1 −3.8 −3.7 −5.0 −4.1 −3.4 −3.5 −4.3 −3.6 −4.6 −3.4 −3.4 −3.0 −4.5 −3.5 −2.8 −2.9 −4.0 −3.0 −4.0 −5
MEAST
−4.5 −4.0 −4.1 −5.5 −3.9 −4.2 −4.2 −4.9 −4.5 −4.7 −3.9 −3.5 −3.5 −5.0 −3.5 −3.7 −3.7 −4.5 −3.9 −4.3
EURO
−5.0 −4.2 −4.8 −3.5 −5.5 −5.4 −5.5 −3.5 −4.9 −5.1 −4.5 −3.9 −4.3 −3.1 −5.1 −4.9 −5.1 −3.2 −4.6 −4.6
−6
EASIA
VERIFICATION
−3.9 −4.1 −3.2 −4.7 −4.1 −3.9 −3.8 −3.9 −3.8 −4.4 −3.3 −3.7 −2.7 −4.3 −3.6 −3.3 −3.3 −3.5 −3.3 −4.0
CSAMERIC
−4.5 −3.5 −4.1 −4.2 −4.0 −3.8 −3.8 −4.5 −4.3 −5.9 −4.1 −3.1 −3.7 −3.8 −3.6 −3.4 −3.5 −4.3 −3.9 −6.0
CASIA
−3.0 −4.6 −4.0 −5.0 −4.3 −4.3 −4.1 −4.0 −3.9 −2.9 −2.5 −4.1 −3.6 −4.6 −3.9 −3.8 −3.6 −3.8 −3.6 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


231
Cross region FMR at threshold T = 37645.000 for algorithm id3_003, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.4 −6.0 −5.1 −5.4 −5.4 −5.7 −5.2 −3.3 −3.0 −6.0 −4.9 −5.9 −4.5 −4.8 −4.8 −5.2 −4.7 −2.9
SSAFRICA
−4.0 −4.7 −3.8 −5.0 −4.5 −3.9 −4.1 −4.5 −3.5 −4.6 −3.0 −3.7 −2.8 −4.2 −3.6 −3.0 −3.2 −3.8 −2.8 −3.8
SASIA
−4.5 −5.1 −4.2 −4.0 −5.1 −4.8 −5.0 −3.1 −4.5 −5.3 −3.7 −4.4 −3.3 −3.5 −4.2 −3.8 −4.1 −2.7 −3.7 −4.6
POLY
2019/10/16 12:43:37
−5.3 −6.0 −4.6 −6.0 −5.4 −4.5 −4.4 −5.6 −4.6 −5.7 −5.0 −6.0 −3.8 −5.7 −5.1 −3.8 −3.6 −6.0 −3.8 −4.9
NAFRICA log10 FMR
−4.2 −4.5 −3.7 −5.2 −4.3 −3.7 −3.9 −4.8 −3.9 −5.0 −3.2 −3.6 −2.6 −4.2 −3.2 −2.8 −2.9 −3.8 −2.9 −4.0
MEAST
−4.5 −4.7 −4.1 −5.3 −4.4 −4.3 −4.6 −5.1 −4.7 −4.9 −3.5 −3.9 −3.1 −4.4 −3.5 −3.4 −3.7 −4.3 −3.8 −4.0
EURO
−5.1 −4.5 −4.7 −3.7 −5.4 −5.4 −5.6 −4.0 −5.2 −5.8 −4.2 −3.8 −3.7 −3.0 −4.5 −4.4 −4.7 −3.4 −4.5 −4.9 −1
EASIA
−4.0 −4.3 −3.4 −4.7 −4.2 −3.8 −4.0 −4.3 −3.9 −4.7 −3.0 −3.4 −2.4 −3.7 −3.2 −2.8 −3.0 −3.4 −3.0 −3.8
FRVT
CSAMERIC
-
−5.2 −4.1 −4.3 −4.7 −4.5 −4.4 −4.9 −5.6 −5.2 −5.8 −4.1 −3.5 −3.2 −4.3 −3.6 −3.4 −4.0 −5.2 −4.2 −4.9
CASIA −2
−3.4 −5.3 −4.6 −5.3 −4.8 −4.8 −4.9 −4.9 −4.7 −3.4 −2.6 −4.5 −3.7 −4.3 −4.0 −3.9 −4.2 −4.1 −3.9 −2.8
CARIB

−3.4 −6.0 −5.2 −6.0 −5.0 −5.2 −5.3 −5.4 −4.9 −3.0 −2.9 −6.0 −4.7 −5.9 −4.4 −4.6 −4.5 −5.0 −4.5 −2.7
SSAFRICA
−3.9 −4.6 −3.7 −4.9 −4.5 −3.9 −4.1 −4.4 −3.3 −4.5 −3.0 −3.8 −2.7 −4.1 −3.6 −3.0 −3.2 −3.7 −2.8 −3.7
SASIA

−4
−4.5 −4.9 −4.1 −3.8 −5.0 −4.7 −4.9 −2.9 −4.3 −5.2 −3.7 −4.2 −3.2 −3.3 −4.1 −3.8 −4.0 −2.5 −3.7 −4.6
POLY
−5.3 −6.0 −4.4 −5.9 −5.2 −4.3 −4.1 −5.3 −4.5 −5.4 −4.7 −6.0 −3.7 −6.0 −4.9 −3.7 −3.4 −6.0 −3.8 −4.6
NAFRICA
-
−4.1 −4.4 −3.6 −5.2 −4.2 −3.6 −3.9 −4.6 −3.8 −5.0 −3.1 −3.6 −2.6 −4.2 −3.2 −2.7 −2.9 −3.7 −2.9 −4.0 −5
MEAST
−4.4 −4.5 −4.1 −5.3 −4.4 −4.3 −4.5 −5.1 −4.6 −4.8 −3.5 −3.8 −3.1 −4.3 −3.5 −3.3 −3.7 −4.3 −3.7 −4.0
EURO
−5.0 −4.3 −4.7 −3.6 −5.4 −5.3 −5.6 −3.8 −5.1 −5.7 −4.1 −3.6 −3.7 −2.9 −4.5 −4.3 −4.7 −3.3 −4.4 −4.9
−6
EASIA
VERIFICATION
−3.9 −4.3 −3.4 −4.7 −4.1 −3.8 −3.9 −4.2 −3.9 −4.7 −2.9 −3.4 −2.4 −3.7 −3.1 −2.8 −2.9 −3.4 −3.0 −3.8
CSAMERIC
−5.0 −3.9 −4.2 −4.5 −4.4 −4.3 −4.7 −5.5 −5.0 −5.9 −4.0 −3.3 −3.2 −4.0 −3.5 −3.4 −3.9 −6.0 −4.1 −6.0
CASIA
−3.2 −5.2 −4.5 −5.2 −4.7 −4.7 −4.7 −4.8 −4.5 −3.2 −2.5 −4.5 −3.6 −4.3 −3.9 −3.8 −4.1 −4.1 −3.8 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 192: For algorithm id3-003 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


232
Cross region FMR at threshold T = 37001.000 for algorithm id3_004, giving FMR(T) = 0.0001 globally.
−3.4 −6.0 −5.1 −5.9 −4.9 −5.2 −5.1 −5.1 −4.9 −3.0 −3.0 −6.0 −4.7 −5.4 −4.4 −4.6 −4.7 −4.8 −4.4 −2.7
SSAFRICA
−4.1 −4.8 −4.0 −5.0 −4.6 −4.1 −4.1 −4.4 −3.2 −4.6 −3.3 −4.0 −3.1 −4.3 −3.8 −3.2 −3.4 −3.9 −2.8 −4.0
SASIA
−4.4 −4.9 −4.2 −3.8 −5.2 −4.9 −5.1 −2.8 −4.3 −5.0 −3.7 −4.7 −3.4 −3.4 −4.4 −4.0 −4.3 −2.5 −3.7 −4.7
POLY
2019/10/16 12:43:37
−4.5 −4.5 −4.2 −5.7 −4.8 −4.1 −3.9 −5.0 −4.3 −5.4 −4.0 −3.7 −3.6 −5.0 −4.2 −3.5 −3.3 −4.9 −3.5 −4.4
NAFRICA log10 FMR
−4.3 −4.4 −3.8 −5.4 −4.4 −3.7 −3.9 −4.8 −3.8 −5.0 −3.4 −3.7 −2.9 −4.5 −3.5 −2.9 −3.1 −4.0 −3.0 −4.3
MEAST
−4.8 −4.4 −4.3 −5.6 −4.3 −4.4 −4.6 −5.2 −4.8 −5.1 −3.9 −3.8 −3.4 −4.9 −3.6 −3.6 −3.9 −4.5 −4.0 −4.3
EURO
−5.2 −4.3 −4.8 −3.6 −5.5 −5.5 −5.5 −3.9 −5.1 −5.7 −4.5 −3.7 −3.9 −3.0 −4.7 −4.6 −4.7 −3.5 −4.5 −5.1 −1
EASIA
−4.1 −4.4 −3.4 −4.9 −4.3 −4.0 −4.1 −4.2 −4.1 −4.8 −3.3 −3.7 −2.6 −4.1 −3.5 −3.1 −3.3 −3.6 −3.3 −4.1
FRVT
CSAMERIC
-
−5.2 −3.7 −4.5 −4.5 −4.4 −4.3 −4.5 −5.1 −5.0 −5.6 −4.7 −3.2 −3.7 −4.1 −3.7 −3.6 −4.2 −5.2 −4.2 −4.9
CASIA −2
−3.3 −5.5 −4.4 −5.4 −4.7 −4.7 −4.5 −4.6 −4.4 −3.3 −2.7 −5.0 −3.8 −4.8 −4.0 −4.0 −3.9 −4.1 −3.9 −2.8
CARIB

−3.1 −6.0 −4.9 −5.6 −4.7 −5.0 −4.8 −4.8 −4.6 −2.7 −2.8 −6.0 −4.5 −5.2 −4.3 −4.4 −4.4 −4.5 −4.2 −2.4
SSAFRICA
−4.0 −4.6 −3.9 −4.8 −4.5 −4.0 −4.0 −4.3 −3.0 −4.5 −3.2 −3.9 −3.0 −4.2 −3.7 −3.2 −3.3 −3.7 −2.6 −3.9
SASIA

−4
−4.2 −4.6 −4.0 −3.6 −5.0 −4.8 −4.9 −2.6 −4.0 −4.8 −3.6 −4.4 −3.3 −3.2 −4.3 −4.0 −4.1 −2.3 −3.6 −4.5
POLY
−4.2 −4.3 −4.0 −5.5 −4.5 −3.9 −3.6 −4.7 −4.1 −5.1 −3.8 −3.4 −3.3 −4.7 −4.0 −3.2 −3.1 −4.6 −3.4 −4.1
NAFRICA
-
−4.2 −4.2 −3.7 −5.3 −4.2 −3.6 −3.7 −4.7 −3.7 −4.8 −3.3 −3.6 −2.8 −4.4 −3.4 −2.8 −2.9 −4.0 −2.9 −4.2 −5
MEAST
−4.6 −4.2 −4.2 −5.5 −4.1 −4.3 −4.4 −5.1 −4.7 −4.9 −3.8 −3.6 −3.3 −4.8 −3.5 −3.5 −3.8 −4.4 −3.9 −4.2
EURO
−5.0 −4.1 −4.6 −3.3 −5.4 −5.4 −5.3 −3.6 −4.9 −5.5 −4.3 −3.5 −3.8 −2.8 −4.6 −4.5 −4.5 −3.2 −4.3 −4.9
−6
EASIA
VERIFICATION
−4.0 −4.2 −3.3 −4.7 −4.2 −3.9 −3.9 −4.0 −3.9 −4.6 −3.2 −3.6 −2.5 −4.0 −3.4 −3.0 −3.2 −3.4 −3.2 −4.0
CSAMERIC
−4.9 −3.5 −4.3 −4.3 −4.2 −4.1 −4.2 −4.8 −4.7 −5.5 −4.4 −3.0 −3.5 −3.8 −3.5 −3.4 −3.9 −4.9 −4.1 −4.9
CASIA
−3.1 −5.2 −4.2 −5.2 −4.5 −4.5 −4.2 −4.4 −4.2 −3.0 −2.6 −4.7 −3.6 −4.6 −3.9 −3.8 −3.6 −3.9 −3.7 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


233
Cross region FMR at threshold T = 3925.463 for algorithm idemia_004, giving FMR(T) = 0.0001 globally.
−3.2 −6.0 −5.1 −6.0 −4.7 −5.0 −4.9 −5.5 −4.8 −2.8 −2.6 −6.0 −4.5 −5.5 −4.2 −4.7 −4.5 −5.0 −4.3 −2.5
SSAFRICA
−4.2 −4.8 −4.2 −4.9 −4.9 −4.2 −4.2 −4.5 −3.2 −4.7 −3.4 −4.2 −3.4 −4.3 −4.2 −3.5 −3.6 −4.0 −2.8 −4.1
SASIA
−4.5 −4.6 −4.4 −3.6 −5.3 −5.1 −5.3 −2.8 −4.4 −5.3 −3.9 −4.3 −3.7 −3.2 −4.7 −4.4 −4.7 −2.5 −3.9 −4.9
POLY
2019/10/16 12:43:37
−4.6 −4.7 −4.3 −6.0 −5.0 −4.2 −4.1 −5.6 −4.3 −5.1 −4.0 −3.7 −3.6 −5.7 −4.2 −3.5 −3.6 −6.0 −3.6 −4.4
NAFRICA log10 FMR
−4.6 −4.5 −4.1 −5.6 −4.6 −3.9 −4.0 −5.0 −4.1 −5.2 −3.7 −3.9 −3.2 −4.8 −3.8 −3.1 −3.2 −4.3 −3.4 −4.7
MEAST
−4.8 −4.6 −4.6 −5.8 −4.5 −4.6 −4.7 −5.5 −5.1 −5.0 −4.0 −4.0 −3.8 −5.2 −3.9 −3.9 −4.1 −4.7 −4.4 −4.4
EURO
−5.4 −4.0 −4.9 −3.2 −5.5 −5.6 −5.7 −3.6 −5.0 −5.7 −4.6 −3.4 −4.1 −2.7 −4.8 −4.8 −4.9 −3.2 −4.5 −5.1 −1
EASIA
−4.2 −4.6 −3.6 −5.1 −4.6 −4.1 −4.2 −4.4 −4.2 −4.8 −3.3 −3.9 −2.8 −4.3 −3.8 −3.3 −3.4 −3.7 −3.5 −4.1
FRVT
CSAMERIC
-
−5.5 −3.6 −4.8 −4.0 −4.7 −4.4 −4.5 −4.7 −5.0 −5.8 −4.7 −3.2 −4.0 −3.6 −4.0 −3.7 −4.0 −4.4 −4.4 −5.2
CASIA −2
−3.0 −5.3 −4.4 −5.5 −4.5 −4.6 −4.5 −4.8 −4.5 −3.0 −2.4 −4.8 −3.7 −4.9 −3.9 −3.9 −3.9 −4.4 −3.9 −2.5
CARIB

−2.9 −6.0 −4.8 −5.8 −4.6 −4.9 −4.6 −5.3 −4.6 −2.6 −2.5 −6.0 −4.3 −5.4 −4.1 −4.6 −4.3 −4.8 −4.2 −2.3
SSAFRICA
−4.0 −4.6 −4.1 −4.7 −4.7 −4.1 −4.0 −4.3 −3.0 −4.5 −3.3 −4.0 −3.3 −4.2 −4.1 −3.5 −3.5 −3.9 −2.6 −3.9
SASIA

−4
−4.3 −4.3 −4.2 −3.3 −5.2 −4.9 −5.1 −2.5 −4.1 −5.0 −3.8 −4.0 −3.6 −3.0 −4.6 −4.3 −4.5 −2.2 −3.7 −4.6
POLY
−4.4 −4.4 −4.1 −6.0 −4.7 −4.0 −3.8 −5.3 −4.1 −4.8 −3.8 −3.4 −3.4 −5.4 −4.0 −3.4 −3.3 −6.0 −3.5 −4.1
NAFRICA
-
−4.4 −4.2 −3.9 −5.5 −4.4 −3.7 −3.8 −4.8 −3.9 −5.0 −3.5 −3.6 −3.1 −4.7 −3.7 −3.0 −3.1 −4.3 −3.2 −4.4 −5
MEAST
−4.6 −4.4 −4.4 −5.6 −4.3 −4.5 −4.6 −5.4 −4.9 −4.8 −3.9 −3.8 −3.7 −5.1 −3.7 −3.8 −4.1 −4.7 −4.3 −4.3
EURO
−5.2 −3.7 −4.8 −3.0 −5.3 −5.5 −5.6 −3.4 −4.8 −5.5 −4.5 −3.2 −4.0 −2.5 −4.7 −4.7 −4.9 −3.0 −4.3 −4.9
−6
EASIA
VERIFICATION
−4.0 −4.4 −3.5 −4.9 −4.4 −4.0 −4.0 −4.2 −4.0 −4.6 −3.3 −3.8 −2.7 −4.2 −3.7 −3.2 −3.2 −3.6 −3.4 −4.0
CSAMERIC
−5.2 −3.4 −4.5 −3.7 −4.4 −4.1 −4.2 −4.4 −4.7 −5.5 −4.4 −2.9 −3.8 −3.3 −3.8 −3.5 −3.7 −4.1 −4.2 −4.9
CASIA
−2.9 −5.0 −4.2 −5.3 −4.4 −4.4 −4.3 −4.5 −4.2 −2.8 −2.3 −4.5 −3.5 −4.7 −3.8 −3.7 −3.7 −4.2 −3.7 −2.4
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 194: For algorithm idemia-004 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


234
Cross region FMR at threshold T = 3764.961 for algorithm idemia_005, giving FMR(T) = 0.0001 globally.
−3.3 −6.0 −5.1 −6.0 −4.8 −5.1 −4.9 −5.3 −4.7 −2.9 −2.8 −6.0 −4.6 −5.6 −4.3 −4.5 −4.6 −5.1 −4.2 −2.5
SSAFRICA
−4.0 −4.7 −3.9 −5.1 −4.5 −3.9 −3.9 −4.4 −3.0 −4.5 −3.1 −3.9 −3.0 −4.4 −3.7 −3.1 −3.2 −3.9 −2.6 −3.8
SASIA
−4.5 −5.0 −4.4 −4.1 −5.4 −5.2 −5.1 −3.1 −4.3 −5.2 −3.9 −5.0 −3.7 −3.6 −4.6 −4.4 −4.4 −2.7 −3.8 −4.8
POLY
2019/10/16 12:43:37
−4.5 −4.3 −4.1 −5.8 −4.8 −4.0 −3.8 −5.3 −4.1 −4.9 −3.9 −3.4 −3.4 −5.2 −4.2 −3.3 −3.3 −6.0 −3.3 −4.4
NAFRICA log10 FMR
−4.2 −4.3 −3.8 −5.4 −4.4 −3.6 −3.8 −5.0 −3.8 −4.9 −3.3 −3.6 −2.9 −4.6 −3.5 −2.8 −2.9 −4.2 −2.9 −4.1
MEAST
−4.6 −4.5 −4.3 −5.9 −4.4 −4.4 −4.5 −5.5 −4.7 −4.9 −3.8 −3.9 −3.4 −5.1 −3.7 −3.6 −3.7 −4.7 −3.9 −4.2
EURO
−5.5 −4.6 −5.2 −3.9 −5.8 −5.6 −5.8 −4.1 −5.2 −5.9 −4.7 −4.1 −4.3 −3.3 −5.1 −4.8 −4.9 −3.7 −4.7 −5.2 −1
EASIA
−4.0 −4.4 −3.5 −5.2 −4.4 −3.9 −4.0 −4.4 −3.9 −4.7 −3.2 −3.7 −2.6 −4.3 −3.5 −3.0 −3.1 −3.7 −3.2 −4.0
FRVT
CSAMERIC
-
−5.2 −3.9 −4.6 −4.7 −4.4 −4.2 −4.3 −5.5 −5.0 −5.9 −4.3 −3.4 −3.7 −4.3 −3.7 −3.5 −4.4 −5.2 −4.4 −6.0
CASIA −2
−3.1 −5.2 −4.4 −5.6 −4.5 −4.6 −4.5 −4.9 −4.4 −3.1 −2.5 −4.5 −3.7 −5.0 −3.9 −3.9 −3.8 −4.3 −3.8 −2.6
CARIB

−3.0 −6.0 −4.8 −5.9 −4.6 −4.8 −4.7 −5.0 −4.5 −2.6 −2.6 −6.0 −4.3 −5.4 −4.2 −4.3 −4.4 −4.9 −4.0 −2.3
SSAFRICA
−3.8 −4.5 −3.8 −4.9 −4.4 −3.8 −3.8 −4.2 −2.8 −4.3 −3.0 −3.8 −2.9 −4.3 −3.7 −3.1 −3.1 −3.7 −2.4 −3.7
SASIA

−4
−4.3 −4.7 −4.2 −3.8 −5.2 −5.1 −4.9 −2.8 −4.1 −4.9 −3.7 −4.7 −3.5 −3.4 −4.5 −4.5 −4.1 −2.4 −3.6 −4.5
POLY
−4.2 −4.1 −3.9 −5.6 −4.6 −3.8 −3.5 −5.0 −3.9 −4.6 −3.7 −3.1 −3.2 −5.0 −4.1 −3.2 −3.0 −6.0 −3.2 −4.1
NAFRICA
-
−4.1 −4.0 −3.7 −5.3 −4.2 −3.4 −3.6 −4.8 −3.6 −4.7 −3.2 −3.4 −2.8 −4.5 −3.4 −2.7 −2.8 −4.1 −2.9 −4.0 −5
MEAST
−4.5 −4.2 −4.2 −5.8 −4.1 −4.2 −4.3 −5.4 −4.6 −4.7 −3.7 −3.7 −3.3 −5.0 −3.5 −3.5 −3.7 −4.6 −3.9 −4.1
EURO
−5.3 −4.4 −5.0 −3.6 −5.7 −5.6 −5.7 −3.8 −5.1 −5.7 −4.6 −3.9 −4.2 −3.1 −5.0 −4.7 −4.9 −3.4 −4.6 −5.1
−6
EASIA
VERIFICATION
−3.9 −4.3 −3.3 −5.0 −4.2 −3.8 −3.8 −4.2 −3.8 −4.5 −3.1 −3.6 −2.5 −4.2 −3.4 −3.0 −3.0 −3.6 −3.1 −4.0
CSAMERIC
−4.9 −3.6 −4.3 −4.5 −4.2 −4.0 −4.0 −5.2 −4.7 −5.6 −4.1 −3.1 −3.6 −4.0 −3.5 −3.3 −4.4 −4.9 −4.2 −6.0
CASIA
−3.0 −4.9 −4.2 −5.4 −4.3 −4.3 −4.2 −4.6 −4.1 −2.9 −2.4 −4.2 −3.5 −4.8 −3.8 −3.7 −3.7 −4.1 −3.6 −2.5
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


235
Cross region FMR at threshold T = 0.760 for algorithm iit_000, giving FMR(T) = 0.0001 globally.
−4.5 −6.0 −6.0 −6.0 −6.0 −5.9 −6.0 −6.0 −5.7 −4.0 −4.1 −6.0 −5.5 −6.0 −5.6 −5.3 −6.0 −5.6 −5.3 −3.6
SSAFRICA
−5.1 −5.1 −4.9 −4.8 −5.5 −4.7 −4.7 −4.8 −3.5 −5.4 −4.6 −4.8 −4.3 −4.3 −5.0 −4.2 −4.2 −4.5 −3.2 −5.1
SASIA
−5.1 −4.6 −4.9 −3.8 −5.7 −5.6 −6.0 −3.3 −4.8 −5.8 −4.6 −4.3 −4.4 −3.4 −5.3 −5.5 −6.0 −3.0 −4.7 −6.0
POLY
2019/10/16 12:43:37
−5.1 −5.0 −4.8 −5.7 −5.2 −4.6 −4.4 −5.2 −4.6 −5.5 −4.7 −4.0 −4.1 −5.2 −4.8 −4.1 −4.3 −4.9 −4.3 −4.9
NAFRICA log10 FMR
−5.1 −4.8 −4.7 −5.9 −4.8 −4.2 −4.4 −5.3 −4.6 −5.9 −4.4 −4.2 −4.0 −5.4 −4.4 −3.6 −3.6 −4.8 −4.0 −5.1
MEAST
−5.4 −4.7 −5.0 −5.3 −4.7 −4.9 −5.1 −5.5 −5.5 −6.0 −4.8 −4.3 −4.4 −4.9 −4.2 −4.4 −4.6 −5.1 −5.0 −5.7
EURO
−5.4 −3.7 −4.9 −2.8 −5.2 −5.5 −6.0 −3.6 −4.9 −5.6 −4.9 −3.2 −4.2 −2.3 −4.6 −5.0 −5.4 −3.2 −4.6 −4.9 −1
EASIA
−5.0 −4.8 −4.3 −5.0 −5.0 −4.8 −4.9 −4.8 −4.8 −5.7 −4.4 −4.3 −3.7 −4.4 −4.5 −4.2 −4.2 −4.2 −4.3 −5.2
FRVT
CSAMERIC
-
−5.3 −3.6 −4.7 −3.6 −4.7 −4.6 −4.5 −4.3 −5.1 −6.0 −4.7 −3.2 −4.1 −3.3 −4.2 −4.0 −4.4 −4.2 −4.4 −6.0
CASIA −2
−4.4 −5.3 −5.0 −5.8 −5.2 −5.0 −4.9 −5.1 −5.0 −4.4 −3.8 −4.8 −4.4 −5.4 −4.7 −4.5 −4.4 −4.8 −4.5 −4.1
CARIB

−4.3 −6.0 −5.8 −6.0 −5.8 −5.6 −6.0 −5.7 −5.4 −3.7 −4.0 −6.0 −5.2 −5.9 −5.6 −5.1 −6.0 −5.3 −5.0 −3.3
SSAFRICA
−4.8 −4.8 −4.7 −4.6 −5.2 −4.5 −4.5 −4.6 −3.3 −5.2 −4.4 −4.5 −4.2 −4.1 −4.8 −4.0 −4.1 −4.3 −3.0 −4.9
SASIA

−4
−4.9 −4.4 −4.7 −3.5 −5.4 −5.3 −5.8 −3.1 −4.6 −5.6 −4.5 −4.1 −4.2 −3.2 −5.0 −5.2 −6.0 −2.8 −4.4 −6.0
POLY
−4.9 −4.7 −4.5 −5.4 −4.9 −4.3 −4.1 −5.0 −4.3 −5.4 −4.7 −3.7 −3.9 −5.1 −4.6 −3.8 −4.1 −4.6 −4.1 −4.6
NAFRICA
-
−4.9 −4.6 −4.5 −5.7 −4.5 −4.0 −4.2 −5.2 −4.3 −5.7 −4.2 −3.9 −3.8 −5.3 −4.1 −3.4 −3.4 −4.7 −3.8 −5.1 −5
MEAST
−5.2 −4.4 −4.8 −5.1 −4.4 −4.7 −4.8 −5.4 −5.2 −6.0 −4.6 −4.0 −4.2 −4.7 −3.9 −4.1 −4.4 −5.0 −4.8 −5.4
EURO
−5.3 −3.5 −4.7 −2.6 −5.0 −5.4 −6.0 −3.4 −4.7 −5.3 −4.8 −3.0 −4.1 −2.1 −4.5 −4.9 −5.1 −3.0 −4.4 −4.7
−6
EASIA
VERIFICATION
−4.8 −4.6 −4.1 −4.8 −4.8 −4.5 −4.6 −4.6 −4.6 −5.5 −4.2 −4.1 −3.5 −4.3 −4.3 −4.0 −4.0 −4.1 −4.1 −4.9
CSAMERIC
−5.0 −3.4 −4.5 −3.4 −4.4 −4.3 −4.2 −4.1 −4.8 −6.0 −4.4 −3.0 −3.8 −3.1 −3.9 −3.7 −4.1 −3.9 −4.2 −6.0
CASIA
−4.2 −5.0 −4.7 −5.5 −5.0 −4.7 −4.7 −4.9 −4.7 −4.2 −3.6 −4.5 −4.2 −5.1 −4.4 −4.3 −4.1 −4.5 −4.3 −3.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 196: For algorithm iit-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


236
Cross region FMR at threshold T = 0.691 for algorithm iit_001, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.3 −5.8 −5.0 −5.3 −5.1 −5.3 −5.0 −3.1 −3.1 −6.0 −4.9 −5.5 −4.5 −4.8 −5.3 −5.1 −4.6 −2.8
SSAFRICA
−4.2 −4.7 −3.9 −4.9 −4.6 −4.0 −4.1 −4.4 −3.3 −4.8 −3.3 −3.9 −3.0 −4.1 −3.8 −3.2 −3.3 −3.8 −2.7 −4.2
SASIA
−4.6 −4.7 −4.3 −3.8 −5.2 −5.1 −5.1 −2.9 −4.5 −5.1 −4.0 −4.1 −3.5 −3.3 −4.4 −4.3 −4.4 −2.5 −3.9 −4.6
POLY
2019/10/16 12:43:37
−4.5 −4.5 −4.2 −5.8 −4.9 −4.0 −3.9 −5.6 −4.3 −5.1 −4.3 −3.6 −3.6 −5.2 −4.2 −3.4 −3.5 −6.0 −3.7 −4.4
NAFRICA log10 FMR
−4.3 −4.4 −3.9 −5.2 −4.4 −3.7 −3.9 −4.8 −3.8 −5.0 −3.4 −3.7 −2.9 −4.4 −3.5 −2.9 −3.0 −4.0 −2.9 −4.3
MEAST
−4.9 −4.5 −4.4 −5.6 −4.5 −4.6 −4.7 −5.3 −4.8 −5.2 −4.1 −3.9 −3.6 −4.9 −3.8 −3.7 −3.9 −4.6 −4.0 −4.6
EURO
−5.3 −4.2 −4.7 −3.4 −5.3 −5.6 −5.7 −3.8 −5.0 −5.5 −4.5 −3.5 −3.9 −2.8 −4.6 −4.7 −5.1 −3.3 −4.5 −4.9 −1
EASIA
−4.3 −4.4 −3.5 −4.8 −4.5 −4.0 −4.0 −4.3 −4.1 −5.0 −3.4 −3.7 −2.6 −4.0 −3.7 −3.2 −3.2 −3.6 −3.3 −4.3
FRVT
CSAMERIC
-
−5.3 −3.7 −4.3 −4.4 −4.5 −4.3 −4.5 −4.8 −4.9 −6.0 −4.4 −3.2 −3.3 −4.0 −3.7 −3.4 −4.0 −4.4 −4.0 −6.0
CASIA −2
−3.4 −5.5 −4.6 −5.5 −4.8 −4.9 −4.7 −4.8 −4.6 −3.4 −2.7 −6.0 −4.0 −4.8 −4.1 −4.2 −4.1 −4.4 −4.2 −2.9
CARIB

−3.3 −6.0 −5.1 −5.6 −4.8 −5.0 −4.8 −5.0 −4.8 −2.8 −2.9 −6.0 −4.6 −5.2 −4.3 −4.6 −5.0 −4.8 −4.3 −2.5
SSAFRICA
−4.0 −4.6 −3.8 −4.7 −4.5 −3.9 −4.0 −4.2 −3.1 −4.6 −3.3 −3.9 −2.9 −4.1 −3.8 −3.2 −3.3 −3.7 −2.6 −4.1
SASIA

−4
−4.4 −4.5 −4.1 −3.5 −5.0 −4.9 −4.8 −2.7 −4.2 −4.8 −3.8 −3.9 −3.4 −3.1 −4.3 −4.2 −4.2 −2.3 −3.7 −4.4
POLY
−4.3 −4.2 −4.0 −5.5 −4.7 −3.8 −3.6 −5.3 −4.1 −4.8 −4.0 −3.3 −3.4 −5.0 −4.0 −3.2 −3.2 −6.0 −3.6 −4.1
NAFRICA
-
−4.2 −4.2 −3.7 −5.1 −4.3 −3.6 −3.7 −4.7 −3.7 −4.9 −3.3 −3.5 −2.8 −4.3 −3.4 −2.7 −2.9 −3.9 −2.8 −4.3 −5
MEAST
−4.7 −4.3 −4.3 −5.4 −4.2 −4.4 −4.5 −5.2 −4.7 −5.0 −4.0 −3.7 −3.5 −4.7 −3.7 −3.6 −3.8 −4.5 −3.9 −4.4
EURO
−5.1 −4.0 −4.6 −3.2 −5.2 −5.5 −5.6 −3.6 −4.9 −5.3 −4.3 −3.4 −3.8 −2.6 −4.4 −4.6 −4.9 −3.1 −4.3 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.7 −4.3 −3.9 −3.9 −4.1 −3.9 −4.8 −3.3 −3.6 −2.5 −3.9 −3.5 −3.1 −3.1 −3.5 −3.2 −4.2
CSAMERIC
−5.0 −3.5 −4.2 −4.1 −4.3 −4.1 −4.3 −4.6 −4.7 −6.0 −4.1 −3.0 −3.2 −3.7 −3.6 −3.3 −3.9 −4.4 −3.9 −6.0
CASIA
−3.2 −5.2 −4.4 −5.2 −4.6 −4.6 −4.5 −4.5 −4.4 −3.2 −2.6 −6.0 −3.8 −4.6 −3.9 −4.0 −3.8 −4.1 −3.9 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


237
Cross region FMR at threshold T = 0.926 for algorithm imagus_000, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.2 −6.0 −4.9 −5.2 −5.0 −5.4 −4.9 −3.1 −3.0 −6.0 −4.6 −5.6 −4.5 −4.8 −4.8 −5.1 −4.5 −2.8
SSAFRICA
−4.2 −4.7 −4.0 −4.9 −4.6 −4.0 −4.1 −4.4 −3.1 −4.7 −3.4 −3.9 −3.1 −4.1 −3.8 −3.3 −3.5 −3.8 −2.7 −4.1
SASIA
−4.4 −4.7 −4.2 −3.8 −5.1 −4.9 −5.0 −2.9 −4.3 −5.0 −3.9 −4.4 −3.5 −3.3 −4.4 −4.2 −4.4 −2.5 −3.8 −4.5
POLY
2019/10/16 12:43:37
−4.5 −4.5 −4.2 −5.8 −4.8 −4.1 −3.9 −5.3 −4.3 −5.3 −3.8 −3.7 −3.5 −5.2 −4.3 −3.5 −3.6 −4.9 −3.6 −4.6
NAFRICA log10 FMR
−4.3 −4.2 −3.8 −5.1 −4.4 −3.6 −3.8 −4.6 −3.9 −4.9 −3.4 −3.5 −2.9 −4.2 −3.5 −2.8 −3.0 −3.8 −3.1 −4.1
MEAST
−4.8 −4.5 −4.4 −5.6 −4.4 −4.5 −4.7 −5.2 −4.8 −5.2 −4.1 −3.9 −3.5 −4.8 −3.8 −3.8 −4.0 −4.5 −4.0 −4.7
EURO
−5.4 −4.1 −4.9 −3.4 −5.5 −5.7 −5.9 −3.8 −5.1 −5.8 −4.6 −3.5 −4.1 −2.8 −4.7 −4.9 −5.1 −3.3 −4.5 −5.0 −1
EASIA
−4.2 −4.4 −3.5 −4.8 −4.4 −4.0 −4.1 −4.2 −4.1 −4.9 −3.4 −3.7 −2.7 −4.1 −3.6 −3.2 −3.3 −3.5 −3.3 −4.2
FRVT
CSAMERIC
-
−4.9 −3.7 −4.3 −4.2 −4.3 −4.2 −4.4 −4.9 −4.6 −5.6 −4.1 −3.2 −3.4 −3.8 −3.6 −3.4 −4.0 −4.7 −3.7 −4.6
CASIA −2
−3.3 −5.2 −4.5 −5.6 −4.7 −4.7 −4.6 −4.8 −4.6 −3.3 −2.7 −4.8 −3.9 −4.9 −4.1 −4.0 −4.0 −4.4 −4.0 −2.9
CARIB

−3.2 −5.7 −4.9 −5.9 −4.7 −4.9 −4.8 −5.2 −4.7 −2.8 −2.8 −6.0 −4.4 −5.5 −4.4 −4.6 −4.7 −4.8 −4.2 −2.5
SSAFRICA
−4.0 −4.5 −3.8 −4.7 −4.5 −3.9 −3.9 −4.2 −2.9 −4.5 −3.3 −3.7 −3.0 −4.0 −3.8 −3.2 −3.4 −3.7 −2.6 −4.0
SASIA

−4
−4.2 −4.4 −4.0 −3.5 −4.9 −4.8 −4.8 −2.6 −4.1 −4.8 −3.7 −4.2 −3.3 −3.1 −4.2 −4.2 −4.1 −2.3 −3.6 −4.4
POLY
−4.3 −4.2 −4.0 −5.5 −4.6 −3.8 −3.7 −5.0 −4.1 −5.0 −3.5 −3.4 −3.3 −5.0 −4.1 −3.2 −3.3 −4.6 −3.5 −4.3
NAFRICA
-
−4.2 −4.1 −3.7 −5.0 −4.2 −3.4 −3.6 −4.5 −3.7 −4.7 −3.3 −3.4 −2.8 −4.2 −3.4 −2.7 −2.9 −3.8 −3.0 −3.9 −5
MEAST
−4.7 −4.2 −4.2 −5.4 −4.1 −4.3 −4.5 −5.1 −4.7 −4.9 −3.9 −3.7 −3.5 −4.7 −3.6 −3.6 −3.9 −4.3 −3.9 −4.5
EURO
−5.2 −3.9 −4.7 −3.2 −5.3 −5.6 −5.6 −3.5 −4.9 −5.6 −4.5 −3.3 −4.0 −2.7 −4.6 −4.7 −4.9 −3.1 −4.4 −4.8
−6
EASIA
VERIFICATION
−4.0 −4.2 −3.3 −4.7 −4.2 −3.9 −3.9 −3.9 −3.9 −4.7 −3.3 −3.6 −2.6 −3.9 −3.5 −3.1 −3.2 −3.4 −3.2 −4.1
CSAMERIC
−4.7 −3.5 −4.1 −4.0 −4.1 −4.0 −4.2 −4.6 −4.5 −5.5 −4.0 −2.9 −3.3 −3.5 −3.4 −3.3 −4.4 −4.4 −3.6 −4.4
CASIA
−3.1 −4.9 −4.3 −5.3 −4.5 −4.5 −4.4 −4.5 −4.3 −3.1 −2.6 −4.5 −3.7 −4.7 −3.9 −3.8 −3.8 −4.2 −3.8 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 198: For algorithm imagus-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


238
Cross region FMR at threshold T = 1.375 for algorithm imperial_000, giving FMR(T) = 0.0001 globally.
−3.3 −5.7 −4.8 −5.8 −4.8 −4.9 −4.6 −4.9 −4.4 −2.9 −2.8 −5.3 −4.3 −5.3 −4.3 −4.3 −4.1 −4.6 −3.9 −2.5
SSAFRICA
−4.0 −4.7 −4.0 −5.1 −4.6 −3.9 −3.9 −4.4 −3.0 −4.4 −3.3 −4.2 −3.3 −4.6 −3.9 −3.2 −3.3 −4.0 −2.6 −3.8
SASIA
−4.3 −5.0 −4.3 −4.2 −5.3 −5.2 −4.9 −3.0 −4.2 −4.8 −3.8 −4.3 −3.8 −3.8 −5.0 −4.7 −4.2 −2.7 −3.7 −4.4
POLY
2019/10/16 12:43:37
−4.2 −4.3 −4.0 −5.7 −4.5 −3.8 −3.6 −5.1 −3.9 −4.7 −3.4 −3.5 −3.3 −4.9 −3.9 −3.1 −3.1 −4.3 −3.1 −4.4
NAFRICA log10 FMR
−4.2 −4.1 −3.9 −5.5 −4.3 −3.6 −3.7 −5.2 −3.7 −4.8 −3.4 −3.6 −3.1 −4.7 −3.5 −2.8 −3.0 −4.7 −3.0 −4.1
MEAST
−4.5 −4.4 −4.3 −6.0 −4.2 −4.3 −4.4 −5.3 −4.6 −4.9 −3.8 −3.9 −3.6 −5.4 −3.6 −3.7 −3.8 −4.7 −4.0 −4.2
EURO
−5.4 −5.0 −5.3 −4.3 −6.0 −5.8 −5.9 −4.2 −5.2 −5.7 −4.8 −4.7 −4.7 −3.8 −5.5 −5.1 −5.1 −3.9 −4.8 −5.1 −1
EASIA
−4.0 −4.5 −3.4 −5.2 −4.4 −4.0 −4.0 −4.3 −3.9 −4.6 −3.2 −3.9 −2.8 −4.6 −3.7 −3.3 −3.3 −3.8 −3.3 −4.0
FRVT
CSAMERIC
-
−4.8 −3.8 −4.4 −5.0 −4.3 −4.1 −4.1 −5.3 −4.7 −5.8 −4.2 −3.3 −3.7 −4.4 −3.7 −3.5 −3.9 −4.7 −4.1 −5.2
CASIA −2
−3.1 −4.9 −4.2 −5.3 −4.4 −4.3 −4.1 −4.5 −4.1 −3.2 −2.5 −4.7 −3.5 −4.7 −3.8 −3.7 −3.5 −4.0 −3.6 −2.7
CARIB

−3.0 −5.5 −4.6 −5.5 −4.6 −4.6 −4.3 −4.6 −4.2 −2.6 −2.6 −5.0 −4.1 −5.1 −4.1 −4.1 −3.9 −4.3 −3.7 −2.3
SSAFRICA
−3.8 −4.4 −3.8 −4.9 −4.4 −3.7 −3.7 −4.1 −2.7 −4.2 −3.1 −4.0 −3.1 −4.4 −3.8 −3.1 −3.2 −3.7 −2.4 −3.7
SASIA

−4
−4.0 −4.7 −4.1 −3.9 −5.1 −4.9 −4.6 −2.8 −3.9 −4.5 −3.5 −4.0 −3.6 −3.6 −4.8 −4.4 −4.0 −2.4 −3.4 −4.1
POLY
−3.9 −4.1 −3.8 −5.4 −4.3 −3.6 −3.3 −4.8 −3.7 −4.4 −3.2 −3.2 −3.1 −4.7 −3.7 −3.0 −2.8 −4.1 −3.0 −4.1
NAFRICA
-
−4.0 −3.9 −3.7 −5.3 −4.1 −3.3 −3.5 −5.0 −3.6 −4.6 −3.2 −3.4 −2.9 −4.6 −3.4 −2.6 −2.8 −4.5 −2.9 −4.0 −5
MEAST
−4.3 −4.1 −4.1 −5.8 −4.0 −4.1 −4.1 −5.1 −4.5 −4.7 −3.7 −3.6 −3.5 −5.3 −3.4 −3.5 −3.6 −4.5 −3.9 −4.1
EURO
−5.2 −4.7 −5.1 −4.0 −5.9 −5.6 −5.6 −3.9 −5.0 −5.4 −4.6 −4.5 −4.5 −3.5 −5.3 −4.9 −4.9 −3.6 −4.5 −4.9
−6
EASIA
VERIFICATION
−3.8 −4.2 −3.2 −5.0 −4.1 −3.8 −3.7 −4.1 −3.7 −4.4 −3.1 −3.7 −2.6 −4.4 −3.5 −3.1 −3.1 −3.6 −3.2 −3.8
CSAMERIC
−4.5 −3.5 −4.1 −4.7 −4.0 −3.8 −3.8 −5.0 −4.4 −5.5 −3.9 −3.0 −3.5 −4.2 −3.4 −3.3 −3.6 −4.4 −3.9 −4.9
CASIA
−2.9 −4.6 −3.9 −5.1 −4.2 −4.1 −3.9 −4.2 −3.8 −3.0 −2.3 −4.4 −3.3 −4.6 −3.6 −3.5 −3.3 −3.8 −3.3 −2.5
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 199: For algorithm imperial-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


239
Cross region FMR at threshold T = 1.358 for algorithm imperial_002, giving FMR(T) = 0.0001 globally.
−3.8 −5.7 −5.3 −5.5 −5.4 −5.4 −5.1 −5.0 −5.0 −3.4 −3.4 −5.0 −4.9 −5.1 −4.9 −4.8 −5.3 −4.7 −4.5 −3.1
SSAFRICA
−4.5 −4.9 −4.4 −4.9 −5.0 −4.4 −4.4 −4.5 −3.3 −4.9 −3.8 −4.3 −3.5 −4.3 −4.3 −3.7 −3.7 −4.1 −2.9 −4.5
SASIA
−4.4 −4.4 −4.2 −3.6 −5.2 −5.1 −5.2 −2.8 −4.4 −4.8 −3.8 −4.1 −3.6 −3.1 −4.6 −4.6 −4.6 −2.4 −3.9 −4.4
POLY
2019/10/16 12:43:37
−4.6 −4.5 −4.3 −5.5 −4.9 −4.1 −3.7 −5.3 −4.4 −5.1 −3.9 −3.7 −3.6 −5.2 −4.4 −3.5 −3.3 −4.9 −3.8 −4.9
NAFRICA log10 FMR
−4.6 −4.5 −4.2 −5.6 −4.7 −3.9 −4.0 −5.3 −4.2 −5.2 −3.8 −3.9 −3.3 −4.9 −3.9 −3.1 −3.2 −4.9 −3.4 −4.5
MEAST
−5.0 −4.6 −4.6 −5.5 −4.5 −4.8 −4.8 −5.3 −5.1 −5.5 −4.3 −4.1 −3.9 −5.0 −4.0 −4.1 −4.2 −4.7 −4.4 −4.9
EURO
−5.1 −3.9 −4.7 −3.1 −5.3 −5.6 −5.5 −3.6 −5.0 −5.3 −4.5 −3.4 −4.0 −2.6 −4.7 −4.8 −5.0 −3.1 −4.5 −4.7 −1
EASIA
−4.3 −4.6 −3.5 −4.8 −4.6 −4.3 −4.2 −4.2 −4.4 −5.0 −3.6 −4.0 −2.9 −4.2 −3.9 −3.5 −3.5 −3.7 −3.7 −4.5
FRVT
CSAMERIC
-
−5.3 −3.5 −4.7 −4.1 −4.6 −4.4 −4.5 −4.5 −5.2 −5.9 −4.5 −3.1 −4.0 −3.6 −3.9 −3.8 −4.1 −4.1 −4.7 −5.2
CASIA −2
−3.6 −5.3 −4.5 −5.2 −4.9 −4.8 −4.6 −4.6 −4.7 −3.8 −3.0 −4.7 −3.9 −4.7 −4.3 −4.2 −4.0 −4.1 −4.2 −3.2
CARIB

−3.6 −5.4 −5.0 −5.2 −5.2 −5.1 −4.8 −4.8 −4.7 −3.2 −3.1 −4.7 −4.6 −4.8 −4.7 −4.5 −5.0 −4.4 −4.3 −2.8
SSAFRICA
−4.3 −4.6 −4.2 −4.6 −4.9 −4.2 −4.2 −4.2 −3.1 −4.7 −3.7 −4.1 −3.4 −4.1 −4.3 −3.6 −3.6 −3.9 −2.7 −4.2
SASIA

−4
−4.1 −4.1 −3.9 −3.3 −4.9 −4.9 −5.0 −2.5 −4.1 −4.5 −3.6 −3.8 −3.4 −2.9 −4.4 −4.3 −4.5 −2.2 −3.7 −4.1
POLY
−4.3 −4.2 −4.0 −5.3 −4.7 −3.8 −3.4 −5.0 −4.1 −4.9 −3.7 −3.4 −3.4 −5.0 −4.2 −3.3 −3.0 −4.6 −3.5 −6.0
NAFRICA
-
−4.5 −4.2 −4.0 −5.4 −4.5 −3.7 −3.7 −5.1 −4.0 −5.1 −3.7 −3.7 −3.2 −4.8 −3.7 −3.0 −3.0 −4.9 −3.3 −4.4 −5
MEAST
−4.8 −4.3 −4.4 −5.3 −4.3 −4.5 −4.5 −5.0 −4.9 −5.3 −4.2 −3.8 −3.7 −4.8 −3.7 −3.9 −4.0 −4.4 −4.3 −4.7
EURO
−4.9 −3.7 −4.5 −2.9 −5.1 −5.4 −5.3 −3.3 −4.7 −5.1 −4.3 −3.2 −3.9 −2.4 −4.5 −4.7 −4.8 −2.9 −4.3 −4.5
−6
EASIA
VERIFICATION
−4.1 −4.4 −3.3 −4.5 −4.3 −4.1 −4.0 −4.0 −4.2 −4.8 −3.4 −3.8 −2.7 −4.0 −3.7 −3.4 −3.3 −3.4 −3.5 −4.3
CSAMERIC
−5.0 −3.3 −4.4 −3.8 −4.3 −4.1 −4.2 −4.2 −4.9 −5.6 −4.2 −2.9 −3.8 −3.3 −3.7 −3.6 −3.8 −3.8 −4.4 −4.9
CASIA
−3.4 −5.0 −4.3 −5.0 −4.7 −4.6 −4.3 −4.3 −4.4 −3.5 −2.8 −4.4 −3.6 −4.4 −4.1 −4.0 −3.7 −3.8 −3.9 −3.0
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


240
Cross region FMR at threshold T = 1.427 for algorithm incode_003, giving FMR(T) = 0.0001 globally.
−3.3 −5.6 −5.0 −5.7 −4.8 −5.0 −5.0 −5.2 −4.7 −2.9 −2.9 −4.8 −4.6 −5.3 −4.4 −4.7 −4.7 −4.9 −4.3 −2.6
SSAFRICA
−4.1 −4.6 −3.9 −5.1 −4.6 −4.0 −4.0 −4.4 −3.1 −4.6 −3.3 −3.9 −3.0 −4.4 −3.8 −3.3 −3.3 −3.8 −2.7 −3.9
SASIA
−4.4 −5.0 −4.3 −4.1 −5.3 −5.1 −5.1 −3.0 −4.3 −4.8 −3.9 −5.0 −3.7 −3.7 −4.6 −4.5 −5.1 −2.7 −3.8 −4.5
POLY
2019/10/16 12:43:37
−4.7 −4.6 −4.3 −5.7 −4.9 −4.2 −3.9 −5.3 −4.3 −4.9 −4.1 −3.6 −3.5 −5.0 −4.2 −3.6 −3.3 −4.6 −3.5 −4.3
NAFRICA log10 FMR
−4.3 −4.4 −3.8 −5.4 −4.4 −3.7 −3.8 −4.8 −3.8 −4.9 −3.3 −3.8 −2.9 −4.5 −3.5 −2.9 −3.0 −4.0 −2.9 −4.1
MEAST
−4.7 −4.5 −4.3 −5.6 −4.4 −4.5 −4.6 −5.3 −4.8 −5.1 −4.0 −3.9 −3.4 −4.8 −3.6 −3.6 −3.9 −4.6 −4.0 −4.5
EURO
−5.2 −4.7 −5.0 −4.0 −5.7 −5.7 −5.7 −4.1 −5.2 −5.5 −4.5 −4.1 −4.2 −3.4 −4.9 −4.7 −5.0 −3.7 −4.6 −4.8 −1
EASIA
−4.1 −4.4 −3.4 −5.0 −4.4 −4.0 −4.0 −4.2 −4.0 −4.8 −3.3 −3.7 −2.6 −4.3 −3.5 −3.1 −3.2 −3.6 −3.2 −4.1
FRVT
CSAMERIC
-
−5.2 −3.8 −4.4 −4.9 −4.4 −4.3 −4.4 −5.1 −4.9 −5.5 −4.4 −3.2 −3.4 −4.4 −3.6 −3.5 −3.9 −4.5 −4.2 −4.9
CASIA −2
−3.3 −5.1 −4.4 −5.5 −4.7 −4.7 −4.6 −4.7 −4.4 −3.2 −2.7 −4.6 −3.8 −4.9 −4.1 −4.1 −4.1 −4.4 −3.9 −2.8
CARIB

−3.0 −5.4 −4.8 −5.5 −4.6 −4.8 −4.7 −4.9 −4.5 −2.6 −2.7 −4.5 −4.3 −5.2 −4.2 −4.4 −4.4 −4.8 −4.0 −2.3
SSAFRICA
−3.9 −4.5 −3.8 −4.9 −4.5 −3.9 −3.9 −4.2 −2.9 −4.4 −3.2 −3.8 −3.0 −4.3 −3.8 −3.2 −3.3 −3.7 −2.5 −3.8
SASIA

−4
−4.2 −4.8 −4.1 −3.9 −5.1 −5.0 −4.9 −2.8 −4.0 −4.6 −3.7 −4.7 −3.5 −3.5 −4.5 −4.4 −4.8 −2.5 −3.5 −4.3
POLY
−4.4 −4.3 −4.0 −5.5 −4.7 −3.9 −3.6 −5.0 −4.1 −4.7 −3.8 −3.3 −3.3 −4.8 −4.0 −3.4 −3.1 −4.6 −3.4 −4.1
NAFRICA
-
−4.1 −4.2 −3.7 −5.2 −4.2 −3.5 −3.6 −4.7 −3.7 −4.8 −3.2 −3.6 −2.8 −4.4 −3.4 −2.7 −2.9 −3.9 −2.9 −4.1 −5
MEAST
−4.6 −4.2 −4.1 −5.6 −4.1 −4.3 −4.5 −5.2 −4.6 −4.9 −3.8 −3.7 −3.3 −4.8 −3.5 −3.6 −3.9 −4.5 −3.9 −4.4
EURO
−5.0 −4.5 −4.9 −3.8 −5.6 −5.5 −5.7 −3.9 −5.0 −5.3 −4.3 −4.0 −4.1 −3.3 −4.8 −4.6 −5.3 −3.5 −4.5 −4.7
−6
EASIA
VERIFICATION
−3.9 −4.2 −3.2 −4.9 −4.2 −3.9 −3.8 −4.0 −3.8 −4.5 −3.2 −3.5 −2.5 −4.1 −3.4 −3.1 −3.1 −3.4 −3.1 −4.0
CSAMERIC
−4.9 −3.6 −4.2 −4.6 −4.2 −4.0 −4.1 −4.8 −4.7 −5.2 −4.1 −3.0 −3.3 −4.1 −3.4 −3.3 −3.8 −4.3 −4.0 −4.9
CASIA
−3.0 −4.8 −4.2 −5.3 −4.5 −4.5 −4.3 −4.4 −4.1 −3.0 −2.6 −4.3 −3.6 −4.7 −4.0 −3.9 −3.9 −4.1 −3.6 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 201: For algorithm incode-003 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


241
Cross region FMR at threshold T = 1.398 for algorithm incode_004, giving FMR(T) = 0.0001 globally.
−3.4 −6.0 −5.1 −5.8 −4.9 −5.2 −4.9 −5.2 −4.8 −3.0 −3.0 −6.0 −4.7 −5.4 −4.5 −4.7 −4.7 −5.3 −4.4 −2.7
SSAFRICA
−4.1 −4.8 −4.0 −5.1 −4.7 −4.0 −4.0 −4.4 −3.1 −4.6 −3.4 −4.1 −3.1 −4.6 −3.9 −3.3 −3.4 −4.0 −2.7 −4.1
SASIA
−4.5 −5.4 −4.3 −4.1 −5.3 −5.2 −5.0 −2.9 −4.3 −4.9 −4.0 −4.7 −3.7 −3.7 −4.8 −4.6 −5.1 −2.6 −3.9 −4.6
POLY
2019/10/16 12:43:37
−4.4 −4.4 −4.1 −6.0 −4.7 −4.0 −3.8 −5.7 −4.3 −5.3 −4.0 −3.6 −3.5 −5.7 −4.2 −3.5 −3.4 −6.0 −3.6 −4.9
NAFRICA log10 FMR
−4.3 −4.3 −3.8 −5.5 −4.4 −3.6 −3.7 −5.0 −3.8 −4.9 −3.5 −3.8 −2.9 −4.6 −3.6 −2.9 −2.9 −4.4 −2.9 −4.3
MEAST
−4.8 −4.5 −4.4 −5.9 −4.3 −4.5 −4.6 −5.4 −4.8 −5.1 −4.1 −4.0 −3.6 −5.3 −3.8 −3.8 −3.9 −4.7 −4.1 −4.6
EURO
−5.3 −4.9 −5.2 −4.2 −5.9 −5.8 −5.9 −4.1 −5.2 −5.8 −4.7 −4.4 −4.4 −3.7 −5.3 −5.0 −5.2 −3.7 −4.8 −5.1 −1
EASIA
−4.1 −4.4 −3.3 −5.1 −4.4 −4.0 −4.0 −4.2 −4.1 −4.9 −3.4 −3.8 −2.6 −4.5 −3.7 −3.2 −3.2 −3.7 −3.3 −4.3
FRVT
CSAMERIC
-
−5.1 −3.8 −4.4 −4.9 −4.4 −4.2 −4.4 −5.2 −5.0 −5.8 −4.5 −3.2 −3.6 −4.5 −3.7 −3.6 −4.0 −4.9 −4.3 −5.2
CASIA −2
−3.3 −5.2 −4.4 −5.4 −4.7 −4.7 −4.6 −4.6 −4.4 −3.3 −2.8 −5.0 −3.9 −4.9 −4.3 −4.1 −4.1 −4.4 −4.0 −2.9
CARIB

−3.1 −6.0 −4.8 −5.6 −4.7 −4.9 −4.7 −4.9 −4.5 −2.7 −2.8 −6.0 −4.5 −5.2 −4.3 −4.5 −4.5 −5.0 −4.1 −2.4
SSAFRICA
−3.9 −4.6 −3.9 −4.9 −4.6 −3.9 −3.9 −4.2 −2.9 −4.4 −3.3 −4.0 −3.1 −4.5 −3.9 −3.3 −3.3 −3.8 −2.5 −4.0
SASIA

−4
−4.2 −5.1 −4.0 −3.8 −5.1 −5.0 −4.9 −2.7 −4.1 −4.6 −3.8 −4.4 −3.5 −3.4 −4.6 −4.5 −6.0 −2.4 −3.7 −4.3
POLY
−4.2 −4.1 −3.9 −5.8 −4.4 −3.7 −3.5 −5.4 −4.0 −5.0 −3.7 −3.3 −3.3 −5.4 −4.0 −3.2 −3.1 −6.0 −3.5 −4.6
NAFRICA
-
−4.2 −4.0 −3.7 −5.3 −4.2 −3.4 −3.5 −4.9 −3.7 −4.7 −3.3 −3.5 −2.8 −4.5 −3.5 −2.7 −2.8 −4.3 −2.9 −4.2 −5
MEAST
−4.6 −4.3 −4.2 −5.7 −4.1 −4.3 −4.4 −5.1 −4.7 −4.9 −4.0 −3.8 −3.5 −5.2 −3.6 −3.7 −3.8 −4.5 −4.0 −4.4
EURO
−5.1 −4.6 −5.0 −4.0 −5.7 −5.7 −5.7 −3.8 −5.0 −5.5 −4.5 −4.2 −4.3 −3.5 −5.1 −4.9 −4.9 −3.5 −4.6 −4.9
−6
EASIA
VERIFICATION
−3.9 −4.2 −3.1 −4.9 −4.2 −3.9 −3.8 −4.0 −3.9 −4.6 −3.3 −3.6 −2.5 −4.3 −3.5 −3.1 −3.1 −3.5 −3.2 −4.1
CSAMERIC
−4.8 −3.5 −4.2 −4.7 −4.1 −4.0 −4.1 −4.9 −4.7 −5.6 −4.3 −3.0 −3.4 −4.2 −3.5 −3.4 −3.7 −4.6 −4.2 −6.0
CASIA
−3.1 −4.9 −4.1 −5.2 −4.5 −4.4 −4.3 −4.4 −4.1 −3.0 −2.6 −4.7 −3.6 −4.7 −4.1 −3.9 −3.9 −4.1 −3.7 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


242
Cross region FMR at threshold T = 29.232 for algorithm innovatrics_004, giving FMR(T) = 0.0001 globally.
−3.2 −6.0 −5.1 −5.6 −4.8 −5.1 −5.0 −5.0 −4.7 −2.8 −2.8 −6.0 −4.7 −5.4 −4.4 −4.7 −4.7 −4.7 −4.3 −2.5
SSAFRICA
−4.3 −5.0 −4.6 −4.8 −5.1 −4.4 −4.4 −4.3 −3.0 −4.6 −3.8 −4.6 −4.0 −4.5 −4.5 −3.9 −4.0 −4.1 −2.7 −4.2
SASIA
−4.3 −4.4 −4.2 −3.4 −5.1 −5.0 −4.9 −2.6 −4.2 −4.9 −3.9 −4.2 −3.7 −3.1 −4.5 −4.6 −4.1 −2.3 −3.7 −4.6
POLY
2019/10/16 12:43:37
−4.6 −5.0 −4.5 −5.9 −5.1 −4.3 −4.0 −4.9 −4.3 −5.4 −4.1 −3.9 −3.9 −5.4 −4.7 −3.9 −3.4 −4.9 −3.8 −4.6
NAFRICA log10 FMR
−4.8 −4.6 −4.5 −5.5 −4.9 −4.1 −4.1 −4.8 −4.2 −5.3 −4.1 −4.0 −3.9 −5.1 −4.3 −3.5 −3.6 −4.3 −3.7 −4.8
MEAST
−4.9 −4.7 −4.9 −5.6 −4.7 −5.0 −5.0 −5.3 −5.2 −5.1 −4.4 −4.1 −4.3 −5.2 −4.2 −4.4 −4.6 −4.7 −4.7 −4.6
EURO
−5.2 −4.0 −4.9 −3.1 −5.4 −5.8 −6.0 −3.4 −4.9 −5.4 −4.7 −3.6 −4.4 −2.7 −4.8 −5.3 −6.0 −3.1 −4.5 −5.0 −1
EASIA
−4.4 −4.8 −3.8 −4.9 −4.8 −4.6 −4.5 −4.2 −4.4 −4.9 −3.8 −4.3 −3.3 −4.5 −4.3 −4.1 −4.0 −3.8 −3.9 −4.4
FRVT
CSAMERIC
-
−5.3 −3.6 −4.8 −3.8 −4.7 −4.5 −4.5 −4.4 −5.0 −5.8 −4.6 −3.2 −4.3 −3.4 −4.2 −4.1 −4.1 −4.3 −4.5 −5.2
CASIA −2
−3.2 −5.1 −4.5 −5.2 −4.7 −4.8 −4.7 −4.4 −4.4 −3.1 −2.6 −5.0 −4.0 −4.7 −4.1 −4.2 −4.3 −4.1 −4.0 −2.7
CARIB

−3.0 −6.0 −4.8 −5.4 −4.6 −4.9 −4.8 −4.7 −4.4 −2.6 −2.6 −6.0 −4.4 −5.1 −4.2 −4.5 −4.4 −4.4 −4.0 −2.3
SSAFRICA
−4.1 −4.7 −4.3 −4.6 −4.9 −4.2 −4.1 −4.1 −2.8 −4.4 −3.6 −4.4 −3.8 −4.3 −4.4 −3.8 −3.8 −3.9 −2.5 −4.0
SASIA

−4
−4.1 −4.1 −4.0 −3.1 −4.9 −4.8 −4.6 −2.3 −3.9 −4.6 −3.7 −3.9 −3.5 −2.8 −4.3 −4.4 −3.9 −2.1 −3.5 −4.3
POLY
−4.4 −4.7 −4.3 −5.6 −4.8 −4.1 −3.8 −4.8 −4.1 −5.1 −3.7 −3.6 −3.7 −5.4 −4.4 −3.7 −3.2 −4.6 −3.6 −4.3
NAFRICA
-
−4.6 −4.3 −4.2 −5.2 −4.6 −3.8 −3.9 −4.6 −4.0 −5.1 −3.9 −3.7 −3.7 −4.8 −4.1 −3.3 −3.5 −4.1 −3.5 −4.6 −5
MEAST
−4.7 −4.4 −4.6 −5.3 −4.4 −4.7 −4.7 −5.0 −4.9 −4.9 −4.1 −3.8 −4.1 −4.9 −3.9 −4.1 −4.3 −4.6 −4.5 −4.5
EURO
−4.9 −3.8 −4.7 −2.8 −5.1 −5.6 −5.8 −3.2 −4.6 −5.1 −4.5 −3.4 −4.2 −2.5 −4.7 −5.1 −6.0 −2.8 −4.2 −4.8
−6
EASIA
VERIFICATION
−4.2 −4.5 −3.6 −4.7 −4.6 −4.4 −4.2 −4.0 −4.2 −4.7 −3.6 −4.0 −3.1 −4.2 −4.1 −3.9 −3.8 −3.6 −3.7 −4.2
CSAMERIC
−5.0 −3.4 −4.5 −3.6 −4.4 −4.2 −4.2 −4.1 −4.8 −5.5 −4.3 −3.0 −4.0 −3.2 −3.9 −3.8 −3.8 −4.0 −4.3 −4.9
CASIA
−3.0 −4.8 −4.3 −4.9 −4.5 −4.5 −4.4 −4.1 −4.1 −2.9 −2.5 −4.7 −3.8 −4.5 −4.0 −4.1 −4.0 −3.8 −3.7 −2.5
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 203: For algorithm innovatrics-004 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


243
Cross region FMR at threshold T = 27.987 for algorithm innovatrics_006, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.2 −5.6 −5.1 −5.2 −5.2 −5.1 −4.9 −3.1 −3.2 −6.0 −4.8 −5.2 −4.7 −5.0 −5.3 −4.8 −4.4 −2.8
SSAFRICA
−4.4 −4.9 −4.5 −4.9 −5.0 −4.4 −4.3 −4.4 −3.3 −4.8 −3.8 −4.5 −3.9 −4.5 −4.4 −3.8 −3.8 −4.1 −2.9 −4.4
SASIA
−4.5 −4.5 −4.3 −3.5 −5.3 −5.2 −4.9 −2.6 −4.3 −4.9 −4.1 −4.2 −3.8 −3.1 −4.8 −4.9 −4.6 −2.3 −3.9 −4.7
POLY
2019/10/16 12:43:37
−4.4 −4.7 −4.2 −5.6 −4.8 −4.0 −3.7 −5.2 −4.3 −4.9 −3.9 −3.9 −3.7 −5.2 −4.4 −3.5 −3.2 −4.9 −3.7 −4.6
NAFRICA log10 FMR
−4.7 −4.4 −4.3 −5.6 −4.7 −3.9 −3.9 −5.0 −4.3 −5.2 −4.1 −4.0 −3.7 −5.2 −4.2 −3.4 −3.3 −4.7 −3.7 −4.7
MEAST
−5.0 −4.5 −4.6 −5.6 −4.4 −4.8 −4.8 −5.4 −5.2 −5.4 −4.5 −4.1 −4.1 −5.2 −4.0 −4.2 −4.4 −5.0 −4.5 −4.8
EURO
−5.4 −4.1 −4.9 −3.2 −5.5 −5.7 −5.7 −3.5 −5.0 −5.4 −4.9 −3.8 −4.4 −2.8 −5.0 −5.1 −5.2 −3.2 −4.6 −4.9 −1
EASIA
−4.3 −4.6 −3.5 −4.9 −4.5 −4.4 −4.1 −4.2 −4.4 −4.9 −3.7 −4.2 −3.0 −4.4 −4.1 −3.8 −3.6 −3.8 −3.9 −4.5
FRVT
CSAMERIC
-
−5.0 −3.6 −4.6 −4.1 −4.5 −4.3 −4.3 −4.7 −5.0 −6.0 −4.5 −3.0 −4.1 −3.7 −4.1 −3.9 −4.1 −4.3 −4.7 −5.2
CASIA −2
−3.4 −5.3 −4.5 −5.3 −4.9 −4.8 −4.5 −4.6 −4.5 −3.4 −2.9 −5.0 −4.0 −4.9 −4.3 −4.2 −4.0 −4.3 −4.1 −3.0
CARIB

−3.2 −6.0 −4.9 −5.3 −4.8 −5.0 −4.9 −4.9 −4.6 −2.8 −2.9 −6.0 −4.5 −4.9 −4.5 −4.7 −5.0 −4.6 −4.1 −2.5
SSAFRICA
−4.1 −4.6 −4.3 −4.7 −4.8 −4.2 −4.1 −4.2 −3.0 −4.5 −3.6 −4.2 −3.7 −4.3 −4.3 −3.7 −3.6 −3.9 −2.7 −4.1
SASIA

−4
−4.2 −4.2 −4.0 −3.2 −5.0 −5.0 −4.7 −2.4 −4.0 −4.7 −3.8 −3.9 −3.6 −2.9 −4.6 −4.7 −4.5 −2.1 −3.6 −4.4
POLY
−4.2 −4.5 −3.9 −5.3 −4.5 −3.7 −3.5 −4.9 −4.0 −4.6 −3.6 −3.6 −3.4 −5.0 −4.2 −3.2 −3.0 −4.6 −3.5 −4.3
NAFRICA
-
−4.5 −4.1 −4.0 −5.4 −4.4 −3.7 −3.7 −4.8 −4.1 −4.9 −3.9 −3.7 −3.5 −5.0 −3.9 −3.1 −3.1 −4.4 −3.6 −4.6 −5
MEAST
−4.7 −4.2 −4.3 −5.3 −4.1 −4.5 −4.5 −5.1 −4.9 −5.1 −4.2 −3.8 −3.8 −4.9 −3.7 −4.0 −4.1 −4.8 −4.4 −4.6
EURO
−5.1 −3.9 −4.7 −3.0 −5.2 −5.5 −5.4 −3.3 −4.7 −5.1 −4.7 −3.5 −4.2 −2.6 −4.8 −4.9 −4.9 −2.9 −4.3 −4.6
−6
EASIA
VERIFICATION
−4.0 −4.3 −3.2 −4.6 −4.3 −4.1 −3.9 −3.9 −4.1 −4.7 −3.5 −3.9 −2.8 −4.2 −3.8 −3.6 −3.4 −3.5 −3.6 −4.2
CSAMERIC
−4.8 −3.3 −4.3 −3.8 −4.2 −4.0 −4.0 −4.4 −4.7 −5.9 −4.2 −2.8 −3.8 −3.4 −3.8 −3.6 −3.8 −4.0 −4.4 −4.9
CASIA
−3.2 −5.0 −4.2 −5.1 −4.6 −4.5 −4.2 −4.3 −4.2 −3.2 −2.7 −5.0 −3.7 −4.7 −4.1 −3.9 −3.8 −4.1 −3.8 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


244
Cross region FMR at threshold T = 0.705 for algorithm intellicloudai_001, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.3 −5.8 −5.2 −5.4 −5.2 −5.2 −5.1 −3.2 −3.2 −6.0 −4.9 −5.6 −4.6 −4.9 −5.3 −5.1 −4.6 −2.9
SSAFRICA
−4.4 −4.8 −4.1 −4.8 −4.8 −4.2 −4.3 −4.5 −3.4 −4.8 −3.6 −4.1 −3.2 −4.2 −4.0 −3.4 −3.5 −3.9 −2.9 −4.3
SASIA
−4.6 −4.5 −4.2 −3.6 −5.2 −5.1 −5.3 −2.8 −4.3 −5.1 −4.1 −4.0 −3.4 −3.2 −4.4 −4.2 −5.1 −2.5 −3.8 −4.7
POLY
2019/10/16 12:43:37
−4.6 −4.7 −4.3 −5.6 −5.0 −4.2 −4.1 −5.3 −4.5 −5.3 −3.8 −3.9 −3.7 −5.4 −4.4 −3.6 −3.7 −4.6 −3.9 −4.9
NAFRICA log10 FMR
−4.6 −4.5 −4.0 −5.3 −4.6 −3.9 −4.0 −4.8 −4.0 −5.2 −3.6 −3.8 −3.1 −4.5 −3.7 −3.0 −3.2 −4.0 −3.2 −4.4
MEAST
−5.0 −4.6 −4.5 −5.6 −4.6 −4.7 −4.8 −5.2 −4.9 −5.4 −4.2 −4.1 −3.6 −4.9 −3.9 −3.9 −4.1 −4.5 −4.1 −4.7
EURO
−5.2 −4.0 −4.7 −3.2 −5.2 −5.6 −5.5 −3.6 −5.0 −5.5 −4.4 −3.5 −3.9 −2.7 −4.5 −4.7 −4.9 −3.2 −4.4 −4.8 −1
EASIA
−4.4 −4.5 −3.5 −4.8 −4.5 −4.2 −4.2 −4.3 −4.2 −5.0 −3.5 −3.7 −2.7 −4.0 −3.7 −3.3 −3.4 −3.6 −3.4 −4.4
FRVT
CSAMERIC
-
−5.3 −3.7 −4.3 −4.1 −4.5 −4.3 −4.7 −4.8 −5.1 −5.9 −4.3 −3.2 −3.3 −3.8 −3.6 −3.5 −4.0 −4.4 −4.4 −4.9
CASIA −2
−3.6 −5.6 −4.7 −5.5 −5.0 −5.0 −4.7 −4.8 −4.7 −3.5 −3.0 −6.0 −4.1 −5.0 −4.4 −4.3 −4.1 −4.5 −4.2 −3.1
CARIB

−3.3 −6.0 −5.1 −5.6 −5.0 −5.2 −4.9 −5.0 −4.8 −2.9 −3.0 −6.0 −4.7 −5.3 −4.4 −4.7 −5.0 −4.9 −4.3 −2.6
SSAFRICA
−4.2 −4.7 −4.0 −4.7 −4.7 −4.1 −4.2 −4.3 −3.2 −4.7 −3.5 −4.1 −3.1 −4.1 −4.0 −3.4 −3.4 −3.8 −2.8 −4.2
SASIA

−4
−4.4 −4.2 −4.0 −3.4 −5.0 −4.9 −5.2 −2.6 −4.1 −4.8 −4.0 −3.8 −3.3 −3.0 −4.3 −4.1 −4.8 −2.2 −3.6 −4.4
POLY
−4.3 −4.4 −4.1 −5.4 −4.7 −3.9 −3.8 −5.0 −4.3 −5.0 −3.5 −3.6 −3.5 −5.1 −4.2 −3.4 −3.6 −4.3 −3.7 −4.6
NAFRICA
-
−4.4 −4.3 −3.9 −5.2 −4.5 −3.7 −3.8 −4.6 −3.9 −5.1 −3.5 −3.7 −3.0 −4.4 −3.6 −2.9 −3.0 −3.9 −3.1 −4.3 −5
MEAST
−4.8 −4.4 −4.4 −5.4 −4.4 −4.6 −4.7 −5.1 −4.8 −5.2 −4.1 −3.9 −3.6 −4.7 −3.7 −3.8 −4.1 −4.4 −4.0 −4.6
EURO
−5.0 −3.8 −4.6 −3.0 −5.1 −5.5 −5.3 −3.4 −4.8 −5.3 −4.3 −3.3 −3.8 −2.5 −4.4 −4.7 −4.7 −3.0 −4.3 −4.7
−6
EASIA
VERIFICATION
−4.2 −4.3 −3.3 −4.6 −4.4 −4.0 −4.0 −4.1 −4.0 −4.8 −3.4 −3.6 −2.6 −3.9 −3.6 −3.2 −3.3 −3.4 −3.3 −4.2
CSAMERIC
−5.0 −3.4 −4.2 −3.9 −4.3 −4.2 −4.5 −4.6 −4.9 −5.9 −4.1 −3.0 −3.2 −3.6 −3.5 −3.4 −3.9 −4.6 −4.3 −4.9
CASIA
−3.3 −5.3 −4.4 −5.3 −4.7 −4.8 −4.5 −4.6 −4.4 −3.3 −2.8 −6.0 −3.9 −4.8 −4.2 −4.1 −3.9 −4.3 −4.0 −2.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 205: For algorithm intellicloudai-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


245
Cross region FMR at threshold T = 0.300 for algorithm intellifusion_001, giving FMR(T) = 0.0001 globally.
−3.6 −5.1 −4.8 −5.4 −4.8 −4.7 −4.6 −4.6 −4.3 −3.0 −3.2 −5.0 −4.4 −5.0 −4.4 −4.3 −4.4 −4.4 −3.9 −2.8
SSAFRICA
−4.0 −4.2 −4.1 −4.8 −4.4 −3.7 −3.7 −4.1 −2.6 −4.1 −3.5 −3.8 −3.5 −4.4 −4.0 −3.3 −3.3 −3.8 −2.3 −3.8
SASIA
−4.3 −4.8 −4.4 −4.4 −5.0 −4.8 −4.5 −3.3 −4.0 −4.7 −4.0 −4.5 −4.0 −4.1 −4.6 −4.5 −4.0 −3.0 −3.7 −4.4
POLY
2019/10/16 12:43:37
−4.1 −4.0 −4.0 −5.1 −4.3 −3.6 −3.4 −4.4 −3.8 −4.4 −3.6 −3.3 −3.5 −4.9 −3.8 −3.2 −2.9 −4.3 −3.3 −4.0
NAFRICA log10 FMR
−4.2 −3.9 −4.0 −5.1 −4.2 −3.4 −3.5 −4.7 −3.6 −4.6 −3.6 −3.5 −3.3 −4.6 −3.6 −2.9 −3.0 −4.3 −3.1 −4.2
MEAST
−4.7 −4.0 −4.3 −5.3 −4.0 −4.2 −4.3 −5.0 −4.5 −4.9 −4.2 −3.6 −3.8 −5.0 −3.6 −3.7 −3.8 −4.6 −4.1 −4.5
EURO
−5.1 −5.0 −5.1 −4.4 −5.4 −5.3 −5.1 −4.5 −4.8 −5.3 −4.5 −4.7 −4.5 −4.0 −4.9 −4.7 −4.8 −4.1 −4.5 −4.9 −1
EASIA
−4.2 −4.3 −3.8 −5.1 −4.4 −4.1 −4.1 −4.4 −4.1 −4.8 −3.6 −3.9 −3.1 −4.6 −3.9 −3.5 −3.5 −4.0 −3.6 −4.3
FRVT
CSAMERIC
-
−4.7 −3.6 −4.3 −4.9 −4.0 −3.9 −3.9 −4.7 −4.3 −5.0 −4.2 −3.2 −3.8 −4.5 −3.6 −3.5 −3.6 −4.4 −3.9 −4.4
CASIA −2
−3.5 −4.7 −4.3 −5.1 −4.6 −4.4 −4.3 −4.3 −4.0 −3.5 −2.9 −4.2 −3.8 −4.8 −4.1 −3.9 −3.8 −4.0 −3.6 −3.1
CARIB

−3.3 −4.9 −4.6 −5.2 −4.6 −4.5 −4.3 −4.4 −4.0 −2.8 −3.0 −4.7 −4.2 −4.8 −4.2 −4.1 −4.2 −4.1 −3.7 −2.5
SSAFRICA
−3.7 −4.0 −3.9 −4.5 −4.2 −3.5 −3.5 −3.9 −2.3 −3.9 −3.3 −3.5 −3.4 −4.2 −3.9 −3.1 −3.1 −3.6 −2.1 −3.6
SASIA

−4
−4.0 −4.6 −4.2 −4.2 −4.8 −4.6 −4.2 −3.1 −3.7 −4.5 −3.7 −4.2 −3.8 −3.8 −4.4 −4.3 −3.7 −2.8 −3.4 −4.2
POLY
−3.9 −3.8 −3.8 −4.9 −4.0 −3.4 −3.1 −4.2 −3.5 −4.2 −3.3 −3.1 −3.2 −4.7 −3.6 −2.9 −2.6 −4.0 −3.1 −3.7
NAFRICA
-
−4.0 −3.7 −3.8 −4.9 −3.9 −3.2 −3.2 −4.4 −3.4 −4.4 −3.4 −3.2 −3.1 −4.4 −3.4 −2.7 −2.8 −4.1 −2.9 −4.1 −5
MEAST
−4.5 −3.7 −4.1 −5.1 −3.7 −3.9 −4.0 −4.8 −4.3 −4.7 −4.0 −3.3 −3.6 −4.8 −3.3 −3.5 −3.6 −4.4 −3.9 −4.3
EURO
−4.9 −4.7 −4.9 −4.2 −5.1 −5.1 −4.9 −4.2 −4.6 −5.1 −4.3 −4.4 −4.3 −3.8 −4.7 −4.5 −4.6 −3.9 −4.2 −4.7
−6
EASIA
VERIFICATION
−4.0 −4.1 −3.6 −4.8 −4.1 −3.8 −3.8 −4.2 −3.9 −4.6 −3.5 −3.7 −3.0 −4.4 −3.7 −3.3 −3.3 −3.7 −3.4 −4.1
CSAMERIC
−4.4 −3.3 −4.0 −4.6 −3.8 −3.6 −3.6 −4.5 −4.0 −4.8 −3.9 −2.9 −3.6 −4.2 −3.3 −3.2 −3.3 −4.1 −3.7 −4.2
CASIA
−3.3 −4.4 −4.1 −4.9 −4.3 −4.1 −4.0 −4.1 −3.8 −3.3 −2.7 −3.9 −3.6 −4.7 −3.9 −3.7 −3.5 −3.8 −3.4 −2.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 206: For algorithm intellifusion-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


246
Cross region FMR at threshold T = 49.664 for algorithm intellivision_001, giving FMR(T) = 0.0001 globally.
−4.0 −6.0 −5.0 −6.0 −5.3 −5.5 −5.9 −5.7 −5.2 −4.0 −3.2 −6.0 −3.9 −5.4 −4.4 −4.6 −5.0 −4.7 −4.3 −3.3
SSAFRICA
−4.0 −4.6 −3.7 −4.9 −4.4 −4.0 −4.2 −4.4 −3.7 −4.7 −3.0 −3.6 −2.7 −4.0 −3.5 −3.1 −3.2 −3.6 −3.0 −3.8
SASIA
−4.8 −4.8 −4.2 −4.2 −5.1 −4.9 −5.0 −3.7 −4.8 −5.9 −4.0 −4.0 −3.3 −3.5 −4.1 −4.0 −4.1 −3.2 −4.0 −5.1
POLY
2019/10/16 12:43:37
−4.6 −5.1 −4.3 −5.8 −5.1 −4.6 −4.7 −5.7 −4.3 −5.4 −3.7 −4.0 −3.2 −5.1 −4.1 −3.6 −3.7 −6.0 −3.2 −4.3
NAFRICA log10 FMR
−4.2 −4.6 −3.8 −5.1 −4.4 −3.8 −4.0 −4.6 −3.9 −5.1 −3.1 −3.6 −2.7 −4.1 −3.4 −2.9 −3.0 −3.6 −2.9 −4.1
MEAST
−4.7 −4.9 −4.3 −5.2 −4.7 −4.5 −4.8 −5.2 −4.9 −5.2 −3.8 −4.0 −3.3 −4.2 −3.7 −3.6 −3.9 −4.2 −4.0 −4.3
EURO
−4.9 −4.3 −4.5 −3.5 −5.1 −5.3 −5.3 −4.1 −5.1 −5.7 −3.9 −3.5 −3.5 −2.8 −4.2 −4.3 −4.3 −3.4 −4.2 −4.7 −1
EASIA
−3.9 −4.3 −3.4 −4.4 −4.1 −3.8 −4.0 −4.1 −3.9 −4.6 −2.9 −3.3 −2.4 −3.5 −3.1 −2.8 −3.0 −3.2 −3.0 −3.6
FRVT
CSAMERIC
-
−6.0 −4.5 −6.0 −4.6 −5.9 −6.0 −5.7 −5.8 −6.0 −6.0 −5.3 −3.9 −5.9 −4.3 −5.3 −5.4 −6.0 −6.0 −5.4 −6.0
CASIA −2
−3.6 −5.4 −4.5 −5.5 −4.9 −4.9 −4.9 −5.0 −4.7 −3.8 −2.8 −4.4 −3.6 −4.6 −4.0 −3.9 −4.0 −4.2 −3.9 −3.1
CARIB

−3.9 −6.0 −5.0 −6.0 −5.2 −5.4 −5.7 −5.6 −5.2 −3.8 −3.2 −6.0 −4.0 −5.2 −4.4 −4.5 −5.0 −4.7 −4.4 −3.2
SSAFRICA
−3.9 −4.5 −3.7 −4.9 −4.4 −4.0 −4.2 −4.4 −3.6 −4.6 −3.0 −3.6 −2.7 −3.9 −3.5 −3.1 −3.3 −3.6 −3.0 −3.8
SASIA

−4
−4.9 −4.8 −4.2 −4.1 −5.0 −4.8 −5.1 −3.5 −4.7 −6.0 −3.9 −3.9 −3.2 −3.5 −4.0 −3.9 −4.3 −3.1 −3.9 −5.3
POLY
−4.7 −4.8 −4.3 −5.6 −5.1 −4.6 −4.5 −5.4 −4.2 −5.4 −3.7 −3.7 −3.2 −5.1 −4.1 −3.6 −3.6 −6.0 −3.2 −4.3
NAFRICA
-
−4.1 −4.6 −3.7 −5.0 −4.3 −3.8 −3.9 −4.5 −3.9 −5.0 −3.0 −3.6 −2.7 −4.0 −3.3 −2.8 −3.0 −3.5 −2.9 −4.2 −5
MEAST
−4.7 −4.8 −4.3 −5.1 −4.6 −4.5 −4.8 −5.1 −4.8 −5.2 −3.7 −3.9 −3.3 −4.2 −3.7 −3.6 −3.9 −4.2 −4.0 −4.4
EURO
−4.9 −4.2 −4.5 −3.4 −5.0 −5.2 −5.2 −4.0 −5.1 −5.7 −3.9 −3.4 −3.5 −2.7 −4.1 −4.2 −4.3 −3.3 −4.2 −4.7
−6
EASIA
VERIFICATION
−3.9 −4.2 −3.4 −4.4 −4.1 −3.8 −4.0 −4.1 −3.9 −4.6 −2.9 −3.3 −2.4 −3.4 −3.1 −2.8 −3.0 −3.1 −3.0 −3.6
CSAMERIC
−5.8 −4.3 −5.8 −4.4 −5.7 −5.7 −5.4 −5.7 −5.8 −6.0 −5.0 −3.9 −5.6 −4.0 −5.1 −5.1 −6.0 −6.0 −5.2 −6.0
CASIA
−3.6 −5.4 −4.5 −5.4 −4.8 −4.8 −4.8 −4.9 −4.6 −3.8 −2.8 −4.5 −3.5 −4.5 −4.0 −3.8 −3.9 −4.1 −3.8 −3.1
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 207: For algorithm intellivision-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


247
Cross region FMR at threshold T = 44.160 for algorithm intellivision_002, giving FMR(T) = 0.0001 globally.
−4.2 −6.0 −5.1 −6.0 −5.4 −5.6 −5.9 −5.7 −5.4 −4.1 −3.3 −6.0 −4.0 −5.1 −4.5 −4.6 −4.8 −4.8 −4.5 −3.4
SSAFRICA
−4.0 −4.6 −3.7 −4.8 −4.5 −4.0 −4.1 −4.4 −3.7 −4.7 −3.0 −3.7 −2.7 −3.9 −3.5 −3.0 −3.2 −3.6 −3.0 −3.7
SASIA
−4.9 −4.9 −4.4 −4.3 −5.2 −5.1 −5.1 −3.9 −4.9 −5.7 −3.9 −4.1 −3.4 −3.5 −4.3 −4.1 −4.2 −3.2 −4.1 −4.8
POLY
2019/10/16 12:43:37
−5.0 −5.1 −4.5 −6.0 −5.2 −4.8 −5.2 −6.0 −4.5 −6.0 −4.0 −4.0 −3.4 −5.0 −4.2 −3.7 −4.3 −6.0 −3.4 −4.9
NAFRICA log10 FMR
−4.2 −4.5 −3.7 −5.1 −4.4 −3.8 −3.9 −4.6 −3.9 −5.1 −3.1 −3.6 −2.7 −4.1 −3.3 −2.8 −2.9 −3.6 −2.9 −4.0
MEAST
−4.7 −4.9 −4.2 −5.2 −4.6 −4.5 −4.7 −5.1 −4.8 −5.4 −3.7 −4.0 −3.2 −4.2 −3.6 −3.5 −3.7 −4.2 −3.9 −4.5
EURO
−4.9 −4.2 −4.4 −3.5 −5.1 −5.3 −5.3 −4.1 −5.0 −5.7 −3.9 −3.5 −3.4 −2.8 −4.2 −4.3 −4.4 −3.3 −4.2 −4.7 −1
EASIA
−3.9 −4.3 −3.4 −4.4 −4.2 −3.8 −4.0 −4.2 −3.9 −4.7 −2.9 −3.3 −2.4 −3.4 −3.1 −2.8 −3.0 −3.2 −3.0 −3.7
FRVT
CSAMERIC
-
−5.2 −4.5 −4.2 −4.8 −4.8 −4.6 −5.7 −5.2 −4.9 −6.0 −4.2 −3.9 −3.1 −4.2 −3.7 −3.5 −4.7 −4.3 −3.8 −5.2
CASIA −2
−3.8 −5.7 −4.6 −5.5 −5.0 −5.0 −4.9 −5.1 −4.8 −4.0 −2.9 −4.8 −3.6 −4.6 −4.1 −4.0 −4.0 −4.2 −4.0 −3.2
CARIB

−4.1 −6.0 −5.1 −6.0 −5.4 −5.5 −6.0 −5.8 −5.4 −4.0 −3.3 −6.0 −4.0 −5.0 −4.6 −4.6 −5.0 −4.9 −4.5 −3.3
SSAFRICA
−4.0 −4.6 −3.7 −4.8 −4.4 −4.0 −4.1 −4.4 −3.7 −4.7 −3.0 −3.6 −2.7 −3.9 −3.5 −3.0 −3.2 −3.6 −3.0 −3.7
SASIA

−4
−4.9 −4.8 −4.3 −4.2 −5.1 −5.0 −5.2 −3.7 −4.9 −5.5 −4.0 −3.9 −3.3 −3.5 −4.2 −4.0 −4.3 −3.2 −4.0 −4.8
POLY
−5.0 −4.8 −4.5 −5.9 −5.2 −4.8 −4.9 −6.0 −4.5 −6.0 −4.0 −3.7 −3.4 −5.0 −4.2 −3.7 −4.1 −6.0 −3.4 −6.0
NAFRICA
-
−4.1 −4.5 −3.7 −5.1 −4.3 −3.7 −3.9 −4.6 −3.9 −5.1 −3.1 −3.6 −2.7 −4.1 −3.3 −2.8 −2.9 −3.6 −2.9 −4.1 −5
MEAST
−4.7 −4.9 −4.2 −5.2 −4.6 −4.4 −4.7 −5.1 −4.8 −5.4 −3.7 −3.9 −3.2 −4.2 −3.6 −3.5 −3.9 −4.2 −3.9 −4.5
EURO
−4.9 −4.2 −4.4 −3.5 −5.1 −5.2 −5.3 −4.0 −5.0 −5.6 −3.9 −3.4 −3.4 −2.7 −4.2 −4.2 −4.4 −3.2 −4.2 −4.6
−6
EASIA
VERIFICATION
−3.9 −4.3 −3.4 −4.4 −4.1 −3.8 −4.0 −4.1 −3.9 −4.7 −2.9 −3.3 −2.4 −3.4 −3.1 −2.8 −2.9 −3.2 −2.9 −3.7
CSAMERIC
−5.2 −4.2 −4.2 −4.6 −4.7 −4.5 −6.0 −5.4 −4.8 −6.0 −4.1 −3.7 −3.1 −4.1 −3.7 −3.5 −6.0 −4.4 −3.7 −6.0
CASIA
−3.7 −5.4 −4.6 −5.4 −4.9 −4.9 −4.9 −5.1 −4.7 −3.9 −2.9 −4.5 −3.6 −4.5 −4.0 −3.9 −4.1 −4.2 −4.0 −3.2
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS


248
Cross region FMR at threshold T = 594.014 for algorithm intelresearch_000, giving FMR(T) = 0.0001 globally.
−3.2 −6.0 −5.1 −6.0 −4.7 −5.1 −4.9 −5.6 −5.0 −2.9 −2.7 −6.0 −4.6 −5.5 −4.2 −4.6 −4.4 −4.9 −4.4 −2.5
SSAFRICA
−4.0 −4.7 −3.9 −4.8 −4.6 −3.9 −4.0 −4.3 −3.2 −4.6 −3.2 −3.9 −3.0 −4.0 −3.8 −3.2 −3.2 −3.7 −2.7 −3.9
SASIA
−4.6 −4.6 −4.2 −3.8 −5.1 −4.9 −4.9 −2.9 −4.3 −5.2 −3.9 −4.1 −3.4 −3.2 −4.3 −4.1 −4.6 −2.4 −3.8 −4.5
POLY
2019/10/16 12:43:37
−4.6 −4.5 −4.2 −5.9 −4.8 −4.1 −4.0 −5.1 −4.2 −5.0 −4.0 −3.9 −3.4 −4.9 −4.2 −3.3 −3.6 −6.0 −3.3 −4.6
NAFRICA log10 FMR
−4.4 −4.3 −3.9 −5.2 −4.5 −3.7 −3.8 −4.7 −3.9 −5.0 −3.5 −3.6 −3.0 −4.3 −3.6 −2.9 −3.0 −3.9 −3.0 −4.4
MEAST
−4.7 −4.7 −4.4 −5.6 −4.5 −4.5 −4.6 −5.2 −4.6 −4.9 −3.8 −4.0 −3.6 −4.8 −3.9 −3.7 −3.8 −4.4 −3.7 −4.2
EURO
−5.5 −4.2 −4.7 −3.4 −5.3 −5.4 −5.8 −3.7 −5.0 −6.0 −4.6 −3.5 −3.9 −2.8 −4.5 −4.7 −5.0 −3.1 −4.4 −5.1 −1
EASIA
−4.1 −4.5 −3.5 −4.8 −4.5 −4.0 −4.0 −4.2 −4.0 −4.8 −3.3 −3.7 −2.7 −3.9 −3.6 −3.2 −3.2 −3.5 −3.2 −4.1
FRVT
CSAMERIC
-
−5.3 −3.8 −4.6 −4.5 −4.6 −4.4 −4.3 −5.0 −5.1 −6.0 −4.6 −3.3 −3.8 −4.2 −3.9 −3.7 −3.8 −4.9 −4.5 −6.0
CASIA −2
−3.1 −5.4 −4.6 −5.8 −4.5 −4.7 −4.7 −5.0 −4.7 −3.1 −2.5 −4.8 −4.0 −5.1 −3.9 −4.0 −4.0 −4.5 −4.2 −2.6
CARIB

−3.0 −5.7 −4.9 −6.0 −4.5 −4.9 −4.6 −5.3 −4.8 −2.6 −2.5 −6.0 −4.4 −5.4 −4.1 −4.4 −4.2 −4.7 −4.2 −2.3
SSAFRICA
−3.9 −4.6 −3.8 −4.7 −4.5 −3.8 −3.9 −4.2 −3.0 −4.5 −3.1 −3.8 −2.9 −3.9 −3.8 −3.1 −3.2 −3.6 −2.5 −3.9
SASIA

−4
−4.4 −4.4 −4.0 −3.6 −4.9 −4.7 −4.7 −2.6 −4.1 −5.0 −3.8 −3.9 −3.3 −3.0 −4.2 −3.9 −4.5 −2.2 −3.6 −4.4
POLY
−4.4 −4.2 −4.0 −5.7 −4.6 −3.9 −3.7 −4.8 −4.0 −4.8 −3.8 −3.6 −3.2 −4.7 −4.0 −3.2 −3.3 −6.0 −3.2 −4.3
NAFRICA
-
−4.3 −4.1 −3.8 −5.1 −4.3 −3.5 −3.7 −4.6 −3.8 −4.8 −3.5 −3.4 −2.9 −4.3 −3.5 −2.8 −2.9 −3.7 −2.9 −4.2 −5
MEAST
−4.5 −4.4 −4.3 −5.5 −4.3 −4.4 −4.5 −5.0 −4.5 −4.7 −3.7 −3.8 −3.5 −4.7 −3.7 −3.6 −3.8 −4.2 −3.7 −4.1
EURO
−5.4 −4.1 −4.6 −3.3 −5.2 −5.4 −5.8 −3.5 −4.9 −5.9 −4.6 −3.4 −3.8 −2.7 −4.5 −4.5 −4.9 −3.0 −4.3 −5.1
−6
EASIA
VERIFICATION
−4.0 −4.3 −3.4 −4.7 −4.3 −3.9 −3.9 −4.1 −3.9 −4.6 −3.2 −3.6 −2.6 −3.8 −3.5 −3.1 −3.1 −3.4 −3.1 −4.0
CSAMERIC
−5.0 −3.5 −4.5 −4.2 −4.3 −4.1 −4.0 −4.7 −4.9 −6.0 −4.4 −3.1 −3.7 −3.9 −3.7 −3.5 −3.5 −4.6 −4.3 −6.0
CASIA
−3.0 −5.1 −4.4 −5.6 −4.4 −4.5 −4.5 −4.7 −4.4 −2.9 −2.4 −4.5 −3.8 −5.0 −3.8 −3.8 −3.8 −4.3 −3.9 −2.4
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 209: For algorithm intelresearch-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


249
Cross region FMR at threshold T = 1.389 for algorithm intsysmsu_000, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.3 −5.8 −5.1 −5.4 −5.2 −5.2 −5.0 −3.2 −3.1 −6.0 −4.9 −5.6 −4.6 −4.9 −5.3 −5.1 −4.5 −2.8
SSAFRICA
−4.2 −4.6 −4.0 −4.8 −4.7 −4.1 −4.2 −4.4 −3.3 −4.8 −3.4 −3.8 −3.0 −4.1 −3.8 −3.3 −3.4 −3.7 −2.8 −4.1
SASIA
−4.6 −4.7 −4.2 −3.8 −5.1 −5.0 −4.9 −3.0 −4.4 −5.0 −3.9 −4.1 −3.4 −3.3 −4.3 −4.2 −4.1 −2.6 −3.8 −4.5
POLY
2019/10/16 12:43:37
−4.6 −4.5 −4.4 −5.9 −5.0 −4.3 −3.9 −5.3 −4.4 −5.2 −4.1 −3.6 −3.7 −5.7 −4.3 −3.7 −3.4 −6.0 −3.7 −4.6
NAFRICA log10 FMR
−4.4 −4.5 −3.9 −5.1 −4.5 −3.8 −3.9 −4.6 −3.9 −5.0 −3.5 −3.8 −2.9 −4.2 −3.5 −2.9 −3.1 −3.7 −3.0 −4.3
MEAST
−5.0 −4.6 −4.5 −5.6 −4.5 −4.6 −4.7 −5.2 −4.9 −5.3 −4.2 −4.0 −3.6 −4.7 −3.9 −3.9 −4.0 −4.5 −4.1 −4.7
EURO
−5.2 −4.1 −4.7 −3.4 −5.3 −5.5 −5.5 −3.8 −5.0 −5.5 −4.4 −3.5 −3.8 −2.7 −4.5 −4.6 −4.8 −3.2 −4.4 −4.8 −1
EASIA
−4.3 −4.4 −3.4 −4.8 −4.4 −4.1 −4.1 −4.3 −4.1 −4.9 −3.4 −3.6 −2.6 −3.9 −3.6 −3.2 −3.3 −3.5 −3.3 −4.2
FRVT
CSAMERIC
-
−5.3 −3.7 −4.4 −4.3 −4.5 −4.4 −4.6 −4.9 −5.1 −5.9 −4.5 −3.3 −3.5 −4.0 −3.7 −3.6 −4.1 −4.6 −4.3 −4.9
CASIA −2
−3.4 −5.9 −4.7 −5.5 −4.9 −5.0 −4.7 −4.8 −4.6 −3.4 −2.8 −6.0 −4.1 −4.9 −4.2 −4.3 −4.2 −4.3 −4.1 −3.0
CARIB

−3.3 −6.0 −5.0 −5.5 −4.9 −5.2 −4.9 −4.9 −4.7 −2.9 −2.9 −6.0 −4.6 −5.3 −4.4 −4.7 −5.0 −4.8 −4.3 −2.6
SSAFRICA
−4.1 −4.6 −3.9 −4.7 −4.6 −4.0 −4.0 −4.2 −3.1 −4.6 −3.3 −3.8 −3.0 −4.0 −3.8 −3.2 −3.3 −3.7 −2.7 −4.0
SASIA

−4
−4.3 −4.4 −4.1 −3.6 −4.9 −4.8 −4.7 −2.7 −4.2 −4.7 −3.7 −3.9 −3.3 −3.1 −4.1 −4.1 −4.1 −2.4 −3.7 −4.2
POLY
−4.3 −4.2 −4.1 −5.6 −4.7 −4.1 −3.7 −5.0 −4.1 −4.9 −3.8 −3.3 −3.5 −5.4 −4.1 −3.5 −3.1 −6.0 −3.6 −4.3
NAFRICA
-
−4.3 −4.2 −3.8 −5.0 −4.3 −3.6 −3.8 −4.5 −3.8 −4.9 −3.4 −3.6 −2.8 −4.1 −3.4 −2.8 −2.9 −3.6 −2.9 −4.2 −5
MEAST
−4.8 −4.3 −4.3 −5.4 −4.3 −4.5 −4.6 −5.1 −4.8 −5.1 −4.1 −3.8 −3.5 −4.7 −3.7 −3.8 −4.0 −4.4 −4.0 −4.5
EURO
−5.0 −3.9 −4.6 −3.2 −5.2 −5.3 −5.4 −3.6 −4.9 −5.3 −4.3 −3.4 −3.8 −2.6 −4.4 −4.5 −4.8 −3.1 −4.3 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.6 −4.3 −4.0 −3.9 −4.1 −4.0 −4.7 −3.3 −3.5 −2.5 −3.8 −3.5 −3.1 −3.2 −3.4 −3.2 −4.1
CSAMERIC
−5.1 −3.5 −4.3 −4.1 −4.3 −4.2 −4.3 −4.7 −4.8 −5.9 −4.2 −3.1 −3.4 −3.7 −3.6 −3.5 −3.9 −4.4 −4.1 −4.9
CASIA
−3.2 −5.6 −4.4 −5.3 −4.7 −4.7 −4.5 −4.6 −4.3 −3.2 −2.6 −6.0 −3.8 −4.7 −4.0 −4.0 −4.1 −4.1 −3.9 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 210: For algorithm intsysmsu-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


250
Cross region FMR at threshold T = 1.361 for algorithm iqface_000, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.2 −5.7 −5.1 −5.3 −5.2 −5.2 −5.0 −3.1 −3.2 −6.0 −4.8 −5.3 −4.8 −4.9 −4.8 −5.0 −4.7 −2.8
SSAFRICA
−4.3 −4.9 −4.2 −4.9 −4.9 −4.2 −4.3 −4.4 −3.2 −4.8 −3.6 −4.3 −3.3 −4.4 −4.1 −3.5 −3.6 −4.0 −2.8 −4.3
SASIA
−4.4 −4.5 −4.2 −3.6 −5.2 −5.2 −5.5 −2.7 −4.3 −5.0 −4.1 −4.0 −3.6 −3.2 −4.6 −4.6 −4.7 −2.4 −3.9 −4.6
POLY
2019/10/16 12:43:37
−4.5 −4.5 −4.3 −5.9 −4.9 −4.2 −3.7 −5.3 −4.4 −5.2 −4.0 −4.0 −3.8 −5.7 −4.4 −3.7 −3.4 −4.9 −3.8 −6.0
NAFRICA log10 FMR
−4.5 −4.4 −4.0 −5.4 −4.6 −3.8 −3.9 −4.8 −4.0 −5.2 −3.7 −3.8 −3.1 −4.5 −3.8 −3.0 −3.2 −4.1 −3.2 −4.5
MEAST
−5.1 −4.5 −4.5 −5.6 −4.5 −4.7 −4.9 −5.4 −5.0 −5.4 −4.4 −4.1 −3.8 −5.1 −4.0 −4.1 −4.2 −4.7 −4.3 −5.0
EURO
−5.3 −4.0 −4.8 −3.3 −5.4 −5.7 −5.6 −3.6 −5.1 −5.5 −4.7 −3.5 −4.2 −2.8 −4.8 −5.1 −5.1 −3.2 −4.7 −5.0 −1
EASIA
−4.3 −4.5 −3.5 −4.9 −4.5 −4.2 −4.2 −4.2 −4.2 −5.0 −3.7 −3.8 −2.8 −4.2 −3.9 −3.5 −3.5 −3.7 −3.5 −4.5
FRVT
CSAMERIC
-
−5.4 −3.5 −4.6 −4.2 −4.5 −4.3 −4.2 −4.6 −5.0 −6.0 −5.0 −3.2 −3.8 −3.8 −3.9 −3.7 −3.9 −4.2 −4.4 −6.0
CASIA −2
−3.5 −5.5 −4.6 −5.5 −5.0 −4.9 −4.7 −4.6 −4.6 −3.5 −2.9 −5.3 −4.1 −5.0 −4.5 −4.4 −4.1 −4.3 −4.2 −3.1
CARIB

−3.2 −6.0 −5.0 −5.4 −4.9 −5.1 −5.0 −5.0 −4.8 −2.8 −2.9 −6.0 −4.6 −5.1 −4.5 −4.6 −5.0 −4.7 −4.4 −2.5
SSAFRICA
−4.1 −4.6 −4.1 −4.7 −4.7 −4.1 −4.1 −4.1 −3.0 −4.6 −3.5 −4.1 −3.2 −4.2 −4.0 −3.4 −3.6 −3.8 −2.7 −4.1
SASIA

−4
−4.2 −4.2 −3.9 −3.3 −5.0 −5.0 −5.2 −2.4 −4.1 −4.7 −3.8 −3.7 −3.4 −3.0 −4.4 −4.5 −4.5 −2.1 −3.7 −4.3
POLY
−4.3 −4.2 −4.0 −5.6 −4.7 −3.9 −3.5 −5.0 −4.1 −4.9 −3.7 −3.7 −3.5 −5.4 −4.2 −3.5 −3.2 −4.6 −3.6 −6.0
NAFRICA
-
−4.4 −4.1 −3.9 −5.3 −4.4 −3.6 −3.7 −4.7 −3.9 −5.0 −3.5 −3.6 −3.0 −4.5 −3.7 −2.9 −3.0 −4.1 −3.1 −4.4 −5
MEAST
−4.8 −4.3 −4.3 −5.4 −4.2 −4.5 −4.7 −5.2 −4.9 −5.1 −4.2 −3.8 −3.7 −4.9 −3.8 −3.9 −4.1 −4.5 −4.2 −4.7
EURO
−5.1 −3.8 −4.7 −3.1 −5.2 −5.6 −5.5 −3.4 −4.8 −5.2 −4.5 −3.3 −4.0 −2.6 −4.6 −4.9 −4.8 −3.0 −4.4 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.2 −4.7 −4.3 −4.1 −4.0 −4.0 −4.0 −4.8 −3.5 −3.7 −2.6 −4.1 −3.7 −3.3 −3.3 −3.5 −3.4 −4.3
CSAMERIC
−5.1 −3.3 −4.3 −3.9 −4.3 −4.0 −3.9 −4.4 −4.8 −5.9 −4.7 −2.9 −3.6 −3.5 −3.7 −3.5 −3.6 −3.9 −4.3 −6.0
CASIA
−3.2 −5.2 −4.3 −5.2 −4.7 −4.7 −4.4 −4.4 −4.3 −3.2 −2.7 −5.0 −3.8 −4.8 −4.3 −4.2 −4.1 −4.0 −3.9 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 211: For algorithm iqface-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


251
Cross region FMR at threshold T = 0.985 for algorithm isap_001, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.6 −6.0 −5.0 −5.6 −5.7 −5.6 −5.7 −3.3 −3.1 −5.3 −5.0 −6.0 −4.5 −4.9 −5.0 −5.4 −5.0 −3.0
SSAFRICA
−4.2 −4.9 −3.9 −5.0 −4.7 −4.3 −4.3 −4.4 −3.6 −4.9 −3.2 −3.9 −2.9 −4.2 −3.8 −3.3 −3.4 −3.7 −3.1 −4.1
SASIA
−4.5 −4.6 −4.2 −3.8 −5.0 −4.8 −4.8 −3.4 −4.6 −5.9 −3.6 −3.8 −3.2 −3.1 −4.1 −3.9 −4.0 −2.9 −3.8 −5.3
POLY
2019/10/16 12:43:37
−5.7 −6.0 −5.4 −6.0 −6.0 −5.3 −6.0 −5.7 −5.1 −6.0 −5.0 −6.0 −4.5 −6.0 −5.2 −4.6 −6.0 −6.0 −4.2 −6.0
NAFRICA log10 FMR
−4.4 −4.8 −4.0 −5.3 −4.7 −4.2 −4.3 −4.6 −4.2 −5.5 −3.4 −3.8 −3.0 −4.4 −3.6 −3.2 −3.3 −3.7 −3.2 −4.7
MEAST
−4.8 −5.2 −4.4 −5.5 −4.6 −4.6 −5.0 −5.4 −5.1 −5.2 −3.8 −4.3 −3.4 −4.6 −3.8 −3.7 −4.0 −4.5 −4.3 −4.4
EURO
−5.1 −3.9 −4.5 −3.1 −5.0 −5.2 −5.5 −3.7 −5.0 −5.9 −4.1 −3.4 −3.6 −2.5 −4.2 −4.3 −4.5 −3.1 −4.3 −5.1 −1
EASIA
−4.1 −4.5 −3.6 −4.5 −4.3 −4.0 −4.2 −4.2 −4.2 −5.0 −3.1 −3.6 −2.6 −3.6 −3.3 −3.0 −3.2 −3.3 −3.2 −4.1
FRVT
CSAMERIC
-
−5.0 −4.0 −4.2 −3.9 −4.4 −4.5 −4.8 −4.7 −5.1 −5.8 −4.0 −3.3 −3.2 −3.7 −3.4 −3.4 −3.8 −4.4 −4.0 −4.7
CASIA −2
−3.5 −6.0 −5.0 −6.0 −4.9 −5.2 −5.3 −5.1 −5.2 −3.4 −2.9 −6.0 −4.3 −5.4 −4.4 −4.5 −4.6 −4.5 −4.6 −3.0
CARIB

−3.4 −6.0 −5.4 −6.0 −4.9 −5.5 −5.6 −5.3 −5.4 −3.1 −2.9 −5.0 −4.9 −6.0 −4.5 −4.9 −5.0 −5.3 −4.8 −2.8
SSAFRICA
−4.2 −4.8 −3.9 −4.9 −4.7 −4.2 −4.3 −4.4 −3.5 −4.8 −3.2 −3.9 −2.9 −4.1 −3.8 −3.3 −3.4 −3.7 −3.0 −4.0
SASIA

−4
−4.4 −4.5 −4.1 −3.7 −4.9 −4.7 −4.7 −3.2 −4.5 −5.9 −3.6 −3.7 −3.2 −3.1 −4.0 −3.8 −3.9 −2.7 −3.8 −5.3
POLY
−5.4 −6.0 −5.2 −6.0 −6.0 −5.0 −6.0 −5.4 −4.9 −5.7 −4.7 −6.0 −4.4 −6.0 −6.0 −4.3 −6.0 −6.0 −4.1 −6.0
NAFRICA
-
−4.4 −4.7 −4.0 −5.2 −4.6 −4.1 −4.3 −4.5 −4.2 −5.3 −3.3 −3.7 −3.0 −4.3 −3.6 −3.2 −3.3 −3.6 −3.2 −4.6 −5
MEAST
−4.7 −5.1 −4.3 −5.4 −4.6 −4.6 −5.1 −5.4 −5.1 −5.1 −3.8 −4.2 −3.4 −4.5 −3.7 −3.7 −4.2 −4.6 −4.2 −4.4
EURO
−5.0 −3.8 −4.4 −3.0 −4.9 −5.2 −5.4 −3.6 −4.9 −5.8 −4.1 −3.2 −3.5 −2.5 −4.2 −4.3 −4.4 −3.1 −4.2 −4.9
−6
EASIA
VERIFICATION
−4.1 −4.5 −3.6 −4.5 −4.3 −4.0 −4.2 −4.1 −4.1 −4.9 −3.1 −3.6 −2.6 −3.5 −3.3 −3.0 −3.2 −3.3 −3.2 −4.0
CSAMERIC
−5.0 −3.7 −4.2 −3.7 −4.4 −4.4 −4.8 −4.5 −5.1 −5.9 −4.0 −3.1 −3.2 −3.4 −3.4 −3.4 −3.9 −4.2 −4.0 −4.9
CASIA
−3.4 −6.0 −4.9 −5.9 −4.8 −5.1 −5.2 −5.0 −5.0 −3.2 −2.8 −6.0 −4.2 −5.3 −4.3 −4.5 −4.4 −4.5 −4.4 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 212: For algorithm isap-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


252
Cross region FMR at threshold T = 23.498 for algorithm isityou_000, giving FMR(T) = 0.0001 globally.
−2.8 −4.9 −4.4 −5.2 −4.3 −4.8 −4.6 −4.4 −4.5 −2.5 −2.6 −5.3 −4.3 −5.3 −4.2 −4.6 −4.4 −4.4 −4.2 −2.3
SSAFRICA
−4.2 −4.6 −4.1 −4.9 −4.6 −4.1 −4.1 −4.4 −3.1 −4.4 −3.5 −4.0 −3.2 −4.2 −3.9 −3.4 −3.5 −3.8 −2.8 −4.0
SASIA
−4.5 −4.6 −4.3 −4.3 −4.9 −4.9 −5.0 −3.8 −4.5 −4.7 −4.1 −3.9 −3.6 −3.8 −4.4 −4.2 −5.1 −3.3 −4.2 −4.4
POLY
2019/10/16 12:43:37
−5.3 −4.7 −4.8 −5.1 −4.8 −4.5 −4.2 −5.0 −4.4 −5.5 −4.4 −4.0 −4.2 −4.5 −4.4 −4.1 −3.7 −4.6 −4.0 −4.9
NAFRICA log10 FMR
−4.6 −4.6 −4.1 −5.1 −4.4 −3.9 −4.1 −4.7 −4.1 −5.1 −3.8 −4.2 −3.2 −4.4 −3.7 −3.2 −3.4 −3.9 −3.4 −4.5
MEAST
−4.6 −4.4 −4.3 −4.9 −4.3 −4.5 −4.6 −4.9 −4.8 −4.5 −4.2 −4.0 −3.6 −4.4 −3.8 −3.8 −4.1 −4.3 −4.3 −4.4
EURO
−5.2 −4.3 −4.8 −3.7 −4.9 −5.1 −5.0 −4.3 −5.1 −5.4 −4.5 −4.0 −3.9 −3.3 −4.5 −4.3 −4.4 −3.9 −4.5 −5.0 −1
EASIA
−4.1 −4.4 −3.5 −4.7 −4.3 −4.1 −4.4 −4.3 −4.3 −4.3 −3.4 −3.7 −2.8 −3.9 −3.5 −3.3 −3.5 −3.5 −3.6 −4.0
FRVT
CSAMERIC
-
−4.7 −4.0 −4.0 −4.2 −4.3 −4.3 −4.3 −4.4 −4.6 −5.4 −3.7 −3.5 −3.0 −3.8 −3.5 −3.3 −3.5 −3.9 −3.7 −4.9
CASIA −2
−2.9 −4.8 −4.3 −5.4 −4.5 −4.8 −4.8 −4.5 −4.4 −2.8 −2.6 −4.4 −3.8 −5.0 −4.1 −4.2 −4.3 −4.2 −4.0 −2.5
CARIB

−2.6 −5.0 −4.3 −5.1 −4.2 −4.7 −4.6 −4.2 −4.2 −2.3 −2.4 −6.0 −4.1 −5.3 −4.0 −4.5 −4.2 −4.2 −3.9 −2.1
SSAFRICA
−4.0 −4.5 −4.0 −4.8 −4.5 −3.9 −3.9 −4.3 −2.8 −4.2 −3.4 −3.9 −3.2 −4.1 −3.8 −3.3 −3.4 −3.8 −2.6 −3.9
SASIA

−4
−4.3 −4.4 −4.2 −4.1 −4.7 −4.7 −4.8 −3.5 −4.3 −4.4 −3.9 −3.9 −3.5 −3.7 −4.2 −4.0 −4.8 −3.1 −4.0 −4.1
POLY
−5.0 −4.4 −4.6 −4.8 −4.5 −4.2 −4.0 −4.8 −4.2 −5.4 −4.2 −3.7 −4.0 −4.3 −4.1 −4.0 −3.6 −6.0 −3.8 −4.6
NAFRICA
-
−4.5 −4.3 −4.0 −4.9 −4.3 −3.7 −4.0 −4.5 −4.0 −4.9 −3.7 −3.9 −3.2 −4.3 −3.7 −3.1 −3.3 −3.8 −3.4 −4.4 −5
MEAST
−4.4 −4.1 −4.2 −4.7 −4.1 −4.3 −4.5 −4.7 −4.7 −4.4 −4.0 −3.8 −3.5 −4.3 −3.7 −3.7 −4.1 −4.3 −4.2 −4.2
EURO
−5.1 −4.1 −4.6 −3.4 −4.7 −4.9 −4.9 −4.1 −4.9 −5.2 −4.5 −3.7 −3.9 −3.1 −4.3 −4.2 −4.4 −3.7 −4.3 −4.9
−6
EASIA
VERIFICATION
−3.9 −4.2 −3.4 −4.6 −4.1 −4.1 −4.2 −4.1 −4.2 −4.1 −3.3 −3.6 −2.7 −3.9 −3.4 −3.2 −3.4 −3.5 −3.5 −3.8
CSAMERIC
−4.6 −3.8 −3.9 −4.0 −4.1 −4.1 −4.2 −4.3 −4.4 −5.3 −3.7 −3.4 −3.0 −3.7 −3.4 −3.3 −3.4 −3.9 −3.6 −6.0
CASIA
−2.7 −4.7 −4.1 −5.3 −4.4 −4.6 −4.7 −4.3 −4.2 −2.6 −2.4 −4.2 −3.6 −4.8 −4.0 −4.1 −4.2 −4.0 −3.7 −2.4
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 213: For algorithm isityou-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


253
Cross region FMR at threshold T = 0.693 for algorithm isystems_001, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.3 −5.7 −5.1 −5.4 −5.1 −5.3 −5.0 −3.2 −3.1 −5.3 −4.8 −5.4 −4.6 −5.0 −4.8 −5.2 −4.5 −2.8
SSAFRICA
−4.3 −4.7 −3.9 −4.9 −4.7 −4.1 −4.2 −4.4 −3.3 −4.8 −3.4 −3.8 −3.0 −4.1 −3.8 −3.3 −3.4 −3.9 −2.8 −4.2
SASIA
−4.5 −4.7 −4.2 −3.8 −5.1 −4.9 −4.9 −2.9 −4.4 −5.0 −3.9 −4.2 −3.4 −3.3 −4.3 −4.1 −4.2 −2.5 −3.9 −4.5
POLY
2019/10/16 12:43:37
−4.5 −4.5 −4.3 −5.8 −4.9 −4.2 −3.9 −5.1 −4.2 −5.1 −3.8 −3.6 −3.5 −5.7 −4.1 −3.4 −3.3 −4.6 −3.3 −4.6
NAFRICA log10 FMR
−4.4 −4.4 −3.8 −5.3 −4.4 −3.7 −3.9 −4.8 −3.9 −5.2 −3.4 −3.7 −2.8 −4.3 −3.5 −2.8 −3.0 −3.9 −2.9 −4.4
MEAST
−5.0 −4.5 −4.5 −5.6 −4.5 −4.6 −4.7 −5.3 −4.9 −5.3 −4.2 −4.1 −3.6 −4.9 −3.8 −3.8 −3.9 −4.6 −4.1 −4.7
EURO
−5.2 −4.2 −4.8 −3.4 −5.4 −5.6 −5.6 −3.8 −5.1 −5.5 −4.4 −3.5 −3.9 −2.8 −4.6 −4.7 −4.8 −3.3 −4.5 −4.9 −1
EASIA
−4.3 −4.4 −3.4 −4.9 −4.4 −4.0 −4.1 −4.3 −4.1 −5.1 −3.4 −3.6 −2.6 −4.0 −3.5 −3.1 −3.2 −3.5 −3.2 −4.5
FRVT
CSAMERIC
-
−5.2 −3.7 −4.3 −4.3 −4.4 −4.3 −4.5 −4.9 −4.7 −5.6 −4.3 −3.3 −3.3 −4.0 −3.7 −3.5 −4.0 −4.5 −3.8 −4.7
CASIA −2
−3.4 −5.4 −4.6 −5.3 −4.8 −4.9 −4.8 −4.7 −4.6 −3.4 −2.8 −4.8 −4.0 −4.6 −4.1 −4.2 −4.1 −4.3 −4.2 −2.9
CARIB

−3.3 −6.0 −5.0 −5.5 −4.9 −5.2 −4.9 −5.0 −4.7 −2.9 −3.0 −5.0 −4.6 −5.2 −4.4 −4.8 −4.7 −5.0 −4.2 −2.6
SSAFRICA
−4.1 −4.5 −3.9 −4.7 −4.6 −4.0 −4.0 −4.2 −3.1 −4.7 −3.3 −3.8 −2.9 −4.1 −3.8 −3.2 −3.4 −3.8 −2.7 −4.1
SASIA

−4
−4.3 −4.5 −4.0 −3.6 −4.9 −4.8 −4.7 −2.6 −4.2 −4.8 −3.8 −4.0 −3.3 −3.1 −4.2 −4.0 −4.1 −2.3 −3.7 −4.2
POLY
−4.3 −4.2 −4.0 −5.6 −4.6 −4.0 −3.6 −4.8 −4.0 −4.9 −3.7 −3.3 −3.3 −5.4 −4.0 −3.3 −3.1 −4.3 −3.3 −4.3
NAFRICA
-
−4.3 −4.2 −3.7 −5.2 −4.3 −3.6 −3.7 −4.6 −3.8 −5.0 −3.3 −3.6 −2.7 −4.3 −3.4 −2.8 −2.9 −3.9 −2.9 −4.3 −5
MEAST
−4.8 −4.3 −4.3 −5.5 −4.3 −4.5 −4.5 −5.2 −4.8 −5.1 −4.1 −3.8 −3.5 −4.8 −3.7 −3.7 −3.8 −4.5 −4.1 −4.5
EURO
−5.0 −4.0 −4.7 −3.2 −5.2 −5.4 −5.6 −3.6 −4.9 −5.3 −4.3 −3.4 −3.8 −2.6 −4.5 −4.6 −4.8 −3.1 −4.4 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.7 −4.3 −3.9 −3.9 −4.1 −4.0 −4.8 −3.3 −3.5 −2.5 −3.9 −3.4 −3.1 −3.2 −3.4 −3.2 −4.3
CSAMERIC
−5.0 −3.4 −4.1 −4.0 −4.2 −4.0 −4.3 −4.6 −4.6 −5.5 −4.3 −3.1 −3.2 −3.7 −3.5 −3.3 −3.9 −4.3 −3.7 −4.6
CASIA
−3.3 −5.1 −4.4 −5.1 −4.6 −4.7 −4.5 −4.4 −4.4 −3.2 −2.6 −4.5 −3.8 −4.5 −4.0 −4.0 −4.0 −4.0 −4.0 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 214: For algorithm isystems-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


254
Cross region FMR at threshold T = 0.690 for algorithm isystems_002, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.2 −5.7 −5.0 −5.2 −4.9 −5.3 −4.9 −3.1 −3.1 −6.0 −4.7 −5.4 −4.5 −5.0 −4.7 −5.1 −4.6 −2.8
SSAFRICA
−4.2 −4.7 −4.0 −4.9 −4.7 −4.1 −4.1 −4.4 −3.3 −4.8 −3.4 −3.9 −3.1 −4.2 −3.9 −3.3 −3.4 −3.9 −2.8 −4.3
SASIA
−4.5 −4.5 −4.2 −3.7 −5.2 −4.9 −4.9 −2.8 −4.4 −5.1 −3.9 −4.1 −3.4 −3.3 −4.3 −4.1 −4.4 −2.5 −3.9 −4.6
POLY
2019/10/16 12:43:37
−4.5 −4.5 −4.2 −5.8 −4.8 −4.1 −3.9 −5.3 −4.3 −5.2 −4.0 −3.6 −3.5 −5.7 −4.1 −3.5 −3.6 −6.0 −3.5 −4.9
NAFRICA log10 FMR
−4.4 −4.4 −3.8 −5.3 −4.5 −3.7 −3.9 −4.7 −3.9 −5.1 −3.4 −3.8 −2.9 −4.4 −3.5 −2.9 −3.0 −4.0 −3.0 −4.4
MEAST
−4.9 −4.5 −4.4 −5.6 −4.5 −4.5 −4.7 −5.3 −4.9 −5.3 −4.2 −3.9 −3.6 −4.8 −3.8 −3.7 −4.0 −4.6 −4.1 −4.7
EURO
−5.2 −4.1 −4.7 −3.4 −5.3 −5.6 −5.7 −3.7 −5.1 −5.5 −4.5 −3.4 −3.8 −2.8 −4.5 −4.7 −5.1 −3.3 −4.5 −4.9 −1
EASIA
−4.2 −4.4 −3.5 −4.8 −4.4 −4.0 −4.1 −4.2 −4.1 −5.0 −3.4 −3.6 −2.6 −4.0 −3.6 −3.2 −3.2 −3.6 −3.3 −4.4
FRVT
CSAMERIC
-
−5.3 −3.7 −4.3 −4.3 −4.5 −4.3 −4.6 −4.8 −4.9 −6.0 −4.5 −3.4 −3.3 −4.0 −3.7 −3.5 −4.0 −4.3 −4.1 −5.2
CASIA −2
−3.4 −5.4 −4.6 −5.3 −4.8 −4.9 −4.6 −4.7 −4.6 −3.4 −2.8 −5.3 −4.0 −4.7 −4.2 −4.2 −4.0 −4.3 −4.2 −2.9
CARIB

−3.3 −5.7 −5.0 −5.5 −4.9 −5.0 −4.6 −5.0 −4.7 −2.9 −2.9 −6.0 −4.5 −5.2 −4.4 −4.7 −4.7 −4.8 −4.3 −2.6
SSAFRICA
−4.1 −4.6 −3.9 −4.8 −4.6 −4.0 −4.0 −4.2 −3.1 −4.6 −3.3 −3.9 −3.0 −4.1 −3.8 −3.2 −3.3 −3.8 −2.7 −4.1
SASIA

−4
−4.3 −4.3 −4.0 −3.5 −5.0 −4.8 −4.6 −2.6 −4.1 −4.8 −3.7 −3.9 −3.2 −3.1 −4.3 −4.0 −4.1 −2.3 −3.7 −4.4
POLY
−4.3 −4.2 −4.0 −5.5 −4.6 −3.9 −3.6 −5.0 −4.1 −5.0 −3.7 −3.3 −3.3 −5.4 −4.0 −3.3 −3.3 −6.0 −3.5 −4.6
NAFRICA
-
−4.2 −4.2 −3.7 −5.1 −4.3 −3.6 −3.7 −4.6 −3.8 −5.0 −3.3 −3.6 −2.8 −4.3 −3.4 −2.8 −2.9 −3.9 −2.9 −4.5 −5
MEAST
−4.8 −4.3 −4.3 −5.4 −4.2 −4.4 −4.5 −5.1 −4.8 −5.1 −4.1 −3.7 −3.5 −4.7 −3.7 −3.6 −3.9 −4.5 −4.0 −4.5
EURO
−5.0 −3.9 −4.6 −3.2 −5.2 −5.5 −5.6 −3.5 −4.9 −5.3 −4.4 −3.3 −3.8 −2.6 −4.4 −4.6 −5.0 −3.1 −4.4 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.3 −4.7 −4.3 −3.9 −3.9 −4.0 −4.0 −4.8 −3.3 −3.5 −2.6 −3.9 −3.5 −3.1 −3.1 −3.4 −3.2 −4.3
CSAMERIC
−5.0 −3.4 −4.1 −4.1 −4.3 −4.1 −4.4 −4.6 −4.6 −6.0 −4.2 −3.1 −3.2 −3.7 −3.6 −3.3 −3.8 −4.1 −3.9 −6.0
CASIA
−3.2 −5.1 −4.3 −5.1 −4.6 −4.6 −4.4 −4.4 −4.3 −3.2 −2.6 −5.0 −3.8 −4.6 −4.0 −4.0 −3.7 −4.0 −3.9 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 215: For algorithm isystems-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


255
Cross region FMR at threshold T = 49.879 for algorithm itmo_005, giving FMR(T) = 0.0001 globally.
−3.3 −6.0 −5.1 −5.8 −4.9 −5.1 −5.0 −5.3 −4.8 −2.9 −2.8 −5.3 −4.5 −5.4 −4.3 −4.6 −4.6 −5.0 −4.3 −2.6
SSAFRICA
−4.2 −4.7 −3.9 −5.0 −4.6 −4.0 −4.1 −4.4 −3.3 −4.6 −3.3 −3.9 −2.9 −4.3 −3.7 −3.2 −3.4 −3.8 −2.8 −3.8
SASIA
−4.5 −5.0 −4.3 −4.0 −5.3 −5.1 −5.2 −3.1 −4.4 −5.1 −3.9 −5.0 −3.6 −3.6 −4.5 −4.2 −4.7 −2.8 −3.8 −4.7
POLY
2019/10/16 12:43:37
−4.8 −4.6 −4.4 −5.8 −5.0 −4.2 −3.9 −5.1 −4.2 −5.2 −4.1 −3.7 −3.7 −5.2 −4.3 −3.5 −3.4 −4.6 −3.4 −4.6
NAFRICA log10 FMR
−4.3 −4.4 −3.7 −5.4 −4.3 −3.7 −3.9 −4.9 −3.9 −5.0 −3.3 −3.5 −2.6 −4.4 −3.3 −2.7 −3.0 −3.9 −3.0 −4.1
MEAST
−4.7 −4.7 −4.2 −5.6 −4.4 −4.4 −4.6 −5.2 −4.8 −5.0 −3.8 −4.0 −3.2 −4.8 −3.6 −3.5 −3.8 −4.4 −3.9 −4.2
EURO
−5.3 −4.3 −4.9 −3.6 −5.6 −5.6 −5.6 −4.0 −5.2 −5.6 −4.4 −3.8 −4.1 −3.0 −4.8 −4.7 −4.8 −3.6 −4.6 −4.9 −1
EASIA
−4.2 −4.4 −3.4 −4.9 −4.3 −3.9 −4.1 −4.3 −4.0 −4.8 −3.2 −3.6 −2.5 −4.1 −3.3 −3.0 −3.1 −3.6 −3.2 −4.0
FRVT
CSAMERIC
-
−5.1 −3.7 −4.2 −4.3 −4.4 −4.2 −4.4 −5.0 −4.8 −5.8 −4.1 −3.2 −3.2 −4.0 −3.5 −3.4 −4.0 −4.4 −3.9 −4.7
CASIA −2
−3.3 −5.5 −4.6 −5.5 −4.7 −4.8 −4.7 −4.8 −4.5 −3.2 −2.6 −4.8 −4.0 −4.9 −4.1 −4.1 −4.1 −4.4 −4.1 −2.7
CARIB

−3.1 −6.0 −4.9 −5.6 −4.7 −4.8 −4.8 −5.1 −4.6 −2.7 −2.7 −5.0 −4.3 −5.2 −4.3 −4.4 −4.5 −4.9 −4.1 −2.4
SSAFRICA
−4.0 −4.5 −3.8 −4.8 −4.5 −4.0 −4.0 −4.3 −3.1 −4.4 −3.2 −3.8 −2.9 −4.2 −3.7 −3.2 −3.4 −3.7 −2.7 −3.8
SASIA

−4
−4.3 −4.7 −4.1 −3.8 −5.1 −4.9 −4.9 −2.9 −4.2 −4.9 −3.8 −4.7 −3.5 −3.4 −4.4 −4.1 −4.5 −2.5 −3.7 −4.4
POLY
−4.6 −4.3 −4.2 −5.5 −4.8 −4.0 −3.6 −4.8 −4.0 −5.0 −4.0 −3.4 −3.5 −5.0 −4.2 −3.4 −3.2 −4.3 −3.3 −4.6
NAFRICA
-
−4.1 −4.2 −3.6 −5.3 −4.2 −3.5 −3.7 −4.8 −3.8 −4.8 −3.1 −3.4 −2.6 −4.4 −3.2 −2.7 −2.9 −3.9 −2.9 −4.0 −5
MEAST
−4.6 −4.4 −4.1 −5.4 −4.2 −4.3 −4.5 −5.0 −4.7 −4.9 −3.8 −3.8 −3.2 −4.7 −3.5 −3.5 −3.7 −4.3 −3.9 −4.2
EURO
−5.1 −4.1 −4.8 −3.3 −5.4 −5.5 −5.5 −3.8 −5.0 −5.4 −4.3 −3.6 −4.0 −2.9 −4.7 −4.7 −4.7 −3.4 −4.4 −4.8
−6
EASIA
VERIFICATION
−4.0 −4.3 −3.3 −4.8 −4.2 −3.9 −3.9 −4.1 −3.9 −4.6 −3.2 −3.5 −2.5 −4.0 −3.3 −2.9 −3.1 −3.5 −3.1 −3.9
CSAMERIC
−4.9 −3.5 −4.1 −4.1 −4.2 −4.0 −4.2 −4.7 −4.6 −5.9 −4.0 −2.9 −3.2 −3.7 −3.4 −3.3 −3.9 −4.1 −3.8 −4.9
CASIA
−3.1 −5.3 −4.3 −5.3 −4.5 −4.6 −4.4 −4.5 −4.3 −3.0 −2.5 −4.5 −3.8 −4.8 −3.9 −3.9 −3.9 −4.2 −3.8 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 216: For algorithm itmo-005 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individ-


256
Cross region FMR at threshold T = 49.789 for algorithm itmo_006, giving FMR(T) = 0.0001 globally.
−3.3 −5.7 −5.0 −6.0 −4.8 −5.0 −4.8 −5.4 −4.6 −2.9 −2.8 −5.3 −4.5 −5.6 −4.3 −4.5 −4.4 −5.2 −4.2 −2.6
SSAFRICA
−4.0 −4.6 −3.9 −5.1 −4.6 −3.9 −4.0 −4.4 −3.0 −4.5 −3.2 −3.9 −3.1 −4.4 −3.8 −3.2 −3.3 −3.9 −2.6 −3.9
SASIA
−4.5 −5.0 −4.4 −4.3 −5.4 −5.2 −5.0 −3.2 −4.3 −5.1 −4.0 −5.0 −3.7 −3.9 −4.7 −4.4 −4.7 −2.8 −3.9 −4.7
POLY
2019/10/16 12:43:37
−4.4 −4.5 −4.1 −5.7 −4.7 −3.9 −3.7 −5.3 −4.0 −5.0 −3.8 −3.7 −3.5 −4.8 −4.1 −3.3 −3.2 −4.9 −3.2 −4.3
NAFRICA log10 FMR
−4.2 −4.2 −3.8 −5.4 −4.3 −3.6 −3.7 −4.8 −3.7 −4.9 −3.3 −3.6 −2.8 −4.5 −3.5 −2.8 −2.9 −4.1 −2.9 −4.1
MEAST
−4.6 −4.5 −4.3 −5.9 −4.3 −4.4 −4.6 −5.2 −4.7 −5.0 −3.8 −3.9 −3.4 −5.1 −3.6 −3.6 −3.8 −4.6 −3.9 −4.2
EURO
−5.3 −4.9 −5.1 −4.2 −5.9 −5.7 −5.6 −4.3 −5.2 −5.8 −4.5 −4.4 −4.3 −3.6 −5.1 −4.8 −4.8 −3.8 −4.7 −4.9 −1
EASIA
−4.1 −4.4 −3.4 −5.1 −4.3 −3.9 −4.0 −4.3 −4.0 −4.7 −3.2 −3.6 −2.6 −4.4 −3.5 −3.1 −3.2 −3.7 −3.2 −4.0
FRVT
CSAMERIC
-
−5.0 −3.8 −4.4 −4.9 −4.4 −4.2 −4.2 −5.4 −4.8 −5.8 −4.3 −3.3 −3.6 −4.5 −3.7 −3.6 −3.7 −6.0 −4.2 −4.7
CASIA −2
−3.2 −5.2 −4.4 −5.6 −4.6 −4.6 −4.4 −4.7 −4.3 −3.2 −2.6 −4.7 −3.8 −5.0 −4.0 −3.9 −3.8 −4.3 −3.9 −2.7
CARIB

−3.1 −5.5 −4.8 −5.7 −4.6 −4.8 −4.6 −5.1 −4.4 −2.7 −2.6 −5.0 −4.3 −5.3 −4.2 −4.2 −4.2 −4.9 −4.0 −2.4
SSAFRICA
−3.8 −4.4 −3.8 −4.9 −4.4 −3.8 −3.8 −4.2 −2.8 −4.3 −3.1 −3.7 −3.0 −4.3 −3.8 −3.1 −3.2 −3.7 −2.5 −3.8
SASIA

−4
−4.3 −4.7 −4.1 −4.0 −5.2 −5.0 −4.8 −2.9 −4.1 −4.8 −3.8 −4.7 −3.5 −3.6 −4.5 −4.4 −4.8 −2.6 −3.6 −4.4
POLY
−4.3 −4.3 −3.9 −5.6 −4.5 −3.7 −3.4 −5.0 −3.8 −4.7 −3.6 −3.4 −3.3 −4.7 −3.9 −3.1 −2.9 −4.6 −3.1 −4.0
NAFRICA
-
−4.0 −4.0 −3.6 −5.3 −4.2 −3.4 −3.5 −4.7 −3.6 −4.7 −3.1 −3.4 −2.7 −4.4 −3.4 −2.7 −2.8 −4.0 −2.9 −4.0 −5
MEAST
−4.5 −4.2 −4.1 −5.8 −4.0 −4.2 −4.4 −5.1 −4.6 −4.8 −3.7 −3.7 −3.3 −5.0 −3.5 −3.5 −3.7 −4.5 −3.9 −4.1
EURO
−5.2 −4.7 −5.0 −4.0 −5.8 −5.6 −5.5 −4.0 −5.1 −5.6 −4.4 −4.2 −4.1 −3.4 −5.0 −4.7 −4.7 −3.6 −4.5 −4.9
−6
EASIA
VERIFICATION
−3.9 −4.2 −3.2 −5.0 −4.2 −3.8 −3.8 −4.1 −3.8 −4.5 −3.1 −3.5 −2.5 −4.2 −3.4 −3.0 −3.1 −3.5 −3.1 −3.9
CSAMERIC
−4.7 −3.6 −4.3 −4.6 −4.1 −3.9 −3.9 −5.1 −4.5 −5.6 −4.1 −3.1 −3.5 −4.2 −3.5 −3.4 −3.5 −6.0 −3.9 −4.6
CASIA
−3.0 −4.9 −4.2 −5.4 −4.4 −4.4 −4.2 −4.5 −4.1 −3.0 −2.4 −4.4 −3.6 −4.8 −3.9 −3.7 −3.6 −4.0 −3.6 −2.5
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 217: For algorithm itmo-006 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individ-


257
Cross region FMR at threshold T = 1.301 for algorithm kakao_001, giving FMR(T) = 0.0001 globally.
−2.7 −6.0 −4.8 −6.0 −4.5 −4.9 −4.9 −5.2 −4.9 −2.3 −2.4 −5.3 −4.5 −5.9 −4.2 −4.7 −4.8 −4.8 −4.4 −2.1
SSAFRICA
−4.5 −5.5 −4.7 −5.0 −5.1 −4.6 −4.6 −4.5 −2.7 −4.8 −4.1 −4.9 −4.2 −4.5 −4.8 −4.2 −4.3 −4.1 −2.4 −4.5
SASIA
−5.0 −4.5 −4.7 −3.7 −5.6 −5.6 −6.0 −2.9 −4.3 −5.4 −4.6 −4.1 −4.1 −3.2 −5.0 −5.1 −6.0 −2.6 −3.8 −5.1
POLY
2019/10/16 12:43:37
−5.6 −5.0 −5.1 −6.0 −5.5 −4.9 −4.4 −6.0 −4.3 −6.0 −5.0 −6.0 −4.4 −5.7 −4.9 −4.3 −3.7 −6.0 −4.0 −6.0
NAFRICA log10 FMR
−4.9 −4.8 −4.9 −6.0 −5.3 −4.6 −4.7 −5.6 −4.2 −5.0 −4.3 −4.3 −4.3 −5.5 −4.5 −4.0 −4.3 −5.3 −3.7 −4.7
MEAST
−4.8 −4.9 −5.2 −6.0 −4.8 −5.2 −5.3 −5.9 −5.4 −4.7 −4.4 −4.4 −4.3 −5.5 −4.2 −4.5 −4.7 −5.7 −5.1 −4.3
EURO
−5.7 −4.0 −5.0 −3.2 −5.4 −6.0 −6.0 −3.7 −5.1 −6.0 −5.2 −3.4 −4.3 −2.6 −4.7 −5.7 −5.9 −3.2 −4.7 −5.4 −1
EASIA
−4.7 −5.2 −4.4 −5.1 −5.3 −5.1 −4.9 −4.7 −4.4 −4.8 −4.2 −4.7 −3.8 −4.3 −4.6 −4.4 −4.4 −4.1 −4.1 −4.4
FRVT
CSAMERIC
-
−5.3 −3.8 −5.0 −3.9 −4.8 −4.7 −4.9 −4.5 −5.5 −6.0 −4.5 −3.2 −4.2 −3.3 −4.0 −4.1 −4.1 −4.1 −4.8 −6.0
CASIA −2
−2.9 −5.6 −4.7 −6.0 −4.6 −5.0 −4.9 −5.1 −4.4 −2.7 −2.6 −5.0 −4.3 −5.7 −4.3 −4.5 −4.2 −4.7 −4.0 −2.4
CARIB

−2.5 −6.0 −4.5 −6.0 −4.2 −4.6 −4.6 −4.9 −4.6 −2.1 −2.2 −5.0 −4.2 −5.6 −3.9 −4.4 −4.7 −4.5 −4.1 −1.8
SSAFRICA
−4.2 −5.2 −4.4 −4.7 −4.9 −4.4 −4.3 −4.3 −2.4 −4.5 −3.8 −4.6 −4.0 −4.3 −4.6 −4.0 −4.0 −3.9 −2.2 −4.2
SASIA

−4
−4.8 −4.2 −4.4 −3.5 −5.3 −5.3 −5.8 −2.7 −4.0 −5.2 −4.3 −3.9 −3.9 −3.0 −4.8 −4.8 −6.0 −2.3 −3.6 −4.8
POLY
−5.3 −4.7 −4.8 −5.9 −5.2 −4.6 −4.1 −5.7 −4.0 −6.0 −4.7 −6.0 −4.1 −5.4 −4.6 −4.0 −3.5 −6.0 −3.7 −6.0
NAFRICA
-
−4.7 −4.5 −4.7 −5.9 −5.0 −4.3 −4.4 −5.3 −3.9 −4.8 −4.0 −4.0 −4.1 −5.2 −4.3 −3.7 −4.0 −5.4 −3.5 −4.5 −5
MEAST
−4.5 −4.6 −5.0 −5.8 −4.5 −5.0 −5.0 −5.7 −5.1 −4.4 −4.1 −4.1 −4.2 −5.4 −4.0 −4.3 −4.4 −5.7 −4.8 −4.0
EURO
−5.5 −3.8 −4.8 −2.9 −5.2 −6.0 −6.0 −3.5 −4.8 −5.7 −5.0 −3.2 −4.1 −2.4 −4.6 −5.7 −5.6 −3.0 −4.4 −5.1
−6
EASIA
VERIFICATION
−4.4 −4.9 −4.2 −5.0 −5.0 −4.8 −4.6 −4.5 −4.1 −4.5 −3.9 −4.5 −3.6 −4.2 −4.4 −4.2 −4.2 −4.0 −3.8 −4.1
CSAMERIC
−5.0 −3.5 −4.7 −3.6 −4.5 −4.4 −4.6 −4.2 −5.2 −5.9 −4.2 −2.9 −4.0 −3.0 −3.8 −3.8 −3.8 −3.8 −4.6 −6.0
CASIA
−2.7 −5.3 −4.4 −5.9 −4.4 −4.7 −4.6 −4.8 −4.1 −2.4 −2.3 −4.7 −4.0 −5.5 −4.0 −4.2 −3.9 −4.4 −3.7 −2.2
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 218: For algorithm kakao-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


258
Cross region FMR at threshold T = 0.929 for algorithm kakao_002, giving FMR(T) = 0.0001 globally.
−3.3 −6.0 −5.1 −6.0 −4.9 −5.3 −5.2 −5.3 −4.6 −3.0 −2.9 −5.3 −4.5 −5.6 −4.3 −4.7 −4.6 −5.0 −4.2 −2.7
SSAFRICA
−4.1 −4.7 −4.0 −5.1 −4.6 −4.0 −4.0 −4.3 −2.8 −4.5 −3.3 −3.9 −3.1 −4.4 −3.9 −3.3 −3.3 −3.8 −2.5 −4.0
SASIA
−4.6 −5.4 −4.5 −4.3 −5.5 −5.3 −5.2 −3.2 −4.3 −5.2 −4.2 −5.0 −4.0 −3.9 −4.8 −4.9 −5.1 −2.9 −3.9 −4.9
POLY
2019/10/16 12:43:37
−4.6 −4.6 −4.3 −5.9 −4.8 −4.2 −3.9 −5.4 −4.1 −5.1 −4.0 −3.6 −3.7 −6.0 −4.3 −3.6 −3.6 −4.9 −3.6 −6.0
NAFRICA log10 FMR
−4.3 −4.2 −3.7 −5.4 −4.2 −3.6 −3.8 −4.9 −3.9 −5.2 −3.3 −3.4 −2.7 −4.4 −3.2 −2.7 −2.9 −4.0 −3.2 −4.5
MEAST
−4.7 −4.5 −4.2 −6.0 −4.3 −4.2 −4.5 −5.5 −4.9 −5.1 −3.9 −3.8 −3.4 −5.4 −3.6 −3.4 −3.8 −5.0 −4.2 −4.6
EURO
−5.4 −5.1 −5.1 −4.1 −5.8 −5.9 −5.9 −4.3 −5.2 −6.0 −4.5 −4.4 −4.2 −3.4 −4.9 −5.0 −5.1 −3.7 −4.6 −5.3 −1
EASIA
−4.1 −4.4 −3.5 −5.1 −4.3 −3.9 −4.0 −4.4 −4.0 −5.0 −3.3 −3.5 −2.6 −4.2 −3.4 −2.9 −3.1 −3.7 −3.3 −4.3
FRVT
CSAMERIC
-
−5.3 −4.2 −4.6 −5.4 −4.5 −4.4 −4.5 −5.2 −4.9 −5.8 −4.7 −3.8 −3.7 −5.0 −3.9 −3.7 −4.2 −4.7 −4.5 −6.0
CASIA −2
−3.3 −5.0 −4.6 −5.8 −4.7 −4.8 −4.6 −4.7 −4.4 −3.3 −2.7 −4.4 −4.0 −5.2 −4.1 −4.2 −3.9 −4.4 −4.0 −2.8
CARIB

−3.1 −6.0 −4.9 −6.0 −4.7 −5.0 −4.9 −5.0 −4.4 −2.7 −2.7 −5.0 −4.4 −5.3 −4.2 −4.5 −4.4 −4.9 −4.0 −2.4
SSAFRICA
−3.9 −4.5 −3.8 −4.9 −4.5 −3.9 −3.8 −4.1 −2.5 −4.3 −3.2 −3.8 −3.0 −4.3 −3.8 −3.2 −3.3 −3.7 −2.2 −3.8
SASIA

−4
−4.4 −5.1 −4.2 −4.1 −5.3 −5.1 −4.9 −3.0 −4.0 −5.0 −4.0 −4.7 −3.8 −3.7 −4.7 −4.8 −4.8 −2.6 −3.7 −4.6
POLY
−4.3 −4.3 −4.0 −5.7 −4.5 −3.9 −3.6 −5.1 −3.9 −4.8 −3.7 −3.3 −3.4 −6.0 −4.0 −3.4 −3.3 −4.6 −3.4 −6.0
NAFRICA
-
−4.1 −4.1 −3.6 −5.3 −4.1 −3.5 −3.6 −4.8 −3.7 −5.0 −3.2 −3.4 −2.6 −4.4 −3.2 −2.6 −2.8 −4.0 −3.1 −4.2 −5
MEAST
−4.5 −4.3 −4.1 −5.9 −4.1 −4.1 −4.4 −5.3 −4.7 −4.9 −3.8 −3.6 −3.3 −5.3 −3.5 −3.3 −3.7 −4.8 −4.2 −4.5
EURO
−5.4 −4.9 −5.0 −3.9 −5.7 −5.8 −5.9 −4.1 −5.0 −5.9 −4.5 −4.3 −4.1 −3.3 −4.8 −5.0 −5.1 −3.5 −4.4 −5.1
−6
EASIA
VERIFICATION
−4.0 −4.2 −3.4 −5.0 −4.2 −3.8 −3.8 −4.2 −3.9 −4.7 −3.2 −3.5 −2.6 −4.1 −3.3 −2.9 −3.0 −3.6 −3.2 −4.1
CSAMERIC
−5.1 −3.9 −4.4 −5.1 −4.3 −4.1 −4.2 −4.9 −4.7 −5.5 −4.7 −3.5 −3.6 −4.7 −3.7 −3.5 −3.9 −4.4 −4.2 −6.0
CASIA
−3.1 −4.7 −4.3 −5.5 −4.5 −4.6 −4.3 −4.4 −4.1 −3.0 −2.6 −4.1 −3.7 −5.0 −3.9 −4.0 −3.7 −4.2 −3.7 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 219: For algorithm kakao-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


259
Cross region FMR at threshold T = 0.686 for algorithm kedacom_000, giving FMR(T) = 0.0001 globally.
−3.2 −5.8 −5.0 −6.0 −4.8 −4.9 −4.7 −5.1 −4.6 −2.9 −2.8 −5.0 −4.5 −5.5 −4.4 −4.6 −4.5 −4.8 −4.2 −2.6
SSAFRICA
−4.0 −4.6 −4.0 −5.2 −4.6 −4.0 −4.0 −4.5 −3.2 −4.4 −3.2 −4.0 −3.1 −4.6 −3.9 −3.2 −3.4 −4.1 −2.8 −3.9
SASIA
−4.5 −5.7 −4.4 −4.4 −5.4 −5.3 −5.1 −3.2 −4.4 −5.0 −4.0 −6.0 −3.9 −4.0 −4.9 −4.8 −5.1 −2.8 −4.0 −4.7
POLY
2019/10/16 12:43:37
−4.3 −4.2 −4.0 −6.0 −4.6 −3.8 −3.6 −5.2 −4.1 −4.8 −3.8 −3.6 −3.3 −5.7 −4.1 −3.3 −3.1 −6.0 −3.4 −4.3
NAFRICA log10 FMR
−4.2 −4.3 −3.8 −5.5 −4.3 −3.6 −3.7 −5.1 −3.8 −4.9 −3.3 −3.8 −2.9 −4.6 −3.5 −2.8 −3.0 −4.4 −3.0 −4.1
MEAST
−4.6 −4.4 −4.3 −6.0 −4.3 −4.5 −4.5 −5.3 −4.7 −5.0 −3.9 −3.9 −3.6 −5.5 −3.8 −3.8 −3.8 −4.6 −4.0 −4.6
EURO
−5.4 −5.5 −5.3 −4.8 −6.0 −5.8 −5.9 −4.4 −5.3 −5.8 −4.6 −5.3 −4.5 −4.3 −5.5 −5.0 −5.1 −4.1 −4.8 −5.3 −1
EASIA
−4.0 −4.4 −3.3 −5.3 −4.3 −4.0 −3.9 −4.4 −4.0 −4.7 −3.3 −3.8 −2.6 −4.5 −3.6 −3.2 −3.2 −3.8 −3.3 −4.1
FRVT
CSAMERIC
-
−5.0 −4.0 −4.4 −5.6 −4.4 −4.2 −4.2 −5.5 −4.9 −5.5 −4.5 −3.6 −3.6 −5.1 −3.8 −3.6 −3.9 −6.0 −4.3 −5.2
CASIA −2
−3.1 −5.0 −4.3 −5.5 −4.5 −4.5 −4.3 −4.6 −4.2 −3.1 −2.6 −4.7 −3.7 −4.9 −3.9 −3.9 −3.7 −4.3 −3.7 −2.7
CARIB

−3.0 −5.5 −4.7 −5.7 −4.6 −4.7 −4.4 −4.9 −4.3 −2.6 −2.6 −4.7 −4.3 −5.3 −4.2 −4.3 −4.3 −4.5 −3.9 −2.4
SSAFRICA
−3.8 −4.5 −3.9 −5.0 −4.5 −3.8 −3.8 −4.3 −3.0 −4.2 −3.1 −3.9 −3.1 −4.5 −3.8 −3.2 −3.3 −3.9 −2.6 −3.8
SASIA

−4
−4.2 −5.4 −4.2 −4.2 −5.3 −5.1 −4.9 −2.9 −4.1 −4.7 −3.7 −6.0 −3.7 −3.8 −4.7 −4.5 −6.0 −2.6 −3.7 −4.5
POLY
−4.0 −3.9 −3.8 −5.9 −4.3 −3.6 −3.3 −5.0 −3.9 −4.5 −3.5 −3.3 −3.1 −5.4 −3.9 −3.1 −2.8 −6.0 −3.3 −4.0
NAFRICA
-
−4.0 −4.0 −3.6 −5.4 −4.2 −3.4 −3.5 −4.9 −3.7 −4.7 −3.2 −3.5 −2.8 −4.5 −3.4 −2.7 −2.8 −4.3 −2.9 −4.0 −5
MEAST
−4.4 −4.1 −4.2 −6.0 −4.0 −4.3 −4.3 −5.2 −4.6 −4.8 −3.8 −3.6 −3.5 −5.5 −3.6 −3.7 −3.7 −4.6 −3.9 −4.5
EURO
−5.3 −5.3 −5.1 −4.6 −6.0 −5.6 −5.7 −4.2 −5.2 −5.6 −4.5 −5.3 −4.4 −4.1 −5.4 −4.8 −5.0 −3.8 −4.6 −5.1
−6
EASIA
VERIFICATION
−3.8 −4.2 −3.1 −5.1 −4.1 −3.8 −3.7 −4.2 −3.9 −4.5 −3.1 −3.7 −2.5 −4.4 −3.5 −3.1 −3.1 −3.6 −3.2 −4.0
CSAMERIC
−4.7 −3.7 −4.2 −5.3 −4.1 −3.9 −3.9 −5.2 −4.6 −5.2 −4.1 −3.4 −3.4 −4.8 −3.6 −3.4 −3.6 −6.0 −4.1 −4.9
CASIA
−2.9 −4.7 −4.0 −5.3 −4.3 −4.3 −4.0 −4.4 −4.0 −2.9 −2.4 −4.4 −3.5 −4.7 −3.8 −3.7 −3.5 −4.1 −3.5 −2.5
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 220: For algorithm kedacom-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


260
Cross region FMR at threshold T = 0.500 for algorithm kneron_003, giving FMR(T) = 0.0001 globally.
−3.9 −6.0 −5.5 −6.0 −5.3 −5.6 −5.9 −5.6 −5.4 −3.5 −3.3 −6.0 −4.6 −5.1 −4.7 −4.9 −5.0 −5.0 −4.8 −3.1
SSAFRICA
−4.0 −4.5 −3.7 −4.6 −4.4 −3.9 −4.2 −4.2 −3.5 −4.6 −3.0 −3.5 −2.7 −3.7 −3.5 −3.0 −3.2 −3.4 −2.8 −3.8
SASIA
−4.5 −4.6 −4.1 −4.0 −4.9 −4.7 −4.8 −3.3 −4.4 −5.4 −3.7 −3.8 −3.1 −3.3 −3.9 −3.7 −3.8 −2.9 −3.6 −4.7
POLY
2019/10/16 12:43:37
−4.8 −4.8 −4.5 −5.7 −5.2 −4.4 −4.4 −5.0 −4.3 −5.5 −3.9 −3.9 −3.7 −4.7 −4.5 −3.6 −3.6 −4.3 −3.3 −4.9
NAFRICA log10 FMR
−4.2 −4.6 −3.7 −4.9 −4.3 −3.8 −4.1 −4.4 −3.9 −4.9 −3.2 −3.6 −2.7 −3.9 −3.3 −2.8 −3.1 −3.5 −2.9 −3.9
MEAST
−4.8 −4.8 −4.2 −5.2 −4.5 −4.5 −4.7 −5.0 −4.7 −5.4 −3.8 −4.0 −3.2 −4.3 −3.6 −3.5 −3.8 −4.1 −3.8 −4.5
EURO
−5.1 −4.3 −4.5 −3.5 −5.2 −5.2 −5.3 −4.0 −5.0 −5.7 −4.1 −3.6 −3.5 −2.8 −4.2 −4.2 −4.3 −3.3 −4.1 −4.8 −1
EASIA
−4.1 −4.3 −3.5 −4.5 −4.3 −4.0 −4.1 −4.1 −3.9 −4.8 −3.1 −3.4 −2.5 −3.5 −3.3 −3.0 −3.1 −3.2 −3.0 −3.9
FRVT
CSAMERIC
-
−5.3 −4.1 −4.4 −4.6 −4.6 −4.5 −5.0 −5.1 −5.1 −5.8 −4.2 −3.6 −3.3 −4.2 −3.7 −3.6 −4.4 −4.4 −4.2 −4.7
CASIA −2
−3.6 −5.4 −4.7 −5.4 −4.8 −4.9 −5.0 −5.0 −4.8 −3.6 −2.8 −4.5 −3.7 −4.5 −4.0 −4.0 −4.3 −4.4 −4.0 −3.0
CARIB

−3.7 −6.0 −5.3 −5.8 −5.2 −5.4 −5.6 −5.3 −5.2 −3.3 −3.1 −6.0 −4.5 −5.0 −4.6 −4.7 −4.7 −4.8 −4.6 −2.9
SSAFRICA
−3.9 −4.4 −3.7 −4.6 −4.4 −3.9 −4.1 −4.2 −3.3 −4.6 −3.0 −3.5 −2.7 −3.7 −3.5 −3.0 −3.2 −3.4 −2.8 −3.7
SASIA

−4
−4.4 −4.5 −4.0 −3.8 −4.8 −4.6 −4.8 −3.1 −4.3 −5.3 −3.6 −3.8 −3.0 −3.2 −3.8 −3.6 −3.9 −2.7 −3.6 −4.6
POLY
−4.7 −4.5 −4.3 −5.5 −5.1 −4.2 −4.1 −4.8 −4.2 −5.4 −3.7 −3.6 −3.6 −4.5 −4.5 −3.4 −3.5 −4.1 −3.3 −4.6
NAFRICA
-
−4.1 −4.4 −3.7 −4.8 −4.2 −3.7 −4.0 −4.4 −3.8 −4.9 −3.1 −3.5 −2.6 −3.9 −3.2 −2.8 −3.0 −3.4 −2.9 −3.9 −5
MEAST
−4.7 −4.7 −4.2 −5.2 −4.4 −4.4 −4.6 −5.0 −4.6 −5.3 −3.7 −3.9 −3.2 −4.2 −3.6 −3.5 −3.8 −4.0 −3.7 −4.4
EURO
−5.0 −4.2 −4.4 −3.4 −5.1 −5.2 −5.3 −3.8 −4.9 −5.6 −4.0 −3.5 −3.4 −2.7 −4.2 −4.1 −4.3 −3.2 −4.1 −4.7
−6
EASIA
VERIFICATION
−4.0 −4.2 −3.4 −4.4 −4.2 −3.9 −4.0 −4.0 −3.9 −4.7 −3.0 −3.3 −2.4 −3.4 −3.3 −2.9 −3.1 −3.1 −3.0 −3.8
CSAMERIC
−5.2 −3.8 −4.3 −4.4 −4.5 −4.4 −4.8 −4.9 −5.0 −5.9 −4.1 −3.3 −3.2 −4.0 −3.6 −3.5 −4.4 −4.4 −4.1 −4.9
CASIA
−3.4 −5.3 −4.5 −5.3 −4.7 −4.8 −4.8 −4.8 −4.6 −3.4 −2.7 −4.4 −3.6 −4.5 −4.0 −3.9 −4.2 −4.3 −3.9 −2.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 221: For algorithm kneron-003 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


261
Cross region FMR at threshold T = 0.701 for algorithm lookman_002, giving FMR(T) = 0.0001 globally.
−3.2 −6.0 −5.0 −5.9 −4.8 −5.2 −5.0 −5.3 −4.8 −2.8 −2.8 −6.0 −4.3 −5.1 −4.3 −4.7 −4.7 −4.7 −4.4 −2.4
SSAFRICA
−4.0 −4.7 −3.8 −5.0 −4.5 −4.0 −4.1 −4.4 −3.1 −4.5 −3.1 −3.8 −2.8 −4.1 −3.6 −3.1 −3.3 −3.7 −2.7 −3.7
SASIA
−4.7 −5.6 −4.5 −4.3 −5.5 −5.3 −5.0 −3.3 −4.5 −5.3 −4.1 −6.0 −3.7 −3.7 −4.7 −4.6 −4.2 −2.9 −3.9 −4.8
POLY
2019/10/16 12:43:37
−4.7 −4.5 −4.4 −5.9 −4.9 −4.2 −4.0 −5.4 −4.3 −5.2 −3.9 −3.7 −3.6 −5.4 −4.4 −3.5 −3.3 −6.0 −3.5 −4.9
NAFRICA log10 FMR
−4.3 −4.4 −3.7 −5.3 −4.3 −3.7 −3.9 −4.8 −3.8 −4.9 −3.2 −3.6 −2.7 −4.3 −3.4 −2.8 −3.0 −3.9 −2.9 −4.0
MEAST
−4.7 −4.6 −4.3 −5.5 −4.5 −4.5 −4.7 −5.3 −4.8 −5.0 −3.8 −3.9 −3.3 −4.6 −3.7 −3.6 −3.9 −4.4 −3.9 −4.4
EURO
−5.2 −4.6 −4.8 −3.8 −5.5 −5.6 −5.7 −4.3 −5.3 −5.6 −4.2 −3.8 −3.8 −3.1 −4.5 −4.6 −4.9 −3.5 −4.5 −4.6 −1
EASIA
−4.0 −4.4 −3.4 −4.7 −4.3 −4.0 −4.1 −4.3 −4.0 −4.7 −3.1 −3.5 −2.5 −3.7 −3.3 −3.0 −3.2 −3.4 −3.1 −3.8
FRVT
CSAMERIC
-
−5.0 −4.0 −4.2 −4.9 −4.4 −4.3 −4.5 −5.2 −4.9 −5.9 −4.0 −3.4 −3.2 −4.3 −3.5 −3.4 −3.7 −4.4 −3.9 −5.2
CASIA −2
−3.2 −5.2 −4.5 −5.4 −4.6 −4.8 −4.7 −4.8 −4.5 −3.1 −2.5 −4.5 −3.7 −4.5 −3.9 −4.0 −4.0 −4.2 −3.8 −2.6
CARIB

−3.0 −6.0 −4.8 −5.8 −4.6 −5.0 −4.7 −5.1 −4.6 −2.5 −2.6 −6.0 −4.2 −5.1 −4.2 −4.7 −4.5 −4.7 −4.2 −2.2
SSAFRICA
−3.9 −4.6 −3.8 −4.9 −4.5 −3.9 −4.0 −4.3 −2.9 −4.4 −3.0 −3.7 −2.8 −4.1 −3.6 −3.1 −3.2 −3.7 −2.5 −3.7
SASIA

−4
−4.4 −5.3 −4.3 −4.1 −5.4 −5.1 −4.9 −3.0 −4.2 −5.0 −3.9 −6.0 −3.6 −3.5 −4.6 −4.5 −4.1 −2.7 −3.8 −4.5
POLY
−4.4 −4.2 −4.2 −5.8 −4.7 −4.0 −3.7 −5.1 −4.2 −5.3 −3.7 −3.4 −3.5 −5.4 −4.3 −3.4 −3.1 −6.0 −3.4 −4.6
NAFRICA
-
−4.1 −4.2 −3.7 −5.2 −4.2 −3.5 −3.7 −4.7 −3.7 −4.8 −3.1 −3.6 −2.6 −4.2 −3.3 −2.7 −2.9 −3.8 −2.9 −3.9 −5
MEAST
−4.5 −4.4 −4.2 −5.5 −4.3 −4.3 −4.6 −5.2 −4.7 −4.8 −3.7 −3.7 −3.2 −4.6 −3.6 −3.5 −3.9 −4.3 −3.8 −4.3
EURO
−5.1 −4.5 −4.7 −3.7 −5.4 −5.5 −5.7 −4.1 −5.1 −5.4 −4.1 −3.7 −3.8 −3.0 −4.5 −4.5 −4.8 −3.4 −4.4 −4.5
−6
EASIA
VERIFICATION
−3.9 −4.3 −3.3 −4.6 −4.2 −3.9 −4.0 −4.2 −3.9 −4.5 −3.0 −3.5 −2.4 −3.6 −3.3 −2.9 −3.1 −3.3 −3.0 −3.8
CSAMERIC
−4.9 −3.8 −4.1 −4.7 −4.2 −4.1 −4.3 −5.1 −4.7 −5.9 −3.9 −3.2 −3.1 −4.2 −3.4 −3.3 −3.5 −4.4 −3.8 −6.0
CASIA
−3.0 −5.0 −4.3 −5.3 −4.4 −4.6 −4.5 −4.6 −4.2 −2.9 −2.4 −4.3 −3.5 −4.4 −3.8 −3.9 −3.9 −4.1 −3.6 −2.4
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 222: For algorithm lookman-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


262
Cross region FMR at threshold T = 0.733 for algorithm lookman_004, giving FMR(T) = 0.0001 globally.
−3.2 −5.6 −4.9 −5.8 −4.7 −4.9 −4.8 −5.0 −4.4 −2.9 −2.9 −5.0 −4.5 −5.4 −4.3 −4.6 −4.5 −4.8 −4.1 −2.6
SSAFRICA
−4.0 −4.7 −4.1 −5.1 −4.6 −4.0 −4.0 −4.2 −2.9 −4.3 −3.4 −4.2 −3.4 −4.7 −4.0 −3.4 −3.5 −3.9 −2.6 −3.9
SASIA
−4.3 −5.1 −4.3 −4.3 −5.3 −5.1 −4.9 −3.0 −4.2 −4.9 −3.8 −4.7 −3.9 −4.0 −4.9 −4.9 −4.6 −2.7 −3.8 −4.4
POLY
2019/10/16 12:43:37
−4.3 −4.2 −4.0 −5.9 −4.6 −3.8 −3.7 −5.1 −4.0 −4.6 −3.9 −3.6 −3.5 −6.0 −4.2 −3.4 −3.2 −4.9 −3.4 −4.2
NAFRICA log10 FMR
−4.3 −4.1 −3.9 −5.7 −4.3 −3.6 −3.7 −5.3 −3.8 −4.9 −3.5 −3.8 −3.2 −5.0 −3.7 −3.0 −3.1 −4.8 −3.2 −4.3
MEAST
−4.6 −4.3 −4.3 −6.0 −4.1 −4.4 −4.5 −5.3 −4.7 −4.9 −4.1 −3.8 −3.8 −5.7 −3.7 −3.8 −4.0 −4.8 −4.2 −4.5
EURO
−5.5 −5.7 −5.5 −4.9 −6.0 −6.0 −6.0 −4.3 −5.2 −5.8 −4.9 −5.6 −4.9 −4.4 −5.7 −5.2 −5.6 −4.0 −4.9 −5.3 −1
EASIA
−4.1 −4.4 −3.4 −5.4 −4.3 −4.0 −4.0 −4.3 −4.1 −4.7 −3.4 −3.9 −2.8 −4.8 −3.8 −3.4 −3.4 −3.9 −3.5 −4.3
FRVT
CSAMERIC
-
−5.0 −3.9 −4.5 −5.7 −4.2 −4.1 −4.2 −5.3 −4.7 −5.3 −4.7 −3.6 −3.9 −5.3 −3.7 −3.6 −3.6 −5.2 −4.2 −6.0
CASIA −2
−3.1 −5.1 −4.3 −5.5 −4.6 −4.6 −4.5 −4.5 −4.1 −3.1 −2.6 −4.8 −3.8 −5.0 −4.1 −4.0 −4.0 −4.3 −3.7 −2.7
CARIB

−3.0 −5.5 −4.6 −5.6 −4.5 −4.6 −4.5 −4.7 −4.2 −2.6 −2.6 −5.0 −4.3 −5.2 −4.1 −4.4 −4.3 −4.5 −3.8 −2.4
SSAFRICA
−3.7 −4.4 −3.8 −4.9 −4.4 −3.8 −3.7 −4.0 −2.7 −4.1 −3.2 −4.0 −3.3 −4.5 −3.9 −3.3 −3.3 −3.7 −2.4 −3.7
SASIA

−4
−4.1 −4.8 −4.1 −4.1 −5.0 −4.8 −4.6 −2.7 −3.9 −4.6 −3.6 −4.4 −3.7 −3.7 −4.6 −4.6 −4.3 −2.4 −3.6 −4.2
POLY
−4.1 −3.9 −3.8 −5.7 −4.3 −3.6 −3.4 −4.8 −3.7 −4.4 −3.6 −3.3 −3.3 −6.0 −4.0 −3.1 −2.9 −4.6 −3.2 −3.9
NAFRICA
-
−4.1 −3.9 −3.7 −5.6 −4.1 −3.4 −3.5 −5.1 −3.6 −4.6 −3.4 −3.5 −3.0 −5.0 −3.5 −2.8 −2.9 −4.7 −3.1 −4.2 −5
MEAST
−4.4 −4.0 −4.1 −6.0 −3.8 −4.1 −4.3 −5.1 −4.5 −4.7 −4.0 −3.5 −3.6 −5.6 −3.4 −3.7 −3.8 −4.6 −4.0 −4.3
EURO
−5.3 −5.4 −5.3 −4.6 −6.0 −5.8 −5.8 −4.0 −5.0 −5.5 −4.7 −5.3 −4.8 −4.2 −5.5 −5.0 −5.3 −3.7 −4.6 −5.1
−6
EASIA
VERIFICATION
−3.9 −4.1 −3.2 −5.2 −4.1 −3.8 −3.7 −4.1 −3.8 −4.5 −3.3 −3.7 −2.7 −4.6 −3.6 −3.3 −3.2 −3.7 −3.3 −4.1
CSAMERIC
−4.7 −3.7 −4.2 −5.4 −4.0 −3.8 −3.9 −5.0 −4.4 −5.0 −4.4 −3.3 −3.7 −5.0 −3.5 −3.4 −3.3 −4.9 −3.9 −6.0
CASIA
−2.9 −4.8 −4.1 −5.3 −4.4 −4.3 −4.3 −4.2 −3.9 −2.8 −2.4 −4.5 −3.6 −4.7 −3.9 −3.8 −3.8 −4.1 −3.5 −2.5
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 223: For algorithm lookman-004 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


263
Cross region FMR at threshold T = 74.511 for algorithm megvii_001, giving FMR(T) = 0.0001 globally.
−2.9 −6.0 −4.7 −6.0 −4.5 −4.7 −4.6 −5.3 −4.4 −2.5 −2.4 −5.3 −4.1 −5.4 −3.9 −4.1 −4.0 −4.9 −3.9 −2.2
SSAFRICA
−3.9 −4.7 −4.0 −5.2 −4.6 −3.9 −3.9 −4.5 −2.8 −4.3 −3.1 −4.1 −3.1 −4.5 −3.8 −3.2 −3.3 −4.0 −2.4 −3.7
SASIA
−4.4 −6.0 −4.7 −5.1 −5.5 −5.2 −5.1 −4.1 −4.1 −5.1 −3.7 −6.0 −3.9 −4.5 −4.7 −4.4 −4.4 −3.5 −3.6 −4.4
POLY
2019/10/16 12:43:37
−4.3 −4.3 −4.1 −6.0 −4.6 −3.9 −3.7 −5.3 −4.0 −5.0 −3.6 −3.6 −3.3 −5.7 −3.9 −3.1 −3.0 −6.0 −3.2 −4.4
NAFRICA log10 FMR
−4.3 −4.2 −3.8 −5.5 −4.2 −3.6 −3.6 −5.2 −3.7 −4.7 −3.3 −3.5 −2.9 −4.6 −3.3 −2.8 −2.8 −4.4 −3.0 −4.0
MEAST
−4.4 −4.2 −4.2 −6.0 −4.0 −4.1 −4.3 −5.3 −4.6 −4.7 −3.6 −3.6 −3.3 −5.1 −3.3 −3.3 −3.7 −4.5 −3.9 −4.0
EURO
−5.6 −5.9 −5.5 −5.0 −6.0 −5.9 −6.0 −5.2 −5.5 −6.0 −4.6 −5.3 −4.6 −4.3 −5.3 −4.9 −5.1 −4.5 −4.9 −5.1 −1
EASIA
−4.0 −4.5 −3.6 −5.5 −4.3 −4.0 −4.1 −4.8 −4.1 −4.5 −3.1 −3.8 −2.7 −4.6 −3.4 −3.1 −3.2 −4.0 −3.3 −3.8
FRVT
CSAMERIC
-
−4.6 −3.9 −4.4 −5.9 −4.2 −4.0 −3.9 −5.8 −4.4 −5.9 −4.2 −3.5 −3.6 −5.2 −3.5 −3.4 −3.4 −6.0 −3.8 −6.0
CASIA −2
−2.8 −4.8 −4.2 −5.7 −4.2 −4.3 −4.2 −4.9 −4.0 −2.8 −2.2 −4.2 −3.5 −4.9 −3.5 −3.6 −3.6 −4.3 −3.5 −2.3
CARIB

−2.7 −5.7 −4.5 −5.9 −4.3 −4.6 −4.3 −5.0 −4.1 −2.3 −2.2 −5.0 −3.9 −5.2 −3.8 −4.0 −3.8 −4.6 −3.7 −2.0
SSAFRICA
−3.7 −4.5 −3.9 −5.0 −4.4 −3.7 −3.7 −4.3 −2.5 −4.2 −3.0 −4.0 −3.0 −4.4 −3.7 −3.1 −3.2 −3.8 −2.2 −3.6
SASIA

−4
−4.3 −6.0 −4.5 −4.9 −5.3 −5.0 −4.9 −3.8 −3.9 −5.1 −3.6 −6.0 −3.8 −4.3 −4.6 −4.3 −4.5 −3.3 −3.4 −4.3
POLY
−4.0 −4.0 −3.9 −5.8 −4.4 −3.7 −3.4 −5.0 −3.7 −4.7 −3.4 −3.3 −3.1 −5.4 −3.8 −3.0 −2.7 −6.0 −3.0 −4.1
NAFRICA
-
−4.1 −3.9 −3.7 −5.4 −4.0 −3.4 −3.4 −5.0 −3.5 −4.5 −3.2 −3.3 −2.8 −4.5 −3.2 −2.6 −2.6 −4.3 −2.9 −3.9 −5
MEAST
−4.2 −3.9 −4.0 −5.9 −3.8 −4.0 −4.1 −5.2 −4.5 −4.5 −3.4 −3.3 −3.2 −5.1 −3.2 −3.2 −3.6 −4.5 −3.8 −3.9
EURO
−5.5 −5.7 −5.4 −4.8 −6.0 −5.8 −5.9 −5.0 −5.4 −5.9 −4.5 −5.0 −4.5 −4.1 −5.2 −4.8 −5.0 −4.3 −4.7 −5.0
−6
EASIA
VERIFICATION
−3.8 −4.3 −3.5 −5.4 −4.1 −3.8 −3.9 −4.6 −3.9 −4.3 −3.0 −3.6 −2.6 −4.5 −3.3 −3.0 −3.1 −3.9 −3.2 −3.7
CSAMERIC
−4.3 −3.6 −4.1 −5.6 −3.9 −3.7 −3.6 −5.5 −4.1 −5.6 −3.8 −3.2 −3.4 −4.9 −3.3 −3.1 −3.1 −6.0 −3.5 −6.0
CASIA
−2.6 −4.5 −3.9 −5.5 −4.0 −4.0 −3.9 −4.6 −3.8 −2.6 −2.0 −3.9 −3.3 −4.8 −3.4 −3.4 −3.3 −4.1 −3.2 −2.2
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 224: For algorithm megvii-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


264
Cross region FMR at threshold T = 66.384 for algorithm megvii_002, giving FMR(T) = 0.0001 globally.
−3.3 −5.4 −4.9 −6.0 −4.9 −4.9 −4.7 −5.2 −4.4 −3.0 −2.8 −4.7 −4.4 −5.4 −4.3 −4.3 −4.3 −4.9 −3.9 −2.6
SSAFRICA
−4.0 −4.5 −4.2 −5.2 −4.8 −4.0 −3.9 −4.5 −2.8 −4.4 −3.5 −4.1 −3.6 −4.7 −4.3 −3.5 −3.4 −4.1 −2.5 −4.0
SASIA
−4.3 −5.2 −4.5 −4.3 −5.4 −5.1 −4.8 −3.3 −4.1 −4.9 −3.9 −6.0 −4.0 −3.8 −4.9 −4.8 −4.7 −2.9 −3.7 −4.4
POLY
2019/10/16 12:43:37
−4.2 −4.1 −4.0 −6.0 −4.3 −3.7 −3.5 −5.3 −3.8 −4.8 −3.6 −3.4 −3.4 −5.4 −3.8 −3.2 −3.0 −4.9 −3.3 −4.3
NAFRICA log10 FMR
−4.3 −3.9 −4.0 −5.8 −4.1 −3.5 −3.5 −5.2 −3.7 −5.0 −3.6 −3.4 −3.3 −5.0 −3.5 −2.9 −2.9 −4.6 −3.2 −4.3
MEAST
−4.5 −3.9 −4.2 −6.0 −3.8 −4.1 −4.2 −5.4 −4.7 −5.1 −3.9 −3.4 −3.6 −5.5 −3.3 −3.6 −3.8 −4.9 −4.3 −4.5
EURO
−5.6 −4.9 −5.5 −4.0 −6.0 −6.0 −5.7 −4.3 −5.4 −5.9 −5.0 −4.4 −4.8 −3.5 −5.5 −5.2 −5.2 −3.9 −5.0 −5.5 −1
EASIA
−4.0 −4.3 −3.6 −5.4 −4.3 −4.1 −4.0 −4.6 −4.1 −4.9 −3.4 −3.9 −3.0 −4.9 −3.7 −3.4 −3.4 −4.1 −3.6 −4.4
FRVT
CSAMERIC
-
−4.4 −3.5 −4.2 −4.8 −3.8 −3.7 −3.7 −5.4 −4.2 −5.6 −3.9 −3.0 −3.6 −4.3 −3.3 −3.2 −3.3 −4.9 −3.7 −4.9
CASIA −2
−3.0 −4.6 −4.0 −5.4 −4.3 −4.2 −4.0 −4.6 −3.9 −3.2 −2.4 −4.0 −3.4 −4.8 −3.7 −3.6 −3.5 −4.1 −3.4 −2.7
CARIB

−3.0 −5.1 −4.6 −5.7 −4.7 −4.6 −4.4 −4.9 −4.1 −2.7 −2.6 −4.4 −4.1 −5.1 −4.2 −4.1 −4.0 −4.6 −3.7 −2.4
SSAFRICA
−3.7 −4.2 −4.0 −4.9 −4.5 −3.7 −3.6 −4.2 −2.5 −4.2 −3.3 −3.8 −3.4 −4.5 −4.1 −3.2 −3.2 −3.9 −2.2 −3.8
SASIA

−4
−4.0 −4.9 −4.2 −4.0 −5.2 −4.8 −4.5 −3.0 −3.8 −4.7 −3.6 −6.0 −3.7 −3.5 −4.6 −4.5 −4.5 −2.6 −3.4 −4.2
POLY
−3.9 −3.8 −3.7 −5.8 −4.0 −3.4 −3.2 −5.0 −3.6 −4.6 −3.3 −3.1 −3.1 −5.1 −3.6 −2.9 −2.7 −4.6 −3.1 −4.0
NAFRICA
-
−4.0 −3.6 −3.7 −5.5 −3.8 −3.2 −3.2 −4.9 −3.5 −4.7 −3.3 −3.1 −3.1 −4.8 −3.3 −2.7 −2.6 −4.3 −3.0 −4.1 −5
MEAST
−4.2 −3.6 −4.0 −5.8 −3.5 −3.8 −3.9 −5.1 −4.5 −4.8 −3.7 −3.1 −3.4 −5.3 −3.0 −3.3 −3.5 −4.6 −4.0 −4.3
EURO
−5.3 −4.7 −5.2 −3.8 −5.8 −5.9 −5.5 −4.0 −5.1 −5.7 −4.8 −4.1 −4.6 −3.3 −5.2 −5.0 −4.9 −3.6 −4.7 −5.2
−6
EASIA
VERIFICATION
−3.8 −4.0 −3.3 −5.2 −4.0 −3.8 −3.7 −4.3 −3.8 −4.6 −3.2 −3.6 −2.7 −4.6 −3.5 −3.2 −3.2 −3.8 −3.3 −4.2
CSAMERIC
−4.1 −3.2 −3.9 −4.5 −3.6 −3.4 −3.4 −5.1 −3.9 −5.3 −3.6 −2.7 −3.3 −4.0 −3.0 −3.0 −3.0 −4.6 −3.4 −4.6
CASIA
−2.8 −4.3 −3.7 −5.2 −4.0 −3.9 −3.7 −4.3 −3.5 −3.0 −2.2 −3.7 −3.2 −4.6 −3.5 −3.3 −3.2 −3.9 −3.1 −2.5
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 225: For algorithm megvii-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


265
Cross region FMR at threshold T = 0.425 for algorithm meiya_001, giving FMR(T) = 0.0001 globally.
−3.1 −5.7 −4.8 −6.0 −4.7 −4.8 −4.7 −5.3 −4.6 −2.7 −2.7 −5.0 −4.3 −5.5 −4.2 −4.3 −4.4 −4.9 −4.2 −2.4
SSAFRICA
−3.9 −4.6 −3.9 −5.2 −4.4 −3.8 −3.9 −4.5 −2.9 −4.3 −3.2 −3.9 −3.0 −4.5 −3.6 −3.0 −3.3 −4.0 −2.5 −3.8
SASIA
−4.6 −5.4 −4.6 −5.0 −5.4 −5.0 −5.4 −3.8 −4.4 −5.2 −4.0 −5.0 −3.7 −4.5 −4.5 −4.1 −5.1 −3.4 −3.8 −4.7
POLY
2019/10/16 12:43:37
−4.4 −4.4 −4.2 −6.0 −4.6 −4.0 −3.8 −5.1 −4.0 −4.7 −3.8 −3.6 −3.5 −6.0 −4.1 −3.4 −3.3 −4.9 −3.3 −4.1
NAFRICA log10 FMR
−4.1 −4.2 −3.7 −5.4 −4.2 −3.5 −3.7 −4.9 −3.7 −4.7 −3.1 −3.6 −2.7 −4.5 −3.3 −2.7 −2.9 −4.1 −2.9 −3.9
MEAST
−4.5 −4.4 −4.2 −6.0 −4.2 −4.3 −4.5 −5.5 −4.6 −4.8 −3.7 −3.9 −3.3 −5.0 −3.6 −3.5 −3.8 −4.6 −3.9 −4.1
EURO
−5.7 −5.8 −5.4 −5.2 −6.0 −5.8 −5.9 −5.1 −5.4 −6.0 −4.9 −5.4 −4.5 −4.6 −5.2 −4.9 −5.1 −4.6 −4.9 −5.8 −1
EASIA
−4.0 −4.5 −3.5 −5.4 −4.3 −3.9 −4.0 −4.7 −4.0 −4.6 −3.2 −3.8 −2.6 −4.5 −3.4 −3.0 −3.2 −3.9 −3.2 −3.9
FRVT
CSAMERIC
-
−5.0 −4.1 −4.4 −5.8 −4.4 −4.2 −4.3 −5.6 −4.8 −5.8 −4.3 −3.8 −3.5 −5.6 −3.7 −3.5 −3.9 −5.2 −4.2 −4.9
CASIA −2
−3.1 −5.0 −4.3 −5.8 −4.5 −4.4 −4.4 −4.9 −4.2 −3.0 −2.5 −4.4 −3.5 −5.0 −3.9 −3.6 −3.8 −4.4 −3.6 −2.6
CARIB

−2.8 −5.4 −4.6 −5.9 −4.5 −4.6 −4.4 −5.0 −4.3 −2.4 −2.5 −4.7 −4.1 −5.3 −4.1 −4.2 −4.2 −4.7 −4.0 −2.2
SSAFRICA
−3.7 −4.4 −3.7 −5.0 −4.3 −3.7 −3.8 −4.3 −2.6 −4.2 −3.0 −3.7 −2.9 −4.4 −3.6 −3.0 −3.2 −3.8 −2.3 −3.6
SASIA

−4
−4.4 −5.1 −4.4 −4.8 −5.3 −4.9 −5.2 −3.5 −4.1 −5.0 −3.9 −4.7 −3.6 −4.3 −4.5 −4.1 −6.0 −3.2 −3.6 −4.4
POLY
−4.2 −4.2 −4.0 −5.9 −4.4 −3.8 −3.5 −4.8 −3.8 −4.5 −3.6 −3.3 −3.4 −6.0 −3.9 −3.2 −3.0 −4.6 −3.2 −4.0
NAFRICA
-
−3.9 −4.0 −3.6 −5.3 −4.0 −3.4 −3.6 −4.7 −3.5 −4.5 −3.0 −3.5 −2.7 −4.5 −3.2 −2.6 −2.8 −4.0 −2.8 −3.8 −5
MEAST
−4.4 −4.2 −4.1 −5.9 −4.0 −4.2 −4.3 −5.4 −4.5 −4.6 −3.6 −3.7 −3.3 −5.0 −3.4 −3.5 −3.7 −4.6 −3.8 −4.0
EURO
−5.5 −5.5 −5.3 −5.0 −6.0 −5.7 −5.8 −4.9 −5.3 −6.0 −4.7 −5.1 −4.4 −4.4 −5.1 −4.8 −4.9 −4.4 −4.8 −5.6
−6
EASIA
VERIFICATION
−3.9 −4.3 −3.4 −5.2 −4.1 −3.8 −3.9 −4.5 −3.9 −4.4 −3.1 −3.7 −2.6 −4.4 −3.3 −2.9 −3.1 −3.8 −3.2 −3.8
CSAMERIC
−4.8 −3.9 −4.3 −5.5 −4.1 −4.0 −4.1 −5.4 −4.5 −5.9 −4.2 −3.6 −3.5 −5.3 −3.5 −3.4 −3.8 −4.9 −4.0 −6.0
CASIA
−2.8 −4.7 −4.1 −5.7 −4.3 −4.2 −4.2 −4.6 −3.9 −2.8 −2.4 −4.1 −3.4 −4.9 −3.7 −3.5 −3.6 −4.2 −3.4 −2.4
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 226: For algorithm meiya-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


266
Cross region FMR at threshold T = 0.668 for algorithm microfocus_001, giving FMR(T) = 0.0001 globally.
−3.2 −6.0 −5.1 −6.0 −4.8 −5.0 −4.8 −5.2 −4.8 −2.8 −3.0 −6.0 −4.7 −5.8 −4.5 −4.6 −4.5 −5.1 −4.4 −2.5
SSAFRICA
−4.3 −4.7 −4.0 −4.8 −4.7 −4.1 −4.2 −4.1 −3.0 −4.7 −3.6 −4.1 −3.2 −4.2 −4.0 −3.5 −3.6 −3.7 −2.7 −4.2
SASIA
−4.4 −4.5 −4.2 −3.7 −5.1 −5.1 −4.9 −3.0 −4.2 −5.4 −4.1 −4.2 −3.8 −3.3 −4.6 −4.8 −4.6 −2.8 −3.9 −5.6
POLY
2019/10/16 12:43:37
−4.8 −4.7 −4.3 −5.4 −4.8 −4.3 −4.1 −4.8 −4.4 −6.0 −4.4 −4.3 −3.8 −5.0 −4.6 −3.7 −3.9 −6.0 −3.9 −6.0
NAFRICA log10 FMR
−4.6 −4.4 −4.0 −5.2 −4.4 −3.9 −4.0 −4.5 −4.0 −5.2 −3.7 −3.8 −3.1 −4.5 −3.6 −3.2 −3.3 −3.8 −3.4 −4.3
MEAST
−4.9 −4.6 −4.4 −5.4 −4.4 −4.5 −4.6 −5.1 −4.9 −5.1 −4.1 −4.0 −3.7 −4.7 −3.8 −3.9 −4.0 −4.5 −4.3 −4.7
EURO
−5.3 −4.1 −4.7 −3.3 −5.4 −5.5 −5.4 −3.6 −4.9 −5.7 −4.7 −3.7 −4.0 −2.9 −4.7 −4.7 −4.7 −3.3 −4.5 −5.2 −1
EASIA
−4.3 −4.5 −3.7 −4.8 −4.4 −4.1 −4.1 −4.1 −4.1 −4.7 −3.5 −3.8 −2.9 −4.1 −3.6 −3.3 −3.4 −3.5 −3.4 −4.1
FRVT
CSAMERIC
-
−4.9 −3.9 −4.3 −4.0 −4.4 −4.3 −4.4 −4.5 −4.8 −5.4 −4.0 −3.5 −3.4 −3.6 −3.6 −3.5 −3.8 −4.2 −4.2 −4.6
CASIA −2
−3.3 −4.9 −4.6 −5.4 −4.7 −4.7 −4.6 −4.4 −4.4 −3.1 −2.9 −4.4 −4.0 −4.9 −4.2 −4.1 −4.0 −4.0 −4.1 −2.8
CARIB

−3.0 −5.7 −4.8 −5.9 −4.6 −4.7 −4.5 −4.9 −4.6 −2.5 −2.7 −6.0 −4.5 −5.6 −4.3 −4.4 −4.3 −5.0 −4.2 −2.3
SSAFRICA
−4.1 −4.5 −3.8 −4.6 −4.5 −3.9 −4.0 −3.9 −2.7 −4.5 −3.5 −4.0 −3.1 −4.1 −3.9 −3.4 −3.6 −3.6 −2.4 −4.0
SASIA

−4
−4.2 −4.2 −4.0 −3.4 −4.9 −4.8 −4.6 −2.8 −4.0 −5.2 −3.9 −3.9 −3.6 −3.1 −4.4 −4.6 −4.3 −2.5 −3.7 −6.0
POLY
−4.6 −4.4 −4.0 −5.2 −4.5 −4.0 −3.8 −4.5 −4.1 −6.0 −4.1 −4.0 −3.6 −4.8 −4.4 −3.5 −3.6 −6.0 −3.7 −6.0
NAFRICA
-
−4.4 −4.2 −3.9 −5.0 −4.2 −3.7 −3.8 −4.3 −3.8 −5.0 −3.6 −3.6 −3.0 −4.4 −3.5 −3.1 −3.2 −3.7 −3.2 −4.2 −5
MEAST
−4.7 −4.3 −4.3 −5.3 −4.1 −4.3 −4.4 −4.9 −4.7 −4.8 −4.0 −3.8 −3.6 −4.6 −3.7 −3.8 −3.9 −4.4 −4.2 −4.5
EURO
−5.1 −3.9 −4.6 −3.0 −5.2 −5.3 −5.3 −3.4 −4.7 −5.5 −4.6 −3.4 −3.9 −2.7 −4.6 −4.6 −4.6 −3.1 −4.3 −5.0
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.6 −4.6 −4.3 −4.0 −4.0 −3.9 −3.9 −4.5 −3.4 −3.7 −2.8 −4.0 −3.5 −3.2 −3.3 −3.4 −3.3 −4.0
CSAMERIC
−4.7 −3.6 −4.1 −3.7 −4.1 −4.0 −4.2 −4.2 −4.6 −5.2 −4.1 −3.2 −3.3 −3.4 −3.5 −3.4 −3.6 −3.9 −4.0 −4.6
CASIA
−3.1 −4.6 −4.3 −5.1 −4.5 −4.5 −4.3 −4.2 −4.2 −2.9 −2.7 −4.1 −3.8 −4.7 −4.0 −3.9 −3.8 −3.8 −3.9 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 227: For algorithm microfocus-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


267
Cross region FMR at threshold T = 0.602 for algorithm microfocus_002, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.4 −6.0 −5.1 −5.4 −5.5 −5.4 −5.2 −3.2 −3.1 −6.0 −4.9 −5.9 −4.7 −4.9 −6.0 −4.9 −4.7 −2.9
SSAFRICA
−4.3 −4.7 −4.0 −4.9 −4.6 −4.1 −4.3 −4.4 −3.3 −4.9 −3.5 −3.9 −3.0 −4.1 −3.8 −3.3 −3.5 −3.9 −2.9 −4.2
SASIA
−4.6 −4.5 −4.4 −3.6 −5.3 −5.0 −5.1 −3.1 −4.5 −5.1 −4.0 −4.2 −3.7 −3.2 −4.8 −4.3 −4.4 −2.8 −4.1 −4.5
POLY
2019/10/16 12:43:37
−5.1 −5.0 −4.6 −5.6 −5.2 −4.4 −4.3 −5.2 −4.5 −5.7 −4.4 −3.9 −4.1 −5.1 −5.1 −3.9 −3.9 −6.0 −4.0 −6.0
NAFRICA log10 FMR
−4.4 −4.4 −3.8 −5.1 −4.3 −3.8 −4.0 −4.6 −4.1 −5.3 −3.4 −3.6 −2.8 −4.4 −3.4 −3.0 −3.1 −3.7 −3.2 −4.4
MEAST
−4.8 −4.7 −4.2 −5.3 −4.4 −4.4 −4.6 −5.1 −4.9 −5.2 −3.9 −4.0 −3.3 −4.4 −3.6 −3.6 −3.8 −4.4 −4.1 −4.5
EURO
−5.2 −4.1 −4.7 −3.2 −5.1 −5.3 −5.5 −3.6 −5.1 −5.6 −4.3 −3.5 −3.8 −2.7 −4.4 −4.5 −4.6 −3.2 −4.5 −4.8 −1
EASIA
−4.2 −4.5 −3.6 −4.7 −4.3 −3.9 −4.1 −4.3 −4.2 −5.0 −3.2 −3.6 −2.6 −3.8 −3.3 −3.0 −3.2 −3.5 −3.3 −4.2
FRVT
CSAMERIC
-
−5.1 −3.9 −4.2 −3.9 −4.5 −4.3 −4.6 −4.6 −4.9 −5.8 −4.1 −3.4 −3.2 −3.6 −3.5 −3.4 −3.8 −4.4 −4.0 −4.7
CASIA −2
−3.4 −5.0 −4.6 −5.6 −4.8 −4.9 −4.9 −4.7 −4.7 −3.4 −2.9 −4.4 −3.9 −5.0 −4.2 −4.2 −4.1 −4.3 −4.2 −3.0
CARIB

−3.3 −6.0 −5.1 −6.0 −4.9 −5.1 −5.2 −5.1 −4.9 −2.9 −2.9 −6.0 −4.7 −5.7 −4.6 −4.7 −6.0 −4.7 −4.5 −2.6
SSAFRICA
−4.2 −4.6 −3.9 −4.7 −4.6 −4.0 −4.2 −4.3 −3.1 −4.8 −3.4 −3.9 −2.9 −4.1 −3.7 −3.2 −3.4 −3.8 −2.7 −4.1
SASIA

−4
−4.4 −4.2 −4.2 −3.4 −5.1 −4.9 −5.0 −2.9 −4.3 −4.9 −3.9 −4.1 −3.6 −3.0 −4.6 −4.2 −4.2 −2.6 −3.9 −4.4
POLY
−5.0 −4.7 −4.4 −5.5 −4.9 −4.2 −4.1 −5.0 −4.3 −5.4 −4.2 −3.6 −3.9 −4.8 −4.8 −3.7 −3.8 −6.0 −3.9 −6.0
NAFRICA
-
−4.3 −4.3 −3.7 −5.0 −4.2 −3.7 −3.9 −4.4 −3.9 −5.1 −3.4 −3.5 −2.8 −4.4 −3.3 −2.9 −3.1 −3.7 −3.2 −4.3 −5
MEAST
−4.6 −4.4 −4.2 −5.2 −4.3 −4.4 −4.5 −5.0 −4.9 −5.1 −3.8 −3.9 −3.2 −4.4 −3.5 −3.5 −3.8 −4.4 −4.1 −4.5
EURO
−5.1 −3.9 −4.6 −3.0 −5.0 −5.3 −5.3 −3.4 −4.9 −5.4 −4.2 −3.4 −3.7 −2.6 −4.3 −4.4 −4.6 −3.0 −4.4 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.4 −3.5 −4.6 −4.2 −3.9 −4.0 −4.1 −4.1 −4.8 −3.2 −3.6 −2.6 −3.7 −3.3 −2.9 −3.1 −3.4 −3.2 −4.1
CSAMERIC
−4.9 −3.6 −4.1 −3.7 −4.3 −4.2 −4.5 −4.4 −4.7 −5.9 −4.0 −3.2 −3.1 −3.4 −3.4 −3.4 −3.7 −4.1 −3.9 −4.9
CASIA
−3.2 −4.7 −4.5 −5.3 −4.7 −4.7 −4.7 −4.4 −4.5 −3.2 −2.7 −4.1 −3.8 −4.8 −4.1 −4.0 −4.0 −4.2 −4.0 −2.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 228: For algorithm microfocus-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


268
Cross region FMR at threshold T = 1.394 for algorithm mt_000, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.3 −5.9 −5.0 −5.3 −5.1 −5.2 −5.0 −3.1 −3.1 −5.3 −4.8 −5.6 −4.5 −4.8 −5.0 −4.9 −4.6 −2.8
SSAFRICA
−4.3 −4.8 −4.0 −4.9 −4.7 −4.2 −4.2 −4.4 −3.3 −4.7 −3.5 −4.0 −3.1 −4.2 −3.9 −3.4 −3.5 −3.8 −2.8 −4.1
SASIA
−4.5 −4.7 −4.2 −3.7 −5.1 −5.0 −5.3 −2.9 −4.3 −5.0 −4.0 −4.1 −3.4 −3.3 −4.3 −4.2 −4.7 −2.5 −3.8 −4.6
POLY
2019/10/16 12:43:37
−4.5 −4.4 −4.2 −5.7 −4.8 −4.1 −3.8 −5.3 −4.4 −5.2 −3.9 −3.6 −3.6 −5.7 −4.3 −3.5 −3.3 −6.0 −3.8 −4.6
NAFRICA log10 FMR
−4.5 −4.4 −3.9 −5.3 −4.5 −3.8 −3.9 −4.8 −4.0 −5.1 −3.6 −3.6 −2.9 −4.6 −3.6 −2.9 −3.1 −4.1 −3.0 −4.3
MEAST
−4.9 −4.6 −4.4 −5.6 −4.4 −4.5 −4.7 −5.3 −4.9 −5.2 −4.2 −3.9 −3.5 −4.8 −3.8 −3.8 −4.0 −4.5 −4.0 −4.7
EURO
−5.2 −4.1 −4.7 −3.4 −5.3 −5.6 −5.6 −3.8 −5.1 −5.6 −4.4 −3.5 −3.9 −2.8 −4.6 −4.8 −4.9 −3.3 −4.5 −4.9 −1
EASIA
−4.3 −4.4 −3.4 −4.8 −4.4 −4.1 −4.1 −4.2 −4.1 −5.0 −3.5 −3.6 −2.6 −4.0 −3.6 −3.2 −3.3 −3.5 −3.4 −4.4
FRVT
CSAMERIC
-
−5.3 −3.7 −4.5 −4.3 −4.5 −4.3 −4.6 −4.8 −5.1 −6.0 −4.5 −3.3 −3.6 −4.0 −3.8 −3.7 −4.2 −4.9 −4.5 −6.0
CASIA −2
−3.4 −5.6 −4.6 −5.6 −4.9 −4.9 −4.6 −4.8 −4.6 −3.4 −2.9 −5.0 −4.0 −5.1 −4.2 −4.3 −3.9 −4.4 −4.1 −3.0
CARIB

−3.3 −6.0 −5.0 −5.6 −4.8 −5.1 −4.9 −5.0 −4.7 −2.8 −2.9 −5.0 −4.6 −5.3 −4.3 −4.5 −4.7 −4.6 −4.3 −2.6
SSAFRICA
−4.1 −4.6 −3.9 −4.7 −4.6 −4.1 −4.1 −4.2 −3.1 −4.5 −3.4 −3.9 −3.1 −4.1 −3.9 −3.3 −3.4 −3.7 −2.7 −4.0
SASIA

−4
−4.3 −4.5 −4.0 −3.5 −5.0 −4.9 −5.1 −2.6 −4.1 −4.8 −3.8 −3.9 −3.3 −3.1 −4.2 −4.1 −4.8 −2.3 −3.6 −4.4
POLY
−4.2 −4.1 −4.0 −5.5 −4.6 −3.8 −3.5 −5.0 −4.1 −4.9 −3.6 −3.3 −3.4 −5.4 −4.0 −3.3 −3.1 −6.0 −3.6 −4.3
NAFRICA
-
−4.3 −4.1 −3.8 −5.2 −4.3 −3.6 −3.7 −4.7 −3.8 −5.0 −3.4 −3.4 −2.9 −4.5 −3.5 −2.8 −2.9 −4.0 −3.0 −4.3 −5
MEAST
−4.8 −4.3 −4.3 −5.4 −4.2 −4.4 −4.5 −5.1 −4.8 −5.0 −4.1 −3.7 −3.5 −4.7 −3.6 −3.7 −4.0 −4.4 −4.0 −4.6
EURO
−5.1 −3.9 −4.6 −3.2 −5.2 −5.5 −5.4 −3.6 −4.9 −5.4 −4.3 −3.4 −3.8 −2.7 −4.5 −4.8 −4.8 −3.1 −4.3 −4.9
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.2 −4.7 −4.3 −3.9 −3.9 −4.0 −4.0 −4.8 −3.4 −3.5 −2.5 −3.9 −3.5 −3.1 −3.2 −3.4 −3.3 −4.2
CSAMERIC
−5.1 −3.4 −4.3 −4.1 −4.3 −4.1 −4.4 −4.5 −4.9 −5.9 −4.3 −3.1 −3.5 −3.7 −3.6 −3.5 −4.1 −4.6 −4.4 −6.0
CASIA
−3.2 −5.4 −4.4 −5.4 −4.7 −4.6 −4.3 −4.6 −4.3 −3.2 −2.7 −5.0 −3.8 −4.9 −4.1 −4.1 −3.7 −4.2 −3.9 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 229: For algorithm mt-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


269
Cross region FMR at threshold T = 46.101 for algorithm neurotechnology_005, giving FMR(T) = 0.0001 globally.
−3.7 −6.0 −5.3 −5.9 −5.2 −5.5 −5.4 −5.3 −5.1 −3.3 −3.2 −6.0 −4.6 −5.4 −4.7 −5.0 −5.0 −5.3 −4.6 −3.0
SSAFRICA
−4.2 −4.8 −3.9 −4.9 −4.7 −4.1 −4.2 −4.4 −3.4 −4.8 −3.4 −4.0 −3.0 −4.2 −3.8 −3.3 −3.3 −3.8 −2.9 −4.1
SASIA
−4.5 −4.6 −4.1 −3.7 −5.1 −5.0 −5.1 −2.9 −4.5 −5.0 −4.0 −3.8 −3.3 −3.0 −4.2 −4.2 −4.6 −2.5 −3.9 −4.5
POLY
2019/10/16 12:43:37
−4.6 −4.7 −4.3 −6.0 −5.0 −4.3 −4.0 −5.6 −4.5 −5.5 −4.2 −3.9 −3.6 −6.0 −4.3 −3.7 −3.6 −6.0 −3.9 −4.9
NAFRICA log10 FMR
−4.4 −4.4 −3.8 −5.1 −4.5 −3.8 −4.0 −4.6 −4.0 −5.1 −3.5 −3.8 −2.8 −4.3 −3.5 −2.9 −3.1 −3.7 −3.0 −4.3
MEAST
−4.9 −4.6 −4.4 −5.4 −4.5 −4.6 −4.7 −5.1 −4.9 −5.3 −4.0 −3.9 −3.5 −4.5 −3.8 −3.8 −3.9 −4.4 −4.1 −4.6
EURO
−5.1 −4.1 −4.6 −3.3 −5.1 −5.4 −5.6 −3.7 −5.0 −5.6 −4.2 −3.4 −3.6 −2.7 −4.3 −4.5 −4.7 −3.0 −4.3 −4.8 −1
EASIA
−4.3 −4.5 −3.5 −4.6 −4.4 −4.1 −4.1 −4.2 −4.1 −5.0 −3.4 −3.7 −2.6 −3.7 −3.6 −3.2 −3.2 −3.4 −3.2 −4.2
FRVT
CSAMERIC
-
−5.2 −3.9 −4.3 −4.4 −4.5 −4.3 −4.6 −5.2 −4.9 −5.9 −4.2 −3.6 −3.3 −4.1 −3.7 −3.5 −3.9 −4.7 −4.0 −5.2
CASIA −2
−3.5 −5.6 −4.7 −5.5 −4.9 −5.0 −4.8 −4.8 −4.7 −3.6 −2.9 −5.3 −4.0 −4.9 −4.2 −4.2 −4.2 −4.3 −4.2 −3.1
CARIB

−3.4 −6.0 −5.0 −5.6 −5.0 −5.2 −5.1 −5.0 −4.9 −3.0 −3.1 −6.0 −4.5 −5.2 −4.5 −4.7 −4.7 −5.1 −4.4 −2.7
SSAFRICA
−4.1 −4.7 −3.9 −4.8 −4.6 −4.0 −4.1 −4.3 −3.2 −4.6 −3.3 −4.0 −2.9 −4.1 −3.8 −3.3 −3.3 −3.7 −2.8 −4.0
SASIA

−4
−4.3 −4.4 −4.0 −3.5 −4.9 −4.9 −4.9 −2.7 −4.2 −4.7 −3.8 −3.7 −3.2 −2.9 −4.1 −4.2 −4.5 −2.3 −3.7 −4.3
POLY
−4.4 −4.4 −4.1 −5.7 −4.8 −4.0 −3.7 −5.3 −4.3 −5.3 −3.8 −3.6 −3.4 −6.0 −4.1 −3.5 −3.5 −6.0 −3.8 −4.6
NAFRICA
-
−4.3 −4.3 −3.7 −5.0 −4.3 −3.7 −3.8 −4.5 −3.9 −5.0 −3.4 −3.7 −2.8 −4.2 −3.5 −2.8 −3.0 −3.7 −3.0 −4.2 −5
MEAST
−4.8 −4.3 −4.3 −5.3 −4.3 −4.5 −4.6 −5.1 −4.8 −5.2 −4.0 −3.7 −3.4 −4.5 −3.7 −3.8 −3.9 −4.3 −4.0 −4.5
EURO
−5.0 −3.9 −4.5 −3.2 −5.1 −5.3 −5.5 −3.5 −4.9 −5.5 −4.1 −3.3 −3.6 −2.6 −4.3 −4.4 −4.7 −2.9 −4.2 −5.0
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.5 −4.3 −4.0 −4.0 −4.0 −4.0 −4.8 −3.3 −3.6 −2.5 −3.7 −3.5 −3.1 −3.2 −3.3 −3.2 −4.1
CSAMERIC
−5.0 −3.6 −4.2 −4.2 −4.3 −4.1 −4.3 −4.9 −4.8 −5.9 −4.1 −3.3 −3.3 −3.8 −3.6 −3.3 −3.7 −4.4 −3.9 −6.0
CASIA
−3.3 −5.3 −4.4 −5.3 −4.7 −4.7 −4.6 −4.5 −4.4 −3.3 −2.8 −5.0 −3.8 −4.7 −4.1 −4.0 −4.0 −4.1 −3.9 −2.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 230: For algorithm neurotechnology-005 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from


270
Cross region FMR at threshold T = 2044.000 for algorithm neurotechnology_006, giving FMR(T) = 0.0001 globally.
−3.4 −6.0 −5.1 −6.0 −5.0 −5.1 −5.2 −5.3 −4.8 −3.0 −3.0 −6.0 −4.8 −5.7 −4.6 −4.6 −5.0 −5.1 −4.4 −2.7
SSAFRICA
−4.2 −4.8 −4.2 −5.0 −4.8 −4.1 −4.1 −4.4 −3.1 −4.6 −3.6 −4.1 −3.4 −4.4 −4.1 −3.5 −3.5 −4.0 −2.7 −4.2
SASIA
−4.4 −4.6 −4.2 −3.7 −5.2 −5.3 −5.0 −2.7 −4.2 −5.1 −3.9 −4.1 −3.7 −3.3 −4.5 −4.9 −4.7 −2.4 −3.8 −4.8
POLY
2019/10/16 12:43:37
−4.4 −4.4 −4.1 −5.9 −4.7 −3.9 −3.7 −5.2 −4.1 −5.0 −3.8 −3.6 −3.5 −5.7 −4.2 −3.3 −3.2 −4.9 −3.5 −4.4
NAFRICA log10 FMR
−4.5 −4.4 −4.1 −5.5 −4.6 −3.8 −3.9 −5.0 −3.9 −5.1 −3.8 −3.8 −3.3 −4.7 −3.9 −3.1 −3.1 −4.3 −3.2 −4.4
MEAST
−5.0 −4.5 −4.6 −5.9 −4.4 −4.7 −4.6 −5.5 −5.0 −5.2 −4.4 −4.0 −3.9 −5.4 −3.9 −4.0 −4.0 −4.9 −4.3 −4.7
EURO
−5.4 −4.2 −5.0 −3.5 −5.6 −5.8 −5.9 −3.7 −5.1 −5.6 −4.7 −3.7 −4.3 −2.9 −4.9 −4.9 −5.1 −3.3 −4.6 −4.9 −1
EASIA
−4.2 −4.5 −3.4 −5.0 −4.5 −4.2 −4.1 −4.2 −4.2 −5.0 −3.6 −3.8 −2.8 −4.3 −3.9 −3.5 −3.4 −3.7 −3.5 −4.5
FRVT
CSAMERIC
-
−5.1 −3.6 −4.6 −4.4 −4.5 −4.2 −4.2 −4.8 −5.0 −6.0 −4.4 −3.2 −3.9 −3.9 −3.9 −3.8 −3.8 −4.6 −4.4 −5.2
CASIA −2
−3.4 −5.2 −4.4 −5.5 −4.8 −4.7 −4.5 −4.6 −4.4 −3.3 −2.8 −4.7 −3.9 −5.0 −4.2 −4.0 −3.9 −4.2 −4.0 −2.9
CARIB

−3.1 −6.0 −4.9 −5.7 −4.7 −4.8 −4.9 −5.0 −4.5 −2.7 −2.8 −6.0 −4.5 −5.4 −4.4 −4.3 −4.7 −4.8 −4.1 −2.4
SSAFRICA
−4.0 −4.5 −4.0 −4.8 −4.6 −4.0 −3.9 −4.1 −2.8 −4.4 −3.5 −4.1 −3.3 −4.2 −4.1 −3.4 −3.4 −3.8 −2.5 −4.0
SASIA

−4
−4.1 −4.3 −4.0 −3.4 −5.0 −5.0 −4.8 −2.5 −4.0 −4.8 −3.6 −3.8 −3.4 −3.0 −4.3 −4.9 −4.5 −2.1 −3.6 −4.5
POLY
−4.1 −4.1 −3.8 −5.6 −4.4 −3.7 −3.4 −4.9 −3.9 −4.7 −3.5 −3.3 −3.2 −5.4 −3.9 −3.1 −3.0 −4.6 −3.4 −4.1
NAFRICA
-
−4.3 −4.1 −3.9 −5.3 −4.3 −3.6 −3.6 −4.7 −3.8 −4.9 −3.6 −3.5 −3.1 −4.6 −3.6 −2.9 −2.9 −4.1 −3.1 −4.2 −5
MEAST
−4.7 −4.3 −4.3 −5.6 −4.1 −4.4 −4.4 −5.2 −4.8 −5.0 −4.2 −3.7 −3.7 −5.2 −3.7 −3.8 −3.9 −4.6 −4.2 −4.5
EURO
−5.1 −3.9 −4.7 −3.2 −5.4 −5.7 −5.6 −3.4 −4.9 −5.4 −4.5 −3.5 −4.1 −2.7 −4.8 −4.9 −4.9 −3.0 −4.4 −4.7
−6
EASIA
VERIFICATION
−4.0 −4.2 −3.2 −4.7 −4.3 −4.0 −3.8 −3.9 −3.9 −4.7 −3.4 −3.6 −2.6 −4.1 −3.7 −3.3 −3.2 −3.4 −3.4 −4.2
CSAMERIC
−4.8 −3.3 −4.3 −4.1 −4.2 −4.0 −3.9 −4.5 −4.7 −5.9 −4.1 −2.9 −3.7 −3.6 −3.7 −3.5 −3.5 −4.3 −4.2 −4.9
CASIA
−3.1 −4.9 −4.1 −5.2 −4.5 −4.4 −4.2 −4.3 −4.1 −3.1 −2.6 −4.4 −3.6 −4.7 −4.0 −3.8 −3.6 −3.9 −3.7 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 231: For algorithm neurotechnology-006 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from


271
Cross region FMR at threshold T = 1.000 for algorithm nodeflux_001, giving FMR(T) = 0.0001 globally.
−3.2 −3.2 −3.1 −3.8 −3.2 −3.1 −3.3 −3.8 −3.3 −2.8 −3.2 −3.2 −3.2 −3.8 −3.2 −3.2 −3.4 −3.7 −3.4 −2.8
SSAFRICA
−3.9 −3.9 −3.8 −4.5 −3.9 −3.9 −4.0 −4.5 −4.1 −3.5 −3.9 −4.0 −3.7 −4.5 −4.0 −3.9 −4.0 −4.6 −4.2 −3.6
SASIA
−4.1 −4.1 −4.0 −4.7 −4.1 −4.0 −4.2 −4.7 −4.2 −3.7 −4.2 −4.1 −4.3 −4.7 −4.0 −4.0 −4.6 −4.8 −4.3 −3.7
POLY
2019/10/16 12:43:37
−3.6 −3.6 −3.5 −4.2 −3.6 −3.5 −3.7 −4.2 −3.8 −3.2 −3.6 −3.4 −3.8 −4.0 −3.4 −3.4 −3.9 −4.1 −3.6 −3.0
NAFRICA log10 FMR
−3.6 −3.6 −3.5 −4.1 −3.6 −3.5 −3.7 −4.2 −3.7 −3.2 −3.6 −3.7 −3.4 −4.3 −3.7 −3.5 −4.0 −4.2 −4.0 −3.3
MEAST
−3.6 −3.6 −3.5 −4.1 −3.6 −3.5 −3.7 −4.2 −3.7 −3.2 −3.5 −3.6 −3.6 −4.2 −3.5 −3.5 −3.7 −4.3 −3.7 −3.2
EURO
−3.8 −3.8 −3.7 −4.4 −3.8 −3.7 −3.9 −4.4 −3.9 −3.4 −3.7 −3.8 −3.9 −4.4 −3.7 −3.8 −3.8 −4.4 −3.9 −3.4 −1
EASIA
−3.7 −3.7 −3.6 −4.3 −3.7 −3.6 −3.8 −4.3 −3.8 −3.3 −3.6 −3.7 −3.3 −4.2 −3.7 −3.5 −3.9 −4.3 −3.9 −3.4
FRVT
CSAMERIC
-
−3.3 −3.4 −3.3 −3.9 −3.3 −3.3 −3.5 −3.9 −3.5 −3.0 −3.4 −3.5 −3.7 −4.1 −3.5 −3.4 −3.6 −4.2 −3.6 −3.1
CASIA −2
−3.6 −3.6 −3.5 −4.2 −3.6 −3.5 −3.7 −4.2 −3.8 −3.2 −3.6 −3.7 −3.6 −4.2 −3.6 −3.6 −3.6 −4.3 −3.8 −3.3
CARIB

−3.1 −3.1 −3.1 −3.7 −3.1 −3.1 −3.3 −3.7 −3.3 −2.7 −3.2 −3.0 −3.2 −3.7 −3.1 −3.1 −3.4 −3.6 −3.4 −2.7
SSAFRICA
−3.9 −3.9 −3.8 −4.5 −3.9 −3.9 −4.0 −4.5 −4.1 −3.5 −3.9 −4.1 −3.7 −4.6 −4.0 −3.9 −4.2 −4.6 −4.2 −3.6
SASIA

−4
−4.0 −3.9 −4.0 −4.5 −4.0 −3.9 −4.3 −4.5 −4.2 −3.5 −4.4 −3.8 −4.2 −4.5 −3.9 −3.9 −4.3 −4.6 −4.3 −3.6
POLY
−3.6 −3.5 −3.5 −4.1 −3.6 −3.5 −3.7 −4.1 −3.8 −3.2 −3.6 −3.3 −3.7 −4.0 −3.4 −3.4 −4.1 −4.1 −3.6 −3.0
NAFRICA
-
−3.5 −3.6 −3.5 −4.1 −3.6 −3.5 −3.7 −4.2 −3.7 −3.2 −3.6 −3.7 −3.5 −4.3 −3.8 −3.6 −3.8 −4.2 −4.0 −3.3 −5
MEAST
−3.5 −3.5 −3.5 −4.1 −3.5 −3.5 −3.7 −4.1 −3.7 −3.1 −3.6 −3.5 −3.5 −4.1 −3.4 −3.4 −3.7 −4.1 −3.7 −3.2
EURO
−3.7 −3.7 −3.7 −4.3 −3.7 −3.7 −3.9 −4.3 −3.9 −3.3 −3.7 −3.6 −3.9 −4.3 −3.7 −3.7 −3.8 −4.3 −3.9 −3.3
−6
EASIA
VERIFICATION
−3.7 −3.7 −3.6 −4.3 −3.7 −3.6 −3.8 −4.3 −3.8 −3.3 −3.6 −3.7 −3.3 −4.2 −3.7 −3.5 −3.9 −4.3 −3.9 −3.4
CSAMERIC
−3.3 −3.4 −3.3 −3.9 −3.4 −3.3 −3.4 −4.0 −3.5 −3.0 −3.4 −3.3 −3.6 −3.9 −3.4 −3.3 −3.5 −4.0 −3.6 −3.0
CASIA
−3.6 −3.5 −3.5 −4.1 −3.5 −3.5 −3.7 −4.1 −3.7 −3.1 −3.6 −3.6 −3.6 −4.2 −3.6 −3.6 −3.6 −4.3 −3.8 −3.2
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 232: For algorithm nodeflux-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


272
Cross region FMR at threshold T = 0.455 for algorithm nodeflux_002, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.4 −6.0 −5.0 −5.4 −5.3 −5.4 −5.1 −3.2 −3.1 −6.0 −4.9 −5.8 −4.5 −4.9 −5.0 −5.2 −4.6 −2.8
SSAFRICA
−4.2 −4.6 −3.9 −4.9 −4.6 −4.0 −4.0 −4.4 −3.3 −4.8 −3.4 −3.9 −2.9 −4.1 −3.7 −3.1 −3.2 −3.8 −2.7 −4.2
SASIA
−4.6 −4.7 −4.2 −3.8 −5.1 −5.0 −5.1 −3.0 −4.5 −5.3 −4.0 −4.0 −3.3 −3.3 −4.2 −4.2 −4.6 −2.6 −3.9 −4.8
POLY
2019/10/16 12:43:37
−4.7 −4.5 −4.4 −5.9 −4.9 −4.1 −3.9 −5.6 −4.4 −5.7 −4.2 −3.6 −3.7 −5.4 −4.3 −3.5 −3.6 −6.0 −3.9 −4.6
NAFRICA log10 FMR
−4.4 −4.3 −3.8 −5.2 −4.4 −3.7 −3.9 −4.7 −3.8 −5.0 −3.4 −3.6 −2.8 −4.3 −3.4 −2.8 −3.0 −3.8 −2.9 −4.3
MEAST
−4.9 −4.6 −4.4 −5.5 −4.5 −4.5 −4.7 −5.3 −4.8 −5.3 −4.1 −3.9 −3.5 −4.7 −3.8 −3.7 −4.0 −4.6 −4.0 −4.6
EURO
−5.3 −4.3 −4.7 −3.5 −5.3 −5.4 −5.7 −3.8 −5.0 −5.8 −4.4 −3.6 −3.8 −2.8 −4.5 −4.5 −4.9 −3.3 −4.4 −5.2 −1
EASIA
−4.3 −4.4 −3.4 −4.8 −4.4 −4.0 −4.0 −4.3 −4.0 −5.1 −3.4 −3.6 −2.6 −3.9 −3.5 −3.1 −3.2 −3.5 −3.2 −4.3
FRVT
CSAMERIC
-
−5.2 −3.8 −4.2 −4.5 −4.4 −4.2 −4.4 −4.8 −4.8 −6.0 −4.3 −3.4 −3.2 −4.0 −3.6 −3.4 −3.7 −4.2 −3.8 −5.2
CASIA −2
−3.4 −5.4 −4.7 −5.6 −4.8 −4.9 −4.8 −4.9 −4.7 −3.4 −2.7 −5.3 −4.0 −5.0 −4.1 −4.2 −4.0 −4.5 −4.2 −2.9
CARIB

−3.3 −6.0 −5.1 −5.8 −4.8 −5.2 −5.1 −5.1 −4.8 −2.9 −2.9 −6.0 −4.7 −5.6 −4.3 −4.7 −4.7 −4.9 −4.4 −2.6
SSAFRICA
−4.1 −4.5 −3.8 −4.7 −4.5 −3.9 −4.0 −4.3 −3.1 −4.6 −3.3 −3.8 −2.9 −4.0 −3.7 −3.1 −3.2 −3.7 −2.6 −4.1
SASIA

−4
−4.4 −4.4 −4.1 −3.6 −4.9 −4.9 −4.9 −2.7 −4.3 −5.0 −3.9 −3.8 −3.2 −3.1 −4.1 −4.1 −4.3 −2.4 −3.7 −4.5
POLY
−4.5 −4.2 −4.1 −5.6 −4.6 −3.9 −3.7 −5.3 −4.2 −5.4 −3.9 −3.3 −3.5 −5.1 −4.1 −3.4 −3.4 −6.0 −3.7 −4.3
NAFRICA
-
−4.2 −4.2 −3.7 −5.1 −4.3 −3.5 −3.7 −4.6 −3.7 −4.8 −3.3 −3.5 −2.7 −4.2 −3.3 −2.7 −2.9 −3.8 −2.8 −4.2 −5
MEAST
−4.8 −4.3 −4.3 −5.4 −4.2 −4.4 −4.6 −5.2 −4.7 −5.1 −4.0 −3.7 −3.4 −4.6 −3.6 −3.6 −4.0 −4.5 −3.9 −4.4
EURO
−5.2 −4.1 −4.6 −3.3 −5.2 −5.3 −5.6 −3.6 −4.9 −5.6 −4.3 −3.5 −3.7 −2.7 −4.4 −4.5 −4.8 −3.1 −4.3 −5.1
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.3 −4.7 −4.3 −3.9 −3.9 −4.1 −3.9 −4.9 −3.3 −3.5 −2.5 −3.8 −3.4 −3.0 −3.1 −3.4 −3.1 −4.2
CSAMERIC
−5.0 −3.5 −4.1 −4.2 −4.2 −4.0 −4.2 −4.6 −4.6 −6.0 −4.0 −3.2 −3.1 −3.7 −3.5 −3.2 −3.7 −4.1 −3.7 −6.0
CASIA
−3.2 −5.1 −4.4 −5.4 −4.6 −4.6 −4.5 −4.6 −4.4 −3.2 −2.6 −5.0 −3.8 −4.8 −4.0 −4.0 −3.8 −4.2 −3.9 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 233: For algorithm nodeflux-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


273
Cross region FMR at threshold T = 1684638382164870077977436979131033446238075281200095429962596511771151810506086548313212266
−5.9 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −5.5 −5.1 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −4.9
SSAFRICA
−5.5 −5.9 −5.5 −5.2 −6.0 −5.8 −5.9 −5.9 −4.3 −6.0 −4.6 −5.0 −4.5 −4.5 −5.1 −4.8 −5.0 −5.3 −3.8 −5.4
SASIA
−6.0 −5.4 −5.7 −4.2 −6.0 −6.0 −6.0 −4.3 −6.0 −6.0 −5.4 −4.7 −4.7 −3.7 −5.1 −5.5 −6.0 −3.6 −5.4 −6.0
POLY
2019/10/16 12:43:37
−6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −5.4 −6.0
NAFRICA log10 FMR
−6.0 −6.0 −5.6 −6.0 −6.0 −5.5 −5.9 −6.0 −5.7 −6.0 −5.0 −6.0 −4.5 −6.0 −5.0 −4.4 −5.1 −5.6 −4.6 −6.0
MEAST
−6.0 −6.0 −5.8 −5.8 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −5.9 −6.0 −4.7 −5.2 −4.9 −5.1 −6.0 −6.0 −6.0 −6.0
EURO
−5.8 −4.2 −5.1 −2.7 −5.0 −6.0 −6.0 −4.1 −5.1 −6.0 −5.3 −3.6 −4.5 −2.3 −4.5 −6.0 −6.0 −3.6 −4.7 −5.9 −1
EASIA
−5.8 −5.6 −4.9 −5.3 −5.7 −5.5 −6.0 −5.5 −5.7 −6.0 −4.7 −4.6 −3.9 −4.5 −4.7 −4.4 −5.0 −4.5 −4.7 −6.0
FRVT
CSAMERIC
-
−6.0 −4.5 −5.1 −4.1 −5.2 −5.2 −6.0 −5.5 −6.0 −6.0 −5.3 −3.9 −4.0 −3.9 −4.2 −4.1 −6.0 −6.0 −6.0 −6.0
CASIA −2
−5.5 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −5.6 −4.6 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −5.5 −4.8
CARIB

−6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −5.2 −5.3 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −4.6
SSAFRICA
−5.4 −5.8 −5.5 −5.0 −6.0 −5.7 −6.0 −5.7 −4.1 −5.8 −4.5 −4.9 −4.4 −4.4 −5.2 −4.8 −5.2 −5.4 −3.7 −5.1
SASIA

−4
−6.0 −5.1 −5.6 −4.0 −5.8 −5.9 −6.0 −4.1 −5.9 −6.0 −6.0 −4.4 −4.6 −3.5 −5.0 −5.2 −6.0 −3.5 −5.2 −6.0
POLY
−6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −5.2 −6.0
NAFRICA
-
−6.0 −6.0 −5.5 −6.0 −6.0 −5.4 −5.9 −6.0 −5.6 −6.0 −5.0 −6.0 −4.4 −5.9 −4.9 −4.3 −6.0 −5.4 −4.6 −6.0 −5
MEAST
−6.0 −6.0 −5.7 −5.5 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −4.7 −4.9 −4.9 −5.1 −6.0 −6.0 −6.0 −6.0
EURO
−5.5 −4.0 −4.9 −2.5 −4.7 −6.0 −6.0 −3.8 −4.9 −6.0 −5.1 −3.4 −4.3 −2.1 −4.4 −5.7 −6.0 −3.4 −4.5 −5.6
−6
EASIA
VERIFICATION
−5.8 −5.6 −4.9 −5.1 −5.7 −5.5 −5.9 −5.5 −5.7 −6.0 −4.7 −4.7 −3.8 −4.4 −4.6 −4.4 −4.8 −4.5 −4.7 −6.0
CSAMERIC
−6.0 −4.2 −5.1 −3.8 −5.0 −5.1 −6.0 −5.2 −6.0 −6.0 −6.0 −3.6 −4.0 −3.6 −4.0 −4.1 −6.0 −6.0 −6.0 −6.0
CASIA
−5.5 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −5.8 −5.5 −4.7 −6.0 −6.0 −6.0 −5.7 −6.0 −6.0 −6.0 −5.2 −4.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 234: For algorithm notiontag-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


274
Cross region FMR at threshold T = 1.997 for algorithm ntechlab_006, giving FMR(T) = 0.0001 globally.
−3.6 −5.3 −4.9 −4.6 −4.9 −4.9 −4.7 −4.5 −4.4 −3.2 −3.3 −5.3 −4.6 −4.3 −4.5 −4.6 −4.4 −4.3 −4.1 −2.8
SSAFRICA
−4.3 −4.6 −4.5 −4.6 −4.8 −4.3 −4.1 −4.3 −3.2 −4.4 −3.9 −4.2 −4.1 −4.3 −4.4 −3.9 −3.9 −4.1 −2.9 −4.1
SASIA
−4.3 −4.4 −4.4 −3.9 −4.9 −4.9 −4.9 −3.3 −4.1 −4.5 −3.8 −4.2 −4.0 −3.6 −4.7 −4.6 −4.6 −2.9 −3.8 −4.2
POLY
2019/10/16 12:43:37
−4.4 −4.3 −4.2 −5.2 −4.4 −3.9 −3.6 −4.8 −4.2 −4.7 −3.7 −3.9 −3.7 −4.9 −4.0 −3.5 −3.3 −4.3 −3.7 −4.6
NAFRICA log10 FMR
−4.5 −4.2 −4.2 −5.1 −4.4 −3.7 −3.8 −5.0 −4.2 −4.9 −3.9 −3.8 −3.7 −4.6 −3.9 −3.3 −3.3 −4.6 −3.8 −4.5
MEAST
−4.7 −4.3 −4.4 −4.9 −4.2 −4.3 −4.4 −4.9 −4.8 −4.9 −4.2 −3.9 −3.9 −4.6 −3.8 −3.9 −4.0 −4.6 −4.4 −4.6
EURO
−4.7 −4.0 −4.8 −3.1 −4.9 −5.1 −5.0 −3.9 −4.7 −4.6 −4.3 −3.6 −4.3 −2.7 −4.5 −4.8 −4.7 −3.6 −4.4 −4.2 −1
EASIA
−4.2 −4.4 −3.6 −4.9 −4.4 −4.2 −4.2 −4.4 −4.4 −4.7 −3.7 −4.0 −3.1 −4.4 −4.0 −3.7 −3.7 −4.0 −4.0 −4.4
FRVT
CSAMERIC
-
−4.7 −3.6 −4.4 −3.9 −4.2 −4.0 −4.1 −4.7 −4.6 −4.8 −4.2 −3.1 −3.9 −3.4 −3.7 −3.5 −3.8 −4.4 −4.3 −4.3
CASIA −2
−3.5 −4.6 −4.3 −4.7 −4.6 −4.5 −4.3 −4.3 −4.3 −3.6 −3.0 −4.2 −3.8 −4.3 −4.2 −4.1 −4.0 −3.9 −3.9 −3.2
CARIB

−3.4 −5.0 −4.6 −4.3 −4.6 −4.6 −4.5 −4.3 −4.1 −2.9 −3.0 −5.0 −4.3 −4.0 −4.3 −4.3 −4.1 −4.0 −3.8 −2.6
SSAFRICA
−4.0 −4.3 −4.3 −4.4 −4.5 −4.0 −3.9 −4.0 −2.9 −4.1 −3.6 −3.9 −3.9 −4.0 −4.2 −3.7 −3.6 −3.8 −2.7 −3.8
SASIA

−4
−4.0 −4.2 −4.1 −3.7 −4.6 −4.7 −4.6 −3.0 −3.9 −4.3 −3.6 −4.0 −3.7 −3.3 −4.5 −4.3 −4.3 −2.7 −3.5 −3.9
POLY
−4.1 −4.0 −3.9 −4.9 −4.2 −3.6 −3.4 −4.5 −3.9 −4.4 −3.4 −3.6 −3.4 −4.7 −3.7 −3.2 −3.0 −4.0 −3.5 −4.3
NAFRICA
-
−4.2 −3.9 −4.0 −4.8 −4.1 −3.5 −3.5 −4.7 −3.9 −4.6 −3.6 −3.5 −3.4 −4.4 −3.6 −3.0 −3.1 −4.4 −3.6 −4.3 −5
MEAST
−4.4 −4.0 −4.1 −4.6 −3.9 −4.1 −4.1 −4.6 −4.5 −4.7 −4.0 −3.6 −3.6 −4.3 −3.5 −3.6 −3.7 −4.3 −4.1 −4.3
EURO
−4.4 −3.7 −4.6 −2.9 −4.7 −4.9 −4.7 −3.7 −4.4 −4.3 −4.0 −3.3 −4.1 −2.5 −4.3 −4.5 −4.4 −3.3 −4.1 −4.0
−6
EASIA
VERIFICATION
−4.0 −4.1 −3.4 −4.6 −4.1 −4.0 −3.9 −4.1 −4.1 −4.5 −3.4 −3.7 −2.9 −4.2 −3.7 −3.5 −3.4 −3.7 −3.7 −4.1
CSAMERIC
−4.4 −3.3 −4.1 −3.6 −3.9 −3.8 −3.8 −4.4 −4.3 −4.6 −3.9 −2.8 −3.6 −3.2 −3.4 −3.2 −3.6 −4.2 −4.0 −4.1
CASIA
−3.3 −4.4 −4.0 −4.4 −4.3 −4.3 −4.1 −4.0 −4.0 −3.3 −2.8 −3.9 −3.6 −4.1 −3.9 −3.8 −3.7 −3.6 −3.6 −2.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 235: For algorithm ntechlab-006 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


275
Cross region FMR at threshold T = 1.416 for algorithm ntechlab_007, giving FMR(T) = 0.0001 globally.
−3.4 −5.4 −4.9 −5.0 −4.9 −4.9 −4.6 −4.7 −4.5 −2.9 −3.0 −6.0 −4.5 −4.7 −4.5 −4.6 −4.3 −4.5 −4.2 −2.6
SSAFRICA
−4.2 −4.7 −4.4 −4.8 −4.8 −4.2 −4.1 −4.3 −3.2 −4.5 −3.8 −4.2 −3.8 −4.4 −4.4 −3.8 −3.7 −4.1 −2.8 −4.2
SASIA
−4.3 −4.6 −4.3 −3.9 −5.0 −5.0 −4.9 −3.0 −4.2 −4.6 −3.9 −4.5 −3.8 −3.5 −4.7 −4.6 −4.4 −2.7 −3.8 −4.1
POLY
2019/10/16 12:43:37
−4.3 −4.3 −4.1 −5.4 −4.5 −3.8 −3.5 −4.9 −4.1 −4.6 −3.7 −3.6 −3.6 −5.1 −4.0 −3.4 −3.1 −4.4 −3.7 −4.2
NAFRICA log10 FMR
−4.5 −4.1 −4.1 −5.3 −4.4 −3.7 −3.7 −5.0 −4.1 −4.9 −3.9 −3.7 −3.5 −4.7 −3.9 −3.2 −3.1 −4.6 −3.6 −4.3
MEAST
−4.8 −4.3 −4.4 −5.2 −4.2 −4.4 −4.4 −5.2 −4.9 −5.0 −4.3 −3.8 −3.9 −4.9 −3.8 −3.9 −4.0 −4.8 −4.4 −4.6
EURO
−5.0 −4.1 −4.9 −3.4 −5.2 −5.5 −5.3 −3.9 −4.9 −5.0 −4.5 −3.7 −4.4 −2.9 −4.7 −5.0 −5.0 −3.5 −4.5 −4.6 −1
EASIA
−4.1 −4.3 −3.5 −4.9 −4.4 −4.2 −4.0 −4.3 −4.3 −4.7 −3.6 −3.9 −2.9 −4.4 −3.9 −3.6 −3.5 −3.8 −3.8 −4.3
FRVT
CSAMERIC
-
−4.9 −3.5 −4.4 −4.1 −4.2 −4.0 −4.1 −4.7 −4.7 −5.2 −4.5 −3.1 −3.9 −3.7 −3.7 −3.6 −3.7 −4.4 −4.3 −4.9
CASIA −2
−3.3 −4.9 −4.3 −5.0 −4.7 −4.5 −4.3 −4.4 −4.3 −3.3 −2.8 −4.6 −3.8 −4.6 −4.2 −4.0 −3.9 −4.0 −3.9 −2.9
CARIB

−3.1 −5.1 −4.6 −4.7 −4.7 −4.6 −4.3 −4.4 −4.2 −2.6 −2.8 −6.0 −4.2 −4.4 −4.3 −4.3 −4.0 −4.2 −3.9 −2.3
SSAFRICA
−4.0 −4.4 −4.1 −4.5 −4.6 −4.0 −3.9 −4.1 −2.9 −4.2 −3.5 −3.9 −3.6 −4.2 −4.2 −3.6 −3.5 −3.8 −2.6 −3.9
SASIA

−4
−4.0 −4.3 −4.0 −3.6 −4.8 −4.8 −4.6 −2.7 −3.9 −4.3 −3.7 −4.2 −3.6 −3.2 −4.4 −4.3 −4.1 −2.4 −3.5 −3.8
POLY
−4.0 −4.0 −3.8 −5.1 −4.2 −3.5 −3.2 −4.6 −3.8 −4.4 −3.4 −3.3 −3.3 −4.8 −3.8 −3.1 −2.8 −4.1 −3.4 −4.0
NAFRICA
-
−4.3 −3.9 −3.9 −5.0 −4.1 −3.4 −3.4 −4.8 −3.9 −4.6 −3.7 −3.4 −3.3 −4.5 −3.6 −2.9 −2.9 −4.5 −3.4 −4.1 −5
MEAST
−4.5 −4.0 −4.1 −5.0 −3.9 −4.2 −4.2 −4.9 −4.6 −4.8 −4.0 −3.5 −3.6 −4.7 −3.5 −3.7 −3.7 −4.6 −4.2 −4.4
EURO
−4.7 −3.9 −4.6 −3.1 −5.0 −5.2 −5.0 −3.6 −4.6 −4.7 −4.3 −3.5 −4.1 −2.7 −4.5 −4.8 −4.7 −3.2 −4.2 −4.3
−6
EASIA
VERIFICATION
−3.9 −4.1 −3.2 −4.6 −4.1 −3.9 −3.8 −4.0 −4.0 −4.4 −3.4 −3.6 −2.7 −4.2 −3.7 −3.4 −3.3 −3.6 −3.6 −4.0
CSAMERIC
−4.6 −3.3 −4.1 −3.8 −4.0 −3.7 −3.8 −4.4 −4.4 −4.9 −4.2 −2.9 −3.6 −3.4 −3.5 −3.3 −3.5 −4.1 −4.0 −4.6
CASIA
−3.0 −4.6 −4.0 −4.7 −4.4 −4.3 −4.0 −4.1 −4.0 −3.0 −2.6 −4.4 −3.5 −4.3 −4.0 −3.8 −3.7 −3.7 −3.6 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 236: For algorithm ntechlab-007 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


276
Cross region FMR at threshold T = 0.428 for algorithm pixelall_002, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.5 −6.0 −5.1 −5.6 −5.5 −5.5 −5.4 −3.2 −3.1 −6.0 −5.1 −5.8 −4.6 −5.1 −5.0 −5.4 −4.9 −2.9
SSAFRICA
−4.2 −4.7 −3.9 −4.9 −4.6 −4.0 −4.1 −4.5 −3.4 −4.8 −3.3 −3.8 −2.9 −4.1 −3.7 −3.1 −3.2 −3.8 −2.8 −4.0
SASIA
−4.8 −4.8 −4.3 −3.9 −5.2 −5.1 −5.2 −3.1 −4.6 −5.3 −4.2 −4.2 −3.4 −3.4 −4.3 −4.2 −4.4 −2.7 −4.0 −4.7
POLY
2019/10/16 12:43:37
−4.8 −4.7 −4.4 −6.0 −5.2 −4.4 −3.9 −5.3 −4.4 −6.0 −4.3 −3.9 −3.7 −5.7 −4.5 −3.7 −3.3 −6.0 −3.8 −6.0
NAFRICA log10 FMR
−4.4 −4.5 −3.8 −5.3 −4.5 −3.8 −3.9 −4.8 −3.9 −5.2 −3.4 −3.6 −2.8 −4.4 −3.5 −2.8 −3.0 −3.9 −2.9 −4.3
MEAST
−4.9 −4.7 −4.3 −5.5 −4.5 −4.5 −4.7 −5.3 −4.8 −5.5 −4.1 −4.0 −3.4 −4.7 −3.7 −3.6 −3.8 −4.5 −3.9 −4.7
EURO
−5.3 −4.2 −4.7 −3.4 −5.3 −5.5 −5.5 −3.9 −5.2 −5.8 −4.4 −3.5 −3.8 −2.8 −4.5 −4.5 −4.5 −3.3 −4.5 −5.1 −1
EASIA
−4.2 −4.4 −3.4 −4.8 −4.4 −4.0 −4.0 −4.3 −4.1 −5.0 −3.3 −3.5 −2.5 −3.9 −3.5 −3.0 −3.1 −3.5 −3.2 −4.2
FRVT
CSAMERIC
-
−5.2 −3.9 −4.3 −4.5 −4.5 −4.4 −4.6 −5.2 −5.0 −5.9 −4.2 −3.5 −3.2 −4.1 −3.6 −3.4 −3.9 −4.9 −4.0 −4.9
CASIA −2
−3.4 −5.7 −4.8 −5.7 −4.8 −5.0 −4.9 −5.0 −4.8 −3.4 −2.7 −5.3 −4.1 −5.1 −4.1 −4.2 −4.2 −4.5 −4.3 −2.8
CARIB

−3.4 −6.0 −5.3 −6.0 −5.0 −5.4 −5.2 −5.3 −5.1 −3.0 −2.9 −6.0 −4.9 −5.6 −4.5 −4.9 −4.7 −5.3 −4.7 −2.7
SSAFRICA
−4.0 −4.7 −3.8 −4.8 −4.6 −4.0 −4.0 −4.4 −3.2 −4.7 −3.2 −3.9 −2.8 −4.1 −3.7 −3.1 −3.2 −3.8 −2.7 −3.9
SASIA

−4
−4.6 −4.7 −4.2 −3.7 −5.1 −5.0 −5.0 −2.9 −4.4 −5.0 −4.0 −4.1 −3.4 −3.2 −4.2 −4.0 −4.1 −2.5 −3.8 −4.4
POLY
−4.6 −4.5 −4.2 −6.0 −4.9 −4.1 −3.6 −5.0 −4.2 −5.7 −4.1 −3.6 −3.5 −5.4 −4.3 −3.5 −3.1 −6.0 −3.6 −6.0
NAFRICA
-
−4.2 −4.3 −3.7 −5.2 −4.4 −3.7 −3.8 −4.7 −3.8 −5.0 −3.3 −3.5 −2.7 −4.3 −3.4 −2.8 −2.9 −3.8 −2.9 −4.1 −5
MEAST
−4.8 −4.5 −4.2 −5.4 −4.4 −4.4 −4.6 −5.2 −4.7 −5.3 −4.0 −3.8 −3.3 −4.6 −3.6 −3.6 −3.9 −4.4 −3.9 −4.6
EURO
−5.2 −4.0 −4.6 −3.2 −5.2 −5.4 −5.4 −3.7 −5.0 −5.7 −4.3 −3.4 −3.7 −2.6 −4.4 −4.4 −4.4 −3.2 −4.4 −5.0
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.7 −4.3 −3.9 −3.9 −4.2 −4.0 −4.8 −3.2 −3.5 −2.5 −3.9 −3.4 −3.0 −3.1 −3.4 −3.1 −4.1
CSAMERIC
−5.1 −3.6 −4.2 −4.3 −4.4 −4.2 −4.4 −4.9 −4.8 −6.0 −4.0 −3.2 −3.1 −3.9 −3.5 −3.3 −3.8 −4.6 −4.0 −6.0
CASIA
−3.2 −5.4 −4.5 −5.5 −4.6 −4.8 −4.7 −4.7 −4.6 −3.2 −2.5 −5.0 −3.9 −4.9 −4.0 −4.1 −4.0 −4.3 −4.1 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 237: For algorithm pixelall-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


277
Cross region FMR at threshold T = 0.353 for algorithm psl_002, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.3 −5.8 −4.9 −5.3 −5.2 −5.3 −5.1 −3.1 −2.9 −6.0 −4.7 −5.5 −4.3 −4.7 −4.8 −5.0 −4.6 −2.7
SSAFRICA
−4.1 −4.7 −3.9 −4.9 −4.6 −4.0 −4.1 −4.4 −3.3 −4.7 −3.3 −3.9 −3.0 −4.2 −3.8 −3.2 −3.3 −3.8 −2.7 −4.0
SASIA
−4.6 −4.9 −4.3 −3.8 −5.2 −5.0 −5.2 −3.0 −4.5 −5.0 −4.0 −4.3 −3.5 −3.3 −4.4 −4.2 −4.7 −2.6 −3.9 −4.5
POLY
2019/10/16 12:43:37
−4.5 −4.6 −4.3 −6.0 −4.9 −4.2 −3.9 −5.2 −4.4 −6.0 −3.9 −3.6 −3.5 −5.7 −4.4 −3.5 −3.4 −6.0 −3.6 −6.0
NAFRICA log10 FMR
−4.3 −4.5 −3.8 −5.3 −4.4 −3.7 −3.9 −4.9 −3.8 −5.0 −3.3 −3.8 −2.8 −4.4 −3.5 −2.8 −2.9 −4.0 −2.9 −4.1
MEAST
−4.8 −4.6 −4.4 −5.7 −4.5 −4.5 −4.7 −5.3 −4.8 −5.5 −4.0 −4.0 −3.5 −4.9 −3.8 −3.7 −3.9 −4.5 −4.0 −4.8
EURO
−5.1 −4.2 −4.8 −3.4 −5.4 −5.5 −5.7 −3.9 −5.1 −5.5 −4.2 −3.6 −3.9 −2.8 −4.6 −4.6 −5.1 −3.3 −4.5 −4.7 −1
EASIA
−4.2 −4.5 −3.4 −4.9 −4.5 −4.1 −4.1 −4.3 −4.1 −4.9 −3.3 −3.6 −2.6 −4.1 −3.6 −3.1 −3.2 −3.5 −3.3 −4.1
FRVT
CSAMERIC
-
−5.8 −3.8 −4.5 −4.5 −4.6 −4.4 −4.6 −5.0 −5.2 −6.0 −4.8 −3.5 −3.5 −4.1 −3.8 −3.7 −4.1 −4.7 −4.5 −6.0
CASIA −2
−3.2 −5.5 −4.6 −5.4 −4.6 −4.8 −4.6 −4.8 −4.7 −3.3 −2.5 −4.7 −3.8 −4.7 −3.9 −4.0 −3.9 −4.2 −4.1 −2.7
CARIB

−3.2 −6.0 −5.1 −5.5 −4.8 −5.1 −4.9 −5.0 −4.9 −2.9 −2.8 −6.0 −4.6 −5.3 −4.2 −4.5 −4.7 −4.7 −4.4 −2.5
SSAFRICA
−4.0 −4.6 −3.8 −4.8 −4.6 −3.9 −4.1 −4.3 −3.1 −4.6 −3.2 −3.9 −2.9 −4.1 −3.7 −3.1 −3.3 −3.7 −2.6 −3.9
SASIA

−4
−4.4 −4.7 −4.1 −3.6 −5.1 −4.9 −4.9 −2.7 −4.3 −4.8 −3.8 −4.1 −3.3 −3.1 −4.4 −4.1 −4.5 −2.4 −3.7 −4.3
POLY
−4.3 −4.3 −4.0 −5.8 −4.7 −3.9 −3.6 −4.9 −4.2 −6.0 −3.6 −3.3 −3.3 −5.4 −4.2 −3.3 −3.2 −6.0 −3.5 −6.0
NAFRICA
-
−4.1 −4.3 −3.7 −5.2 −4.3 −3.5 −3.7 −4.8 −3.7 −4.8 −3.2 −3.7 −2.7 −4.3 −3.4 −2.7 −2.9 −4.0 −2.8 −4.0 −5
MEAST
−4.7 −4.3 −4.3 −5.5 −4.3 −4.4 −4.5 −5.2 −4.7 −5.3 −3.9 −3.7 −3.4 −4.7 −3.7 −3.6 −3.8 −4.5 −3.9 −4.7
EURO
−5.0 −4.0 −4.7 −3.2 −5.2 −5.5 −5.7 −3.6 −5.0 −5.4 −4.1 −3.4 −3.8 −2.7 −4.5 −4.5 −5.1 −3.1 −4.4 −4.6
−6
EASIA
VERIFICATION
−4.0 −4.3 −3.3 −4.8 −4.3 −4.0 −4.0 −4.1 −4.0 −4.8 −3.2 −3.6 −2.5 −3.9 −3.5 −3.1 −3.1 −3.4 −3.2 −4.1
CSAMERIC
−5.6 −3.5 −4.3 −4.2 −4.4 −4.2 −4.3 −4.7 −5.0 −6.0 −4.7 −3.3 −3.4 −3.8 −3.7 −3.5 −3.9 −4.6 −4.5 −6.0
CASIA
−3.1 −5.3 −4.3 −5.2 −4.5 −4.6 −4.4 −4.5 −4.4 −3.1 −2.4 −4.5 −3.7 −4.6 −3.8 −3.9 −3.7 −4.0 −3.9 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 238: For algorithm psl-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


278
Cross region FMR at threshold T = 0.668 for algorithm psl_003, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.2 −5.9 −5.1 −5.2 −5.2 −5.3 −4.9 −3.2 −3.1 −6.0 −4.8 −5.7 −4.5 −4.9 −5.0 −4.9 −4.5 −2.8
SSAFRICA
−4.2 −4.8 −4.1 −5.1 −4.8 −4.1 −4.2 −4.5 −3.2 −4.7 −3.6 −4.2 −3.3 −4.6 −4.1 −3.5 −3.6 −4.1 −2.8 −4.2
SASIA
−4.6 −5.0 −4.4 −3.9 −5.3 −5.1 −5.2 −3.0 −4.4 −5.0 −4.0 −5.0 −3.7 −3.6 −4.8 −4.4 −4.7 −2.7 −3.9 −4.6
POLY
2019/10/16 12:43:37
−4.5 −4.4 −4.2 −5.8 −4.7 −4.0 −3.8 −5.3 −4.3 −5.4 −3.9 −3.7 −3.5 −5.4 −4.0 −3.5 −3.3 −6.0 −3.6 −4.9
NAFRICA log10 FMR
−4.5 −4.4 −3.9 −5.5 −4.5 −3.7 −3.8 −5.1 −3.9 −5.1 −3.6 −3.9 −3.0 −4.7 −3.7 −3.0 −3.1 −4.4 −3.2 −4.5
MEAST
−4.9 −4.4 −4.4 −5.8 −4.3 −4.5 −4.7 −5.5 −4.9 −5.3 −4.1 −4.0 −3.7 −5.2 −3.8 −3.8 −4.1 −4.8 −4.2 −4.6
EURO
−5.3 −4.4 −5.1 −3.7 −5.8 −5.8 −5.6 −4.0 −5.2 −5.8 −4.5 −3.9 −4.3 −3.2 −5.1 −4.9 −5.0 −3.6 −4.7 −5.2 −1
EASIA
−4.3 −4.4 −3.3 −5.1 −4.4 −4.1 −4.1 −4.4 −4.2 −5.0 −3.5 −3.9 −2.7 −4.5 −3.8 −3.4 −3.4 −3.8 −3.5 −4.3
FRVT
CSAMERIC
-
−5.3 −3.7 −4.6 −4.5 −4.5 −4.3 −4.3 −5.1 −5.1 −6.0 −5.0 −3.3 −3.9 −4.1 −4.0 −3.8 −3.8 −4.9 −4.8 −6.0
CASIA −2
−3.4 −5.3 −4.5 −5.6 −4.8 −4.7 −4.6 −4.8 −4.5 −3.5 −2.8 −5.0 −3.9 −4.9 −4.2 −4.1 −4.0 −4.4 −4.1 −2.9
CARIB

−3.3 −6.0 −5.0 −5.6 −4.9 −5.0 −4.9 −5.0 −4.7 −2.9 −2.9 −6.0 −4.6 −5.5 −4.4 −4.6 −4.7 −4.6 −4.2 −2.6
SSAFRICA
−4.0 −4.6 −4.0 −4.9 −4.7 −4.0 −4.0 −4.3 −2.9 −4.5 −3.4 −4.0 −3.2 −4.4 −4.0 −3.4 −3.4 −3.9 −2.6 −4.1
SASIA

−4
−4.4 −4.7 −4.2 −3.7 −5.1 −4.9 −4.9 −2.7 −4.1 −4.8 −3.8 −4.7 −3.6 −3.3 −4.7 −4.3 −4.5 −2.4 −3.7 −4.4
POLY
−4.2 −4.1 −4.0 −5.5 −4.5 −3.8 −3.5 −5.0 −4.1 −5.1 −3.7 −3.4 −3.3 −5.1 −3.9 −3.4 −3.0 −6.0 −3.5 −4.6
NAFRICA
-
−4.3 −4.1 −3.8 −5.3 −4.3 −3.5 −3.6 −4.9 −3.8 −4.9 −3.5 −3.7 −2.9 −4.6 −3.5 −2.8 −2.9 −4.2 −3.1 −4.4 −5
MEAST
−4.7 −4.2 −4.2 −5.6 −4.1 −4.3 −4.5 −5.3 −4.8 −5.1 −3.9 −3.8 −3.5 −5.0 −3.6 −3.7 −3.9 −4.7 −4.1 −4.5
EURO
−5.1 −4.2 −4.9 −3.4 −5.5 −5.6 −5.4 −3.7 −5.0 −5.5 −4.3 −3.7 −4.2 −3.0 −4.9 −4.8 −4.8 −3.4 −4.4 −5.0
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.1 −4.9 −4.2 −3.9 −3.9 −4.1 −4.0 −4.8 −3.4 −3.7 −2.5 −4.3 −3.6 −3.2 −3.3 −3.6 −3.4 −4.3
CSAMERIC
−5.0 −3.4 −4.3 −4.2 −4.2 −4.0 −4.0 −4.8 −4.8 −5.9 −4.7 −3.0 −3.8 −3.8 −3.7 −3.6 −3.5 −4.6 −4.6 −6.0
CASIA
−3.2 −5.0 −4.3 −5.4 −4.6 −4.5 −4.3 −4.6 −4.2 −3.2 −2.6 −5.0 −3.7 −4.8 −4.0 −3.9 −3.8 −4.1 −3.8 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 239: For algorithm psl-003 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


279
Cross region FMR at threshold T = 0.779 for algorithm rankone_006, giving FMR(T) = 0.0001 globally.
−4.2 −6.0 −5.8 −6.0 −5.6 −5.7 −5.6 −6.0 −5.3 −3.9 −3.4 −6.0 −5.1 −6.0 −4.9 −5.1 −5.0 −5.6 −4.8 −3.4
SSAFRICA
−4.1 −4.6 −3.7 −4.8 −4.4 −3.9 −4.1 −4.5 −3.3 −4.7 −3.1 −3.7 −2.7 −4.0 −3.5 −3.0 −3.1 −3.6 −2.7 −3.8
SASIA
−4.9 −5.1 −4.4 −4.4 −5.3 −5.1 −5.1 −3.9 −4.6 −5.7 −4.1 −4.4 −3.6 −3.7 −4.6 −4.4 −4.4 −3.2 −4.0 −5.1
POLY
2019/10/16 12:43:37
−5.0 −5.0 −4.5 −6.0 −5.1 −4.6 −4.4 −5.4 −4.5 −6.0 −4.1 −4.0 −3.5 −5.4 −4.3 −3.7 −3.9 −4.6 −3.6 −4.9
NAFRICA log10 FMR
−4.3 −4.4 −3.6 −5.1 −4.2 −3.7 −3.9 −4.6 −3.8 −5.0 −3.2 −3.5 −2.5 −4.1 −3.2 −2.7 −2.9 −3.6 −2.8 −4.0
MEAST
−4.7 −4.7 −4.2 −5.4 −4.4 −4.3 −4.7 −5.2 −4.7 −5.5 −3.8 −3.9 −3.2 −4.5 −3.5 −3.4 −3.8 −4.3 −3.9 −4.7
EURO
−5.3 −4.3 −4.6 −3.6 −5.4 −5.4 −5.6 −4.2 −5.1 −6.0 −4.4 −3.6 −3.7 −2.9 −4.5 −4.5 −4.7 −3.5 −4.3 −5.3 −1
EASIA
−4.1 −4.4 −3.4 −4.7 −4.2 −3.9 −4.1 −4.4 −4.0 −5.0 −3.1 −3.4 −2.5 −3.7 −3.2 −2.9 −3.1 −3.4 −3.0 −4.0
FRVT
CSAMERIC
-
−5.0 −3.9 −4.1 −4.4 −4.4 −4.3 −4.4 −4.9 −4.5 −6.0 −3.9 −3.3 −3.0 −3.8 −3.5 −3.3 −3.6 −4.2 −3.5 −5.2
CASIA −2
−3.7 −5.6 −4.6 −5.7 −4.9 −4.9 −4.8 −5.2 −4.7 −3.9 −2.9 −5.0 −3.8 −4.9 −4.2 −4.0 −4.1 −4.4 −4.0 −3.2
CARIB

−4.1 −6.0 −5.6 −6.0 −5.6 −5.6 −5.3 −6.0 −5.1 −3.8 −3.3 −6.0 −4.9 −5.9 −4.9 −5.0 −4.7 −5.3 −4.6 −3.2
SSAFRICA
−4.0 −4.5 −3.7 −4.8 −4.4 −3.8 −4.0 −4.4 −3.1 −4.6 −3.1 −3.6 −2.7 −3.9 −3.5 −3.0 −3.1 −3.6 −2.6 −3.8
SASIA

−4
−4.8 −5.0 −4.3 −4.3 −5.2 −5.0 −4.9 −3.7 −4.4 −5.5 −4.0 −4.7 −3.5 −3.6 −4.5 −4.3 −4.3 −3.1 −3.9 −5.3
POLY
−4.8 −4.7 −4.4 −5.8 −4.9 −4.4 −4.2 −5.3 −4.4 −6.0 −4.0 −3.7 −3.5 −5.1 −4.3 −3.6 −3.6 −4.6 −3.6 −6.0
NAFRICA
-
−4.2 −4.3 −3.5 −5.1 −4.1 −3.6 −3.8 −4.5 −3.7 −5.0 −3.1 −3.4 −2.5 −4.1 −3.1 −2.6 −2.8 −3.5 −2.8 −4.0 −5
MEAST
−4.7 −4.5 −4.1 −5.4 −4.3 −4.3 −4.6 −5.1 −4.7 −5.4 −3.8 −3.8 −3.2 −4.5 −3.5 −3.4 −3.8 −4.2 −3.8 −4.6
EURO
−5.3 −4.2 −4.6 −3.4 −5.3 −5.3 −5.6 −4.1 −5.0 −6.0 −4.3 −3.5 −3.7 −2.8 −4.4 −4.4 −4.7 −3.4 −4.3 −5.4
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.4 −4.6 −4.1 −3.8 −4.0 −4.3 −3.9 −4.9 −3.1 −3.4 −2.4 −3.7 −3.2 −2.9 −3.1 −3.4 −3.0 −3.9
CSAMERIC
−4.9 −3.6 −4.0 −4.2 −4.3 −4.1 −4.3 −4.7 −4.4 −6.0 −3.8 −3.0 −3.0 −3.6 −3.4 −3.2 −3.6 −4.1 −3.4 −6.0
CASIA
−3.6 −5.3 −4.5 −5.6 −4.8 −4.7 −4.8 −5.1 −4.5 −3.8 −2.8 −4.7 −3.6 −4.8 −4.1 −3.9 −4.0 −4.3 −3.8 −3.1
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 240: For algorithm rankone-006 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


280
Cross region FMR at threshold T = 0.661 for algorithm rankone_007, giving FMR(T) = 0.0001 globally.
−4.0 −6.0 −5.2 −6.0 −5.4 −5.5 −5.4 −5.9 −5.1 −3.7 −3.3 −5.3 −4.2 −5.6 −4.6 −4.6 −5.3 −5.1 −4.3 −3.2
SSAFRICA
−4.1 −4.5 −3.8 −4.8 −4.5 −4.0 −4.1 −4.5 −3.3 −4.7 −3.1 −3.6 −2.8 −3.9 −3.6 −3.1 −3.2 −3.7 −2.7 −3.9
SASIA
−4.8 −4.6 −4.3 −4.1 −5.2 −5.0 −5.1 −3.6 −4.5 −5.5 −3.9 −3.9 −3.3 −3.4 −4.2 −4.1 −4.4 −3.0 −3.8 −4.9
POLY
2019/10/16 12:43:37
−5.3 −4.7 −4.8 −6.0 −5.1 −4.7 −4.2 −5.7 −4.6 −5.3 −4.3 −4.0 −4.0 −6.0 −4.4 −4.0 −3.6 −4.9 −3.8 −6.0
NAFRICA log10 FMR
−4.3 −4.4 −3.8 −5.2 −4.3 −3.8 −4.0 −4.8 −3.9 −5.1 −3.3 −3.6 −2.7 −4.2 −3.3 −2.8 −3.0 −3.7 −2.9 −4.1
MEAST
−4.8 −4.6 −4.3 −5.4 −4.5 −4.5 −4.7 −5.2 −4.8 −5.5 −3.9 −3.8 −3.3 −4.5 −3.7 −3.6 −3.8 −4.3 −3.9 −4.6
EURO
−5.1 −4.1 −4.5 −3.4 −5.2 −5.3 −5.4 −4.0 −5.0 −5.8 −4.2 −3.5 −3.6 −2.7 −4.4 −4.4 −4.7 −3.3 −4.2 −5.0 −1
EASIA
−4.1 −4.3 −3.5 −4.6 −4.3 −4.0 −4.2 −4.3 −4.0 −5.0 −3.1 −3.4 −2.5 −3.6 −3.3 −3.0 −3.2 −3.4 −3.0 −4.0
FRVT
CSAMERIC
-
−4.9 −3.7 −4.2 −4.1 −4.4 −4.4 −4.6 −4.8 −4.7 −6.0 −4.0 −3.1 −3.3 −3.6 −3.6 −3.5 −4.0 −4.3 −3.8 −6.0
CASIA −2
−3.6 −5.1 −4.6 −5.7 −4.8 −4.9 −4.8 −5.1 −4.7 −3.8 −2.9 −4.7 −3.8 −4.9 −4.1 −4.2 −4.1 −4.4 −4.0 −3.1
CARIB

−3.8 −6.0 −5.1 −6.0 −5.3 −5.4 −5.1 −5.7 −4.9 −3.4 −3.2 −5.0 −4.2 −5.4 −4.6 −4.7 −6.0 −5.0 −4.2 −3.0
SSAFRICA
−4.0 −4.4 −3.8 −4.7 −4.5 −3.9 −4.1 −4.4 −3.1 −4.6 −3.1 −3.5 −2.8 −3.9 −3.6 −3.0 −3.2 −3.7 −2.6 −3.8
SASIA

−4
−4.7 −4.4 −4.2 −3.9 −5.1 −4.8 −4.9 −3.3 −4.3 −5.3 −3.8 −3.8 −3.2 −3.3 −4.2 −4.0 −4.3 −2.8 −3.7 −5.0
POLY
−5.0 −4.5 −4.6 −6.0 −4.9 −4.5 −4.0 −5.4 −4.4 −5.3 −4.1 −3.7 −3.9 −6.0 −4.2 −3.8 −3.4 −4.6 −3.6 −6.0
NAFRICA
-
−4.2 −4.3 −3.7 −5.2 −4.2 −3.7 −3.9 −4.7 −3.8 −5.1 −3.2 −3.5 −2.7 −4.2 −3.3 −2.8 −2.9 −3.7 −2.9 −4.2 −5
MEAST
−4.7 −4.4 −4.3 −5.3 −4.4 −4.5 −4.6 −5.1 −4.7 −5.4 −3.8 −3.7 −3.3 −4.4 −3.6 −3.6 −3.8 −4.2 −3.9 −4.6
EURO
−5.0 −3.9 −4.5 −3.2 −5.1 −5.3 −5.3 −3.8 −4.9 −5.6 −4.1 −3.3 −3.5 −2.6 −4.3 −4.3 −4.6 −3.2 −4.2 −4.9
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.4 −4.5 −4.2 −3.9 −4.1 −4.3 −3.9 −4.9 −3.1 −3.3 −2.5 −3.6 −3.3 −2.9 −3.1 −3.4 −3.0 −4.0
CSAMERIC
−4.7 −3.4 −4.1 −3.9 −4.2 −4.2 −4.3 −4.5 −4.4 −6.0 −3.8 −2.9 −3.1 −3.4 −3.5 −3.4 −3.9 −4.2 −3.7 −6.0
CASIA
−3.5 −4.8 −4.4 −5.5 −4.6 −4.7 −4.6 −4.9 −4.5 −3.7 −2.8 −4.4 −3.6 −4.7 −3.9 −4.0 −3.9 −4.2 −3.8 −3.1
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 241: For algorithm rankone-007 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


281
Cross region FMR at threshold T = 0.883 for algorithm realnetworks_002, giving FMR(T) = 0.0001 globally.
−3.4 −5.8 −5.0 −5.3 −4.9 −4.9 −4.8 −4.8 −4.7 −2.9 −3.0 −6.0 −4.6 −5.1 −4.5 −4.6 −4.3 −4.5 −4.3 −2.6
SSAFRICA
−4.4 −4.5 −4.5 −4.8 −4.8 −4.2 −4.1 −4.3 −3.1 −4.6 −4.0 −4.2 −4.1 −4.4 −4.5 −3.8 −3.7 −4.0 −2.8 −4.3
SASIA
−4.5 −4.4 −4.4 −3.6 −5.0 −5.1 −4.8 −2.8 −4.2 −4.8 −4.1 −4.0 −3.9 −3.3 −4.6 −4.9 −4.4 −2.5 −3.9 −4.4
POLY
2019/10/16 12:43:37
−4.4 −4.0 −4.1 −5.3 −4.3 −3.8 −3.5 −4.6 −4.1 −4.9 −3.8 −3.6 −3.5 −5.4 −3.9 −3.3 −3.2 −4.3 −3.6 −4.2
NAFRICA log10 FMR
−4.5 −4.0 −4.1 −5.3 −4.2 −3.6 −3.7 −4.9 −4.1 −4.9 −3.9 −3.5 −3.6 −4.9 −3.7 −3.1 −3.3 −4.8 −3.7 −4.5
MEAST
−4.8 −3.9 −4.3 −5.1 −3.8 −4.2 −4.3 −5.1 −4.9 −5.0 −4.3 −3.5 −3.8 −4.8 −3.4 −3.8 −3.9 −4.7 −4.5 −4.7
EURO
−5.3 −4.0 −4.9 −3.2 −5.2 −5.4 −5.4 −3.6 −4.8 −5.2 −4.8 −3.6 −4.4 −2.8 −4.8 −5.0 −5.0 −3.3 −4.5 −4.9 −1
EASIA
−4.4 −4.2 −3.7 −4.9 −4.3 −4.2 −4.1 −4.3 −4.4 −4.9 −3.8 −3.8 −3.2 −4.5 −3.9 −3.7 −3.7 −3.9 −4.0 −4.5
FRVT
CSAMERIC
-
−4.8 −3.4 −4.3 −4.0 −4.0 −3.9 −4.0 −4.5 −4.6 −5.3 −4.3 −3.1 −3.8 −3.6 −3.6 −3.4 −3.5 −4.5 −4.1 −5.2
CASIA −2
−3.4 −4.9 −4.4 −5.4 −4.7 −4.6 −4.5 −4.6 −4.5 −3.3 −2.9 −4.5 −3.9 −4.9 −4.3 −4.1 −4.1 −4.3 −4.1 −3.0
CARIB

−3.1 −5.5 −4.7 −5.1 −4.6 −4.6 −4.5 −4.6 −4.4 −2.7 −2.8 −6.0 −4.4 −4.9 −4.3 −4.4 −4.0 −4.3 −4.0 −2.4
SSAFRICA
−4.1 −4.2 −4.2 −4.5 −4.6 −3.9 −3.8 −4.0 −2.9 −4.3 −3.8 −3.9 −3.8 −4.1 −4.2 −3.5 −3.5 −3.7 −2.6 −4.0
SASIA

−4
−4.3 −4.1 −4.1 −3.4 −4.7 −4.8 −4.5 −2.6 −4.0 −4.6 −3.9 −3.8 −3.7 −3.0 −4.3 −4.8 −4.1 −2.2 −3.6 −4.2
POLY
−4.1 −3.7 −3.8 −5.1 −4.1 −3.5 −3.3 −4.4 −3.8 −4.7 −3.5 −3.3 −3.2 −5.4 −3.7 −3.0 −2.9 −4.1 −3.4 −4.0
NAFRICA
-
−4.3 −3.7 −3.9 −5.1 −3.9 −3.3 −3.4 −4.7 −3.8 −4.7 −3.7 −3.2 −3.4 −4.7 −3.5 −2.8 −3.0 −4.6 −3.4 −4.3 −5
MEAST
−4.5 −3.6 −4.0 −4.9 −3.5 −3.9 −4.0 −4.8 −4.6 −4.7 −4.0 −3.2 −3.5 −4.5 −3.1 −3.5 −3.6 −4.5 −4.3 −4.4
EURO
−5.0 −3.8 −4.6 −2.9 −4.9 −5.2 −5.2 −3.3 −4.6 −5.0 −4.6 −3.3 −4.2 −2.5 −4.5 −4.8 −4.7 −3.0 −4.2 −4.7
−6
EASIA
VERIFICATION
−4.1 −4.0 −3.4 −4.6 −4.0 −3.9 −3.8 −4.0 −4.1 −4.6 −3.6 −3.5 −2.9 −4.2 −3.6 −3.4 −3.4 −3.6 −3.7 −4.2
CSAMERIC
−4.6 −3.2 −4.0 −3.8 −3.7 −3.6 −3.7 −4.3 −4.3 −5.0 −4.0 −2.8 −3.6 −3.4 −3.3 −3.1 −3.3 −4.2 −3.8 −4.9
CASIA
−3.1 −4.6 −4.2 −5.1 −4.4 −4.3 −4.1 −4.4 −4.2 −3.0 −2.7 −4.2 −3.7 −4.7 −4.0 −3.8 −3.8 −4.1 −3.9 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 242: For algorithm realnetworks-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


282
Cross region FMR at threshold T = 0.886 for algorithm realnetworks_003, giving FMR(T) = 0.0001 globally.
−3.4 −5.7 −5.0 −5.4 −4.9 −4.9 −4.7 −4.9 −4.7 −2.9 −3.0 −6.0 −4.6 −5.1 −4.5 −4.5 −4.3 −4.5 −4.3 −2.6
SSAFRICA
−4.4 −4.5 −4.5 −4.8 −4.8 −4.2 −4.0 −4.3 −3.2 −4.6 −4.0 −4.1 −4.1 −4.4 −4.4 −3.8 −3.7 −4.0 −2.9 −4.2
SASIA
−4.5 −4.3 −4.4 −3.7 −5.0 −5.0 −4.8 −2.8 −4.2 −4.8 −4.1 −3.9 −3.9 −3.3 −4.5 −4.8 −4.4 −2.5 −3.8 −4.4
POLY
2019/10/16 12:43:37
−4.4 −4.0 −4.0 −5.4 −4.3 −3.8 −3.5 −4.9 −4.1 −5.2 −3.8 −3.6 −3.5 −5.4 −4.0 −3.3 −3.1 −4.3 −3.6 −4.3
NAFRICA log10 FMR
−4.5 −4.0 −4.1 −5.3 −4.2 −3.6 −3.7 −5.0 −4.1 −4.8 −4.0 −3.5 −3.6 −4.9 −3.7 −3.1 −3.2 −4.6 −3.7 −4.5
MEAST
−4.8 −3.9 −4.3 −5.1 −3.8 −4.2 −4.3 −5.1 −4.9 −4.9 −4.3 −3.6 −3.8 −4.7 −3.4 −3.8 −3.9 −4.8 −4.5 −4.6
EURO
−5.2 −4.1 −4.9 −3.2 −5.2 −5.5 −5.4 −3.6 −4.8 −5.2 −4.8 −3.7 −4.5 −2.8 −4.8 −5.0 −4.9 −3.3 −4.4 −4.9 −1
EASIA
−4.4 −4.2 −3.7 −4.9 −4.3 −4.2 −4.1 −4.3 −4.4 −4.9 −3.8 −3.8 −3.2 −4.5 −3.8 −3.7 −3.7 −3.9 −4.0 −4.5
FRVT
CSAMERIC
-
−4.8 −3.5 −4.3 −4.0 −4.0 −4.0 −4.1 −4.5 −4.6 −5.5 −4.3 −3.1 −3.8 −3.6 −3.6 −3.4 −3.6 −4.2 −4.0 −6.0
CASIA −2
−3.4 −4.9 −4.4 −5.4 −4.7 −4.6 −4.4 −4.6 −4.5 −3.3 −2.9 −4.3 −3.9 −5.0 −4.3 −4.1 −3.9 −4.4 −4.1 −2.9
CARIB

−3.1 −5.4 −4.7 −5.1 −4.6 −4.6 −4.5 −4.6 −4.4 −2.7 −2.8 −6.0 −4.3 −4.9 −4.3 −4.3 −4.1 −4.3 −4.0 −2.4
SSAFRICA
−4.1 −4.2 −4.2 −4.5 −4.5 −3.9 −3.8 −4.0 −2.9 −4.3 −3.7 −3.8 −3.8 −4.1 −4.2 −3.5 −3.5 −3.7 −2.6 −4.0
SASIA

−4
−4.3 −4.1 −4.1 −3.4 −4.7 −4.8 −4.5 −2.5 −4.0 −4.5 −3.9 −3.6 −3.7 −3.0 −4.2 −4.7 −4.2 −2.2 −3.6 −4.2
POLY
−4.1 −3.7 −3.8 −5.1 −4.0 −3.5 −3.3 −4.7 −3.8 −4.9 −3.5 −3.3 −3.2 −5.4 −3.8 −3.0 −2.8 −4.1 −3.4 −4.1
NAFRICA
-
−4.3 −3.7 −3.8 −5.1 −3.9 −3.3 −3.4 −4.7 −3.8 −4.6 −3.7 −3.2 −3.4 −4.7 −3.5 −2.9 −2.9 −4.4 −3.5 −4.3 −5
MEAST
−4.5 −3.7 −4.0 −4.8 −3.5 −3.9 −4.0 −4.8 −4.6 −4.7 −4.0 −3.3 −3.5 −4.5 −3.1 −3.5 −3.7 −4.5 −4.2 −4.3
EURO
−5.0 −3.8 −4.7 −2.9 −4.9 −5.3 −5.1 −3.4 −4.6 −4.9 −4.5 −3.4 −4.2 −2.5 −4.6 −4.8 −4.7 −3.0 −4.2 −4.7
−6
EASIA
VERIFICATION
−4.1 −4.0 −3.4 −4.6 −4.0 −3.9 −3.8 −4.0 −4.1 −4.6 −3.6 −3.5 −2.9 −4.2 −3.6 −3.4 −3.4 −3.6 −3.7 −4.2
CSAMERIC
−4.6 −3.2 −4.0 −3.8 −3.7 −3.7 −3.8 −4.2 −4.3 −5.3 −4.0 −2.8 −3.6 −3.4 −3.3 −3.1 −3.3 −3.9 −3.7 −6.0
CASIA
−3.1 −4.6 −4.2 −5.1 −4.4 −4.3 −4.1 −4.3 −4.2 −3.0 −2.7 −4.0 −3.7 −4.8 −4.1 −3.8 −3.6 −4.1 −3.8 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 243: For algorithm realnetworks-003 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


283
Cross region FMR at threshold T = 70.373 for algorithm remarkai_000, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.4 −5.9 −5.1 −5.5 −5.2 −5.4 −5.1 −3.2 −3.2 −6.0 −4.9 −5.7 −4.6 −5.2 −5.3 −5.1 −4.7 −2.9
SSAFRICA
−4.2 −4.7 −3.9 −4.9 −4.6 −4.1 −4.1 −4.4 −3.3 −4.7 −3.4 −3.8 −2.9 −4.1 −3.8 −3.2 −3.3 −3.8 −2.8 −4.1
SASIA
−4.6 −4.6 −4.2 −3.8 −5.1 −5.0 −5.2 −2.9 −4.4 −5.1 −4.0 −3.9 −3.3 −3.2 −4.3 −4.2 −4.7 −2.6 −3.8 −4.6
POLY
2019/10/16 12:43:37
−4.6 −4.7 −4.3 −5.8 −4.9 −4.1 −3.9 −5.7 −4.4 −5.5 −4.1 −3.9 −3.7 −5.7 −4.4 −3.5 −3.5 −6.0 −3.8 −4.9
NAFRICA log10 FMR
−4.4 −4.4 −3.8 −5.3 −4.5 −3.8 −3.9 −4.7 −3.9 −5.2 −3.5 −3.6 −2.8 −4.4 −3.5 −2.9 −3.0 −3.8 −2.9 −4.5
MEAST
−4.9 −4.7 −4.4 −5.6 −4.5 −4.6 −4.8 −5.3 −4.8 −5.3 −4.1 −4.1 −3.6 −4.8 −3.9 −3.8 −4.0 −4.5 −4.0 −4.5
EURO
−5.3 −4.2 −4.7 −3.5 −5.4 −5.5 −5.6 −3.8 −5.0 −5.7 −4.5 −3.6 −3.8 −2.9 −4.6 −4.7 −5.1 −3.3 −4.4 −5.0 −1
EASIA
−4.3 −4.4 −3.4 −4.8 −4.5 −4.1 −4.1 −4.3 −4.1 −5.1 −3.5 −3.6 −2.6 −4.0 −3.6 −3.2 −3.2 −3.5 −3.2 −4.4
FRVT
CSAMERIC
-
−5.5 −3.8 −4.5 −4.4 −4.6 −4.4 −4.5 −4.9 −5.0 −5.9 −4.7 −3.4 −3.5 −4.1 −3.8 −3.5 −3.9 −4.9 −4.2 −5.2
CASIA −2
−3.5 −5.6 −4.7 −5.6 −4.9 −4.9 −4.8 −4.9 −4.6 −3.5 −2.8 −5.0 −4.0 −4.9 −4.2 −4.3 −4.2 −4.4 −4.2 −3.0
CARIB

−3.4 −6.0 −5.1 −5.7 −4.9 −5.2 −5.0 −5.1 −4.8 −2.9 −3.0 −6.0 −4.7 −5.5 −4.5 −4.9 −5.0 −4.9 −4.4 −2.6
SSAFRICA
−4.1 −4.6 −3.8 −4.8 −4.6 −4.0 −4.0 −4.2 −3.1 −4.6 −3.3 −3.8 −2.9 −4.1 −3.7 −3.2 −3.3 −3.7 −2.6 −4.0
SASIA

−4
−4.4 −4.4 −4.0 −3.6 −5.0 −4.9 −5.1 −2.7 −4.2 −4.9 −3.8 −3.8 −3.2 −3.1 −4.2 −4.0 −4.5 −2.4 −3.6 −4.4
POLY
−4.3 −4.4 −4.1 −5.6 −4.7 −3.9 −3.7 −5.4 −4.2 −5.3 −3.8 −3.6 −3.4 −5.4 −4.1 −3.3 −3.3 −6.0 −3.6 −4.6
NAFRICA
-
−4.3 −4.3 −3.7 −5.2 −4.4 −3.6 −3.7 −4.6 −3.8 −5.1 −3.4 −3.6 −2.8 −4.3 −3.5 −2.8 −2.9 −3.7 −2.9 −4.5 −5
MEAST
−4.8 −4.4 −4.3 −5.4 −4.3 −4.5 −4.7 −5.1 −4.7 −5.1 −4.0 −3.8 −3.5 −4.7 −3.7 −3.7 −4.0 −4.4 −3.9 −4.4
EURO
−5.1 −4.0 −4.6 −3.3 −5.3 −5.4 −5.5 −3.6 −4.9 −5.5 −4.4 −3.5 −3.7 −2.7 −4.5 −4.5 −5.0 −3.1 −4.3 −5.0
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.3 −4.7 −4.3 −3.9 −3.9 −4.1 −3.9 −4.9 −3.4 −3.5 −2.5 −3.9 −3.5 −3.1 −3.2 −3.4 −3.1 −4.3
CSAMERIC
−5.3 −3.5 −4.3 −4.1 −4.4 −4.1 −4.2 −4.6 −4.8 −5.6 −4.5 −3.1 −3.4 −3.8 −3.7 −3.4 −3.9 −4.9 −4.0 −4.9
CASIA
−3.3 −5.3 −4.4 −5.4 −4.7 −4.7 −4.5 −4.6 −4.4 −3.2 −2.7 −4.7 −3.8 −4.7 −4.1 −4.1 −3.9 −4.1 −3.9 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 244: For algorithm remarkai-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


284
Cross region FMR at threshold T = 70.384 for algorithm remarkai_001, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.4 −5.9 −5.1 −5.5 −5.2 −5.4 −5.1 −3.2 −3.2 −6.0 −5.0 −5.7 −4.6 −5.2 −5.3 −5.1 −4.7 −2.9
SSAFRICA
−4.2 −4.7 −3.9 −4.9 −4.6 −4.0 −4.1 −4.4 −3.3 −4.7 −3.4 −3.9 −2.9 −4.1 −3.8 −3.2 −3.3 −3.8 −2.8 −4.1
SASIA
−4.6 −4.6 −4.2 −3.8 −5.1 −5.0 −5.2 −2.9 −4.4 −5.1 −4.0 −3.9 −3.3 −3.2 −4.3 −4.2 −4.7 −2.6 −3.8 −4.6
POLY
2019/10/16 12:43:37
−4.6 −4.7 −4.3 −5.8 −4.9 −4.1 −3.9 −6.0 −4.4 −5.5 −4.1 −3.9 −3.7 −5.7 −4.4 −3.6 −3.5 −6.0 −3.8 −4.9
NAFRICA log10 FMR
−4.4 −4.4 −3.8 −5.3 −4.5 −3.8 −3.9 −4.7 −3.9 −5.2 −3.5 −3.6 −2.8 −4.4 −3.6 −2.9 −3.0 −3.8 −2.9 −4.5
MEAST
−4.9 −4.7 −4.4 −5.6 −4.6 −4.6 −4.8 −5.3 −4.8 −5.3 −4.1 −4.1 −3.6 −4.8 −3.9 −3.8 −4.0 −4.5 −4.0 −4.5
EURO
−5.3 −4.2 −4.7 −3.5 −5.4 −5.5 −5.6 −3.8 −5.0 −5.7 −4.5 −3.6 −3.8 −2.9 −4.6 −4.6 −5.1 −3.3 −4.4 −5.1 −1
EASIA
−4.3 −4.4 −3.4 −4.8 −4.5 −4.1 −4.1 −4.3 −4.0 −5.1 −3.5 −3.6 −2.6 −4.0 −3.6 −3.2 −3.2 −3.5 −3.2 −4.4
FRVT
CSAMERIC
-
−5.5 −3.8 −4.5 −4.4 −4.6 −4.4 −4.5 −4.9 −5.0 −5.9 −4.6 −3.4 −3.5 −4.1 −3.9 −3.6 −3.9 −4.9 −4.2 −5.2
CASIA −2
−3.5 −5.6 −4.7 −5.6 −4.9 −4.9 −4.8 −4.9 −4.7 −3.5 −2.8 −5.0 −4.0 −4.9 −4.2 −4.2 −4.2 −4.4 −4.2 −3.0
CARIB

−3.4 −6.0 −5.1 −5.7 −4.9 −5.2 −4.9 −5.1 −4.8 −2.9 −3.0 −6.0 −4.7 −5.5 −4.5 −4.9 −5.0 −4.9 −4.4 −2.6
SSAFRICA
−4.1 −4.6 −3.8 −4.8 −4.6 −4.0 −4.0 −4.2 −3.1 −4.6 −3.3 −3.8 −2.9 −4.1 −3.7 −3.2 −3.3 −3.7 −2.6 −4.0
SASIA

−4
−4.4 −4.4 −4.0 −3.6 −5.0 −4.8 −5.1 −2.7 −4.2 −4.9 −3.9 −3.8 −3.2 −3.1 −4.2 −4.0 −4.5 −2.4 −3.6 −4.4
POLY
−4.4 −4.4 −4.1 −5.6 −4.7 −3.9 −3.7 −5.7 −4.2 −5.3 −3.8 −3.6 −3.4 −5.4 −4.1 −3.3 −3.3 −6.0 −3.6 −4.6
NAFRICA
-
−4.3 −4.3 −3.7 −5.2 −4.4 −3.6 −3.7 −4.6 −3.8 −5.1 −3.4 −3.6 −2.8 −4.3 −3.5 −2.8 −2.9 −3.7 −2.9 −4.5 −5
MEAST
−4.8 −4.4 −4.3 −5.4 −4.3 −4.5 −4.7 −5.1 −4.7 −5.1 −4.0 −3.8 −3.5 −4.7 −3.7 −3.7 −4.0 −4.4 −3.9 −4.4
EURO
−5.1 −4.0 −4.6 −3.3 −5.3 −5.4 −5.5 −3.6 −4.9 −5.6 −4.4 −3.5 −3.7 −2.7 −4.5 −4.5 −5.0 −3.1 −4.3 −5.0
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.3 −4.7 −4.3 −3.9 −3.9 −4.1 −3.9 −4.9 −3.4 −3.5 −2.5 −3.9 −3.5 −3.1 −3.2 −3.4 −3.1 −4.3
CSAMERIC
−5.3 −3.5 −4.3 −4.1 −4.4 −4.1 −4.2 −4.6 −4.8 −5.6 −4.4 −3.1 −3.4 −3.8 −3.7 −3.4 −3.9 −4.9 −4.0 −4.9
CASIA
−3.3 −5.3 −4.4 −5.4 −4.7 −4.7 −4.5 −4.6 −4.4 −3.2 −2.7 −4.7 −3.8 −4.7 −4.1 −4.1 −4.0 −4.1 −3.9 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 245: For algorithm remarkai-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


285
Cross region FMR at threshold T = 0.663 for algorithm rokid_000, giving FMR(T) = 0.0001 globally.
−3.4 −6.0 −5.2 −5.6 −5.0 −5.3 −5.0 −5.2 −4.9 −3.0 −3.1 −6.0 −4.8 −5.2 −4.6 −4.9 −5.3 −4.8 −4.5 −2.7
SSAFRICA
−4.4 −4.8 −4.3 −5.0 −5.0 −4.3 −4.3 −4.5 −3.3 −4.8 −3.8 −4.3 −3.5 −4.5 −4.3 −3.7 −3.7 −4.1 −2.9 −4.4
SASIA
−4.5 −4.6 −4.2 −3.6 −5.2 −5.2 −5.1 −2.6 −4.3 −4.9 −4.3 −4.1 −3.6 −3.2 −4.7 −4.6 −4.6 −2.3 −3.9 −4.5
POLY
2019/10/16 12:43:37
−4.4 −4.4 −4.2 −5.6 −4.8 −4.1 −3.7 −5.1 −4.4 −5.1 −3.9 −3.6 −3.7 −5.2 −4.5 −3.8 −3.2 −6.0 −3.9 −4.9
NAFRICA log10 FMR
−4.6 −4.4 −4.0 −5.4 −4.6 −3.8 −3.9 −4.9 −4.1 −5.1 −3.7 −3.9 −3.2 −4.6 −3.8 −3.1 −3.2 −4.2 −3.3 −4.5
MEAST
−5.0 −4.5 −4.5 −5.6 −4.4 −4.7 −4.7 −5.3 −5.1 −5.2 −4.4 −4.0 −3.9 −5.1 −4.0 −4.1 −4.2 −4.7 −4.4 −4.8
EURO
−5.2 −4.0 −4.9 −3.3 −5.4 −5.8 −5.8 −3.6 −5.0 −5.4 −4.7 −3.5 −4.2 −2.8 −4.7 −5.1 −5.4 −3.2 −4.6 −5.0 −1
EASIA
−4.3 −4.4 −3.5 −4.9 −4.5 −4.3 −4.1 −4.2 −4.3 −4.9 −3.7 −3.8 −2.9 −4.2 −3.9 −3.5 −3.5 −3.7 −3.6 −4.5
FRVT
CSAMERIC
-
−5.2 −3.5 −4.5 −4.1 −4.5 −4.2 −4.5 −4.7 −4.9 −6.0 −4.6 −3.2 −3.8 −3.7 −3.8 −3.6 −4.2 −4.3 −4.4 −6.0
CASIA −2
−3.4 −5.3 −4.5 −5.4 −4.9 −4.8 −4.5 −4.7 −4.6 −3.4 −2.9 −4.7 −4.0 −5.0 −4.3 −4.4 −4.1 −4.4 −4.2 −3.0
CARIB

−3.1 −5.7 −4.9 −5.3 −4.8 −5.0 −4.7 −4.9 −4.6 −2.7 −2.8 −6.0 −4.5 −5.0 −4.4 −4.6 −5.0 −4.5 −4.2 −2.4
SSAFRICA
−4.2 −4.6 −4.1 −4.7 −4.8 −4.2 −4.1 −4.2 −3.0 −4.6 −3.6 −4.1 −3.4 −4.3 −4.2 −3.6 −3.6 −3.9 −2.7 −4.2
SASIA

−4
−4.2 −4.3 −3.9 −3.3 −5.0 −5.0 −4.8 −2.4 −4.0 −4.6 −4.0 −3.8 −3.4 −2.9 −4.5 −4.6 −4.3 −2.1 −3.6 −4.2
POLY
−4.1 −4.1 −3.9 −5.3 −4.5 −3.8 −3.4 −4.8 −4.1 −4.9 −3.6 −3.3 −3.4 −5.0 −4.2 −3.5 −3.0 −6.0 −3.7 −4.6
NAFRICA
-
−4.4 −4.1 −3.9 −5.2 −4.4 −3.6 −3.7 −4.7 −4.0 −4.9 −3.5 −3.7 −3.1 −4.5 −3.7 −3.0 −3.0 −4.1 −3.2 −4.4 −5
MEAST
−4.8 −4.2 −4.3 −5.3 −4.2 −4.4 −4.5 −5.1 −4.9 −5.0 −4.2 −3.7 −3.8 −4.9 −3.7 −3.9 −4.0 −4.5 −4.3 −4.6
EURO
−5.0 −3.8 −4.7 −3.0 −5.2 −5.6 −5.5 −3.3 −4.8 −5.2 −4.5 −3.3 −4.1 −2.6 −4.6 −4.9 −5.1 −3.0 −4.4 −4.9
−6
EASIA
VERIFICATION
−4.1 −4.1 −3.2 −4.6 −4.3 −4.0 −3.9 −3.9 −4.1 −4.7 −3.5 −3.6 −2.7 −4.0 −3.7 −3.4 −3.4 −3.5 −3.5 −4.3
CSAMERIC
−4.9 −3.3 −4.2 −3.8 −4.2 −3.9 −4.2 −4.4 −4.7 −6.0 −4.3 −2.9 −3.6 −3.5 −3.6 −3.4 −3.9 −4.0 −4.1 −6.0
CASIA
−3.1 −5.1 −4.2 −5.1 −4.6 −4.6 −4.3 −4.4 −4.3 −3.1 −2.7 −4.5 −3.8 −4.8 −4.1 −4.1 −3.8 −4.1 −3.9 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 246: For algorithm rokid-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


286
Cross region FMR at threshold T = 0.682 for algorithm saffe_001, giving FMR(T) = 0.0001 globally.
−3.2 −6.0 −5.1 −5.7 −4.8 −5.1 −4.9 −5.3 −5.2 −2.8 −3.0 −6.0 −4.8 −5.6 −4.6 −4.9 −4.7 −5.3 −5.1 −2.6
SSAFRICA
−4.7 −4.8 −4.6 −4.8 −5.2 −4.5 −4.7 −4.6 −3.4 −5.2 −4.0 −4.2 −3.7 −4.3 −4.4 −3.8 −4.0 −4.1 −3.1 −4.8
SASIA
−4.8 −4.4 −4.6 −3.7 −5.3 −5.2 −5.1 −3.4 −4.6 −5.4 −4.3 −4.0 −3.8 −3.3 −4.7 −4.4 −4.4 −3.0 −4.2 −5.3
POLY
2019/10/16 12:43:37
−5.3 −5.4 −5.2 −5.4 −5.4 −4.8 −5.2 −5.2 −5.0 −6.0 −4.5 −6.0 −4.8 −4.9 −5.2 −4.4 −6.0 −4.9 −4.6 −6.0
NAFRICA log10 FMR
−5.0 −4.8 −4.6 −5.5 −4.9 −4.4 −4.5 −5.0 −4.5 −5.7 −4.2 −4.3 −3.6 −4.8 −4.2 −3.7 −3.7 −4.2 −3.8 −5.4
MEAST
−5.3 −5.0 −5.1 −5.0 −5.0 −5.1 −5.2 −5.6 −5.3 −5.2 −4.7 −4.5 −4.3 −4.6 −4.4 −4.5 −4.8 −5.0 −4.8 −4.8
EURO
−5.3 −3.7 −4.8 −2.8 −5.1 −5.3 −5.7 −3.6 −4.8 −5.6 −4.8 −3.4 −4.1 −2.5 −4.6 −4.6 −5.1 −3.2 −4.4 −5.2 −1
EASIA
−4.8 −4.9 −4.3 −4.9 −5.1 −4.7 −4.8 −4.7 −4.6 −5.1 −4.0 −4.1 −3.4 −4.1 −4.3 −3.9 −3.9 −3.9 −3.9 −4.8
FRVT
CSAMERIC
-
−5.3 −3.6 −4.8 −3.6 −4.7 −4.8 −4.9 −4.1 −5.1 −5.9 −4.6 −3.2 −4.2 −3.3 −4.0 −4.1 −4.2 −4.2 −4.7 −5.2
CASIA −2
−3.3 −5.4 −5.0 −5.7 −4.9 −5.1 −5.1 −5.0 −4.7 −3.2 −2.9 −4.8 −4.6 −5.3 −4.5 −4.6 −4.8 −4.6 −4.4 −2.9
CARIB

−3.0 −6.0 −4.9 −5.6 −4.6 −4.9 −4.7 −5.2 −5.0 −2.6 −2.8 −6.0 −4.7 −5.5 −4.4 −4.8 −4.4 −5.3 −4.8 −2.4
SSAFRICA
−4.4 −4.6 −4.4 −4.6 −5.0 −4.3 −4.5 −4.4 −3.1 −5.0 −3.9 −4.1 −3.6 −4.1 −4.4 −3.8 −4.0 −4.0 −2.8 −4.6
SASIA

−4
−4.6 −4.2 −4.4 −3.4 −5.1 −5.0 −5.0 −3.1 −4.4 −5.2 −4.2 −3.9 −3.7 −3.1 −4.5 −4.3 −4.5 −2.8 −4.0 −5.3
POLY
−5.0 −5.1 −5.0 −5.1 −5.1 −4.5 −4.9 −4.9 −4.7 −5.7 −4.2 −6.0 −4.6 −4.7 −4.9 −4.1 −6.0 −4.6 −4.3 −6.0
NAFRICA
-
−4.8 −4.6 −4.4 −5.4 −4.7 −4.2 −4.3 −4.8 −4.2 −5.4 −4.0 −4.1 −3.5 −4.6 −4.0 −3.5 −3.5 −4.0 −3.7 −5.1 −5
MEAST
−5.0 −4.7 −5.0 −4.8 −4.7 −4.9 −5.0 −5.5 −5.2 −5.0 −4.5 −4.2 −4.2 −4.4 −4.2 −4.3 −4.7 −4.9 −4.6 −4.5
EURO
−5.0 −3.5 −4.6 −2.6 −4.9 −5.2 −5.5 −3.3 −4.6 −5.3 −4.6 −3.2 −4.0 −2.3 −4.4 −4.5 −4.9 −3.0 −4.2 −5.0
−6
EASIA
VERIFICATION
−4.6 −4.7 −4.2 −4.7 −4.9 −4.6 −4.6 −4.5 −4.5 −4.9 −3.9 −4.1 −3.4 −4.0 −4.2 −3.8 −3.8 −3.8 −3.8 −4.6
CSAMERIC
−5.0 −3.4 −4.6 −3.3 −4.4 −4.6 −4.7 −3.8 −4.8 −5.6 −4.3 −2.9 −4.0 −3.1 −3.8 −4.1 −4.1 −4.0 −4.5 −4.9
CASIA
−3.1 −5.1 −4.8 −5.4 −4.7 −4.9 −4.9 −4.8 −4.4 −3.0 −2.7 −4.5 −4.3 −5.0 −4.3 −4.3 −4.5 −4.4 −4.1 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 247: For algorithm saffe-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individ-


287
Cross region FMR at threshold T = 0.383 for algorithm saffe_002, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.3 −5.8 −5.0 −5.3 −5.0 −5.3 −5.0 −3.1 −3.0 −6.0 −4.8 −5.5 −4.5 −4.8 −4.8 −4.9 −4.6 −2.8
SSAFRICA
−4.2 −4.7 −3.9 −4.9 −4.6 −4.0 −4.1 −4.4 −3.3 −4.8 −3.4 −3.9 −3.0 −4.1 −3.8 −3.2 −3.3 −3.8 −2.7 −4.2
SASIA
−4.6 −4.6 −4.3 −3.8 −5.2 −5.2 −5.2 −2.9 −4.5 −5.1 −4.0 −4.0 −3.5 −3.3 −4.4 −4.4 −4.6 −2.6 −4.0 −4.7
POLY
2019/10/16 12:43:37
−4.6 −4.6 −4.2 −5.9 −4.9 −4.0 −3.9 −5.4 −4.4 −5.2 −4.2 −3.9 −3.6 −5.7 −4.3 −3.4 −3.5 −4.9 −3.8 −4.4
NAFRICA log10 FMR
−4.3 −4.4 −3.8 −5.2 −4.4 −3.7 −3.9 −4.7 −3.8 −5.0 −3.4 −3.8 −2.9 −4.4 −3.5 −2.8 −3.0 −4.0 −2.9 −4.2
MEAST
−4.9 −4.5 −4.4 −5.6 −4.5 −4.6 −4.7 −5.4 −4.8 −5.3 −4.1 −3.9 −3.6 −4.8 −3.8 −3.7 −3.9 −4.6 −4.0 −4.6
EURO
−5.3 −4.1 −4.7 −3.4 −5.3 −5.5 −5.6 −3.8 −5.0 −5.6 −4.5 −3.5 −3.8 −2.8 −4.5 −4.7 −4.9 −3.3 −4.5 −4.9 −1
EASIA
−4.3 −4.4 −3.5 −4.8 −4.5 −4.0 −4.1 −4.3 −4.1 −5.0 −3.4 −3.6 −2.6 −4.0 −3.6 −3.2 −3.2 −3.6 −3.3 −4.3
FRVT
CSAMERIC
-
−5.3 −3.7 −4.2 −4.4 −4.5 −4.3 −4.5 −4.9 −4.8 −6.0 −4.3 −3.3 −3.2 −4.0 −3.7 −3.4 −4.0 −4.3 −3.9 −5.2
CASIA −2
−3.4 −5.9 −4.6 −5.4 −4.8 −4.9 −4.8 −4.8 −4.7 −3.4 −2.7 −6.0 −4.0 −4.8 −4.1 −4.2 −4.1 −4.4 −4.2 −2.8
CARIB

−3.3 −6.0 −5.0 −5.5 −4.8 −5.1 −4.7 −5.0 −4.8 −2.8 −2.9 −6.0 −4.6 −5.2 −4.3 −4.5 −4.5 −4.6 −4.4 −2.5
SSAFRICA
−4.1 −4.6 −3.8 −4.7 −4.5 −3.9 −4.0 −4.3 −3.1 −4.6 −3.3 −3.8 −2.9 −4.0 −3.8 −3.2 −3.3 −3.8 −2.6 −4.1
SASIA

−4
−4.4 −4.4 −4.1 −3.5 −5.0 −5.0 −4.9 −2.7 −4.3 −4.9 −3.9 −3.8 −3.4 −3.1 −4.3 −4.2 −4.3 −2.3 −3.8 −4.4
POLY
−4.4 −4.4 −4.0 −5.6 −4.7 −3.8 −3.6 −5.1 −4.2 −4.9 −4.0 −3.6 −3.4 −5.4 −4.1 −3.2 −3.2 −4.6 −3.8 −4.1
NAFRICA
-
−4.2 −4.2 −3.7 −5.1 −4.3 −3.6 −3.7 −4.6 −3.7 −4.9 −3.3 −3.6 −2.8 −4.3 −3.4 −2.7 −2.9 −3.9 −2.8 −4.2 −5
MEAST
−4.8 −4.3 −4.3 −5.4 −4.2 −4.4 −4.5 −5.2 −4.7 −5.1 −4.0 −3.7 −3.5 −4.7 −3.7 −3.6 −3.8 −4.5 −3.9 −4.5
EURO
−5.1 −4.0 −4.6 −3.2 −5.2 −5.4 −5.5 −3.6 −4.9 −5.4 −4.4 −3.4 −3.7 −2.6 −4.4 −4.6 −4.7 −3.1 −4.3 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.7 −4.3 −3.9 −3.9 −4.1 −4.0 −4.8 −3.3 −3.6 −2.5 −3.9 −3.5 −3.1 −3.1 −3.4 −3.2 −4.2
CSAMERIC
−5.0 −3.5 −4.1 −4.1 −4.3 −4.1 −4.3 −4.7 −4.7 −6.0 −4.1 −3.0 −3.1 −3.7 −3.5 −3.2 −3.9 −4.3 −3.8 −6.0
CASIA
−3.2 −5.6 −4.4 −5.2 −4.6 −4.7 −4.5 −4.6 −4.4 −3.1 −2.6 −6.0 −3.8 −4.6 −4.0 −4.0 −3.9 −4.1 −3.9 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 248: For algorithm saffe-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individ-


288
Cross region FMR at threshold T = 0.390 for algorithm sensetime_001, giving FMR(T) = 0.0001 globally.
−3.4 −5.8 −5.1 −5.8 −4.9 −5.1 −4.9 −5.1 −4.7 −2.9 −2.9 −6.0 −4.7 −5.5 −4.5 −4.7 −4.6 −4.8 −4.2 −2.6
SSAFRICA
−4.2 −4.8 −4.2 −5.1 −4.8 −4.1 −4.1 −4.4 −2.9 −4.6 −3.5 −4.1 −3.3 −4.4 −4.1 −3.4 −3.5 −4.0 −2.5 −4.1
SASIA
−4.5 −4.9 −4.4 −4.0 −5.3 −5.2 −5.1 −3.0 −4.2 −5.0 −4.0 −4.4 −3.7 −3.5 −4.6 −4.6 −4.4 −2.6 −3.7 −4.7
POLY
2019/10/16 12:43:37
−4.4 −4.6 −4.2 −5.9 −4.8 −4.0 −3.6 −5.3 −4.1 −4.8 −3.8 −3.7 −3.5 −5.7 −4.3 −3.4 −3.1 −4.6 −3.6 −4.4
NAFRICA log10 FMR
−4.4 −4.4 −4.0 −5.5 −4.5 −3.7 −3.8 −5.2 −3.9 −5.0 −3.6 −3.8 −3.1 −4.7 −3.8 −3.0 −3.1 −4.5 −3.2 −4.5
MEAST
−4.9 −4.5 −4.5 −5.8 −4.3 −4.6 −4.7 −5.4 −4.9 −5.1 −4.2 −3.9 −3.8 −5.0 −3.8 −3.9 −4.0 −4.6 −4.2 −4.4
EURO
−5.4 −4.4 −5.1 −3.5 −5.6 −5.8 −6.0 −4.0 −5.3 −5.6 −4.6 −3.9 −4.3 −3.0 −4.9 −5.0 −5.4 −3.5 −4.7 −5.0 −1
EASIA
−4.2 −4.6 −3.5 −5.1 −4.5 −4.2 −4.1 −4.4 −4.2 −4.8 −3.5 −3.9 −2.8 −4.3 −3.8 −3.4 −3.4 −3.8 −3.5 −4.2
FRVT
CSAMERIC
-
−5.2 −3.7 −4.6 −4.5 −4.4 −4.3 −4.3 −5.1 −5.0 −6.0 −4.3 −3.2 −3.9 −4.1 −3.8 −3.8 −4.1 −5.2 −4.6 −5.2
CASIA −2
−3.3 −5.2 −4.4 −5.6 −4.7 −4.7 −4.4 −4.7 −4.4 −3.3 −2.7 −4.8 −3.9 −5.0 −4.1 −4.0 −3.8 −4.3 −3.8 −2.8
CARIB

−3.1 −5.5 −4.8 −5.6 −4.7 −4.8 −4.6 −4.8 −4.4 −2.6 −2.7 −6.0 −4.4 −5.2 −4.3 −4.4 −4.4 −4.5 −3.9 −2.3
SSAFRICA
−3.9 −4.6 −4.0 −4.8 −4.6 −3.9 −3.9 −4.2 −2.7 −4.3 −3.4 −4.0 −3.2 −4.3 −4.0 −3.3 −3.3 −3.8 −2.3 −3.9
SASIA

−4
−4.2 −4.6 −4.1 −3.7 −5.1 −5.0 −4.8 −2.7 −3.9 −4.8 −3.7 −4.1 −3.5 −3.2 −4.4 −4.5 −4.1 −2.3 −3.4 −4.4
POLY
−4.1 −4.3 −3.9 −5.6 −4.5 −3.7 −3.4 −5.0 −3.9 −4.6 −3.5 −3.4 −3.3 −5.4 −4.1 −3.2 −2.8 −4.3 −3.3 −4.1
NAFRICA
-
−4.2 −4.1 −3.9 −5.4 −4.3 −3.5 −3.5 −5.0 −3.7 −4.7 −3.4 −3.5 −3.0 −4.6 −3.6 −2.8 −2.9 −4.4 −3.1 −4.3 −5
MEAST
−4.7 −4.2 −4.2 −5.5 −4.1 −4.4 −4.4 −5.2 −4.8 −4.9 −4.0 −3.6 −3.6 −4.9 −3.6 −3.8 −3.8 −4.4 −4.1 −4.3
EURO
−5.2 −4.2 −4.9 −3.3 −5.4 −5.7 −5.8 −3.7 −5.0 −5.4 −4.4 −3.7 −4.1 −2.8 −4.7 −4.9 −5.3 −3.2 −4.5 −4.7
−6
EASIA
VERIFICATION
−4.0 −4.3 −3.2 −4.9 −4.3 −4.0 −3.9 −4.1 −3.9 −4.6 −3.3 −3.7 −2.6 −4.2 −3.7 −3.3 −3.2 −3.6 −3.3 −4.1
CSAMERIC
−4.9 −3.5 −4.4 −4.3 −4.1 −4.0 −4.0 −4.8 −4.7 −5.9 −4.0 −3.0 −3.7 −3.8 −3.6 −3.5 −3.8 −4.9 −4.3 −4.9
CASIA
−3.1 −4.9 −4.2 −5.4 −4.5 −4.4 −4.2 −4.4 −4.1 −3.0 −2.5 −4.5 −3.6 −4.9 −3.9 −3.8 −3.6 −4.0 −3.6 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 249: For algorithm sensetime-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


289
Cross region FMR at threshold T = 0.390 for algorithm sensetime_002, giving FMR(T) = 0.0001 globally.
−3.3 −6.0 −5.1 −6.0 −4.9 −5.1 −4.9 −5.2 −4.7 −2.9 −2.9 −6.0 −4.7 −5.6 −4.5 −4.7 −4.5 −5.0 −4.2 −2.6
SSAFRICA
−4.2 −4.8 −4.1 −5.1 −4.7 −4.1 −4.1 −4.5 −2.9 −4.6 −3.5 −4.1 −3.2 −4.5 −4.0 −3.4 −3.5 −4.0 −2.6 −4.1
SASIA
−4.5 −5.2 −4.4 −4.1 −5.4 −5.3 −5.1 −3.0 −4.2 −5.1 −4.1 −5.0 −3.8 −3.6 −4.7 −4.6 −4.6 −2.7 −3.8 −4.8
POLY
2019/10/16 12:43:37
−4.3 −4.5 −4.1 −6.0 −4.7 −3.9 −3.6 −5.6 −4.1 −4.8 −3.7 −3.7 −3.5 −5.7 −4.2 −3.3 −3.0 −4.9 −3.5 −4.3
NAFRICA log10 FMR
−4.4 −4.2 −4.0 −5.5 −4.4 −3.6 −3.8 −5.2 −3.9 −5.0 −3.6 −3.7 −3.1 −4.7 −3.6 −2.9 −3.0 −4.5 −3.1 −4.5
MEAST
−4.9 −4.5 −4.4 −5.8 −4.3 −4.5 −4.6 −5.4 −4.9 −5.2 −4.2 −3.9 −3.7 −5.1 −3.8 −3.9 −4.0 −4.7 −4.2 −4.7
EURO
−5.5 −4.5 −5.1 −3.7 −5.7 −5.9 −5.9 −4.1 −5.3 −5.7 −4.6 −4.0 −4.3 −3.1 −4.9 −5.0 −5.1 −3.6 −4.8 −4.9 −1
EASIA
−4.2 −4.5 −3.4 −5.1 −4.4 −4.1 −4.1 −4.4 −4.1 −4.8 −3.5 −3.8 −2.7 −4.4 −3.8 −3.4 −3.4 −3.8 −3.4 −4.3
FRVT
CSAMERIC
-
−5.1 −3.7 −4.6 −4.6 −4.4 −4.2 −4.3 −5.5 −5.0 −6.0 −4.5 −3.2 −3.9 −4.1 −3.8 −3.6 −4.4 −6.0 −4.5 −6.0
CASIA −2
−3.3 −5.0 −4.4 −5.7 −4.7 −4.7 −4.4 −4.7 −4.4 −3.3 −2.7 −4.5 −3.8 −5.1 −4.1 −4.0 −3.8 −4.3 −3.9 −2.8
CARIB

−3.1 −5.7 −4.8 −5.8 −4.7 −4.8 −4.6 −4.9 −4.4 −2.6 −2.7 −6.0 −4.4 −5.3 −4.3 −4.5 −4.3 −4.7 −4.0 −2.3
SSAFRICA
−3.9 −4.6 −4.0 −4.9 −4.6 −3.9 −3.9 −4.2 −2.7 −4.3 −3.4 −3.9 −3.2 −4.3 −3.9 −3.3 −3.3 −3.8 −2.4 −3.9
SASIA

−4
−4.3 −4.9 −4.1 −3.8 −5.1 −5.1 −4.9 −2.8 −4.0 −4.8 −3.8 −4.7 −3.6 −3.4 −4.5 −4.6 −4.3 −2.4 −3.5 −4.5
POLY
−4.0 −4.2 −3.9 −5.8 −4.5 −3.7 −3.3 −5.3 −3.8 −4.6 −3.4 −3.4 −3.2 −5.4 −4.0 −3.1 −2.7 −4.6 −3.3 −4.1
NAFRICA
-
−4.2 −4.0 −3.8 −5.4 −4.2 −3.4 −3.5 −5.0 −3.7 −4.8 −3.4 −3.5 −2.9 −4.6 −3.5 −2.7 −2.8 −4.4 −3.0 −4.3 −5
MEAST
−4.6 −4.2 −4.2 −5.6 −4.0 −4.3 −4.4 −5.3 −4.7 −4.9 −4.0 −3.6 −3.5 −5.0 −3.5 −3.7 −3.8 −4.6 −4.1 −4.5
EURO
−5.2 −4.3 −4.9 −3.4 −5.5 −5.7 −5.6 −3.8 −5.1 −5.4 −4.5 −3.8 −4.2 −2.9 −4.8 −4.8 −4.9 −3.4 −4.6 −4.8
−6
EASIA
VERIFICATION
−4.0 −4.3 −3.2 −4.9 −4.2 −4.0 −3.8 −4.1 −3.9 −4.6 −3.3 −3.6 −2.6 −4.2 −3.6 −3.2 −3.2 −3.6 −3.3 −4.1
CSAMERIC
−4.8 −3.4 −4.3 −4.3 −4.1 −3.9 −4.0 −5.2 −4.8 −6.0 −4.2 −2.9 −3.6 −3.9 −3.6 −3.4 −4.1 −6.0 −4.3 −6.0
CASIA
−3.0 −4.7 −4.1 −5.5 −4.4 −4.4 −4.1 −4.4 −4.1 −3.0 −2.5 −4.2 −3.6 −4.9 −3.9 −3.8 −3.5 −4.0 −3.6 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 250: For algorithm sensetime-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


290
Cross region FMR at threshold T = 0.713 for algorithm sertis_000, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.3 −6.0 −4.9 −5.2 −5.1 −5.4 −4.9 −3.1 −2.9 −6.0 −4.8 −5.7 −4.4 −4.6 −4.8 −5.2 −4.4 −2.8
SSAFRICA
−4.0 −4.7 −3.8 −5.0 −4.4 −3.8 −3.9 −4.4 −3.1 −4.5 −3.1 −3.8 −2.8 −4.1 −3.6 −3.0 −3.1 −3.7 −2.6 −3.8
SASIA
−4.7 −5.0 −4.4 −4.1 −5.3 −5.1 −5.1 −3.2 −4.4 −5.4 −4.0 −4.3 −3.5 −3.6 −4.4 −4.1 −4.6 −2.8 −3.8 −4.9
POLY
2019/10/16 12:43:37
−4.5 −4.8 −4.2 −6.0 −5.0 −4.0 −3.8 −5.7 −4.3 −5.0 −3.9 −3.9 −3.6 −5.7 −4.3 −3.4 −3.4 −6.0 −3.6 −4.6
NAFRICA log10 FMR
−4.2 −4.5 −3.7 −5.3 −4.3 −3.6 −3.7 −4.9 −3.7 −4.9 −3.2 −3.9 −2.8 −4.4 −3.4 −2.7 −2.8 −4.0 −2.8 −4.1
MEAST
−4.7 −4.7 −4.3 −5.8 −4.5 −4.5 −4.6 −5.4 −4.6 −5.1 −3.9 −4.0 −3.4 −4.9 −3.8 −3.6 −3.8 −4.5 −3.8 −4.4
EURO
−5.4 −4.6 −4.9 −3.8 −5.6 −5.6 −5.7 −4.2 −5.2 −6.0 −4.5 −3.9 −3.9 −3.2 −4.7 −4.6 −4.8 −3.6 −4.5 −5.2 −1
EASIA
−4.1 −4.5 −3.4 −5.0 −4.4 −3.9 −3.9 −4.4 −3.9 −4.9 −3.2 −3.6 −2.5 −4.1 −3.5 −3.0 −3.1 −3.6 −3.1 −4.1
FRVT
CSAMERIC
-
−5.2 −3.9 −4.4 −4.9 −4.5 −4.3 −4.6 −5.3 −5.1 −6.0 −4.3 −3.4 −3.4 −4.3 −3.7 −3.5 −4.1 −5.2 −4.2 −6.0
CASIA −2
−3.3 −5.9 −4.6 −5.8 −4.7 −4.8 −4.7 −5.0 −4.5 −3.3 −2.6 −6.0 −3.9 −5.1 −4.0 −4.1 −4.0 −4.5 −4.0 −2.7
CARIB

−3.2 −6.0 −5.0 −5.9 −4.8 −4.9 −4.9 −5.1 −4.6 −2.9 −2.8 −6.0 −4.5 −5.4 −4.2 −4.3 −4.7 −4.9 −4.2 −2.5
SSAFRICA
−3.8 −4.6 −3.7 −4.9 −4.4 −3.8 −3.8 −4.3 −3.0 −4.4 −3.0 −3.8 −2.8 −4.1 −3.6 −3.0 −3.1 −3.7 −2.5 −3.8
SASIA

−4
−4.5 −4.7 −4.2 −3.9 −5.2 −4.9 −4.8 −2.9 −4.2 −5.1 −3.9 −4.1 −3.4 −3.4 −4.3 −4.1 −4.3 −2.5 −3.7 −4.7
POLY
−4.3 −4.5 −4.0 −5.8 −4.8 −3.8 −3.5 −5.4 −4.1 −4.7 −3.8 −3.6 −3.4 −5.4 −4.2 −3.2 −3.1 −6.0 −3.5 −4.3
NAFRICA
-
−4.1 −4.3 −3.6 −5.3 −4.2 −3.5 −3.6 −4.8 −3.6 −4.8 −3.1 −3.8 −2.7 −4.3 −3.3 −2.6 −2.8 −4.0 −2.7 −4.0 −5
MEAST
−4.6 −4.4 −4.2 −5.7 −4.3 −4.4 −4.5 −5.3 −4.5 −5.0 −3.8 −3.8 −3.3 −4.8 −3.7 −3.5 −3.7 −4.4 −3.7 −4.3
EURO
−5.2 −4.4 −4.8 −3.6 −5.5 −5.5 −5.6 −3.9 −5.1 −5.9 −4.4 −3.7 −3.8 −3.0 −4.6 −4.6 −4.8 −3.4 −4.4 −5.2
−6
EASIA
VERIFICATION
−4.0 −4.3 −3.3 −4.9 −4.3 −3.8 −3.8 −4.3 −3.8 −4.7 −3.2 −3.6 −2.5 −4.0 −3.4 −2.9 −3.0 −3.5 −3.0 −4.0
CSAMERIC
−5.0 −3.7 −4.3 −4.7 −4.4 −4.1 −4.3 −5.1 −4.9 −6.0 −4.1 −3.2 −3.3 −4.1 −3.6 −3.4 −3.9 −6.0 −4.1 −6.0
CASIA
−3.1 −5.6 −4.4 −5.6 −4.5 −4.6 −4.4 −4.7 −4.2 −3.1 −2.5 −6.0 −3.7 −5.0 −3.9 −3.9 −3.8 −4.2 −3.8 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 251: For algorithm sertis-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


291
Cross region FMR at threshold T = 0.970 for algorithm shaman_000, giving FMR(T) = 0.0001 globally.
−3.7 −3.9 −3.9 −4.2 −3.9 −3.9 −3.9 −4.0 −3.8 −3.6 −3.6 −3.8 −3.8 −4.1 −3.9 −3.8 −3.8 −3.9 −3.7 −3.6
SSAFRICA
−3.8 −4.0 −3.9 −4.2 −4.0 −3.9 −3.8 −4.0 −3.7 −3.8 −3.7 −3.9 −3.8 −4.1 −3.9 −3.8 −3.8 −4.0 −3.6 −3.7
SASIA
−4.1 −4.1 −4.1 −4.0 −4.2 −4.2 −4.0 −3.9 −4.0 −4.0 −4.0 −4.2 −4.0 −4.0 −4.3 −4.3 −4.0 −3.9 −4.0 −3.9
POLY
2019/10/16 12:43:37
−3.8 −4.0 −3.9 −4.2 −3.9 −3.9 −3.8 −3.9 −3.8 −3.8 −3.8 −4.0 −3.8 −4.2 −4.0 −3.9 −3.7 −3.8 −3.7 −3.8
NAFRICA log10 FMR
−4.0 −4.1 −4.0 −4.3 −4.1 −4.0 −4.0 −4.2 −3.9 −3.9 −3.9 −4.2 −3.9 −4.2 −4.0 −3.9 −3.9 −4.0 −3.8 −3.9
MEAST
−4.0 −4.1 −4.0 −4.2 −4.0 −4.0 −4.0 −4.2 −4.0 −4.0 −4.0 −4.1 −3.9 −4.2 −4.0 −3.9 −3.9 −4.1 −4.0 −3.9
EURO
−4.1 −4.0 −4.1 −3.8 −4.2 −4.2 −4.1 −4.0 −4.2 −4.2 −4.1 −4.0 −4.1 −3.8 −4.2 −4.1 −4.0 −4.0 −4.1 −4.1 −1
EASIA
−3.9 −4.0 −4.0 −4.1 −4.0 −4.0 −3.9 −4.1 −3.9 −3.9 −3.9 −3.9 −3.8 −4.1 −3.9 −3.9 −3.9 −4.0 −3.8 −3.8
FRVT
CSAMERIC
-
−4.0 −4.0 −4.1 −4.1 −4.0 −4.1 −4.1 −4.2 −4.0 −4.0 −3.9 −4.0 −3.9 −4.2 −3.9 −3.9 −4.7 −4.1 −4.0 −4.0
CASIA −2
−3.8 −3.9 −3.9 −4.2 −4.0 −3.9 −3.9 −4.0 −3.8 −3.7 −3.7 −3.9 −3.8 −4.2 −3.9 −3.9 −3.8 −4.1 −3.7 −3.7
CARIB

−3.7 −3.9 −3.8 −4.2 −3.9 −3.9 −3.8 −3.9 −3.8 −3.6 −3.6 −3.7 −3.7 −4.1 −3.9 −3.8 −3.7 −3.8 −3.7 −3.5
SSAFRICA
−3.8 −4.0 −3.9 −4.2 −4.0 −3.9 −3.8 −4.0 −3.6 −3.7 −3.7 −4.0 −3.8 −4.1 −4.0 −3.8 −3.7 −4.0 −3.5 −3.7
SASIA

−4
−4.1 −4.1 −4.1 −4.0 −4.2 −4.2 −4.1 −3.9 −4.0 −4.0 −4.0 −4.4 −4.0 −4.0 −4.3 −4.5 −3.9 −3.9 −4.0 −3.8
POLY
−3.8 −4.0 −3.9 −4.2 −3.9 −3.9 −3.8 −3.8 −3.8 −3.8 −4.0 −3.7 −3.8 −4.2 −3.9 −3.8 −3.6 −3.7 −3.7 −3.8
NAFRICA
-
−3.9 −4.0 −4.0 −4.3 −4.0 −3.9 −4.0 −4.2 −3.9 −3.9 −3.8 −4.2 −3.9 −4.2 −3.9 −3.8 −3.8 −4.0 −3.7 −3.8 −5
MEAST
−4.0 −4.0 −4.0 −4.2 −4.0 −4.0 −4.0 −4.1 −4.0 −4.0 −3.9 −4.0 −3.9 −4.2 −3.9 −3.9 −3.9 −4.1 −4.0 −3.9
EURO
−4.1 −4.0 −4.1 −3.8 −4.2 −4.2 −4.1 −4.0 −4.1 −4.1 −4.1 −4.0 −4.0 −3.7 −4.2 −4.1 −4.1 −3.9 −4.1 −4.2
−6
EASIA
VERIFICATION
−3.9 −3.9 −3.9 −4.1 −3.9 −3.9 −3.9 −4.0 −3.9 −3.9 −3.8 −3.8 −3.8 −4.1 −3.9 −3.8 −3.8 −3.9 −3.8 −3.8
CSAMERIC
−4.0 −4.0 −4.0 −4.1 −4.0 −4.0 −4.0 −4.1 −4.0 −4.0 −3.8 −3.7 −3.9 −4.1 −3.8 −3.8 −4.4 −4.0 −3.9 −4.1
CASIA
−3.7 −3.9 −3.9 −4.2 −3.9 −3.9 −3.9 −4.0 −3.8 −3.7 −3.6 −3.8 −3.8 −4.1 −3.9 −3.9 −3.8 −4.0 −3.7 −3.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 252: For algorithm shaman-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


292
Cross region FMR at threshold T = 0.725 for algorithm shaman_001, giving FMR(T) = 0.0001 globally.
−4.9 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −4.7 −4.1 −6.0 −5.8 −6.0 −5.5 −6.0 −5.3 −6.0 −5.7 −4.1
SSAFRICA
−4.3 −4.6 −3.8 −4.7 −4.4 −4.0 −4.2 −4.4 −3.7 −5.0 −3.2 −3.6 −2.8 −3.8 −3.5 −3.0 −3.2 −3.6 −3.0 −4.1
SASIA
−4.9 −4.8 −4.2 −4.2 −5.1 −4.8 −4.8 −3.9 −4.8 −6.0 −4.0 −4.1 −3.2 −3.5 −4.1 −3.8 −3.8 −3.2 −4.0 −5.6
POLY
2019/10/16 12:43:37
−5.6 −6.0 −5.1 −6.0 −5.9 −5.4 −5.2 −6.0 −4.9 −6.0 −4.4 −6.0 −4.1 −5.2 −5.2 −4.6 −4.3 −6.0 −3.8 −6.0
NAFRICA log10 FMR
−4.4 −4.7 −3.8 −5.4 −4.4 −4.0 −4.2 −4.8 −4.1 −5.5 −3.4 −3.7 −2.8 −4.3 −3.4 −3.0 −3.2 −3.8 −3.1 −4.5
MEAST
−4.8 −4.8 −4.2 −5.0 −4.6 −4.5 −4.7 −4.9 −4.8 −5.6 −3.8 −3.9 −3.1 −4.1 −3.7 −3.5 −3.8 −4.0 −3.8 −4.6
EURO
−5.3 −4.0 −4.4 −3.2 −5.0 −5.2 −5.4 −4.0 −5.1 −5.9 −4.3 −3.3 −3.4 −2.6 −4.1 −4.2 −4.3 −3.3 −4.3 −4.9 −1
EASIA
−4.2 −4.4 −3.5 −4.4 −4.2 −3.9 −4.1 −4.2 −4.1 −5.1 −3.1 −3.4 −2.5 −3.4 −3.2 −2.9 −3.1 −3.2 −3.1 −4.0
FRVT
CSAMERIC
-
−5.0 −4.2 −4.2 −4.2 −4.6 −4.6 −5.4 −5.0 −5.1 −6.0 −3.9 −3.7 −3.1 −3.8 −3.6 −3.5 −4.4 −4.1 −4.0 −5.2
CASIA −2
−4.5 −6.0 −5.1 −6.0 −5.6 −5.6 −5.6 −5.7 −5.4 −4.8 −3.7 −5.3 −4.1 −5.4 −4.7 −4.7 −4.8 −5.0 −4.5 −4.1
CARIB

−4.8 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −4.6 −4.1 −6.0 −5.6 −6.0 −5.5 −6.0 −5.0 −6.0 −5.7 −3.9
SSAFRICA
−4.3 −4.5 −3.8 −4.6 −4.4 −4.0 −4.2 −4.4 −3.6 −5.0 −3.2 −3.6 −2.7 −3.8 −3.5 −3.1 −3.2 −3.6 −3.0 −4.1
SASIA

−4
−4.8 −4.8 −4.1 −4.1 −5.0 −4.7 −4.9 −3.7 −4.8 −6.0 −3.9 −3.9 −3.1 −3.4 −4.1 −3.7 −3.9 −3.1 −4.0 −6.0
POLY
−5.4 −6.0 −5.0 −6.0 −5.8 −5.3 −4.9 −6.0 −4.8 −6.0 −4.2 −6.0 −4.0 −5.1 −5.2 −4.8 −4.1 −6.0 −3.7 −6.0
NAFRICA
-
−4.3 −4.6 −3.8 −5.3 −4.4 −3.9 −4.1 −4.8 −4.1 −5.5 −3.3 −3.6 −2.7 −4.3 −3.3 −2.9 −3.1 −3.7 −3.1 −4.6 −5
MEAST
−4.8 −4.8 −4.1 −5.0 −4.6 −4.4 −4.8 −5.0 −4.8 −5.6 −3.8 −3.9 −3.1 −4.0 −3.6 −3.5 −3.8 −4.0 −3.8 −4.6
EURO
−5.3 −3.9 −4.4 −3.1 −4.9 −5.1 −5.4 −3.9 −5.1 −5.8 −4.3 −3.2 −3.4 −2.6 −4.1 −4.1 −4.4 −3.2 −4.3 −4.9
−6
EASIA
VERIFICATION
−4.2 −4.4 −3.5 −4.4 −4.2 −3.9 −4.1 −4.2 −4.1 −5.1 −3.1 −3.4 −2.5 −3.4 −3.2 −2.9 −3.1 −3.2 −3.1 −4.0
CSAMERIC
−5.1 −4.0 −4.2 −4.0 −4.6 −4.6 −5.4 −4.9 −5.0 −6.0 −4.0 −3.5 −3.1 −3.6 −3.6 −3.5 −4.4 −4.1 −4.0 −6.0
CASIA
−4.5 −6.0 −5.0 −6.0 −5.6 −5.5 −5.6 −5.6 −5.3 −4.7 −3.7 −6.0 −4.1 −5.2 −4.7 −4.7 −5.0 −4.8 −4.4 −4.1
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 253: For algorithm shaman-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


293
Cross region FMR at threshold T = 0.400 for algorithm shu_001, giving FMR(T) = 0.0001 globally.
−3.5 −5.8 −4.9 −5.3 −5.1 −5.0 −4.7 −4.7 −4.5 −3.1 −3.1 −6.0 −4.5 −5.0 −4.7 −4.6 −4.1 −4.3 −4.1 −2.8
SSAFRICA
−4.0 −4.5 −4.0 −5.2 −4.6 −3.9 −3.9 −4.4 −2.9 −4.5 −3.4 −4.1 −3.4 −4.7 −4.0 −3.3 −3.3 −4.0 −2.6 −4.1
SASIA
−4.2 −5.3 −4.4 −4.6 −5.2 −4.9 −4.8 −3.6 −4.2 −4.5 −3.8 −5.0 −4.0 −4.2 −4.8 −4.4 −4.4 −3.3 −3.7 −4.1
POLY
2019/10/16 12:43:37
−4.1 −4.5 −3.9 −5.4 −4.4 −3.7 −3.5 −4.6 −3.9 −4.6 −3.5 −4.0 −3.4 −5.1 −3.9 −3.3 −3.1 −4.3 −3.5 −4.1
NAFRICA log10 FMR
−4.2 −4.0 −3.8 −5.4 −4.2 −3.5 −3.5 −4.8 −3.7 −4.7 −3.5 −3.5 −3.1 −4.8 −3.6 −2.9 −3.0 −4.2 −3.1 −4.4
MEAST
−4.5 −4.1 −4.2 −5.7 −3.9 −4.2 −4.2 −5.3 −4.7 −5.1 −4.0 −3.6 −3.6 −5.2 −3.5 −3.7 −3.8 −4.7 −4.1 −4.7
EURO
−5.2 −5.3 −5.3 −4.7 −5.8 −5.5 −5.4 −4.8 −5.2 −5.3 −4.7 −5.0 −4.6 −4.3 −5.3 −4.9 −4.8 −4.4 −4.8 −4.9 −1
EASIA
−4.0 −4.3 −3.4 −5.2 −4.2 −3.9 −3.9 −4.4 −4.0 −4.7 −3.4 −3.8 −2.9 −4.7 −3.7 −3.3 −3.3 −3.9 −3.5 −4.2
FRVT
CSAMERIC
-
−4.6 −3.6 −4.3 −5.3 −4.0 −4.0 −3.9 −5.1 −4.6 −5.8 −4.1 −3.1 −3.7 −4.8 −3.6 −3.5 −3.5 −6.0 −4.1 −6.0
CASIA −2
−3.4 −4.6 −4.1 −5.2 −4.4 −4.3 −4.1 −4.3 −4.1 −3.5 −2.9 −4.1 −3.6 −4.8 −3.9 −3.8 −3.6 −4.0 −3.7 −3.1
CARIB

−3.2 −5.5 −4.6 −5.0 −4.8 −4.7 −4.4 −4.4 −4.3 −2.8 −2.8 −6.0 −4.2 −4.7 −4.4 −4.3 −3.9 −4.0 −3.8 −2.5
SSAFRICA
−3.7 −4.2 −3.7 −4.9 −4.3 −3.6 −3.6 −4.1 −2.6 −4.2 −3.2 −3.8 −3.1 −4.4 −3.9 −3.1 −3.2 −3.8 −2.3 −3.9
SASIA

−4
−3.9 −5.0 −4.1 −4.3 −4.9 −4.6 −4.5 −3.3 −3.9 −4.3 −3.5 −4.7 −3.7 −3.9 −4.5 −4.1 −4.2 −3.0 −3.5 −3.8
POLY
−3.8 −4.2 −3.6 −5.1 −4.1 −3.4 −3.2 −4.3 −3.6 −4.3 −3.2 −3.7 −3.1 −4.8 −3.6 −3.0 −2.8 −4.0 −3.2 −3.8
NAFRICA
-
−3.9 −3.7 −3.5 −5.1 −3.9 −3.2 −3.3 −4.5 −3.5 −4.5 −3.2 −3.2 −2.9 −4.6 −3.3 −2.6 −2.7 −4.0 −2.9 −4.2 −5
MEAST
−4.3 −3.8 −3.9 −5.4 −3.7 −3.9 −3.9 −5.0 −4.4 −4.8 −3.7 −3.3 −3.4 −5.0 −3.2 −3.4 −3.5 −4.5 −3.9 −4.4
EURO
−4.9 −5.0 −5.0 −4.4 −5.5 −5.3 −5.1 −4.5 −5.0 −5.0 −4.4 −4.7 −4.3 −4.0 −5.0 −4.6 −4.5 −4.1 −4.5 −4.6
−6
EASIA
VERIFICATION
−3.8 −4.0 −3.2 −5.0 −4.0 −3.6 −3.6 −4.2 −3.7 −4.4 −3.2 −3.5 −2.6 −4.4 −3.4 −3.0 −3.0 −3.6 −3.2 −3.9
CSAMERIC
−4.3 −3.3 −4.0 −5.0 −3.7 −3.7 −3.6 −4.8 −4.3 −5.5 −3.8 −2.8 −3.5 −4.5 −3.3 −3.2 −3.2 −6.0 −3.9 −6.0
CASIA
−3.1 −4.3 −3.8 −4.9 −4.1 −4.0 −3.8 −4.0 −3.8 −3.2 −2.6 −3.8 −3.3 −4.4 −3.7 −3.5 −3.3 −3.7 −3.4 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 254: For algorithm shu-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


294
Cross region FMR at threshold T = 0.390 for algorithm siat_002, giving FMR(T) = 0.0001 globally.
−3.1 −6.0 −5.0 −6.0 −4.8 −4.9 −4.7 −5.3 −4.6 −2.6 −2.7 −6.0 −4.5 −5.8 −4.3 −4.6 −4.3 −5.0 −4.1 −2.3
SSAFRICA
−4.2 −4.8 −4.3 −5.1 −4.8 −4.0 −4.1 −4.5 −2.8 −4.5 −3.6 −4.2 −3.5 −4.4 −4.2 −3.4 −3.6 −4.1 −2.4 −4.1
SASIA
−4.6 −5.1 −4.6 −4.1 −5.5 −5.3 −5.1 −3.1 −4.3 −5.3 −4.1 −4.7 −4.0 −3.6 −4.9 −4.9 −4.6 −2.7 −3.8 −5.1
POLY
2019/10/16 12:43:37
−4.5 −4.4 −4.2 −6.0 −4.8 −3.9 −3.7 −5.4 −4.1 −5.4 −3.9 −3.6 −3.5 −5.4 −4.4 −3.3 −3.3 −4.6 −3.5 −6.0
NAFRICA log10 FMR
−4.5 −4.3 −4.1 −5.6 −4.5 −3.6 −3.7 −5.2 −3.8 −5.1 −3.7 −3.7 −3.2 −4.8 −3.7 −2.9 −3.0 −4.6 −3.1 −4.5
MEAST
−4.8 −4.4 −4.5 −5.9 −4.3 −4.5 −4.6 −5.5 −4.9 −5.0 −4.2 −3.9 −3.8 −5.2 −3.7 −3.9 −4.0 −4.8 −4.3 −4.4
EURO
−5.6 −4.5 −5.3 −3.5 −5.7 −5.8 −6.0 −4.1 −5.2 −6.0 −4.9 −4.0 −4.5 −3.0 −5.0 −5.0 −5.3 −3.6 −4.8 −5.4 −1
EASIA
−4.3 −4.6 −3.6 −5.3 −4.5 −4.2 −4.2 −4.6 −4.3 −4.9 −3.6 −4.0 −2.9 −4.6 −3.9 −3.4 −3.5 −4.0 −3.6 −4.3
FRVT
CSAMERIC
-
−5.2 −3.7 −4.6 −4.4 −4.3 −4.1 −4.3 −5.3 −4.9 −5.9 −4.8 −3.2 −4.0 −3.9 −3.8 −3.5 −3.9 −5.2 −4.4 −4.9
CASIA −2
−3.1 −5.2 −4.4 −5.8 −4.6 −4.6 −4.5 −4.8 −4.3 −3.0 −2.6 −4.6 −3.9 −5.2 −4.0 −4.0 −3.8 −4.4 −3.8 −2.6
CARIB

−2.9 −6.0 −4.7 −5.9 −4.5 −4.7 −4.4 −5.0 −4.3 −2.4 −2.5 −6.0 −4.3 −5.6 −4.1 −4.4 −4.0 −4.7 −3.8 −2.1
SSAFRICA
−3.9 −4.5 −4.1 −4.8 −4.6 −3.8 −3.9 −4.3 −2.5 −4.3 −3.4 −4.0 −3.3 −4.3 −4.1 −3.3 −3.4 −3.9 −2.2 −3.9
SASIA

−4
−4.3 −4.8 −4.3 −3.8 −5.2 −5.1 −4.9 −2.8 −4.0 −5.0 −3.8 −4.4 −3.8 −3.3 −4.6 −4.7 −4.3 −2.4 −3.5 −4.8
POLY
−4.1 −4.1 −3.9 −5.8 −4.5 −3.7 −3.4 −5.1 −3.8 −5.1 −3.6 −3.3 −3.2 −5.1 −4.1 −3.1 −3.0 −4.3 −3.3 −6.0
NAFRICA
-
−4.3 −4.0 −3.9 −5.4 −4.2 −3.4 −3.5 −4.9 −3.6 −4.9 −3.5 −3.4 −3.1 −4.7 −3.6 −2.8 −2.8 −4.3 −3.0 −4.5 −5
MEAST
−4.6 −4.1 −4.3 −5.6 −4.0 −4.3 −4.3 −5.3 −4.7 −4.7 −4.0 −3.6 −3.7 −5.1 −3.5 −3.7 −3.7 −4.6 −4.2 −4.2
EURO
−5.3 −4.2 −5.0 −3.3 −5.5 −5.6 −5.7 −3.8 −5.0 −5.7 −4.7 −3.7 −4.3 −2.7 −4.8 −4.8 −5.0 −3.4 −4.5 −5.1
−6
EASIA
VERIFICATION
−4.0 −4.4 −3.4 −5.0 −4.3 −4.0 −3.9 −4.3 −4.0 −4.6 −3.4 −3.8 −2.7 −4.4 −3.7 −3.3 −3.3 −3.8 −3.4 −4.1
CSAMERIC
−4.9 −3.5 −4.4 −4.2 −4.1 −3.8 −4.0 −5.0 −4.6 −5.6 −4.5 −3.0 −3.7 −3.6 −3.5 −3.3 −3.6 −4.9 −4.1 −4.6
CASIA
−2.9 −4.9 −4.2 −5.5 −4.4 −4.4 −4.2 −4.5 −4.0 −2.8 −2.4 −4.3 −3.6 −5.0 −3.8 −3.8 −3.6 −4.2 −3.5 −2.4
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 255: For algorithm siat-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


295
Cross region FMR at threshold T = 0.393 for algorithm siat_004, giving FMR(T) = 0.0001 globally.
−3.2 −6.0 −5.1 −6.0 −4.8 −5.1 −5.0 −5.3 −4.7 −2.8 −2.8 −6.0 −4.7 −5.8 −4.4 −4.7 −4.6 −4.9 −4.3 −2.5
SSAFRICA
−4.2 −4.9 −4.2 −5.1 −4.8 −4.1 −4.1 −4.5 −2.8 −4.5 −3.5 −4.2 −3.3 −4.5 −4.1 −3.5 −3.5 −4.0 −2.5 −4.1
SASIA
−4.5 −5.3 −4.4 −4.0 −5.3 −5.4 −5.2 −2.9 −4.2 −4.9 −3.9 −5.0 −3.8 −3.5 −4.6 −5.1 −4.7 −2.5 −3.7 −4.5
POLY
2019/10/16 12:43:37
−4.5 −4.4 −4.2 −6.0 −4.9 −4.1 −3.6 −5.3 −4.1 −5.0 −4.0 −3.6 −3.6 −5.7 −4.4 −3.5 −3.0 −4.6 −3.6 −4.4
NAFRICA log10 FMR
−4.5 −4.5 −4.1 −5.6 −4.6 −3.7 −3.8 −5.2 −3.9 −5.1 −3.7 −4.0 −3.2 −4.7 −3.8 −3.0 −3.1 −4.6 −3.1 −4.4
MEAST
−4.9 −4.6 −4.5 −6.0 −4.5 −4.7 −4.8 −5.6 −4.9 −5.1 −4.2 −4.0 −3.8 −5.3 −3.9 −4.0 −4.2 −4.8 −4.2 −4.5
EURO
−5.6 −4.5 −5.2 −3.8 −5.8 −6.0 −6.0 −4.0 −5.3 −5.9 −4.8 −4.0 −4.4 −3.1 −5.0 −5.2 −5.4 −3.5 −4.8 −5.2 −1
EASIA
−4.2 −4.6 −3.5 −5.1 −4.5 −4.3 −4.1 −4.3 −4.2 −4.8 −3.6 −3.9 −2.8 −4.4 −3.9 −3.5 −3.4 −3.8 −3.5 −4.3
FRVT
CSAMERIC
-
−5.3 −3.8 −4.6 −4.7 −4.5 −4.3 −4.5 −5.1 −5.1 −5.9 −4.8 −3.3 −3.9 −4.1 −3.9 −3.7 −4.2 −4.6 −4.5 −6.0
CASIA −2
−3.2 −5.2 −4.4 −5.7 −4.7 −4.7 −4.4 −4.8 −4.4 −3.2 −2.7 −5.0 −3.9 −5.1 −4.1 −4.1 −3.8 −4.4 −3.9 −2.7
CARIB

−3.0 −6.0 −4.8 −5.8 −4.6 −4.8 −4.7 −5.0 −4.4 −2.5 −2.6 −6.0 −4.4 −5.5 −4.2 −4.4 −4.3 −4.6 −4.0 −2.2
SSAFRICA
−3.9 −4.7 −4.0 −4.9 −4.6 −3.9 −3.9 −4.2 −2.6 −4.3 −3.4 −4.0 −3.2 −4.4 −4.0 −3.4 −3.4 −3.8 −2.2 −3.8
SASIA

−4
−4.2 −5.0 −4.1 −3.7 −5.1 −5.1 −4.9 −2.6 −3.9 −4.6 −3.7 −4.7 −3.6 −3.2 −4.5 −5.0 −4.5 −2.3 −3.4 −4.2
POLY
−4.3 −4.1 −4.0 −5.7 −4.6 −3.8 −3.3 −5.0 −3.8 −4.7 −3.7 −3.3 −3.3 −5.4 −4.2 −3.3 −2.8 −4.3 −3.3 −4.1
NAFRICA
-
−4.3 −4.2 −3.9 −5.5 −4.4 −3.5 −3.6 −5.0 −3.7 −4.9 −3.5 −3.7 −3.0 −4.7 −3.6 −2.8 −2.9 −4.5 −3.1 −4.3 −5
MEAST
−4.7 −4.3 −4.3 −5.8 −4.2 −4.5 −4.6 −5.3 −4.7 −4.9 −4.1 −3.8 −3.7 −5.1 −3.7 −3.9 −4.1 −4.6 −4.1 −4.3
EURO
−5.3 −4.3 −5.0 −3.5 −5.7 −5.9 −5.8 −3.7 −5.1 −5.6 −4.6 −3.8 −4.2 −3.0 −4.9 −5.1 −5.3 −3.3 −4.6 −5.0
−6
EASIA
VERIFICATION
−4.0 −4.3 −3.2 −4.9 −4.3 −4.1 −3.9 −4.1 −4.0 −4.6 −3.4 −3.7 −2.6 −4.2 −3.7 −3.4 −3.3 −3.5 −3.4 −4.1
CSAMERIC
−5.0 −3.5 −4.3 −4.4 −4.3 −4.0 −4.2 −4.8 −4.8 −5.6 −4.5 −3.1 −3.7 −3.9 −3.7 −3.4 −4.1 −4.3 −4.3 −6.0
CASIA
−3.0 −4.9 −4.1 −5.4 −4.5 −4.5 −4.1 −4.5 −4.1 −2.9 −2.5 −4.7 −3.6 −4.9 −3.9 −3.9 −3.5 −4.1 −3.6 −2.5
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 256: For algorithm siat-004 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


296
Cross region FMR at threshold T = 1.206 for algorithm sjtu_001, giving FMR(T) = 0.0001 globally.
−3.5 −5.5 −4.9 −5.3 −5.0 −5.0 −4.7 −4.8 −4.6 −3.1 −3.1 −4.7 −4.5 −5.0 −4.4 −4.6 −4.6 −4.5 −4.2 −2.8
SSAFRICA
−4.2 −4.4 −4.1 −5.0 −4.6 −4.0 −3.9 −4.3 −3.1 −4.6 −3.6 −3.9 −3.5 −4.5 −4.1 −3.5 −3.4 −4.0 −2.8 −4.2
SASIA
−4.1 −4.6 −4.1 −4.1 −4.8 −4.6 −4.4 −3.2 −4.1 −4.6 −3.6 −4.2 −3.6 −3.7 −4.3 −4.0 −4.0 −2.8 −3.7 −4.3
POLY
2019/10/16 12:43:37
−4.0 −4.0 −3.9 −5.1 −4.2 −3.7 −3.4 −4.5 −3.9 −4.6 −3.4 −3.4 −3.3 −4.7 −3.7 −3.1 −2.9 −4.1 −3.4 −4.3
NAFRICA log10 FMR
−4.2 −3.7 −3.8 −5.0 −3.9 −3.4 −3.5 −4.6 −3.8 −4.8 −3.5 −3.2 −3.2 −4.4 −3.4 −2.9 −2.9 −4.0 −3.3 −4.3
MEAST
−4.3 −3.7 −4.0 −5.0 −3.6 −3.9 −4.0 −4.9 −4.6 −5.0 −3.8 −3.3 −3.5 −4.5 −3.1 −3.4 −3.6 −4.4 −4.1 −4.5
EURO
−4.9 −4.6 −4.8 −4.1 −5.0 −5.1 −4.9 −4.2 −5.0 −5.2 −4.4 −4.2 −4.2 −3.6 −4.4 −4.5 −4.3 −3.8 −4.5 −4.7 −1
EASIA
−4.1 −4.1 −3.5 −4.8 −4.1 −3.9 −3.9 −4.2 −4.1 −4.8 −3.4 −3.6 −2.9 −4.2 −3.6 −3.3 −3.3 −3.7 −3.6 −4.2
FRVT
CSAMERIC
-
−4.2 −3.3 −4.0 −4.5 −3.7 −3.7 −3.7 −4.6 −4.3 −5.4 −3.7 −2.9 −3.4 −4.0 −3.2 −3.2 −3.3 −4.2 −3.8 −4.9
CASIA −2
−3.3 −4.1 −4.0 −4.9 −4.0 −4.0 −4.0 −4.3 −4.1 −3.5 −2.8 −3.6 −3.4 −4.4 −3.5 −3.4 −3.4 −3.9 −3.6 −3.1
CARIB

−3.2 −5.2 −4.6 −5.1 −4.7 −4.7 −4.4 −4.5 −4.4 −2.9 −2.8 −4.4 −4.2 −4.7 −4.2 −4.3 −4.3 −4.2 −3.9 −2.5
SSAFRICA
−3.9 −4.1 −3.9 −4.7 −4.4 −3.7 −3.7 −4.1 −2.8 −4.4 −3.4 −3.7 −3.3 −4.3 −3.9 −3.3 −3.2 −3.7 −2.5 −4.0
SASIA

−4
−3.8 −4.3 −3.8 −3.8 −4.5 −4.3 −4.2 −2.9 −3.8 −4.3 −3.4 −3.9 −3.3 −3.4 −4.1 −3.7 −3.7 −2.6 −3.4 −4.0
POLY
−3.7 −3.7 −3.6 −4.8 −3.9 −3.4 −3.1 −4.2 −3.6 −4.3 −3.1 −3.1 −3.0 −4.4 −3.4 −2.9 −2.6 −3.8 −3.1 −4.0
NAFRICA
-
−3.9 −3.4 −3.5 −4.7 −3.7 −3.2 −3.2 −4.3 −3.6 −4.5 −3.2 −2.9 −2.9 −4.2 −3.1 −2.6 −2.7 −3.7 −3.1 −4.1 −5
MEAST
−4.0 −3.4 −3.8 −4.7 −3.3 −3.6 −3.7 −4.6 −4.3 −4.7 −3.5 −3.0 −3.2 −4.2 −2.8 −3.1 −3.3 −4.2 −3.8 −4.2
EURO
−4.7 −4.3 −4.5 −3.8 −4.7 −4.8 −4.7 −3.9 −4.7 −4.9 −4.2 −3.9 −3.9 −3.3 −4.1 −4.3 −4.0 −3.6 −4.3 −4.4
−6
EASIA
VERIFICATION
−3.8 −3.8 −3.2 −4.5 −3.8 −3.6 −3.6 −3.9 −3.8 −4.5 −3.2 −3.3 −2.7 −4.0 −3.3 −3.1 −3.0 −3.4 −3.4 −4.0
CSAMERIC
−3.9 −3.0 −3.7 −4.2 −3.4 −3.4 −3.4 −4.3 −4.1 −5.1 −3.4 −2.6 −3.1 −3.8 −2.9 −2.9 −3.0 −3.9 −3.6 −4.6
CASIA
−3.0 −3.8 −3.7 −4.6 −3.7 −3.7 −3.7 −4.0 −3.8 −3.2 −2.5 −3.3 −3.1 −4.1 −3.2 −3.1 −3.1 −3.6 −3.3 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 257: For algorithm sjtu-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


297
Cross region FMR at threshold T = 0.598 for algorithm smilart_002, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.6 −6.0 −5.0 −5.6 −5.4 −5.7 −5.6 −3.3 −3.0 −6.0 −5.2 −5.8 −4.5 −4.8 −4.7 −5.6 −5.2 −2.9
SSAFRICA
−4.5 −4.9 −4.2 −4.9 −4.9 −4.4 −4.5 −4.7 −3.6 −5.2 −3.6 −4.1 −3.2 −4.2 −4.0 −3.5 −3.6 −4.1 −3.1 −4.4
SASIA
−5.0 −4.7 −4.6 −3.8 −5.4 −5.2 −5.6 −3.3 −4.8 −5.7 −4.1 −4.1 −3.7 −3.2 −4.5 −4.3 −4.6 −2.9 −4.2 −5.3
POLY
2019/10/16 12:43:37
−5.4 −5.1 −4.7 −6.0 −5.3 −4.7 −4.6 −5.6 −4.5 −5.7 −4.5 −4.3 −3.9 −5.1 −4.5 −3.9 −4.3 −4.9 −3.6 −4.9
NAFRICA log10 FMR
−4.7 −4.8 −4.1 −5.6 −4.7 −4.1 −4.3 −5.0 −4.3 −5.9 −3.6 −3.8 −3.0 −4.7 −3.6 −3.1 −3.3 −4.2 −3.3 −5.2
MEAST
−5.0 −5.0 −4.5 −5.4 −4.7 −4.8 −5.1 −5.4 −5.4 −5.3 −4.1 −4.2 −3.5 −4.5 −3.8 −3.9 −4.2 −4.4 −4.5 −4.6
EURO
−5.4 −3.8 −4.7 −2.9 −5.0 −5.4 −5.7 −3.7 −5.1 −5.8 −4.6 −3.2 −3.8 −2.4 −4.4 −4.6 −4.7 −3.1 −4.5 −5.2 −1
EASIA
−4.4 −4.6 −3.8 −4.7 −4.5 −4.2 −4.3 −4.5 −4.4 −5.3 −3.4 −3.7 −2.8 −3.8 −3.5 −3.2 −3.3 −3.5 −3.5 −4.4
FRVT
CSAMERIC
-
−5.2 −4.0 −4.3 −3.8 −4.7 −4.6 −5.0 −4.8 −5.2 −6.0 −4.1 −3.3 −3.3 −3.5 −3.7 −3.6 −4.4 −4.5 −4.2 −5.2
CASIA −2
−3.4 −5.7 −4.9 −5.9 −4.9 −5.2 −5.1 −5.1 −5.0 −3.4 −2.7 −5.0 −4.1 −5.4 −4.2 −4.4 −4.4 −4.7 −4.2 −2.9
CARIB

−3.3 −6.0 −5.4 −5.9 −4.8 −5.5 −5.1 −5.4 −5.4 −3.1 −2.9 −6.0 −5.0 −5.6 −4.4 −4.7 −4.4 −5.3 −5.0 −2.7
SSAFRICA
−4.4 −4.8 −4.1 −4.8 −4.8 −4.3 −4.5 −4.6 −3.4 −5.1 −3.5 −4.1 −3.1 −4.1 −4.0 −3.4 −3.6 −4.0 −3.0 −4.4
SASIA

−4
−4.8 −4.5 −4.4 −3.6 −5.3 −5.0 −5.5 −3.1 −4.5 −5.4 −4.1 −3.9 −3.6 −3.1 −4.4 −4.2 −4.5 −2.7 −4.1 −5.0
POLY
−5.4 −4.8 −4.6 −5.9 −5.2 −4.6 −4.5 −5.3 −4.5 −5.4 −4.7 −4.0 −3.8 −5.1 −4.5 −3.8 −6.0 −4.6 −3.5 −4.6
NAFRICA
-
−4.6 −4.7 −4.0 −5.5 −4.6 −4.0 −4.2 −4.8 −4.2 −5.7 −3.5 −3.8 −3.0 −4.7 −3.6 −3.1 −3.3 −4.0 −3.3 −5.4 −5
MEAST
−5.0 −4.9 −4.5 −5.3 −4.7 −4.7 −5.0 −5.3 −5.3 −5.2 −4.1 −4.2 −3.5 −4.4 −3.8 −3.9 −4.2 −4.4 −4.5 −4.7
EURO
−5.3 −3.6 −4.6 −2.8 −4.9 −5.4 −5.8 −3.6 −5.0 −5.5 −4.5 −3.1 −3.8 −2.3 −4.3 −4.5 −4.8 −3.0 −4.4 −5.0
−6
EASIA
VERIFICATION
−4.3 −4.6 −3.7 −4.7 −4.5 −4.2 −4.3 −4.4 −4.3 −5.2 −3.4 −3.7 −2.7 −3.7 −3.5 −3.2 −3.3 −3.5 −3.4 −4.4
CSAMERIC
−5.1 −3.7 −4.3 −3.6 −4.6 −4.5 −4.9 −4.6 −5.1 −6.0 −4.0 −3.1 −3.2 −3.2 −3.6 −3.5 −6.0 −4.4 −4.2 −6.0
CASIA
−3.2 −5.4 −4.8 −5.7 −4.7 −5.0 −5.0 −4.9 −4.8 −3.2 −2.6 −4.7 −4.0 −5.2 −4.1 −4.3 −4.3 −4.6 −4.1 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 258: For algorithm smilart-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


298
Cross region FMR at threshold T = 0.654 for algorithm smilart_003, giving FMR(T) = 0.0001 globally.
−4.9 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −4.9 −3.9 −6.0 −6.0 −6.0 −5.1 −5.7 −6.0 −6.0 −6.0 −4.0
SSAFRICA
−4.4 −4.7 −3.9 −5.1 −4.4 −4.0 −4.2 −5.0 −4.4 −5.7 −3.3 −3.8 −2.8 −4.2 −3.5 −3.0 −3.2 −4.2 −3.5 −4.8
SASIA
−5.7 −4.6 −4.8 −3.8 −5.3 −5.6 −6.0 −3.9 −5.4 −6.0 −4.6 −3.7 −3.8 −3.0 −4.4 −4.7 −6.0 −3.1 −4.4 −6.0
POLY
2019/10/16 12:43:37
−6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0
NAFRICA log10 FMR
−3.9 −4.2 −3.4 −5.5 −3.9 −3.5 −3.7 −5.0 −4.1 −5.7 −2.9 −3.3 −2.4 −4.5 −2.9 −2.5 −2.7 −3.9 −3.1 −4.6
MEAST
−4.3 −4.6 −3.8 −5.1 −4.3 −3.9 −4.1 −5.1 −4.6 −5.7 −3.4 −3.8 −2.9 −4.2 −3.4 −3.0 −3.3 −4.2 −3.7 −4.7
EURO
−5.5 −4.4 −4.8 −3.5 −5.2 −5.8 −6.0 −3.8 −5.4 −6.0 −4.6 −3.6 −3.9 −2.8 −4.4 −4.9 −6.0 −3.0 −4.5 −6.0 −1
EASIA
−4.0 −4.2 −3.4 −4.6 −3.9 −3.6 −3.8 −4.5 −4.1 −5.6 −2.9 −3.3 −2.4 −3.7 −2.9 −2.6 −2.7 −3.6 −3.1 −4.5
FRVT
CSAMERIC
-
−5.8 −5.7 −4.7 −6.0 −5.0 −5.2 −5.7 −6.0 −5.6 −5.9 −4.7 −4.6 −3.6 −6.0 −3.9 −4.1 −4.7 −6.0 −4.5 −4.9
CASIA −2
−4.4 −5.6 −4.7 −6.0 −5.1 −4.8 −5.0 −6.0 −5.5 −4.6 −3.5 −5.3 −5.0 −5.7 −4.7 −4.8 −5.0 −5.9 −5.4 −3.6
CARIB

−4.8 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −4.8 −3.9 −6.0 −6.0 −6.0 −5.0 −5.4 −6.0 −6.0 −6.0 −3.9
SSAFRICA
−4.4 −4.7 −3.9 −5.1 −4.4 −4.0 −4.2 −5.1 −4.4 −5.7 −3.3 −3.7 −2.8 −4.2 −3.5 −3.1 −3.2 −4.2 −3.6 −4.7
SASIA

−4
−5.7 −4.8 −4.8 −3.8 −5.2 −5.7 −6.0 −3.9 −5.3 −6.0 −4.6 −4.1 −3.8 −3.0 −4.3 −4.6 −6.0 −3.1 −4.3 −6.0
POLY
−6.0 −6.0 −6.0 −6.0 −6.0 −5.9 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0 −6.0
NAFRICA
-
−3.9 −4.3 −3.4 −5.4 −3.9 −3.5 −3.7 −5.0 −4.1 −5.7 −2.9 −3.3 −2.4 −4.4 −2.9 −2.5 −2.7 −4.0 −3.1 −4.7 −5
MEAST
−4.3 −4.6 −3.8 −5.1 −4.3 −3.9 −4.1 −5.1 −4.6 −5.7 −3.4 −3.8 −2.9 −4.2 −3.4 −3.0 −3.3 −4.2 −3.7 −4.7
EURO
−5.4 −4.3 −4.7 −3.5 −5.2 −5.8 −6.0 −3.8 −5.4 −6.0 −4.5 −3.6 −3.9 −2.8 −4.4 −4.9 −6.0 −3.0 −4.6 −6.0
−6
EASIA
VERIFICATION
−4.0 −4.2 −3.4 −4.6 −3.9 −3.6 −3.8 −4.5 −4.1 −5.5 −2.9 −3.3 −2.4 −3.7 −2.9 −2.6 −2.7 −3.6 −3.1 −4.5
CSAMERIC
−5.8 −5.4 −4.6 −6.0 −4.8 −5.2 −5.4 −6.0 −5.5 −6.0 −4.7 −4.3 −3.5 −5.7 −3.8 −4.1 −4.4 −6.0 −4.4 −6.0
CASIA
−4.4 −5.7 −4.7 −6.0 −5.1 −4.8 −5.0 −6.0 −5.5 −4.6 −3.5 −6.0 −5.1 −5.5 −4.7 −4.9 −6.0 −5.6 −5.4 −3.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 259: For algorithm smilart-003 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


299
Cross region FMR at threshold T = 0.314 for algorithm starhybrid_001, giving FMR(T) = 0.0001 globally.
−3.5 −5.2 −4.8 −5.6 −4.9 −4.7 −4.7 −4.8 −4.2 −3.0 −3.2 −5.0 −4.4 −5.1 −4.5 −4.4 −4.5 −4.6 −3.9 −2.7
SSAFRICA
−3.9 −4.2 −4.1 −4.8 −4.4 −3.7 −3.7 −4.2 −2.5 −4.1 −3.5 −3.8 −3.5 −4.4 −4.0 −3.3 −3.3 −3.9 −2.3 −3.8
SASIA
−4.4 −5.0 −4.6 −4.6 −5.2 −4.9 −4.7 −3.5 −4.1 −4.8 −4.1 −5.0 −4.0 −4.2 −4.7 −4.6 −4.4 −3.2 −3.7 −4.4
POLY
2019/10/16 12:43:37
−4.1 −4.0 −4.1 −5.3 −4.4 −3.7 −3.5 −4.7 −3.7 −4.5 −3.6 −3.3 −3.5 −4.9 −3.9 −3.2 −2.9 −4.6 −3.2 −4.2
NAFRICA log10 FMR
−4.3 −3.9 −4.0 −5.3 −4.2 −3.5 −3.6 −4.9 −3.6 −4.6 −3.6 −3.6 −3.3 −4.7 −3.7 −2.9 −3.0 −4.4 −3.1 −4.1
MEAST
−4.7 −4.1 −4.4 −5.6 −4.1 −4.2 −4.3 −5.2 −4.5 −4.9 −4.2 −3.7 −3.8 −5.2 −3.7 −3.8 −3.8 −4.8 −4.1 −4.5
EURO
−5.3 −5.2 −5.3 −4.6 −5.6 −5.5 −5.3 −4.6 −5.0 −5.6 −4.7 −5.2 −4.7 −4.1 −5.3 −4.8 −4.9 −4.2 −4.6 −5.2 −1
EASIA
−4.3 −4.4 −3.8 −5.2 −4.4 −4.1 −4.1 −4.6 −4.1 −4.8 −3.7 −3.9 −3.1 −4.7 −3.9 −3.5 −3.5 −4.1 −3.6 −4.3
FRVT
CSAMERIC
-
−4.7 −3.6 −4.4 −5.0 −4.1 −3.9 −4.0 −5.0 −4.3 −5.2 −4.3 −3.2 −3.9 −4.9 −3.7 −3.5 −3.6 −4.6 −3.9 −4.6
CASIA −2
−3.5 −4.7 −4.3 −5.3 −4.6 −4.4 −4.3 −4.5 −4.0 −3.5 −2.9 −4.2 −3.8 −4.9 −4.1 −3.9 −3.9 −4.2 −3.6 −3.1
CARIB

−3.3 −5.0 −4.6 −5.4 −4.6 −4.5 −4.4 −4.6 −4.0 −2.8 −2.9 −4.7 −4.2 −4.9 −4.3 −4.1 −4.2 −4.3 −3.7 −2.5
SSAFRICA
−3.7 −4.0 −3.9 −4.6 −4.2 −3.5 −3.5 −3.9 −2.3 −3.9 −3.2 −3.5 −3.3 −4.2 −3.9 −3.1 −3.1 −3.7 −2.0 −3.6
SASIA

−4
−4.2 −4.7 −4.3 −4.3 −4.9 −4.7 −4.4 −3.2 −3.8 −4.6 −3.8 −4.7 −3.8 −4.0 −4.5 −4.4 −4.1 −2.9 −3.5 −4.2
POLY
−3.9 −3.8 −3.8 −5.1 −4.1 −3.5 −3.2 −4.4 −3.5 −4.3 −3.4 −3.0 −3.3 −4.7 −3.7 −3.0 −2.7 −4.3 −3.1 −4.0
NAFRICA
-
−4.0 −3.7 −3.8 −5.1 −4.0 −3.2 −3.3 −4.6 −3.4 −4.4 −3.4 −3.3 −3.1 −4.6 −3.4 −2.7 −2.8 −4.2 −2.9 −4.0 −5
MEAST
−4.5 −3.8 −4.2 −5.4 −3.8 −4.0 −4.1 −5.0 −4.3 −4.7 −3.9 −3.4 −3.6 −5.0 −3.4 −3.5 −3.6 −4.6 −3.9 −4.3
EURO
−5.1 −5.0 −5.1 −4.3 −5.4 −5.3 −5.1 −4.4 −4.7 −5.3 −4.5 −5.0 −4.5 −3.9 −5.1 −4.7 −4.7 −4.0 −4.3 −4.9
−6
EASIA
VERIFICATION
−4.1 −4.1 −3.6 −5.0 −4.2 −3.9 −3.9 −4.3 −3.9 −4.6 −3.5 −3.7 −3.0 −4.5 −3.7 −3.3 −3.3 −3.8 −3.4 −4.1
CSAMERIC
−4.4 −3.4 −4.1 −4.8 −3.8 −3.6 −3.7 −4.7 −4.0 −5.0 −4.0 −2.9 −3.6 −4.6 −3.4 −3.3 −3.4 −4.3 −3.6 −4.4
CASIA
−3.2 −4.4 −4.1 −5.2 −4.3 −4.1 −4.0 −4.2 −3.7 −3.2 −2.7 −3.9 −3.6 −4.8 −3.9 −3.6 −3.7 −3.9 −3.3 −2.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 260: For algorithm starhybrid-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


300
Cross region FMR at threshold T = 0.221 for algorithm synesis_004, giving FMR(T) = 0.0001 globally.
−3.7 −5.6 −5.3 −5.8 −5.1 −5.3 −5.2 −5.3 −5.0 −3.3 −3.1 −4.8 −4.8 −5.6 −4.6 −5.0 −5.3 −5.2 −4.5 −3.0
SSAFRICA
−4.2 −4.6 −3.8 −4.8 −4.5 −4.0 −4.1 −4.3 −3.3 −4.8 −3.3 −3.7 −2.8 −4.0 −3.7 −3.1 −3.2 −3.6 −2.8 −4.0
SASIA
−4.5 −4.7 −4.2 −3.9 −5.1 −4.8 −5.1 −3.1 −4.4 −5.1 −3.8 −4.0 −3.3 −3.3 −4.2 −4.0 −4.4 −2.7 −3.7 −4.4
POLY
2019/10/16 12:43:37
−4.7 −4.6 −4.3 −6.0 −4.9 −4.2 −4.0 −5.4 −4.3 −5.3 −4.0 −3.7 −3.5 −6.0 −4.1 −3.5 −3.4 −4.9 −3.3 −4.6
NAFRICA log10 FMR
−4.3 −4.4 −3.7 −5.1 −4.4 −3.8 −3.9 −4.5 −3.8 −5.2 −3.3 −3.6 −2.7 −4.2 −3.4 −2.8 −3.0 −3.6 −2.9 −4.3
MEAST
−4.8 −4.6 −4.3 −5.6 −4.5 −4.5 −4.6 −5.1 −4.7 −5.4 −4.0 −4.0 −3.4 −4.7 −3.8 −3.6 −3.8 −4.3 −3.9 −4.6
EURO
−5.3 −4.3 −4.7 −3.5 −5.3 −5.4 −5.5 −3.9 −5.0 −5.6 −4.4 −3.6 −3.7 −2.8 −4.5 −4.5 −4.6 −3.3 −4.3 −4.8 −1
EASIA
−4.2 −4.4 −3.4 −4.7 −4.4 −4.0 −4.0 −4.2 −4.0 −5.0 −3.3 −3.5 −2.5 −3.8 −3.5 −3.0 −3.1 −3.4 −3.1 −4.3
FRVT
CSAMERIC
-
−5.3 −3.8 −4.4 −4.5 −4.6 −4.4 −4.5 −5.0 −5.0 −5.6 −4.2 −3.4 −3.3 −4.2 −3.7 −3.5 −3.8 −4.9 −4.0 −4.6
CASIA −2
−3.5 −5.7 −4.8 −5.6 −4.9 −5.0 −4.8 −5.0 −4.7 −3.5 −2.7 −4.8 −4.1 −4.8 −4.2 −4.3 −4.2 −4.5 −4.2 −2.9
CARIB

−3.4 −5.3 −5.1 −5.6 −5.0 −5.0 −5.0 −5.0 −4.8 −3.1 −3.0 −4.5 −4.6 −5.3 −4.6 −4.7 −5.0 −4.9 −4.2 −2.7
SSAFRICA
−4.0 −4.6 −3.7 −4.7 −4.5 −3.9 −4.0 −4.2 −3.2 −4.6 −3.2 −3.7 −2.8 −4.0 −3.6 −3.1 −3.2 −3.6 −2.7 −3.9
SASIA

−4
−4.4 −4.5 −4.0 −3.7 −4.9 −4.7 −4.9 −2.8 −4.2 −4.9 −3.7 −3.7 −3.2 −3.2 −4.1 −3.8 −4.3 −2.5 −3.6 −4.3
POLY
−4.5 −4.4 −4.1 −5.9 −4.7 −4.0 −3.7 −5.1 −4.1 −5.0 −3.8 −3.4 −3.4 −6.0 −4.0 −3.3 −3.2 −4.6 −3.3 −4.3
NAFRICA
-
−4.2 −4.3 −3.6 −5.0 −4.3 −3.6 −3.7 −4.4 −3.8 −5.1 −3.2 −3.5 −2.6 −4.1 −3.4 −2.7 −2.9 −3.5 −2.8 −4.3 −5
MEAST
−4.7 −4.5 −4.3 −5.4 −4.3 −4.4 −4.6 −5.1 −4.7 −5.3 −3.9 −3.8 −3.4 −4.6 −3.7 −3.6 −3.8 −4.3 −3.8 −4.5
EURO
−5.1 −4.2 −4.6 −3.3 −5.2 −5.3 −5.3 −3.7 −4.9 −5.5 −4.3 −3.5 −3.7 −2.7 −4.4 −4.4 −4.4 −3.1 −4.2 −4.7
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.6 −4.3 −3.9 −3.9 −4.1 −3.9 −4.8 −3.2 −3.4 −2.5 −3.7 −3.4 −3.0 −3.0 −3.3 −3.0 −4.1
CSAMERIC
−5.2 −3.6 −4.3 −4.3 −4.4 −4.2 −4.3 −4.7 −4.9 −5.6 −4.1 −3.1 −3.3 −4.0 −3.6 −3.4 −3.8 −4.6 −4.0 −4.6
CASIA
−3.3 −5.4 −4.5 −5.4 −4.7 −4.8 −4.6 −4.8 −4.5 −3.3 −2.6 −4.5 −3.9 −4.8 −4.1 −4.1 −4.0 −4.3 −4.0 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 261: For algorithm synesis-004 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


301
Cross region FMR at threshold T = 0.356 for algorithm synesis_005, giving FMR(T) = 0.0001 globally.
−3.4 −6.0 −5.2 −5.9 −4.9 −5.2 −5.1 −5.3 −4.9 −3.0 −2.9 −6.0 −4.9 −5.5 −4.3 −4.7 −4.6 −4.9 −4.5 −2.7
SSAFRICA
−4.1 −4.9 −4.1 −4.9 −4.7 −4.1 −4.2 −4.4 −3.1 −4.7 −3.3 −4.2 −3.2 −4.3 −3.9 −3.4 −3.5 −3.9 −2.7 −4.1
SASIA
−4.6 −4.8 −4.3 −3.7 −5.2 −5.0 −5.2 −2.8 −4.4 −5.2 −4.0 −4.3 −3.6 −3.3 −4.5 −4.3 −5.1 −2.5 −3.8 −4.7
POLY
2019/10/16 12:43:37
−4.6 −4.4 −4.2 −6.0 −4.8 −4.0 −3.8 −5.4 −4.2 −5.4 −4.1 −3.7 −3.6 −5.7 −4.3 −3.4 −3.5 −6.0 −3.6 −4.6
NAFRICA log10 FMR
−4.4 −4.4 −4.0 −5.4 −4.5 −3.7 −3.8 −4.7 −3.9 −5.2 −3.5 −3.8 −3.1 −4.5 −3.7 −2.9 −3.1 −4.0 −3.0 −4.4
MEAST
−5.0 −4.6 −4.5 −5.8 −4.5 −4.7 −4.8 −5.3 −4.9 −5.2 −4.2 −4.1 −3.8 −5.1 −3.9 −4.0 −4.1 −4.7 −4.1 −4.7
EURO
−5.3 −4.1 −4.9 −3.4 −5.4 −5.8 −6.0 −3.7 −5.1 −5.6 −4.7 −3.5 −4.1 −2.8 −4.7 −4.9 −5.9 −3.3 −4.6 −4.9 −1
EASIA
−4.3 −4.5 −3.5 −5.0 −4.5 −4.2 −4.1 −4.3 −4.2 −5.0 −3.5 −3.8 −2.8 −4.2 −3.8 −3.4 −3.4 −3.7 −3.5 −4.3
FRVT
CSAMERIC
-
−5.2 −3.6 −4.5 −4.2 −4.5 −4.3 −4.4 −4.9 −5.0 −6.0 −4.6 −3.1 −3.8 −3.9 −3.8 −3.7 −4.2 −4.5 −4.5 −5.2
CASIA −2
−3.3 −5.5 −4.6 −5.5 −4.7 −4.8 −4.7 −4.8 −4.6 −3.3 −2.6 −5.0 −3.9 −4.9 −4.0 −4.1 −4.1 −4.3 −4.1 −2.7
CARIB

−3.2 −6.0 −5.0 −5.6 −4.7 −5.0 −4.8 −5.0 −4.6 −2.8 −2.7 −6.0 −4.6 −5.2 −4.2 −4.4 −4.4 −4.6 −4.2 −2.5
SSAFRICA
−4.0 −4.7 −4.0 −4.7 −4.6 −4.0 −4.0 −4.2 −2.9 −4.4 −3.2 −4.2 −3.2 −4.2 −3.9 −3.3 −3.5 −3.8 −2.5 −3.9
SASIA

−4
−4.4 −4.6 −4.1 −3.5 −5.0 −4.9 −4.9 −2.6 −4.1 −5.0 −3.9 −4.2 −3.5 −3.0 −4.4 −4.2 −4.8 −2.3 −3.6 −4.6
POLY
−4.4 −4.1 −4.0 −5.8 −4.6 −3.7 −3.5 −5.1 −4.0 −5.1 −3.8 −3.4 −3.4 −5.4 −4.1 −3.2 −3.3 −6.0 −3.4 −4.3
NAFRICA
-
−4.3 −4.1 −3.8 −5.2 −4.3 −3.5 −3.6 −4.6 −3.7 −5.0 −3.4 −3.5 −3.0 −4.5 −3.5 −2.8 −2.9 −3.9 −3.0 −4.3 −5
MEAST
−4.8 −4.3 −4.3 −5.5 −4.2 −4.5 −4.6 −5.2 −4.8 −5.0 −4.1 −3.8 −3.6 −4.9 −3.7 −3.8 −4.0 −4.6 −4.0 −4.5
EURO
−5.1 −3.9 −4.8 −3.2 −5.3 −5.6 −5.8 −3.5 −4.9 −5.4 −4.6 −3.3 −4.0 −2.6 −4.6 −4.8 −5.6 −3.1 −4.4 −4.7
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.8 −4.3 −4.0 −3.9 −4.1 −4.1 −4.8 −3.4 −3.7 −2.6 −4.1 −3.7 −3.3 −3.3 −3.5 −3.4 −4.2
CSAMERIC
−4.9 −3.3 −4.3 −4.0 −4.3 −4.0 −4.1 −4.6 −4.7 −5.9 −4.3 −2.9 −3.6 −3.7 −3.7 −3.5 −3.9 −4.2 −4.2 −4.9
CASIA
−3.1 −5.2 −4.3 −5.3 −4.6 −4.6 −4.5 −4.5 −4.3 −3.1 −2.5 −4.7 −3.7 −4.8 −3.9 −3.9 −3.9 −4.2 −3.8 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 262: For algorithm synesis-005 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


302
Cross region FMR at threshold T = 147.661 for algorithm tech5_002, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.1 −5.7 −5.1 −5.1 −4.9 −5.2 −4.5 −3.1 −3.1 −5.3 −4.7 −5.2 −4.6 −4.6 −4.8 −4.9 −4.1 −2.7
SSAFRICA
−4.2 −4.8 −4.5 −4.9 −4.8 −4.1 −4.2 −4.5 −2.8 −4.4 −3.6 −4.3 −3.8 −4.4 −4.3 −3.7 −3.7 −4.1 −2.5 −4.0
SASIA
−4.6 −4.9 −4.7 −4.0 −5.6 −5.6 −5.5 −3.3 −4.2 −5.0 −4.2 −5.0 −4.2 −3.5 −5.0 −5.3 −5.1 −2.9 −3.8 −4.5
POLY
2019/10/16 12:43:37
−4.6 −4.6 −4.6 −6.0 −4.9 −4.2 −3.9 −5.1 −4.0 −5.1 −4.1 −3.7 −4.1 −5.7 −4.5 −3.7 −3.5 −4.9 −3.6 −4.9
NAFRICA log10 FMR
−4.6 −4.5 −4.4 −5.6 −4.5 −3.9 −4.0 −5.3 −4.0 −4.9 −3.8 −3.9 −3.6 −4.9 −3.8 −3.2 −3.3 −4.6 −3.4 −4.2
MEAST
−4.9 −4.3 −4.7 −5.5 −4.3 −4.6 −4.7 −5.5 −4.9 −5.1 −4.2 −3.9 −4.0 −5.1 −3.7 −4.0 −4.2 −4.8 −4.4 −4.5
EURO
−5.3 −4.1 −5.0 −3.1 −5.5 −5.8 −5.9 −3.9 −5.0 −5.3 −4.6 −3.6 −4.3 −2.6 −4.9 −5.2 −5.2 −3.5 −4.6 −4.8 −1
EASIA
−4.5 −4.7 −4.1 −5.1 −4.7 −4.6 −4.5 −4.7 −4.4 −4.9 −3.9 −4.3 −3.4 −4.5 −4.1 −3.9 −3.9 −4.2 −3.9 −4.3
FRVT
CSAMERIC
-
−4.9 −3.6 −4.6 −4.0 −4.3 −4.3 −4.5 −4.9 −4.6 −5.4 −4.2 −3.2 −3.9 −3.5 −3.7 −3.6 −4.4 −4.6 −4.0 −5.2
CASIA −2
−3.4 −5.0 −4.5 −5.3 −4.7 −4.6 −4.5 −4.8 −4.3 −3.4 −2.8 −4.4 −3.9 −4.8 −4.1 −4.0 −3.9 −4.3 −3.8 −3.0
CARIB

−3.2 −6.0 −4.8 −5.4 −4.9 −4.8 −4.6 −4.9 −4.2 −2.8 −2.8 −5.0 −4.4 −5.0 −4.5 −4.3 −4.5 −4.6 −3.8 −2.4
SSAFRICA
−3.9 −4.5 −4.3 −4.6 −4.6 −3.9 −3.9 −4.2 −2.5 −4.2 −3.4 −4.1 −3.7 −4.2 −4.1 −3.5 −3.5 −3.9 −2.2 −3.8
SASIA

−4
−4.4 −4.6 −4.4 −3.7 −5.3 −5.3 −5.2 −3.1 −4.0 −4.8 −4.0 −4.7 −4.0 −3.2 −4.7 −5.0 −4.8 −2.7 −3.6 −4.3
POLY
−4.3 −4.3 −4.3 −5.8 −4.6 −3.9 −3.7 −4.8 −3.8 −4.8 −3.7 −3.4 −3.8 −5.4 −4.2 −3.4 −3.2 −4.6 −3.4 −4.6
NAFRICA
-
−4.4 −4.2 −4.2 −5.5 −4.3 −3.7 −3.7 −5.0 −3.7 −4.7 −3.6 −3.7 −3.4 −4.8 −3.6 −3.0 −3.1 −4.4 −3.2 −4.1 −5
MEAST
−4.6 −4.0 −4.4 −5.3 −4.0 −4.3 −4.5 −5.3 −4.6 −4.9 −4.0 −3.6 −3.8 −4.9 −3.5 −3.8 −3.9 −4.7 −4.2 −4.4
EURO
−5.1 −3.8 −4.7 −2.8 −5.2 −5.6 −5.7 −3.7 −4.7 −5.1 −4.4 −3.4 −4.1 −2.4 −4.7 −5.1 −5.0 −3.2 −4.3 −4.6
−6
EASIA
VERIFICATION
−4.3 −4.5 −3.8 −4.8 −4.5 −4.3 −4.3 −4.5 −4.1 −4.7 −3.7 −4.0 −3.2 −4.3 −3.9 −3.7 −3.7 −4.0 −3.7 −4.1
CSAMERIC
−4.6 −3.3 −4.3 −3.7 −4.0 −4.0 −4.2 −4.7 −4.3 −5.1 −3.9 −2.9 −3.7 −3.2 −3.5 −3.3 −4.1 −4.3 −3.8 −4.9
CASIA
−3.2 −4.7 −4.3 −5.1 −4.4 −4.4 −4.3 −4.5 −4.0 −3.2 −2.6 −4.1 −3.7 −4.5 −3.9 −3.7 −3.7 −4.0 −3.5 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 263: For algorithm tech5-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


303
Cross region FMR at threshold T = 147.080 for algorithm tech5_003, giving FMR(T) = 0.0001 globally.
−3.8 −5.6 −5.2 −6.0 −5.2 −5.0 −4.9 −5.5 −4.6 −3.4 −3.4 −5.3 −4.7 −5.6 −4.9 −4.6 −4.5 −5.1 −4.2 −3.0
SSAFRICA
−4.3 −4.5 −4.5 −4.9 −4.8 −4.2 −4.1 −4.5 −2.9 −4.6 −3.9 −4.1 −4.0 −4.5 −4.4 −3.8 −3.7 −4.2 −2.6 −4.3
SASIA
−4.7 −4.7 −4.7 −4.1 −5.4 −5.4 −5.3 −3.5 −4.2 −5.3 −4.2 −4.7 −4.2 −3.7 −5.1 −5.1 −5.1 −3.1 −3.8 −4.8
POLY
2019/10/16 12:43:37
−4.3 −4.1 −4.2 −5.7 −4.4 −3.8 −3.6 −5.0 −3.9 −4.8 −3.8 −3.5 −3.7 −5.1 −4.0 −3.4 −3.1 −4.6 −3.5 −4.4
NAFRICA log10 FMR
−4.5 −4.1 −4.2 −5.8 −4.3 −3.7 −3.8 −5.3 −4.0 −5.0 −3.8 −3.7 −3.6 −5.1 −3.7 −3.2 −3.2 −4.6 −3.5 −4.5
MEAST
−4.6 −3.9 −4.3 −5.3 −3.8 −4.2 −4.3 −5.4 −4.8 −5.2 −4.1 −3.5 −3.8 −4.9 −3.4 −3.7 −3.8 −4.8 −4.4 −4.8
EURO
−5.4 −3.9 −5.0 −3.1 −5.4 −5.8 −5.6 −4.1 −5.0 −5.6 −4.7 −3.5 −4.4 −2.7 −4.9 −5.4 −5.1 −3.7 −4.6 −5.1 −1
EASIA
−4.4 −4.4 −3.8 −5.1 −4.4 −4.3 −4.3 −4.7 −4.3 −5.1 −3.8 −3.9 −3.2 −4.6 −3.9 −3.8 −3.8 −4.2 −3.9 −4.6
FRVT
CSAMERIC
-
−4.6 −3.3 −4.2 −3.9 −3.9 −3.9 −3.9 −4.8 −4.4 −5.3 −4.0 −2.9 −3.7 −3.5 −3.4 −3.4 −3.7 −4.3 −3.9 −4.9
CASIA −2
−3.5 −4.5 −4.3 −5.5 −4.4 −4.4 −4.3 −4.7 −4.2 −3.8 −3.0 −3.9 −3.7 −4.9 −3.9 −4.0 −3.8 −4.4 −3.8 −3.4
CARIB

−3.5 −5.3 −4.9 −5.7 −5.0 −4.7 −4.6 −5.2 −4.3 −3.1 −3.1 −5.0 −4.5 −5.3 −4.6 −4.3 −4.2 −4.8 −3.9 −2.7
SSAFRICA
−4.0 −4.2 −4.2 −4.7 −4.6 −3.9 −3.8 −4.3 −2.6 −4.3 −3.6 −3.8 −3.8 −4.3 −4.2 −3.6 −3.5 −4.0 −2.4 −4.0
SASIA

−4
−4.4 −4.5 −4.4 −3.8 −5.1 −5.1 −5.0 −3.2 −4.0 −5.0 −4.0 −4.4 −4.0 −3.4 −4.8 −4.8 −4.8 −2.8 −3.6 −4.5
POLY
−4.0 −3.8 −4.0 −5.4 −4.1 −3.5 −3.3 −4.7 −3.6 −4.5 −3.5 −3.2 −3.5 −4.8 −3.8 −3.1 −2.9 −4.3 −3.2 −4.3
NAFRICA
-
−4.2 −3.8 −4.0 −5.6 −4.0 −3.4 −3.5 −5.0 −3.7 −4.7 −3.5 −3.4 −3.4 −4.9 −3.4 −2.9 −2.9 −4.4 −3.3 −4.2 −5
MEAST
−4.4 −3.6 −4.0 −5.1 −3.6 −3.9 −4.0 −5.2 −4.5 −5.0 −3.8 −3.2 −3.5 −4.7 −3.1 −3.5 −3.5 −4.5 −4.1 −4.5
EURO
−5.2 −3.6 −4.8 −2.9 −5.1 −5.6 −5.3 −3.8 −4.7 −5.3 −4.5 −3.2 −4.2 −2.5 −4.6 −5.2 −4.8 −3.4 −4.3 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.1 −3.5 −4.8 −4.1 −4.1 −4.0 −4.4 −4.1 −4.8 −3.5 −3.7 −3.0 −4.3 −3.6 −3.6 −3.5 −4.0 −3.7 −4.3
CSAMERIC
−4.3 −3.0 −4.0 −3.6 −3.6 −3.6 −3.6 −4.5 −4.1 −5.0 −3.7 −2.6 −3.4 −3.2 −3.1 −3.1 −3.4 −4.0 −3.6 −4.6
CASIA
−3.2 −4.2 −4.0 −5.2 −4.2 −4.1 −4.0 −4.5 −3.9 −3.5 −2.7 −3.6 −3.5 −4.6 −3.7 −3.7 −3.5 −4.1 −3.5 −3.1
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 264: For algorithm tech5-003 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


304
Cross region FMR at threshold T = 0.896 for algorithm tevian_004, giving FMR(T) = 0.0001 globally.
−3.2 −6.0 −5.2 −6.0 −4.9 −5.1 −4.9 −5.4 −4.8 −2.7 −2.8 −6.0 −4.8 −5.8 −4.5 −4.9 −4.6 −5.3 −4.4 −2.4
SSAFRICA
−4.7 −5.1 −5.0 −4.7 −5.2 −4.5 −4.5 −4.6 −2.9 −4.7 −4.2 −4.6 −4.5 −4.3 −4.8 −4.1 −4.1 −4.3 −2.6 −4.3
SASIA
−5.1 −4.7 −4.9 −3.7 −5.6 −5.6 −5.8 −3.0 −4.5 −5.4 −4.6 −4.2 −4.4 −3.3 −5.1 −5.1 −6.0 −2.6 −4.1 −4.9
POLY
2019/10/16 12:43:37
−5.0 −6.0 −4.9 −6.0 −5.2 −4.4 −4.1 −5.4 −4.3 −5.5 −4.3 −6.0 −4.3 −5.7 −4.8 −3.8 −3.5 −4.6 −3.8 −6.0
NAFRICA log10 FMR
−5.3 −4.7 −4.9 −6.0 −4.9 −4.2 −4.4 −5.5 −4.3 −5.6 −4.5 −4.1 −4.2 −5.7 −4.3 −3.6 −3.7 −4.7 −3.8 −5.0
MEAST
−5.1 −4.7 −5.1 −5.7 −4.6 −4.9 −5.1 −6.0 −5.4 −5.1 −4.5 −4.1 −4.5 −5.2 −4.0 −4.4 −4.5 −5.3 −5.0 −4.7
EURO
−5.5 −3.7 −5.0 −2.9 −5.4 −5.9 −6.0 −3.6 −4.8 −5.7 −5.0 −3.3 −4.4 −2.5 −4.9 −5.5 −5.9 −3.2 −4.5 −5.2 −1
EASIA
−4.9 −5.0 −4.3 −5.1 −5.1 −5.0 −4.8 −4.9 −4.8 −5.0 −4.3 −4.4 −3.7 −4.6 −4.5 −4.4 −4.3 −4.4 −4.3 −4.5
FRVT
CSAMERIC
-
−5.1 −3.5 −4.8 −3.7 −4.5 −4.4 −4.4 −4.5 −4.9 −6.0 −4.6 −3.2 −4.2 −3.3 −4.0 −3.8 −4.2 −4.2 −4.4 −6.0
CASIA −2
−3.3 −5.2 −4.9 −5.7 −4.9 −5.0 −4.8 −5.0 −4.6 −3.1 −2.8 −4.4 −4.3 −5.1 −4.3 −4.3 −4.3 −4.5 −4.1 −2.8
CARIB

−2.9 −6.0 −4.9 −5.8 −4.6 −4.8 −4.6 −5.1 −4.5 −2.4 −2.6 −6.0 −4.5 −5.5 −4.3 −4.6 −4.3 −5.0 −4.1 −2.1
SSAFRICA
−4.4 −4.8 −4.7 −4.4 −4.9 −4.2 −4.3 −4.3 −2.6 −4.4 −3.9 −4.3 −4.2 −4.0 −4.6 −3.8 −3.9 −4.0 −2.4 −4.1
SASIA

−4
−4.8 −4.4 −4.6 −3.4 −5.4 −5.3 −5.5 −2.7 −4.2 −5.1 −4.2 −3.9 −4.2 −3.0 −4.9 −4.8 −6.0 −2.4 −3.8 −4.6
POLY
−4.7 −6.0 −4.6 −5.9 −4.9 −4.1 −3.8 −5.1 −4.0 −5.3 −4.0 −6.0 −4.0 −5.4 −4.5 −3.6 −3.2 −4.3 −3.5 −6.0
NAFRICA
-
−5.0 −4.4 −4.6 −5.7 −4.6 −3.9 −4.1 −5.3 −4.0 −5.3 −4.3 −3.8 −4.0 −5.5 −4.0 −3.3 −3.5 −4.6 −3.5 −4.7 −5
MEAST
−4.8 −4.4 −4.8 −5.4 −4.3 −4.7 −4.8 −5.7 −5.1 −4.8 −4.3 −3.8 −4.2 −5.0 −3.8 −4.1 −4.2 −5.0 −4.7 −4.5
EURO
−5.2 −3.5 −4.7 −2.7 −5.2 −5.7 −5.8 −3.3 −4.6 −5.4 −4.7 −3.0 −4.1 −2.2 −4.7 −5.2 −5.6 −2.9 −4.2 −4.9
−6
EASIA
VERIFICATION
−4.6 −4.7 −4.0 −4.8 −4.8 −4.7 −4.5 −4.7 −4.5 −4.7 −4.0 −4.1 −3.5 −4.3 −4.3 −4.2 −4.0 −4.2 −4.0 −4.3
CSAMERIC
−4.8 −3.2 −4.5 −3.4 −4.2 −4.1 −4.1 −4.2 −4.7 −5.9 −4.3 −2.9 −3.9 −3.0 −3.7 −3.5 −3.9 −3.9 −4.1 −6.0
CASIA
−3.1 −4.9 −4.6 −5.5 −4.6 −4.7 −4.5 −4.7 −4.3 −2.9 −2.6 −4.1 −4.0 −4.9 −4.1 −4.1 −4.0 −4.2 −3.8 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 265: For algorithm tevian-004 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


305
Cross region FMR at threshold T = 0.854 for algorithm tevian_005, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.2 −5.9 −5.1 −5.1 −4.9 −5.4 −5.0 −3.1 −3.1 −5.3 −4.8 −5.4 −4.7 −4.8 −4.5 −5.0 −4.6 −2.8
SSAFRICA
−5.0 −5.3 −5.1 −4.9 −5.5 −4.9 −4.7 −5.0 −3.9 −5.3 −4.5 −4.8 −4.6 −4.5 −5.2 −4.5 −4.3 −4.7 −3.6 −5.1
SASIA
−5.0 −4.7 −4.8 −3.9 −5.6 −5.7 −5.2 −3.4 −4.8 −5.3 −4.6 −4.1 −4.3 −3.6 −5.3 −5.2 −5.1 −3.1 −4.5 −4.8
POLY
2019/10/16 12:43:37
−4.7 −4.5 −4.5 −5.9 −4.7 −4.1 −3.8 −5.6 −4.6 −5.1 −4.0 −4.3 −4.0 −5.4 −4.2 −3.7 −3.3 −4.9 −4.1 −4.9
NAFRICA log10 FMR
−4.8 −4.2 −4.5 −5.8 −4.5 −3.9 −4.0 −5.8 −4.8 −5.2 −4.1 −3.7 −4.0 −5.2 −3.9 −3.4 −3.5 −5.3 −4.3 −4.8
MEAST
−4.9 −4.2 −4.5 −5.4 −4.1 −4.4 −4.6 −5.6 −5.4 −5.3 −4.5 −3.7 −4.1 −5.0 −3.6 −4.0 −4.1 −5.2 −4.9 −5.0
EURO
−5.4 −3.9 −4.9 −2.9 −5.3 −5.6 −5.7 −3.9 −5.0 −5.6 −5.1 −3.5 −4.4 −2.4 −4.8 −5.1 −5.4 −3.5 −4.7 −5.2 −1
EASIA
−4.6 −4.7 −3.9 −5.1 −4.6 −4.5 −4.5 −4.8 −4.9 −5.1 −4.1 −4.2 −3.4 −4.7 −4.1 −4.1 −4.0 −4.4 −4.4 −4.6
FRVT
CSAMERIC
-
−4.8 −3.6 −4.5 −3.9 −4.1 −4.1 −4.2 −4.8 −5.0 −6.0 −4.2 −3.2 −3.9 −3.5 −3.6 −3.6 −4.1 −4.4 −4.6 −6.0
CASIA −2
−3.4 −5.0 −4.5 −5.7 −4.6 −4.7 −4.6 −5.1 −4.7 −3.5 −2.9 −4.8 −4.0 −5.1 −4.1 −4.1 −4.2 −4.7 −4.2 −3.1
CARIB

−3.2 −6.0 −4.9 −5.7 −4.9 −4.8 −4.6 −5.1 −4.7 −2.9 −2.9 −5.0 −4.5 −5.1 −4.5 −4.6 −4.2 −4.8 −4.3 −2.6
SSAFRICA
−4.7 −5.0 −4.8 −4.7 −5.2 −4.7 −4.5 −4.7 −3.7 −5.0 −4.2 −4.5 −4.3 −4.3 −4.9 −4.3 −4.1 −4.5 −3.4 −4.9
SASIA

−4
−4.7 −4.4 −4.5 −3.7 −5.3 −5.4 −4.9 −3.2 −4.5 −5.1 −4.3 −3.8 −4.0 −3.3 −5.1 −4.9 −4.8 −2.8 −4.2 −4.6
POLY
−4.4 −4.2 −4.2 −5.6 −4.4 −3.8 −3.5 −5.3 −4.3 −4.8 −3.7 −4.0 −3.7 −5.1 −4.0 −3.5 −3.1 −4.6 −3.9 −4.6
NAFRICA
-
−4.5 −3.9 −4.2 −5.6 −4.2 −3.6 −3.8 −5.5 −4.5 −4.9 −3.8 −3.4 −3.7 −5.0 −3.7 −3.2 −3.2 −5.0 −4.0 −4.6 −5
MEAST
−4.6 −3.9 −4.2 −5.1 −3.8 −4.2 −4.3 −5.4 −5.1 −5.0 −4.2 −3.4 −3.8 −4.8 −3.4 −3.7 −3.9 −4.9 −4.7 −4.7
EURO
−5.1 −3.7 −4.6 −2.6 −5.0 −5.4 −5.5 −3.6 −4.7 −5.4 −4.9 −3.3 −4.1 −2.2 −4.6 −4.9 −5.1 −3.2 −4.4 −4.9
−6
EASIA
VERIFICATION
−4.3 −4.4 −3.6 −4.8 −4.3 −4.3 −4.2 −4.6 −4.6 −4.8 −3.8 −3.9 −3.1 −4.4 −3.9 −3.8 −3.7 −4.1 −4.2 −4.3
CSAMERIC
−4.5 −3.3 −4.2 −3.6 −3.9 −3.8 −3.9 −4.5 −4.8 −5.9 −3.9 −2.9 −3.7 −3.2 −3.3 −3.3 −3.9 −4.2 −4.3 −6.0
CASIA
−3.1 −4.7 −4.3 −5.4 −4.4 −4.4 −4.3 −4.8 −4.4 −3.2 −2.7 −4.5 −3.7 −4.9 −3.8 −3.8 −3.9 −4.4 −3.9 −2.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 266: For algorithm tevian-005 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


306
Cross region FMR at threshold T = 151.011 for algorithm tiger_002, giving FMR(T) = 0.0001 globally.
−3.4 −6.0 −5.3 −6.0 −5.1 −5.3 −5.4 −5.3 −4.8 −3.0 −3.0 −6.0 −4.9 −5.6 −4.6 −4.9 −6.0 −5.0 −4.4 −2.6
SSAFRICA
−4.5 −5.1 −4.6 −4.8 −5.1 −4.5 −4.5 −4.4 −3.0 −4.8 −3.9 −4.5 −3.9 −4.2 −4.5 −3.9 −3.9 −4.1 −2.7 −4.4
SASIA
−4.6 −4.4 −4.6 −3.6 −5.4 −5.4 −5.2 −3.0 −4.2 −5.4 −4.1 −4.1 −4.0 −3.2 −4.8 −4.6 −4.7 −2.6 −3.7 −5.1
POLY
2019/10/16 12:43:37
−5.0 −5.1 −4.9 −5.8 −5.5 −4.7 −4.4 −5.3 −4.3 −6.0 −4.1 −4.3 −4.1 −5.2 −4.8 −4.2 −3.9 −6.0 −3.7 −6.0
NAFRICA log10 FMR
−4.9 −4.7 −4.6 −5.7 −4.9 −4.3 −4.4 −5.1 −4.2 −5.5 −4.1 −4.2 −3.7 −5.0 −4.1 −3.4 −3.6 −4.5 −3.5 −4.9
MEAST
−5.2 −4.8 −5.1 −5.5 −4.9 −5.1 −5.3 −5.6 −5.3 −5.5 −4.4 −4.4 −4.3 −4.9 −4.2 −4.3 −4.6 −5.0 −4.6 −4.9
EURO
−5.3 −3.8 −5.0 −2.9 −5.4 −5.6 −5.8 −3.5 −4.9 −5.5 −4.7 −3.4 −4.3 −2.5 −4.8 −5.1 −5.3 −3.1 −4.5 −4.8 −1
EASIA
−4.7 −5.0 −4.2 −5.2 −5.1 −4.9 −5.0 −4.6 −4.5 −5.1 −3.9 −4.4 −3.5 −4.5 −4.4 −4.0 −4.2 −4.1 −3.9 −4.5
FRVT
CSAMERIC
-
−5.4 −3.6 −5.1 −3.8 −4.7 −4.8 −4.8 −4.2 −5.2 −6.0 −5.0 −3.1 −4.3 −3.4 −4.2 −4.3 −4.4 −3.8 −4.6 −6.0
CASIA −2
−3.3 −5.3 −4.8 −5.5 −4.9 −5.1 −5.1 −4.8 −4.5 −3.3 −2.8 −4.7 −4.2 −4.9 −4.3 −4.5 −4.7 −4.4 −4.0 −2.9
CARIB

−3.1 −6.0 −5.0 −5.9 −4.9 −5.1 −5.1 −5.0 −4.6 −2.7 −2.8 −6.0 −4.7 −5.3 −4.5 −4.7 −6.0 −4.7 −4.2 −2.4
SSAFRICA
−4.2 −4.8 −4.4 −4.5 −4.9 −4.3 −4.3 −4.2 −2.7 −4.5 −3.7 −4.3 −3.7 −4.0 −4.4 −3.7 −3.8 −3.9 −2.4 −4.1
SASIA

−4
−4.4 −4.1 −4.3 −3.3 −5.1 −5.2 −5.0 −2.7 −3.9 −5.1 −3.9 −3.8 −3.8 −2.9 −4.5 −4.4 −4.8 −2.4 −3.5 −4.8
POLY
−4.8 −4.8 −4.7 −5.5 −5.2 −4.5 −4.1 −5.0 −4.1 −6.0 −3.8 −4.0 −3.9 −5.1 −4.5 −4.0 −3.6 −6.0 −3.5 −6.0
NAFRICA
-
−4.7 −4.5 −4.5 −5.5 −4.7 −4.1 −4.2 −4.8 −4.0 −5.3 −3.9 −3.9 −3.6 −4.9 −3.9 −3.3 −3.5 −4.3 −3.4 −4.8 −5
MEAST
−4.9 −4.5 −4.9 −5.3 −4.6 −4.9 −5.1 −5.3 −5.1 −5.4 −4.2 −4.1 −4.2 −4.7 −4.0 −4.2 −4.5 −4.8 −4.5 −4.8
EURO
−5.1 −3.6 −4.8 −2.7 −5.2 −5.4 −5.5 −3.3 −4.6 −5.3 −4.6 −3.2 −4.1 −2.2 −4.6 −4.8 −5.0 −2.9 −4.2 −4.7
−6
EASIA
VERIFICATION
−4.4 −4.8 −4.0 −4.9 −4.9 −4.7 −4.7 −4.4 −4.3 −4.9 −3.8 −4.3 −3.3 −4.3 −4.2 −3.9 −4.0 −3.9 −3.8 −4.4
CSAMERIC
−5.1 −3.3 −4.8 −3.5 −4.4 −4.5 −4.5 −3.9 −4.9 −6.0 −4.7 −2.8 −4.1 −3.1 −3.9 −4.1 −4.1 −3.6 −4.3 −6.0
CASIA
−3.1 −5.0 −4.5 −5.3 −4.7 −4.8 −4.8 −4.5 −4.2 −3.0 −2.6 −4.5 −3.9 −4.7 −4.1 −4.3 −4.4 −4.1 −3.8 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 267: For algorithm tiger-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individ-


307
Cross region FMR at threshold T = 149.313 for algorithm tiger_003, giving FMR(T) = 0.0001 globally.
−3.7 −6.0 −5.4 −6.0 −5.1 −5.5 −5.2 −5.5 −5.3 −3.3 −3.2 −6.0 −4.6 −5.8 −4.4 −4.8 −5.0 −5.2 −4.7 −2.9
SSAFRICA
−4.1 −4.5 −3.7 −4.7 −4.5 −4.0 −4.1 −4.2 −3.5 −4.7 −3.1 −3.6 −2.7 −3.8 −3.5 −3.1 −3.2 −3.5 −2.9 −3.8
SASIA
−4.6 −4.6 −4.0 −3.9 −4.9 −4.7 −4.9 −3.3 −4.3 −5.4 −3.8 −3.8 −3.0 −3.3 −3.9 −3.7 −4.0 −2.8 −3.5 −4.6
POLY
2019/10/16 12:43:37
−5.3 −4.8 −4.7 −6.0 −5.3 −4.6 −4.6 −5.7 −4.7 −6.0 −6.0 −3.9 −3.9 −5.4 −4.6 −4.0 −4.0 −6.0 −3.8 −4.9
NAFRICA log10 FMR
−4.2 −4.6 −3.6 −5.0 −4.3 −3.8 −4.0 −4.5 −3.8 −4.9 −3.1 −3.6 −2.6 −4.0 −3.2 −2.8 −3.0 −3.5 −2.9 −3.9
MEAST
−4.7 −4.8 −4.2 −5.2 −4.6 −4.4 −4.6 −5.0 −4.7 −5.1 −3.7 −4.0 −3.2 −4.3 −3.6 −3.4 −3.7 −4.1 −3.7 −4.2
EURO
−5.1 −4.2 −4.5 −3.4 −5.2 −5.3 −5.3 −3.9 −4.9 −5.6 −4.1 −3.5 −3.6 −2.8 −4.3 −4.3 −4.4 −3.2 −4.1 −4.7 −1
EASIA
−4.2 −4.4 −3.5 −4.5 −4.3 −4.0 −4.1 −4.2 −3.9 −4.8 −3.2 −3.5 −2.5 −3.5 −3.3 −3.0 −3.1 −3.3 −3.0 −3.9
FRVT
CSAMERIC
-
−5.2 −3.9 −4.3 −4.4 −4.6 −4.5 −4.8 −5.1 −5.0 −6.0 −4.2 −3.4 −3.2 −3.9 −3.6 −3.4 −3.9 −4.4 −4.0 −5.2
CASIA −2
−3.5 −5.4 −4.7 −5.5 −4.8 −4.9 −4.8 −5.0 −4.7 −3.5 −2.8 −4.5 −3.7 −4.7 −4.0 −3.9 −4.0 −4.3 −3.9 −2.9
CARIB

−3.5 −6.0 −5.2 −6.0 −5.0 −5.3 −5.0 −5.2 −5.1 −3.1 −3.0 −6.0 −4.5 −5.5 −4.4 −4.6 −4.7 −5.0 −4.6 −2.7
SSAFRICA
−4.0 −4.4 −3.7 −4.6 −4.4 −4.0 −4.1 −4.2 −3.4 −4.6 −3.1 −3.5 −2.7 −3.8 −3.5 −3.1 −3.2 −3.5 −2.8 −3.8
SASIA

−4
−4.5 −4.5 −4.0 −3.8 −4.8 −4.6 −5.2 −3.1 −4.2 −5.2 −3.8 −3.8 −3.0 −3.2 −3.9 −3.6 −4.3 −2.6 −3.5 −4.6
POLY
−5.0 −4.5 −4.6 −5.8 −5.1 −4.4 −4.3 −5.4 −4.6 −5.7 −6.0 −3.6 −3.8 −5.4 −4.5 −3.9 −3.8 −6.0 −3.7 −4.6
NAFRICA
-
−4.1 −4.5 −3.6 −4.9 −4.2 −3.7 −3.9 −4.4 −3.8 −4.9 −3.0 −3.7 −2.5 −3.9 −3.2 −2.7 −2.9 −3.4 −2.8 −4.0 −5
MEAST
−4.7 −4.7 −4.2 −5.1 −4.4 −4.4 −4.6 −4.9 −4.6 −5.0 −3.7 −4.0 −3.1 −4.2 −3.6 −3.4 −3.7 −4.1 −3.7 −4.2
EURO
−5.0 −4.0 −4.4 −3.3 −5.1 −5.2 −5.3 −3.7 −4.8 −5.6 −4.1 −3.4 −3.5 −2.7 −4.2 −4.2 −4.5 −3.1 −4.0 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.4 −4.4 −4.3 −3.9 −4.0 −4.1 −3.9 −4.7 −3.1 −3.4 −2.4 −3.5 −3.3 −2.9 −3.0 −3.2 −3.0 −3.8
CSAMERIC
−5.1 −3.7 −4.2 −4.2 −4.5 −4.4 −4.8 −4.9 −4.9 −6.0 −4.0 −3.2 −3.2 −3.7 −3.5 −3.4 −4.1 −4.6 −3.9 −6.0
CASIA
−3.4 −5.1 −4.6 −5.4 −4.7 −4.8 −4.6 −4.8 −4.5 −3.4 −2.7 −4.2 −3.7 −4.6 −4.0 −3.8 −3.8 −4.2 −3.8 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 268: For algorithm tiger-003 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individ-


308
Cross region FMR at threshold T = 43.677 for algorithm tongyi_005, giving FMR(T) = 0.0001 globally.
−3.9 −6.0 −5.3 −5.9 −5.4 −5.2 −5.2 −5.6 −4.9 −3.4 −3.4 −5.3 −4.8 −5.4 −5.0 −4.8 −4.7 −5.1 −4.3 −3.0
SSAFRICA
−4.2 −4.7 −3.9 −5.2 −4.5 −3.8 −4.0 −4.6 −3.3 −4.9 −3.4 −3.8 −2.9 −4.4 −3.7 −3.0 −3.1 −3.9 −2.7 −4.3
SASIA
−4.6 −5.0 −4.4 −4.3 −5.4 −5.2 −5.4 −3.2 −4.5 −5.5 −4.1 −4.4 −3.7 −3.8 −4.7 −4.3 −6.0 −2.8 −3.9 −5.3
POLY
2019/10/16 12:43:37
−4.3 −4.4 −4.1 −5.7 −4.6 −3.9 −3.8 −5.2 −4.1 −5.0 −3.7 −3.6 −3.3 −4.9 −3.8 −3.1 −3.2 −4.3 −3.3 −4.4
NAFRICA log10 FMR
−4.1 −4.2 −3.6 −5.2 −4.1 −3.4 −3.6 −5.0 −3.7 −5.0 −3.1 −3.4 −2.6 −4.3 −3.1 −2.5 −2.7 −4.0 −2.8 −4.2
MEAST
−4.8 −4.4 −4.1 −5.6 −4.1 −4.2 −4.4 −5.3 −4.7 −5.4 −3.9 −3.8 −3.2 −4.9 −3.4 −3.3 −3.6 −4.5 −3.8 −4.8
EURO
−5.4 −4.8 −5.0 −4.1 −5.7 −5.6 −5.9 −4.3 −5.4 −5.8 −4.5 −4.2 −4.0 −3.4 −4.9 −4.7 −5.1 −3.7 −4.8 −5.2 −1
EASIA
−4.1 −4.3 −3.3 −5.0 −4.2 −3.8 −3.9 −4.4 −4.0 −5.1 −3.2 −3.5 −2.5 −4.1 −3.3 −2.8 −3.0 −3.6 −3.2 −4.4
FRVT
CSAMERIC
-
−5.1 −4.0 −4.5 −4.9 −4.3 −4.2 −4.6 −5.5 −5.1 −5.5 −4.2 −3.5 −3.6 −4.3 −3.5 −3.4 −4.1 −6.0 −4.4 −4.7
CASIA −2
−3.7 −5.0 −4.5 −5.7 −4.9 −4.8 −4.5 −4.9 −4.6 −3.8 −3.1 −4.4 −3.8 −5.0 −4.3 −4.1 −3.9 −4.4 −4.0 −3.4
CARIB

−3.6 −5.7 −5.1 −5.6 −5.2 −4.9 −4.9 −5.3 −4.6 −3.1 −3.2 −5.0 −4.5 −5.3 −4.8 −4.5 −4.4 −4.8 −4.0 −2.7
SSAFRICA
−4.1 −4.5 −3.7 −5.1 −4.4 −3.8 −3.8 −4.5 −3.1 −4.6 −3.3 −3.8 −2.8 −4.3 −3.6 −2.9 −3.0 −3.8 −2.6 −4.1
SASIA

−4
−4.4 −4.7 −4.2 −4.1 −5.2 −5.0 −5.1 −3.0 −4.2 −5.3 −3.8 −4.2 −3.5 −3.5 −4.5 −4.2 −6.0 −2.6 −3.7 −5.0
POLY
−4.1 −4.1 −3.8 −5.4 −4.3 −3.6 −3.6 −5.0 −4.0 −4.8 −3.5 −3.3 −3.0 −4.6 −3.6 −2.9 −2.9 −4.1 −3.2 −4.1
NAFRICA
-
−4.0 −4.0 −3.5 −5.1 −3.9 −3.3 −3.5 −4.7 −3.6 −4.8 −3.0 −3.3 −2.5 −4.3 −3.0 −2.4 −2.6 −3.8 −2.7 −4.0 −5
MEAST
−4.6 −4.1 −4.0 −5.5 −3.9 −4.0 −4.2 −5.1 −4.6 −5.2 −3.8 −3.6 −3.1 −4.8 −3.2 −3.2 −3.5 −4.3 −3.7 −4.7
EURO
−5.3 −4.6 −4.8 −3.8 −5.5 −5.4 −5.8 −4.0 −5.2 −5.6 −4.4 −4.0 −3.9 −3.2 −4.7 −4.5 −5.1 −3.5 −4.6 −5.0
−6
EASIA
VERIFICATION
−3.9 −4.1 −3.2 −4.8 −4.0 −3.6 −3.7 −4.2 −3.9 −4.8 −3.1 −3.4 −2.3 −4.0 −3.2 −2.7 −2.9 −3.4 −3.1 −4.2
CSAMERIC
−4.9 −3.7 −4.2 −4.6 −4.0 −4.0 −4.3 −5.5 −4.8 −5.5 −4.0 −3.2 −3.4 −4.1 −3.3 −3.2 −3.8 −6.0 −4.3 −4.9
CASIA
−3.5 −4.8 −4.2 −5.5 −4.6 −4.5 −4.3 −4.6 −4.3 −3.6 −2.9 −4.1 −3.6 −4.9 −4.0 −3.8 −3.7 −4.2 −3.7 −3.1
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 269: For algorithm tongyi-005 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


309
Cross region FMR at threshold T = 0.628 for algorithm toshiba_002, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.3 −5.9 −5.2 −5.4 −5.2 −5.5 −5.1 −3.2 −3.2 −6.0 −4.8 −5.7 −4.7 −4.9 −4.8 −5.4 −4.7 −2.9
SSAFRICA
−4.2 −4.7 −4.0 −4.9 −4.7 −4.1 −4.1 −4.4 −3.3 −4.8 −3.4 −3.9 −3.0 −4.1 −3.8 −3.3 −3.4 −3.8 −2.8 −4.1
SASIA
−4.6 −4.8 −4.2 −3.8 −5.1 −5.1 −4.9 −2.9 −4.4 −5.2 −4.1 −4.2 −3.4 −3.3 −4.4 −4.3 −4.4 −2.6 −3.9 −4.6
POLY
2019/10/16 12:43:37
−4.5 −4.5 −4.3 −5.7 −5.0 −4.2 −3.8 −5.3 −4.3 −5.4 −4.1 −3.6 −3.7 −5.7 −4.3 −3.6 −3.4 −4.9 −3.6 −4.9
NAFRICA log10 FMR
−4.4 −4.5 −3.9 −5.3 −4.5 −3.8 −3.9 −4.7 −3.9 −5.2 −3.5 −3.8 −2.9 −4.4 −3.5 −2.9 −3.1 −3.9 −3.0 −4.4
MEAST
−4.9 −4.6 −4.4 −5.6 −4.5 −4.6 −4.8 −5.2 −4.9 −5.4 −4.1 −4.0 −3.5 −4.8 −3.8 −3.7 −4.0 −4.4 −4.1 −4.7
EURO
−5.2 −4.2 −4.7 −3.4 −5.3 −5.5 −5.6 −3.8 −5.0 −5.7 −4.4 −3.6 −3.8 −2.8 −4.5 −4.6 −4.8 −3.3 −4.4 −4.9 −1
EASIA
−4.3 −4.4 −3.4 −4.8 −4.4 −4.1 −4.1 −4.2 −4.1 −5.0 −3.4 −3.6 −2.6 −3.9 −3.6 −3.2 −3.3 −3.5 −3.3 −4.3
FRVT
CSAMERIC
-
−5.1 −3.8 −4.3 −4.4 −4.5 −4.3 −4.5 −5.0 −5.0 −6.0 −4.1 −3.4 −3.3 −4.1 −3.7 −3.5 −3.9 −4.5 −4.1 −6.0
CASIA −2
−3.5 −5.7 −4.6 −5.5 −4.9 −4.9 −4.7 −4.9 −4.7 −3.5 −2.8 −5.0 −4.0 −4.9 −4.2 −4.3 −4.2 −4.5 −4.2 −3.0
CARIB

−3.4 −6.0 −5.1 −5.7 −5.0 −5.2 −4.9 −5.2 −4.8 −3.0 −3.0 −6.0 −4.6 −5.4 −4.5 −4.7 −4.5 −5.3 −4.5 −2.7
SSAFRICA
−4.1 −4.6 −3.9 −4.7 −4.6 −4.0 −4.0 −4.3 −3.1 −4.6 −3.3 −3.8 −3.0 −4.0 −3.8 −3.3 −3.4 −3.7 −2.7 −4.0
SASIA

−4
−4.4 −4.6 −4.1 −3.6 −5.0 −4.9 −4.7 −2.7 −4.2 −4.9 −3.9 −3.9 −3.3 −3.1 −4.2 −4.1 −4.3 −2.3 −3.7 −4.4
POLY
−4.3 −4.2 −4.0 −5.5 −4.7 −4.0 −3.6 −5.0 −4.1 −5.1 −3.8 −3.3 −3.4 −5.4 −4.1 −3.3 −3.2 −4.6 −3.5 −4.6
NAFRICA
-
−4.3 −4.3 −3.7 −5.2 −4.3 −3.6 −3.7 −4.6 −3.8 −5.0 −3.4 −3.7 −2.8 −4.4 −3.4 −2.8 −2.9 −3.8 −3.0 −4.3 −5
MEAST
−4.8 −4.4 −4.2 −5.4 −4.3 −4.5 −4.6 −5.1 −4.8 −5.2 −4.0 −3.8 −3.4 −4.7 −3.6 −3.7 −3.9 −4.4 −4.0 −4.6
EURO
−5.1 −4.0 −4.6 −3.2 −5.2 −5.4 −5.5 −3.6 −4.9 −5.5 −4.3 −3.4 −3.7 −2.6 −4.4 −4.5 −4.8 −3.1 −4.3 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.6 −4.3 −4.0 −3.9 −4.0 −4.0 −4.8 −3.3 −3.5 −2.5 −3.8 −3.5 −3.1 −3.2 −3.3 −3.2 −4.2
CSAMERIC
−4.9 −3.6 −4.2 −4.2 −4.3 −4.1 −4.3 −4.8 −4.8 −6.0 −4.0 −3.1 −3.2 −3.8 −3.5 −3.4 −3.8 −4.4 −4.0 −6.0
CASIA
−3.3 −5.4 −4.4 −5.3 −4.7 −4.7 −4.5 −4.6 −4.4 −3.2 −2.7 −4.7 −3.8 −4.8 −4.1 −4.1 −4.0 −4.2 −4.0 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 270: For algorithm toshiba-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


310
Cross region FMR at threshold T = 0.626 for algorithm toshiba_003, giving FMR(T) = 0.0001 globally.
−3.7 −6.0 −5.4 −6.0 −5.2 −5.4 −5.2 −5.7 −5.1 −3.3 −3.2 −6.0 −4.9 −5.6 −4.7 −4.9 −4.8 −5.9 −4.8 −3.0
SSAFRICA
−4.2 −4.6 −3.9 −4.9 −4.6 −4.1 −4.1 −4.4 −3.3 −4.7 −3.3 −3.8 −2.9 −4.1 −3.8 −3.2 −3.3 −3.7 −2.8 −4.1
SASIA
−4.6 −4.8 −4.2 −3.8 −5.1 −5.0 −5.1 −2.9 −4.5 −5.2 −4.1 −4.2 −3.4 −3.3 −4.3 −4.2 −4.4 −2.5 −3.9 −4.7
POLY
2019/10/16 12:43:37
−4.6 −4.7 −4.3 −5.8 −4.9 −4.2 −3.9 −5.3 −4.4 −5.2 −4.0 −3.7 −3.7 −5.4 −4.3 −3.5 −3.3 −4.9 −3.7 −4.9
NAFRICA log10 FMR
−4.4 −4.4 −3.8 −5.2 −4.4 −3.7 −3.8 −4.6 −3.9 −5.2 −3.4 −3.7 −2.8 −4.3 −3.5 −2.8 −3.0 −3.8 −3.0 −4.4
MEAST
−4.9 −4.6 −4.3 −5.6 −4.4 −4.6 −4.7 −5.1 −4.9 −5.4 −4.0 −4.0 −3.4 −4.7 −3.7 −3.7 −3.9 −4.3 −4.0 −4.6
EURO
−5.2 −4.3 −4.7 −3.5 −5.3 −5.5 −5.6 −3.8 −5.1 −5.8 −4.3 −3.6 −3.7 −2.8 −4.5 −4.5 −4.7 −3.3 −4.4 −5.0 −1
EASIA
−4.2 −4.4 −3.4 −4.7 −4.4 −4.0 −4.1 −4.2 −4.1 −5.0 −3.4 −3.5 −2.6 −3.8 −3.5 −3.1 −3.2 −3.4 −3.2 −4.3
FRVT
CSAMERIC
-
−5.1 −3.8 −4.3 −4.5 −4.4 −4.3 −4.6 −4.9 −5.0 −5.9 −4.1 −3.3 −3.3 −4.1 −3.6 −3.4 −4.0 −4.5 −4.1 −5.2
CASIA −2
−3.5 −5.6 −4.6 −5.5 −4.9 −5.0 −4.7 −4.9 −4.7 −3.6 −2.9 −5.0 −4.0 −4.9 −4.2 −4.3 −4.2 −4.6 −4.3 −3.0
CARIB

−3.5 −6.0 −5.2 −5.8 −5.1 −5.2 −4.9 −5.4 −4.9 −3.0 −3.0 −6.0 −4.7 −5.5 −4.5 −4.6 −4.5 −5.6 −4.5 −2.7
SSAFRICA
−4.1 −4.5 −3.8 −4.8 −4.6 −4.0 −4.0 −4.2 −3.2 −4.6 −3.3 −3.8 −2.9 −4.0 −3.8 −3.2 −3.3 −3.7 −2.7 −4.0
SASIA

−4
−4.4 −4.6 −4.0 −3.6 −4.9 −4.8 −4.8 −2.7 −4.2 −5.0 −3.9 −3.9 −3.2 −3.1 −4.1 −4.1 −4.3 −2.3 −3.7 −4.5
POLY
−4.3 −4.4 −4.0 −5.6 −4.7 −3.9 −3.6 −5.0 −4.2 −4.9 −3.7 −3.4 −3.4 −5.4 −4.1 −3.3 −3.1 −4.6 −3.5 −4.6
NAFRICA
-
−4.2 −4.2 −3.7 −5.2 −4.3 −3.6 −3.7 −4.5 −3.8 −5.0 −3.3 −3.5 −2.7 −4.3 −3.4 −2.7 −2.9 −3.7 −2.9 −4.4 −5
MEAST
−4.7 −4.4 −4.2 −5.4 −4.2 −4.4 −4.5 −5.0 −4.8 −5.2 −3.9 −3.8 −3.4 −4.6 −3.6 −3.6 −3.9 −4.2 −4.0 −4.5
EURO
−5.1 −4.1 −4.6 −3.3 −5.2 −5.4 −5.6 −3.6 −4.9 −5.7 −4.2 −3.5 −3.7 −2.7 −4.4 −4.5 −4.8 −3.1 −4.3 −4.9
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.3 −4.6 −4.3 −3.9 −3.9 −4.0 −4.0 −4.8 −3.3 −3.5 −2.5 −3.8 −3.4 −3.1 −3.1 −3.3 −3.2 −4.2
CSAMERIC
−4.9 −3.5 −4.2 −4.2 −4.2 −4.1 −4.3 −4.7 −4.8 −5.9 −3.9 −3.1 −3.2 −3.8 −3.5 −3.3 −3.8 −4.6 −4.0 −4.9
CASIA
−3.3 −5.3 −4.4 −5.3 −4.7 −4.7 −4.5 −4.6 −4.4 −3.3 −2.7 −4.7 −3.7 −4.7 −4.0 −4.1 −4.1 −4.3 −4.0 −2.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 271: For algorithm toshiba-003 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


311
Cross region FMR at threshold T = 0.368 for algorithm trueface_000, giving FMR(T) = 0.0001 globally.
−3.7 −6.0 −5.5 −6.0 −5.2 −5.6 −5.4 −5.5 −5.3 −3.3 −3.1 −6.0 −5.1 −5.8 −4.6 −5.0 −5.3 −5.2 −4.9 −3.0
SSAFRICA
−4.2 −4.7 −4.0 −4.7 −4.7 −4.1 −4.2 −4.4 −3.4 −4.9 −3.4 −3.8 −3.0 −4.1 −3.8 −3.2 −3.4 −3.7 −2.8 −4.2
SASIA
−4.7 −4.7 −4.3 −3.8 −5.1 −5.0 −5.6 −3.1 −4.6 −5.2 −4.0 −4.0 −3.4 −3.2 −4.3 −4.1 −4.6 −2.7 −3.9 −4.6
POLY
2019/10/16 12:43:37
−4.8 −4.7 −4.3 −6.0 −5.1 −4.3 −4.1 −5.2 −4.4 −6.0 −4.2 −3.6 −3.5 −5.7 −4.3 −3.6 −3.6 −4.9 −3.5 −6.0
NAFRICA log10 FMR
−4.4 −4.6 −3.9 −5.3 −4.5 −3.8 −4.0 −4.8 −3.9 −5.2 −3.4 −3.9 −2.9 −4.4 −3.6 −2.9 −3.1 −3.9 −2.9 −4.3
MEAST
−5.0 −4.8 −4.5 −5.5 −4.6 −4.6 −4.8 −5.2 −4.9 −5.6 −4.2 −4.1 −3.5 −4.6 −3.9 −3.8 −4.0 −4.4 −4.0 −4.8
EURO
−5.2 −4.0 −4.7 −3.2 −5.3 −5.7 −5.8 −3.7 −5.1 −5.7 −4.3 −3.5 −3.9 −2.7 −4.5 −4.7 −5.0 −3.2 −4.5 −5.0 −1
EASIA
−4.3 −4.5 −3.5 −4.9 −4.5 −4.1 −4.2 −4.4 −4.1 −5.1 −3.4 −3.7 −2.6 −4.0 −3.6 −3.2 −3.3 −3.6 −3.3 −4.4
FRVT
CSAMERIC
-
−5.6 −4.0 −4.5 −4.0 −4.7 −4.5 −4.8 −4.6 −5.1 −6.0 −4.6 −3.7 −3.5 −3.9 −3.8 −3.6 −4.1 −4.4 −4.1 −5.2
CASIA −2
−3.4 −5.6 −4.8 −5.6 −4.9 −5.0 −4.8 −5.0 −4.8 −3.5 −2.7 −5.0 −4.1 −4.9 −4.1 −4.3 −4.2 −4.5 −4.3 −2.9
CARIB

−3.4 −6.0 −5.3 −5.7 −5.0 −5.4 −5.3 −5.2 −5.0 −3.1 −3.0 −6.0 −4.8 −5.5 −4.5 −4.9 −6.0 −4.9 −4.6 −2.7
SSAFRICA
−4.1 −4.6 −3.9 −4.6 −4.6 −4.0 −4.1 −4.3 −3.2 −4.7 −3.3 −3.7 −3.0 −4.1 −3.8 −3.2 −3.4 −3.7 −2.7 −4.1
SASIA

−4
−4.5 −4.7 −4.1 −3.6 −5.0 −4.8 −5.3 −2.9 −4.4 −5.0 −3.9 −3.9 −3.3 −3.1 −4.1 −3.9 −4.3 −2.5 −3.8 −4.5
POLY
−4.6 −4.4 −4.1 −5.8 −4.9 −4.1 −3.8 −4.9 −4.2 −5.7 −3.9 −3.3 −3.4 −5.4 −4.2 −3.5 −3.5 −4.6 −3.5 −6.0
NAFRICA
-
−4.3 −4.4 −3.8 −5.2 −4.4 −3.7 −3.8 −4.7 −3.8 −5.1 −3.3 −3.9 −2.8 −4.3 −3.5 −2.8 −3.0 −3.9 −2.9 −4.2 −5
MEAST
−4.9 −4.5 −4.4 −5.4 −4.4 −4.5 −4.7 −5.2 −4.8 −5.4 −4.1 −3.9 −3.5 −4.5 −3.8 −3.7 −4.0 −4.3 −3.9 −4.7
EURO
−5.0 −3.9 −4.7 −3.1 −5.2 −5.6 −5.7 −3.5 −5.0 −5.6 −4.2 −3.4 −3.8 −2.6 −4.4 −4.7 −5.0 −3.1 −4.4 −4.9
−6
EASIA
VERIFICATION
−4.2 −4.4 −3.4 −4.8 −4.4 −4.0 −4.0 −4.2 −4.0 −5.0 −3.3 −3.6 −2.5 −3.9 −3.5 −3.1 −3.2 −3.5 −3.2 −4.3
CSAMERIC
−5.5 −3.7 −4.4 −3.8 −4.5 −4.3 −4.6 −4.4 −4.9 −6.0 −4.5 −3.6 −3.4 −3.7 −3.7 −3.5 −4.1 −4.1 −4.0 −6.0
CASIA
−3.3 −5.3 −4.6 −5.4 −4.7 −4.8 −4.6 −4.7 −4.5 −3.3 −2.6 −4.7 −3.9 −4.8 −4.1 −4.1 −4.0 −4.2 −4.0 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 272: For algorithm trueface-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


312
Cross region FMR at threshold T = 0.151 for algorithm ulsee_001, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.2 −5.8 −5.0 −5.2 −4.9 −5.3 −4.9 −3.0 −3.0 −6.0 −4.9 −5.4 −4.5 −5.1 −4.7 −4.9 −4.5 −2.7
SSAFRICA
−4.2 −4.7 −4.0 −4.9 −4.7 −4.0 −4.1 −4.4 −3.2 −4.8 −3.5 −3.9 −3.1 −4.2 −3.9 −3.2 −3.4 −3.9 −2.8 −4.2
SASIA
−4.6 −4.8 −4.2 −3.8 −5.2 −5.0 −5.0 −2.9 −4.4 −5.1 −4.1 −4.2 −3.5 −3.3 −4.4 −4.2 −4.6 −2.5 −3.9 −4.9
POLY
2019/10/16 12:43:37
−4.6 −4.5 −4.2 −5.8 −4.7 −4.1 −3.8 −5.1 −4.3 −5.2 −4.2 −3.4 −3.5 −5.4 −4.1 −3.5 −3.3 −4.4 −3.8 −4.9
NAFRICA log10 FMR
−4.4 −4.4 −3.9 −5.3 −4.5 −3.8 −3.9 −4.8 −3.9 −5.1 −3.5 −3.7 −2.9 −4.4 −3.6 −2.9 −3.0 −4.0 −3.0 −4.5
MEAST
−4.9 −4.5 −4.5 −5.7 −4.4 −4.6 −4.7 −5.4 −4.8 −5.3 −4.1 −3.9 −3.6 −4.9 −3.8 −3.8 −4.0 −4.7 −4.0 −4.6
EURO
−5.3 −4.1 −4.8 −3.3 −5.3 −5.7 −5.7 −3.8 −5.0 −5.6 −4.6 −3.5 −3.9 −2.8 −4.6 −4.8 −5.1 −3.3 −4.6 −4.9 −1
EASIA
−4.3 −4.4 −3.5 −4.9 −4.4 −4.1 −4.1 −4.3 −4.2 −5.0 −3.5 −3.7 −2.7 −4.1 −3.6 −3.2 −3.3 −3.6 −3.4 −4.4
FRVT
CSAMERIC
-
−5.5 −3.7 −4.5 −4.3 −4.5 −4.4 −4.5 −4.8 −5.0 −6.0 −5.0 −3.3 −3.5 −3.9 −3.9 −3.6 −4.1 −4.4 −4.2 −6.0
CASIA −2
−3.3 −5.6 −4.6 −5.4 −4.8 −4.8 −4.7 −4.8 −4.6 −3.3 −2.7 −6.0 −4.0 −4.8 −4.1 −4.2 −4.0 −4.4 −4.2 −2.8
CARIB

−3.2 −6.0 −5.0 −5.5 −4.8 −5.0 −4.6 −5.0 −4.6 −2.8 −2.9 −6.0 −4.7 −5.2 −4.4 −4.9 −4.4 −4.6 −4.3 −2.5
SSAFRICA
−4.0 −4.6 −3.9 −4.7 −4.6 −3.9 −4.0 −4.2 −3.0 −4.6 −3.3 −3.9 −3.0 −4.1 −3.8 −3.2 −3.3 −3.8 −2.6 −4.1
SASIA

−4
−4.4 −4.5 −4.0 −3.5 −5.0 −4.8 −4.8 −2.6 −4.2 −4.9 −3.9 −3.9 −3.3 −3.1 −4.3 −4.1 −4.3 −2.3 −3.7 −4.7
POLY
−4.4 −4.2 −4.0 −5.6 −4.5 −3.8 −3.6 −4.8 −4.0 −5.0 −3.9 −3.1 −3.3 −5.4 −3.9 −3.3 −3.0 −4.1 −3.7 −4.6
NAFRICA
-
−4.3 −4.2 −3.8 −5.2 −4.3 −3.6 −3.7 −4.7 −3.8 −4.9 −3.4 −3.6 −2.9 −4.4 −3.5 −2.8 −2.9 −4.0 −3.0 −4.5 −5
MEAST
−4.8 −4.2 −4.3 −5.5 −4.2 −4.4 −4.5 −5.3 −4.7 −5.1 −4.1 −3.6 −3.5 −4.8 −3.6 −3.7 −3.9 −4.6 −3.9 −4.5
EURO
−5.1 −3.9 −4.6 −3.2 −5.2 −5.5 −5.6 −3.5 −4.9 −5.4 −4.4 −3.3 −3.8 −2.6 −4.5 −4.7 −5.1 −3.1 −4.4 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.3 −4.7 −4.3 −3.9 −3.9 −4.1 −4.0 −4.7 −3.4 −3.6 −2.6 −4.0 −3.5 −3.1 −3.2 −3.5 −3.3 −4.2
CSAMERIC
−5.2 −3.5 −4.3 −4.0 −4.3 −4.2 −4.2 −4.5 −4.7 −6.0 −4.7 −3.1 −3.4 −3.6 −3.7 −3.5 −3.8 −4.2 −4.0 −6.0
CASIA
−3.2 −5.3 −4.4 −5.2 −4.6 −4.6 −4.5 −4.5 −4.3 −3.1 −2.6 −6.0 −3.8 −4.7 −4.0 −4.1 −3.8 −4.1 −3.9 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 273: For algorithm ulsee-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individ-


313
Cross region FMR at threshold T = 0.771 for algorithm uluface_002, giving FMR(T) = 0.0001 globally.
−3.3 −5.4 −5.0 −5.6 −4.8 −5.0 −4.7 −5.0 −4.7 −2.9 −3.0 −5.0 −4.5 −5.2 −4.4 −4.7 −4.3 −4.9 −4.2 −2.6
SSAFRICA
−4.0 −4.6 −3.9 −5.0 −4.6 −4.0 −4.0 −4.3 −3.1 −4.5 −3.3 −4.0 −3.1 −4.4 −3.8 −3.2 −3.3 −3.9 −2.7 −3.9
SASIA
−4.4 −5.1 −4.4 −4.2 −5.3 −5.0 −4.9 −3.1 −4.2 −5.0 −3.9 −6.0 −3.8 −3.8 −4.7 −4.3 −4.4 −2.8 −3.7 −4.8
POLY
2019/10/16 12:43:37
−4.4 −4.5 −4.1 −5.5 −4.6 −3.9 −3.6 −5.1 −4.1 −4.8 −3.9 −3.6 −3.4 −5.2 −4.0 −3.4 −3.2 −4.6 −3.4 −4.4
NAFRICA log10 FMR
−4.2 −4.2 −3.8 −5.2 −4.3 −3.6 −3.8 −4.8 −3.8 −4.8 −3.2 −3.6 −2.8 −4.4 −3.4 −2.8 −3.0 −4.1 −2.9 −4.0
MEAST
−4.7 −4.4 −4.3 −5.7 −4.3 −4.4 −4.5 −5.2 −4.7 −4.9 −3.9 −3.9 −3.6 −5.1 −3.7 −3.7 −3.9 −4.6 −4.0 −4.3
EURO
−5.1 −4.8 −5.0 −4.1 −5.7 −5.5 −5.4 −4.2 −5.0 −5.5 −4.4 −4.3 −4.3 −3.5 −5.0 −4.7 −4.6 −3.8 −4.6 −5.0 −1
EASIA
−4.1 −4.4 −3.4 −5.0 −4.3 −4.0 −4.1 −4.3 −4.0 −4.7 −3.3 −3.7 −2.7 −4.3 −3.6 −3.2 −3.3 −3.7 −3.3 −4.0
FRVT
CSAMERIC
-
−4.9 −3.8 −4.4 −4.9 −4.3 −4.2 −4.4 −5.0 −4.8 −5.5 −4.5 −3.2 −3.6 −4.5 −3.6 −3.6 −4.1 −4.4 −4.3 −4.9
CASIA −2
−3.2 −5.2 −4.3 −5.3 −4.6 −4.6 −4.4 −4.5 −4.3 −3.2 −2.6 −5.0 −3.7 −4.8 −4.0 −3.9 −3.9 −4.2 −3.8 −2.8
CARIB

−3.1 −5.2 −4.7 −5.4 −4.6 −4.8 −4.5 −4.7 −4.4 −2.6 −2.8 −4.7 −4.3 −5.0 −4.3 −4.6 −4.2 −4.6 −4.0 −2.4
SSAFRICA
−3.9 −4.4 −3.8 −4.8 −4.4 −3.9 −3.9 −4.1 −2.9 −4.3 −3.2 −3.9 −3.0 −4.3 −3.8 −3.2 −3.2 −3.7 −2.5 −3.8
SASIA

−4
−4.1 −4.8 −4.1 −3.9 −5.1 −4.8 −4.6 −2.8 −3.9 −4.7 −3.6 −6.0 −3.6 −3.6 −4.6 −4.2 −4.2 −2.6 −3.5 −4.5
POLY
−4.1 −4.2 −3.9 −5.2 −4.3 −3.7 −3.4 −4.8 −3.9 −4.5 −3.6 −3.3 −3.3 −5.0 −3.8 −3.2 −2.9 −4.3 −3.3 −4.1
NAFRICA
-
−4.0 −4.0 −3.7 −5.1 −4.1 −3.5 −3.6 −4.6 −3.7 −4.6 −3.1 −3.4 −2.8 −4.3 −3.3 −2.7 −2.9 −3.9 −2.9 −3.9 −5
MEAST
−4.5 −4.1 −4.2 −5.5 −4.0 −4.2 −4.3 −5.0 −4.5 −4.7 −3.8 −3.7 −3.5 −5.0 −3.5 −3.6 −3.8 −4.4 −3.9 −4.2
EURO
−4.9 −4.5 −4.9 −3.9 −5.5 −5.3 −5.3 −3.9 −4.8 −5.3 −4.3 −4.1 −4.2 −3.4 −4.8 −4.6 −4.6 −3.6 −4.4 −4.9
−6
EASIA
VERIFICATION
−3.9 −4.2 −3.2 −4.9 −4.1 −3.9 −3.9 −4.1 −3.8 −4.5 −3.2 −3.6 −2.5 −4.2 −3.5 −3.1 −3.2 −3.5 −3.2 −3.9
CSAMERIC
−4.6 −3.5 −4.2 −4.6 −4.1 −3.9 −4.1 −4.8 −4.5 −5.2 −4.2 −3.0 −3.4 −4.3 −3.4 −3.4 −3.8 −4.3 −4.2 −4.9
CASIA
−3.0 −5.0 −4.1 −5.1 −4.4 −4.3 −4.2 −4.3 −4.0 −3.0 −2.5 −5.0 −3.5 −4.6 −3.8 −3.7 −3.7 −4.0 −3.5 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 274: For algorithm uluface-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


314
Cross region FMR at threshold T = 0.482 for algorithm upc_001, giving FMR(T) = 0.0001 globally.
−3.3 −6.0 −5.2 −6.0 −4.7 −5.0 −5.0 −5.6 −4.8 −3.0 −2.8 −6.0 −4.5 −5.6 −4.2 −4.5 −4.4 −5.1 −4.3 −2.6
SSAFRICA
−3.8 −4.7 −3.7 −5.1 −4.3 −3.7 −3.8 −4.5 −3.1 −4.4 −2.9 −3.8 −2.7 −4.3 −3.4 −2.9 −3.0 −3.9 −2.6 −3.6
SASIA
−4.5 −5.7 −4.8 −5.0 −5.5 −5.3 −5.4 −3.9 −4.4 −5.1 −4.0 −5.0 −3.9 −4.4 −4.8 −4.5 −4.7 −3.4 −3.9 −4.8
POLY
2019/10/16 12:43:37
−4.6 −4.7 −4.3 −6.0 −5.2 −4.1 −4.0 −5.6 −4.2 −5.1 −3.9 −3.9 −3.6 −6.0 −4.5 −3.4 −3.5 −4.6 −3.4 −4.4
NAFRICA log10 FMR
−4.0 −4.5 −3.6 −5.3 −4.1 −3.5 −3.7 −4.9 −3.6 −4.8 −3.0 −3.7 −2.6 −4.3 −3.1 −2.6 −2.8 −4.1 −2.7 −3.9
MEAST
−4.4 −4.7 −4.1 −5.8 −4.3 −4.2 −4.5 −5.4 −4.5 −4.9 −3.6 −4.0 −3.1 −4.9 −3.5 −3.3 −3.6 −4.6 −3.6 −4.2
EURO
−5.4 −6.0 −5.3 −5.3 −6.0 −5.6 −5.7 −5.0 −5.3 −5.9 −4.5 −5.1 −4.3 −4.4 −5.2 −4.8 −5.0 −4.3 −4.7 −5.0 −1
EASIA
−3.9 −4.6 −3.5 −5.2 −4.2 −3.8 −3.9 −4.7 −3.9 −4.6 −2.9 −3.7 −2.5 −4.3 −3.2 −2.8 −3.0 −3.8 −3.0 −3.7
FRVT
CSAMERIC
-
−4.9 −4.3 −4.2 −6.0 −4.4 −4.2 −4.5 −6.0 −4.8 −5.9 −3.8 −3.8 −3.1 −5.1 −3.4 −3.2 −3.9 −5.2 −3.8 −4.9
CASIA −2
−3.2 −5.9 −4.5 −5.7 −4.5 −4.7 −4.7 −5.1 −4.3 −3.2 −2.5 −4.8 −3.7 −4.9 −3.8 −3.9 −4.0 −4.4 −3.7 −2.6
CARIB

−3.1 −6.0 −4.9 −6.0 −4.6 −4.8 −4.8 −5.3 −4.6 −2.7 −2.7 −6.0 −4.3 −5.4 −4.1 −4.3 −4.3 −4.9 −4.0 −2.4
SSAFRICA
−3.7 −4.6 −3.6 −5.0 −4.3 −3.7 −3.7 −4.4 −2.9 −4.3 −2.8 −3.8 −2.7 −4.2 −3.4 −2.9 −3.0 −3.8 −2.5 −3.6
SASIA

−4
−4.4 −5.4 −4.7 −4.9 −5.4 −5.1 −5.2 −3.6 −4.2 −5.0 −3.8 −4.7 −3.8 −4.2 −4.7 −4.4 −4.5 −3.2 −3.7 −4.8
POLY
−4.3 −4.4 −4.1 −6.0 −5.0 −3.9 −3.7 −5.4 −4.0 −4.8 −3.7 −3.6 −3.4 −6.0 −4.5 −3.2 −3.2 −4.6 −3.4 −4.1
NAFRICA
-
−3.9 −4.3 −3.5 −5.2 −4.1 −3.4 −3.6 −4.8 −3.5 −4.7 −2.9 −3.6 −2.5 −4.3 −3.1 −2.5 −2.8 −4.0 −2.7 −3.8 −5
MEAST
−4.4 −4.5 −4.1 −5.8 −4.2 −4.2 −4.4 −5.3 −4.4 −4.8 −3.5 −3.8 −3.1 −4.9 −3.4 −3.3 −3.6 −4.6 −3.6 −4.1
EURO
−5.2 −5.8 −5.1 −5.1 −5.9 −5.6 −5.5 −4.8 −5.2 −5.8 −4.4 −4.8 −4.2 −4.3 −5.1 −4.7 −4.8 −4.1 −4.6 −5.0
−6
EASIA
VERIFICATION
−3.8 −4.5 −3.4 −5.1 −4.1 −3.7 −3.8 −4.5 −3.8 −4.5 −2.9 −3.6 −2.4 −4.2 −3.2 −2.8 −2.9 −3.7 −2.9 −3.7
CSAMERIC
−4.9 −4.0 −4.1 −5.9 −4.2 −4.1 −4.2 −6.0 −4.7 −6.0 −3.8 −3.5 −3.0 −5.0 −3.3 −3.1 −3.7 −6.0 −3.7 −6.0
CASIA
−3.0 −5.6 −4.3 −5.6 −4.4 −4.5 −4.5 −4.9 −4.1 −3.0 −2.4 −4.5 −3.6 −4.8 −3.7 −3.8 −3.9 −4.2 −3.6 −2.5
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 275: For algorithm upc-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


315
Cross region FMR at threshold T = 0.428 for algorithm vcog_002, giving FMR(T) = 0.0001 globally.
−3.2 −5.7 −4.9 −5.4 −4.7 −5.0 −4.7 −5.0 −4.6 −2.8 −3.0 −6.0 −4.7 −5.2 −4.6 −4.7 −4.3 −4.9 −4.4 −2.6
SSAFRICA
−4.0 −4.7 −4.3 −4.6 −4.7 −4.1 −4.1 −4.3 −3.1 −4.0 −3.7 −4.6 −4.0 −4.4 −4.5 −3.8 −3.8 −4.0 −2.9 −3.8
SASIA
−4.2 −4.3 −4.3 −3.8 −4.9 −4.7 −4.3 −3.4 −4.2 −4.3 −4.1 −4.5 −4.2 −3.6 −4.8 −4.8 −4.3 −3.1 −4.0 −4.1
POLY
2019/10/16 12:43:37
−4.1 −4.0 −4.1 −4.6 −4.3 −3.9 −3.9 −4.6 −4.0 −4.2 −3.7 −3.6 −3.8 −4.3 −4.0 −3.6 −3.3 −4.4 −3.6 −4.1
NAFRICA log10 FMR
−4.3 −4.3 −4.2 −4.6 −4.4 −3.9 −4.0 −4.7 −3.9 −4.3 −4.0 −4.1 −3.9 −4.6 −4.1 −3.4 −3.6 −4.6 −3.7 −4.2
MEAST
−4.0 −4.1 −4.3 −4.3 −4.1 −4.3 −4.4 −4.9 −4.7 −3.8 −3.9 −3.8 −4.2 −4.2 −3.8 −4.0 −4.2 −4.6 −4.5 −3.7
EURO
−4.7 −3.6 −4.4 −3.1 −4.7 −4.8 −4.8 −3.9 −4.7 −4.5 −4.6 −3.4 −4.5 −2.8 −4.7 −4.9 −4.9 −3.6 −4.5 −4.4 −1
EASIA
−4.2 −4.5 −4.0 −4.6 −4.5 −4.3 −4.3 −4.5 −4.3 −4.3 −3.9 −4.1 −3.6 −4.4 −4.2 −3.9 −4.0 −4.2 −4.0 −4.1
FRVT
CSAMERIC
-
−4.4 −3.4 −4.2 −3.5 −4.2 −4.2 −4.4 −4.3 −4.7 −4.1 −4.2 −3.0 −4.0 −3.3 −3.9 −4.0 −4.1 −4.4 −4.4 −4.1
CASIA −2
−3.2 −4.9 −4.3 −5.0 −4.6 −4.5 −4.3 −4.4 −4.2 −3.0 −2.8 −4.8 −4.1 −4.9 −4.3 −4.2 −4.1 −4.3 −3.9 −2.8
CARIB

−3.0 −5.4 −4.7 −5.3 −4.6 −4.9 −4.4 −4.8 −4.3 −2.6 −2.8 −6.0 −4.4 −5.2 −4.4 −4.5 −4.0 −4.7 −4.1 −2.4
SSAFRICA
−3.8 −4.4 −4.1 −4.5 −4.5 −3.9 −3.9 −4.1 −2.9 −3.8 −3.5 −4.4 −3.7 −4.2 −4.3 −3.6 −3.6 −3.8 −2.7 −3.6
SASIA

−4
−4.1 −4.1 −4.1 −3.6 −4.7 −4.5 −4.2 −3.1 −4.0 −4.1 −4.0 −4.2 −4.0 −3.4 −4.5 −4.5 −4.0 −2.8 −3.8 −3.9
POLY
−4.0 −3.8 −3.9 −4.5 −4.1 −3.7 −3.7 −4.4 −3.7 −4.1 −3.7 −3.3 −3.5 −4.4 −3.7 −3.3 −3.1 −4.3 −3.4 −4.0
NAFRICA
-
−4.2 −4.0 −4.0 −4.6 −4.2 −3.6 −3.8 −4.5 −3.7 −4.2 −3.8 −3.9 −3.6 −4.5 −3.9 −3.2 −3.4 −4.3 −3.5 −4.1 −5
MEAST
−3.9 −3.9 −4.2 −4.2 −3.9 −4.1 −4.2 −4.8 −4.6 −3.8 −3.8 −3.6 −3.9 −4.1 −3.5 −3.7 −3.9 −4.6 −4.3 −3.7
EURO
−4.6 −3.4 −4.3 −2.9 −4.5 −4.7 −4.6 −3.7 −4.6 −4.4 −4.5 −3.2 −4.3 −2.6 −4.5 −4.8 −4.7 −3.4 −4.3 −4.3
−6
EASIA
VERIFICATION
−4.1 −4.2 −3.8 −4.5 −4.3 −4.1 −4.1 −4.3 −4.1 −4.2 −3.7 −3.8 −3.4 −4.3 −4.0 −3.7 −3.7 −4.0 −3.8 −4.0
CSAMERIC
−4.3 −3.2 −4.1 −3.3 −4.0 −4.0 −4.3 −4.0 −4.5 −4.1 −4.0 −2.8 −3.8 −3.1 −3.6 −3.8 −3.9 −4.2 −4.3 −4.1
CASIA
−3.0 −4.6 −4.1 −4.9 −4.4 −4.3 −4.1 −4.2 −4.0 −2.8 −2.7 −4.5 −3.8 −4.7 −4.1 −3.9 −3.8 −4.0 −3.6 −2.6
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 276: For algorithm vcog-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individ-


316
Cross region FMR at threshold T = 71.529 for algorithm vd_001, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.3 −6.0 −5.2 −5.3 −5.1 −5.5 −5.0 −3.2 −3.1 −5.0 −4.7 −5.7 −4.6 −4.9 −5.0 −5.6 −4.5 −2.9
SSAFRICA
−4.2 −4.6 −3.8 −4.8 −4.6 −4.0 −4.1 −4.3 −3.3 −4.7 −3.3 −3.8 −2.9 −4.1 −3.7 −3.1 −3.2 −3.7 −2.8 −4.1
SASIA
−4.5 −4.8 −4.3 −3.9 −5.1 −4.9 −5.1 −3.0 −4.4 −5.2 −3.8 −4.1 −3.4 −3.3 −4.3 −4.0 −4.4 −2.6 −3.9 −4.6
POLY
2019/10/16 12:43:37
−4.6 −4.4 −4.3 −5.9 −4.8 −4.2 −3.9 −5.6 −4.2 −5.1 −3.8 −3.6 −3.4 −5.4 −3.9 −3.4 −3.4 −6.0 −3.2 −4.4
NAFRICA log10 FMR
−4.3 −4.3 −3.8 −5.1 −4.4 −3.8 −3.9 −4.6 −3.9 −5.0 −3.3 −3.5 −2.7 −4.2 −3.4 −2.8 −3.0 −3.7 −2.9 −4.2
MEAST
−4.8 −4.7 −4.4 −5.5 −4.5 −4.6 −4.6 −5.2 −4.8 −5.2 −3.9 −4.0 −3.4 −4.7 −3.8 −3.7 −3.8 −4.4 −4.0 −4.4
EURO
−5.2 −4.2 −4.7 −3.4 −5.3 −5.4 −5.4 −3.9 −5.0 −5.6 −4.3 −3.5 −3.8 −2.8 −4.5 −4.5 −4.6 −3.3 −4.4 −4.8 −1
EASIA
−4.3 −4.4 −3.5 −4.8 −4.4 −4.0 −4.0 −4.2 −4.0 −5.0 −3.3 −3.5 −2.6 −3.9 −3.5 −3.0 −3.1 −3.4 −3.1 −4.3
FRVT
CSAMERIC
-
−5.3 −3.8 −4.5 −4.4 −4.6 −4.4 −4.5 −5.0 −5.0 −6.0 −4.4 −3.4 −3.5 −4.1 −3.8 −3.6 −4.1 −4.4 −4.1 −5.2
CASIA −2
−3.4 −5.3 −4.7 −5.4 −4.8 −4.9 −4.7 −4.9 −4.6 −3.4 −2.7 −4.8 −4.0 −4.7 −4.1 −4.2 −4.1 −4.4 −4.1 −2.9
CARIB

−3.4 −5.7 −5.1 −5.9 −5.0 −5.1 −4.9 −5.3 −4.8 −3.0 −3.0 −4.7 −4.5 −5.5 −4.5 −4.7 −4.7 −5.3 −4.2 −2.7
SSAFRICA
−4.0 −4.6 −3.8 −4.7 −4.5 −3.9 −4.0 −4.2 −3.1 −4.6 −3.2 −3.7 −2.8 −4.0 −3.7 −3.1 −3.2 −3.6 −2.7 −4.0
SASIA

−4
−4.4 −4.6 −4.1 −3.7 −5.0 −4.8 −4.8 −2.8 −4.2 −5.0 −3.8 −3.9 −3.3 −3.2 −4.1 −3.9 −4.2 −2.4 −3.7 −4.5
POLY
−4.4 −4.1 −4.1 −5.6 −4.6 −4.0 −3.6 −5.3 −4.0 −4.9 −3.7 −3.3 −3.3 −5.1 −3.8 −3.3 −3.1 −6.0 −3.2 −4.1
NAFRICA
-
−4.2 −4.2 −3.7 −5.1 −4.3 −3.6 −3.7 −4.5 −3.8 −4.9 −3.2 −3.4 −2.7 −4.2 −3.4 −2.8 −2.9 −3.7 −2.9 −4.1 −5
MEAST
−4.7 −4.5 −4.3 −5.4 −4.3 −4.4 −4.5 −5.1 −4.8 −5.1 −3.8 −3.8 −3.4 −4.6 −3.7 −3.6 −3.8 −4.3 −3.9 −4.4
EURO
−5.1 −4.0 −4.6 −3.2 −5.2 −5.4 −5.3 −3.7 −4.9 −5.4 −4.2 −3.4 −3.7 −2.7 −4.4 −4.5 −4.5 −3.1 −4.3 −4.7
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.7 −4.3 −3.9 −3.9 −4.1 −3.9 −4.8 −3.3 −3.4 −2.5 −3.8 −3.4 −3.0 −3.0 −3.4 −3.1 −4.1
CSAMERIC
−5.2 −3.6 −4.4 −4.2 −4.3 −4.2 −4.2 −4.7 −4.9 −5.9 −4.3 −3.2 −3.4 −3.9 −3.6 −3.5 −3.9 −4.2 −4.0 −4.9
CASIA
−3.3 −5.0 −4.5 −5.3 −4.7 −4.7 −4.5 −4.7 −4.4 −3.3 −2.6 −4.5 −3.9 −4.6 −4.0 −4.1 −3.9 −4.2 −3.9 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 277: For algorithm vd-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


317
Cross region FMR at threshold T = 3.325 for algorithm veridas_001, giving FMR(T) = 0.0001 globally.
−3.8 −6.0 −5.6 −6.0 −5.2 −5.4 −5.2 −6.0 −4.7 −3.6 −3.1 −6.0 −4.9 −5.9 −4.5 −4.8 −4.7 −5.6 −4.3 −3.1
SSAFRICA
−4.1 −4.9 −4.0 −4.9 −4.6 −4.0 −4.0 −4.5 −2.8 −4.5 −3.3 −4.2 −3.1 −4.2 −3.9 −3.2 −3.3 −3.9 −2.5 −4.0
SASIA
−4.8 −4.7 −4.5 −4.0 −5.4 −5.2 −5.0 −3.4 −4.3 −5.7 −4.0 −3.9 −3.7 −3.5 −4.8 −4.4 −4.7 −2.9 −3.8 −5.3
POLY
2019/10/16 12:43:37
−5.0 −5.1 −4.5 −6.0 −5.1 −4.3 −4.1 −6.0 −4.3 −5.5 −4.2 −4.3 −3.6 −5.7 −4.2 −3.5 −3.4 −4.9 −3.6 −4.9
NAFRICA log10 FMR
−4.4 −4.6 −4.0 −5.6 −4.6 −3.8 −4.0 −5.1 −3.8 −5.2 −3.5 −3.9 −3.1 −4.7 −3.7 −3.0 −3.1 −4.2 −3.0 −4.5
MEAST
−4.9 −4.7 −4.5 −5.4 −4.6 −4.6 −4.7 −5.3 −4.8 −5.5 −4.1 −4.0 −3.6 −4.6 −3.9 −3.8 −4.0 −4.4 −4.0 −4.7
EURO
−5.4 −4.0 −4.8 −3.3 −5.3 −5.6 −5.7 −4.0 −4.9 −6.0 −4.6 −3.4 −3.9 −2.7 −4.5 −4.7 −4.9 −3.3 −4.4 −5.3 −1
EASIA
−4.3 −4.6 −3.7 −4.8 −4.6 −4.1 −4.1 −4.4 −4.0 −5.2 −3.4 −3.8 −2.8 −3.8 −3.7 −3.2 −3.2 −3.5 −3.3 −4.5
FRVT
CSAMERIC
-
−5.2 −3.9 −4.7 −4.0 −4.6 −4.7 −4.8 −5.0 −5.2 −6.0 −4.5 −3.4 −3.7 −3.7 −3.7 −3.8 −4.0 −4.7 −4.7 −6.0
CASIA −2
−3.4 −5.3 −4.7 −5.8 −4.8 −4.8 −4.8 −5.2 −4.5 −3.6 −2.6 −5.0 −4.0 −5.2 −4.1 −4.0 −4.2 −4.7 −3.9 −3.0
CARIB

−3.7 −5.7 −5.3 −6.0 −5.1 −5.1 −5.0 −5.7 −4.4 −3.4 −3.0 −6.0 −4.7 −5.8 −4.5 −4.6 −4.5 −5.3 −4.1 −2.9
SSAFRICA
−3.9 −4.7 −3.9 −4.7 −4.5 −3.9 −3.9 −4.3 −2.6 −4.3 −3.2 −4.2 −3.0 −4.1 −3.8 −3.2 −3.2 −3.7 −2.3 −3.8
SASIA

−4
−4.7 −4.5 −4.3 −3.8 −5.2 −5.1 −4.8 −3.2 −4.1 −5.4 −3.9 −3.8 −3.6 −3.3 −4.7 −4.3 −4.5 −2.7 −3.6 −5.3
POLY
−4.7 −4.8 −4.3 −6.0 −4.9 −4.1 −3.8 −5.7 −4.1 −5.3 −3.9 −4.0 −3.4 −5.4 −4.0 −3.3 −3.2 −4.6 −3.4 −4.6
NAFRICA
-
−4.3 −4.5 −3.9 −5.5 −4.5 −3.7 −3.8 −4.9 −3.7 −5.1 −3.4 −3.8 −3.0 −4.8 −3.6 −2.9 −3.0 −4.0 −2.9 −4.3 −5
MEAST
−4.8 −4.5 −4.4 −5.3 −4.4 −4.5 −4.6 −5.2 −4.7 −5.4 −3.9 −3.8 −3.5 −4.5 −3.8 −3.7 −3.9 −4.3 −3.9 −4.7
EURO
−5.3 −3.8 −4.7 −3.1 −5.2 −5.5 −5.6 −3.8 −4.7 −5.9 −4.5 −3.2 −3.8 −2.5 −4.5 −4.6 −4.9 −3.2 −4.2 −5.2
−6
EASIA
VERIFICATION
−4.1 −4.5 −3.6 −4.7 −4.5 −4.0 −4.0 −4.3 −3.9 −5.0 −3.3 −3.7 −2.7 −3.8 −3.6 −3.1 −3.1 −3.5 −3.2 −4.3
CSAMERIC
−4.9 −3.6 −4.5 −3.8 −4.4 −4.5 −4.5 −4.7 −5.0 −5.9 −4.2 −3.2 −3.7 −3.5 −3.6 −3.7 −3.8 −4.4 −4.6 −6.0
CASIA
−3.3 −5.0 −4.5 −5.6 −4.6 −4.6 −4.6 −4.9 −4.2 −3.5 −2.6 −4.7 −3.8 −5.0 −4.0 −3.9 −4.0 −4.4 −3.7 −2.9
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 278: For algorithm veridas-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


318
Cross region FMR at threshold T = 3.389 for algorithm veridas_002, giving FMR(T) = 0.0001 globally.
−4.2 −6.0 −5.8 −6.0 −5.6 −5.6 −5.3 −5.7 −4.8 −3.8 −3.7 −6.0 −5.2 −6.0 −5.0 −5.1 −4.8 −5.1 −4.4 −3.4
SSAFRICA
−4.2 −4.8 −4.2 −4.9 −4.7 −4.0 −4.1 −4.5 −2.6 −4.6 −3.5 −4.2 −3.4 −4.3 −4.1 −3.4 −3.5 −4.0 −2.3 −4.2
SASIA
−4.8 −4.7 −4.6 −4.1 −5.5 −5.3 −5.0 −3.5 −4.2 −5.7 −4.1 −4.0 −3.9 −3.5 −4.8 −4.6 −4.2 −3.1 −3.6 −5.1
POLY
2019/10/16 12:43:37
−4.8 −4.4 −4.5 −5.9 −5.0 −4.2 −3.9 −6.0 −4.1 −5.7 −4.2 −4.0 −3.8 −5.4 −4.6 −3.7 −3.6 −6.0 −3.6 −6.0
NAFRICA log10 FMR
−4.6 −4.4 −4.2 −5.7 −4.6 −3.9 −4.0 −5.3 −3.8 −5.3 −3.7 −3.8 −3.4 −5.0 −3.8 −3.1 −3.3 −4.6 −3.2 −4.6
MEAST
−5.0 −4.5 −4.6 −5.6 −4.5 −4.6 −4.7 −5.6 −4.9 −5.8 −4.4 −4.0 −3.8 −4.8 −3.9 −3.9 −4.1 −4.7 −4.4 −5.3
EURO
−5.6 −4.0 −4.9 −3.3 −5.3 −5.8 −6.0 −4.0 −5.0 −6.0 −4.8 −3.3 −4.0 −2.7 −4.6 −5.0 −5.1 −3.4 −4.5 −5.3 −1
EASIA
−4.4 −4.6 −3.8 −4.9 −4.7 −4.3 −4.3 −4.6 −4.1 −5.4 −3.7 −3.8 −3.0 −4.0 −3.9 −3.5 −3.5 −3.8 −3.5 −4.8
FRVT
CSAMERIC
-
−5.0 −3.8 −4.7 −4.1 −4.5 −4.3 −4.4 −5.1 −5.0 −6.0 −4.3 −3.3 −3.9 −3.8 −3.9 −3.8 −3.9 −4.6 −4.3 −6.0
CASIA −2
−3.8 −4.8 −4.6 −5.9 −4.8 −4.6 −4.6 −5.2 −4.4 −4.1 −3.1 −4.2 −4.0 −5.3 −4.2 −4.0 −3.9 −4.6 −3.9 −3.5
CARIB

−4.0 −6.0 −5.5 −6.0 −5.5 −5.3 −5.0 −5.5 −4.5 −3.6 −3.5 −6.0 −4.9 −6.0 −4.9 −4.8 −4.5 −5.0 −4.2 −3.2
SSAFRICA
−3.9 −4.6 −4.0 −4.7 −4.5 −3.9 −3.9 −4.3 −2.4 −4.4 −3.3 −4.0 −3.3 −4.2 −4.0 −3.3 −3.4 −3.8 −2.1 −4.0
SASIA

−4
−4.6 −4.5 −4.4 −3.9 −5.3 −5.2 −4.8 −3.3 −3.9 −5.5 −4.1 −3.7 −3.7 −3.3 −4.6 −4.5 −3.9 −2.8 −3.4 −5.0
POLY
−4.6 −4.1 −4.2 −5.8 −4.7 −4.0 −3.6 −5.7 −3.9 −5.4 −4.0 −3.7 −3.6 −5.1 −4.3 −3.4 −3.3 −6.0 −3.3 −6.0
NAFRICA
-
−4.3 −4.1 −4.0 −5.6 −4.4 −3.6 −3.7 −5.1 −3.6 −5.0 −3.6 −3.6 −3.2 −5.0 −3.6 −3.0 −3.1 −4.6 −3.0 −4.4 −5
MEAST
−4.8 −4.2 −4.4 −5.5 −4.2 −4.4 −4.5 −5.5 −4.7 −5.6 −4.1 −3.7 −3.7 −4.7 −3.7 −3.8 −3.9 −4.7 −4.3 −5.1
EURO
−5.4 −3.8 −4.8 −3.1 −5.2 −5.6 −6.0 −3.8 −4.8 −5.8 −4.7 −3.2 −3.9 −2.6 −4.5 −4.9 −5.1 −3.2 −4.4 −5.1
−6
EASIA
VERIFICATION
−4.2 −4.4 −3.7 −4.8 −4.5 −4.1 −4.1 −4.4 −3.9 −5.1 −3.5 −3.7 −2.9 −4.0 −3.8 −3.4 −3.3 −3.7 −3.3 −4.5
CSAMERIC
−4.7 −3.5 −4.5 −3.9 −4.2 −4.1 −4.1 −4.9 −4.7 −6.0 −4.0 −3.1 −3.7 −3.5 −3.6 −3.6 −3.6 −4.3 −4.1 −6.0
CASIA
−3.6 −4.5 −4.3 −5.6 −4.5 −4.4 −4.3 −4.9 −4.1 −3.9 −3.0 −3.9 −3.7 −5.0 −4.0 −3.7 −3.6 −4.3 −3.6 −3.4
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 279: For algorithm veridas-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


319
Cross region FMR at threshold T = 2.859 for algorithm via_000, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.3 −5.8 −5.1 −5.4 −5.2 −5.3 −5.0 −3.2 −3.2 −6.0 −4.8 −5.6 −4.6 −5.0 −5.3 −5.2 −4.5 −2.9
SSAFRICA
−4.2 −4.7 −4.0 −4.8 −4.7 −4.1 −4.2 −4.4 −3.4 −4.8 −3.4 −3.9 −3.0 −4.0 −3.8 −3.3 −3.4 −3.7 −2.8 −4.1
SASIA
−4.6 −4.8 −4.1 −3.8 −5.0 −4.8 −5.2 −3.0 −4.3 −5.1 −3.9 −4.1 −3.3 −3.2 −4.2 −3.9 −4.4 −2.6 −3.7 −4.7
POLY
2019/10/16 12:43:37
−4.7 −4.5 −4.3 −5.7 −5.0 −4.2 −4.0 −5.3 −4.4 −6.0 −4.0 −3.7 −3.6 −5.7 −4.4 −3.6 −3.6 −6.0 −3.6 −6.0
NAFRICA log10 FMR
−4.4 −4.5 −3.9 −5.2 −4.5 −3.8 −4.0 −4.6 −4.0 −5.2 −3.5 −3.7 −2.9 −4.3 −3.5 −2.9 −3.1 −3.8 −3.1 −4.4
MEAST
−4.7 −4.6 −4.3 −5.4 −4.5 −4.5 −4.6 −5.1 −4.8 −5.2 −3.9 −4.0 −3.4 −4.5 −3.8 −3.7 −3.8 −4.3 −4.0 −4.5
EURO
−5.1 −4.2 −4.7 −3.3 −5.3 −5.4 −5.5 −3.8 −5.0 −5.4 −4.2 −3.5 −3.7 −2.7 −4.4 −4.5 −4.8 −3.2 −4.3 −4.7 −1
EASIA
−4.2 −4.4 −3.5 −4.7 −4.4 −4.0 −4.1 −4.2 −4.1 −4.9 −3.3 −3.6 −2.6 −3.8 −3.5 −3.1 −3.2 −3.4 −3.2 −4.2
FRVT
CSAMERIC
-
−5.1 −3.8 −4.3 −4.3 −4.5 −4.3 −4.4 −4.8 −4.8 −5.9 −4.1 −3.4 −3.3 −4.0 −3.6 −3.4 −3.8 −4.6 −3.9 −4.9
CASIA −2
−3.4 −5.3 −4.6 −5.4 −4.8 −4.9 −4.7 −4.8 −4.6 −3.5 −2.7 −4.8 −3.9 −4.7 −4.1 −4.1 −4.2 −4.3 −4.1 −2.9
CARIB

−3.4 −6.0 −5.1 −5.6 −4.9 −5.2 −4.9 −5.0 −4.7 −3.0 −3.0 −6.0 −4.6 −5.3 −4.5 −4.8 −5.0 −4.9 −4.3 −2.7
SSAFRICA
−4.1 −4.7 −3.9 −4.7 −4.6 −4.1 −4.1 −4.2 −3.2 −4.7 −3.3 −3.9 −2.9 −4.0 −3.8 −3.3 −3.4 −3.6 −2.7 −4.1
SASIA

−4
−4.4 −4.5 −4.0 −3.6 −4.9 −4.7 −4.9 −2.8 −4.1 −4.9 −3.8 −3.9 −3.2 −3.1 −4.0 −3.8 −4.2 −2.4 −3.6 −4.5
POLY
−4.4 −4.2 −4.1 −5.5 −4.7 −3.9 −3.7 −5.0 −4.2 −5.7 −3.7 −3.4 −3.4 −5.4 −4.2 −3.3 −3.3 −6.0 −3.5 −6.0
NAFRICA
-
−4.3 −4.3 −3.8 −5.1 −4.4 −3.7 −3.8 −4.5 −3.9 −5.1 −3.4 −3.6 −2.8 −4.3 −3.5 −2.8 −2.9 −3.7 −3.0 −4.3 −5
MEAST
−4.6 −4.3 −4.2 −5.3 −4.3 −4.4 −4.5 −5.0 −4.7 −5.1 −3.8 −3.8 −3.4 −4.4 −3.6 −3.6 −3.8 −4.3 −3.9 −4.5
EURO
−5.0 −4.0 −4.5 −3.2 −5.2 −5.3 −5.3 −3.6 −4.8 −5.2 −4.1 −3.4 −3.7 −2.6 −4.3 −4.4 −4.7 −3.1 −4.2 −4.6
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.6 −4.3 −3.9 −3.9 −4.0 −3.9 −4.8 −3.2 −3.5 −2.5 −3.7 −3.5 −3.1 −3.1 −3.3 −3.1 −4.0
CSAMERIC
−4.9 −3.5 −4.2 −4.1 −4.2 −4.1 −4.2 −4.5 −4.6 −5.9 −4.0 −3.1 −3.2 −3.7 −3.5 −3.3 −3.8 −4.3 −3.8 −4.9
CASIA
−3.3 −5.0 −4.4 −5.2 −4.6 −4.6 −4.5 −4.5 −4.3 −3.2 −2.6 −4.5 −3.7 −4.7 −4.0 −4.0 −4.1 −4.1 −3.9 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 280: For algorithm via-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


320
Cross region FMR at threshold T = 0.842 for algorithm videonetics_001, giving FMR(T) = 0.0001 globally.
−3.8 −6.0 −5.9 −6.0 −5.4 −6.0 −6.0 −6.0 −6.0 −3.3 −3.4 −6.0 −5.6 −6.0 −4.9 −5.3 −5.3 −6.0 −6.0 −3.0
SSAFRICA
−5.2 −5.5 −5.0 −5.0 −5.5 −5.1 −5.2 −5.6 −4.4 −5.9 −4.2 −4.9 −3.9 −4.7 −4.6 −4.2 −4.2 −5.1 −3.8 −5.1
SASIA
−5.9 −5.0 −5.4 −3.8 −6.0 −5.9 −6.0 −3.8 −5.7 −6.0 −5.1 −5.0 −4.6 −3.5 −5.3 −5.1 −6.0 −3.5 −5.3 −6.0
POLY
2019/10/16 12:43:37
−5.9 −6.0 −5.7 −6.0 −6.0 −6.0 −6.0 −6.0 −5.4 −6.0 −4.7 −6.0 −4.7 −6.0 −5.2 −5.1 −6.0 −6.0 −4.5 −6.0
NAFRICA log10 FMR
−5.7 −5.9 −4.8 −5.4 −5.2 −4.9 −5.2 −5.5 −5.0 −6.0 −4.6 −4.8 −3.7 −4.4 −4.2 −3.8 −4.3 −4.6 −4.1 −5.4
MEAST
−5.4 −5.7 −5.3 −5.3 −5.4 −5.6 −6.0 −6.0 −6.0 −5.3 −4.5 −4.9 −4.3 −4.7 −4.5 −4.6 −5.3 −5.2 −5.1 −4.6
EURO
−5.9 −3.7 −4.9 −2.7 −5.0 −5.7 −6.0 −3.8 −5.2 −5.7 −5.2 −3.3 −4.2 −2.3 −4.5 −5.0 −6.0 −3.3 −4.7 −5.1 −1
EASIA
−5.2 −5.1 −4.5 −4.9 −5.1 −4.9 −5.2 −5.1 −5.1 −5.6 −4.1 −4.2 −3.4 −4.1 −4.1 −3.8 −4.1 −4.2 −4.1 −5.1
FRVT
CSAMERIC
-
−5.9 −4.1 −5.0 −3.6 −5.0 −5.1 −5.1 −4.8 −5.9 −6.0 −4.8 −3.7 −3.9 −3.5 −4.0 −4.2 −4.4 −4.7 −5.1 −6.0
CASIA −2
−3.8 −6.0 −5.9 −6.0 −5.4 −5.8 −5.5 −6.0 −5.8 −3.7 −3.2 −6.0 −5.3 −5.7 −4.8 −4.8 −4.7 −5.9 −5.2 −3.2
CARIB

−3.6 −6.0 −5.7 −6.0 −5.2 −5.9 −5.7 −6.0 −6.0 −3.0 −3.2 −6.0 −5.4 −6.0 −4.8 −5.2 −5.0 −6.0 −6.0 −2.8
SSAFRICA
−5.1 −5.3 −4.9 −4.8 −5.5 −5.1 −5.2 −5.4 −4.2 −5.8 −4.1 −4.9 −3.9 −4.5 −4.6 −4.2 −4.3 −4.9 −3.7 −5.1
SASIA

−4
−5.8 −4.8 −5.3 −3.6 −5.9 −5.8 −6.0 −3.6 −5.5 −6.0 −5.1 −4.7 −4.5 −3.3 −5.2 −4.9 −6.0 −3.2 −5.1 −6.0
POLY
−5.9 −6.0 −5.7 −6.0 −6.0 −6.0 −6.0 −6.0 −5.3 −6.0 −4.7 −6.0 −4.6 −6.0 −5.2 −6.0 −6.0 −6.0 −4.6 −6.0
NAFRICA
-
−5.6 −5.9 −4.7 −5.3 −5.2 −4.8 −5.1 −5.4 −5.0 −6.0 −4.6 −4.8 −3.6 −4.4 −4.1 −3.8 −4.2 −4.5 −4.1 −6.0 −5
MEAST
−5.4 −5.5 −5.3 −5.2 −5.4 −5.6 −6.0 −5.9 −6.0 −5.2 −4.5 −4.7 −4.3 −4.6 −4.5 −4.6 −5.1 −5.2 −5.1 −4.6
EURO
−5.7 −3.5 −4.8 −2.6 −4.9 −5.6 −6.0 −3.6 −5.0 −5.6 −4.9 −3.1 −4.1 −2.2 −4.4 −5.1 −6.0 −3.2 −4.6 −5.0
−6
EASIA
VERIFICATION
−5.1 −5.1 −4.4 −4.8 −5.1 −4.9 −5.1 −5.1 −5.0 −5.4 −4.1 −4.2 −3.4 −4.0 −4.1 −3.8 −4.1 −4.1 −4.0 −5.1
CSAMERIC
−5.8 −3.8 −4.9 −3.4 −5.0 −5.1 −4.9 −4.6 −5.6 −6.0 −4.7 −3.4 −3.9 −3.3 −4.0 −4.2 −4.4 −4.4 −5.0 −6.0
CASIA
−3.7 −6.0 −5.7 −6.0 −5.2 −5.6 −5.4 −6.0 −5.6 −3.5 −3.1 −6.0 −5.1 −5.5 −4.7 −4.7 −4.7 −5.6 −5.0 −3.1
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 281: For algorithm videonetics-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


321
Cross region FMR at threshold T = 3.057 for algorithm vigilantsolutions_006, giving FMR(T) = 0.0001 globally.
−4.4 −6.0 −5.9 −6.0 −5.7 −6.0 −5.9 −6.0 −5.7 −4.0 −3.6 −6.0 −5.1 −5.8 −4.9 −5.3 −5.0 −5.9 −5.0 −3.5
SSAFRICA
−3.9 −4.6 −3.6 −4.7 −4.2 −3.8 −4.1 −4.5 −3.5 −4.4 −2.9 −3.6 −2.6 −3.7 −3.2 −2.8 −3.1 −3.6 −2.9 −3.5
SASIA
−4.5 −4.9 −4.1 −4.2 −4.8 −4.5 −4.8 −3.5 −4.5 −5.3 −3.5 −4.1 −3.1 −3.5 −3.8 −3.4 −3.7 −3.0 −3.6 −4.3
POLY
2019/10/16 12:43:37
−5.7 −5.0 −5.2 −6.0 −5.8 −4.9 −4.7 −6.0 −5.0 −6.0 −4.7 −3.9 −4.5 −6.0 −5.2 −4.1 −4.0 −6.0 −4.0 −4.9
NAFRICA log10 FMR
−3.9 −4.5 −3.5 −4.7 −4.1 −3.7 −3.9 −4.6 −3.8 −4.4 −2.7 −3.5 −2.4 −3.6 −3.0 −2.6 −2.9 −3.5 −2.7 −3.4
MEAST
−4.4 −4.8 −4.0 −5.1 −4.5 −4.2 −4.5 −5.1 −4.5 −4.9 −3.3 −3.9 −3.0 −4.1 −3.5 −3.2 −3.5 −4.1 −3.5 −3.9
EURO
−5.0 −4.4 −4.6 −3.6 −5.1 −5.0 −5.2 −4.1 −5.0 −5.6 −3.9 −3.6 −3.5 −3.0 −4.1 −3.9 −4.2 −3.4 −4.1 −4.6 −1
EASIA
−4.0 −4.5 −3.5 −4.5 −4.2 −3.8 −4.1 −4.4 −4.0 −4.6 −2.9 −3.4 −2.4 −3.5 −3.1 −2.8 −3.0 −3.4 −3.0 −3.5
FRVT
CSAMERIC
-
−4.2 −4.1 −3.9 −4.5 −4.3 −4.0 −4.3 −4.9 −4.3 −4.7 −3.1 −3.6 −2.8 −3.8 −3.3 −3.0 −3.3 −4.0 −3.2 −3.6
CASIA −2
−3.8 −5.3 −4.1 −5.2 −4.6 −4.3 −4.6 −5.2 −4.5 −4.0 −2.9 −4.2 −3.0 −4.2 −3.5 −3.2 −3.5 −4.2 −3.5 −3.2
CARIB

−4.2 −6.0 −5.8 −6.0 −5.7 −5.9 −6.0 −6.0 −5.5 −3.8 −3.5 −6.0 −5.1 −5.6 −4.9 −5.4 −6.0 −5.6 −4.9 −3.3
SSAFRICA
−3.9 −4.5 −3.6 −4.6 −4.2 −3.8 −4.1 −4.4 −3.4 −4.4 −2.8 −3.6 −2.6 −3.7 −3.2 −2.8 −3.1 −3.6 −2.8 −3.5
SASIA

−4
−4.4 −4.8 −4.1 −4.0 −4.7 −4.5 −4.8 −3.2 −4.4 −5.2 −3.4 −4.0 −3.0 −3.4 −3.7 −3.4 −3.9 −2.8 −3.6 −4.2
POLY
−5.4 −4.7 −5.0 −6.0 −5.6 −4.7 −4.4 −6.0 −4.9 −5.7 −4.4 −3.6 −4.3 −6.0 −5.2 −4.0 −3.8 −6.0 −3.9 −4.6
NAFRICA
-
−3.8 −4.4 −3.5 −4.7 −4.0 −3.6 −3.9 −4.5 −3.7 −4.4 −2.7 −3.4 −2.4 −3.6 −3.0 −2.6 −2.9 −3.5 −2.7 −3.3 −5
MEAST
−4.3 −4.7 −4.0 −5.1 −4.4 −4.2 −4.5 −5.0 −4.5 −4.9 −3.3 −3.9 −2.9 −4.1 −3.5 −3.2 −3.5 −4.1 −3.5 −3.9
EURO
−4.9 −4.3 −4.5 −3.5 −5.1 −5.0 −5.3 −4.0 −5.0 −5.5 −3.9 −3.5 −3.5 −2.8 −4.1 −3.9 −4.2 −3.3 −4.1 −4.5
−6
EASIA
VERIFICATION
−4.0 −4.4 −3.5 −4.5 −4.2 −3.8 −4.1 −4.3 −4.0 −4.6 −2.9 −3.4 −2.4 −3.5 −3.1 −2.8 −3.0 −3.3 −3.0 −3.6
CSAMERIC
−4.1 −3.9 −3.8 −4.3 −4.2 −4.0 −4.3 −5.0 −4.3 −4.6 −3.0 −3.4 −2.7 −3.6 −3.2 −2.9 −3.4 −4.1 −3.2 −3.5
CASIA
−3.8 −5.3 −4.1 −5.2 −4.6 −4.3 −4.5 −5.1 −4.5 −3.9 −2.9 −4.3 −3.0 −4.2 −3.5 −3.2 −3.5 −4.2 −3.4 −3.2
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 282: For algorithm vigilantsolutions-006 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from


322
Cross region FMR at threshold T = 2.926 for algorithm vigilantsolutions_007, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.3 −5.7 −5.1 −5.3 −5.0 −5.3 −4.9 −3.2 −3.1 −6.0 −4.8 −5.4 −4.7 −5.0 −4.7 −5.0 −4.5 −2.9
SSAFRICA
−4.2 −4.7 −4.1 −4.8 −4.8 −4.1 −4.1 −4.3 −3.0 −4.6 −3.4 −4.1 −3.2 −4.2 −4.0 −3.4 −3.5 −3.8 −2.6 −4.1
SASIA
−4.4 −4.3 −4.2 −3.6 −5.1 −4.9 −5.0 −2.8 −4.1 −5.1 −3.9 −4.1 −3.5 −3.2 −4.4 −4.2 −4.4 −2.5 −3.7 −4.7
POLY
2019/10/16 12:43:37
−4.6 −4.3 −4.3 −5.6 −4.8 −4.0 −3.8 −5.1 −4.2 −4.9 −4.2 −3.4 −3.7 −4.9 −4.2 −3.4 −3.2 −4.9 −3.6 −4.4
NAFRICA log10 FMR
−4.5 −4.4 −4.0 −5.3 −4.5 −3.7 −3.8 −4.7 −3.9 −5.0 −3.6 −3.8 −3.1 −4.6 −3.7 −3.0 −3.1 −4.0 −3.1 −4.5
MEAST
−5.0 −4.5 −4.6 −5.5 −4.4 −4.6 −4.7 −5.3 −4.9 −5.3 −4.2 −4.0 −3.8 −4.9 −3.9 −3.9 −4.2 −4.6 −4.2 −4.7
EURO
−5.2 −4.0 −4.8 −3.2 −5.4 −5.6 −5.7 −3.6 −4.9 −5.7 −4.5 −3.5 −4.0 −2.7 −4.7 −4.8 −4.9 −3.2 −4.4 −5.0 −1
EASIA
−4.3 −4.5 −3.7 −4.9 −4.6 −4.2 −4.2 −4.3 −4.2 −5.1 −3.5 −3.8 −2.8 −4.1 −3.9 −3.4 −3.4 −3.6 −3.4 −4.4
FRVT
CSAMERIC
-
−5.8 −3.5 −4.7 −3.9 −4.5 −4.3 −4.4 −4.6 −4.9 −6.0 −5.0 −3.1 −3.9 −3.6 −3.9 −3.8 −4.1 −4.2 −4.3 −5.2
CASIA −2
−3.4 −5.3 −4.6 −5.4 −4.9 −4.7 −4.5 −4.7 −4.5 −3.5 −2.8 −5.0 −4.0 −4.8 −4.2 −4.1 −3.9 −4.2 −3.9 −3.0
CARIB

−3.4 −6.0 −5.0 −5.5 −4.9 −5.0 −4.8 −5.1 −4.6 −3.0 −2.9 −6.0 −4.6 −5.2 −4.5 −4.7 −4.4 −4.8 −4.3 −2.6
SSAFRICA
−4.0 −4.5 −4.0 −4.6 −4.6 −3.9 −3.9 −4.1 −2.7 −4.4 −3.3 −3.9 −3.2 −4.0 −4.0 −3.3 −3.4 −3.7 −2.4 −3.9
SASIA

−4
−4.2 −4.1 −4.0 −3.3 −4.9 −4.8 −4.8 −2.5 −3.9 −4.9 −3.7 −3.9 −3.4 −3.0 −4.2 −4.1 −4.2 −2.2 −3.4 −4.5
POLY
−4.3 −4.0 −4.0 −5.4 −4.5 −3.8 −3.5 −4.9 −3.9 −4.6 −3.9 −3.1 −3.4 −4.6 −3.9 −3.2 −2.9 −4.6 −3.4 −4.3
NAFRICA
-
−4.3 −4.1 −3.9 −5.1 −4.3 −3.5 −3.6 −4.6 −3.7 −4.8 −3.5 −3.5 −3.0 −4.5 −3.6 −2.9 −2.9 −4.0 −3.0 −4.4 −5
MEAST
−4.8 −4.2 −4.4 −5.3 −4.2 −4.4 −4.5 −5.1 −4.7 −5.1 −4.1 −3.8 −3.7 −4.7 −3.6 −3.8 −4.1 −4.4 −4.1 −4.5
EURO
−5.0 −3.7 −4.6 −3.0 −5.2 −5.4 −5.4 −3.4 −4.7 −5.5 −4.4 −3.3 −3.9 −2.5 −4.6 −4.7 −4.7 −3.0 −4.2 −4.9
−6
EASIA
VERIFICATION
−4.2 −4.3 −3.5 −4.7 −4.4 −4.1 −4.0 −4.1 −4.0 −4.9 −3.4 −3.7 −2.7 −4.0 −3.7 −3.3 −3.3 −3.5 −3.3 −4.2
CSAMERIC
−5.6 −3.3 −4.4 −3.7 −4.2 −4.0 −4.1 −4.4 −4.6 −5.9 −5.0 −2.8 −3.7 −3.3 −3.7 −3.6 −3.9 −3.9 −4.1 −4.9
CASIA
−3.2 −5.0 −4.3 −5.1 −4.6 −4.5 −4.3 −4.4 −4.2 −3.2 −2.6 −4.7 −3.7 −4.7 −4.1 −3.9 −3.7 −4.0 −3.7 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 283: For algorithm vigilantsolutions-007 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from


323
Cross region FMR at threshold T = 0.432 for algorithm vion_000, giving FMR(T) = 0.0001 globally.
−3.7 −6.0 −5.5 −6.0 −5.2 −5.5 −5.3 −5.5 −5.1 −3.4 −3.2 −6.0 −4.9 −5.8 −4.7 −5.1 −5.3 −5.6 −4.5 −3.0
SSAFRICA
−4.2 −4.6 −3.8 −4.8 −4.5 −4.0 −4.0 −4.3 −3.3 −4.8 −3.3 −3.7 −2.8 −4.0 −3.6 −3.1 −3.2 −3.6 −2.8 −4.0
SASIA
−4.6 −4.8 −4.2 −3.9 −5.2 −4.9 −5.0 −3.1 −4.4 −5.1 −3.9 −4.1 −3.4 −3.3 −4.3 −4.1 −4.3 −2.7 −3.8 −4.6
POLY
2019/10/16 12:43:37
−4.7 −4.6 −4.4 −5.9 −4.9 −4.2 −3.9 −5.3 −4.4 −5.4 −3.9 −3.7 −3.6 −5.7 −4.2 −3.5 −3.6 −4.9 −3.4 −4.9
NAFRICA log10 FMR
−4.3 −4.4 −3.7 −5.1 −4.4 −3.7 −3.9 −4.5 −3.8 −5.2 −3.3 −3.5 −2.7 −4.2 −3.4 −2.8 −2.9 −3.6 −2.9 −4.4
MEAST
−4.8 −4.7 −4.3 −5.6 −4.5 −4.5 −4.6 −5.2 −4.7 −5.5 −4.0 −3.9 −3.4 −4.8 −3.8 −3.6 −3.8 −4.4 −3.9 −4.7
EURO
−5.3 −4.3 −4.7 −3.5 −5.3 −5.5 −5.5 −3.9 −5.0 −5.7 −4.4 −3.6 −3.8 −2.8 −4.5 −4.5 −4.6 −3.3 −4.3 −4.9 −1
EASIA
−4.2 −4.4 −3.4 −4.8 −4.4 −4.0 −4.0 −4.2 −4.0 −5.0 −3.3 −3.5 −2.5 −3.8 −3.5 −3.0 −3.1 −3.4 −3.1 −4.2
FRVT
CSAMERIC
-
−5.4 −3.9 −4.4 −4.5 −4.5 −4.4 −4.5 −5.1 −5.1 −6.0 −4.5 −3.5 −3.4 −4.2 −3.7 −3.5 −3.8 −4.6 −4.3 −5.2
CASIA −2
−3.4 −5.7 −4.8 −5.6 −4.8 −5.0 −4.8 −5.0 −4.7 −3.5 −2.7 −5.0 −4.1 −4.9 −4.1 −4.2 −4.2 −4.5 −4.2 −2.9
CARIB

−3.5 −6.0 −5.2 −5.8 −5.0 −5.3 −5.0 −5.3 −4.8 −3.1 −3.0 −6.0 −4.7 −5.6 −4.6 −4.9 −5.0 −5.3 −4.3 −2.8
SSAFRICA
−4.0 −4.5 −3.7 −4.7 −4.5 −3.9 −4.0 −4.2 −3.2 −4.6 −3.2 −3.6 −2.8 −3.9 −3.6 −3.1 −3.2 −3.5 −2.7 −4.0
SASIA

−4
−4.4 −4.5 −4.1 −3.7 −5.0 −4.8 −4.8 −2.9 −4.2 −5.0 −3.9 −3.9 −3.3 −3.2 −4.2 −4.0 −4.1 −2.5 −3.7 −4.5
POLY
−4.5 −4.4 −4.1 −5.6 −4.8 −4.0 −3.7 −5.0 −4.2 −5.1 −3.8 −3.4 −3.4 −5.4 −4.0 −3.4 −3.3 −4.6 −3.4 −4.6
NAFRICA
-
−4.2 −4.3 −3.6 −5.1 −4.3 −3.6 −3.7 −4.5 −3.7 −5.2 −3.2 −3.5 −2.6 −4.2 −3.3 −2.7 −2.9 −3.6 −2.8 −4.4 −5
MEAST
−4.7 −4.4 −4.3 −5.5 −4.3 −4.4 −4.5 −5.1 −4.7 −5.3 −3.9 −3.8 −3.3 −4.7 −3.7 −3.5 −3.7 −4.3 −3.8 −4.5
EURO
−5.2 −4.1 −4.6 −3.3 −5.2 −5.4 −5.4 −3.7 −4.9 −5.5 −4.4 −3.5 −3.7 −2.7 −4.4 −4.5 −4.5 −3.1 −4.2 −4.9
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.6 −4.3 −3.9 −3.9 −4.1 −3.9 −4.8 −3.2 −3.4 −2.5 −3.7 −3.4 −3.0 −3.0 −3.3 −3.0 −4.1
CSAMERIC
−5.3 −3.6 −4.3 −4.3 −4.4 −4.2 −4.3 −4.8 −5.0 −6.0 −4.4 −3.2 −3.3 −3.9 −3.5 −3.4 −3.9 −4.3 −4.2 −6.0
CASIA
−3.3 −5.4 −4.6 −5.5 −4.7 −4.8 −4.6 −4.7 −4.5 −3.3 −2.6 −4.7 −3.9 −4.8 −4.0 −4.1 −4.1 −4.2 −4.0 −2.8
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 284: For algorithm vion-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individ-


324
Cross region FMR at threshold T = 0.433 for algorithm visionbox_000, giving FMR(T) = 0.0001 globally.
−3.6 −6.0 −5.3 −6.0 −5.0 −5.3 −5.4 −5.4 −5.0 −3.2 −3.0 −5.3 −4.7 −5.6 −4.5 −4.9 −6.0 −5.2 −4.5 −2.8
SSAFRICA
−4.1 −4.6 −3.8 −4.9 −4.6 −4.0 −4.1 −4.3 −3.2 −4.7 −3.2 −3.8 −2.9 −4.1 −3.7 −3.1 −3.2 −3.6 −2.7 −4.0
SASIA
−4.6 −4.8 −4.3 −3.9 −5.2 −4.9 −5.2 −3.1 −4.3 −5.0 −3.9 −4.1 −3.4 −3.4 −4.4 −4.1 −4.4 −2.7 −3.7 −4.4
POLY
2019/10/16 12:43:37
−4.7 −4.8 −4.3 −5.7 −4.9 −4.3 −4.1 −5.6 −4.2 −5.7 −4.2 −3.9 −3.5 −5.0 −4.1 −3.5 −3.6 −6.0 −3.3 −4.9
NAFRICA log10 FMR
−4.3 −4.4 −3.8 −5.2 −4.4 −3.8 −3.9 −4.6 −3.8 −5.1 −3.3 −3.6 −2.8 −4.3 −3.5 −2.9 −2.9 −3.7 −2.8 −4.2
MEAST
−4.9 −4.7 −4.4 −5.6 −4.5 −4.5 −4.6 −5.3 −4.7 −5.4 −4.0 −4.0 −3.4 −4.8 −3.8 −3.7 −3.8 −4.5 −3.8 −4.6
EURO
−5.3 −4.2 −4.7 −3.4 −5.3 −5.4 −5.5 −3.9 −5.0 −5.7 −4.4 −3.6 −3.8 −2.8 −4.5 −4.5 −4.6 −3.2 −4.3 −4.9 −1
EASIA
−4.2 −4.4 −3.5 −4.8 −4.4 −4.0 −4.0 −4.3 −4.0 −4.9 −3.3 −3.5 −2.6 −3.9 −3.5 −3.1 −3.1 −3.4 −3.1 −4.2
FRVT
CSAMERIC
-
−5.4 −3.9 −4.5 −4.5 −4.6 −4.4 −4.6 −4.9 −5.1 −6.0 −4.4 −3.6 −3.5 −4.1 −3.8 −3.6 −3.9 −4.5 −4.3 −5.2
CASIA −2
−3.3 −5.4 −4.6 −5.4 −4.7 −4.9 −4.7 −4.8 −4.6 −3.4 −2.6 −4.6 −3.9 −4.6 −4.0 −4.1 −4.1 −4.4 −4.0 −2.8
CARIB

−3.4 −6.0 −5.0 −5.7 −4.9 −5.1 −5.1 −5.2 −4.7 −3.0 −2.9 −5.0 −4.5 −5.3 −4.4 −4.7 −6.0 −5.0 −4.2 −2.6
SSAFRICA
−4.0 −4.6 −3.8 −4.7 −4.5 −3.9 −4.0 −4.2 −3.1 −4.6 −3.2 −3.7 −2.8 −4.0 −3.7 −3.1 −3.2 −3.6 −2.6 −3.9
SASIA

−4
−4.4 −4.7 −4.1 −3.7 −5.1 −4.8 −5.2 −2.9 −4.1 −4.8 −3.8 −4.0 −3.3 −3.2 −4.2 −3.9 −4.5 −2.5 −3.6 −4.2
POLY
−4.6 −4.7 −4.1 −5.4 −4.6 −4.0 −3.8 −5.3 −4.1 −5.4 −4.1 −3.6 −3.3 −4.7 −3.9 −3.3 −3.3 −6.0 −3.3 −4.6
NAFRICA
-
−4.2 −4.2 −3.7 −5.1 −4.3 −3.6 −3.7 −4.5 −3.7 −4.9 −3.2 −3.5 −2.7 −4.2 −3.4 −2.8 −2.9 −3.6 −2.8 −4.1 −5
MEAST
−4.7 −4.5 −4.3 −5.5 −4.3 −4.4 −4.5 −5.2 −4.6 −5.2 −3.9 −3.9 −3.4 −4.7 −3.7 −3.6 −3.8 −4.4 −3.8 −4.6
EURO
−5.1 −4.1 −4.6 −3.3 −5.2 −5.4 −5.4 −3.7 −4.9 −5.5 −4.3 −3.5 −3.7 −2.7 −4.4 −4.5 −4.4 −3.1 −4.2 −4.8
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.7 −4.3 −3.9 −3.9 −4.1 −3.9 −4.8 −3.2 −3.5 −2.5 −3.8 −3.5 −3.0 −3.0 −3.4 −3.0 −4.1
CSAMERIC
−5.2 −3.6 −4.3 −4.2 −4.4 −4.2 −4.5 −4.6 −4.9 −6.0 −4.3 −3.5 −3.4 −3.9 −3.7 −3.5 −3.9 −4.2 −4.2 −6.0
CASIA
−3.2 −5.1 −4.4 −5.2 −4.6 −4.7 −4.5 −4.6 −4.3 −3.2 −2.5 −4.3 −3.8 −4.5 −3.9 −3.9 −3.9 −4.2 −3.8 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 285: For algorithm visionbox-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


325
Cross region FMR at threshold T = 0.382 for algorithm visionbox_001, giving FMR(T) = 0.0001 globally.
−3.5 −6.0 −5.3 −5.8 −4.9 −5.3 −5.0 −5.4 −5.0 −3.1 −3.0 −6.0 −4.8 −5.5 −4.4 −4.8 −5.3 −5.1 −4.6 −2.8
SSAFRICA
−4.2 −4.7 −3.9 −4.9 −4.6 −4.0 −4.1 −4.4 −3.2 −4.7 −3.3 −4.0 −3.0 −4.1 −3.8 −3.2 −3.3 −3.8 −2.7 −4.1
SASIA
−4.6 −4.6 −4.2 −3.8 −5.2 −5.1 −5.1 −2.9 −4.4 −5.1 −4.1 −3.9 −3.5 −3.3 −4.4 −4.4 −4.4 −2.6 −3.9 −4.7
POLY
2019/10/16 12:43:37
−4.6 −4.7 −4.2 −5.8 −4.9 −4.0 −3.9 −5.4 −4.3 −5.1 −4.3 −3.9 −3.5 −5.2 −4.3 −3.4 −3.6 −6.0 −3.8 −4.6
NAFRICA log10 FMR
−4.4 −4.5 −3.9 −5.2 −4.5 −3.7 −3.9 −4.7 −3.8 −5.0 −3.4 −3.8 −2.9 −4.4 −3.6 −2.8 −3.0 −3.9 −2.9 −4.3
MEAST
−4.9 −4.6 −4.5 −5.6 −4.5 −4.6 −4.7 −5.3 −4.8 −5.3 −4.2 −3.9 −3.7 −4.9 −3.9 −3.8 −4.0 −4.6 −4.0 −4.7
EURO
−5.3 −4.2 −4.7 −3.4 −5.3 −5.6 −5.7 −3.8 −5.0 −5.6 −4.5 −3.5 −3.9 −2.8 −4.5 −4.7 −4.9 −3.3 −4.5 −5.0 −1
EASIA
−4.3 −4.4 −3.5 −4.8 −4.5 −4.1 −4.1 −4.3 −4.1 −5.0 −3.5 −3.7 −2.6 −4.0 −3.7 −3.2 −3.3 −3.6 −3.3 −4.3
FRVT
CSAMERIC
-
−5.3 −3.7 −4.3 −4.4 −4.5 −4.3 −4.4 −4.8 −5.0 −6.0 −4.5 −3.2 −3.4 −4.0 −3.7 −3.5 −3.8 −4.4 −4.1 −6.0
CASIA −2
−3.4 −5.3 −4.6 −5.5 −4.8 −4.9 −4.7 −4.8 −4.6 −3.4 −2.7 −5.3 −4.0 −4.9 −4.1 −4.2 −4.1 −4.4 −4.2 −2.8
CARIB

−3.3 −6.0 −5.0 −5.5 −4.8 −5.1 −4.8 −5.1 −4.7 −2.9 −2.8 −6.0 −4.6 −5.2 −4.2 −4.6 −5.0 −4.9 −4.3 −2.6
SSAFRICA
−4.0 −4.6 −3.8 −4.7 −4.5 −3.9 −4.0 −4.2 −3.0 −4.6 −3.2 −3.9 −3.0 −4.1 −3.8 −3.2 −3.3 −3.7 −2.6 −4.0
SASIA

−4
−4.4 −4.3 −4.1 −3.5 −5.0 −4.9 −4.8 −2.7 −4.2 −4.9 −4.0 −3.7 −3.4 −3.1 −4.3 −4.2 −4.2 −2.3 −3.7 −4.4
POLY
−4.4 −4.4 −3.9 −5.6 −4.6 −3.8 −3.6 −5.1 −4.1 −4.9 −4.0 −3.6 −3.3 −5.1 −4.0 −3.2 −3.4 −6.0 −3.6 −4.3
NAFRICA
-
−4.3 −4.3 −3.8 −5.2 −4.3 −3.6 −3.7 −4.6 −3.7 −4.9 −3.3 −3.7 −2.8 −4.3 −3.5 −2.7 −2.9 −3.8 −2.8 −4.3 −5
MEAST
−4.8 −4.3 −4.3 −5.4 −4.3 −4.5 −4.5 −5.1 −4.7 −5.1 −4.1 −3.7 −3.5 −4.7 −3.7 −3.7 −3.9 −4.4 −3.9 −4.6
EURO
−5.1 −4.0 −4.6 −3.2 −5.2 −5.5 −5.6 −3.6 −4.9 −5.4 −4.4 −3.4 −3.8 −2.7 −4.4 −4.7 −4.8 −3.1 −4.4 −4.9
−6
EASIA
VERIFICATION
−4.1 −4.3 −3.3 −4.7 −4.3 −3.9 −3.9 −4.1 −3.9 −4.8 −3.3 −3.6 −2.5 −3.9 −3.6 −3.1 −3.2 −3.4 −3.2 −4.2
CSAMERIC
−5.1 −3.5 −4.2 −4.1 −4.3 −4.1 −4.1 −4.6 −4.8 −6.0 −4.3 −3.0 −3.3 −3.7 −3.6 −3.4 −3.5 −4.4 −4.0 −6.0
CASIA
−3.2 −5.0 −4.4 −5.3 −4.6 −4.6 −4.4 −4.6 −4.3 −3.1 −2.6 −5.0 −3.8 −4.6 −4.0 −4.0 −3.8 −4.1 −3.9 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 286: For algorithm visionbox-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


326
Cross region FMR at threshold T = 0.669 for algorithm visionlabs_006, giving FMR(T) = 0.0001 globally.
−3.4 −5.7 −5.0 −5.4 −4.9 −5.0 −4.9 −5.0 −4.7 −3.0 −3.0 −5.0 −4.4 −5.2 −4.5 −4.5 −4.8 −4.7 −4.2 −2.7
SSAFRICA
−4.1 −4.7 −3.9 −4.9 −4.6 −4.0 −4.1 −4.4 −3.1 −4.5 −3.3 −3.9 −3.0 −4.1 −3.8 −3.2 −3.3 −3.9 −2.7 −3.9
SASIA
−4.4 −5.1 −4.3 −4.0 −5.1 −5.1 −4.9 −3.0 −4.3 −4.9 −3.9 −4.3 −3.5 −3.5 −4.4 −4.2 −4.3 −2.7 −3.8 −4.5
POLY
2019/10/16 12:43:37
−4.5 −4.6 −4.3 −5.7 −4.9 −4.1 −3.9 −5.3 −4.2 −5.1 −3.9 −4.0 −3.6 −5.0 −4.3 −3.5 −3.3 −4.6 −3.5 −4.4
NAFRICA log10 FMR
−4.4 −4.5 −3.9 −5.3 −4.5 −3.7 −3.9 −4.9 −3.8 −4.8 −3.4 −3.8 −2.9 −4.4 −3.6 −2.9 −3.0 −4.2 −3.0 −4.0
MEAST
−4.8 −4.8 −4.4 −5.6 −4.6 −4.6 −4.7 −5.2 −4.8 −5.0 −4.0 −4.3 −3.5 −4.8 −4.0 −3.8 −4.0 −4.5 −4.0 −4.4
EURO
−5.0 −4.5 −4.8 −3.7 −5.4 −5.5 −5.5 −4.0 −5.0 −5.3 −4.2 −3.9 −3.9 −3.1 −4.6 −4.6 −4.7 −3.5 −4.4 −4.6 −1
EASIA
−4.2 −4.5 −3.4 −4.8 −4.4 −4.1 −4.1 −4.3 −4.0 −4.8 −3.3 −3.7 −2.6 −3.9 −3.6 −3.2 −3.2 −3.6 −3.2 −4.0
FRVT
CSAMERIC
-
−5.5 −4.2 −4.7 −4.7 −4.8 −4.5 −4.9 −5.2 −5.1 −5.9 −4.8 −3.7 −3.9 −4.3 −4.1 −3.8 −4.2 −6.0 −4.5 −5.2
CASIA −2
−3.3 −5.7 −4.5 −5.2 −4.8 −4.8 −4.5 −4.6 −4.3 −3.3 −2.7 −6.0 −4.0 −4.7 −4.1 −4.1 −3.8 −4.3 −3.8 −2.9
CARIB

−3.1 −5.5 −4.8 −5.1 −4.7 −4.8 −4.6 −4.7 −4.4 −2.7 −2.7 −5.0 −4.3 −5.0 −4.3 −4.3 −4.7 −4.4 −4.0 −2.4
SSAFRICA
−3.9 −4.5 −3.8 −4.7 −4.5 −3.9 −3.9 −4.2 −2.9 −4.3 −3.2 −3.7 −2.9 −4.1 −3.8 −3.2 −3.3 −3.7 −2.5 −3.8
SASIA

−4
−4.2 −4.9 −4.1 −3.8 −4.9 −4.9 −4.7 −2.8 −4.0 −4.7 −3.7 −4.1 −3.4 −3.3 −4.2 −4.0 −4.2 −2.5 −3.6 −4.2
POLY
−4.2 −4.3 −4.0 −5.5 −4.7 −3.9 −3.6 −5.0 −3.9 −4.8 −3.7 −3.7 −3.4 −4.8 −4.2 −3.4 −3.1 −4.3 −3.4 −4.1
NAFRICA
-
−4.2 −4.3 −3.7 −5.2 −4.3 −3.5 −3.7 −4.7 −3.7 −4.7 −3.3 −3.8 −2.8 −4.3 −3.5 −2.8 −2.9 −4.0 −2.9 −4.0 −5
MEAST
−4.6 −4.6 −4.2 −5.5 −4.4 −4.5 −4.6 −5.1 −4.7 −4.8 −3.9 −4.1 −3.5 −4.7 −3.8 −3.8 −3.9 −4.4 −3.9 −4.3
EURO
−4.8 −4.4 −4.6 −3.5 −5.3 −5.4 −5.4 −3.7 −4.8 −5.1 −4.1 −3.8 −3.8 −3.0 −4.5 −4.5 −4.6 −3.3 −4.3 −4.5
−6
EASIA
VERIFICATION
−4.0 −4.3 −3.2 −4.6 −4.3 −3.9 −3.9 −4.1 −3.9 −4.6 −3.2 −3.6 −2.5 −3.8 −3.5 −3.1 −3.1 −3.5 −3.1 −3.9
CSAMERIC
−5.2 −4.0 −4.5 −4.5 −4.5 −4.2 −4.6 −4.9 −4.9 −5.6 −4.7 −3.5 −3.7 −4.0 −3.8 −3.7 −3.9 −6.0 −4.3 −4.9
CASIA
−3.1 −5.4 −4.3 −5.0 −4.6 −4.6 −4.2 −4.3 −4.1 −3.1 −2.6 −6.0 −3.7 −4.6 −4.0 −3.9 −3.6 −4.0 −3.6 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 287: For algorithm visionlabs-006 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


327
Cross region FMR at threshold T = 0.657 for algorithm visionlabs_007, giving FMR(T) = 0.0001 globally.
−3.3 −5.4 −5.0 −5.1 −4.9 −5.1 −4.8 −4.7 −4.6 −2.9 −3.0 −5.0 −4.6 −4.8 −4.7 −4.7 −4.8 −4.3 −4.2 −2.6
SSAFRICA
−4.3 −4.8 −4.4 −4.9 −5.0 −4.3 −4.3 −4.3 −3.1 −4.5 −3.9 −4.5 −3.9 −4.6 −4.7 −4.0 −4.0 −4.0 −2.8 −4.3
SASIA
−4.3 −5.1 −4.3 −3.8 −5.2 −5.1 −4.9 −2.8 −4.2 −4.6 −4.0 −5.0 −3.8 −3.4 −4.8 −4.7 −4.7 −2.5 −3.8 −4.3
POLY
2019/10/16 12:43:37
−4.4 −4.6 −4.2 −5.6 −4.8 −4.1 −3.8 −5.0 −4.2 −5.0 −4.0 −4.0 −3.7 −5.2 −4.5 −3.5 −3.3 −4.4 −3.8 −4.6
NAFRICA log10 FMR
−4.7 −4.5 −4.3 −5.4 −4.7 −3.9 −4.0 −4.8 −4.2 −5.1 −4.1 −4.1 −3.8 −5.0 −4.2 −3.3 −3.4 −4.5 −3.8 −4.6
MEAST
−5.0 −4.6 −4.5 −5.6 −4.5 −4.8 −4.8 −5.3 −5.1 −5.0 −4.6 −4.3 −4.0 −5.2 −4.0 −4.3 −4.4 −5.0 −4.7 −4.9
EURO
−5.1 −4.5 −5.0 −3.6 −5.5 −5.7 −5.4 −3.8 −4.9 −5.1 −4.6 −3.9 −4.5 −3.1 −5.0 −5.1 −4.9 −3.5 −4.5 −4.7 −1
EASIA
−4.3 −4.6 −3.4 −5.0 −4.5 −4.4 −4.2 −4.2 −4.2 −4.8 −3.7 −4.1 −2.9 −4.5 −4.0 −3.9 −3.7 −3.8 −3.8 −4.5
FRVT
CSAMERIC
-
−5.3 −3.9 −4.7 −4.5 −4.6 −4.4 −4.5 −4.9 −4.9 −5.8 −4.8 −3.4 −4.2 −4.1 −4.0 −4.1 −4.4 −5.2 −4.6 −4.9
CASIA −2
−3.3 −5.5 −4.4 −5.0 −4.8 −4.7 −4.5 −4.4 −4.3 −3.3 −2.9 −5.0 −3.9 −4.7 −4.4 −4.2 −3.9 −4.1 −3.9 −3.0
CARIB

−3.1 −5.1 −4.7 −4.8 −4.6 −4.8 −4.5 −4.4 −4.3 −2.6 −2.8 −5.0 −4.4 −4.5 −4.4 −4.5 −4.5 −4.1 −3.9 −2.3
SSAFRICA
−4.0 −4.5 −4.1 −4.7 −4.8 −4.1 −4.0 −4.0 −2.8 −4.3 −3.6 −4.2 −3.7 −4.3 −4.5 −3.7 −3.7 −3.8 −2.5 −4.0
SASIA

−4
−4.0 −4.8 −4.0 −3.5 −4.9 −4.9 −4.7 −2.5 −3.9 −4.3 −3.7 −4.7 −3.6 −3.2 −4.6 −4.4 −4.5 −2.2 −3.5 −4.0
POLY
−4.2 −4.3 −4.0 −5.4 −4.5 −3.8 −3.5 −4.7 −3.9 −4.7 −3.7 −3.7 −3.4 −5.1 −4.2 −3.3 −3.0 −4.1 −3.5 −4.3
NAFRICA
-
−4.5 −4.2 −4.0 −5.2 −4.4 −3.6 −3.7 −4.6 −4.0 −4.8 −3.9 −3.7 −3.5 −4.7 −4.0 −3.1 −3.1 −4.2 −3.6 −4.3 −5
MEAST
−4.7 −4.3 −4.2 −5.3 −4.2 −4.5 −4.5 −5.1 −4.9 −4.8 −4.4 −4.0 −3.8 −4.9 −3.8 −4.0 −4.1 −4.7 −4.5 −4.6
EURO
−4.8 −4.2 −4.7 −3.4 −5.3 −5.4 −5.1 −3.5 −4.7 −4.8 −4.3 −3.7 −4.2 −2.9 −4.8 −4.9 −4.7 −3.2 −4.3 −4.4
−6
EASIA
VERIFICATION
−4.0 −4.3 −3.1 −4.7 −4.2 −4.1 −3.9 −4.0 −4.0 −4.5 −3.5 −3.8 −2.7 −4.3 −3.8 −3.6 −3.4 −3.6 −3.6 −4.2
CSAMERIC
−5.0 −3.7 −4.4 −4.2 −4.3 −4.1 −4.2 −4.6 −4.6 −5.6 −4.5 −3.2 −3.9 −3.8 −3.7 −3.8 −4.1 −4.9 −4.3 −4.6
CASIA
−3.1 −5.3 −4.1 −4.8 −4.6 −4.5 −4.2 −4.1 −4.0 −3.0 −2.6 −4.7 −3.6 −4.4 −4.1 −4.0 −3.6 −3.8 −3.6 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 288: For algorithm visionlabs-007 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


328
Cross region FMR at threshold T = 995.898 for algorithm vocord_006, giving FMR(T) = 0.0001 globally.
−3.4 −6.0 −5.0 −5.6 −5.1 −5.1 −4.8 −5.0 −4.6 −3.0 −3.1 −6.0 −4.6 −5.1 −4.6 −4.7 −4.6 −4.6 −4.1 −2.7
SSAFRICA
−4.1 −4.8 −4.1 −5.0 −4.7 −4.1 −4.1 −4.4 −3.0 −4.5 −3.4 −4.2 −3.2 −4.4 −4.0 −3.4 −3.5 −4.0 −2.6 −4.0
SASIA
−4.3 −5.1 −4.3 −4.1 −5.3 −5.1 −4.7 −3.3 −4.2 −4.8 −3.8 −5.0 −3.7 −3.6 −4.6 −4.3 −4.4 −2.8 −3.6 −4.5
POLY
2019/10/16 12:43:37
−4.2 −4.5 −4.2 −5.8 −4.7 −4.0 −3.6 −5.0 −4.0 −4.6 −3.7 −3.7 −3.6 −5.2 −4.2 −3.6 −3.3 −4.9 −3.4 −4.2
NAFRICA log10 FMR
−4.4 −4.5 −4.0 −5.4 −4.4 −3.7 −3.8 −5.0 −3.9 −4.9 −3.5 −3.8 −3.1 −4.6 −3.6 −3.0 −3.1 −4.3 −3.1 −4.2
MEAST
−4.7 −4.4 −4.4 −5.7 −4.4 −4.5 −4.6 −5.4 −4.8 −5.1 −4.0 −3.9 −3.6 −5.0 −3.8 −3.8 −3.9 −4.7 −4.1 −4.5
EURO
−5.1 −4.6 −4.9 −3.6 −5.5 −5.7 −5.6 −4.1 −5.1 −5.4 −4.3 −4.1 −4.1 −3.1 −4.8 −4.9 −4.9 −3.6 −4.5 −4.8 −1
EASIA
−4.1 −4.5 −3.5 −4.9 −4.4 −4.1 −4.0 −4.3 −4.0 −4.8 −3.4 −3.8 −2.8 −4.2 −3.7 −3.4 −3.3 −3.7 −3.4 −4.2
FRVT
CSAMERIC
-
−4.8 −3.9 −4.4 −4.7 −4.4 −4.1 −4.2 −5.2 −4.9 −5.6 −4.3 −3.4 −3.7 −4.1 −3.8 −3.5 −3.9 −4.9 −4.2 −4.9
CASIA −2
−3.3 −4.9 −4.2 −5.2 −4.7 −4.5 −4.3 −4.6 −4.2 −3.4 −2.8 −4.4 −3.7 −4.6 −4.1 −4.0 −3.9 −4.1 −3.8 −3.0
CARIB

−3.2 −5.7 −4.7 −5.3 −4.9 −4.8 −4.5 −4.7 −4.3 −2.8 −2.8 −6.0 −4.4 −4.9 −4.4 −4.5 −4.3 −4.4 −3.8 −2.5
SSAFRICA
−3.8 −4.6 −3.9 −4.8 −4.6 −3.9 −3.9 −4.2 −2.7 −4.2 −3.2 −4.0 −3.1 −4.3 −3.9 −3.3 −3.4 −3.8 −2.4 −3.9
SASIA

−4
−4.1 −4.8 −4.0 −3.8 −5.1 −4.9 −4.5 −3.0 −3.9 −4.5 −3.6 −4.7 −3.5 −3.4 −4.4 −4.1 −4.2 −2.6 −3.4 −4.2
POLY
−3.9 −4.2 −3.9 −5.5 −4.4 −3.7 −3.4 −4.7 −3.8 −4.3 −3.4 −3.4 −3.4 −5.0 −3.9 −3.3 −3.1 −4.6 −3.2 −3.9
NAFRICA
-
−4.1 −4.2 −3.8 −5.2 −4.2 −3.5 −3.5 −4.8 −3.7 −4.7 −3.3 −3.6 −3.0 −4.5 −3.5 −2.8 −2.9 −4.2 −3.0 −4.0 −5
MEAST
−4.5 −4.1 −4.2 −5.5 −4.1 −4.3 −4.3 −5.2 −4.7 −4.9 −3.8 −3.6 −3.5 −5.0 −3.6 −3.7 −3.7 −4.6 −4.0 −4.3
EURO
−4.9 −4.3 −4.7 −3.3 −5.3 −5.6 −5.4 −3.8 −4.8 −5.1 −4.1 −3.9 −4.0 −2.8 −4.6 −4.8 −4.7 −3.4 −4.3 −4.5
−6
EASIA
VERIFICATION
−3.8 −4.2 −3.2 −4.7 −4.2 −3.9 −3.8 −4.0 −3.8 −4.5 −3.2 −3.6 −2.6 −4.1 −3.5 −3.2 −3.2 −3.5 −3.2 −4.0
CSAMERIC
−4.5 −3.6 −4.2 −4.4 −4.1 −3.8 −3.9 −4.9 −4.6 −5.5 −4.0 −3.1 −3.5 −3.8 −3.5 −3.3 −3.6 −4.6 −4.0 −4.9
CASIA
−3.1 −4.6 −4.0 −5.0 −4.4 −4.3 −4.0 −4.3 −3.9 −3.1 −2.6 −4.1 −3.4 −4.3 −3.9 −3.7 −3.6 −3.9 −3.5 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 289: For algorithm vocord-006 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


329
Cross region FMR at threshold T = 995.241 for algorithm vocord_007, giving FMR(T) = 0.0001 globally.
−3.7 −5.8 −5.0 −5.4 −4.9 −4.8 −4.7 −5.2 −4.5 −3.3 −3.3 −5.3 −4.6 −5.0 −4.7 −4.4 −4.5 −4.8 −4.1 −3.0
SSAFRICA
−4.2 −4.7 −4.2 −5.1 −4.7 −4.1 −4.0 −4.5 −2.9 −4.6 −3.7 −4.2 −3.6 −4.6 −4.2 −3.5 −3.5 −4.1 −2.6 −4.2
SASIA
−4.5 −5.0 −4.5 −4.2 −5.2 −5.2 −4.8 −3.3 −4.2 −5.0 −4.0 −4.5 −3.9 −3.7 −4.8 −4.6 −4.2 −2.9 −3.7 −4.5
POLY
2019/10/16 12:43:37
−4.2 −4.4 −4.1 −5.5 −4.4 −3.8 −3.5 −5.1 −4.0 −4.9 −3.6 −3.9 −3.5 −4.7 −4.0 −3.3 −2.9 −4.6 −3.5 −4.3
NAFRICA log10 FMR
−4.4 −4.2 −4.0 −5.4 −4.3 −3.6 −3.7 −5.2 −3.9 −4.9 −3.6 −3.7 −3.2 −4.8 −3.7 −2.9 −3.1 −4.4 −3.2 −4.4
MEAST
−4.7 −4.2 −4.3 −5.5 −4.1 −4.3 −4.4 −5.4 −4.8 −5.2 −4.1 −3.7 −3.7 −5.1 −3.6 −3.8 −3.9 −4.8 −4.2 −4.7
EURO
−5.2 −4.5 −5.1 −3.6 −5.2 −5.4 −5.6 −4.2 −5.2 −5.5 −4.6 −4.0 −4.4 −3.1 −4.9 −4.9 −4.8 −3.7 −4.7 −4.9 −1
EASIA
−4.1 −4.4 −3.5 −5.0 −4.3 −4.1 −4.0 −4.5 −4.1 −4.9 −3.5 −3.8 −2.9 −4.4 −3.7 −3.5 −3.4 −3.9 −3.6 −4.4
FRVT
CSAMERIC
-
−4.7 −3.7 −4.3 −4.6 −4.2 −4.0 −4.0 −5.1 −4.6 −5.4 −4.2 −3.3 −3.7 −4.0 −3.6 −3.5 −3.8 −4.9 −4.0 −5.2
CASIA −2
−3.5 −4.7 −4.2 −5.2 −4.5 −4.4 −4.3 −4.7 −4.2 −3.7 −3.0 −4.3 −3.7 −4.8 −4.1 −3.8 −3.8 −4.3 −3.8 −3.3
CARIB

−3.4 −5.5 −4.8 −5.2 −4.7 −4.5 −4.4 −5.0 −4.3 −3.0 −3.1 −5.0 −4.3 −4.8 −4.5 −4.2 −4.2 −4.5 −3.8 −2.7
SSAFRICA
−3.9 −4.5 −4.0 −4.8 −4.5 −3.8 −3.8 −4.2 −2.6 −4.3 −3.4 −4.0 −3.4 −4.4 −4.1 −3.4 −3.3 −3.9 −2.4 −3.9
SASIA

−4
−4.2 −4.7 −4.2 −3.9 −5.0 −4.9 −4.5 −3.1 −3.9 −4.7 −3.7 −4.2 −3.6 −3.4 −4.6 −4.4 −3.9 −2.7 −3.4 −4.2
POLY
−3.9 −4.1 −3.8 −5.4 −4.2 −3.5 −3.2 −4.8 −3.8 −4.6 −3.4 −3.6 −3.3 −4.7 −3.8 −3.0 −2.7 −4.3 −3.3 −4.0
NAFRICA
-
−4.1 −3.9 −3.8 −5.3 −4.0 −3.3 −3.4 −5.0 −3.7 −4.6 −3.4 −3.4 −3.1 −4.7 −3.4 −2.7 −2.8 −4.2 −3.1 −4.2 −5
MEAST
−4.4 −3.9 −4.0 −5.3 −3.8 −4.1 −4.1 −5.2 −4.6 −5.0 −3.9 −3.4 −3.4 −4.9 −3.3 −3.5 −3.6 −4.6 −4.1 −4.5
EURO
−5.0 −4.2 −4.8 −3.3 −5.1 −5.3 −5.3 −3.9 −4.9 −5.2 −4.4 −3.8 −4.2 −2.8 −4.7 −4.7 −4.6 −3.5 −4.4 −4.6
−6
EASIA
VERIFICATION
−3.9 −4.1 −3.2 −4.8 −4.0 −3.9 −3.8 −4.2 −3.9 −4.7 −3.3 −3.5 −2.7 −4.2 −3.5 −3.3 −3.2 −3.7 −3.4 −4.2
CSAMERIC
−4.5 −3.4 −4.0 −4.3 −3.9 −3.7 −3.7 −4.8 −4.3 −5.1 −3.9 −3.0 −3.4 −3.7 −3.4 −3.2 −3.5 −4.6 −3.7 −4.9
CASIA
−3.2 −4.4 −4.0 −5.0 −4.3 −4.1 −4.0 −4.4 −3.9 −3.4 −2.7 −4.0 −3.4 −4.5 −3.8 −3.5 −3.5 −4.0 −3.5 −3.0
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 290: For algorithm vocord-007 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


330
Cross region FMR at threshold T = 0.400 for algorithm winsense_000, giving FMR(T) = 0.0001 globally.
−3.4 −6.0 −5.1 −5.7 −5.0 −5.3 −5.0 −5.3 −5.0 −3.0 −3.0 −6.0 −4.8 −5.5 −4.5 −4.9 −5.3 −5.3 −4.8 −2.7
SSAFRICA
−4.3 −4.8 −4.2 −4.9 −4.9 −4.3 −4.2 −4.4 −3.2 −4.8 −3.6 −4.2 −3.3 −4.4 −4.1 −3.6 −3.6 −4.0 −2.8 −4.3
SASIA
−4.5 −4.6 −4.2 −3.6 −5.1 −5.0 −5.5 −2.7 −4.4 −4.9 −4.1 −4.4 −3.7 −3.2 −4.5 −4.3 −5.1 −2.4 −4.0 −4.6
POLY
2019/10/16 12:43:37
−4.5 −4.5 −4.2 −6.0 −4.9 −4.1 −3.7 −5.7 −4.3 −5.2 −3.9 −3.6 −3.6 −5.7 −4.6 −3.6 −3.3 −6.0 −4.0 −4.6
NAFRICA log10 FMR
−4.5 −4.3 −4.0 −5.4 −4.6 −3.8 −3.9 −5.0 −4.0 −5.2 −3.7 −3.8 −3.1 −4.7 −3.8 −3.0 −3.1 −4.3 −3.2 −4.5
MEAST
−4.9 −4.5 −4.5 −5.6 −4.4 −4.6 −4.7 −5.3 −5.0 −5.2 −4.3 −4.0 −3.8 −5.0 −3.9 −3.9 −4.0 −4.7 −4.3 −4.7
EURO
−5.2 −4.1 −4.8 −3.3 −5.4 −5.7 −5.6 −3.7 −5.1 −5.6 −4.4 −3.6 −4.0 −2.8 −4.7 −4.8 −4.9 −3.2 −4.5 −5.1 −1
EASIA
−4.3 −4.5 −3.5 −4.9 −4.5 −4.2 −4.1 −4.2 −4.2 −4.9 −3.5 −3.8 −2.8 −4.2 −3.8 −3.4 −3.3 −3.6 −3.5 −4.3
FRVT
CSAMERIC
-
−5.1 −3.7 −4.5 −4.2 −4.5 −4.2 −4.5 −4.7 −5.0 −5.9 −4.5 −3.2 −3.6 −3.8 −3.8 −3.5 −4.7 −4.4 −4.4 −6.0
CASIA −2
−3.4 −5.1 −4.5 −5.5 −4.8 −4.8 −4.6 −4.7 −4.6 −3.3 −2.9 −4.6 −4.0 −5.1 −4.3 −4.2 −4.1 −4.4 −4.1 −3.0
CARIB

−3.1 −6.0 −4.9 −5.4 −4.7 −5.0 −4.7 −5.0 −4.7 −2.7 −2.8 −6.0 −4.5 −5.3 −4.3 −4.6 −5.0 −5.1 −4.5 −2.4
SSAFRICA
−4.1 −4.6 −4.1 −4.7 −4.7 −4.1 −4.0 −4.2 −2.9 −4.6 −3.5 −4.0 −3.3 −4.2 −4.1 −3.5 −3.5 −3.8 −2.6 −4.1
SASIA

−4
−4.2 −4.3 −4.0 −3.4 −4.9 −4.8 −5.2 −2.5 −4.2 −4.7 −3.9 −4.1 −3.5 −3.0 −4.4 −4.1 −4.8 −2.2 −3.8 −4.3
POLY
−4.2 −4.2 −3.9 −5.7 −4.6 −3.8 −3.5 −5.4 −4.1 −4.9 −3.6 −3.3 −3.4 −5.4 −4.3 −3.4 −3.0 −6.0 −3.7 −4.3
NAFRICA
-
−4.3 −4.1 −3.9 −5.2 −4.4 −3.6 −3.7 −4.8 −3.9 −5.0 −3.5 −3.7 −3.0 −4.5 −3.6 −2.9 −3.0 −4.2 −3.2 −4.4 −5
MEAST
−4.7 −4.2 −4.3 −5.4 −4.2 −4.4 −4.5 −5.0 −4.9 −5.0 −4.1 −3.8 −3.6 −4.8 −3.7 −3.8 −3.9 −4.5 −4.2 −4.5
EURO
−5.0 −3.9 −4.7 −3.1 −5.2 −5.5 −5.4 −3.4 −4.8 −5.4 −4.3 −3.4 −3.9 −2.6 −4.5 −4.7 −4.7 −3.0 −4.3 −4.9
−6
EASIA
VERIFICATION
−4.0 −4.2 −3.3 −4.7 −4.3 −4.0 −3.9 −4.0 −4.1 −4.6 −3.4 −3.6 −2.6 −4.1 −3.7 −3.3 −3.2 −3.5 −3.4 −4.1
CSAMERIC
−4.8 −3.4 −4.3 −3.9 −4.2 −4.0 −4.2 −4.5 −4.7 −5.6 −4.2 −3.0 −3.5 −3.5 −3.6 −3.3 −4.4 −4.1 −4.2 −6.0
CASIA
−3.1 −4.8 −4.3 −5.3 −4.6 −4.5 −4.3 −4.4 −4.3 −3.1 −2.7 −4.3 −3.8 −4.9 −4.1 −4.0 −3.9 −4.1 −3.8 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 291: For algorithm winsense-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


331
Cross region FMR at threshold T = 0.404 for algorithm x−laboratory_000, giving FMR(T) = 0.0001 globally.
−3.4 −5.7 −5.0 −5.9 −4.8 −5.0 −4.9 −5.2 −4.7 −3.0 −3.0 −5.3 −4.7 −5.5 −4.5 −4.8 −4.4 −5.4 −4.3 −2.7
SSAFRICA
−4.1 −4.8 −4.1 −5.2 −4.7 −4.1 −4.1 −4.6 −3.1 −4.6 −3.4 −4.2 −3.2 −4.6 −3.9 −3.4 −3.4 −4.1 −2.7 −4.1
SASIA
−4.5 −5.1 −4.4 −4.3 −5.2 −5.2 −5.0 −3.1 −4.4 −5.1 −4.1 −5.0 −3.8 −3.9 −4.6 −4.3 −5.1 −2.8 −3.9 −4.7
POLY
2019/10/16 12:43:37
−4.3 −4.2 −4.0 −6.0 −4.5 −3.9 −3.6 −5.3 −4.1 −5.0 −3.6 −3.6 −3.4 −6.0 −4.1 −3.4 −3.1 −4.9 −3.5 −4.9
NAFRICA log10 FMR
−4.3 −4.2 −3.8 −5.5 −4.3 −3.6 −3.7 −5.1 −3.9 −4.8 −3.4 −3.6 −3.0 −4.7 −3.6 −2.9 −3.0 −4.3 −3.1 −4.1
MEAST
−4.7 −4.4 −4.3 −6.0 −4.2 −4.4 −4.5 −5.4 −4.8 −5.0 −4.1 −3.9 −3.6 −5.4 −3.7 −3.8 −3.9 −4.8 −4.1 −4.5
EURO
−5.5 −5.1 −5.3 −4.4 −5.9 −5.8 −5.7 −4.3 −5.3 −5.9 −4.7 −4.6 −4.5 −3.8 −5.3 −5.0 −5.1 −3.9 −4.8 −5.5 −1
EASIA
−4.1 −4.3 −3.3 −5.2 −4.3 −4.0 −3.9 −4.3 −4.1 −4.8 −3.4 −3.8 −2.7 −4.6 −3.7 −3.3 −3.2 −3.8 −3.4 −4.3
FRVT
CSAMERIC
-
−4.8 −3.8 −4.2 −5.1 −4.3 −4.1 −4.2 −5.2 −4.9 −5.6 −4.0 −3.4 −3.3 −4.6 −3.6 −3.5 −3.7 −4.9 −4.2 −4.7
CASIA −2
−3.3 −5.2 −4.4 −5.8 −4.7 −4.6 −4.4 −4.7 −4.4 −3.3 −2.8 −4.7 −3.9 −5.3 −4.1 −4.0 −3.8 −4.5 −4.0 −2.9
CARIB

−3.1 −5.7 −4.7 −5.6 −4.6 −4.8 −4.6 −5.0 −4.5 −2.7 −2.8 −6.0 −4.4 −5.3 −4.3 −4.5 −4.2 −5.1 −4.1 −2.4
SSAFRICA
−3.9 −4.5 −3.9 −5.0 −4.5 −3.9 −3.9 −4.3 −2.9 −4.4 −3.3 −4.1 −3.1 −4.5 −3.9 −3.3 −3.3 −3.9 −2.6 −4.0
SASIA

−4
−4.3 −4.8 −4.1 −4.0 −5.1 −5.1 −4.8 −2.9 −4.1 −4.9 −3.9 −4.7 −3.6 −3.6 −4.5 −4.3 −4.8 −2.6 −3.7 −4.5
POLY
−4.0 −3.9 −3.8 −5.8 −4.2 −3.6 −3.4 −5.0 −3.9 −4.8 −3.3 −3.3 −3.2 −6.0 −3.8 −3.1 −2.8 −4.6 −3.3 −4.6
NAFRICA
-
−4.1 −3.9 −3.7 −5.5 −4.1 −3.4 −3.5 −4.9 −3.7 −4.6 −3.3 −3.4 −2.9 −4.7 −3.5 −2.8 −2.8 −4.2 −3.0 −4.0 −5
MEAST
−4.5 −4.1 −4.1 −5.9 −4.0 −4.2 −4.2 −5.2 −4.7 −4.8 −4.0 −3.7 −3.5 −5.4 −3.5 −3.6 −3.7 −4.6 −4.0 −4.3
EURO
−5.3 −4.8 −5.1 −4.1 −5.8 −5.6 −5.4 −4.1 −5.1 −5.7 −4.5 −4.4 −4.4 −3.6 −5.1 −4.8 −4.8 −3.7 −4.6 −5.3
−6
EASIA
VERIFICATION
−3.9 −4.1 −3.1 −5.0 −4.1 −3.8 −3.7 −4.1 −3.9 −4.5 −3.3 −3.6 −2.5 −4.4 −3.5 −3.1 −3.1 −3.6 −3.3 −4.1
CSAMERIC
−4.6 −3.6 −4.0 −4.8 −4.0 −3.9 −3.9 −4.9 −4.7 −5.5 −3.9 −3.3 −3.2 −4.4 −3.4 −3.3 −3.5 −4.6 −4.0 −4.6
CASIA
−3.1 −4.9 −4.1 −5.5 −4.4 −4.3 −4.1 −4.4 −4.1 −3.0 −2.6 −4.4 −3.6 −5.1 −3.9 −3.8 −3.6 −4.2 −3.7 −2.7
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 292: For algorithm x-laboratory-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


332
Cross region FMR at threshold T = 5.544 for algorithm yisheng_004, giving FMR(T) = 0.0001 globally.
−4.2 −6.0 −6.0 −6.0 −5.5 −6.0 −6.0 −6.0 −6.0 −4.1 −3.4 −6.0 −5.6 −6.0 −4.7 −5.2 −6.0 −6.0 −5.6 −3.4
SSAFRICA
−4.2 −4.8 −3.9 −4.9 −4.7 −4.1 −4.2 −4.5 −3.7 −5.0 −3.2 −3.8 −2.9 −4.0 −3.7 −3.2 −3.2 −3.7 −2.9 −4.1
SASIA
−5.1 −4.6 −4.4 −3.8 −5.1 −5.1 −6.0 −3.4 −4.9 −6.0 −4.2 −3.8 −3.5 −3.1 −4.3 −4.2 −6.0 −2.8 −4.1 −5.3
POLY
2019/10/16 12:43:37
−5.7 −5.4 −5.6 −6.0 −6.0 −5.4 −6.0 −6.0 −5.3 −6.0 −4.7 −4.3 −4.5 −6.0 −6.0 −4.5 −6.0 −6.0 −4.1 −6.0
NAFRICA log10 FMR
−4.6 −4.8 −4.0 −5.4 −4.6 −4.0 −4.2 −4.9 −4.0 −5.4 −3.5 −3.9 −2.9 −4.4 −3.6 −3.1 −3.2 −4.0 −3.0 −4.5
MEAST
−5.0 −5.2 −4.4 −5.2 −4.8 −4.7 −5.0 −5.1 −5.1 −5.6 −4.0 −4.2 −3.4 −4.2 −3.8 −3.7 −4.0 −4.2 −4.1 −4.7
EURO
−5.4 −3.9 −4.5 −3.1 −5.0 −5.4 −5.7 −3.7 −5.0 −5.9 −4.4 −3.2 −3.5 −2.4 −4.2 −4.5 −4.7 −3.0 −4.2 −5.0 −1
EASIA
−4.3 −4.5 −3.6 −4.5 −4.4 −4.0 −4.2 −4.3 −4.1 −5.2 −3.2 −3.5 −2.6 −3.6 −3.4 −3.0 −3.1 −3.3 −3.2 −4.2
FRVT
CSAMERIC
-
−5.5 −4.1 −4.4 −4.2 −4.7 −4.7 −5.1 −4.9 −5.6 −5.9 −4.4 −3.4 −3.3 −4.0 −3.7 −3.6 −4.2 −4.7 −4.5 −4.9
CASIA −2
−3.7 −6.0 −5.6 −6.0 −5.1 −5.7 −5.4 −6.0 −5.5 −3.9 −2.9 −6.0 −4.8 −5.3 −4.3 −4.9 −4.5 −5.2 −4.6 −3.1
CARIB

−4.1 −6.0 −6.0 −6.0 −5.4 −5.9 −6.0 −6.0 −6.0 −4.0 −3.3 −6.0 −5.4 −6.0 −4.7 −5.1 −6.0 −6.0 −5.5 −3.3
SSAFRICA
−4.2 −4.8 −3.9 −4.9 −4.6 −4.1 −4.2 −4.5 −3.7 −4.9 −3.2 −3.9 −2.8 −4.0 −3.7 −3.2 −3.2 −3.7 −2.9 −4.0
SASIA

−4
−5.0 −4.4 −4.4 −3.7 −5.1 −5.0 −6.0 −3.2 −4.8 −5.9 −4.2 −3.6 −3.4 −3.0 −4.3 −4.1 −6.0 −2.7 −4.1 −5.3
POLY
−5.9 −5.1 −5.4 −6.0 −6.0 −5.4 −6.0 −6.0 −5.2 −6.0 −6.0 −4.0 −4.3 −6.0 −6.0 −4.5 −6.0 −6.0 −4.1 −6.0
NAFRICA
-
−4.5 −4.8 −3.9 −5.3 −4.5 −4.0 −4.2 −4.8 −4.0 −5.5 −3.4 −3.8 −2.9 −4.3 −3.5 −3.0 −3.2 −3.8 −3.0 −4.6 −5
MEAST
−5.1 −5.1 −4.4 −5.1 −4.7 −4.7 −5.0 −5.1 −5.0 −5.6 −4.0 −4.1 −3.3 −4.2 −3.7 −3.7 −4.0 −4.2 −4.1 −4.8
EURO
−5.3 −3.8 −4.4 −2.9 −4.9 −5.4 −5.8 −3.6 −5.0 −5.8 −4.4 −3.1 −3.5 −2.3 −4.2 −4.4 −4.8 −2.9 −4.3 −5.0
−6
EASIA
VERIFICATION
−4.3 −4.5 −3.6 −4.5 −4.4 −4.0 −4.1 −4.2 −4.1 −5.2 −3.2 −3.5 −2.5 −3.5 −3.3 −3.0 −3.1 −3.3 −3.1 −4.2
CSAMERIC
−5.3 −3.8 −4.3 −4.0 −4.6 −4.7 −4.9 −4.8 −5.6 −6.0 −4.2 −3.2 −3.3 −3.7 −3.6 −3.6 −4.1 −4.4 −4.5 −6.0
CASIA
−3.7 −6.0 −5.4 −6.0 −5.1 −5.6 −5.8 −5.8 −5.4 −3.8 −2.9 −6.0 −4.7 −5.1 −4.3 −4.8 −5.0 −5.1 −4.6 −3.1
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 293: For algorithm yisheng-004 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different


333
Cross region FMR at threshold T = 37.698 for algorithm yitu_003, giving FMR(T) = 0.0001 globally.
−3.9 −5.7 −5.1 −5.7 −5.2 −5.0 −4.8 −5.2 −4.9 −3.5 −3.4 −5.3 −4.7 −5.3 −5.0 −4.5 −4.4 −4.7 −4.4 −3.1
SSAFRICA
−4.4 −4.8 −4.2 −5.1 −4.8 −4.1 −4.1 −4.6 −3.4 −4.9 −3.8 −4.1 −3.4 −4.6 −4.1 −3.4 −3.5 −4.1 −3.0 −4.4
SASIA
−4.4 −4.5 −4.3 −4.0 −5.2 −5.1 −5.0 −2.9 −4.4 −5.0 −4.0 −4.3 −3.8 −3.6 −4.7 −4.6 −4.6 −2.5 −4.0 −4.5
POLY
2019/10/16 12:43:37
−4.1 −4.4 −3.9 −5.4 −4.4 −3.8 −3.5 −5.3 −4.2 −4.8 −3.5 −3.9 −3.3 −5.0 −3.8 −3.2 −2.8 −4.6 −3.6 −4.4
NAFRICA log10 FMR
−4.3 −4.2 −3.9 −5.3 −4.3 −3.6 −3.6 −4.8 −4.0 −5.0 −3.5 −3.7 −3.1 −4.6 −3.5 −2.8 −3.0 −4.2 −3.2 −4.5
MEAST
−4.8 −4.2 −4.2 −5.5 −4.0 −4.3 −4.4 −5.2 −4.9 −5.4 −4.1 −3.7 −3.6 −5.0 −3.5 −3.7 −3.8 −4.6 −4.2 −4.9
EURO
−5.5 −4.6 −5.0 −3.8 −5.5 −5.4 −5.5 −4.0 −5.2 −5.6 −4.8 −4.1 −4.3 −3.3 −4.9 −4.7 −4.9 −3.6 −4.7 −5.1 −1
EASIA
−4.1 −4.3 −3.3 −4.9 −4.2 −4.0 −3.9 −4.2 −4.2 −4.9 −3.4 −3.7 −2.6 −4.3 −3.6 −3.2 −3.2 −3.7 −3.6 −4.4
FRVT
CSAMERIC
-
−5.0 −3.7 −4.5 −4.6 −4.2 −4.1 −4.4 −4.8 −5.0 −5.5 −4.5 −3.3 −3.8 −4.2 −3.7 −3.5 −4.2 −4.4 −4.3 −4.9
CASIA −2
−3.5 −4.9 −4.2 −5.5 −4.7 −4.6 −4.2 −4.6 −4.5 −3.8 −3.0 −4.5 −3.6 −5.0 −4.2 −3.9 −3.6 −4.2 −3.9 −3.5
CARIB

−3.6 −5.4 −4.8 −5.4 −5.0 −4.8 −4.5 −4.9 −4.6 −3.2 −3.2 −5.0 −4.4 −5.0 −4.7 −4.3 −4.2 −4.4 −4.1 −2.9
SSAFRICA
−4.2 −4.5 −4.0 −4.9 −4.6 −4.0 −3.9 −4.3 −3.2 −4.6 −3.6 −4.0 −3.2 −4.4 −4.0 −3.3 −3.4 −3.9 −2.8 −4.2
SASIA

−4
−4.1 −4.2 −4.0 −3.7 −4.9 −4.9 −4.8 −2.6 −4.1 −4.8 −3.7 −4.0 −3.5 −3.3 −4.5 −4.5 −4.3 −2.3 −3.7 −4.2
POLY
−3.9 −4.1 −3.7 −5.2 −4.1 −3.5 −3.2 −5.0 −3.9 −4.6 −3.2 −3.6 −3.0 −4.8 −3.5 −2.9 −2.5 −4.3 −3.4 −4.1
NAFRICA
-
−4.1 −3.9 −3.7 −5.1 −4.0 −3.3 −3.4 −4.6 −3.8 −4.7 −3.3 −3.4 −2.9 −4.4 −3.3 −2.7 −2.7 −4.0 −3.1 −4.3 −5
MEAST
−4.5 −3.9 −4.0 −5.3 −3.8 −4.1 −4.2 −5.0 −4.7 −5.1 −3.9 −3.5 −3.3 −4.8 −3.3 −3.5 −3.6 −4.4 −4.1 −4.7
EURO
−5.2 −4.3 −4.7 −3.5 −5.3 −5.2 −5.3 −3.7 −5.0 −5.3 −4.5 −3.9 −4.0 −3.0 −4.7 −4.5 −4.6 −3.4 −4.5 −4.9
−6
EASIA
VERIFICATION
−3.8 −4.0 −3.1 −4.7 −4.0 −3.7 −3.7 −4.0 −4.0 −4.7 −3.2 −3.5 −2.4 −4.1 −3.4 −3.0 −3.0 −3.4 −3.4 −4.2
CSAMERIC
−4.8 −3.4 −4.2 −4.3 −3.9 −3.9 −4.1 −4.5 −4.7 −5.2 −4.2 −3.0 −3.6 −3.9 −3.4 −3.3 −3.9 −4.1 −4.1 −4.6
CASIA
−3.3 −4.7 −4.0 −5.2 −4.5 −4.3 −4.0 −4.3 −4.2 −3.6 −2.7 −4.2 −3.4 −4.8 −3.9 −3.7 −3.3 −3.9 −3.6 −3.2
CARIB
FMR(T)
FNMR(T)
SA NA SA A N
C S CS SS
Figure 294: For algorithm yitu-003 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals


334
Cross country FMR at threshold T = 2.575 for algorithm 3divi_003, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
Any impostor pairing Same sex but any age impostor
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK
Country of birth of impostor

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
Country of birth of enrollee
FMR(T)
FNMR(T)
uals who were born in the given country pair. False matches are counted against a recognition threshold fixed globally to give the target FMR in the plot title, computed

335
Cross country FMR at threshold T = 2.692 for algorithm 3divi_004, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

336
Cross country FMR at threshold T = 0.632 for algorithm adera_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 297: For algorithm adera-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different
individuals who were born in the given country pair. False matches are counted against a recognition threshold fixed globally to give the target FMR in the plot title,

337
Cross country FMR at threshold T = 0.662 for algorithm alchera_000, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

338
Cross country FMR at threshold T = 0.667 for algorithm alchera_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

339
Cross country FMR at threshold T = 0.339 for algorithm allgovision_000, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 300: For algorithm allgovision-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

340
Cross country FMR at threshold T = 0.313 for algorithm alphaface_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 301: For algorithm alphaface-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

341
Cross country FMR at threshold T = 3.524 for algorithm amplifiedgroup_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 302: For algorithm amplifiedgroup-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from
different individuals who were born in the given country pair. False matches are counted against a recognition threshold fixed globally to give the target FMR in the
plot title, computed over all on the order of 1010 impostor comparisons. If text appears in each box it give the same quantity as that coded by the color. Grey indicates
FMR is at the intended FMR target level. Light red colors present a security vulnerability to, for example, a passport gate. Each +1 increase in log10 FMR corresponds to
a factor of 10 increase in FMR. The matrix is not quite symmetric because images in the enrollment and verification sets are different.

342
Cross country FMR at threshold T = 0.313 for algorithm anke_003, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

343
Cross country FMR at threshold T = 0.309 for algorithm anke_004, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

344
Cross country FMR at threshold T = 1.431 for algorithm anyvision_002, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

345
Cross country FMR at threshold T = 1.297 for algorithm anyvision_004, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

346
Cross country FMR at threshold T = 2.758 for algorithm aware_003, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

347
Cross country FMR at threshold T = 3.681 for algorithm aware_004, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

348
Cross country FMR at threshold T = 0.790 for algorithm awiros_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 309: For algorithm awiros-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

349
Cross country FMR at threshold T = 0.800 for algorithm ayonix_000, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 310: For algorithm ayonix-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

350
Cross country FMR at threshold T = 0.649 for algorithm bm_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 311: For algorithm bm-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals
who were born in the given country pair. False matches are counted against a recognition threshold fixed globally to give the target FMR in the plot title, computed over

351
Cross country FMR at threshold T = 0.306 for algorithm camvi_002, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

352
Cross country FMR at threshold T = 0.272 for algorithm camvi_004, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

353
Cross country FMR at threshold T = 0.346 for algorithm ceiec_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

354
Cross country FMR at threshold T = 0.247 for algorithm ceiec_002, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

355
Cross country FMR at threshold T = 0.365 for algorithm chtface_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 316: For algorithm chtface-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

356
Cross country FMR at threshold T = 2845.000 for algorithm cogent_003, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

357
Cross country FMR at threshold T = 2939.000 for algorithm cogent_004, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

358
Cross country FMR at threshold T = 0.522 for algorithm cognitec_000, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

359
Cross country FMR at threshold T = 0.522 for algorithm cognitec_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

360
Cross country FMR at threshold T = 3.572 for algorithm ctbcbank_000, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 321: For algorithm ctbcbank-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

361
Cross country FMR at threshold T = 0.702 for algorithm cyberextruder_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

362
Cross country FMR at threshold T = 0.408 for algorithm cyberextruder_002, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

363
Cross country FMR at threshold T = 1.322 for algorithm cyberlink_002, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

364
Cross country FMR at threshold T = 5958.000 for algorithm dahua_002, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

365
Cross country FMR at threshold T = 5392.000 for algorithm dahua_003, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

366
Cross country FMR at threshold T = 1.293 for algorithm deepglint_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 327: For algorithm deepglint-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

367
Cross country FMR at threshold T = 1.300 for algorithm deepsea_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 328: For algorithm deepsea-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

368
Cross country FMR at threshold T = 75.231 for algorithm dermalog_005, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

369
Cross country FMR at threshold T = 76.496 for algorithm dermalog_006, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

370
Cross country FMR at threshold T = 0.547 for algorithm digitalbarriers_002, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 331: For algorithm digitalbarriers-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

371
Cross country FMR at threshold T = 0.974 for algorithm dsk_000, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 332: For algorithm dsk-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals

372
Cross country FMR at threshold T = 48.749 for algorithm einetworks_000, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 333: For algorithm einetworks-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

373
Cross country FMR at threshold T = 2.426 for algorithm everai_002, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 334: For algorithm everai-002 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

374
Cross country FMR at threshold T = 0.311 for algorithm f8_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 335: For algorithm f8-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals

375
Cross country FMR at threshold T = 1.300 for algorithm facesoft_000, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 336: For algorithm facesoft-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

376
Cross country FMR at threshold T = 0.591 for algorithm glory_000, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

377
Cross country FMR at threshold T = 0.596 for algorithm glory_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

378
Cross country FMR at threshold T = 0.402 for algorithm gorilla_002, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

379
Cross country FMR at threshold T = 0.357 for algorithm gorilla_003, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

380
Cross country FMR at threshold T = 63.025 for algorithm hik_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 341: For algorithm hik-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different individuals

381
Cross country FMR at threshold T = 0.727 for algorithm hr_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

382
Cross country FMR at threshold T = 0.109 for algorithm hr_002, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

383
Cross country FMR at threshold T = 36641.000 for algorithm id3_003, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

384
Cross country FMR at threshold T = 36163.000 for algorithm id3_004, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

385
Cross country FMR at threshold T = 3261.090 for algorithm idemia_004, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

386
Cross country FMR at threshold T = 3178.151 for algorithm idemia_005, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

387
Cross country FMR at threshold T = 0.721 for algorithm iit_000, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

388
Cross country FMR at threshold T = 0.647 for algorithm iit_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

389
Cross country FMR at threshold T = 0.809 for algorithm imagus_000, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 350: For algorithm imagus-000 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

390
Cross country FMR at threshold T = 1.302 for algorithm imperial_000, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

391
Cross country FMR at threshold T = 1.285 for algorithm imperial_002, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

392
Cross country FMR at threshold T = 1.340 for algorithm incode_003, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

393
Cross country FMR at threshold T = 1.314 for algorithm incode_004, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

394
Cross country FMR at threshold T = 21.422 for algorithm innovatrics_004, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

395
Cross country FMR at threshold T = 20.505 for algorithm innovatrics_006, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

396
Cross country FMR at threshold T = 0.662 for algorithm intellicloudai_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 357: For algorithm intellicloudai-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

397
Cross country FMR at threshold T = 0.240 for algorithm intellifusion_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)
Figure 358: For algorithm intellifusion-001 operating on visa images, the heatmap shows false match rates observed over impostor comparisons of faces from different

398
Cross country FMR at threshold T = 37.554 for algorithm intellivision_001, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

399
Cross country FMR at threshold T = 31.547 for algorithm intellivision_002, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_BRZL
CSAMERIC_BRZL
SSAFRICA_GHAN
SSAFRICA_GHAN
CSAMERIC_GUAT
CSAMERIC_GUAT
CSAMERIC_VENZ
CSAMERIC_VENZ
CSAMERIC_CSTR
CSAMERIC_CSTR
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_ECUA
CSAMERIC_PERU
CSAMERIC_HOND
CSAMERIC_HOND
FMR(T)
FNMR(T)

400
Cross country FMR at threshold T = 565.207 for algorithm intelresearch_000, giving FMR(T) = 0.001 globally.
log10 FMR
−6 −5 −4 −3 −2 −1
2019/10/16 12:43:37
SSAFRICA_NRA
SSAFRICA_KENY
SSAFRICA_GHAN
SASIA_PKST
SASIA_NEP
SASIA_IND
POLY_PHIL
NAFRICA_EGYP
MEAST_TRKY
MEAST_SARB
MEAST_LEBN
MEAST_ISRL
FRVT
EURO_UKR
-
EURO_SAFR
EURO_RUS
EURO_ROM
EURO_POL
EURO_GRC
EURO_GRBR
EURO_GER
EURO_CZEC
EURO_ASTL
EASIA_VTNM
EASIA_TWAN
EASIA_THAI
EASIA_MLAS
EASIA_KOR
EASIA_JPN
EASIA_IDSA
EASIA_HNK

EASIA_CHIN
CSAMERIC_VENZ
CSAMERIC_PERU
CSAMERIC_MEX
CSAMERIC_HOND
CSAMERIC_GUAT
CSAMERIC_ELSL
-
CSAMERIC_ECUA
CSAMERIC_CSTR
CSAMERIC_CHIL
CSAMERIC_BRZL
CSAMERIC_ARG
CARIB_TRIN
CARIB_JAM
CARIB_HAT
CARIB_DOMR
CARIB_CUBA
VERIFICATION
SASIA_IND
SASIA_IND
POLY_PHIL
POLY_PHIL
EASIA_JPN
EASIA_JPN
EURO_POL
EURO_POL
CARIB_HAT
CARIB_HAT
EURO_RUS
EURO_RUS
EURO_UKR
EURO_UKR
SASIA_NEP
SASIA_NEP
CARIB_JAM
EURO_GER
CARIB_JAM
EURO_GER
EASIA_HNK
EASIA_HNK
EASIA_KOR
EASIA_KOR
EURO_GRC
EURO_GRC
EURO_ROM
EURO_ROM
EASIA_THAI
EASIA_THAI
EASIA_IDSA
EASIA_IDSA
EURO_ASTL
EURO_ASTL
CARIB_TRIN
EASIA_CHIN
CARIB_TRIN
EASIA_CHIN
EURO_SAFR
EURO_SAFR
SASIA_PKST
SASIA_PKST
EURO_CZEC
EURO_CZEC
EASIA_MLAS
MEAST_ISRL
EASIA_MLAS
MEAST_ISRL
EURO_GRBR
EURO_GRBR
EASIA_VTNM
EASIA_VTNM
CARIB_CUBA
CARIB_CUBA
EASIA_TWAN
EASIA_TWAN
MEAST_LEBN
MEAST_LEBN
CARIB_DOMR
MEAST_TRKY
CARIB_DOMR
MEAST_TRKY
MEAST_SARB
MEAST_SARB
SSAFRICA_NRA
SSAFRICA_NRA
NAFRICA_EGYP
NAFRICA_EGYP
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_ARG
CSAMERIC_MEX
CSAMERIC_CHIL
CSAMERIC_CHIL
CSAMERIC_ELSL
SSAFRICA_KENY
CSAMERIC_ELSL

FRVT Report 2019 10 16 PDF

Uploaded by

Document Information

Original Description:

Original Title

Copyright

Available Formats

Share this document

Share or Embed Document

Sharing Options

Did you find this document useful?

Is this content inappropriate?

Copyright:

Available Formats

FRVT Report 2019 10 16 PDF

Uploaded by

Copyright:

Available Formats

NISTIR XXXX Draft

Ongoing Face Recognition

This publication is available free of charge from:

FNMR(T) “False non-match rate”

Changes since September 11, 2019:

Changes since July 31 2019:

Changes since July 3 2019:

FNMR(T) “False non-match rate”

Changes since June 20 2019:

Changes since April 2019:

Changes since February 2019:

FNMR(T) “False non-match rate”

FNMR(T) “False non-match rate”

FNMR(T) “False non-match rate”

4 PERFORMANCE ON 20 HUMAN - DIFFICULT PAIRS . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 38

FNMR(T) “False non-match rate”

61 SEX AND RACE EFFECTS : MUGSHOT IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 95

FNMR(T) “False non-match rate”

118 ERROR TRADEOFF CHARACTERISTIC : MUGSHOT IMAGES . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 154

FNMR(T) “False non-match rate”

173 ALGORITHM DAHUA -002 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 213

FNMR(T) “False non-match rate”

230 ALGORITHM NEUROTECHNOLOGY-005 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 270

FNMR(T) “False non-match rate”

287 ALGORITHM VISIONLABS -006 CROSS REGION FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 327

FNMR(T) “False non-match rate”

344 ALGORITHM ID 3-003 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 384

FNMR(T) “False non-match rate”

400 ALGORITHM SENSETIME -001 CROSS COUNTRY FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 440

FNMR(T) “False non-match rate”

456 ALGORITHM ANYVISION -004 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 497

FNMR(T) “False non-match rate”

513 ALGORITHM INTSYSMSU -000 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 554

FNMR(T) “False non-match rate”

570 ALGORITHM TIGER -002 CROSS AGE FMR . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 611

FNMR(T) “False non-match rate”

FACE RECOGNITION VENDOR TEST

41 Ever AI everai 002 2019-03-01 561727 4096 ± 0 758 ± 0 No 644 ± 14 624 ± 35

FACE RECOGNITION VENDOR TEST

150 95 148 148

85 Megvii/Face++ megvii 002 2018-10-19 1809564 No

FACE RECOGNITION VENDOR TEST

132 8 140 141

129 TongYi Transportation Technology tongyi 005 2019-06-12 1140701 No

FACE RECOGNITION VENDOR TEST

FACE RECOGNITION VENDOR TEST

44 facesoft-000 0.0085 34 0.0112 29 0.0032 31 0.0064 16 0.0107 18 0.0091 11 0.0275 3 0.4992 17

FACE RECOGNITION VENDOR TEST

FACE RECOGNITION VENDOR TEST

FACE RECOGNITION VENDOR TEST

1.8 2.1 2.4 2.7

FACE RECOGNITION VENDOR TEST

FACE RECOGNITION VENDOR TEST

1.1 Core accuracy

where H(x) is the unit step function, and H(0) taken to be 1.

FNMR(T) “False non-match rate”

2.1 Child exploitation images

. The number of images is on the order of 104 .

. The number of subjects is on the order of 103 .

. The number of subjects with two images on the order of 103 .

. The images are of children, from infancy to late adolescence.

2.2 Visa images