Professional Documents
Culture Documents
Journal of Forensic Sciences - 2016 - Linden - Forensic Analysis of Digital Dynamic Signatures New Methods For Data
Journal of Forensic Sciences - 2016 - Linden - Forensic Analysis of Digital Dynamic Signatures New Methods For Data
Journal of Forensic Sciences - 2016 - Linden - Forensic Analysis of Digital Dynamic Signatures New Methods For Data
See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
J Forensic Sci, March 2017, Vol. 62, No. 2
doi: 10.1111/1556-4029.13288
PAPER Available online at: onlinelibrary.wiley.com
QUESTIONED DOCUMENTS
Jacques Linden,1 M.Sc.; Raymond Marquis,1 Ph.D.; and Williams Mazzella,1 Ph.D.
ABSTRACT: This study explored digital dynamic signatures containing quantifiable dynamic data. The change in data content and nature
necessitates the development of new data treatment approaches. A SignPad Omega digitizing tablet was used to assess measurement repro-
ducibility, as well as within-writer variation and the occurrence of correctly simulated features. Measurement reproducibility was found to be
high except for pressure information. Within-writer variation was found to be higher between days than on a same day. Occurrence of correct
simulation was low for features such as signature size, trajectory length, and total signature time. Feature discrimination factors combining
within-writer variability and the occurrence of correctly simulated features were computed and show that signature size, trajectory length, and
signature time are the features that perform the best for discriminating genuine from simulated signatures. A final experiment indicates that
dynamic information can be used to create connections between simulation cases.
KEYWORDS: forensic science, forensic document examination, dynamic signature, data analysis methods, variation study, feature
discrimination
questioned value to the reference boxplot. The value measured distance. As for the reference signatures, the data from the thirty
from the questioned signature was then positioned as being in genuine signatures were compared for each combination, creat-
the main variation (box), the borderline regions (upper and lower ing a large body of Euclidean distance data. All distances, 435
25%), or as an outlier. All cases that were on the borderline of for a thirty signature set, were then used to create a boxplot to
the variation were classified as accepted, and only outliers were quantify within-writer variation for the local features. Questioned
classified as refused. This categorical statement scheme yielded signatures were compared to each signature in the reference set
high acceptance rates and may produce false positives from the (thirty comparisons in total for a given questioned signature),
borderline values that may cause underestimation of feature and the mean distance was plotted with the reference set’s dis-
discriminative power. tance boxplot. Comparison was carried out in the same way as
Genuine signatures were grouped together (thirty signatures for the global characteristics, where the mean distance between
per writer) and compared with each other to generate within- the questioned signature data and the reference set was used to
writer variation. For local features, day-to-day comparison was determine whether or not the values were inside or outside of
carried out by DTW. The sets per day, formed of ten signatures, the genuine writer’s variation.
were taken one by one, and each signature in a set was com- The third and last approach consisted in segmenting the signa-
pared to each signature in a second set. The mean distance from ture into smaller units to extract movement-related information.
those comparisons was then plotted as a boxplot to illustrate Signatures were analyzed for changes in direction (horizontal
day-to-day variation. As for genuine and simulation comparison, and vertical) that, by hypothesis, impose movement constraints
each feature was compared to the writer’s standard value and on the signatory. As an example, a sharp turn would impose a
classified as inside or outside natural variation, yielding an deceleration of the pen and a decrease in pressure, while a large
occurrence frequency per feature. rounded turn would only require a lesser change in dynamics.
The simulated signatures were also compared to the set of Straight segments between separation points should show accel-
genuine signatures. Each feature was measured against the gen- eration at the beginning, stable velocity in the middle, and decel-
uine set, and the feature value was either classified as different eration at the end. Segments between turning points were thus
or not matching. This yielded an occurrence of correctly simu- supposed to be more homogenous and comparable on a dynamic
lated features. scale, as they constitute a dynamic unit. An example of the
resulting segmentation is given in Figs 4 and 5. An algorithm
detecting changes in direction was developed, and additional or
Within-Writer Variation and Occurrence of Correctly Simulated missing points were corrected manually to equalize the number
Features of segments. For the reference set, each segment was grouped
The second step was the assessment of genuine signatures with its counterpart in the other signatures. Then boxplots for
variation for each of the chosen samples. Within-writer variation each dynamic characteristic were generated to show variation
was studied with signatures taken on three different days. Varia- per segment, and the stepwise rises and declines between seg-
tion was thus assessed within a single day as well as between ments. These data were then plotted against the mean values
days. Occurrence of correctly simulated features was studied with the standard deviation for the questioned signature.
using a database of the twenty best simulations per reference sig-
nature (a, b, and c). Feature Discrimination Factor
For the global features, we chose boxplots to visualize within-
writer variation measurements. As such, values could be plotted The third step was to compute a feature discrimination factor,
in a set containing all genuine signature values and a point con- a concept similar to discriminative power. Occurrence of genuine
taining the value measured on a questioned signature, as can be signatures fitting into the normal variation of the genuine signa-
seen in Fig. 2 below. Features were classified as either being tures for the given feature was divided by the occurrence of sim-
inside or outside of the total observed variation. This comparison ulated signatures fitting into the normal variation of the genuine
scheme was applied for all quantifiable characteristics. Nonquan- signature. The ratio of these occurrences combines within-writer
tifiable characteristics were subjectively qualified and it was then variation and between-writer variation data from a trained imita-
determined whether or not they matched. tor population. The feature discrimination factor expresses
For local characteristics, the three following approaches were whether or not that feature might be useful to classify a signa-
applied: ture into either the genuine or into the simulated signature popu-
The first approach consisted in a qualitative comparison by lation. A high ratio means that the feature has high potential to
either plotting multiple feature curves (generally two) on the differentiate both populations and thus is useful for the forensic
same graph (superposition) or by aligning several graphs document examiner, while values close to one imply low dis-
(juxtaposition). The plotted curves were the characteristics inten- crimination and impact on the classification. The estimated fea-
sity as a function of the timing or advancement ture discrimination factor is in no way an approach to evaluate
evidence findings. The proposed approach is purely aimed at
(TotalActual time
signature time 100). The main criteria for comparison determining which feature is most useful for classification and
were the general curve profile (general trends in the curve), the should possibly be prioritized or more highly valued during the
position of the main peaks, and their intensity, as can be seen in comparison phase.
Fig. 3.
The second approach uses a dynamic time warping (DTW)
algorithm, created by Giorgino (10) for the R software package, Results and Discussion
to mathematically compare the local characteristics. A symmetri- Reproducibility
cal DTW approach allowing only for complete graph compres-
sion/extension was chosen to keep the computation times low. Results showed that reproducibility of graphical features is
The dissimilarity between curves was measured using Euclidean very high with a few minor deviations, as can be seen in Fig. 6.
15564029, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/1556-4029.13288 by Niko KALANTZIS - <Shibboleth>-student@staffs.ac.uk , Wiley Online Library on [29/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
LINDEN ET AL. . DYNAMIC SIGNATURE ANALYSIS 385
850
18
CM
750
ms
16
14
650
12
FIG. 2––Illustration of the model used to assess whether features can be differentiated or not. Boxplots represent measurements for the thirty genuine
signatures. The dot represents the measurement of the questioned signature.
25
10
0
0 20 40 60 80 100
Advancement [%]
25
10
0
0 20 40 60 80 100
Advancement [%]
FIG. 3––Example of a feature graph comparison by juxtaposition of two genuine signatures (c).
Twenty autopen signatures can be superimposed almost (either amplification or reduction based on signal strength)
exactly, independently of the region where they were captured takes place for both low- and high-pressure signals, thus ren-
or the applied pressure. The few minor variations may be the dering the use of a mean pressure value as comparison feature
result of the imperfect pen fixation to the autopen device. useless. Authors report different conclusions on the use of
Total signature time varied very slightly. The highest variation pressure, some obtain better results (1,11–13) while integrating
was observed for the pressure information. The signal differed pressure into their classification models and some others claim
strongly between different regions on the digitizing tablet, significance only if the signal matches (5). Because the
making capture position an important factor. Results showed pressure measurement was region-dependent, it was considered
that intensity values on the low-pressure settings were often nonreliable and was discarded. This result highlights the need
higher or equivalent to the values obtained using high-pressure to check measurement reproducibility for each digitizing
settings. This led to the hypothesis that a signal pre-treatment system.
15564029, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/1556-4029.13288 by Niko KALANTZIS - <Shibboleth>-student@staffs.ac.uk , Wiley Online Library on [29/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
386 JOURNAL OF FORENSIC SCIENCES
Total time
600
ms
550
500
FIG. 7––Trend in median velocity in the signature segments of signature
(c). Each colour corresponds to a day. Curves are staggered vertically for 1 2 3
clarity. Day
Day seem to be conserved even between days. Again, all of the val-
15
1 ues superimpose at least partially. Trajectory length showed
2 large variations, on the scale of several centimeters. Variation
10
3 within days was often quite large, but between-day values
superimpose partially.
5 Total signature time (Figs 9 and 10) had complex variation
and was quite signature-dependent. Within days, values were
often grouped quite closely (variation of about 100 ms), but
0
variation was often quite significant between days, having only
1 2 3 4 5 6 7 8 very limited superimposition. The (b) signature was quite prob-
Segment lematic concerning this feature, as signature time seemed to get
slower every day. Still, signature time is undoubtedly linked to
FIG. 8––Signature (b) variation for velocity. trajectory length, which is also higher for the samples taken on
days two and three, possibly explaining some of the variation.
reproduced on several days. While not adapted for comparison Additionally, this high variation might also be explained by the
purposes, the approach may yet have potential for research and fact that signature (b) was only recently adopted by the signa-
variation studies. tory. The writer of signature (b) had to sign a lot of documents
for her job and changed her signature only three months prior to
the examination, possibly leaving her still in a learning phase,
Within-Writer Variation
where features and execution stabilize. The third signature was
Variation was studied in detail for each of the three signatures. the only with a pen-up movement, but the pen lift duration was
Qualitatively assessed features (e.g., form, slope, and line qual- reproducibly short, both within and between days, as can be seen
ity) were stable for each of the signatures. None of the thirty in Fig. 11.
genuine signatures presented any outliers for these features. All Dynamic feature variation was measured using the segmenta-
of them displayed a good fit in terms of form and slope. All the tion approach and the dynamic time warping method. The seg-
signatures showed good, smooth, and dynamic line quality. mentation approach yielded the general trends for corresponding
There were no significant differences observed on these macro- features, if one examined the median values for example.
scopic features acquired on signatures written on different days. Repeatable patterns and trends were observed for velocity and
The categories defined as low-confidence features (LCF) showed acceleration. Even though variation is clearly present, general
differing amount on variation depending on the characteristics. high and low regions as well as peaks are conserved between
Some, such as stroke angle and presence of stroke end artifacts days. The DTW method clearly shows that in velocity (Fig. 12)
in the form of hooks were very variable, but this variation was and acceleration (Fig. 13) graphs, within-day distances are lower
global and independent of the day. Others, such as internal letter than between-day distances.
proportions and proportions between letters, were more stable Generally speaking, variation between days is higher than
and reliable. Those features produced the same results for each within-day variation. This appears to be especially noticeable for
signature. Only the LCFs and specific features with low varia- dynamic features. This fact reaffirms the need for multiple sam-
tion mentioned above were chosen from the pool of LCFs for ples taken on different days, as suggested by Thiery (14).
the genuine-simulation comparisons, the reason being the low The chosen comparison approach yielded a very high “toler-
chance of discrimination between the two. ance” for feature measurements and thus high acceptance rates.
The quantitatively assessed features produced more noticeable Specifically, the acceptance percentage for each static character-
variation between signatures acquired on different days. Features istic was 100%, except for trajectory length, which had 97%
such as width and height varied often on the scale of a few mil- acceptance for signature (a). As for the dynamic features, the
limeters within a day. Height seems to be a more variable fea- same is true, except for velocity and acceleration in signature
ture than width, and two of three writers had quite large (a), which were at 98% acceptance and 99% for acceleration in
variations within a single day. Between days, values were signature (b).
15564029, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/1556-4029.13288 by Niko KALANTZIS - <Shibboleth>-student@staffs.ac.uk , Wiley Online Library on [29/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
388 JOURNAL OF FORENSIC SCIENCES
900
1200
ms
800
Euclidean Distance
1000
700
1 2 3
600
Day
500
FIG. 10––Signature (b) variation for total signature time.
400
Pause
Day 1 Day 2 Day 3 Day 1 - Day 1 - Day 2 -
Day 2 Day 3 Day 3
250
Time[ms]
tion.
50
ture time, and velocity. Second, one should take special care
with graphical LCF’s values. Some features, like starting angles
700
studied and used. Third, only one of the signatures was com-
posed of multiple strokes and contained pen lifts and pen lift
600
Conclusion Feature Accepted (%) Rejected (%) Accepted (%) Rejected (%) Accepted (%) Rejected (%)
Signature shape 70 30 55 45 80 20
Line quality 80 20 80 20 100 0
Signature slope 90 10 80 20 75 25
Bounding box dimensions 40 60 40 60 15 85
Bounding box ratio 75 25 15 85 75 25
Trajectory length 35 65 25 75 15 85
LCF 45 55 25 75 50 50
Conclusion Feature Accepted (%) Rejected (%) Accepted (%) Rejected (%) Accepted (%) Rejected (%)
Total signature time 35 65 45 55 15 85
Stops 100 0 85 15 100 0
Pen-up time - - - - 35 65
Execution/sequence 85 15 90 10 80 20
Velocity (DTW) 75 25 60 40 40 60
Acceleration (DTW) 70 30 60 40 70 30
TABLE 5––Static feature discrimination factors. comparisons show that simulations from the same person are
closer (regarding velocity and acceleration graphs) than simula-
Signature Signature Signature
Feature (a) (b) (c) Mean tions from different people. If this hypothesis is further tested
and explored, it might be possible to connect simulations made
Trajectory length 2.86 4.00 6.67 4.51 by the same person.
Bounding box 2.50 2.50 6.67 3.89
dimensions Finally, all the feature information per signature was consid-
Bounding box ratio 1.33 6.67 1.33 3.11 ered in a subjective manner to form a classification conclusion
LCF 2.22 4.00 2.00 2.74 (genuine/simulation). None of the simulated signatures showed
Signature shape 1.43 1.82 1.25 1.50 sufficient similarity on both dynamic and static levels to be clas-
Signature slope 1.11 1.25 1.33 1.23
sified as genuine. The testing procedure was not performed
Line quality 1.25 1.25 1.00 1.17
blind, but first experiments show that combining information
from the different techniques leads to correct conclusions. Still,
dynamic information needs to be considered together with the
static information. The obvious correlations between trajectory
TABLE 6––Dynamic feature discrimination factors.
path, trajectory length, size, as well as velocity and acceleration
Feature Signature (a) Signature (b) Signature (c) Mean make an independency assumption between these characteristics
impossible.
Total signature time 2.86 2.22 6.67 3.92
Pen-lift duration - - 2.86 2.86
Velocity (DTW) 1.31 1.66 2.50 1.82 Conclusions
Acceleration (DTW) 1.40 1.64 1.43 1.49
Direction/execution 1.18 1.11 1.25 1.18 This study focused on examining a state-of-the-art dynamic
Stops 1.00 1.18 1.00 1.06 signature system, determining whether or not the data provided
were reliable and how to use the data efficiently. It further inves-
tigated whether or not within-writer variation was sufficiently
small to attempt to discriminate genuine and simulated signa-
cases (84.21%) and were inside the imitator’s variation in only tures.
three cases (15.79%). Mostly, the other imitator’s velocity and Our results show that most of the data can be relied upon, but
acceleration features were quite different from each other, as can pressure information may be problematic, either as a result of
be seen in Fig. 17. sensor inadequacy, low discriminative value, or a combination
A possible explanation might be that the imitator uncon- of both, and was not considered. Data can be easily extracted,
sciously adopts a certain “compatible” way for him to imitate analyzed, and compared with a few lines of computer code. To
the signature in question and keeps that program in mind. compare the dynamic information, dynamic time warping
Thus, simulations produced by the same person are similar in (DTW) was proposed and showed promising results. This auto-
graphical and dynamical features. Considering that each person mated comparison yields distances that can be used to describe
has a different compatibility and motor program, the natural feature variation and distribution, as well as being less subjective
simulation profile is different between imitators. As such, than simple qualitative approaches.
15564029, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/1556-4029.13288 by Niko KALANTZIS - <Shibboleth>-student@staffs.ac.uk , Wiley Online Library on [29/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
390 JOURNAL OF FORENSIC SCIENCES
Acknowledgments
First and foremost, the authors would like to thank all of the
participants in the study, especially the signers. The authors
FIG. 17––Illustration of the DTW results of a set of three signatures (box) would also like to thank the many proofreaders and colleagues
and the distances of a questioned signature with said set (the upper dot cor- that were involved in the production of this article. The authors
responds to the mean distance and the lower dot corresponds to the closest would further like to thank two anonymous reviewers who con-
distance). tributed to the improvement of this paper.
References
The study showed the extent of variation within writers and
between genuine signatures and simulations. It also implies that 1. Mohammed L, Found B, Caligiuri M, Rogers D. Dynamic characteristics
of signatures: effects of writer style on genuine and simulated signatures.
separating genuine and simulated signatures is possible by study- J Forensic Sci 2015;60(1):89–94.
ing within- and between-writer variation and considering multi- 2. Franke K. The influence of physical and biomechanical processes on the
ple features. None of the simulations were perfect and could ink trace methodological foundations for the forensic analysis of
15564029, 2017, 2, Downloaded from https://onlinelibrary.wiley.com/doi/10.1111/1556-4029.13288 by Niko KALANTZIS - <Shibboleth>-student@staffs.ac.uk , Wiley Online Library on [29/10/2022]. See the Terms and Conditions (https://onlinelibrary.wiley.com/terms-and-conditions) on Wiley Online Library for rules of use; OA articles are governed by the applicable Creative Commons License
LINDEN ET AL. . DYNAMIC SIGNATURE ANALYSIS 391
signatures [Ph.D. thesis]. Rijksuniversiteit Groningen, the Netherlands: 11. Muramatsu D, Matsumoto T. Effectiveness of pen pressure, azimuth, and
University of Groningen, 2005. altitude features for online signature verification. In: Lee S-W, Li S, edi-
3. Flynn W. Executing a forensic examination of electronically captured tors. Advances in biometrics. Berlin/Heidelberg, Germany: Springer Ber-
signatures. J Am Soc Quest Doc Exam 2012;15(1):3–10. lin Heidelberg, 2007;503–12.
4. Nicolaides KA. Using acceleration plots in the forensic examination of 12. Tariq S, Sarwar S, Hussain W. Classification of features into strong and
electronically captured signatures. J Am Soc Quest Doc Exam 2012;15 weak features for an intelligent online signature verification system. Pro-
(2):29–43. ceedings of the First International Workshop on Automated Forensic
5. Harralson H. Developments in handwriting and signature identification in Handwriting Analysis; 2011 Sept 17–18; Beijing, China; http://ceur-
the digital age. London, U.K.: Routledge, Taylor & Francis Group, 2015. ws.org/Vol-768/ProceedingsAFHA.pdf.
6. Signotec. Signotec Homepage, 2016; http://www.signotec.com/produkte/ 13. Liwicki M. Automatic signature verification: in-depth investigation of
unterschriften-pads/omega-pad/. novel features and different models. J Forensic Doc Exam 2012;22:25–
7. Damilic. The Autopen Company homepage. Damilic, 2016; http://www. 39.
damilic.com/autopen-products/office-signature-machines (accessed Jan- 14. Thiery A, Marquis R, Montani I. Statistical evaluation of the influence
uary 20, 2016). of writing postures on on-line signatures. Study of the impact of time.
8. R Core Team. R: a language and environment for statistical computing. Forensic Sci Int 2013;230(1–3):107–16.
Vienna, Austria: R Foundation for Statistical Computing, 2015; https://
www.R-project.org/. Additional information and reprint requests:
9. Richiardi J, Ketabdar H, Drygajlo A. Local and global feature selection Jacques Linden, M.Sc.
for on-line signature verification. In: Werner B, editor. Eighth interna- Universite de Lausanne – School of Criminal Sciences
tional conference on document analysis and recognition, 2005 Aug 29– Batochime UNIL-Sorge
Sept 1; Seoul, Korea. Los Alamitos, CA: IEEE Computer Society, Lausanne-Dorigny Lausanne Vaud 1015
2005;625–9. Switzerland
10. Giorgino T. Computing and visualizing dynamic time warping align- E-mail: Jacques.linden@unil.ch
ments in R: the dtw package. J Stat Softw 2009;31(7):24.