1. Introduction
Fingerprints, characterized as unique biometric features of the human body [
1], exhibit distinctiveness and immutability over time [
2]. With intricately complex patterns, fingerprints pose a formidable challenge to forging, making them indispensable for various applications such as document signing and attendance tracking. In the twenty-first century, fingerprints have evolved into a pivotal tool for enhancing information security. As fingerprint technology continues to mature, its application scope has significantly broadened, finding widespread utility in fields like identity verification [
3], medical applications [
4,
5], and forensic identification [
6,
7]. However, certain demographic groups, including individuals with disabilities, those engaged in manual labor, or professionals in specialized occupations such as swimmers and researchers exposed to chemicals, often confront issues like partial or worn fingerprints. The disappearance of fingerprints presents substantial challenges for these individuals, affecting activities such as unlocking smartphones [
8], visa processing, attendance tracking, and banking transactions. While superficially damaged fingerprints can be restored [
9], the recovery period for fingerprint skin is relatively extended [
10]. Therefore, the imperative to back up personal fingerprints and fabricate fingerprint membranes [
11] becomes crucial to address unforeseen circumstances.
With the rapid advancement of technology, the design and functionalities of smartphones are continually evolving. Among these advancements, in-display fingerprint scanning technology has emerged as a recent trend in the mobile industry [
12,
13]. This technology utilizes the screen as a fingerprint recognition sensor, employing optical [
14] or ultrasonic [
15,
16] methods to collect fingerprint information. It then compares this information with pre-stored fingerprint data to achieve fingerprint unlocking. The principle behind optical fingerprint recognition involves the refraction and reflection of light. When a user places their finger in the unlocking area, the region is illuminated, causing different angles and intensities of reflected light to occur on the "ridge lines" and "valley lines" of the fingerprint (
Figure 1). These reflections pass through the pixel gaps of the screen and are received by the optical sensor beneath the screen, enabling fingerprint identification [
17]. In contrast, ultrasonic fingerprint recognition relies on the contact of ultrasonic waves with the "ridge lines" and "valley lines" of the fingerprint (
Figure 1). Differences in absorption, penetration, and reflection levels produce echoes of varying energy, which are then detected by the sensor, allowing for the determination of the specific form of the fingerprint [
16]. The distinction between the two lies in the fact that optical fingerprint recognition captures 2D fingerprint images, while ultrasonic fingerprint recognition senses the 3D morphology of the fingerprint. Optical and ultrasonic in-display fingerprint locks represent the mainstream solutions currently available in the market, widely adopted by numerous renowned smartphone brands globally, including Apple, Samsung, Huawei, Xiaomi, and others [
18].
Fingerprint impression is the most widely used fingerprint preparation method [
19]. This procedure entails directly molding one’s finger on modeling hot melt glue, enabling the hot melt glue to solidify and cool, ultimately yielding a fingerprint model. Subsequently, the fingerprint membrane is cast using this model. Generally, two primary types of fingerprint membranes are available: regular silicone fingerprint membranes and capacitive conductive silicone fingerprint membranes.
Numerous researchers have conducted experiments using fingerprint impression technique to circumvent smartphone fingerprint locks. The research outcomes indicated that fingerprint membranes produced through fingerprint impression could successfully unlock smartphones. The ease of breaching smartphone security varied among different brands and models. For some smartphones, creating a regular silicone fingerprint model was sufficient, while others necessitated the fabrication of capacitive conductive silicone fingerprint models. Despite the noteworthy effectiveness of fingerprint impression technology in backing up fingerprints, it demands a certain level of molding skill. In comparison to genuine fingerprints, those prepared through fingerprint impression may exhibit issues such as "blank" or "broken" features, irregular edges, uneven surfaces, and indistinct secondary features.
Since the outbreak of the COVID-19 pandemic in 2019, there has been an urgent demand for non-contact collection and more precise and efficient fingerprint backup techniques. In recent years, 3D printing technology, as an emerging digital manufacturing technology, has rapidly advanced. Stereo-lithography Apparatus (SLA) technology, the earliest commercialized form of 3D printing, demonstrates higher part accuracy compared to other 3D printing techniques, achieving precision within 10 μm. Research indicates that the spatial distance between the ridge and valley lines of human fingerprints is approximately 60 μm [
20]. Therefore, the precision of SLA printing is sufficient to meet the requirements for preparing fingerprint molds, providing an alternative means of obtaining fingerprint membranes. This entails the utilization of only a fingerprint photograph, processing software, and a 3D printer to unlock a smartphone. Consequently, several researchers have explored the use of SLA printing technology for fingerprint backup. Maro et al. [
21] utilized SLA printing to fabricate artificial fingerprint membranes, successfully unlocking the fingerprint lock systems of iPhone 6, iPhone 8, Samsung Galaxy S8, Meizu M5s smartphones, iPad Air 2, and Schenker XMG A507 laptop. Arora et al. [
22] employed 3D printing technology to design and manufacture a wearable fingerprint device that interacts with fingerprint reader panels, replicating the behavior of a normal finger and facilitating various operational settings. However, existing studies have predominantly concentrated on backing up unworn fingerprints, a task for which traditional fingerprint impression technique can yield similar results with pristine fingerprints. The advantage of employing 3D printing technology for fingerprint backup lies in its capability to address challenges faced by traditional fingerprint impression method in accurately replicating fingerprints from unclean or worn fingers through image processing. Nevertheless, research on obtaining, processing, and recognizing fingerprint images in a damaged state using 3D printing technology is presently limited.
Additionally, we delve into the impact of factors such as fingerprint image processing and ridge height settings on SLA-printed fingerprint molds. The objective of this study is to provide a more comprehensive understanding of fingerprint backup technologies, aiming to address the challenges faced by specific user groups encountering difficulties in normal fingerprint unlocking. Furthermore, this research contributes insights that may inform the security considerations of future fingerprint unlocking systems.
In this study, we address fingerprints with varying degrees of wear by employing both traditional fingerprint impression techniques and SLA printing technology to create fingerprint molds. And then conducted unlocking tests on several widely available smartphones equipped with in-display fingerprint recognition systems, recording the unlock success rates. Through experimental research, the unlocking success rates of these two fingerprint backup methods for fingerprints with different levels of wear were compared. Additionally, the impact of factors such as fingerprint image processing and ridge height settings on SLA-printed fingerprint molds were also investigated. The objective of this study is to provide a more comprehensive understanding of fingerprint backup technologies, aiming to address the challenge faced by specific user groups who encounter difficulties in normal fingerprint unlocking. Furthermore, this research contributes insights that may inform the security considerations of future fingerprint unlocking systems.
5. Conclusions
This study provided an in-depth analysis of the preparation efficacy of two fingerprint backup methods, namely fingerprint impression and SLA printing, concerning fingerprints with varying degrees of wear. By delving into the optimization of the SLA process for preparing fingerprint membranes, the study aimed to enhance the quality and performance of fingerprint models, ensuring more reliable outcomes in unlocking tests. The findings of this research hold significant guiding implications for the development and improvement of fingerprint backup technologies. The specific conclusions are as follows:
(1) Both fingerprint impression and SLA printing methods successfully produce fingerprint membranes capable of unlocking an under-display fingerprint lock. However, fingerprint membranes created through the fingerprint impression method are susceptible to the condition of finger wear. As the degree of finger wear increases, the unlocking success rate of the molded fingerprint membranes decreases. After 30 times of finger fingerprint polishing, the lowest unlocking success rate achieved using the fingerprint impression method is 24.4%, reaching a maximum of only 35.6%.
(2) Fingerprint membranes prepared using the SLA printing method for worn fingerprints exhibit a lower unlocking performance in their untreated state compared to fingerprint membranes obtained through the fingerprint impression method. The unlocking success rate ranges from 20% to 26.7%. However, through further image processing and optimization of ridge height parameters, the quality and unlocking success rate of the fingerprint membranes can be significantly improved. The optimal unlocking success rate can reach up to 91.1%.
Figure 1.
The ridge line, valley line and ridge height of fingerprint.
Figure 1.
The ridge line, valley line and ridge height of fingerprint.
Figure 2.
Schematic diagram of the workflow for making fingerprint membrane using fingerprint impression method.
Figure 2.
Schematic diagram of the workflow for making fingerprint membrane using fingerprint impression method.
Figure 3.
Schematic diagram of the workflow for making fingerprint membrane by SLA printing method.
Figure 3.
Schematic diagram of the workflow for making fingerprint membrane by SLA printing method.
Figure 4.
Fingerprint molds and membranes prepared from fingerprints with different degrees of wear using fingerprint impression method. Polishing times: (a) and (e) 0 times, (b) and (f) 10 times, (c) and (g) 20 times, (d) and (h) 30 times.
Figure 4.
Fingerprint molds and membranes prepared from fingerprints with different degrees of wear using fingerprint impression method. Polishing times: (a) and (e) 0 times, (b) and (f) 10 times, (c) and (g) 20 times, (d) and (h) 30 times.
Figure 5.
(a) The fingerprint image collected through powder dusting method, (b) fingerprint image after processing, (c) three-dimensional fingerprint model built by Zbrush software, (d) fingerprint mold printed by SLA.
Figure 5.
(a) The fingerprint image collected through powder dusting method, (b) fingerprint image after processing, (c) three-dimensional fingerprint model built by Zbrush software, (d) fingerprint mold printed by SLA.
Figure 6.
(a) Preparation of fingerprint membrane, (b) fingerprint membrane, (c) unlocking test.
Figure 6.
(a) Preparation of fingerprint membrane, (b) fingerprint membrane, (c) unlocking test.
Figure 7.
The unlocking pass rate of fingerprint membrane obtained under different polishing times.
Figure 7.
The unlocking pass rate of fingerprint membrane obtained under different polishing times.
Figure 8.
Using (a)- (e) unprocessed and (f)- (j) processed fingerprint images to backup fingerprints. (a) and (f) fingerprint image, (b) and (g) 3D fingerprint model, (c) and (h) partial enlarged view of 3D fingerprint model, (d) and (i) printed fingerprint mold, (e) and (j) fingerprint membrane.
Figure 8.
Using (a)- (e) unprocessed and (f)- (j) processed fingerprint images to backup fingerprints. (a) and (f) fingerprint image, (b) and (g) 3D fingerprint model, (c) and (h) partial enlarged view of 3D fingerprint model, (d) and (i) printed fingerprint mold, (e) and (j) fingerprint membrane.
Figure 9.
Fingerprint membranes made of three-dimensional models of different ridge heights. (a)- (d) 30μm, (e)- (h) 60μm, (i)- (l) 90μm, (m)- (p) 120μm.
Figure 9.
Fingerprint membranes made of three-dimensional models of different ridge heights. (a)- (d) 30μm, (e)- (h) 60μm, (i)- (l) 90μm, (m)- (p) 120μm.
Figure 10.
The unlocking pass rate of fingerprint membrane obtained from different fingerprint ridge height models.
Figure 10.
The unlocking pass rate of fingerprint membrane obtained from different fingerprint ridge height models.
Table 1.
Results of the fingerprint membrane unlock fingerprint lock test.
Table 1.
Results of the fingerprint membrane unlock fingerprint lock test.
|
Huawei Mate 30 pro |
Huawei Mate 40 pro |
Xiaomi 10 |
Honor 10 |
OPPO Reno 6 |
Untreated fingerprint images |
20.0% |
28.9% |
22.2% |
24.4% |
26.7% |
Processed fingerprint images |
60.0% |
62.2% |
73.3% |
66.7% |
68.9% |