Your mobile phone may be unlocked by scanning lips in near future
With the continuous development of science and technology, smart phone technology is also constantly changing. From the initial key unlocking to slide-to-unlock, and now fingerprint and facial recognition unlocking, the unlocking recognition method of mobile phones has been updated again and again.
On June 29 2021, Huawei published a new patent for smartphone unlocking, entitled “equipment unlocking method and device”. The patent abstract shows that this application can use the biological attributes of lip movement characteristics for identity authentication, thereby unlocking the device, and has flexibility, anti-forgetting, anti-plagiarism, and modifiability.
The unlocking method consists of a scanning unit and an identifying unit. Just like face unlock we are familiar with, the device uses pre-store lip movements to perform the authentication. Here’s a brief introduction of this recognition method:
● The scanning unit scans the user’s lip movement picture
● Then it captures the first lip movement features according to the current lip movement picture
● According to the degree of matching between the first lip movement features and second lip moment features, it determines whether to unlock the device
As the first listed company in China’s AI data service industry, Datatang is committed to breaking through technical bottlenecks and developed datasets for lip movement recognition, such as “1,998 People — Lip Language Video Data”, “156 Hours — Lip Sync Multimodal Video Data”, “1,056 People Living Face & Anti-Spoofing Data” etc. These own copyright datasets are collected with proper data collection authorization agreement.
Data Size: 1,998 people, at least 14 videos per person, 41,866 videos in total
Age Distribution: ranging from teenager to the elderly, the middle-aged and young people are the majorities
Collecting Environment: indoor scenes
Accuracy: the accuracy of annotation of shooting time and video content exceeds 95%
156 Hours — Lip Sync Multimodal Video Data
Recording Environment: Using quiet sunny room to stimulate daytime outdoor driving scenes, Signal to noise ratio 25~20dB
Recording Content: Short signals and spoken sentences
Recording Angle: Recording videos of front face, single side face, looking up, looking down, side face looking down and side face looking up all 6 different angles, and proximal and distant audio at the same time
Accuracy: Accuracy of sentence exceeds 95%
Data Size: 1,066 people, 235 videos and 63 images for each person
Collection Diversity: various postures, expressions, light condition, scenes, time periods and distances
Accuracy: the accuracy of actions exceeds 97%, the accuracy of naming the actions and lip language exceeds 97%
If you need data services, please feel free to contact us： firstname.lastname@example.org