Building a speech recognition system with privacy identification information based on Google Voice for social robots
The Journal of Supercomputing, Apr 12, 2022
DOI: 10.1007/s11227-022-04487-3
Summary in three lines
- The paper studies speech recognition for social robots using Google Voice.
- It addresses speech inputs that contain information capable of identifying a person.
- The prototype was evaluated for accuracy and privacy protection in quiet, noisy, and music-playing settings.
Figures from the paper


Abstract
Currently, many smart speakers, even social robots, appear on the market to help people's lives become more convenient. Usually, people use smart speakers to check their daily schedule or control home appliances in their house. Many social robots also include smart speakers. They have the common property of being used in voice control machines. Regardless of where the smart speaker is installed and used, when people start a conversation with voice equipment, a security or privacy risk is exposed. Hence, we want to build a speech recognition (SR) that contains the privacy identification information (PII) system in this paper. We call this the SR-PII system. We used a Google Artificial-Intelligence-Yourself (AIY) Voice Kit released from Google to build a simple, smart dialog speaker and included our SR-PII system. In our experiments, we test SR accuracy and the reliability of privacy settings in three environments (quiet, noise, and playing music). We also examine the cloud response and speaker response times during our experiments. The results show that the speaker response is approximately 3.74 s in the cloud environment and approximately 9.04 s from the speaker. We also showed the response accuracy of the speaker, which successfully prevented personal information with the SR-PII system in three environments. The speaker has a response mean time of approximately 8.86 s with 93% mean accuracy in a quiet room, approximately 9.18 s with 89% mean accuracy in a noisy environment, and approximately 9.62 s with 90% mean accuracy in an environment that plays music. We conclude that the SR-PII system can secure private information and that the most important factor affecting the response speed of the speaker is the network connection status. We hope that people can, through our experiments, have some guidelines in building social robots and installing the SR-PII system to protect users’ personal identification information.
How to cite
P.-C. Lin, B. Yankson, V. Chauhan, and M. Tsukada, “Building a speech recognition system with privacy identification information based on Google Voice for social robots,” The Journal of Supercomputing, 2022, doi: 10.1007/s11227-022-04487-3.
BibTeX
@article{Lin2022d,
title = {Building a speech recognition system with privacy identification information based on Google Voice for social robots},
author = {Pei-Chun Lin and Benjamin Yankson and Vishal Chauhan and Manabu Tsukada},
doi = {10.1007/s11227-022-04487-3},
isbn = {1573-0484},
year = {2022},
date = {2022-04-12},
journal = {The Journal of Supercomputing},
abstract = {Currently, many smart speakers, even social robots, appear on the market to help people's lives become more convenient. Usually, people use smart speakers to check their daily schedule or control home appliances in their house. Many social robots also include smart speakers. They have the common property of being used in voice control machines. Regardless of where the smart speaker is installed and used, when people start a conversation with voice equipment, a security or privacy risk is exposed. Hence, we want to build a speech recognition (SR) that contains the privacy identification information (PII) system in this paper. We call this the SR-PII system. We used a Google Artificial-Intelligence-Yourself (AIY) Voice Kit released from Google to build a simple, smart dialog speaker and included our SR-PII system. In our experiments, we test SR accuracy and the reliability of privacy settings in three environments (quiet, noise, and playing music). We also examine the cloud response and speaker response times during our experiments. The results show that the speaker response is approximately 3.74 s in the cloud environment and approximately 9.04 s from the speaker. We also showed the response accuracy of the speaker, which successfully prevented personal information with the SR-PII system in three environments. The speaker has a response mean time of approximately 8.86 s with 93{%} mean accuracy in a quiet room, approximately 9.18 s with 89{%} mean accuracy in a noisy environment, and approximately 9.62 s with 90{%} mean accuracy in an environment that plays music. We conclude that the SR-PII system can secure private information and that the most important factor affecting the response speed of the speaker is the network connection status. We hope that people can, through our experiments, have some guidelines in building social robots and installing the SR-PII system to protect users’ personal identification information.},
keywords = {},
pubstate = {published},
tppubtype = {article}
}