Why do you do human review of Hey Portal voice interactions?

We use both machine processes and human reviewers to train and improve our voice services to help make our voice services get smarter, more accurate and better for everyone. Making sure that our voice services can understand and respond to a wide range of speech patterns, phrases, local dialects, and accents is important to us. Human reviewers are particularly helpful in identifying voice interactions that machines are likely to misinterpret.

For example, someone might say "Newark," but with their accent, Portal could interpret what they said as "New York." Human reviewers are also useful in evaluating how well “Hey Portal” executes on your voice command. For example, we can evaluate if Portal actually called the person you meant to call, and help improve Portal to respond more accurately over time.