Usability testing with voice assistant

Methodology

Usability testing + interview

Industry

Year

Mobility 

2019

*Due to the confidentiality of the research, only the main learnings will be shared, not the results

The challenge

Evaluate the context and usability of two voice assistants prototypes in two locations.

About the project & research

Sometimes businesses do research at a very advanced stage of the development of a project so we are only sought out for very specific details and the advice only applies for those.

A good thing about this project was that we received a prototype voice assistant that was in its early stages of development and our feedback worked to understand a lot, not only about the assistant itself, but about the context and how a person builds and moves in the city.

 

If our client had not done this research it would have been very complicated for them to understand the whys and wherefores of programming the assistant to suit the user it is being designed for.

What we learn as a team?

Before testing, read and talk with the experts

We decided to start reading a book about voice assistants and also attended a couple of meetingups and scheduled a private session with an IBM voice assistant programmer. This allowed us to understand the technical construction and the possibilities of carrying out a project like this on a user research level.

Technical control gives power to the researcher
Unlike usability testing with an app, testing with voice assistants needs much more control. You must know the dialogues before starting, their reactions, and have the transcripts of each test. 

 

Pilot tests are necessary
Because the voice assistant was activated with the Google assistant and that could be seen on the screen, we had to cover it in order to simulate a call where there was only voice, no text. Pilot tests had to be done earlier to avoid technical errors in the real tests.

Avoiding external sounds that make it impossible to use the assistant

Our goal was to understand the operation of the voice assistant for calling a taxi, so we tried to avoid outside sounds that could interfere with the test.

Meet your stakeholders
During the whole project we asked who would be our interlocutors in order to better orient our discourse and results. 

 

Before testing, read and talk with the experts

We decided to start reading a book about voice assistants and also attended a couple of meetups and scheduled a private session with an IBM voice assistant programmer. This allowed us to understand the technical construction and the possibilities of carrying out a project like this on a user research level.

Want to know more about this project?

Write me an e-mail: jackieebenitez@gmail.com or send me a DM :)
 

  • LinkedIn
  • Twitter
  • Instagram

© 2020 JBH