USABILITY TESTING & RECOMMENDATIONS I CLIENT
Due to my NDA with PILOT, this work reflects high level content only
PILOT is an innovative career improvement company revolutionizing the way individuals command their career. PILOT combines an easy-to-use technology platform with focused, real-world advice that empowers individuals to take control of their professional success.
PILOT launched their first web-based product, the Job Renovator, in May 2016. The Job Renovator is a five step process designed to quickly make you more satisfied every day at work.
PILOT, a New York City-based start-up, had been in beta phase with their consumer tech product, the Job Renovator, prior to our work with them. My team and I performed usability testing on the Job Renovator product with potential users and advised PILOT on how to improve the product based on user-centered feedback.
As project manager, I led the UX team for our three week sprint with PILOT. I was also the main point of contact with the client and our scheduled user testers. I was the primary user researcher - writing our Usability Findings Report and performing half of our user testing. I assisted in the design and protoyping of the Job Renovator Version 1.0 and Version 2.0 that we created for PILOT.
PILOT launched their consumer tech product, The Job Renovator, May 2016. The scope of my project with PILOT focused on the following objectives :
Test the Job Renovator product with potential users. My team and I tested the full scope from purchase, signup and reassessement.
Review and recommend how to improve the product with any possible additional features that users mau be able to add based on research and testing. These recommendations could include both add-on purchase items or embedded features to core product.
My colleagues and I created an Affinity Map based on two surveys that we submitted. Based on our results, we created several versions of an Affinity Map using Post It notes by grouping together similar thoughts. This image represents our final Affinity Map that was created.
Our User Testing script was based on Nielsen Norman Group's usability studies. We performed usability testing over a two week span. The purpose of the test was to assess the usability, information flow and information architecture of the product. User testing was performed via Skype using screen sharing, and all participants gave verbal confirmation to be recorded. Each user who participated was given a $20 Amazon gift card, provided by PILOT. Testing lasted approximately 30 minutes.
Sample questions included the following:
- You can scroll if you want to, but don’t click on anything yet. Just look around and do a little narrative.
- First, I’m going to ask you to look at this page and tell me what you make of it?
- What strikes you about it, whose site you think it is, what you can do here, and what it’s for.
- What do you think this product is about?
- What are your overall thoughts about this video?
- Where do you expect to go next?
USABILTY FINDINGS & RECOMMENDATIONS
Nine of our user tests were conducted remotely, using Skype's screen sharing capabilities. Three user tests were performed on usertesting.com. In the remote user testing, the test administrator and data logger were present in the testing room. The session captured the participant's navigational choices, task completion, comments, questions and feedback.
USABILITY FINDINGS REPORT
Due to my NDA with PILOT, I am unable to share my Usability Report. Highlights of the usability findings included:
Users hesitated or were confused over unmarked voice recordings.
Users hesitated or were confused on how to proceed to next pages on the Devote and Assessment page - due to lack of error management and poor use signifiers.
Users want more actionable steps and content after they completed the product.
Based on the usability findings, my team and I designed a Version 1.0 for the Job Renovator.
Version 1.0 includes the following changes:
Users only had to click one button to begin the Job Renovator process VERSUS selecting five tickboxes and needing to click Submit.
Informational tracker bar outlining the user's place in the assessment.
Additional icons to guide the user for actions that were missing affordances.
In addition to the features we recommend in V1.0, Version 2.0 includes the following changes:
Added a User Profile, so users can be taken directly to their completed Blueprint.
Added warm colors, so users don't think of this as a clinical process.
Created an actionable Blueprint, so users can track their progress.
Click to see V3.0 of the Job Renovator here