RITE usability test

Photo by Matthieu Joannon on Unsplash

Project Overview

Product: Fair Hire AI resume anonymization prototype

Role: Founder & UX Researcher

Method: RITE usability testing

Participants: 12 hiring managers / HR professionals

Outcome: Redesigned workflow and multi-file support

Background

Hiring managers support blind hiring in principle, but existing tools are cumbersome.

We needed to determine whether recruiters could intuitively anonymize resumes using our prototype without training.

Objectives/Research Questions

Approach

Methodology: RITE (Rapid Iterative Testing and Evaluation)

Participants: 12 hiring managers and HR professionals

Session format:

Tasks

Results (Metrics)

Task Success Rate Observations
Upload resume 60% unclear first step, expected multi-file support
Anonymize file 70% confusion about workflow, expected to select which data to mask
Download file 85% minor issues

Results were captured in a rainbow sheet to detect trends.

Step 1: Upload file(s)

Fair Hire AI wizard step 1: upload files to anonymize

RITE Updates

Design Impact

The RITE sessions led to three major changes:

  1. Guided 3-step workflow
    Upload → Select anonymization → Download
  2. Batch processing
    Users can upload multiple resumes
  3. Selectable anonymization fields
    Users control which data to mask

Step 2: Select information to mask

Fair Hire AI wizard step 2: select personal information to redact

Step 3: Anonymize file(s)

Fair Hire AI wizard step 3: review and anonymize uploaded files

Retrospective

What I Learned

Next Steps