Working on the PS5 was super exciting! Unfortunately, it also meant really tight controls on user research and user testing. Fortunately, privacy settings isn't exactly core functionality or exciting to leak to the masses, so we were allowed to test our work with minimal tweaks to remove any terms that could identify the screens as from PlayStation.
Click to launch the prototype in a new tab
As I mentioned before, these profiles followed a large body of existing research on players, so I was fairly certain on the concept as well as the major groups. For this test, I wanted to understand the following:
- On the initial page, is enough information provided for players to differentiate and choose an option?
- After selection, does the detailed description match their expectation?
- After reading the detailed description, do the actual settings and preset values match their expectations?
- At each stage, how confident are players that they will end up with the right settings for them?
Due to limited research resources at this time (always in high demand!), we enlisted the help of UserTesting.com to run an unmoderated qualitative study with 20 participants (15 adults, 5 minors) that self-identified as PlayStation owners. Since I wanted to check how well the statements resonated with each type of gamer persona, we recruited a mix of single player gamers, multiplayer gamers, and mixed (plays both types)--not perfect, but it was difficult to refine beyond that without introducing too much bias.
I collaborated heavily with our internal research team as well as the UserTesting.com team that was running the study for us, producing the prototype (shown above: simple click prototype using Sketch Cloud) as well as guiding the study script to ensure we got what we needed.
The prototype tested extremely well overall. Although this wasn't unexpected since it was based off of past research, it was very valuable for me to watch the recordings and see the positive reactions since it was all very theoretical for me up to this point. I was particularly happy about one quote from a participant:
Top level findings were as follows:
- Overall, participants understood that there was a gradient of privacy levels available and were able to find an option that suited their needs.
- Participants reported high confidence that the default settings were correct, even if they chose to make adjustments.
- The short descriptions for "Team Player" and "Off the Record" needed some clarification, some participants had trouble differentiating.
- The detailed descriptions reinforced what participants believed after reading the short description and added value in making them feel their choice was a good fit. Minor language tweaks needed as well.
- Participants valued the ability to customize settings but many were happy with the pre-set. A few participants indicated they would go directly to customize without selecting a profile, but were still able to identify a profile that matched their needs and agreed with the presets.