Clarisa Diaz, Designer @Clarii_D
Complete the feedback loop to THOSE AFFECTED
● ● Limited time before publishing, particularly daily stories Complex organization in producing large projects
2. Talk to non-journalists (& non-DesignerS)
3. Listen & Observe, Ask WHY
5. Quality Check Revisions
Participant #1: ● ● ● Understood graphic talking about symptoms of heat illness, what to do is not as clear on both sides because of stars. CALL 9–1–1 is important as first step on heat stroke side. May Lose Consciousness is more of a symptom. Illustration is clear. Participant #2: ● Spanish is good, but the italics makes it look secondary, a little hard to read. Participant #3: ● Most important thing to do is call 9–1–1 when having a heat stroke, so that should be first.
Participant #4: ● ● First impression is to be aware of heat illness, notices call to action to either stay cool or call 9–1–1. Self-explanatory, pretty clear graphic. Participant #5: ● ● ● First sees body graphic, likes the round softness of it, not overly serious. Understood symptoms and graphics from both sides. Looks advisory.
First Iteration Published Iteration
Congressional Primary Election Guide, WNYC
NY Primary Election Guide, WNYC
General Election Guide, WNYC
Things we wanted to know Determine if users understand the election guide features and iconography:
● ● ● ● ● Is finding information about each race clear? Is finding information about each candidate clear? Is the election guide intuitive and easy to use? How do users react to the guide colors, photos and illustration? Are the icons understandable? Observe:
● Any points of frustration or distress ● Does the election guide make sense to them? ● Do they come away more knowledgeable?
Screener for selecting participants, choose a range of participants as diverse as possible.
The Interview Guide Warm-up Script Welcome. Thanks for coming in today. I’m a researcher and it’s my job to learn about you and observe how and why people use online tools. This is not a standard test, so there are no right or wrong answers or actions. Please speak openly and honestly throughout the session, and just imagine you’re putting your brain on speakerphone. Ask permission to record.
The Interview Guide Before we start ● ● ● ● ● What are the top websites you visit the most? What do you know about WNYC? Have you ever visited their website? How often do you visit? ○ For what reason? (Podcasts, streaming, on air (live), donation, etc.) Do you consider yourself an informed voter?
The Interview Guide Show the Prototype Imagine Election Day is coming up in a few days and you’re going to vote. You see this link to an election guide on your social media feed, you click and see this. 1. “What are you seeing?” 2. “What would you do next?”
The Interview Guide Follow up questions 1. On a scale from 1 to 10, how likely are you to use this? 2. Why? ● ● ● ● ● What do you like best about this experience? What do you like least about this experience? Was there anything confusing? What information would you want to know about voting in elections? Did you think there was information missing from this guide? What would be your next step after using this guide?
Resources General overview:
○ Usability Testing Demystified, by Dana Chisnell. http://bit.ly/2mN9U
○ Never Show a Design You Haven’t Tested on Users, by Ida Aalen. http://bit.ly/2mNp9Oh
○ Usability Testing. Oh, The Things You Can Learn., by Jared Spool. http://bit.ly/2mvKwaA
○ Two out of two news organizations recommend user research, by Laura Hazard Owen. http://bit.ly/2mvE97d
○ The Myth of Usability Testing, by Robert Hoekman Jr. http://bit.ly/2mvIKGy
○ Don’t Make Me Think, Revisited (book), by Steve Krug. New Riders Publishing, 2014. http://bit.ly/2lYEEns
○ You say "potato," I say "focus group" (video), by Steve Krug. http://bit.ly/2mHwkIv
○ How Usability Testing Can Improve News Stories, by Clarisa Diaz. http://bit.ly/2leS9SQ
The testing process:
○ Collaborative User Testing:
Less Bias, Better Research, by Alla Kholmatova. http://bit.ly/2mNsAVi
○ Improving Your Website Usability Tests, by Damian Rees. http://bit.ly/2lVWEAv
○ Quick and Dirty Remote User Testing, by Nate Bolt. http://bit.ly/2mNcRp0
○ A Guide To Simple And Painless Mobile User Testing, by Colman Walsh. http://bit.ly/2mbj5lq
○ Testing Content, by Angela Colter. http://bit.ly/2lB7uJC
○ UX for Lean Startups:
Faster, Smarter User Experience Research and Design, by Laura Klein. http://oreil.ly/2mNdzTc
Thank You, Feel Free to Reach out. Clarisa Diaz, WNYC @Clarii_D firstname.lastname@example.org