How not to user test. – Evaluation Comics

Skip to content

How not to user test.

Do you even know how to use a computer?

Published On: February 2, 2022

Freshspectrum cartoon by Chris Lysy - Weather app with a methods section.

Audience Interest Level Cartoon - High Interest - "Give me all the data." Medium interest - "Okay, I'm listening, what you got?" Low Interest - "I'm sorry did you say something?"

freshspectrum cartoon by Chris Lysy. Person driving a car (badly), "I love this new smart dashboard. It's so engaging. Look, you can play candy crush.

Freshspectrum cartoon by Chris Lysy. An older Alice seeing the white rabbit walk by, thinking, "Not falling for that one again. I'm much too busy anyway." Rabbit looking at pocketwatch saying, "I'm Late."

Freshspectrum comic by Chris Lysy. One person to another, "So you don't find long wordy evaluation reports inspiring? That's just me?

Freshspectrum cartoon by Chris Lysy, "I use lots of jargon because I care more about precision than you understanding my lesson."

Freshspectrum cartoon by Chris Lysy, Person 1, "A few years ago I launched my independent consulting practice." Person 2, "Neat, what kind of consulting do you do?" Person 1, "Oh, you know, a little of this, a little of that."

Freshspectrum cartoon by Chris Lysy. "We suggest using a modern 1:3:25 reporting strategy." "1 slidedoc, 3 blog posts, and 25 social media posts."

Freshspectrum cartoon by Chris Lysy. How to identify a data visualization expert.

You're blocking the chart!

3 Page report reads like a 50 page report

We need to prove evaluation works to others.

Rich like me cartoon.

I don't get it, it's just a simple word game.

"Careful? You fall into that and you'll never see our program in the same light again."

"So you just fell into evaluation?" person 2, "I considered starting my own nonprofit. But then I thought, we don't need more nonprofits, we need the ones we have to be more effective.

What it means to "fall into" evaluation. "Our grant application requires an evaluation plan. You're good at Excel and power point right?"

Fell into a logic model cartoon.

Have you ever flipped through a notebook and found some random phrase that you have no recollection hearing, thinking, or writing? "This frog has style. "Asking for a friend."

So yea, I went to school for social science, and, yada, yada, yada, now I'm a program evaluator."

"I was told you find our new report really useful? Person 2, "Oh, I do, I needed to raise my monitor and it was just the right length."

You said to only schedule with likely report readers. There are none.

Do you even know how to use a computer?

My Cartoonist Trophy

Too many reports?

Eval-entine's day

Creative in the box.

50 page word doc 25 page visual report

Sure, you can write what you want to write.

Missed Communication

Itzhak Perlman of Mixed Method Data Governance

Pretend we read it.

Reporting Secret

Matchy Matchy Color

“So moving on from the manure and back to the tree,” says person presenting in the front of the room. Person watching, “I think you may be taking the metaphor too far.”

That data set is so dirty we might need to put a parental advisory label on it.

Who, Deja Vu. I feel like we've asked these same evaluation questions before. Person 2, "That's because we have. And I would call them monitoring questions.

"If you're cleaning data and you just delete it all. Could you still call it a clean dataset?" Person 2, "Umm, I guess so, kinda misses the point through."

We found our new evaluator! Here resume was just okay. But the after the inerview she delivered a very well written actionable report on how we can improve our hiring process.

I don't this this whole NFT and bitcoin thing. They are just made up things that are only valuable because people say they have value. "So just like paper money and shiny rocks?"

Hi, I donated $20 last year. Can you tell me exactly how many children I've saved?

Cartoon - So this is my first interview with an applicant who showed up without pants. Person 2 (standing in boxer shorts) You know the advice "dress for the job you want?" Well, I want to work from home.

Cartoon person standing next to machine, "This is our new impact washing machine. Simply drop your impact investment money here and the machine will generate a nice impact statement you can share with your investors."

Cartoon: I'm part of the internal evaluation team. Or, technically, we are the Strategy, Measurement, Evaluation, Learning, and Leadership Team. It was a recent change." Person 2, "SMELL?" Person 1, The group that does the acronyms didn't like our last evaluation. I think the name change was payback.

If logic models were drawn to scale…”if you’ll follow me, we’ll head down the hall and take a look at our longer term outcomes.

Cartoon Person reading..."Give us money and nobody will get hurt." They then say, "okay everyone, I am all for using simple language in our grant applications but can we avoid sounding like bank robbers in the next draft?"

24

#218