This piece is inspired by Startup Edition in response to, “How do you discover what people really want?”
“So I have this awesome idea for a new startup: Uber for hot dogs! Love hot dogs? Hungry? Get a delicious dog delivered to your door within 30 minutes. It’s gonna be HUGE! What do you think, Sarah?”
“Yeah… sounds interesting” she replied.
“Cool! Would you use it?” questioned the enthusiastic Kyle.
“Sure, I like hot dogs.” Sarah apathetically replied.
“Booyah! [:D] I knew you’d like it.”
There are several obvious customer development mistakes with this hypothetical example - nothing surprising. In reality, Sarah may very well love hot dogs and become Kyle’s most devote customer. But this feedback isn’t very useful.
There are several tactics for discovering problems worth solving and validating customer needs, but not all are equal. Each provide a different level of fidelity. When testing your hypotheses, it’s important to choose the right tactic and recognize the quality of the feedback.
I’ve found that signal quality is highly correlated to pain. In other words, the more pain - effort, work, investment - demonstrated by the user, the more reliable the feedback.
Lets take a look at things people do to test a hypothesis:
These artifacts plot a diagonal line up and to the right, where the graph’s y-axis is pain and x-axis is signal quality.
It’s important to know your audience to identify the severity of pain illustrated in each of these categories. Pain materializes in the form of spending time, social capital, or money and the level of pain demonstrated in each of these varies by person. For example, a busy venture capitalist values her time more than money where a broke college student is more willing to offer their time than pitch a few dollars.
So back to the hot-dog mastermind. What should Kyle do? Sarah expressed interest. Is that feedback enough to validate his genius idea? But that’s just one person’s opinion. Perhaps he should talk to more people. Not a bad idea but unless he moves higher up the y-axis of pain, the signal quality will continue to be low.
When doing customer development, consider the level of pain invested by users before drawing conclusions and how you can increase signal quality. The more pain, the better.
Read more on this topic from an awesome group of entrepreneurs at Startup Edition.
Photo credit: Shelley