PRODEF029 BusinessModelsAndCustomerDevelopment
PRODEF029 BusinessModelsAndCustomerDevelopment
Hypothesis Testing
The next piece about customer development to understand is what is it you’re actually doing outside the
building? And what I think about is you’re really testing on the highest possible level your understanding
of the customer’s problem or need. You implicitly had a hypothesis. I want to extract from implicit to
have you make it explicit. Here’s what the pain and the gain is we’re actually doing for these hypothetical
customer segments that I’ve written down on my canvas. Great, so how are we going to go do that? Literally
we’re going to get out of the building, take our hypotheses, and we’re not just getting out of the building
and randomly talking to customers because if that was the case we could have just sent them a letter or
sent an email. What we’re looking for is not just data, it’s insights, and how this process will work is we’ll
get out of the building, and then as we find those new insights we’ll actually change the canvas. Big idea.
We’ll change the canvas by marking it up and saying, you know, we thought the customers were these kinds
of people. Holy cow, they’re actually these kinds of people, and we thought the features we need, well,
they’re kind of different. They’re actually these features, so what we are doing outside the building is you
start with these hypotheses. In this case let’s just take an example of the customers will be male, 24-35,
live in urban areas, and then we’re going to design some experiments. Let’s go figure out maybe a Google
AdWords campaign. Or if it was a physical product, go out and meet them personally, and then run some
tests and take a look and analyze the data. But it’s not just the data. We’re trying to understand did the
results match the hypotheses? And if not, just don’t give up and say, ”Well, it didn’t.” ”Let’s try another
segment.” Understand why your initial hypotheses were wrong because it’s this why not that might give you
some insight. What you might find out in this case is, oops, we kept getting teen girls in suburbia, and you
can either keep deciding no, no, no, I want men, or you might go ”Well, wait a minute.” ”The teen girls are
actually enthusiastic, in fact, trying to figure out how to buy our product right now.”
Pivot
One of the other interesting observations about customer development is this notion of the pivot. The
pivot was a term that my best student ever Eric Reese coined when he noticed the arrow between customer
validation and customer discovery, and he actually gave it a name, which I think is incredibly accurate. A
pivot says what do you do when your hypotheses don’t meet reality? And this is such a neat observation
about startups and why what we now know is much different than before. What we now know instead of
firing executives when our business model doesn’t match what’s going on outside in the real world we fire the
model, and we simply say, ”Hey, our hypotheses were wrong,” so because we’ve been building the product
iteratively and incrementally and keeping our burn rate incredibly low a pivot is a substantive change to
one or more of the business model components. It just simply says, ”Hey, this isn’t our customer segment.”
”Our customer segment is really here,” or ”Wait a minute.” ”Our revenue model shouldn’t be freemium.”
”We should be charging for it from day 1,” or ”Wait a minute.” ”We’ve been using the wrong distribution
channel.” ”We need a direct sales force,” or ”Gee, we have the wrong partners.” By the way, an iteration is
Estimate SAM
So how would you estimate the served available market or SAM for an Android Game within an order of
magnitude? Choose from the list below.