Idea Testing Presentation preview
Title Slide preview
Assumption Mapping Slide preview
Assumption Mapping Slide preview
Fake Door Test Slide preview
Wizard of Oz Test Slide preview
Multivariate Test Slide preview
Dogfooding (Internal Test) Slide preview
Phase / Partial Rollout Test Slide preview
Wizard of Oz Dialogue Flow Slide preview
Wizard of Oz Test - Results and Findings Slide preview
A/B Testing Slide preview
A/B Testing - Performance Trackging Slide preview
A/B Testing - Test Results Slide preview
A/B Testing - Test Results Slide preview
A/B Test Report Slide preview
Dogfooding Slide preview
Dogfooding - Key Findings Slide preview
Longitudinal Study Timeline Slide preview
Longitudinal Study Results Slide preview
Usability Test Slide preview
System Usability Scale (SUS) Slide preview
System Usability Scale (SUS) Slide preview
Hypothesis Setting Slide preview
GIST Testing Board Slide preview
Idea Confidence Meter Slide preview
Experiment Prioritization Slide preview
Experiment Prioritization - RICE Framework Slide preview
Experiment Prioritization - Value vs. Effort Slide preview
Validation Methods Slide preview
Implementation vs. Scope Slide preview
SUS Score Interpretation Slide preview
chevron_right
chevron_left
download
Download this presentation in

Get 5 out of 31 slides

PowerPoint Keynote Google Slides
Not for commercial use
Microsoft Powerpoint
Not for commercial use

Or, start for free ⬇️

Download and customize this and hundreds of business presentation templates for free

Voila! You can now download this presentation

Download

Explainer

Preview

View all chevron_right

Synopsis

How to know if an idea is worth pursuing? Companies need tried-and-true ways to discover the next big idea that will disrupt their industry. We've created this Idea Testing template that includes tools such as: Smokescreen Wizard of Oz, multivariate test, phased rollout, longitudinal studies, and many more that can be downloaded and customized to different business scenarios. Let's review how these tools work, and how each one can provide a framework for brainstorming and testing new ideas.

Questions and answers

info icon

The tools in the Idea Testing template can assist companies in various ways. The Smokescreen Wizard of Oz allows companies to create a facade of a product or service to gauge customer interest before actual development. Multivariate tests enable companies to test different variables in a controlled setting to determine which combination performs the best. Phased rollouts allow companies to introduce a new product or service in stages to assess its performance and make necessary adjustments. Longitudinal studies provide companies with data over a long period, allowing them to observe trends and make informed decisions.

The main components of the Idea Testing framework for brainstorming and testing new ideas include tools such as the Smokescreen Wizard of Oz, multivariate test, phased rollout, and longitudinal studies. These tools provide a structured approach to evaluate the potential of new ideas and can be customized to different business scenarios.

View all questions
stars icon Ask follow up
download
Download this presentation in

Get 5 out of 31 slides

PowerPoint Keynote Google Slides
Not for commercial use
Microsoft Powerpoint
Not for commercial use

Or, start for free ⬇️

Download and customize this and hundreds of business presentation templates for free

Voila! You can now download this presentation

Download

Dogfooding

Before the iPhone keyboard design became something billions of people use every day, Apple employees first tested the waters. They used it in their daily lives as if they were real life users.

Dogfooding is a way to test ideas with internal team members. Get honest feedback quickly from your own employees first, so you know if you're on the right track. This word cloud represents employees' responses to an idea or prototype. Compile these adjectives to see what people are saying at a glance. The bigger the word, the more common the sentiment. (Slide 18)

Questions and answers

info icon

Microsoft is a notable example of a company that uses dogfooding. They often use their own software products internally for testing before releasing them to the public. This allows them to identify and fix any issues or bugs, ensuring the product is as reliable and efficient as possible when it reaches the market.

Some alternative methods to 'Dogfooding' for idea testing in business scenarios include customer interviews, surveys, focus groups, A/B testing, and using a minimum viable product (MVP). These methods can provide valuable insights into customer needs and preferences, and can help businesses refine their ideas and products before launching them on a larger scale.

View all questions
stars icon Ask follow up
Dogfooding - Key Findings

Wizard of Oz

How can you gauge user opinion on a new product, without spending resources to build the whole thing? With the Wizard of Oz tool, create a mockup of how a product or feature would function, BUT without any real technical input. Think of it as a facade.

On the left here is the mock-up; on the right are the findings. For example, see what potential customers think of chatbot responses, without actually programming the bot. In this case, a team member would respond to customer inquiries manually, pretending to be the bot. (Slide 11)

Wizard of Oz Test - Results and Findings
download
Download this presentation in

Get 5 out of 31 slides

PowerPoint Keynote Google Slides
Not for commercial use
Microsoft Powerpoint
Not for commercial use

Or, start for free ⬇️

Download and customize this and hundreds of business presentation templates for free

Voila! You can now download this presentation

Download

Multivariate test

Sometimes it pays to test multiple solutions at once. Use the Multivariate Test tool to neatly structure the performance of different product iterations. Before starting the experiment, make sure to identify what metrics you want to measure. These are the numbers that will determine which idea is the winner. (Slide 7)

stars icon Ask follow up
Multivariate Test

First, list the control of the experiment. This is the current version that customers have been seeing. Then, list the variations you're testing. In most cases, it'd help to add a picture of what the variation looks like. At the end of the experiment, calculate if the solution actually increased the performance. Note the improvement, or the lack of, in the boxes on the right. Then, simply pick a winner to proceed.

Questions and answers

info icon

A real-world example of a successful Phased Rollout is the launch of Gmail by Google. Initially, Gmail was released to a limited number of users in 2004. Google used this phase to gather feedback and make necessary improvements. The service was then gradually rolled out to more users over the next few years, before becoming available to the general public in 2007. The key success metrics used included user feedback, adoption rate, and the number of bug reports or issues.

Some alternative strategies to a Phased Rollout when launching a new product or service include a Big Bang Adoption, where the new product or service is launched to all users at once, or a Parallel Adoption, where the new product or service is launched alongside the old one, allowing users to switch between the two until they are comfortable with the new one. Another strategy is a Pilot or Trial Launch, where the new product or service is launched to a small, select group of users for feedback and testing before a full launch.

View all questions
stars icon Ask follow up

Phased rollouts

Imagine this: you're about to launch a new product feature. You give every user access, all at once. What if something goes wrong? In most cases, it's not a question of "if" but "when". Unfortunately, something will probably go wrong. Worst case scenario? You release a bad, unreliable product to every one of your customers. They flee to your competitors.

Questions and answers

info icon

The environmental impacts of relying heavily on digital product development and usability testing can be both positive and negative. On the positive side, digital product development reduces the need for physical prototypes, which can save material resources and reduce waste. Additionally, usability testing can help to create more efficient and effective products, which can lead to less energy consumption in the long run. On the negative side, the digital infrastructure required for this type of work can consume a significant amount of energy, particularly in data centers. Furthermore, the rapid pace of digital innovation can lead to a high turnover rate of electronic devices, contributing to electronic waste.

Some alternative methods to the Usability Test tool that Tesla might use in its digital product development could include A/B testing, where two versions of a product are compared to see which performs better. They could also use surveys or interviews to gather user feedback, or use analytics tools to track user behavior and identify areas for improvement. Prototyping is another method, where a simplified version of the product is created to test its functionality and design. Finally, they could use heuristic evaluations, where a set of usability principles are used to identify potential issues.

View all questions
stars icon Ask follow up
Multivariate Test

Companies will often test a new launch via a Phased Rollout. Just dip your toe in, and feel for any unforeseen mistakes or bugs. Break down the rollout into phases and what percentage of the users will receive the new release at what phase. If all goes well, then proceed to the next phase. Otherwise, fix any hiccups before rolling out to more users. In this example, the rollout is in phase six, with 50% of the user base already receiving it. At the button, highlight success metrics such as adoption rate and crash-free sessions. (Slide 9)

stars icon Ask follow up
download
Download this presentation in

Get 5 out of 31 slides

PowerPoint Keynote Google Slides
Not for commercial use
Microsoft Powerpoint
Not for commercial use

Or, start for free ⬇️

Download and customize this and hundreds of business presentation templates for free

Voila! You can now download this presentation

Download

Usability tests

One of the most commonly used methods in digital product development is the Usability Test tool, which assesses how different subjects perform given tasks. Use this tool to see how intuitive your products are. You may design a customer journey for your new app. How smooth do people find each step of the experience?

stars icon Ask follow up

Subjects are scored from one to three on a list of tasks they're given. Use these results to get a total usability score for each subject. If you're a social media company, examples might be uploading an image, or sharing a post with a friend. Usually, usability tests are most effective with five subjects. After that, there tend to be diminishing returns. (Slide 21)

stars icon Ask follow up
Usability Test

System usability scale (SUS)

System Usability Scale (SUS)

Similarly, the System Usability Scale, or SUS, obtains individual responses to survey questions. It then uses these responses to calculate a total usability score for each question. (Slides 22-23)

System Usability Scale (SUS)

Where the previous tool tracked the performance of tasks, this one documents user sentiment about overall usability. If the last tool revealed how easily subjects performed tasks, this tool will tell you how they feel about those tasks.

Longitudinal studies

The Longitudinal Study tool is used for qualitative observation of customer behavior or sentiment. Where other tools in this presentation are best for making sense of metrics like number of click-throughs, this tool is used to add context to such data. In other words, adding the "why".

Also known as a diary study, longitudinal studies are great for tracking the intention and meaning of user behavior in their natural environments across time. Because these tests usually take longer to plan and execute, it's helpful to have a timeline that everyone can follow - all the way from initial planning, to the actual logging process, and through the post-study interview. (Slide 19)

stars icon Ask follow up
Longitudinal Study Timeline
download
Download this presentation in

Get 5 out of 31 slides

PowerPoint Keynote Google Slides
Not for commercial use
Microsoft Powerpoint
Not for commercial use

Or, start for free ⬇️

Download and customize this and hundreds of business presentation templates for free

Voila! You can now download this presentation

Download