“Be a user of your own product.” Evan Williams, Cofounder @Twitter
Have you ever felt so frustrated with long meetings in which everyone gives his/her opinion on how to improve an ad or marketing materials, but didn’t have enough data to back up their gut feelings? That frustration was why we started Spot Trender.
We eat our own dog food at Spot Trender. Recently, we made a video explainer to help explain our products and services to new clients. Our team had mixed feelings about the first version, so we decided to use Spot Trender to help make the best decision (also known as “Dogfooding” in Silicon Valley).
Here’s version 1 of the video:
When we got the test results back, here’s the process we used to generate actionable insights:
- Quantitative comparison:
To get a general sense on performance, we compared our video against competitors & general industry norm. While the majority of our key metrics were high, our likelihood to act (consider using, email Spot Trender) were just about average. Product and brand perception metrics were encouraging, but “Spot Trender lets you run more tests” were low. Based on the data, we decided that we need to improve the spot. To step 2!
- Correlate reaction graphs with actual scenes:
The reaction graph was mostly positive; however, it dipped low at 3 points: at 00:21, 00:34, and 01:06.
You can learn more about Spot Trender Reaction Graphs here.
- Analyze live comments to make sense of reaction graphs:
When we correlated the scenes to the reaction graphs, we isolated and identified 3 “problem segments”, listed below. Then, we combed through the live comments to identified why the audience didn’t like them.
- Problem Segment 1: Stop waiting weeks for results (around 21s)
- Live Comment: “Too much on the screen” 00:21
- Analysis: The arrows were moving too fast, and distracted viewers from one of our key message.
- Problem Segment 2: Used by Top Fortune 500 companies and agencies (33s)
- Live Comment: “This is for bigger companies than mine, but I like it.” 00:36
- Analysis: Participants who offered similar comments listed themselves as small business owners.
- Problem Segment 3: With the same budget you can test more
- Live Comment: “The pile of gold is distracting and looks juvenile!” 01:04
- Analysis: The pile of gold is a flop!
Based on the quant and quals from the test, below are some the of changes we made to the video:
- Use more professional, stable graphics for problem segment 1.
- Since the primary audience of this explainer is our enterprise clients and ad agencies, we left problem segment 2 alone.
- We change the pile of gold graphics in problem segment 3.
- Adjust the music to voice volume, since many participants complained that the music was too loud in the Live Comments.
- Add Reason to Contact at the end of the video to improve likelihood to act.
Here’s version 2 of the video:
If you’re curious what our survey looked like, you can give us feedback on Version 2!
Are you looking to test your ads quickly, affordable, and generate actionable insights? Contact us for a FREE consultation with our insight experts!