Mathew PaquetChecklist · 4 min read
The Thumbnail Test Sheet
Use YouTube's AI thumbnail generator and its A/B test the way a business should: different ideas in, a clean test, and the final call kept by you.
YouTube showed a lot of creator AI on September 23, 2026. Most of it arrives later. Two tools work today:
The winner is not the thumbnail people click the most. It is the one with the highest watch time share: the version whose viewers watched the most, in total. YouTube's help page says it plainly: "we optimize tests for overall watch time over other metrics, like click through rate."
Watch time is not buyers.Say you run a bookkeeping firm. "The tax mistake everyone makes" pulls a wide crowd that watches long. "Bookkeeping for restaurants" pulls fewer people, and some of them own restaurants. The test can crown the first one. It won't show which version brought the person who booked a call.
We put three thumbnails into YouTube's test on every video we post. Here is how to feed it real options and keep the decision that matters.
On your video's details page in YouTube Studio, look under the thumbnail for a button called Get suggestions. It opens Ask Studio, which reads your video's transcript and what your channel has posted before, and gives you thumbnail options. You ask for changes in plain words: bigger text, a darker background, your face reacting. Then you download the one you like and upload it yourself.
It costs nothing extra. TubeBuddy's reading of the rules: an AI thumbnail on a real video does not trigger YouTube's altered content label, but the file carries an invisible watermark that marks it as AI made. It is desktop only and still rolling out, so some channels don't see the button yet.
The catch. Every option starts from the same transcript, so expect three takes on one idea, not three ideas. And you can't hand it a reference image to copy.
Marques Brownlee's lesson from a year of tests: when two thumbnails differ by a small detail, like text size or an arrow, the results usually aren't far enough apart to matter. Completely different concepts are where you learn something. So you write the ideas. The generator draws them.
1. The result: [WHAT THE VIEWER GETS]
2. The problem: [THE PROBLEM THEY HAVE NOW]
3. The proof: [A REAL BEFORE AND AFTER]
Example (bookkeeping firm):
1. Books done in an hour a week.
2. Why your restaurant's numbers never match.
3. A real client's before and after.
YouTube's steps, on a computer:
A test takes a few days to two weeks. YouTube doesn't say how many impressions it needs, but not enough impressions is one reason there is no winner.
Small channel? If making thumbnails is the bottleneck, test titles only. Same test, no design at all.
The result shows on the video's details page and in Analytics, under the Reach tab.
The tools choose between options. Three things stay yours: a genuinely different idea, the truth (does the video deliver what the thumbnail promises?), and the call on which viewer counts.
Sponsored videos. YouTube says an agent that tests new thumbnails on older videos reaches trusted testers later this year. Shelly Palmer says most of his clients require approval of thumbnails, titles and alternate cuts in creator contracts. When that agent reaches your channel, keep it off sponsored videos.
Promises tested: [RESULT] / [PROBLEM] / [PROOF]
Result: [WINNER / PERFORMED SAME / INCONCLUSIVE]
Why I think it won: [ONE SENTENCE]
Did it bring the viewer I want? [YES / NO / CAN'T TELL]
Sources
Mathew's LibraryLibrary card
Keep reading free with your library card
One email opens this checklist and all 3 resources in Mathew's library. No account, no password.
Open an older video in YouTube Studio, click A/B Testing under the thumbnail, and upload three different promises with your best guess first.
Saving works best in your phone's browser. A copy is also in your inbox.