Kickstart Your A/B Testing
How to setup the simplest A/B testing program
I often get asked: “What does the simplest A/B testing program look like?”
And sometimes ‘simplest’ is replaced by: cheapest … leanest or fastest.
Most teams chase flawless processes or the ‘best idea’. Often they don’t get started at all, or never create an a/b test out of their idea.
The hardest part isn’t running the “perfect” experiment.
It’s getting started and staying consistent.
You will make mistakes along the way.
Your idea won’t be perfect yet.
Embrace it.
Love it.
And…
Just start.
Practices makes perfect.
You and your team will get better at everything.
But please, just start small.
More info on: bulletproof, consistent A/B testing for 1-3 tests a month?
In the full blog you’ll learn
how to do all the research you need in ONE WEEK 😮
Then you’ll put your first a/b test live in ONE DAY 😱
And we’ll setup the simplest Experimentation Process in ANOTHER DAY 😳
———
In sum: you just need about 9 days.
Read it here: How to Kickstart Your A/B Testing And Build a Scalable Experimentation Process
🎥 Or, if you prefer our team made a YouTube video out of this content too:
And just in case you’re looking for an extra push, about, having a tool ≠ running experiments, here it is:
🔗 Read the full post on Linkedin
1. Inspiration from Duolingo
“Our entire product organization, the whole system is about shipping AB tests as fast as possible”
— Luis von Ahn, CEO of Duolingo
2. More A/B testing resources
3 most asked questions on starting A/B testing processes?
How long should my test run? Video here.
Who do i prioritize ideas? Video here.
How do I actually interpret the results? Video here.
👉 You’ll miss videos if you don’t subscribe. So please do. Check out the Youtube channel.
3. The easiest Low-Code Experiments
🍑 Building my own tests saved my ass so many times 🍑
It’s not the perfect process, I know.
It’s not the perfect Experimentation Culture.
But I embraced the fact that I didn’t always have dev resources.
And Low-Code experiments still brought us learnings, and more momentum for Experimentation.
So these are the easiest a/b tests to build buy yourself (either with a visual editor or AI):
Remove elements
Replace elements
Change color
Adjust font
Adjust copy
Add microcopy
Add an extra CTA
Sidenote: Visual editors generally suck & you are NOT a developer (!!),
so please QA your test thoroughly. Or, better even, ask a dev to QA for you (and make clear how much time is being saved by you coding up these tests wink 😉 ).
👉 I’ve written a full blog on this (with examples and strategies). You can read it here: No or Low Code A/B Tests to Try for your eCommerce shop right now.
4. How to plan your A/B tests by Ruben de Boer
Working on your Experimentation Muscle? 💪
Planning three tests ahead is key to success!
👉 One test live
👉 One in development & QA
👉 One in the UX stage
🔗 Read Ruben's full post on Linkedin
5. Integrate AI automations into your A/B testing flow
We’re building smart AI automations in the Experimentation Programs of our clients. Things like:
Automated analysis & test reports
Automated test recommendations
Test updates to your inbox, or to that of your stakeholders.
Work smarter, not harder in CRO. Automate the repetitive parts of your workflow, so you can focus on more important things.
6. We’re anti-agency
We don’t like how agencies take on as many clients as possible,
and don’t care about every little detail any more.
So we’re an agency, but we’re also anti-agency. We work with a limited amount of clients (5 is our max now), and do 2 small research projects each quarter.
For Q4 2025 we still have ONE spot for:
CRO Research Audit: we dig into your data and deliver 20+ test ideas ready to go.
Experimentation Program: we help you setup and run Experiments.
👉 You can book a call with me here to see if it’s the right fit: Calendly link.
See you soon, and enjoy the ride.
Lucia from Increase Conversion Rate.com