Skip to main content
Wysera
Operations10 min read

How to Measure Marketing Automation Success (Without a Dashboard)

Most owners can say how many emails went out. Few can say whether anything got better, because nobody wrote down the numbers before.

Girish Kotte
Girish Kotte

Founder, CEO & CTO, Wysera

Three months after switching on marketing automation, most small business owners can tell you how many emails went out. Very few can tell you whether anything got better. That is not because the results are hidden. It is because nobody wrote down what the numbers were before, so there is nothing to compare against, and the only question left is whether it feels like it is working.

Measure the leak you fixed, not everything#

Every automation you set up was meant to fix something specific. An instant reply was meant to stop enquiries going cold while you were busy. A follow-up sequence was meant to stop quotes dying after one email. Reminders were meant to stop people missing appointments.

So the measure of each one is the number it was meant to move. Not total revenue, which goes up and down with the season, the weather, one large customer and a dozen other things. Not emails sent, which only tells you the machine is running. The right number for an instant reply is how long enquiries wait for a first response. The right number for a follow-up sequence is how many enquiries get followed up, and how many of those reply.

This makes the job small. Instead of a dashboard with forty figures, you need one number per automation, plus two that cover the whole effort: customers won and hours spent.

If you cannot name the number an automation was meant to change, you cannot tell whether it worked, and you probably should not have built it.
The working test

Record a baseline before you switch anything on#

A baseline is a record of where things stood before the change. It is the step people skip, and skipping it makes every later number meaningless. You need about an hour and the last three months of enquiries.

1

Time to first reply

For each enquiry, how long between it arriving and a person or message answering it. Note the typical figure and the worst cases.

2

Follow-up rate

The share of enquiries that got at least two follow-ups when they did not answer the first time. For most businesses this is lower than they think.

3

Booked and attended

How many calls or appointments were booked, and how many actually happened. The gap between those two is a number worth having.

4

Customers won

How many enquiries became paying customers in the period, and roughly what they were worth.

5

Hours on marketing

Log your marketing time for a normal week or two. Memory overestimates how long tasks take and underestimates how often they happen.

6

Warning lights

Current unsubscribe and bounce rates on your email, so you can tell later whether more sending is annoying people or hurting delivery.

Write it all on one page with the date. If you have already switched things on, you can still build a rough baseline from last year's same months, which is less precise but much better than nothing.

The numbers that matter, and the ones that flatter#

Marketing software reports a lot of figures, and the easiest to produce are often the least useful. A rough guide to which ones deserve your trust:

Tells you
Trust it
Emails sent
Machine is running
Open rate
Inflated by bots
Partly
Clicks
Interest
Partly
Replies
Real attention
Booked and attended
Buying intent
Customers won
The point
Hours spent
Your cost

Open rates deserve a specific warning. Some email apps download images in the background whether or not anyone reads the message, and company security filters often open emails to check the links. Both register as opens. That makes the open rate look healthy while telling you little about whether a human read anything. Some tools now try to separate the two; Wysera, for instance, reports verified human opens with bot and scanner opens filtered out. Even so, treat replies and bookings as the real signal and opens as a rough indicator.

Clicks are similar. A click from a scanner checking a link looks the same as a click from a buyer. Clicks that lead to something you can see, such as a form filled in or a booking made, are worth more than the raw count. Tagging your links with UTM codes (small labels added to the end of a web address that tell your analytics where a visitor came from) lets you follow a click through to what it led to.

What actually happens when you automate#

There are no customer stories here, because the honest version is more useful than a success story. This is the pattern to expect for a small business that switches on the basics: instant replies, follow-up sequences, reminders and scheduled posts. Timings vary with your sales cycle, so read them as a rough shape, not a promise.

Weeks one and two: activity jumps, results do not. Far more messages go out. First-reply time drops almost at once, because the instant reply works from day one. You will find a few problems: a merge field that printed someone's name wrong, a sequence that kept going after a reply, a form that was not connected. This is the period for fixing, not judging.

Weeks three to six: the process settles. The follow-up rate climbs, because the software does not forget. Replies start to come from people who would previously have heard nothing after the first email. Unsubscribes may tick up slightly as more people receive more messages, which is normal as long as it stays small.

Months two and three: sales from recovered leads. After one full sales cycle, you can see whether the enquiries that used to go quiet are now turning into customers. This is the first point at which a judgement about sales is fair. Time savings should also be stable by now, once the review routine is part of the week.

Months three to six: the slower work. Anything that depends on new people finding you, such as search visibility, content and social posting, starts to show here if it shows at all. Measure it separately, because it runs on a different clock.

Comparing before and after fairly#

A before-and-after comparison is easy to fool yourself with. Four habits keep it honest.

Compare like with like. If your busy season starts in spring, comparing April with February will flatter anything you switched on in March. Compare with the same months last year as well as with last month.

Change one thing at a time. If you launch an instant reply, a new website and a price change in the same week, you will never know which one did what. Stagger them by a few weeks.

Hold a few back. Where you can, leave a small, random group of enquiries on the old process for a month. If the automated group replies or books noticeably more over the same weeks, you have real evidence. This is the same test described in lead scoring without a data team, applied to automation.

Respect small numbers. With twenty enquiries a month, one extra customer is a big percentage and could easily be luck. Look for a change that holds for two or three months before you believe it.

A one-page monthly scorecard#

Once a month, fill in the same page. It should take fifteen minutes, and if it takes longer, cut lines.

Reply time
Typical wait for a first response, against baseline
Follow-up %
Enquiries with at least two follow-ups
Show rate
Booked calls that actually happened
Customers
Won this month, and from which sequence
Hours
Marketing time this week, including review
Warnings
Bounces, unsubscribes, complaints

Beside each, write the baseline figure and one sentence on what you will change. A scorecard you do not act on is just a record of things that happened. For the time column specifically, how much time marketing automation saves has the arithmetic, and the show-rate line is unpacked in booking rate versus show rate.

When measuring is overkill#

Not every business needs this. If you get a handful of enquiries a month, the numbers will be mostly noise and the scorecard will swing on single customers. In that case, skip the spreadsheet and ask one question at the end of each month: did any enquiry go unanswered or un-followed-up? If the answer is no, the automation is doing its job.

Measurement is also the wrong place to spend effort if you have not decided what the automation is for. Building a dashboard before choosing the problem is a common way to feel busy without learning anything. Decide the leak first, then measure it. If you are still deciding whether the effort will pay at all, whether marketing automation brings more sales is the place to start.

Try it on autopilot

The numbers that matter, in one weekly report.

Wysera keeps every lead, email and call in one CRM, filters bot opens out of your email numbers, and sends a weekly report so you can see what changed. A person approves anything before it goes out.

Request a demo

Frequently asked

How do you measure the success of marketing automation?

Pick the specific problem each automation was meant to fix, record where that number stood before you switched it on, and compare the same number a full sales cycle later. For most small businesses that means first-reply time, the share of enquiries followed up, booked calls that actually happen, replies, customers won and hours spent. Total revenue alone is too noisy to tell you anything.

What happens when you automate your marketing?

In the first fortnight activity jumps: more emails sent, more posts out, faster replies, and usually a few bugs to fix. Over the next month or two, response times and follow-up rates settle at a better level and replies and bookings start to move. Sales from recovered leads show up within one sales cycle. Anything that depends on search or content takes months.

What metrics should a small business track for marketing automation?

Time to first reply, the percentage of enquiries that get at least two follow-ups, reply rate, booked meetings and how many of them happen, customers won from automated sequences, and the hours you spend on marketing each week. Add unsubscribes and bounces as warning lights. Skip anything you would not act on.

Are email open rates a reliable measure?

Not on their own. Some email apps load images automatically, and security scanners open messages to check links, so a recorded open often does not mean a person read it. Replies, clicks you can tie to a real action, and bookings are much more trustworthy. If your tool can separate likely human opens from machine opens, use that figure instead.

How long should I wait before judging marketing automation?

At least one full sales cycle, the time it normally takes from first enquiry to purchase, and ideally two. For many small service businesses that is four to eight weeks. Judging after a week mostly measures set-up problems, and judging only on revenue after a month mostly measures luck.

How do I know the results came from automation and not something else?

Change one thing at a time, compare against the same period last year as well as last month, and where you can, hold back a small group that does not get the automation. If the automated group replies or books more than the held-back group over the same weeks, the automation did it.