Civis Analytics Short List · walkthrough
Back to the results
Civis Analytics

Short List: the next campaign, walked through

Three short emails over three weeks, to the people the last campaign already warmed up. Each email carries one link, and the landing page does the explaining.

StatusMock, nothing staged to send
Emails3, under 90 words each
CadenceDay 0, day 8, day 15
Working titleNot a product name
1. Who it goes to

Three waves, smallest and warmest first

The last campaign did not produce a demo, but it did produce a sorted audience. Start there, then extend to fresh cold audience in the same format so the two reads are comparable.

Wave 1

People worth a call

Reached the landing page, or read it, or already known to Civis from a previous event. Security-scanner accounts are stripped out.

127people
Wave 2

Repeat engagers

Opened or clicked across two or more separate messages. Repeat engagement over weeks is the signal email security software cannot fake.

772people
Wave 3

Fresh cold audience

Nonprofits from the public-filings and hiring-signal pipeline, in the same short format. Sized when the list is built.

TBDat build

What comes out before anyone is mailed

Every layer is applied when the list is built. The last campaign learned this the expensive way: 467 people who could not receive mail sat on the lists through five sends, and only one of them would have been caught by send-time suppression.

Mailability is checked against every candidate up front, not against whoever survives the other filters. Otherwise the people we drop have unknown reachability, and we can never answer who we left out or whether we could have reached them.
2. The emails

Three sentences, one link, one small ask

Rendered as they would arrive. Two subject lines per touch, because the subject is now the only thing being tested. Everything else is identical between the arms.

Touch 1Day 0, Tuesday, early afternoon
Subject A
one question about your Salesforce data
From Civis Analytics, reply goes to a person
Subject B
the queue for data answers
From Civis Analytics, reply goes to a person

Scroll the email sideways to read it at full width.

57 words. One link, to a two minute overview. No form, no calendar, no demo button.

Touch 2Day 8, new copy and a new subject
Subject A
no SQL, no report ticket
From Civis Analytics, reply goes to a person
Subject B
in case last week's note got buried
From Civis Analytics, reply goes to a person

Scroll the email sideways to read it at full width.

50 words. The second touch gets new sentences even when the facts are unchanged. People who read the first one and never registered as opening it would otherwise get proof that nobody is reading what we send.

Touch 3Day 15, the ask
Subject A
worth a look this year, or not?
From Civis Analytics, reply goes to a person
Subject B
should I stop sending these?
From Civis Analytics, reply goes to a person

Scroll the email sideways to read it at full width.

49 words. The ask is a yes or a no, which a person can give in four seconds without talking to anybody. The demo comes after the yes.

Why it is branded at all

After the open, the plain and branded lanes were indistinguishable on clicks, the branded one won the Leadership persona on both metrics, and it produced fewer opt-outs. There is no evidence a light wrapper suppresses response, and a real cost to sending unbranded mail from a company this audience cannot name.

Still to decide

Who fronts the sends. The named human sender is the variable most likely to have earned the open rate in the last campaign, and it decides where replies land. Whoever it is, the reply address has to reach somebody who reads it.

3. How it plays out

Six weeks becomes three

The last campaign spent six weeks per group on four long emails, and the three after the first bought no incremental engagement.

week 0 1 2 3 4 5 6 Last campaign 4 emails, 213 to 300 words three reasons storage cost analytics and AI team access Short List 3 emails, under 90 words the bottleneck what changes yes or no read the result, decide wave 2

Scroll the timeline sideways to read it.

The last campaign's dates are the actual send dates for the first pair of groups. The Short List cadence is the proposal.
Touch 1 asks for

A click. One link to a two minute overview, with no form in the way.

Touch 2 asks for

The same click, from a different angle and in new words. Never the same body twice.

Touch 3 asks for

A yes or a no, by reply. That is the whole ask, and it is the one we can count.

What triggers the next step

Day 22, one week after the last touch, opens have finished accruing and the result is read on clicks and replies. A yes goes straight to a person. The winning subject line carries into wave 2 unchanged, so waves 2 and 3 are not re-running the same test. One send time and one wave size every wave: the last campaign's worst-performing send was its only morning send and its largest, and the same first email, unchanged, swung from 29.3% open to 16.8% depending on the day it went out.

4. How we would measure it

The instrumentation, fixed before the first send

Every gap below is one the last campaign is still carrying, and none of them can be fixed after a send.

What the last campaign could say

  • Opens and clicks per send, inflated by security software we identified in week six
  • Landing-page arrivals for the recipients we could identify, which was fewer than half the traffic
  • Form opens the page fired for people on arrival, whether they wanted the form or not
  • Demos: zero, and that number is correct
  • Replies: unknown, on both arms, for the whole campaign

What Short List would say

  • Replies counted from the first send, because the reply address is one somebody reads and labels
  • Clicks per person, per touch, per subject arm, with per-person tracking live on the first email
  • Human clicks and machine clicks reported as separate numbers from the first send, using the scanner shape we can now describe
  • Page reading, because the page will not open its own form and manufacture intent
  • Which subject line won, read on clicks and replies, with opens as a secondary signal

The funnel we would instrument

Open rate stays on the report and stops being a success metric. Apple is 62% of all email opens and its privacy feature affects 55 to 60% of them, so an open is a signal about the subject line and nothing else.

5. Summary

What changes from the last campaign

The last campaign proved we can reach these people and that they will not book a demo with a company they cannot name. Short List keeps the reach, drops the ask to something a stranger can complete alone, and counts the one signal we have never been able to count.

Back to the results