Home · Business · Marketing & Content · Email & CRM campaigns

PARTLY

As of 13 August 2026, AI can only partly run an A/B test on your marketing emails.

This still needs a person who signs their name to it.

Can you do it?

30 minutesto a draft.

1 hourto something you’d act on.

Cost, all in£0

Skill neededpower-user

Who has to check ityou

What the alternative costsJasper is an AI marketing platform for on-brand campaign copy at volume; the supplied data gives no price for a human marketing alternative.

If this goes wrong, you send a weaker or non-compliant email to part of your list and draw the wrong conclusion from the result.

What to actually do

  1. Hand it to a person

    The route this page recommends

    A person who owns the outcome does this end to end, worth it when the failure is dear.

  2. Use a tool built for this

    Second choice
  3. Do it yourself

    The distant third

    A chat interface, power-user skill, and roughly 1 hour until you can act on the result.

    How to actually do it

    1. Open your email platform and record its A/B testing options, audience exclusions, consent settings, tracking controls and reporting fields.
    2. Gather the current email, approved brand guidance, offer details, landing-page URL, audience definition and any past campaign results you can verify.
    3. Paste those materials into the prompt and ask the model for one hypothesis, two single-variable versions and the setup checklist.
    4. Compare both drafted emails against your approved offer, price list, landing page, unsubscribe process and brand guidance, then correct unsupported claims.
    5. Configure the test in your email platform with matched audience rules, exclusions, tracking links, one fixed test variable and a documented primary metric.
    6. Send a test email to internal addresses and check links, rendering, personalisation, unsubscribe controls and tracking before obtaining campaign approval.
    7. Run the test through your platform, export the results into the results table, and ask the model to compare the versions without inventing missing figures.
    8. Check the model's interpretation against the platform report and your campaign objective before choosing a winner or sending a follow-up email.

    Prompt

    Help me plan and prepare an A/B test for a marketing email. Do not claim to access, configure or send anything in my email platform.
    
    Business and campaign context:
    - Business: [business and offer]
    - Audience: [who will receive it]
    - Existing email or draft: [paste email]
    - Campaign objective: [the single primary objective]
    - Email platform: [platform name]
    - Brand and legal constraints: [tone, claims, exclusions and consent requirements]
    - Available audience size and relevant past results: [paste only figures I can verify]
    - Test window and practical limits: [details]
    
    Produce:
    1. One clear test hypothesis.
    2. Two versions that change only one meaningful variable, such as the subject line, preview text or call to action. Keep all other content and targeting the same.
    3. A test setup checklist for my email platform, including audience splitting, exclusions, send timing, tracking links, suppression rules and final-send controls.
    4. A primary success metric and sensible secondary checks. Do not invent benchmarks, sample sizes or statistical results.
    5. A results table with fields for version, recipients, deliveries, bounces, opens if available, clicks, conversions, unsubscribes and complaints.
    6. A plain-English method for comparing the results, including what would make the result inconclusive. Do not declare a winner from incomplete data.
    7. A list of every factual, legal, consent or platform-specific item I must check myself before sending.
    
    Write concise copy in British English. Preserve factual claims from my source material, flag anything unsupported, and do not invent customer details, performance figures or compliance approval.

    Open it prefilled in ChatGPT or Claude, or copy it into Gemini, which takes no prefill link.

What it gets wrong

  • AI cannot access your customer list, consent records, suppression list or email-platform account without a separate authorised integration.
  • AI cannot decide whether a difference is meaningful when the audience, timing or conversion path makes the result ambiguous.
  • AI cannot take responsibility for UK marketing permissions, inaccurate claims, unsubscribe failures or damage to your sender reputation.
  • AI cannot know which brand trade-offs matter more than a measurable click rate, such as sounding trustworthy rather than merely attention-grabbing.

What caps this at PARTLY: private data access, verification cost and judgement under ambiguity.

How we scored this

Five axes, each scored nought to two by hand: ten means AI carries the task cleanly, and the thresholds that turn a total into YES, PARTLY or NO are published in the methodology. Each axis name links to its definition.

AxisScore (0–2)
Output1
Inputs1
Verification1
Liability1
Effort delta1
Total5 / 10

FAQ

Can ChatGPT run an A/B test for my email campaign?
Partly. It can create the variants, hypothesis, setup checklist and results analysis, but it cannot access your email platform or take responsibility for sending the campaign.
Can AI choose the winning email version?
It can compare results you provide and explain what they show. It cannot reliably choose a winner when the data is incomplete, the test changed more than one variable or the business value is not captured by the primary metric.
What do I need to give AI to create an email A/B test?
Give it the current email, audience definition, campaign objective, platform capabilities, approved claims, tracking requirements and any verified past results. Do not give it access to private customer data unless your organisation has approved the relevant tool and integration.
Is it safe to use AI for email marketing?
It is useful for drafting and planning, but you must check consent, suppression rules, factual claims, links, personalisation and unsubscribe controls in your email platform before sending. Your business remains responsible for the campaign and its consequences.

Nearby answers

Assessed by gpt-5.6-luna (gpt-5.6-luna) on 2026-08-13, second-checked by an independent model. Wrong somewhere? Email [email protected] and it gets re-checked.

The newsletter

AI news, new answers and product picks, straight to your inbox.