[Digital commerce & conversion](<https://www.thekeating.co/programs/digital-commerce/>) / [Use cases](<https://www.thekeating.co/programs/digital-commerce/use-cases/>) / [Release assurance](<https://www.thekeating.co/use-cases/release-assurance/#main>)

[How it works](<https://www.thekeating.co/use-cases/release-assurance/#system>) [What you get](<https://www.thekeating.co/use-cases/release-assurance/#outputs>) [Scope](<https://www.thekeating.co/use-cases/release-assurance/#scope>) [Start a review](<https://www.thekeating.co/contact/?source=discovery&landing_path=%2Fuse-cases%2Frelease-assurance%2F&intent=discovery&cta_page=%2Fuse-cases%2Frelease-assurance%2F&cta_placement=navigation&program=digital-commerce>)

[Digital commerce & conversion](<https://www.thekeating.co/programs/digital-commerce/>)[Releases](<https://www.thekeating.co/programs/digital-commerce/use-cases/#area-ship>)

# Ship proven changes every week, safely.

Changes go out behind a flag with tests behind them, a rollback ready and a readout attached.

[Start with a conversion review](<https://www.thekeating.co/contact/?source=discovery&landing_path=%2Fuse-cases%2Frelease-assurance%2F&intent=discovery&cta_page=%2Fuse-cases%2Frelease-assurance%2F&cta_placement=hero&program=digital-commerce>) [How it works](<https://www.thekeating.co/use-cases/release-assurance/#system>)

Every readout sets the next change

## Sound familiar?

-   The fix is known and waits months behind platform work.
-   Every release breaks something nobody tested.
-   Nobody can tell a real failure from a flaky check.

A slow, risky release process caps what any test or fix can be worth, however good the idea.

## What changes.

ShowTodayWith the engine

Release rhythm

A batch every few weeks Small changes every week, behind flags

Tests

Written after the bug Drafted with the change, run on every release

Failures

Hours spent separating real from flaky Grouped by cause, with the likely owner

Rollback

A hotfix under pressure A flag you switch off

## How it works. 6 steps, 5 stages.

-   AI**2**
-   Rules and automation**2**
-   Your team**2**
-   Approval

1.  1 Accept
    
    1.  Your team Approval
        
        ### Accept a change
        
        A decision from a diagnosis or a test, with its measure and its owner.
        
2.  2 Build
    
    1.  AI
        
        ### Draft the change and its tests
        
        Code, variants and tests drafted in your repository, for your engineers to review.
        
        -   GitHub
3.  3 Test
    
    1.  Rules and automation
        
        ### Run the checks
        
        Build, unit tests and journey checks on key devices, with accessibility scans and a keyboard path.
        
        -   Playwright
        -   GitHub
    2.  Your team Approval
        
        ### Review and approve
        
        An engineer checks correctness. A designer or category owner checks the experience.
        
4.  4 Release
    
    1.  Rules and automation
        
        ### Release behind a flag
        
        Exposure ramps up, guardrails on speed and errors watch, and one switch rolls it back.
        
        -   GrowthBook
5.  5 Read
    
    1.  AI
        
        ### Draft the readout
        
        What changed, who saw it and what it did, with a decision and a date to check again.
        

Every readout sets the next change

## What you get. Real work, every week.

Releases Last six weeks

-   Machine-washable answerFirst screen, from the spec · week 3 **Live**Kept
-   Delivery date in the cartHalf the visitors · week 6 **Open**Running
-   10% off a second jacketFlag off after two days **−$4**Rolled back

Every release and what became of it. A change that lost money is switched off in a day or two.

Release checks · week 6

**39 of 40**journey checks pass

-   Search finds CAT-042
-   Checkout completes on mobile
-   Keyboard path to payment
-   Product image loads in time Grouped as flaky: timeout

The checks that run on every release. One failing check is grouped with its likely cause.

Release card Delivery date in the cart

Half the visitors, one flag, ready to roll back.

Exposure

Half the visitors, persistent

Checks

Journey checks pass; one flaky check rerun

Guardrails

Page speed and support contacts

Rollback

One flag, no deploy

Read

After 10 weeks: a decision and a date

The release card an engineer signs before exposure ramps up.

## How you’ll know it’s working.

1.  Lead time from decision to live
    
    Days from an accepted change to shoppers seeing it.
    
2.  Defects that reach shoppers
    
    Customer-impacting problems per release, with rollbacks counted.
    
3.  Review and rework time
    
    Drafted code that needs heavy rework moves the delay into review.
    

Baselines agreed before we build.

## Works with what you have.

Delivery

-   GitHub
-   Playwright

Measurement

-   GrowthBook

Commerce

-   Shopify

We configure first

Your repository, your CI and a free flag tool carry most of this. We add what’s missing, not a new platform.

We build when

Known fixes wait on release capacity, or releases still break journeys nobody tested.

## What a first build includes.

Built in your accounts, around your team. Scope, fee and baseline agreed before we start.

1.  1 Design
2.  2 Build
3.  3 Run it, or hand it over

[Start with a review](<https://www.thekeating.co/contact/?source=discovery&landing_path=%2Fuse-cases%2Frelease-assurance%2F&intent=discovery&cta_page=%2Fuse-cases%2Frelease-assurance%2F&cta_placement=content&program=digital-commerce>) [Scope this build](<https://www.thekeating.co/contact/?source=project&landing_path=%2Fuse-cases%2Frelease-assurance%2F&intent=project&cta_page=%2Fuse-cases%2Frelease-assurance%2F&cta_placement=content&use_case=release-assurance>)

### We build

-   A release pipeline with flags and guardrails
-   Journey checks on the paths that earn money
-   Drafted tests and grouped failures
-   A readout and a rollback for every change

### We start from

-   Repository, CI and hosting access
-   Design system and theme code
-   Open fixes and test history

### From your team

Owner

Head of ecommerce, with engineering

Involves

-   Engineering
-   Design
-   Ecommerce
-   QA

## Questions teams ask.

Will you replace our developers or our agency?

No. We work in your repository with your engineers reviewing, and we leave the pipeline and the playbooks with you. If an agency owns the code today, we start by moving that know-how in.

Does AI-drafted code make this faster?

Sometimes. A 2025 randomized study by METR found experienced open-source developers took 19% longer with AI tools in that setting. So we judge accepted changes: the ones reviewed, tested and measured.

Who owns it once it’s running?

You do. It’s built in your accounts, documented, with training for the people who run it. Ownership usually sits with your head of ecommerce, with engineering. We can keep running it with you, or step back.

How do we start?

Usually with a conversion review: two to four weeks, a fixed fee credited to the build, and a plan that’s yours. If the job is already clear, we can scope the build directly.

## Part of your conversion engine. One of 14 use cases, in 5 parts.

[See the whole conversion engine](<https://www.thekeating.co/programs/digital-commerce/#look-inside>)

1.  [Evidence & decisions **2**](<https://www.thekeating.co/programs/digital-commerce/use-cases/#area-diagnose>)
2.  [Search & discovery **2**](<https://www.thekeating.co/programs/digital-commerce/use-cases/#area-find>)
3.  [Guidance **4**](<https://www.thekeating.co/programs/digital-commerce/use-cases/#area-choose>)
4.  [Cart & checkout **4**](<https://www.thekeating.co/programs/digital-commerce/use-cases/#area-buy>)
5.  [Releases **2**](<https://www.thekeating.co/programs/digital-commerce/use-cases/#area-ship>)

In releases

-   **Release assurance**You’re here
-   [**Accessible checkout**Make search, sizes, cart and payment work for everyone](<https://www.thekeating.co/use-cases/accessible-checkout/>)

Works with

-   [**Experiment planning**Test what matters, and know when a test can’t tell you](<https://www.thekeating.co/use-cases/experiment-planning/>)
-   [**Bring growth in-house**Bring agency work in-house without losing ground](<https://www.thekeating.co/use-cases/bring-growth-in-house/>)

## Ship the fix, with proof. Start with a conversion review.

[Start with a conversion review](<https://www.thekeating.co/contact/?source=discovery&landing_path=%2Fuse-cases%2Frelease-assurance%2F&intent=discovery&cta_page=%2Fuse-cases%2Frelease-assurance%2F&cta_placement=closing&program=digital-commerce>) [**Talk it through first**15 minutes](<https://cal.com/nkeating/15min>)

We reply within one business day.

---

Source: [https://www.thekeating.co/use-cases/release-assurance/](<https://www.thekeating.co/use-cases/release-assurance/>)

[Contact Keating & Co](mailto:nelson@thekeating.co) · [Agent guidance](https://www.thekeating.co/llms.txt)
