Skip to main content

Getting Started with Lyntest

Welcome to Lyntest, the easiest way to run content-focused A/B tests on your Shopify store.
This guide walks you through creating your first experiment in just a few steps.

1. Install the App​

  1. Go to the Shopify App Store and install Lyntest.
  2. Once installed, Shopify will redirect you to https://app.lyntest.com.

Click “Create A/B Test” to start your first test!

Docs Version Dropdown

2. Create an A/B Test​

  • A/B test name :​

    Enter a name for your test.

  • A/B test duration​

    Choose how long your test will run (between 1 and 30 days).
    We recommend running your test for at least 15 days to ensure statistical significance.

  • Schedule​

    You can schedule your test to start later by selecting a specific launch date and time.

    tip

    The “End date” label appears in both the Duration and Schedule sections.
    It indicates the date your test will end.

  • Theme​

    Select the theme where the test will run.

    important

    For your first selection, you’ll see this message :​

    Docs Version Dropdown

    You need to install the extension on your theme.​

    • (1) Click the link, this will open Shopify.

      Docs Version Dropdown

    • (2) Make sure lyntest sdk is checked on the left side.

      Docs Version Dropdown

    • (3) Then click Save (top-right corner).

      Docs Version Dropdown

    • (4) Close the tab, return to the A/B Test page, and click the button:

      Docs Version Dropdown

  • Add a variant and set traffic split​

    Docs Version Dropdown
    Once you’ve added a variant, you can define the traffic split between versions.

    In the example above :

    • Control : 40% of visitors will see the original store version.
    • Variant : 60% will see the modified version.

3. Edit the Variant​

important

If your store is password-protected, please log in before continuing.

Next to “Variant”, you can edit or delete it:
Docs Version Dropdown

Clicking Edit redirects you to your store with the Lyntest editor open:

Docs Version Dropdown

Making changes​

You can select and modify any element on your store.
All changes are saved automatically.
When finished, click the red cross to close the editor.

4. Launch your test​

At the bottom of the page, click “Launch Test.”
The test status at the top will change to Live.

For scheduled tests, we’ll automatically start the test at the defined date and time.

Your test is now live ! 🎉🎉🎉​

5. Analytics​

Variant comparison​

Docs Version Dropdown

This table allows you to compare performance between the Variant and the Control.
By default, four columns are displayed: Visitors, Add to cart rate, Conversion rate, and Revenue per visitor.

Uplift is shown in green for each metric: add to cart rate, conversion rate and revenue per visitor.
It represents the estimated percentage improvement of the variant over the control, based on the Bayesian model (not a simple ratio).

If you would like to see the detailed analytics, click the toggle switch at the top.

Variant comparison - details​

Docs Version Dropdown The detailed analytics view adds several additional columns to the table: Add to cart, Sales, Orders, and Average Order Value.

Sales calculation uses Net Sales : the amount paid by customers after discounts, excluding taxes and shipping.

Note on Add-to-cart calculation

We don't subtract removals because we measure user interest, not final sales. An "Add to Cart" proves the variant was effective, even if external factors (like shipping costs) led the user to change their mind. This prevents "false negatives" in your data.

Winner detection​

Docs Version Dropdown

It provides a clear performance verdict for the Variant across add to cart rate, conversion rate and revenue per visitor , explicitly showing if it outperforms the Control.

The more data, the better!

At 30 orders per version or 30 add to carts :

  • consider this a preliminary analysis.

At 100 orders per version or 100 add to carts:

  • You can start making decisions based on the winner detection results.

Multi-Page Testing​

If you edited a page that isn’t a product page, Lyntest will show your overall store performance.
If you edited a product page, Lyntest will show its individual performance.

Example

You edited the home page, product page 1, and product page 2 in a same test.
Analytics will display:

  • Overall store performance
  • Product page 1 performance
  • Product page 2 performance

Users assigned to the Variant will remain in that group across all pages. The same applies to users assigned to the Control."