Overview

Before publishing your A/B tests, you can preview and test variants across multiple devices to ensure everything works as expected. CleverTap’s enhanced A/B Test feature allows you to test on registered devices, view live variants, and run multiple tests.

The Device Previews in CleverTap enable you to:

• Mark devices as test devices and target them for QA.
• Assign specific variants to individual devices or user profiles.
• Verify app behavior and visual consistency before rollout.

This feature is designed for QA, marketing, and product teams who want complete control over their A/B testing environment.

Prerequisites

Before testing an A/B experiment:

• Check that your CleverTap SDK is updated to the latest version that supports test device registration.
• You must have access permissions for A/B test creation and Device Previews.
• The devices you plan to use for testing must be part of a test profile.

Mark a Profile as Test Profile

A Test Profile lists all the devices associated with it. Before assigning test devices to variants, you must first mark the user profile as a Test Profile. To mark a profile as a test profile, do the following:

1. Go to Segments > Find People.
2. Search for a user profile using Identity or CleverTap ID.
3. Select mark as test profile.

For more information, refer to Mark a user profile as a Test Profile.

Assign Test Devices to Variants

1. Go to Product Experiences > A/B Tests
2. Create a new A/B Test or open an existing A/B Test.
3. Under the Device Preview section, click Add Preview. The users and devices are listed. Each entry shows the following:
   • Test User or Profile Name
   • Preview Status (Active or Inactive)
   • Preview Devices (number of devices linked)
   • Variant assigned to that device
4. Select the Test Users and Devices.
5. Select the variant for the selected device and click Save.

📘

Note

You can mark multiple devices on the same user profile. Only devices marked as test devices appear in the Test Devices selector during A/B test setup.

This allows different devices under the same profile to preview distinct variants, such as:

• Variant A on the Home screen of an iPhone
• Variant B on the Settings screen of a Pixel device

Use this panel to:

• Start or stop previews
• Deselect or clear specific devices
• Quickly compare variant performance in real-time environments

👍

Tip

You can now conduct multiple A/B tests simultaneously, making parallel QA testing possible across teams.

Stop or Edit a Device Preview

To modify or stop an active test session:

1. View Running Tests in the A/B Test dashboard.

2. From the Device Previews section, select the profiles and devices.

3. You can either edit the device preview or do the following:

   • Update Test – to add or remove devices.
   • Stop Test – to end test mode for that session.
   • Delete – to remove the device from the preview.

📘

Note

Stopping a preview only removes the device from device list. It does not affect your published A/B test configuration.

Troubleshooting

FAQs

Can I run multiple tests in Test Mode?

Yes. You can now preview and test multiple A/B experiments simultaneously.

Do test devices affect production users?

No. Only registered test devices get variant changes.

Can I remove the test device later?

Yes. Remove the device by editing Device Previews.