Set up an InSight test

This guide describes how to create and manage InSight incrementality tests. With Adjust InSight, you gain a deeper understanding of campaign efficacy through advanced data modeling, utilizing both your app's data and Adjust's extensive dataset.

There are two types of incrementality tests:

• Historic tests: the test is run for a marketing action that was taken over 7 days in the past.
• Scheduled tests: the test is scheduled to run fewer than 7 days in the past. You can select a future date or a date that is fewer than 7 days in the past.

Before you begin

Here's what you need to know before getting started:

• Admin and Editor users may create new incrementality tests. No Custom user can access Adjust InSight tests. See the Permission levels article for more information about different user roles.
• Adjust InSight requires at least 12 weeks of ad spend data to offer accurate insights into campaigns. Make sure you configure ad spend and verify the data is accurate before enabling InSight. For the best results, ensure you configure all applicable sources in SpendWorks.
• To ensure a clean dataset, you must not start, stop, or make budget increases or decreases to any channels or campaigns in the network and country of your test, 7 days pre- or 7 days post-launch of the incremental campaign(s) being analyzed.
• You can perform analysis only on metrics that occur on average 100 times per day or more.

Prepare for an InSight test

Adjust InSight tests are run on historical data. To create a dataset for an incrementality test, you must leave a pre- and post-period of 7 days before and after the marketing action you want to measure.

You can run incrementality tests for the following marketing actions.

• Starting a new campaign or launching a new network.
• Stopping an existing campaign or halting an existing network.
• Increasing the budget of a campaign or network.
• Reducing the budget of a campaign or network.

Follow the instructions below to prepare your incrementality test data.

1. Decide what action and data to test on

To prepare for an incrementality test with Adjust InSight, follow these steps:

1. Choose which of the above marketing actions you want to test, and which partner/network you want to run the test for.
2. Choose the metric you want to measure. You can choose between installs or any in-app events.
3. Decide on which dates you are going to perform your marketing action. Make sure that no other marketing actions are executed during the selected period with the test partner or any other partner/network.
4. Carry out the test with your partner/network. Make sure that no other marketing actions are executed with the test partner or any other partner/network while the test is running.

2. Check your data set for analysis

To ensure the best results, check your data set to confirm the following:

• Ad Spend for the partner is accurate for at least 12 weeks.
• The measured metric has at least 100 conversions per day for the target campaign/network and Organic traffic.
• No other marketing actions are taken 7 days prior to or after you perform the test marketing action.

Create an InSight incrementality test in the Adjust dashboard

To create a new InSight incrementality test:

1. Select Datascape -> InSight in the left-hand sidebar.
2. Select + New test in the top-right of the screen.
3. Select the pencil icon () next to the test name to rename the test.

1. Choose the action and metric to measure

To create a new InSight test, you need to define what you want to measure. To do this:

1. Select an Action to measure. The available options are:
   • Campaign start
   • Campaign stop
   • Budget increase
   • Budget decrease
2. Select an Action date. This is the date on which your target action occurred or will occur.
   • If you select an Action date in the future or less than 7 days in the past, the test is scheduled to run 7 days after the action date.
3. Select the Metric to measure:
   • Events: measure the number of times an event was triggered or the amount of revenue generated by an event. Revenue events are not available in Adjust InSight.
   • Installs: measure the number of installs by Attribution or Network.

2. Select the app, platform, and country

Select the app you want to perform incremental analysis on and enter the platform and country details you want to measure. You can use the search bar in any option list to look for a specific app, platform, and country.

1. Choose an app from the list and select Apply.
2. Choose the platform you want to measure and select Apply. Only the platforms that you have set up for your app are available.
3. Choose the country that you would like to focus on for your test and select Apply.

3. Choose to test by campaign or network

Choose either to run the test for specific campaigns or for all the campaigns you have with a specific network.

Select either Campaigns or Network. According to your selection, you can perform two different actions:

For Campaigns:

1. Select a network.
2. Select one or more campaigns. Your test will show the combined result of all the campaigns you select.

For Network:

1. Select a network.

After you have filled out all sections and fields, select Create test to finish. You can see the status of your test in the test list.

View your InSight test results

Once your test is Completed, you can view the test results. See the InSight results page guide for information on how to interpret test results.

Manage your InSight tests

The InSight tests page presents a list of all your available tests and their relevant details. Use the search bar to search for a specific test or narrow down the list by selecting any of the available filters:

• Actions
• Networks
• Apps
• Platforms
• Countries

Here are the relevant details you can see for each test:

Test statuses

Adjust InSight displays the current status of your tests in the test list. Here is a list of statuses and their meanings:

• Pending: The test has not yet run.
• Scheduled: The test is scheduled to run in the future.
• Running: The test is currently running and results are not yet available.
• Failed: The test failed to run. Select the test to check the reason for the failure and what actions you can take to remedy the failure. Reach out to your Adjust representative if you are experiencing issues.
• Completed: The test has finished running and has produced results. Select the test from the test list to see the results.

Edit a scheduled test

You can edit scheduled tests at any time before midnight UTC on the day they are scheduled to run. To edit a scheduled test:

Find the test you want to edit. Select the three-dot menu and select Edit.

Select Edit test on the test page.

Edit the details of your test and select Save.

1/3

(1/3)

(2/3)

(3/3)

1. Find the test you want to edit.
2. Select the three-dot menu () and select Edit.
3. On the test page that appears, select Edit test.
4. Edit the details of your test and select Save to save the test.

The test will run with the updated details on the scheduled date.

Delete an InSight test

To delete an InSight test:

1. Select Datascape -> InSight in the left-hand sidebar.
2. Find the test you want to delete in the test list and select the trash can icon () on the right-hand side.