NOTE: Split testing is a feature of ListManager Enterprise, and is unavailable for standard ListManager. Contact your account representative at sales@lyris.com if you'd like to upgrade to ListManager Enterprise.
Split-testing gives you the ability to send different versions of a message to random subsets of your mailing list, then compare the results to see which version is most effective. This type of testing eliminates any demographic or action-based bias that could alter your results.
After you determine which version of the message gives the best results, you can send it to the rest of your list.
Before doing a split test, you must create at least two content items to use in the test. For information about creating content, see Creating Content -- Overview.
1. In the left Navigation Bar, select Mailings: Advanced Mailings.: Split Test Mailings and then click Split Test Mailings Wizard.
Screen 1
On this screen, you create the split test.
Split Test Name
Type a name to identify your split test. The name can be up to 70 characters long.
Split Test Description
Type a description for your split test.
Segment
To send the split test to a specific segment instead of the entire mailing list, select the segment you want from the Segment drop down list. The default setting is the entire mailing list.
Sampling Methodology
You can send the split test to either a percentage of your mailing list or segment, or a specific number of members in the list:
To send the message to a percentage of a list or segment
Select % of Segment, then type the percentage in the Total % to receive test field.
To send the message to a specific number of members
Select # of Members, then type the number in the Total # to receive tests field.
Content 1
In the Content 1 drop down list, select the content you want to send to the first group.
Content 2
In the Content 2 drop down list, select the content you want to send to the second group.
TIP: To view the content, click View next to the content you want to see.
Click OK..
To add another content item to the split test
This option is available only if additional content items exist. For information about creating content, see Creating Content -- Overview.
1. Click More.
The Content 3 drop down list appears.
2. In the Content 3 drop down list, select the content you want.
3. Repeat steps 1 and 2 to add more content.
To remove the most recently added content item
This option is available only if you added more than two content items.
To continue, click Next.
Screen 2
On this screen, you specify test options.
Purge From
To purge members who received previous messages and/or members who will receive scheduled messages:
1. Click Choose Mailings.
2. In the Available Sent Mailings to Purge From and/or Available Scheduled Mailings to Purge From list, select the message you want.
TIP: To select multiple messages, hold down the CTRL key while selecting each message.
3. Click >>.
TIP: To deselect a message, select it in the Chosen Sent Mailings to Purge From or Chosen Scheduled Mailings to Purge From list, then click <<.
4. Click OK.
Suppression list
To add a list of members who should not receive this split test:
1. Click Choose File.
2. To terminate importing of the list after a certain number of malformed addresses, select an option from the Terminate import drop down list.
3. Click Browse and select the suppression list you want.
4. Click OK.
Recency Limit
To purge members who recently received email from you:
1. Click Edit Recency.
2. Specify the recency you want.
3. Click OK.
Synchronize list prior to mailing
By default, synchronization is turned off. If you want to synchronize, select Yes to use ODBC to synchronize with your external database.
Note This option will be greyed out if you have not first configured ODBC synchronization under Members: Synchronize Settings.
By default, ListManager keeps track of the members who open your test email. If you do not want to track opens, select no.
Detect HTML capability
By default, ListManager detects whether a member's email software is capable of displaying HTML. If you do not want to detect HTML capability, select no.
By default, ListManager makes all URLs in the mailing clickthrough tracking URLs. If you do not want to track URLs, select no.
Web Analytics
By default, ListManager enables analysis of all trackable web actions by the mailing list recipients. If you do not want to receive web analysis, select no.
Note Web Analytics need to be enabled on the Utilities: Administration: Sites: Edit Site screen.
To go back to the previous screen, click Go Back. To continue, click Next.
Screen 3
On this screen, you have the option to either schedule the mailing by selecting schedule for or wait for the mailing to be scheduled at a future time by selecting wait for approval.
To schedule the split test to be sent at a specific time:
1. Select schedule for
.
2. Enter the date and time in the schedule for text box or calendar drop-down.
All of the parts of the split test will be scheduled to be sent at the same time.
4. Click Next.
To schedule the split test to be sent when approved.
1. Select the default, Wait for Approval.
2. Click Next.
To go back to the previous screen, click Go Back. To continue, click Next.
Screen 4
On this screen, you can review your split test settings.
To return to a previous screen
To send the split test now.
To save the split test without sending
To cancel the split test and go back to screen 3
To reschedule a version of the split test