3 out of 6 rated this helpful - Rate this topic

IMAP Email Migration

 

Topic Last Modified: 2013-03-13

Use Email Migration in the Exchange Control Panel to migrate the contents of user mailboxes from an IMAP messaging system to your cloud-based email organization.

To start an IMAP migration, select Manage My Organization > Users & Groups > Email Migration > New. On the Welcome to Email Migration page, select IMAP and click Next.

Important   For an IMAP migration, you can only migrate a user’s inbox or other mail folders. You can’t migrate contacts or calendar items. Additionally, a maximum of 500,000 items can be migrated from a user’s mailbox.

Before you migrate mail from an IMAP server, be sure to plan your email migration carefully, especially if you're migrating lots of users. When you plan, make sure to check out Best practices.

To prepare for the migration:

  • Create a cloud-based mailbox for each user that you will migrate   Before you can migrate data from a user's mailbox on the IMAP server, the user has to have a cloud-based mailbox and user ID. Here's how to create new mailboxes and user ID for each user:
  • Obtain the FQDN for your IMAP server   You need to provide the FQDN of the IMAP server that you will migrate mailbox data from, for example, imap.contoso.edu.
    Tip   Use an IMAP client or the PING command to verify that you can use the FQDN to communicate with the IMAP server over the Internet.
  • Configure your on-premises firewall to allow IMAP connections   You may have to open ports in your on-premises firewall so network traffic originating from the Microsoft datacenter during the migration is allowed to enter your on-premises organization. For a list of IP addresses used by Microsoft datacenters, see Outgoing IP Addresses.
  • Decide which folders you don't want to migrate from the IMAP messaging system   For example, you may not want to migrate the contents of the Deleted Items and Junk Mail, and shared or public folders.
    Important   If you're migrating email from an on-premises Microsoft Exchange server, we recommend that you exclude public folders from the migration. If you don't exclude public folders, the contents of the public folders are copied to the cloud-based mailbox of every user.
  • Prepare the CSV file   Identify the group of users whose mailboxes you want to migrate. Include these users in the CSV file that will make up the migration batch. If you have to migrate thousands of mailboxes, it's a good idea to migrate users in several smaller batches. For example, if you have 10,000 accounts to migrate, you could run four batches with 2,500 users each, or you could divide the batches alphabetically, by user type, such as faculty, students, and alumni, by class, such as freshman, sophomore, junior, and senior, or in other ways that will help you keep track of the users you've migrated.
    Here are the required attributes for each user:
    • EmailAddress specifies the user ID for the user's cloud-based mailbox.
    • UserName specifies the user logon name for the user's mailbox on the IMAP server.
    • Password is the password for the user's account in the IMAP messaging system.
    Here's an example of the format for the CSV file. In this example, three mailboxes are migrated:
    EmailAddress,UserName,Password
    terrya@contoso.edu,terry.adams,1091990
    annb@contoso.edu,ann.beebe,2111991
    chrisc@contoso.edu,chris.cannon,3281986
    
    For the UserName attribute, in addition to the user name, you can use the credentials of a super-user account or administrator account that has the rights to access all mailboxes on the IMAP server. For more information, see Email Migration CSV Learn More.
    Tip   Use the CSV file that you used to import new users as the starting point for CSV migration file. For example, if you import 2,000 new users to your organization in the cloud, create a CSV file to migrate mail for those same 2,000 users.
  • Assign the super-user or administrator account permissions to access mailboxes in your Exchange organization   If you use administrator credentials in the CSV file, the account that you use must have the necessary permissions to access the on-premises mailboxes. You can assign the Full Access permission for individual mailboxes or assign the Receive As permission for a mailbox database. For more information, see the following:

     

    Exchange 2010

    Allow Mailbox Access

    Exchange 2007

    Exchange 2003

Return to top

  1. Select Manage My Organization > Users & Groups > E-Mail Migration > New.
  2. On the Welcome to E-mail Migration page, select IMAP and click Next.
  3. Configure the server settings.

     

    In this field… Do this…

    * IMAP server

    Type the FQDN of the IMAP server for the IMAP messaging system.

    Authentication

    Select the authentication method used by the IMAP server. Options are Basic, the default, or NTLM. Use NTLM if it's required by your IMAP server.

    Encryption

    Select the encryption method used by the IMAP server. Options are None, TLS, or SSL, the default.

    * Port

    Select the TCP port number used to connect to the IMAP server. Use port 143 for unencrypted connections, port 143 for TLS connections, and port 993 for SSL connections.

    Number of mailboxes to migrate simultaneously

    Specify the number of connections to the IMAP server available to migrate e-mail to cloud-based mailboxes. If the value is set to 3, the default value, you can migrate up to three mailboxes at the same time until all the mailboxes in the migration batch have been migrated. The maximum number of connections is 10.

    Note   The server settings you configure will persist on this page the next time you run E-Mail Migration to migrate a new batch of mailboxes.
  4. Click Next. Microsoft Exchange tries to communicate with the IMAP server to verify the server's FQDN and the port used to receive the IMAP requests. If the test connection to the IMAP server is successful, the Specify what and how to migrate (Step 2 of 3) page is displayed. If the test connection isn't successful, you'll get an error. Verify the configuration settings and try to connect again. You have to connect to the IMAP server to continue.
    If you can’t connect to the IMAP server, see this video for troubleshooting tips.

Return to top

  1. Click Browse to select the CSV file for the IMAP migration batch.
  2. In the Batch name field, type a name that identifies the migration batch. This name is displayed on the E-Mail Migration page. Batch names can’t contain spaces or special characters.
  3. Click Add folders to exclude if you don’t want to migrate the contents of certain folders in users' mailboxes, such as Deleted Items or Junk E-Mail, or if you want to exclude shared and public folders.
  4. Type the name of the folder and click Add. Be sure to type the folder name exactly as it appears, for example, Deleted Items or Junk E-Mail.
  5. You can add more than one folder to the list. When you are finished adding folders, click OK.
    Important   If you're migrating e-mail from an on-premises Microsoft Exchange server, we recommend that you exclude public folders from the migration. If you don't exclude public folders, the contents of the public folders are copied to the cloud-based mailbox of every user.
    Also, folders with a forward slash ( / ) in the name aren't migrated. If users want to migrate folders that contain forward slashes in their names, they have to rename the folders or replace the forward slashes with a different character, such as an underscore character ( _ ) or a dash ( - ).
  6. To send copies of the migration reports to other users, click Browse at the bottom of the page.
  7. Click Next.
    Microsoft Exchange checks the CSV file for the following:
    • It isn't empty.
    • It uses comma-separated formatting.
    • It doesn't contain more than 50,000 rows.
    • It isn't larger than 10 MB.
    • It includes the required attributes in the header row:
      • EmailAddress, which specifies the user ID for the user's cloud-based account
      • UserName, which specifies the user logon name for the user's mailbox in the IMAP messaging system
      • Password, which specifies the password for the user's account in the IMAP messaging system
    • It contains rows with the same number of columns as the header row.
    If any one of these checks fails, you'll get an error that describes the reason for the failure. At this point, you have to fix the CSV file and resubmit it. For more information, see Prepare a CSV file to Migrate E-mail.
    If the CSV file successfully passes these checks, you'll move on to the Migration batch <batch name> created successfully (Step 3 of 3) page.
  8. Review the information about the migration batch, and then click Close.

Return to top

After you create a migration batch, it’s displayed in the list on the E-mail Migration page. Details about the selected migration batch are displayed in the details pane. The status of the migration batch is set to Created.

To start processing a migration batch, select it and then click Start.

Return to top

In addition to the checks described in step 3, Microsoft Exchange also checks for data validation errors in the CSV file. If data in any row of the CSV file doesn't meet the property definition for the corresponding attribute in the header, you'll get an error. The migration process isn't terminated if data validation errors are found, but e-mail won't be migrated for the mailboxes that correspond to the rows that have data validation errors. If data validation errors are found, a warning and a link to the validation error report are displayed on the Start the migration page. For more information, see Troubleshoot Migration Validation Errors (EmailMigrationViewMigrationValidationErrorsLearnMore).

To start the migration:

  1. Decide if you want Microsoft Exchange to send a status e-mail message to other users when the migration batch is done running. If so, click the Browse to select one or more users.
  2. Review the migration settings.
    • To start processing the migration batch, click Run.
    • To cancel the current migration batch and return to step 1, click Start Over.

Return to top

After you start the migration batch, the status displayed in the details pane is changed to Queued or Running. Mailboxes are migrated in the same sequence as they’re listed in the CSV file.

The following table describes the information displayed in the details pane for the selected migration batch.

 

Field Description

Status

The current state of the selected migration batch. Includes the following states:

  • Created   Indicates that the migration batch is created. In this state, you can start, edit, delete, or change its position in the migration queue using the up or down arrow controls.
  • Queued   Indicates that the migration batch has been started. If the migration batch is at the top of the queue, it will start to run. If there are migration batches above it in the migration queue, the migration batch will remain in a queued state. It will start running after all migration batches above it are completed. In this state, you can stop the migration batch or change its position in the migration queue using the up or down arrow controls.
  • Running   Indicates that mailboxes in the migration batch are being actively migrated. In this state, you can stop the migration batch.
  • Stopped   Indicates that the migration batch is stopped, and no more mailboxes from the batch are being migrated. In this state, you can re-start the migration batch.
  • Synced   Indicates that migration batch is completed, and no mailboxes are being migrated. A migration batch in this state may contain errors when mailboxes weren’t migrated.

Requested

The number of mailboxes to be migrated in the migration batch. This number corresponds to the number of rows in the migration CSV file.

Synced

The number of mailboxes from the current migration batch that have been created in your cloud-based organization. This field is updated during the migration.

Active

Specifies the number of mailboxes being actively migrated. This number corresponds to the number of mailboxes to migrate simultaneously that you specified when configuring the connection settings.

Errors

The number of mailboxes that failed migration.

Creation Time

Date and time when the migration batch was created.

Start Time

Date and time when the migration batch was started.

Initial Sync Time

Date and time when the migration batch was completed.

Initial Sync Duration

The amount of time it took to complete the migration batch.

Last Synced Time

The last time the migration batch was re-started or the last time that incremental synchronization was performed for the batch.

Per-User Details

Click Open to display status information about each mailbox in the migration batch. For more information, see E-mail Migration Per-User Status Report.

Reports

This section of the details pane contains links to the migration success and error reports. Links to these reports are sent to the administrator after the migration is complete.

Click Success or Errors to download the following reports:

  • MigrationStatistics   A CSV file that contains a row for each mailbox that was successfully migrated. Each row contains the e-mail address of the mailbox, the status of the migration, the number of mailbox items migrated and the number of mailbox items that were skipped and not migrated.
  • MigrationErrors   A CSV file that contains a row for each mailbox that wasn't migrated or configured for mail forwarding. Each row contains e-mail address of the mailbox and a description of the error.

Return to top

To stop a migration batch, in the Active Email Migration pane, click Stop.

You can only stop migration batches that have mailboxes in the process of being migrated or are waiting to be migrated. The migration of any mailbox currently being processed is stopped immediately and is not completed. Also, stopping a migration batch won't affect mailboxes that have been migrated already.

After you stop a migration batch, you receive a status email message that says how many mailboxes were successfully migrated before the batch was stopped. This message also has an attached MigrationErrors.csv file that identifies the rows that were in progress when the migration was stopped and the rows waiting to be migrated.

After the current migration batch is complete, repeat steps 1 through 4 to run additional migration batches. Each migration batch uses its own CSV file.

Return to top

After you've run all your IMAP migration batches for the mailboxes you plan to migrate, you're ready to complete the migration. Follow these steps:

  1. Configure your MX record to point to your cloud-based email organization    Until you change your MX record, email sent to users is still routed to their mailboxes in the IMAP messaging system. When a user mailbox is successfully migrated, the mailbox on the IMAP server and cloud-based mailbox are periodically synchronized until you complete the overall migration. This lets users use their cloud-based account to access email sent to their IMAP mailbox. When you configure your organization's MX record to point to your cloud-based email organization, all email is sent directly to the cloud-based mailboxes.
    After you change the MX record and verify that all email is being routed to cloud-based mailboxes, you're ready to complete the migration.
    Important   It can take from 24 to 72 hours for the updated MX record to be propagated. Wait at least 24 hours after you change the MX record before you complete the migration. Verify that mail is being routed to cloud-based mailboxes before you complete the migration.
  2. Complete the overall migration process   Click Complete Migration in the Email Migration pane. What happens when you click Complete Migration?
    • Microsoft Exchange runs a final synchronization for all mailboxes. After this, email is no longer synchronized between mailboxes on the IMAP messaging system and cloud-based mailboxes.
    • Microsoft Exchange sends a final status email message after the migration is complete. If there are any errors during the final synchronization process, a MigrationErrors.csv file that lists the errors is attached to this message.

Return to top

Here are some tips to optimize your IMAP migration:

  • Increase the connection limits to your IMAP server   Many firewalls and email servers have per-user limits, per-IP address limits, and overall connection limits. Before you migrate mailboxes, make sure that your firewall and IMAP server are configured to allow a large, or maximum, number of connections for the following settings:
    • The total number of connections to the IMAP server
    • The number of connections by a particular user. This is important if you use administrator credentials in the CSV migration file because all connections to the IMAP server are made by this user account.
    • The number of connections from a single IP address. This limit is typically enforced by the firewall or the email server.
    If your IMAP server is running Exchange Server 2010 or Exchange 2007, the default settings for connection limits are low. Be sure to increase these limits before you migrate email. By default, Exchange 2003 doesn't limit the number of connections.
    For more information, see:
  • Change the DNS Time-to-Live (TTL) setting on your MX record   Before you start migrating mailboxes, change the DNS TTL setting on your current MX record to a shorter interval, such as 3600 seconds (one hour). Then, when you change MX record to point to your cloud-based email organization after all mailboxes are migrated, the updated MX record should propagate more quickly because of the shortened TTL interval.
  • Run one or more test migration batches   Run a few small IMAP migration batches before you migrate larger numbers of users. In a test migration, you can do the following:
    • Verify the format of the CSV file.
    • Test the settings used to connect to the IMAP server
    • Verify you can successfully migrate email using super-user credentials, if applicable.
    • Determine the optimal number of simultaneous connections to the IMAP server that minimize the impact on your Internet bandwidth. For more information, see Maximum Number of Connections to Your Mail Server.
    • Verify that folders you exclude aren't migrated to the cloud-based mailboxes.
    • Determine how long it takes to migrate a batch of users.
    Use CSV files with the same number of rows and run the batches at similar times during the day. Then compare the total running time for each test batch. This will help you estimate how long it will take to migrate all your mailboxes, how large each migration batch should be, and how many simultaneous connections to the IMAP server you should use to balance migration speed and Internet bandwidth.
  • Create mailboxes and migrate email for the same batch of users   Use the CSV file that you used to import new users as the starting point for the CSV file. For example, if you import 2,000 new users to your cloud-based email organization, create a CSV file to migrate mail for those same 2,000 users. This is an effective way to organize and manage your migration from an on-premises messaging system to your cloud-based organization.
  • Use super-user or administrator credentials in the CSV file to migrate email   This method is the least disruptive and inconvenient for users, and it will help minimize synchronization errors caused when users change the password on their on-premises account. It also saves you from having to obtain or change user passwords. If you use this method, be sure to verify that the administrator account you use has the necessary permissions to access the mailboxes you are migrating.
    Tip   If you decide to use user credentials in the CSV file, consider globally changing users' passwords and then preventing users from changing their password on their on-premises account before you migrate their mailboxes. If users change their password before their mailbox is migrated to the cloud-based mailbox, the migration will fail. If they change their password after the mailbox is migrated, new email sent to their mailbox on the IMAP server will not be migrated to their cloud-based mailbox.
  • Don't delete mailboxes or change their SMTP addresses during migration   The migration system will report an error when it can't find a mailbox that's been migrated. Be sure to complete the migration before you delete or change the SMTP address of a cloud-based or on-premises mailbox that's been migrated.
  • Communicate with your users   Give users a heads-up that you are migrating the content of their on-premises mailboxes to your cloud-based organization. Consider the following:
    • Tell users that email messages larger than 35 MB won't be migrated. Ask users to save very large messages and attachments to their local computer or to a removable USB drive.
    • Ask users to delete old or unnecessary email messages from the on-premises mailbox before migration. This helps reduce the amount of data that has to be migrated and can help reduce the overall migration time. Or you can clean up their mailboxes yourself.
    • Suggest that users to back up their Inbox.
    • Tell users which folders won't be migrated.
    • Folders with a forward slash ( / ) in the folder name aren't migrated. If users want to migrate folders that contain forward slashes in their names, they have to rename the folders or replace the forward slashes with a different character, such as an underscore character ( _ ) or a dash ( - ).
    • Tell users when they can use their cloud-based account to access the email that was migrated from their on-premises account. Don't give users access to their cloud-based accounts until you're ready to complete the migration.
      Need a good way to provide users with information about their new cloud-based accounts? See Send a Welcome Message to New Users.

Return to top

 
Did you find this helpful?
(1500 characters remaining)
© 2013 Microsoft. All rights reserved.