Exchange Server 2003 MAPI Messaging Benchmark 3

Exchange Server 2003 MAPI Messaging...

Topic Last Modified: 2007-12-26

Published: July 14, 2003

MAPI Messaging Benchmark 3 (MMB3) is the benchmarking standard for measuring the performance and scalability of computers running Exchange Server 2003.

What's New in MMB3

For Exchange 2000 Server, the benchmarks were measured using the MAPI Messaging Benchmark 2 (MMB2). MMB3 evaluates the messaging performance of a server by measuring how it scales up when adding concurrent load that is modeled after typical corporate e-mail use. An operating environment with higher MMB3 results than another is able to hold more users per server, although the exact number is not the MMB3 score.

The MMB3 workload for LoadSim 2003 is a modification of the previous MMB2 workload. It is designed to include new features from Exchange Server 2003 and Microsoft Office Outlook 2003. This workload achieves the following:

Uses the Outlook 2003 client.
Introduces Smart Folders.
Introduces the use of server-side rules.
The message distribution is composed of bigger messages then MMB2.
The mailbox size is increased to 100 megabytes (MB) per user.
Removes journaling from the benchmark.

The following tables offer a complete comparison of the MMB3 workload to the MMB2 workload.

Topology Properties	MMB2	MMB3
Security
Uses a separate account for each Exchange Server user	No	Yes
Uses one account for all Exchange Server users	Yes	Not tested
Credentials
Logs on to users using their respective accounts	No	No
Distribution Lists
Uses distribution lists	Yes	Yes
Number of distribution lists per site	100	1,000
Distribution list minimum/average/maximum	2/10/20	2/10/20
Dynamic Distribution Lists (DDLs)
Uses DDLs	No	No
Creates one DDL for all LoadSim users	No	No
Creates one per database (.mdb)	No	No

Test Properties	MMB2	MMB3
Tasks
Sends mail
Number of times per day	7	8
Priority percent high	1	15
Priority percent low	0	15
Request receipts percent delivery	0	0
Request receipts percent read	0	0
Request receipts percent both	0	0
File name (weight)
Oups1k.msg	37	15
Oups2k.msg	18	18
Oups4k.msg	14	16
Oups10kat.msg	0	0
OupsWDatt.msg	7	20
OupsXLatt.msg	7	17
OupsBMobj.msg	10	5
OupsXLobj.msg	0	0
McPP1Matt.msg	1	2
McPP100katt.msg	5	5
McWD2Matt.msg	1	2
Recipients per message	1?5, average 3	1?5, average 3
Adds a distribution list to percent messages sent	30	30
Adds a DDL to percent messages sent	0	0
Saves a copy in Sent Items folder	Yes	Yes
Processes Inbox
Reads new mail per day	Yes	Yes
Loads MAPI properties as Outlook 2003 does	No	Yes
Applies random views to Inbox percent of the time	Not tested	75
Message actions
Replies	20	45
Replies to all	7	5
Forwards	10	5
Deletes	100	25
Copies	0	0
Moves	0	10
Permanently deletes	0	10
Reads note delay minimum/average/maximum	1.0/1.0/1.0	0.0/0.0/0.0
Loads percent of attachments	75	95
Accepts percent of meeting requests	70	70
Opens messages
Keeps up to messages open after browsing	0	0
Leaves messages open percent of the time	0	0
Maximum messages in folders
No limit	No	No
Limits number of messages	125	125
Browses mail
Browses mail per day	15	15
Applies random views to folders percent of the time	Not tested	75
Opens messages
Keeps up to messages open after browsing	Not tested	0
Leaves messages open percent of the time	Not tested	0
Maximum messages in folders
No limit	Yes	Yes
Limits number of messages	?	?
Public folder post	Not tested	Not tested
Browse public folders	Not tested	Not tested
Free/Busy
Updates schedule times per day	4	4
Updates Free/Busy information	No	Yes
Schedule size minimum/maximum/average in kilobytes	5/40/22	5/40/22
Requests meetings
Makes new meetings per day	2	2
Meeting length minimum/average/maximum in hours	1/2/7	1/2/7
Attendees minimum/average/maximum	1/5/40	1/5/40
Adds a distribution list percent of the time	20	20
Makes appointments
New appointments per day	4	4
Appointment length minimum/average/maximum	1/3/9	1/3/9
Percent recurring appointments	15	15
Percent all-day events	5	5
Browse calendar
Number of times per day	6	6
Journal mail items
Number of times per day	Not tested	Not tested
Journal applications
Activity number of times per day	3	Not tested
Logs off
Number of times per day to log off	3	3
Always keeps connection	No	No
Empties Deleted Items folder	Yes	Yes
Browses Contacts
Number of times per day	10	10
Creates Contact
Number of times per day to make new contact	1.4	1.4
Smart Folders
Number of times per day	Not tested	3
Actions
Deletes	Not tested	40
Creates	Not tested	60
Browses	Not tested	0
Number of Smart Folders (minimum/maximum)	Not tested	3/10
Criteria for mail in Smart Folders
Unread	Not tested	20
Important	Not tested	5
Old mail	Not tested	5
For follow up	Not tested	10
Conversation with random person or distribution list	Not tested	5
Unread or for follow up	Not tested	5
Received this week	Not tested	5
From random person or distribution list	Not tested	20
Large (size)	Not tested	10
Sent to random distribution list	Not tested	5
With specific word	Not tested	10
Rules
Number of times per day	Not tested	3
Activities with rules
Deletes	Not tested	40
Creates	Not tested	50
Number of rules (minimum/maximum)	Not tested	0/10
Conditions
From distribution list	Not tested	20
From person	Not tested	45
Sent only to me	Not tested	0
With word in subject or body	Not tested	5
Name in To/CC box	Not tested	0
With attachment	Not tested	10
Name not in To box	Not tested	0
With word in subject	Not tested	20
Actions
Deletes	Not tested	0
Moves to folder	Not tested	100
Copies to folder	Not tested	0
Forwards to person	Not tested	0
Forwards to distribution list	Not tested	0
Permanently deletes	Not tested	0
Stops processing more rules	Not tested	100
Test/log ons
Logs on immediately at the very beginning of the test	Yes	Yes
Logs off at the end of each simulated day	Yes	Yes
Empties Deleted Items folder while logging off	Yes	Yes
Test report: approximate message traffic, per user, per day
Total received	185	205
Replies	20.56	46.61
Replies to all	6.48	4.78
Forwards	10.08	4.78
Total submitted	51	84
Average number of recipients per message (all messages)	3.63	2.44
Approximate receipts requested, per user, per day
Read receipts	0	0
Delivery receipts

1	All messages were converted to HTML bodies in LoadSim 2003.

Initialization Properties	MMB2	MMB3
Mailbox Setup
Number of messages in Inbox	55	250
Number of messages in Deleted Items folder	1	1
Number of new folders	10	5
Messages per new folder	55	200
Number of Smart Folders	0	3
Number of rules in Inbox	0	5
Initializes Free/Busy information	No	No
Calendar Setup
Number of appointments	25	25
Contacts Setup
Number of contacts	64	64

Action Weights (for calculating response times)	MMB2	MMB3
Mailbox Setup
Sends	1	1
Reads	10	25
Replies	1	3
Replies to all	1	3
Forwards	1	3
Moves	1	5
Deletes	3	5
Permanently deletes	0	5
Schedule Plus Free/Busy	0	2
Browses calendar	1	1
Makes appointment	1	1
Requests meeting	1	1
Creates Smart Folder	0	1
Deletes Smart Folder	0	1
Creates rule	0	1
Deletes rule	0	1
Applies view/sorts	0	1