Export (0) Print
Expand All
Expand Minimize

Exchange Server 2003 MAPI Messaging Benchmark 3

 

Topic Last Modified: 2007-12-26

Published: July 14, 2003

MAPI Messaging Benchmark 3 (MMB3) is the benchmarking standard for measuring the performance and scalability of computers running Exchange Server 2003.

For Exchange 2000 Server, the benchmarks were measured using the MAPI Messaging Benchmark 2 (MMB2). MMB3 evaluates the messaging performance of a server by measuring how it scales up when adding concurrent load that is modeled after typical corporate e-mail use. An operating environment with higher MMB3 results than another is able to hold more users per server, although the exact number is not the MMB3 score.

The MMB3 workload for LoadSim 2003 is a modification of the previous MMB2 workload. It is designed to include new features from Exchange Server 2003 and Microsoft Office Outlook 2003. This workload achieves the following:

  • Uses the Outlook 2003 client.

  • Introduces Smart Folders.

  • Introduces the use of server-side rules.

  • The message distribution is composed of bigger messages then MMB2.

  • The mailbox size is increased to 100 megabytes (MB) per user.

  • Removes journaling from the benchmark.

The following tables offer a complete comparison of the MMB3 workload to the MMB2 workload.

 

Topology Properties MMB2 MMB3

Security

 

 

  • Uses a separate account for each Exchange Server user

No

Yes

  • Uses one account for all Exchange Server users

Yes

Not tested

Credentials

 

 

  • Logs on to users using their respective accounts

No

No

Distribution Lists

 

 

  • Uses distribution lists

Yes

Yes

  • Number of distribution lists per site

100

1,000

  • Distribution list minimum/average/maximum

2/10/20

2/10/20

Dynamic Distribution Lists (DDLs)

 

 

  • Uses DDLs

No

No

  • Creates one DDL for all LoadSim users

No

No

  • Creates one per database (.mdb)

No

No

 

Test Properties MMB2 MMB3

Tasks

 

 

Sends mail

 

 

  • Number of times per day

7

8

  • Priority percent high

1

15

  • Priority percent low

0

15

  • Request receipts percent delivery

0

0

  • Request receipts percent read

0

0

  • Request receipts percent both

0

0

  • File name (weight)

 

 

  • Oups1k.msg

37

15

  • Oups2k.msg

18

18

  • Oups4k.msg

14

16

  • Oups10kat.msg

0

0

  • OupsWDatt.msg

7

20

  • OupsXLatt.msg

7

17

  • OupsBMobj.msg

10

5

  • OupsXLobj.msg

0

0

  • McPP1Matt.msg

1

2

  • McPP100katt.msg

5

5

  • McWD2Matt.msg

1

2

  • Recipients per message

1?5, average 3

1?5, average 3

  • Adds a distribution list to percent messages sent

30

30

  • Adds a DDL to percent messages sent

0

0

  • Saves a copy in Sent Items folder

Yes

Yes

Processes Inbox

 

 

  • Reads new mail per day

Yes

Yes

  • Loads MAPI properties as Outlook 2003 does

No

Yes

  • Applies random views to Inbox percent of the time

Not tested

75

  • Message actions

 

 

  • Replies

20

45

  • Replies to all

7

5

  • Forwards

10

5

  • Deletes

100

25

  • Copies

0

0

  • Moves

0

10

  • Permanently deletes

0

10

  • Reads note delay minimum/average/maximum

1.0/1.0/1.0

0.0/0.0/0.0

  • Loads percent of attachments

75

95

  • Accepts percent of meeting requests

70

70

  • Opens messages

 

 

  • Keeps up to messages open after browsing

0

0

  • Leaves messages open percent of the time

0

0

  • Maximum messages in folders

 

 

  • No limit

No

No

  • Limits number of messages

125

125

Browses mail

 

 

  • Browses mail per day

15

15

  • Applies random views to folders percent of the time

Not tested

75

  • Opens messages

 

 

  • Keeps up to messages open after browsing

Not tested

0

  • Leaves messages open percent of the time

Not tested

0

  • Maximum messages in folders

 

 

  • No limit

Yes

Yes

  • Limits number of messages

?

?

Public folder post

Not tested

Not tested

Browse public folders

Not tested

Not tested

Free/Busy

 

 

  • Updates schedule times per day

4

4

  • Updates Free/Busy information

No

Yes

  • Schedule size minimum/maximum/average in kilobytes

5/40/22

5/40/22

Requests meetings

 

 

  • Makes new meetings per day

2

2

  • Meeting length minimum/average/maximum in hours

1/2/7

1/2/7

  • Attendees minimum/average/maximum

1/5/40

1/5/40

  • Adds a distribution list percent of the time

20

20

Makes appointments

 

 

  • New appointments per day

4

4

  • Appointment length minimum/average/maximum

1/3/9

1/3/9

  • Percent recurring appointments

15

15

  • Percent all-day events

5

5

Browse calendar

 

 

  • Number of times per day

6

6

Journal mail items

 

 

  • Number of times per day

Not tested

Not tested

Journal applications

 

 

  • Activity number of times per day

3

Not tested

Logs off

 

 

  • Number of times per day to log off

3

3

  • Always keeps connection

No

No

  • Empties Deleted Items folder

Yes

Yes

Browses Contacts

 

 

  • Number of times per day

10

10

Creates Contact

 

 

  • Number of times per day to make new contact

1.4

1.4

Smart Folders

 

 

  • Number of times per day

Not tested

3

  • Actions

 

 

  • Deletes

Not tested

40

  • Creates

Not tested

60

  • Browses

Not tested

0

  • Number of Smart Folders (minimum/maximum)

Not tested

3/10

  • Criteria for mail in Smart Folders

 

 

  • Unread

Not tested

20

  • Important

Not tested

5

  • Old mail

Not tested

5

  • For follow up

Not tested

10

  • Conversation with random person or distribution list

Not tested

5

  • Unread or for follow up

Not tested

5

  • Received this week

Not tested

5

  • From random person or distribution list

Not tested

20

  • Large (size)

Not tested

10

  • Sent to random distribution list

Not tested

5

  • With specific word

Not tested

10

Rules

 

 

  • Number of times per day

Not tested

3

  • Activities with rules

 

 

  • Deletes

Not tested

40

  • Creates

Not tested

50

  • Number of rules (minimum/maximum)

Not tested

0/10

  • Conditions

 

 

  • From distribution list

Not tested

20

  • From person

Not tested

45

  • Sent only to me

Not tested

0

  • With word in subject or body

Not tested

5

  • Name in To/CC box

Not tested

0

  • With attachment

Not tested

10

  • Name not in To box

Not tested

0

  • With word in subject

Not tested

20

  • Actions

 

 

  • Deletes

Not tested

0

  • Moves to folder

Not tested

100

  • Copies to folder

Not tested

0

  • Forwards to person

Not tested

0

  • Forwards to distribution list

Not tested

0

  • Permanently deletes

Not tested

0

  • Stops processing more rules

Not tested

100

Test/log ons

 

 

  • Logs on immediately at the very beginning of the test

Yes

Yes

  • Logs off at the end of each simulated day

Yes

Yes

  • Empties Deleted Items folder while logging off

Yes

Yes

Test report: approximate message traffic, per user, per day

 

 

  • Total received

185

205

  • Replies

20.56

46.61

  • Replies to all

6.48

4.78

  • Forwards

10.08

4.78

  • Total submitted

51

84

Average number of recipients per message (all messages)

3.63

2.44

  • Approximate receipts requested, per user, per day

 

 

  • Read receipts

0

0

  • Delivery receipts

 

 

 

1

All messages were converted to HTML bodies in LoadSim 2003.

 

Initialization Properties MMB2 MMB3

Mailbox Setup

 

 

  • Number of messages in Inbox

55

250

  • Number of messages in Deleted Items folder

1

1

  • Number of new folders

10

5

  • Messages per new folder

55

200

  • Number of Smart Folders

0

3

  • Number of rules in Inbox

0

5

  • Initializes Free/Busy information

No

No

Calendar Setup

 

 

  • Number of appointments

25

25

Contacts Setup

 

 

  • Number of contacts

64

64

 

Action Weights (for calculating response times) MMB2 MMB3

Mailbox Setup

 

 

  • Sends

1

1

  • Reads

10

25

  • Replies

1

3

  • Replies to all

1

3

  • Forwards

1

3

  • Moves

1

5

  • Deletes

3

5

  • Permanently deletes

0

5

  • Schedule Plus Free/Busy

0

2

  • Browses calendar

1

1

  • Makes appointment

1

1

  • Requests meeting

1

1

  • Creates Smart Folder

0

1

  • Deletes Smart Folder

0

1

  • Creates rule

0

1

  • Deletes rule

0

1

  • Applies view/sorts

0

1

 
Was this page helpful?
(1500 characters remaining)
Thank you for your feedback

Community Additions

ADD
Show:
© 2014 Microsoft