Reports

Microsoft Office Communications Server 2007 and Microsoft Office Communications Server 2007 R2 will reach end of support on January 9, 2018. To stay supported, you will need to upgrade. For more information, see Resources to help you upgrade your Office 2007 servers and clients.

You obtain information about media quality by reviewing reports that are based on the data that the QoE Monitoring Server collects and uses to calculate mean opinion scores. If you installed SQL 2005 with Reporting Services, then you can view these reports at the Reporting Service instance that you specified during setup.

You need the Windows Internet Explorer® 7 Internet browser or Microsoft Internet Explorer 6 for Windows with all service packs applied and with scripting enabled on the QoE Monitoring Server on the computer which you plan to view the reports.

You can create your own reports, but the QoE Monitoring Server includes the following predefined reports:

QoE Monitoring Server generates the following reports:

  • QoE summary

  • QoE trends

  • Worst performing endpoints

  • Devices (not included for conference reports)

The reports are described in the following sections. The reports are collected in predefined scenarios, which are described later in this guide.

QoE Summary Report

The QoE summary report shows the sample size of calls and aggregate values for the following MOSs so that you can see at a glance the average level of media quality for audio calls whose quality was monitored:

  • Conversational MOS

  • Listening MOS

  • Network MOS

  • Sending MOS

If you click a metric in the report, a subreport displays a histogram that shows the distribution of scores for that metric.

For each MOS, the QoE Summary Report shows the average score for a prior period, as well as for the current period. The current period is the time range that is specified in the Period filter, and the period ends on the date and time specified in the Period End field of the report. The Prior Period is the same time range, but it ends on the start date of the Current Period. For example, Figure 2 shows a QoE Summary Report for the current week and for the week before. The Difference column shows the difference between the sample size and the MOSs for both periods of time. The larger the sample size, the more meaningful the average score.

Note

In general, a sample size of less than 30 has too large a margin of error to provide a useful MOS.

961007d4-4033-4eeb-af19-58f4e68eae9b

Figure 2. QoE Summary Report

c340af49-b103-4cb8-848f-c7883bf401b8

Figure 3. QoE Summary Report – Conversational MOS

QoE Trend Report

The QoE trend report shows changes in the MOSs over time so that you can see whether media quality is improving, declining, or staying the same. The following MOSs are reported:

  • Conversational MOS

  • Listening MOS

  • Sending MOS

  • Network MOS

  • Network MOS Degradation

The QoE Trend Report displays the MOSs and the network MOS degradation over the period that is specified by the Period and Period Ends filters. For example, the QoE Trend Report in Figure 4 shows the MOSs over one week period with the specified end date. Each row shows a trend for a particular metric. The blue horizontal line represents the cumulative mean value for the MOSs that are shown. In this example, the Mean column shows the cumulative MOS for each metric for the previous week. The mean value can be calculated by using the following formula:

Mean = sum of (MOS * number of samples) / total number of samples

Using the above formula, the mean value for this example would be:

Conversational MOS Mean = (2.98*44 + 3.12*33 + 3.06*26 + 2.88*33 + 3.40*4 + 3.08*35 + 2.96*31) / (44 + 33 + 26 + 33 + 4 + 35 + 31) = 3.02

If you click the column heading, a Call List Report for that day will be displayed. For details about the Call List Report, see the Call List section in Scenario and Other Report Collections later in this guide.

ebfa18f4-6576-4812-ab60-4eb2339f1a73

Figure 4. QoE Trend Report

Worst Performing Endpoints

The worst performing endpoints report shows the 100 endpoint with the lowest MOSs so that you can proactively correct poor performing endpoints even if the individual endpoint is not causing an alert.

By default, the Worst Performing Endpoints report lists the endpoints beginning with the worst performer. You can, however, sort each column as you choose. Because the conversational MOS, the sending MOS, and the listening MOS are not statistically valid if the sample size is too small, these values are included in the report only if the sample size is greater than 30.

Table 4 shows an example of a Worst Performing Endpoints report.

Table 4. Sample Worst Performing Endpoints report

Rank Endpoint IP Address No. Calls Endpoint Type Average Listening MOS Average Sending MOS Average Conver-sational MOS Average Network MOS % Calls w/degraded Network MOS % High delay % Failed Connect-ivity

0.19

Jones.acme.com

10.10.10.15

220

Office

Communicator

2.90

2.20

2.20

3.88

10.00%

2.00%

1.00%

0.16

Frank.acme.com

10.80.10.15

100

IP Phone

3.11

3.00

3.00

3.77

6.00%

30.00%

2.00%

Device Report

The device report, which is not included in conference reports, displays the number of calls that were made and the number of unique users, as well as the cumulative Conversational MOS, Sending MOS, and Listening MOS of the recipients for each device.

The device report captures the conversational MOS, sending MOS of the device, and the listening MOS on the receiving end in order to help you identify devices that are performing poorly. By default, the report will show all capture devices so that you can compare performance across devices. A typical device issue will manifest itself as echo and/or distortion. The following device report shows a sample of capture devices. For each device, it shows the number of calls that were made, how many unique users made calls, and the relevant MOSs.

Table 5. Device Report

Capture Device No. Calls No. Unique Users Conversational MOS Sending MOS (of device) Listening MOS (of recipients)

Microphone (High Definition Audio Device)

555

87

3.75

3.65

3.60

Echo Cancelling Speakerphone (USB Audio Device)

365

48

3.75

4.25

4.13

Headset Microphone

265

59

3.55

3.75

4.02

USB Audio CODEC

86

23

3.39

3.21

3.35

Echo Cancelling Speakerphone(3)

64

10

3.85

4.48

4.63

Echo Cancelling Speakerphone(4)

48

7

4.05

4.55

4.30

Headset Microphone (USB Headset)

32

4

 

4.71

4.19

Headset Microphone (OC Dongle)

12

2

3.09

3.62

3.88