TechNet
Export (0) Print
Expand All

SystemGetClusterAccuracyResults (Analysis Services - Data Mining)

 

Applies To: SQL Server 2016

Returns cross-validation accuracy metrics for a mining structure and related clustering models.

This stored procedure returns metrics for the entire data set as a single partition. To partition the dataset into cross-sections and return metrics for each partition, use SystemGetClusterCrossValidationResults (Analysis Services - Data Mining).

System_CAPS_ICON_note.jpg Note


This stored procedure works only for clustering models. For non-clustering models, use SystemGetAccuracyResults (Analysis Services - Data Mining).

  
SystemGetClusterAccuracyResults(  
<mining structure>   
[,<mining model list>]  
,<data set>  
,<test list>])  

mining structure
Name of a mining structure in the current database.

(Required)

mining model list
Comma-separated list of models to validate.

The default is null, meaning that all applicable models are used. When the default is used, non-clustering models are automatically excluded from the list of candidates for processing.

(Optional)

data set
An integer value that indicates which partition in the mining structure is to be used for testing. The value is derived from a bitmask that represents the sum of the following values, where any single value is optional:

Training cases0x0001
Test cases0x0002
Model filter0x0004

For a complete list of possible values, see the Remarks section of this topic.

(Required)

test list
A string that specifies testing options. This parameter is reserved for future use.

(optional)

A table that contains scores for each individual partition and aggregates for all models.

The following table lists the columns returned by SystemGetClusterAccuracyResults. To learn more about how to interpret the information returned by the stored procedure, see Measures in the Cross-Validation Report.

Column NameDescription
ModelNameThe name of the model that was tested. All indicates that the result is an aggregate for all models.
AttributeNameNot applicable to clustering models.
AttributeStateNot applicable to clustering models.
PartitionIndexA number that indicates the partition.

For this stored procedure, the number is always 0.
PartitionCasesAn integer that indicates how many cases have been tested.
TestThe type of test that was performed.
MeasureThe name of the measure returned by the test. Measures for each model depend on the model type, and the type of the predictable value.

For a list of measures returned for each predictable type, see Measures in the Cross-Validation Report.

For a definition of each measure, see Cross-Validation (Analysis Services - Data Mining).
ValueA probability score that indicates the cluster case likelihood.

The following table provides examples of the values that you can use to specify the data in the mining structure that is used for cross-validation. If you want to use test cases for cross-validation, the mining structure must already contain a testing data set. For information about how to define a testing data set when you create a mining structure, see Training and Testing Data Sets.

Integer ValueDescription
1Only training cases are used.
2Only test cases are used.
3Both the training cases and testing cases are used.
4Invalid combination.
5Only training cases are used, and the model filter is applied.
6Only test cases are used, and the model filter is applied.
7Both the training and testing cases are used, and the model filter is applied.

For more information about the scenarios in which you would use cross-validation, see Testing and Validation (Data Mining).

This example returns accuracy measures for two clustering models, named Cluster 1 and Cluster 2, that are associated with the vTargetMail mining structure. The code on line four indicates that the results should be based on the testing cases alone, without using any filters that might be associated with each model.

CALL SystemGetClusterAccuracyResults (  
[vTargetMail],  
[Cluster 1], [Cluster 2],  
2  
)  

Sample Results:

ModelNameAttributeNameAttributeStatePartitionIndexPartitionSizeTestMeasureValue
Cluster 105545ClusteringCase Likelihood0.796514342249313
Cluster 205545ClusteringCase Likelihood0.732122471228572

Cross-validation is available only in SQL Server Enterprise beginning in SQL Server 2008.

SystemGetCrossValidationResults (Analysis Services - Data Mining)
SystemGetAccuracyResults (Analysis Services - Data Mining)
SystemGetClusterCrossValidationResults (Analysis Services - Data Mining)
SystemClusterGetAccuracyResults

Community Additions

ADD
Show:
© 2016 Microsoft