Events
Mar 31, 11 PM - Apr 2, 11 PM
The biggest SQL, Fabric and Power BI learning event. March 31 – April 2. Use code FABINSIDER to save $400.
Register todayThis browser is no longer supported.
Upgrade to Microsoft Edge to take advantage of the latest features, security updates, and technical support.
Applies to:
SQL Server
SSIS Integration Runtime in Azure Data Factory
The Cache Transform transformation generates a reference dataset for the Lookup Transformation by writing data from a connected data source in the data flow to a Cache connection manager. The Lookup transformation performs lookups by joining data in input columns from a connected data source with columns in the reference database.
You can use the Cache connection manager when you want to configure the Lookup Transformation to run in the full cache mode. In this mode, the reference dataset is loaded into cache before the Lookup Transformation runs.
For instructions on how to configure the Lookup transformation in full cache mode with the Cache connection manager and Cache Transform transformation, see Implement a Lookup Transformation in Full Cache Mode Using the Cache Connection Manager.
For more information on caching the reference dataset, see Lookup Transformation.
Note
The Cache Transform writes only unique rows to the Cache connection manager.
In a single package, only one Cache Transform can write data to the same Cache connection manager. If the package contains multiple Cache Transforms, the first Cache Transform that is called when the package runs, writes the data to the connection manager. The write operations of subsequent Cache Transforms fail.
For more information, see Cache Connection Manager.
You can configure the Cache connection manager to save the data to a cache file (.caw).
You can configure the Cache Transform in the following ways:
Specify the Cache connection manager.
Map the input columns in the Cache Transform to destination columns in the Cache connection manager.
Note
Each input column must be mapped to a destination column, and the column data types must match. Otherwise, Integration Services Designer displays an error message.
You can use the Cache Connection Manager Editor to modify column data types, names, and other column properties.
You can set properties through Integration Services Designer. For more information about the properties that you can set in the Advanced Editor dialog box, see Transformation Custom Properties.
For more information about how to set properties, see Set the Properties of a Data Flow Component.
Use the Connection Manager page of the Cache Transformation Editor dialog box to select an existing Cache connection manager or create a new one.
To learn more about the Cache connection manager, see Cache Connection Manager.
Cache connection manager
Select an existing Cache connection manager by using the list, or create a new connection by using the New button.
New
Create a new connection by using the Cache Connection Manager Editor dialog box.
Edit
Modify an existing connection.
Events
Mar 31, 11 PM - Apr 2, 11 PM
The biggest SQL, Fabric and Power BI learning event. March 31 – April 2. Use code FABINSIDER to save $400.
Register todayTraining
Module
Code-free transformation at scale with Azure Data Factory - Training
Perform code-free transformation at scale with Azure Data Factory or Azure Synapse Pipeline
Certification
Microsoft Certified: Azure Data Engineer Associate - Certifications
Demonstrate understanding of common data engineering tasks to implement and manage data engineering workloads on Microsoft Azure, using a number of Azure services.