Format files to import or export data (SQL Server)

Applies to: SQL Server Azure SQL Database Azure SQL Managed Instance Analytics Platform System (PDW)

When you bulk import data into a SQL Server table or bulk export data from a table, you can use a format file to store all the format information that is required to bulk export or bulk import data. This includes format information for each field in a data file relative to that table.

SQL Server supports two types of format files: XML formats and non-XML format files. Both non-XML format files and XML format files contain descriptions of every field in a data file, and XML format files also contain descriptions of the corresponding table columns. Generally, XML and non-XML format files are interchangeable. However, we recommend that you use the XML syntax for new format files because they provide several advantages over non-XML format files. For more information, see XML Format Files (SQL Server).

Format files provide a flexible system for writing data files that requires little or no editing to comply with other data formats or to read data files from other software.

You can bulk import data without having to add or delete unnecessary data or to reorder existing data in the data file. Format files can be useful when a mismatch exists between fields in the data file and columns in the table.

The following examples show the layout of a non-XML format file and of an XML format file. These format files correspond to the HumanResources.myTeam table in the AdventureWorks2022 sample database. This table contains four columns: EmployeeID, Name, Title, and ModifiedDate.

The following non-XML format file uses the SQL Server native data format for the HumanResources.myTeam table. This format file was created by using the following bcp command.

bcp AdventureWorks2022.HumanResources.myTeam format nul -f myTeam.Fmt -n -T

The bcp command defaults to a local, default instance of SQL Server with Windows Authentication. You can specify other instance and login information as desired, for more information, see bcp Utility. For example, to specify a remote server named instance with Windows Authentication, use:

bcp AdventureWorks2022.HumanResources.myTeam format nul -f myTeam.Fmt -n -T -S servername/instancename

The contents of this format file are as follows, starting with the major version number of SQL Server, and the table metadata information.

14.0
4
1       SQLSMALLINT   0       2       ""   1     EmployeeID               ""
2       SQLNCHAR      2       100     ""   2     Name                     SQL_Latin1_General_CP1_CI_AS
3       SQLNCHAR      2       100     ""   3     Title                    SQL_Latin1_General_CP1_CI_AS
4       SQLNCHAR      2       100     ""   4     Background               SQL_Latin1_General_CP1_CI_AS

For more information, see Use Non-XML format files (SQL Server).

The following XML format file uses the SQL Server native data format for the HumanResources.myTeam table. This format file was created by using the following bcp command.

bcp AdventureWorks2022.HumanResources.myTeam format nul -f myTeam.xml -x -n -T

The format file contains:

<?xml version="1.0"?>
<BCPFORMAT xmlns="http://schemas.microsoft.com/sqlserver/2004/bulkload/format" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance">
<RECORD>
  <FIELD ID="1" xsi:type="NativePrefix" LENGTH="1"/>
  <FIELD ID="2" xsi:type="NCharPrefix" PREFIX_LENGTH="2" MAX_LENGTH="100" COLLATION="SQL_Latin1_General_CP1_CI_AS"/>
  <FIELD ID="3" xsi:type="NCharPrefix" PREFIX_LENGTH="2" MAX_LENGTH="100" COLLATION="SQL_Latin1_General_CP1_CI_AS"/>
  <FIELD ID="4" xsi:type="NCharPrefix" PREFIX_LENGTH="2" MAX_LENGTH="100" COLLATION="SQL_Latin1_General_CP1_CI_AS"/>
</RECORD>
<ROW>
  <COLUMN SOURCE="1" NAME="EmployeeID" xsi:type="SQLSMALLINT"/>
  <COLUMN SOURCE="2" NAME="Name" xsi:type="SQLNVARCHAR"/>
  <COLUMN SOURCE="3" NAME="Title" xsi:type="SQLNVARCHAR"/>
  <COLUMN SOURCE="4" NAME="Background" xsi:type="SQLNVARCHAR"/>
</ROW>
</BCPFORMAT>

For more information, see XML Format Files (SQL Server).

Format files are usually required in the following circumstances:

• When you use an INSERT ... SELECT * FROM OPENROWSET(BULK...) statement.

• For complex bulk-import situations using bcp or BULK INSERT.

• The same data file is used as a source for multiple tables that have different schemas.

• The data file has a different number of fields that the target table has columns; for example:

  • The target table contains at least one column for which either a default value is defined or NULL is allowed.
  • The users don't have SELECT/INSERT permissions on one or more columns in the table.
  • A single data file is used with two or more tables that have different schemas.

• The column order is different for the data file and table.

• The terminating characters or prefix lengths differ among the columns of the data file.

• Using BCP native/format file vs text file and the BOM
• Use Non-XML format files (SQL Server)
• XML Format Files (SQL Server)
• Data formats for bulk import or bulk export (SQL Server)
• Create a format file with bcp (SQL Server)

• bcp Utility
• Use a format file to bulk import data (SQL Server)
• Use a Format file to skip a table column (SQL Server)
• Use a format file to skip a data field (SQL Server)
• Use a format file to map table columns to data-file fields (SQL Server)