EarthSoft.Common.Data.Connection.SkipBulkCopy

As described in the EDP Commit techniques article, SqlBulkCopy is one of the techniques that may be used when committing records to the database. In many cases, SqlBulkCopy can decrease the amount of time it takes to insert the data into the database. However, bulk loading rows is a single operation and can cause timeout errors when committing very large datasets (e.g., data migrations). In some situations, it may be desirable to disable SqlBulkCopy and use an EQuIS-specific BatchInsert process that sends data to the database in batches.

EQuIS Version: v7+

Products Affected: Enterprise EDP, Professional EDP, Professional

Requires Module: EDP

ST_CONFIG	VALUE	REMARK	VALID VALUES
CONFIG_SECTION	EarthSoft.Common.Data.Connection	Required
CONFIG_KEY	SkipBulkCopy	Required
OBJECT_TYPE	null	Not applicable
OBJECT_VALUE	null	Not applicable
STRING_VALUE	'*' or pipe-delimited list of table names	Required	Asterisk will skip bulk insert for all tables. Pipe-delimited list of tables names (with beginning and ending pipe) will skip bulk insert for just the given table names.

Remarks:

By default, SqlBulkCopy is used for all tables. This setting may be used to either (a) disable SqlBulkCopy for all tables or (b) disable SqlBulkCopy for only specific tables. This setting is independent of any particular EDD format; when configured, it will be applied to all formats (as well as loading data manually in Professional).

Example: The following ST_CONFIG record will skip bulk copy/insert for all tables.

CONFIG_SECTION	CONFIG_KEY	STRING_VALUE
EarthSoft.Common.Data.Connection	SkipBulkCopy	*

Example: The following ST_CONFIG record will skip bulk copy/insert for just DT_TEST and DT_RESULT (notice the pipe at the beginning and end of STRING_VALUE).

CONFIG_SECTION	CONFIG_KEY	STRING_VALUE
EarthSoft.Common.Data.Connection	SkipBulkCopy	\|DT_TEST\|DT_RESULT\|