Live File Processor Agent Example

Add the following settings to the ST_CONFIG table (CONFIG_SECTION = 'Live.FileProcessor', CONFIG_KEY = 'Agent').

OBJECT_TYPE	OBJECT_VALUE	STRING_VALUE	Description
YSI-EXO	dateTimeColumnHeaderRegex	Date	DT_LOGGER_DATUM.DATUM_UTC_DT date; column header text contains Date.
YSI-EXO	folderWatcherPath	C:\EarthSoft\Live\YSI-EXO
YSI-EXO	headerLinesRegex	Date.*Time	The header line contains Date + anything (.*) + Time.
YSI-EXO	ignoreColumnHeadersRegex	Time.*Fract	Do not add series or datum for columns whose header text contains Time + anything (.*) + Fract.
YSI-EXO	loggerCodeColumnHeaderRegex	Site Name	DT_LOGGER.LOGGER_CODE
YSI-EXO	utcOffsetHeaderLinesRegexGroups	Time Zone.\(UTC(?'a'.?)\)	DT_LOGGER.UTC_OFFSET_HRS; Time Zone + anything + (UTC + named group value + ). (The \ escapes the parentheses.)
YSI-EXO	YSI-EXO.timeColumnHeaderRegex	Time.*:	DT_LOGGER_DATUM.DATUM_UTC_DT time; column header text contains Time + anything (.*) + :.

KOR Export File,,,,,,,,,,,,,,,,,,,

,,,,,,,,,,,,,,,,,,,

File Created:10/1/2015 6:38:28 AM,,,,,,,,,,,,,,,,,,,

,,,,,,,,,,,,,,,,,,,

Sonde ID,Sonde 12345,,,,,,,,,,,,,,,,,,

User ID,,,,,,,,,,,,,,,,,,,

Site,Site1,,,,,,,,,,,,,,,,,,

Template,KOR Capture,,,,,,,,,,,,,,,,,,

Averaging Mode,Default,,,,,,,,,,,,,,,,,,

Time Zone,(UTC-06:00) Central Time (US & Canada),,,,,,,,,,,,,,,,,,

,,,,,,,,,,,,,,,,,,,

Sonde ID,Sonde James1,,,,,,,,,,,,,,,,,,

User ID,,,,,,,,,,,,,,,,,,,

Site,James1,,,,,,,,,,,,,,,,,,

Template,KOR Capture,,,,,,,,,,,,,,,,,,

Averaging Mode,Default,,,,,,,,,,,,,,,,,,

Time Zone,(UTC-06:00) Central Time (US & Canada),,,,,,,,,,,,,,,,,,

,,,,,,,,,,,,,,,,,,,

Devices List:,,,,,,,,,,,,,,,,,,,

Name,SN,Firmware,Corresponding Data Column(s),,,,,,,,,,,,,,,,

Data Collection Device,,,1;2;3;4;5,,,,,,,,,,,,,,,,

EXO1 Sonde,15H103842,1.0.18,19;20,,,,,,,,,,,,,,,,

Conductivity/Temp,15H101121,3.0.0,6;7;8;9;10;11,,,,,,,,,,,,,,,,

Optical DO,15H102951,3.0.0,12;13;14,,,,,,,,,,,,,,,,

pH,15H104175,3.0.0,16;17,,,,,,,,,,,,,,,,

Depth Non-Vented 0-100m,15H101536,3.0.0,15;18,,,,,,,,,,,,,,,,

,,,,,,,,,,,,,,,,,,,

1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17,18,19,20

Date (M/D/YYYY),Time (HH:MM:SS),Time (Fract. Sec),Site Name,Fault Code,Temp øC,Cond æS/cm,nLF Cond æS/cm,SpCond æS/cm,TDS mg/L,Sal psu,ODO % sat,ODO mg/L,ODO % EU,Press psi a,pH,pH mV,Depth m,Cable Pwr V,Battery V

9/3/2015,10:34:54,0.545,B-31,0,19.272,305.3,346.2,342.8,223,0.16,81.9,7.55,83.8,0.015,8.41,-85.9,0.01,0,2.8

9/30/2015,10:35:34,0.614,B-31,0,19.244,305.1,346.2,342.7,223,0.16,81.1,7.48,82.9,1.537,8.4,-85.2,1.082,0,2.7

10/3/2015,10:36:12,0.869,B-31,0,19.226,305.1,346.4,343,223,0.16,78.8,7.27,80.6,2.964,8.37,-83.6,2.087,0,2.7

Note: The series units cannot be easily extracted from the series names, in the column header text.

e.g., 'Press psi a' => SERIES_NAME = 'Press' (first word), SERIES_UNIT = 'psi a' (last two words)

and 'Cable Pwr V' => SERIES_NAME = 'Cable Pwr' (first two words), SERIES_UNIT = 'V' (last word)

The seriesNameColumnHeaderRegexGroups setting is not defined; all of a column's header text (e.g., 'Press psi a', or 'Cable Pwr V') is the SERIES_NAME.

Live File Processor Agent Example – YSI-EXO

Live File Processor Agent Example – YSI-EXO