Live File Processor Agent Example – TOA5

<< Click to Display Table of Contents >>

Navigation:  Live > Agents > File Agents > File Processor > Examples >

Live File Processor Agent Example – TOA5

Add the following settings to the ST_CONFIG table (CONFIG_SECTION = 'Live.FileProcessor', CONFIG_KEY = 'Agent').

 

OBJECT_TYPE

OBJECT_VALUE

STRING_VALUE

Description

TOA5

dateTimeColumnHeaderRegex

TIMESTAMP

DT_LOGGER_DATUM.DATUM_UTC_DT date; column header text contains TIMESTAMP.

TOA5

delimiters

 ,

The fields are separated by tabs and/or commas.

TOA5

folderWatcherPath

C:\EarthSoft\Live\TOA5


TOA5

headerLinesRegex

TIMESTAMP\n.*\n.*

The header has 3 lines that look like this:

1.Contains TIMESTAMP

2.Anything (.*)

3.Anything (.*)

TOA5

ignoreColumnHeadersRegex

RECORD

Do not add series or datum for columns whose header text contains RECORD.

TOA5

loggerCodeHeaderLinesRegex
Groups

^&quot;*TOA5&quot;*[\t,]&quot;*(?'a'.*?)&quot;*([\t,].*){4}[\t,]&quot;*(?'c'.*?)&quot;*[\t,]&quot;*(?'b'.*?)&quot;*$

DT_LOGGER.LOGGER_CODE; the named group values are ordered alphabetically, based on the group names: a:b:c
(e.g., ABC-03:Min_60:22222).

TOA5

seriesNameColumnHeaderRegex
Groups

^(?'a'.*)\n

DT_LOGGER_SERIES.SERIES_NAME, SERIES_UNIT, and SERIES_FUNCTION (e.g., Veloc_ms_Avg, m/s, Avg).

TOA5

seriesUnitColumnHeaderRegex
Groups

\n(?'a'.*)\n

TOA5

seriesFunctionColumnHeaderRegex
Groups

(?'a'.*)$

 

 

 

"TOA5","ABC-03","CR1000","12345","CR1000.Std.27","CPU:FM6_101012.CR1","22222","Min_60"

"TIMESTAMP","RECORD","Veloc_ms_Avg","Direction_Deg_Avg","Temp_C_Avg","Solar_Rad_Tot","Evaporation_mm_Smp"

"TS","RN","m/s","Deg","C","MJ/m2","mm"

"","","Avg","Avg","Avg","Tot","Smp"

"2017-06-22 16:00:00",3812,1.918,358.5,26.4,1.847365,0.258

"2017-06-22 17:00:00",3813,2.179,21.56,26.17,1.29014,0.257

"2017-06-22 18:00:00",3814,2.844,42.54,24.73,0.5120003,0.311

 

 

 

Note: The Campbell Scientific LoggerNet Agent can also be used to load data from Campbell Scientific LoggerNet logger ('TOA5') files. It has some additional functionality (e.g., it adds DT_EQUIPMENT rows) and can watch individual files, in addition to folders.