Live File Processor Agent Example – In-Situ-5

<< Click to Display Table of Contents >>

Navigation:  Live > Agents > File Agents > File Processor > Examples >

Live File Processor Agent Example – In-Situ-5

Add the following settings to the ST_CONFIG table (CONFIG_SECTION = 'Live.FileProcessor', CONFIG_KEY = 'Agent').

 

OBJECT_TYPE

OBJECT_VALUE

STRING_VALUE

Description

In-Situ-5

dataEndLineRegex

^\s*---

Stop loading data at line that starts with (^) optional whitespace (\s*) and is followed by 3 dashes (---). See Example File 4 – Tube 300R Telemetry System, e.g., ----------- STATUS -----------.

In-Situ-5

dateTimeColumnHeaderRegex

^\s*(Created|Date and Time)

DT_LOGGER_DATUM.DATUM_UTC_DT; column header text starts with zero or more whitespace characters, followed by Created, or Date and Time.

In-Situ-5

folderWatcherPath

C:\EarthSoft\Live\In-Situ-5


In-Situ-5

headerLinesRegex

^\s*(Created|Date and Time.*[Ss]econds)

The header line starts with zero or more whitespace characters, followed by Created, or Date and Time + S or s + econds.

In-Situ-5

ignoreColumnHeadersRegex

^\s*(Record|Sensor)

Do not add series or datum for columns whose header text starts with (^) optional whitespace (\s*) and is followed by Record or Sensor.

In-Situ-5

loggerCodeHeaderLinesRegex
Groups

^(Site|Location Name)[ :,=]*(?'a'[^,]*)

DT_LOGGER.LOGGER_CODE

In-Situ-5

seriesNameColumnHeaderRegex
Groups

(?'a'.*)\s*\(.*\)\s*[\(\[][\d:]+[\)\]]$|(?'b'[^\(\[]*)

DT_LOGGER_SERIES.SERIES_NAME

In-Situ-5

seriesUnitColumnHeaderRegex
Groups

\((?'a'.*)\)\s*[\(\[][\d:]+[\)\]]$|\((?'b'[^)]*)\)[^(]*$

DT_LOGGER_SERIES.SERIES_UNIT

In-Situ-5

timeColumnHeaderRegex

^\s*Time


In-Situ-5

utcOffsetHeaderLinesRegexGroups

^Time Offset[ :,=]*(?'a'[^,]*)

See Example File 3 – VuSitu,
e.g., Time Offset = -04:00:00,,,,,,,,,.

 

 

Example File 1 – Win-Situ 5

 

 

Report Date:,9/22/2016 4:25:26 PM,,,

Report User Name:EQuIS_User,,,

Report Computer Name:,R76,,,

,,,,

,,,,

Log File Properties,,,,

File Name,Troll300.csv,,,

Create Date,9/20/2016 10:48:30 AM,,,

,,,,

Device Properties,,,,

Device,Level TROLL 300,,,

Site,WellABC,,,

Device Name, ,,,

Serial Number,654321,,,

Firmware Version,2.04,,,

Hardware Version,3,,,

,,,,

Log Configuration,,,,

,Log Name,X12,,

,Created By,DataManager,,

,Computer Name,Pocket PC,,

,Application,WinSituMobile.exe,,

,Application Version,5.5.10.3,,

,Create Date,12/23/2015 7:56:35 AM,,

,Notes Size(bytes),4096,,

,Type,Linear,,

,Overwrite when full,Enabled,,

,Scheduled Start Time,12/23/2015 8:00:00 AM,,

,Scheduled Stop Time,No Stop Time,,

,Interval,Days: 0 hrs: 04 mins: 00 secs: 00,,

,,,,

,,,,

,,,,

Level Reference Settings At Log Creation,,,,

,        Level Measurement Mode,Level Depth To Water,,

,              Specific Gravity,0.999,,

,          Level Reference Mode:,Set new reference,,

,         Level Reference Value:,31.84 (ft),,

, Level Reference Head Pressure,30.257 (PSI),,

,                 Head Pressure,29.3932 (PSI),,

,                   Temperature,13.7213 (C),,

,                Depth of Probe,67.8679 (ft),,

,,,,

,,,,

Log Notes:,,,,

Date and Time,Note,,,

12/23/2015 7:56:39 AM ,Sensor:654321 Factory calibration has expired.: 2/23/2010 4:06:16 PM,,,

,,,,

,,,,

Log Data:,,,,

Record Count,1633,,,

,,,,

Sensors,1,,,

,,,,

,1,654321,Pressure/Temp 100 PSIA (60.1m/197.3ft),

,,,,

Time Zone: Pacific Standard Time/Pacific Daylight Time,,,,

,,,,

,,Sensor: Pres(A) 197.3ft  ,Sensor: Pres(A) 197.3ft  ,Sensor: Pres(A) 197.3ft  

,Elapsed Time,SN#: 654321     ,SN#: 654321         ,SN#: 654321    

Date and Time,Milliseconds,Pressure (PSI)           ,Temperature (C)          ,Level Depth To Water (ft)

12/23/2015 8:00:00 AM ,0,29.418718,13.658508,31.764286

12/23/2015 12:00:00 PM,14400.001,29.415125,13.651779,31.772583

12/23/2015 4:00:00 PM ,28800.001,29.420811,13.649857,31.759455

 

 

 

Example File 2 – Win-Situ 5

 

 

Log:,Default Site- 1 of 2,,,,,,,,,,,,,,

Report Created:, 2015-06-14 14:20:31,,,,,,,,,,,,,,

Site:,SpringField,,,,,,,,,,,,,,

Log Created:, 1970-01-02 05:58:40,,,,,,,,,,,,,,

Number Readings:,8,,,,,,,,,,,,,,

Battery Type:, SmarTROLL™ Battery Pack,,,,,,,,,,,,,,

Battery SN:,363879,,,,,,,,,,,,,,

Device Type:, SmarTROLL™ MP,,,,,,,,,,,,,,

Device SN:,ABC1234,,,,,,,,,,,,,,

Created, Baro (mbar), Temp (C), RDO (mg/L), RDO Sat (%), pH (pH), ORP (mV), Act Cond (µS/cm), Sp Cond (µS/cm), Salinity (psu), Resist (Ohm-cm), Density (g/cm^3), TDS (ppt), Depth (ft), Pressure (psi), Air Temp (C)

1/2/1970 5:58,986.2,20.05,7.81,92.2,7.64,92.9,10997,12143.4,7,91,1.004,8,0.02,0.011,20.9

1/2/1970 6:03,986.3,20.37,4.38,52,7.14,12.6,11164.3,12246.6,7.1,90,1.004,8,0.01,0.005,20.8

1/2/1970 6:08,986.2,21.31,1.65,20,6.79,-12.8,11599.7,12480.2,7.2,86,1.003,8,0.03,0.012,20.8

 

 

 

Example File 3 – VuSitu

 

 

Location Properties,,,,,,,,,

Location Name = MW-18D,,,,,,,,,

Location ID = ebc1bf1d-7172-41c5-98db-ba2e52ec9d85,,,,,,,,,

Latitude = 41.5716717239628 ø,,,,,,,,,

Longitude = -71.2813762575388 ø,,,,,,,,,

,,,,,,,,,

Report Properties,,,,,,,,,

Start Time = 2019-05-13 19:00:00,,,,,,,,,

Duration = 6.13:15:02,,,,,,,,,

Readings = 1888,,,,,,,,,

Time Offset = -04:00:00,,,,,,,,,

,,,,,,,,,

Instrument Properties,,,,,,,,,

Device Model = Aqua TROLL 600,,,,,,,,,

Device SN = 513188,,,,,,,,,

Device Firmware = 2.08,,,,,,,,,

,,,,,,,,,

Log Properties,,,,,,,,,

Log Name = MW-18D_20190513,,,,,,,,,

Log Type = Linear,,,,,,,,,

Log File Number = 1,,,,,,,,,

Log ID = ab8d7c1c-85fd-4724-b817-f6753ae42114,,,,,,,,,

Interval = 00:05:00,,,,,,,,,

,,,,,,,,,

,,,,,,,,,

Date Time,Actual Conductivity (æS/cm) (537820),Specific Conductivity (æS/cm) (537820),pH (pH) (598177),pH mV (mV) (598177),ORP (mV) (598177),RDO Concentration (mg/L) (648451),RDO Saturation (%Sat) (648451),Temperature (øC) (513188),Battery Capacity (%) (513188)

5/13/19 19:00:00.000,1301.343,1647.842,6.371077,40.23552,87.36451,6.538359,76.58764,13.99088,99

5/20/19 8:10:02.000,2175.703,2755.845,6.305352,43.84995,214.1627,6.392605,75.13709,13.97836,97

,,,,,,,,,

,,,,,,,,,

,,,,,,,,,

,,,,,,,,,

 

 

 

Example File 4 – Tube 300R Telemetry System

 

 

Attempt 01

Site: A04

Device: T3R1-3U-B-1T

S/n: 17022901

13-Sept-2017   11:00:07

Sensor n. 01  Type: Barometer[161]  s/n:17022900  Batt:100%

Sensor n. 02  Type: AquaTR200[5]  s/n:494551  Batt:94%

Record n,Date,Time,Sensor n,Pressure(mBar)[2:21],Sensor n,Pressure(PSI)[2:17],Temperature(°C)[1:1],Level Depth(m)[4:35],Actual Conduct.(uS/cm)[9:65],Specific Conduct.(uS/cm)[10:65],Salinity(PSU)[12:97],Tot Diss. Solids(ppt)[13:114],Resistivity(ohm*cm)[11:81],Density of Water(g/cm3)[14:129]

692,13/09/2017,05:00,01,992.50,02,6.02,18.51,18.14,588.17,671.36,0.33,0.44,1700.20,1.00

693,13/09/2017,11:00,01,993.70,02,6.01,18.51,18.15,586.51,669.46,0.33,0.44,1705.00,1.00

----------- STATUS -----------

- Signal (UMTS): 0%

- Temperature:  18.25 °C

- Battery Level:  9.71 V

- Firmware version: 11.36

- System Resets: 17

----------- SETTINGS -----------

MODEM PARAMETERS:

- Access Point Name: telstra.internet

- Smtp Server: smtp.net.vodafone.it

- To Address: antgroup-tube@hotmail.com

- To CC Address:

- Ftp Server: ftp.hydrovu.com

- File Name: A04.csv

- Phone Number for SMS alarms:

- Second Phone Number for SMS alarms:

LOGGING PARAMETERS:

- Logging period(hh:mm): 06:00

- Save data every: 01 readings

- Send data every: 4 saved data

PROBES:

- 01  Type: Barometer Addr: 100

- 02  Type: AquaTR200 Addr: 1

 

------ End of Message -----