Cleaning steps performed by data contributor before being sent to BCO-DMO:
- All daily csv files combined to master file.
- "-999" = "no data"
- All "NaN" turned to "-999"
- combined Latitude & Longitude degrees, minutes, seconds into Decimal degrees
-- Eliminated columns:
-- Ashtech GPS coordinates (No long data recorded)
-- Rel_STBD_WD (no dynamic range, nearly all data ~270)
-- Rel STBD WS (no dynamic range, all data 0)
-- As in original excel sheet the following were omitted: SSC, SWDI, LWDI, PIR PSP, PIR dome C, PIR case C, PIR V therm, AVG Circ C, Battery V
- Eliminated the following data points and changed to -999
- Air temp F (3 values, 449, 454, 486)
-- Air temp C (3 values, 231, 234, 252)
-- Solar radiation (2 values, 13934, 1991)
-- SST (94 values recorded from 68 to -83)
- Salinity (8 values >40)
-- Xmiss% (325 values, % <0)
-- Fluoro (1 value <0)
BCO-DMO Data Manager Processing Notes:
* added a conventional header with dataset name, PI name, version date (can't use spaces, slashes, percent signs)
* modified parameter names to conform with BCO-DMO naming conventions
* -999 values changed to "nd" for no data so they are recognized in our system
* ISO timestamp added based on YMD, and HMS fields
* SST, Salinity, SST_TSAL rounded to three decimal places, lat/lon rounded to 5 decimal places