As of 01.01.2001 the Hydstra site database contains 1446 active sites, and 3300 terminated sites. The active sites currently hold a combined 11,000,000 days of archived data for specific parameters. Of these sites, there are to date;
- Sewer 7,400,000 days
- Rainfall 1,400,000 days
- River 936,000 days
- Sewerage Treatment Plants 689,000 days
- Thermistor Chains 339,000 days
- Other 150,000
Active sites on the main archive are made up primarily of Sydney Water Hydrographic sites, but also include Sydney Water IICATS and SCADA sites, plus Contractor data. Hydrographic data is primarily retrieved on a weekly basis using automated Hydstra telemetry routines.
Fully automated Hydstra routines for data handling on the main archive currently include;
- Telemetered data retrieval from Mace, Hydrological Services, ADS, Unidata and PSM loggers.
- HYAUDIT data present checking and reporting.
- Customer specific report generation using HYEXTR and HYHOUR (reports are sent via auto-e-mail and ftp external routines.)
- HTML reporting via HYBATCH and MAPWEB of all catchment sites. These reports include site reports (HYSITREP), performance reports (WBPERF), rainfall statistics (HYSTATR), annual plots of flow (HYPLOT), comment reports on data (HYREP), and quality plots (HYQPLOT).
- Weekly creation of rainfall centroid data using HYCCCS with composite datasources via HYBATCH. This is used for data integrity checks via HYAUDIT.
- Hydstra housekeeping tasks such as HYPERUPD (period database updates) plus HYDBUTIL for sorting and packing databases.
- Continuous processing and report generation (at 30 minute intervals) of RADTEL radio telemetered data for the Sydney Catchment Authority flood warning system.
These routines have all been set up using Hydstra automation and batch tools such as HYBATCH, HYSETE and HYPSCENV, with some additional PERL scripting and batch routines.
User initiated automated Hydstra routines include;
- Automated routines for thermistor chain data gap filling, spike removal, smoothing, quality coding, and archiving. This is all dependent upon passing a series of HYAUDIT integrity checks.
- Processing of spreadsheet input data via macros with HYCREATE and PERL
Hydrographic have developed routines using Hydstra to auto process daily over 400 IICATS telemetered sites for the Sydney Water Illawarra region. Telemetered data retrieval is utilised where possible, with methods including Satellite communications, SCADA, RADTEL, ALERT and IICATS radio and ISDN links, plus digital mobile and standard telephone lines. Data retrieval and management is undertaken with Hydstra. Telemetry unloads are conducted on a continuous, daily, or weekly automated basis, with corresponding automated data verification, report generation, and data dissemination via Hydstra as required.
Verified data is integrated with fully dynamic time series models such as HSPF SalmonQ, MouseMan and Mouse.
Routines have also been developed for auto processing of Gold Coast City Council [GCCC] radio telemetered data. In total approximately 500 sites from the GCCC Radtel and KingFisher / Macroview systems are processed on demand to Hydstra. GCCC are also Hydstra users.