In December 2009 the New South Wales Office of Water (NOW) contracted KISTERS to implement a new organisation-wide advanced sampling data management system. The system was required to replace their 15 year old in-house water quality system with a modern commercial package.
The KISTERS Water Quality Module KiWQM is designed for the efficient and effective management, analysis, and reporting of sampling data, which comprises water quality, ecological analysis and air quality. KiWQMs capabilities cover a wide range of functions and calculations used for the analysis, interpretation and comparison of sampling data. Furthermore, through the implementation of ESRI's ArcGIS Engine users are also able to manage, access and analyse data from a spatial perspective.
KiWQM is based on the KISTERS advanced WISKI 7 technology and functionality. This technology comprises a 3-tier architecture, with a database layer, which is MSSQL 2008 @ NOW, the KiTSM business logic layer and the KiWQM application layer. Through the application of KiTSM, sample data is processed as soon as data has entered the system. This means data validation and correction as well as analysis are carried out automatically. Examples here include calculation of annual percentiles, long-term statistics or specific routines such as ionization balancing. In terms of standard functionality, KiWQM comprises the flexible WISKI 7 meta-data framework, the agent and operation frameworks, the KiScript scripting language and the user administration.
The KiWQM system at NOW also comprises the distributed service manager KiDSM and the alarm manager KiAM. KiDSM allows lab results, which are sent to a hot folder, to be automatically imported into the system - on a predefined schedule or event triggered. KiAM informs project managers about potential water quality or algae issues by email or text message as soon as they are reported.
A main focus of the implementation of the new system for managing water quality samples was the seamless integration with the existing NOW systems, in particular Hydstra, which is applied for handling all time series data. The KiWQM client will be accessible for users through Hydstra within the Hydstra application menu. This will allow users to work on water quality meta and sample data (KiWQM) and time series data (Hydstra) starting from the same platform. In addition KiWQM data can be exported directly to the Hydstra WQ warehouse where it can then be treated as any other data sources and exposed to Hydstra functionality. It can also potentially be published to Hydstra/Web or exported to the BOM in WDTF format.
A major part of the implementation of the new system was the migration of legacy data into the KiWQM database structure. This included more than 20,000 sampling stations. 500,000 samples and 3.5 million analysis results. This was achieved using the newly built KiWQM batch import framework, a flexible and scalable tool used to import bulk data seamlessly into the data structure.
The data migration is now complete and as of June 2011, KiWQM is now available to staff from a variety of NSW government departments that deal with water quality data.