CloudWatch
Background[edit | edit source]
CloudWatch is used for monitoring and logging within various AWS services, including the K'aute data pipeline.
At the time of writing, this predominantly concerns tracking performance metrics, logging data, and setting up alarms for the Indici data processes.
Detail[edit | edit source]
TODO[edit | edit source]
- Implement and monitor CloudWatch alarms, logging, along with SNS notifications to ensure the accuracy, consistency, and timely processing of data within the INDICI QA process, addressing key risks such as data transfer errors, incorrect partitioning and SQL execution failures.