Synapse Usage Metrics Dashboard Implementation Plan

Web UI

This will be written in GWT/GXT3.  This exposes and does pretty things with the data, which is available from two (possibly three) sources:

1. RDS High-resolution data window
2. Amazon Cloudwatch Aggregates
3. Long-term RRD of cloudwatch aggregates

If this third component is necessary, then it is questionable whether involving Cloudwatch at all is cost-effective or wanted.

Data Origin

The data comes from two sources:

1. Synapse Repository Services (possibly via logs, but possibly through other means)
2. Synapse Crowd Server(s) (via the logs)

These logs are scanned on a daily basis (could be more often if
wanted).

Data Collection/Aggregation

The scanning process will involve calling three Simple
Workflow workers:

1. scan log data and update the RDS window
2. take data from the RDS window and update cloudwatch
3. 2 week old data from cloudwatch that is still wanted into the long-term RRD storage