Overview

Image RemovedImage Added

1. Bridge-EX-Scheduler lives inside AWS Lambda, with a schedule configured to execute every day at 10am UTC (2am PST, 3am PDT).
   1. Scheduler pulls configs from DynamoDB table Exporter-Scheduler-Config, which contains the SQS queue URL, time zone, and an optional request JSON override.
   2. Scheduler generates the request, fills in yesterday's date, and writes the request to the SQS queue.
2. Bridge-EX polls SQS, waiting for a request.
   1. When the request arrives, it pulls user health data records from DDB (along with study info, schemas, attachment metadata, and participant options (sharing options)), as well as attachment content from S3.
   2. Bridge-EX writes uploads attachments to Synapse as file handles and writes the record to a TSV (tab-separated values) file on disk.
   3. On completion, Bridge-EX uploads the TSVs to the Synapse tables, creating new tables as necessary.

Components

Image RemovedImage Added

Bridge-EX components can be broken down into 3 major groups (not including Spring components and various helpers).

...