Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

See /wiki/spaces/BRIDGE/pages/75071519 for how this could integrated with the survey API for future improvements.

Dynamo DB Tables

HealthDataAttachment - Keys health data attachments to health data records. A record can have many attachments, but an attachment can only live in a single record.

HealthDataRecord3 - Stores metadata and flattened data processed from uploads. The "data" field is a flat field ready to be exported directly to Synapse Tables. The data field also holds attachment IDs. Bridge knows these are attachment IDs because of the schema.

Upload2 - Stores metadata for raw uploads, including MD5, healthcode, timestamps, validation status, and validation messages. The primary key uploadId also serves as the unique S3 key for the raw upload data.

UploadDedupe - (IN DEVELOPMENT) A dedupe table that keys off of health code, schema, and timestamp.

UploadSchema - Upload schemas. See above for more details.

Misc Hacks

TODO

Bridge Exporter

...