...
At the start of each month, create a Jira for this month’s redrives. See
for an example.Jira Legacy server System JIRA serverId ba6fb084-9827-3160-8067-8ac7470f78b2 key BRIDGE-2794 Over the course of the month, whenever Ops finds an upload that needs to be redriven, add it to the Jira (ideally with the appId and studyId, so we can validate if needed).
At the end of each month, create a text file with each upload ID, one ID per line, and upload it to S3 bucket
org-sagebridge-backfill-prod
in the Bridge-Prod AWS account.Get written approval from the Director of Bridge (currently Erin Mounts). For tracking purposes, this is best done as a comment in the Jira.
Write the JSON message to the Bridge-Worker-Request-Prod SQS queue to kick off the redrive.
You can verify the redrive by going to CloudWatch, opening up the worker logs (log group /aws/elasticbeanstalk/bridgeworker-prod/var/log/tomcat8/catalina.out), and searching for the upload ID(s). You can also verify by going to the Synapse projects for the corresponding studies, look in Files → Raw Data → today’s date, and searching for the file that starts with your upload ID(s).
See Bridge Data Change Request Process for information on the formal redrive process.
...