Document toolboxDocument toolbox

Bridge Backups

New Backup Design: 



**The below is now defunct**

Currently all the production tables and several staging tables are backed up daily.  They are dumped as S3 files in the bucket org-sagebridge-dynamo-backup-prod.  To restore the tables, go to the AWS DDB console, click on "Import/Export".  On the "Import/Export" screen, you should see a list of export/import pipelines.  Note it may take a while to load the pipelines.  To restore a table, select it and click "Import into DynamoDB".  Next step will choose the snapshot to import, specify the destination, whether it is one-time or repetitive.  At the end it kicks off a EMR cluster to do the actual restore.


TODO: Automate the backup pipelines

TODO: Back up data stored as S3 files