How to tell if it's down

email received via sageInfo@sagebase.org or synapseeng@sagebase.org or platform@sagebase.org.

Jira ticket

Informal communication (hallway conversation, Slack)

Recovery

Judge the severity

Case 1: Portal is up but Synapse is non-functional (e.g. back end is down):

Step 1:  Put "Synapse Down" banner on the portal

Banner should automatically be added/removed. If it isn't there then...

• Go to https://manage.statuspage.io
• Log in (verify can do this, credentials in LastPass)
• Go to Incidents
• Create a new Incident
• Verify that Incident is shown on www.synapse.org
• Resolve Incident when Synapse is back up.

Step 2: Assess stack elements

• check which stack number we are on (

  curl  https://repo-prod.prod.sagebase.org/repo/v1/version or

  traceroute repo-prod.prod.sagebase.org on mac or tracert on win) 

Log in to aws.amazon.com under the synapse prod account, 325565585839

- Go to RDS console and look at 3 RDS, first ID gen, then others

• Go to Elastic beanstalk, scroll to synapse-prod-<stack> and see if green; Click on 'health" and "monitoring" at LHS.

Step 3: Recovery

Synapse Deployment Notes - 2018