HPN Submission Scoring Workflow
...
Invalid Submission Email: Your submission to the HPN xxxx Challenge (Synapse ID syn123456) has been received, but was not accepted because it is not in a valid format. The error message is: xxxxx. You are still allowed one model submission for scoring in the current leader board round. Please review your submission against the error code you received, make the necessary changes and try re-submitting. Alternatively, you may submit a different model . If you have questions, please contact Challenge support at http://support.sagebase.org/sagebase.
Submission Accepted Email: Your valid submission to the HPN xxxx Challenge (Synapse ID syn123456) has been received and was given a score xxxx. Upon the next leader board update, your score will appear here: https://www.synapse.org/#!Synapse:syn98765432. If you have further questions, please contact Challenge support at http://support.sagebase.org/sagebase.
Notes:
This is the workflow for scoring, but not for leader board updating. This process will run frequently, to give users prompt feedback, while the leader board update will run infrequently, e.g. once per scoring round.
The weekly quota is tracked by counting the number of scored submissions having time stamps during the week in question, sent for a team.
...