...
Synapse Evaluations are constructed around three primary objects: Evaluation, Participant, and Submission. These objects are defined by eponymous JSON schema files in the Synapse Repository Services.
Evaluation
Object representing a Synapse Evaluation
...
- submissionID
- eTag - optimistic concurrency flag; changes with each update
- status - enum describing the state of the Submission, one of: OPEN, CLOSED, SCORED, INVALID
- score - numerical score for this Submission (double between 0 and 1)
- report - String describing this Submission and/or its scoring. May contain additional scoring information, error logs, etc.
REST API
Evaluation
| URL | HTTP Type | Description |
|---|---|---|
| /evaluation | POST | Create a new Evaluation |
| /evaluation/{evaluationId} | GET | Get a Evaluation |
| /evaluation/{evaluationId} | PUT | Update a Evaluation |
| /evaluation/{evaluationId} | DELETE | Delete a Evaluation |
| /evaluation | GET | Batch Get Evaluations (Paginated) |
| /evaluation/count | GET | Get the number of Evaluations |
| /evaluation/name/{name} | GET | Find a Evaluation by name Note that the name must be URL-encoded |
...