Repository Service API
- 1 Introduction
- 1.1 Encoding
- 1.2 Security
- 1.3 Log into Synapse
- 1.4 Create/Update/Delete Examples
- 1.4.1 Create a Entity
- 1.4.2 Basic Entity Fields
- 1.4.3 Update an Entity
- 1.4.4 Creating Hierarchy
- 1.4.5 Entity Annotations
- 1.4.5.1 Get Annotations
- 1.4.5.2 Update Annotations
- 1.4.6 Set Entity Location
- 1.4.7 Versions Create/Read/Update/Delete (and Promote)
- 1.4.7.1 Version-able Entity Metadata
- 1.4.7.1.1 Current API
- 1.4.7.1.2 Version-able Additions to the API
- 1.4.7.2 Version API Examples:
- 1.4.7.3 Get the Location to Version
- 1.4.7.4 Create New Version
- 1.4.7.5 List Versions
- 1.4.7.6 Get a Previous Version
- 1.4.7.7 Get Annotations of a Previous Version
- 1.4.7.8 Delete a Version
- 1.4.7.9 Promote a Version
- 1.4.7.10 Finally List Versions Again
- 1.4.7.1 Version-able Entity Metadata
- 1.4.8 Delete a Project
- 2 Query API
- 2.1 Examples
- 2.1.1 'Select *' Query
- 2.1.2 'Order By' Query
- 2.1.3 Single clause 'Where' Query
- 2.1.4 Multiple clause 'Where' Query
- 2.1.5 'Select *' Query for the Layers of a Dataset
- 2.1.6 'Order By' Query for the Layers of a Dataset
- 2.1.7 'Select *' Query for the all the people who have agreed to the terms in the End User License Agreement for a Dataset
- 2.2 Schema
- 2.2.1 Query Response Schema
- 2.1 Examples
- 3 REST API
- 3.1 Read-Only Examples
- 3.1.1 Get All Datasets
- 3.1.2 Get a Dataset
- 3.1.3 Get Annotations for a Dataset
- 3.1.4 Get all the Layers for a Dataset
- 3.1.5 Get a Clinical Dataset Layer
- 3.1.5.1 Get Annotations for a Clinical Dataset Layer
- 3.1.5.2 Get the Eula for a Clinical Dataset
- 3.1.5.3 Get preview data for a Clinical Dataset Layer
- 3.1.5.4 Get preview data as a map for a Clinical Dataset Layer
- 3.1.5.5 Get the locations for a Clinical Dataset Layer
- 3.1.5.6 Get the awss3 for a Clinical Dataset Layer
- 3.1.5.7 Get the awss3 for a Clinical Dataset Layer for HTTP method HEAD
- 3.1.6 Get storage usage
- 3.1.6.1 Get aggregated storage usage
- 3.1.6.2 Get detailed storage usage
- 3.1.6.3 Get detailed storage usage for an entity
- 3.1.7 Get the descendants of an entity
- 3.1.7.1 Get all the descendants of an entity
- 3.1.7.1.1 Request for getting the first page
- 3.1.7.1.2 Response for getting the first page
- 3.1.7.1.3 Request for getting the second page
- 3.1.7.1.4 Response for getting the second page
- 3.1.7.2 Get the descendants of a specific generation
- 3.1.7.1 Get all the descendants of an entity
- 3.2 References
- 3.3 Schemas
- 3.3.1 Query Results Schema
- 3.3.2 Project Schema
- 3.3.3 Eula Schema
- 3.3.4 Agreement Schema
- 3.3.5 Dataset Schema
- 3.3.6 Layer Schema
- 3.3.7 Layer Preview Schema
- 3.3.8 Dataset or Layer Locations Schema
- 3.3.9 Annotations Schema
- 3.3.10 Access Control List Schema
- 3.1 Read-Only Examples
Introduction
The Query API is loosely modeled after Facebook's Query Language.
The REST API took inspiration from several successful REST APIs:
Facebook's Graph API
Google's Data Protocol
See Service API Design for more information regarding the rationale and design details.
Encoding
The primary request and response encoding for the service is JSON. Here's a handy tool to make a blob of JSON more readable: http://jsonformatter.curiousconcept.com/
In responses from the service, dates are serialized as long integers expressing epoch time - the number of seconds elapsed since midnight Coordinated Universal Time (UTC) of January 1, 1970, not counting leap seconds. Here's a handy tool to convert from epoch time to human readable dates: http://www.epochconverter.com/
In requests to the service, dates can be serialized either as long integers expressing epoch time or human readable dates in http://www.ietf.org/rfc/rfc3339.txt format such as '2011-01-31' or '2011-01-31T22:00:00'
Security
Eventually these services will be HTTPS only and disallow HTTP. For all requests requiring authentication, users will pass a special header sessionToken with
each request to the service.
Log into Synapse
You must have an account with permission to create entities in Synapse.
Request
curl -i -k -H Accept:application/json -H Content-Type:application/json -d '{
"email": "me@myEmail.com",
"password": "thisIsAFakePassword"
}' https://auth-prod.sagebase.org/auth/v1/sessionResponse
Create/Update/Delete Examples
You can create entities, update entities, read entities, and delete entities. More advanced querying is implemented as a separate API. Partial updates (e.g., just updating two fields in a dataset) are not supported. In a nutshell, when you update something like a dataset, you GET the dataset first, modify the properties you want to change, and then send the entire object back to the service so that this revised entity overwrites the previously stored entity. Conflicting updates are detected and rejected through the use of the ETag header.
Create a Entity
An entity is created with a POST where the entity body is passed with a content type of application/json. The only required property for any entity is the 'entityType' which indicates the type of entity you wish to create. See the following table for common entity types:
entityType | Alias (for query) | Description |
|---|---|---|
org.sagebionetworks.repo.model.Project | project | A project entity serves as the root for collaboration. It is a common practices to place all other entities within a project. |
org.sagebionetworks.repo.model.Folder | folder | A simple tool for organizing entities. This is similar to a file folder. |
org.sagebionetworks.repo.model.Link | link | An entity that points to another entity, similar to a Window's Short Cut or a Linux/Mac Link. |
org.sagebionetworks.repo.model.Code | code | An entity where the location is composed of source code. |
org.sagebionetworks.repo.model.PhenotypeData | phenotypedata | Used for phenotypic data. |
org.sagebionetworks.repo.model.GenotypeData | genotypedata | Used for genotypic data. |
org.sagebionetworks.repo.model.ExpressionData | expressiondata | Used for expression data. |
org.sagebionetworks.repo.model.RObject | robject | Language specific 'R' object. |
org.sagebionetworks.repo.model.Study | study | Used for a study. |
org.sagebionetworks.repo.model.Data | data | Generic data. |
For more information on entity types see: Synapse Entity Types.
Note that the request is a POST and the content type of the data we are sending to the service is json
In the following example we are going to create a project entity:
Request
curl -i -k -H sessionToken:YourSessionToken -H Accept:application/json -H Content-Type:application/json -d '{"entityType": "org.sagebionetworks.repo.model.Project"}' https://repo-prod.sagebase.org/repo/v1/entityResponse
In the above example, we created an entity with only the 'entityType' but the returned entity had many more fields set. In the next section we will cover the basic fields of an entity.
Basic Entity Fields
The following are fields that are common to all entities and entity types:
Field Name | Type | Description | Editable | Default Value |
|---|---|---|---|---|
id | String | The ID issued to this entity by Synapse to unique identify it. This ID is immutable and guaranteed to be unique within Synapse. Once an ID is issue to entity the ID will never be issued to another entity even if the original entity is deleted. | false | auto-generated |
| String | This is the ID of this entity's parent. This is used to build a hierarchy of entities. | true | Root folder |
| ISO 8601 date-time | The date and time when the entity was original created. | false | auto-generated |
| ISO 8601 date-time | The date and time when the entity was last modified. | false | auto-generated |
| String | The name of the user that originally created the entity. | false | auto-generated |
| String | The name of the user that last modified the entity. | false | auto-generated |
| String | The name of the entity. This is the most prominent fields of the entity and will show up everywhere. Just like a file must have a unique name within a folder, an Entity must have a unique name within its parent. | true | entity id |
description | String | The description provides more details about an Entity. This field is very prominent on the Synapse web site. | true | null |
| String | Used to concurrency and change detection. | false | auto-generated |
| String | Relative URI of the entity. | false | auto-generated |