Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

Learn how to set up custom storage locations and access them with Synapse.

...

Synapse provides physical storage for files using Amazon S3, however, you can configure your own custom storage locations as well. For example, data files can physically reside in your own S3 bucket, or a local file server using a proxy servers. Creating a custom storage location allows you greater ownership and control of your files, especially when you have a large amount of data or when additional restrictions need to be set on the data.

(plus) Learn how to take advantage of custom storage locations /wiki/spaces/DOCS/pages/2048327803.

...

Using AWS Security Token Service (STS), Synapse can securely grant you temporary AWS credentials to access data directly in S3. This can be useful if you want to:

  • Download data in bulk

  • Upload data in bulk

  • Allow your compute cluster to read S3 objects using the S3 APIs

All of which you can now do with minimal overhead from Synapse.

(plus) Learn how to compute directly on data in Synapse or S3 /wiki/spaces/DOCS/pages/2048426057.