Add source storage location option to storage migrate functions

Description

In validating the migration functions for her use case has come across cases where she'd want to limit the scope of a migration to files that existed in a specific set of existing storage locations rather than targeting all files in a project/folder even if those files exist in multiple separate storage locations.

This could be accomplished by adding a source_storage_location_ids argument to the index_files_for_migration function, all files existing in other storage locations than those specified would be skipped.

Environment

None

Activity

Show:
Nicole Kauer
March 3, 2021, 1:00 AM

This seems to be working for me! Thank you, !

Jordan Kiang
February 27, 2021, 11:25 PM

The latest release candidate build adds an optional source_storage_location_ids keyword parameter to the index_files_for_migration function which takes a list of storage location ids. If passed, only files in one of the listed ids will be included in the migration index, any other files are ignored.

The doc for the updated function can be previewed here:
https://jkiang13.github.io/synapsePythonClient/build/html/synapseutils.html#synapseutils.migrate_functions.index_files_for_migration

Via the command line this value is via the optional --source_storage_location_ids parameter, e.g.

The latest build can be installed e.g.

Fixed

Assignee

Jordan Kiang

Reporter

Jordan Kiang

Labels

None

Validator

Nicole Kauer

Development Area

Synapse Core Infrastructure

Release Version History

None

Slack Channel

None

Fix versions

Priority

Major