...
clusterEvalQ(cl, {
system('svn export --no-auth-cache --non-interactive --username joe.user --password supeRsecRet77 https://sagebionetworks.jira.com/svn/COMPBIO/trunk/users/juser/fantasticAnalysis.R')
})<<github example>>
Return values
-------------
Return values from distributed computations have to come across a socket connection, so be careful what you return. Status values such as dim(result) can confirm that a computation succeeded and are often better than returning a whole result.
clusterEvalQ(cl, {
...
result <- produceGiantResultMatrix(foo, bar, bat)
...
dim(result)
})
Also, consider putting intermediate values in synapse, which might serve as a means of checkpointing lengthy computations.
<<synapse example>>
Stopping a cluster
...
stopCluster(cl)Don't forget to delete the stack in the AWS administration console to avoid continuing charges.
To do
...
...
- Spot instances? Is this worthwhile for interactive use?
...
- Create our own Cloud Formation template
...
- Run a user-specified script on start-up