...
- ssh to sodo
- Create the configuration file for
s3curl
command line toolCode Block ~>cat ~/.ssh/s3curl #!/bin/perl %awsSecretAccessKeys = ( YourUnixUsername => { id => 'YourAccessKeyID', key => 'YourSecretAccessKey', }, );
- Make a symlink to it in your home directory
Code Block ~>ln -s ~/.ssh/s3curl ~/.s3curl
- Test that you can run s3curl
Code Block ~> chmod 600 /home/$USER/.s3curl ~>/work/platform/bin/s3curl.pl --id $USER https://s3.amazonaws.com/sagebio-$USER/ | head -c 200 <?xml version="1.0" encoding="UTF-8"?> <ListBucketResult xmlns="http://s3.amazonaws.com/doc/2006-03-01/"><Name>sagebio-ndeflaux</Name><Prefix></Prefix><Marker></Marker><MaxKeys>1000</MaxKeys><IsTruncated>
...
Code Block |
---|
~>ssh ndeflaux@pegasus.ccs.miami.edu ndeflaux@pegasus.ccs.miami.edu's password: Last login: Thu May 19 18:59:51 2011 from dhcp149019.fhcrc.org *********************************************************************** * * * Welcome to Pegasus Linux Cluster at CCS/University of Miami. * * * * .... * * *********************************************************************** [ndeflaux@u01 ~]$ nano file.txt [ndeflaux@u01 ~]$ |
Where to go next?
- Try A Simple Example of an R MapReduce Job
- Take a look at the AWS documentation for Elastic MapReduce