...
- Use the AWS console to make a new S3 bucket named sagetest_-YourUsername and make these four subdirectories
- scripts
- input
- output
- results
- logs
Set up your config files for the AWS command line tools installed on the shared servers
Get your credentials
Get your security credentials from your AWS Account
- Access Key ID
- Secret Access Key
Set up s3curl
Set up your configuration files for the AWS tools installed on the shared server
- Create the configuration file for
s3curl
command line toolCode Block ~>cat .s3curl #!/bin/perl %awsSecretAccessKeys = ( YourUsername => { id => 'YourAccessKeyID', key => 'YourSecretAccessKey', }, );
- Test that you can run s3curl
Code Block /work/platform/bin/s3curl.pl --id $USER https://s3.amazonaws.com/sagetest-$USER/
Set up the Elastic MapReduce command line tools
- Create the configuration file for the Elastic Map Reduce command line tool
_Code Block ~>cat YourUsername-credentials.json { "access_id": "YourAccessKeyID", "private_key": "YourSecretAccessKey", "keypair": "SageKeyPair", "key-pair-file": "/home/$user/SageKeyPair.pem", "log_uri": "s3n://sagetest
-YourUsername/logs/", "region": "us-east-1" }
- Test it
Code Block /work/platform/bin/elastic-mapreduce-cli/elastic-mapreduce --credentials ~/$USER-credentials.json --help