Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

...

  1. Use the AWS console to make a new S3 bucket named sagetest_-YourUsername and make these four subdirectories
    1. scripts
    2. input
    3. output
    4. results
    5. logs

Set up your config files for the AWS command line tools installed on the shared servers

Get your credentials

Get your security credentials from your AWS Account

  • Access Key ID
  • Secret Access Key

Set up s3curl

Set up your configuration files for the AWS tools installed on the shared server

  1. Create the configuration file for s3curl command line tool
    Code Block
    
    ~>cat .s3curl 
    #!/bin/perl
    %awsSecretAccessKeys = (
        YourUsername => {
            id => 'YourAccessKeyID',
            key => 'YourSecretAccessKey',
        },
    );
    
  2. Test that you can run s3curl
    Code Block
    
    /work/platform/bin/s3curl.pl --id $USER https://s3.amazonaws.com/sagetest-$USER/
    

Set up the Elastic MapReduce command line tools

  1. Create the configuration file for the Elastic Map Reduce command line tool
    Code Block
    
    ~>cat YourUsername-credentials.json 
    {
    "access_id": "YourAccessKeyID",
    "private_key": "YourSecretAccessKey",
    "keypair": "SageKeyPair",
    "key-pair-file": "/home/$user/SageKeyPair.pem",
    "log_uri": "s3n://sagetest
    _
    -YourUsername/logs/",
    "region": "us-east-1"
    }
    
  2. Test it
    Code Block
    
    /work/platform/bin/elastic-mapreduce-cli/elastic-mapreduce --credentials ~/$USER-credentials.json --help