Section | ||||||||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
|
Note that the elastic map reduce client on the shared servers has moved. See the updated instructions below.
...
- Use the AWS console to make a new S3 bucket named sagebio-YourUnixUsername Note: Do not put any underscores in your bucket name. Only use hyphens, lowercase letters and numbers.
- Make these five subdirectories
- scripts
- input
- output
- results
- logs
Set up your config file for the AWS Elastic MapReduce command line tool installed on the shared servers
...
Get your AWS credentials
Get your security credentials from your AWS Account
- Access Key ID
- Secret Access Key
Set up the Elastic MapReduce command line
...
tool
Set up your configuration files for the Elastic MapReduce AWS tool installed on the shared servers (belltown, sodo, ballard, ...)
...
Code Block |
---|
~>ssh ndeflaux@pegasus.ccs.miami.edu ndeflaux@pegasus.ccs.miami.edu's password: Last login: Thu May 19 18:59:51 2011 from dhcp149019.fhcrc.org *********************************************************************** * * * Welcome to Pegasus Linux Cluster at CCS/University of Miami. * * * * .... * * *********************************************************************** [ndeflaux@u01 ~]$ nano file.txt [ndeflaux@u01 ~]$ |
Where to go next?
- Try A Simple Example of an R MapReduce Job Getting Started with R on Elastic Map Reduce
- Take a look at the AWS documentation for Elastic MapReduce