...
- ssh to one of the shared servers sodo/ballard/belltown
- Kick of the Elastic Map Reduce Job. This will start 14 hosts: one for the master and 13 for the slaves running the map tasks.
Code Block ~>/work/platform/bin/elastic-mapreduce-cli/elastic~>elastic-mapreduce --credentials ~/.ssh/$USER-credentials.json --create \ --enable-debugging --bootstrap-action s3://elasticmapreduce/bootstrap-actions/configurations/latest/memory-intensive \ --master-instance-type=m1.small --slave-instance-type=c1.medium --num-instances=14 --json phase.json --name phaseTry1 Created job flow j-GA47B7VD991Q
...
If something is misconfigured, it will fail in a minute or two. Check on the job status and make sure it is running.
| Code Block |
|---|
~>/work/platform/bin/elastic-mapreduce-cli/elastic~>elastic-mapreduce --credentials ~/.ssh/$USER-credentials.json --list --jobflow j-GA47B7VD991Q j-GA47B7VD991Q RUNNING ec2-174-129-134-200.compute-1.amazonaws.com filesysTry1 RUNNING MapReduce Step 1: Run Phase |
If there were any errors, make corrections and resubmit the job step
| Code Block |
|---|
~>/work/platform/bin/elastic-mapreduce-cli/elastic~>elastic-mapreduce --credentials ~/.ssh/$USER-credentials.json --json phase.json --jobflow j-GA47B7VD991Q Added jobflow steps |
...