Cluster Monitoring Connection Instructions could be awesomer.

[gregglind]

Currently, the rsync / scp of the files is a drag. There are lots of solutions here, including autosync with s3, or gist or github.

I have been thinking something along the lines of this:

## GREGG TOTALLY STINKS AT BASH, this needs to be... sourceable?

export -f TELEMETRYCLUSTER=ec2-54-201-192-120.us-west-2.compute.amazonaws.com;
export TELDIR=~/telemetry-analysis-files
mkdir -p "${TELDIR}"

echo -n "${TELEMETRYCLUSTER}" > ~/.telemtry-cluster
echo -n "${TELDIR}" > ~/.telemetry-dir


# connect
tel-connect () { ssh -i my-private-key -L 4040:localhost:4040 -L 8888:localhost:8888 hadoop@`cat ~/.cluster`; }

# scp down
tel-download () { scp -i my-private-key hadoop@$(cat ~/.cluster):~/analyses/* "${TELDIR}"; }

# scp up
tel-upload () { scp -i my-private-key "${TELDIR}"/* hadoop@$(cat ~/.cluster):~/analyses/ ; }

export tel-connect
export tel-upload
export tel-download

Maybe suggesting putting this is some snippet you can cram into a .bash_profile or whatnot :)