This is brilliant, thanks. I just found that in install-spark-hadoop.sh the spark file couldn't be found, so I had to wget it from: http://mirrors.london-do.gethosted.online/apache/spark/spark-2.2.3/spark-2.2.3-bin-hadoop2.7.tgz Also needed to update spark version in script to 2.2.3. Thanks again!