spark1.4.0 with alluxio

classic Classic list List threaded Threaded
1 message Options
Reply | Threaded
Open this post in threaded view
|

spark1.4.0 with alluxio

ge zhang

Hi guys,
I had read http://alluxio.org/documentation/v1.1.0-RC2/en/Running-Spark-on-Alluxio.html about DATA LOCALITY. And I have already export "export SPARK_LOCAL_HOSENAME=node75" in spark-env.sh.  When I use MASTER=spark://10.1.1.75:7077 bin/spark-shell
to start spark-shell and then executed job , the locality level is still ANY. When I try MASTER=spark://node75:7077 bin/spark-shell to start shell. it went wrong like "<console>:10: error: not found: value sqlContext
                                                                    import sqlContext.sql"

Best,

GE

--
You received this message because you are subscribed to the Google Groups "Alluxio Users" group.
To unsubscribe from this group and stop receiving emails from it, send an email to [hidden email].
For more options, visit https://groups.google.com/d/optout.