开发者学堂课程【大数据实时计算框架 Spark 快速入门: Yarn 集群模式_3 】学习笔记,与课程紧密联系,让用户快速学习知识。
课程地址:https://developer.aliyun.com/learning/course/100/detail/1661
Yarn 集群模式_3
内容介绍:
一、cluster 模式
一、cluster 模式
cluster 模式
/bin/spark-submit --class org apache, spark examples. sparkPi --master yarn-cluster --executor-memory--num4
client token:
N/A
diagnostics:
N/A
ApplicationMaster
host:
192.168.80.23
ApplicationMaster RPCport:0
queue:default
Start time:1480412782816
Final status: SUCCEEDED
Tracking URL: http://node24:8088/proxy/application_1480412414584_0002/A
user: root
16/11/29 17:47:09 INFO util.ShutdownHookManager: Shutdownhook called
16/11/29 17:47:09INFO util.ShutdownHookManager: Deleting
directory/tmp/spark-3316c182-8444-4a49-bd67-56c1f055766
c
[root@node21 spark-1.6.0-bin-hadoop2.41#
/bin/spark-submit --class org.apache.spark.examples.SparkPi--master yar
n-cluster /lib/spark-examples-1.6.0-hadoop2.4.0.jar 100