Spark+zookeeper搭建高可用集群_spark spark.deploy.zookeeper.session.timeout-CSDN博客

网站介绍:文章浏览阅读297次。Master结点存在单点故障,所以要借助zookeeper,至少启动两台Master结点来实现高可用,配置方案比较简单先停止所有Spark服务,然后安装zookeeper,并启动zookeeper集群规划:一、先安装Spark集群(Spark2.2.0安装教程)二、安装zookeeper:(zookeeper安装教程)三、高可用配置在spark-env.sh上删掉SPARK_MASTER_IP配置项,并添加以下内容:export SPARK_DAEMON_JAVA_OPTS="-_spark spark.deploy.zookeeper.session.timeout