Hadoop YARN新特性—label based scheduling.docx


立即下载 布偶的表弟派大星丶
2024-03-27
调度 duling 配置 功能 ton property 集群 de-labels.enabled YARN 策略
1.1 MB

在最新的hadoop 2.6.0版本中,YARN引入了一种新的调度策略:基于标签的调度机制。该机制的主要引入动机是更好地让YARN运行在异构集群中,进而更好地管理和调度混合类型的应用程序。
http://doc.mapr.com/display/MapR/Label-based+Scheduling
http://hortonworks.com/blog/support-long-running-services-hadoop-yarn-clusters/?utm_source=tuicool&utm_medium=referral
http://blog.sequenceiq.com/blog/2014/11/10/new-yarn-features-part-1-label-based-scheduling/
https://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.3.4/bk_yarn_resource_mgt/content/ch_node_labels.html
http://aajisaka.github.io/hadoop-project/hadoop-yarn/hadoop-yarn-site/NodeLabel.html
http://www.cloudera.com/documentation/enterprise/5-4-x/topics/cdh_rn_new_in_547.html?q=labels
# 配置基于hadoop-yarn-label-based-scheduling功能条件是,一个正常使用的集群!
#环境是2个node,hadoop-2.7.1
# 调度策略
# 开启yarn.node-labels.enabled功能,添加系统级别的label
1、配置Yarn-site.xml,追加内容:

yarn.node-labels.enabled
true


yarn.node-labels.fs-store.root-dir
hdfs://myclu


调度/duling/配置/功能/ton/property/集群/de-labels.enabled/YARN/策略/ 调度/duling/配置/功能/ton/property/集群/de-labels.enabled/YARN/策略/
-1 条回复
登录 后才能参与评论
-->