Skip to content

hadoop-resource-manager.md

Latest commit

 

History

History
81 lines (65 loc) · 2.61 KB

hadoop-resource-manager.md

File metadata and controls

81 lines (65 loc) · 2.61 KB

Hadoop resource manager section parser

Default configuration

hadoop-resource-manager default configuration

How to configure cluster section in service-configuraiton.yaml

All configurations in this section is optional. If you want to customized these value, you can configure it in service-configuration.yaml.

  • virtualClusters Initial virtual cluster, containers multiple sub-clusters, the total capacity should equal to 100.

    • virtualClusters.{name} Sub-cluster name.
      • virtualClusters.{name}.description Comments, no influence.
      • virtualClusters.{name}.capacity Resource quota.

  • yarn_exporter_port The port used to export yarn metrics.

Generated Configuration

After parsing, object model looks like:

hadoop-resource-manager:
    virtualClusters:
      default:
        description: Default VC.
        capacity: 100
    
    yarn_exporter_port: 9459
    yarn_log_retain_seconds: 2592000

Table

Data in Configuration File Data in Cluster Object Model Data in Jinja2 Template Data type
hadoop-resource-manager.virtualClusters com["hadoop-resource-manager"]["virtualClusters"] cluster_cfg["hadoop-resource-manager"]["virtualClusters"] Dict
hadoop-resource-manager.virtualClusters.{ vcName }.description com["hadoop-resource-manager"]["virtualClusters"][{ vcName }]["description"] cluster_cfg["hadoop-resource-manager"]["virtualClusters"][{ vcName }]["description"] Str
hadoop-resource-manager.virtualClusters.{ vcName }.capacity com["hadoop-resource-manager"]["virtualClusters"][{ vcName }]["capacity"] cluster_cfg["hadoop-resource-manager"]["virtualClusters"][{ vcName }]["capacity"] Int
hadoop-resource-manager.yarn_exporter_port com["hadoop-resource-manager"]["yarn_exporter_port"] cluster_cfg["hadoop-resource-manager"]["yarn_exporter_port"] Int
hadoop-resource-manager.yarn_log_retain_seconds com["hadoop-resource-manager"]["yarn_log_retain_seconds"] cluster_cfg["hadoop-resource-manager"]["yarn_log_retain_seconds"] Int