Bug 1149055 - [RFE][sahara]: Enable HDFS NameNode High Availability in HDP 2.* plugin
Summary: [RFE][sahara]: Enable HDFS NameNode High Availability in HDP 2.* plugin
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat OpenStack
Classification: Red Hat
Component: openstack-sahara
Version: unspecified
Hardware: Unspecified
OS: Unspecified
urgent
medium
Target Milestone: Upstream M1
: 7.0 (Kilo)
Assignee: Elise Gafford
QA Contact: Luigi Toscano
URL: https://blueprints.launchpad.net/saha...
Whiteboard: upstream_milestone_kilo-1 upstream_de...
Depends On:
Blocks:
TreeView+ depends on / blocked
 
Reported: 2014-10-03 04:01 UTC by RHOS Integration
Modified: 2015-08-05 13:14 UTC (History)
6 users (show)

Fixed In Version: openstack-sahara-2015.1.0-2.el7ost
Doc Type: Enhancement
Doc Text:
This enhancement adds namenode high availability as a supported option in the HDP 2.0.6 plugin. Users can signal that they require a cluster to be generated in HA mode, by passing a cluster with a quorum of zookeeper servers and journalnodes, and at least 2 namenodes. For example: "cluster_configs": { "HDFSHA": { "hdfs.nnha": true } }
Clone Of:
Environment:
Last Closed: 2015-08-05 13:14:11 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Bugzilla 1238700 0 high CLOSED NameNode HA for HDP2 does not set up Oozie correctly 2021-02-22 00:41:40 UTC
Red Hat Product Errata RHEA-2015:1548 0 normal SHIPPED_LIVE Red Hat Enterprise Linux OpenStack Platform Enhancement Advisory 2015-08-05 17:07:06 UTC

Internal Links: 1238700

Description RHOS Integration 2014-10-03 04:01:10 UTC
Cloned from launchpad blueprint https://blueprints.launchpad.net/sahara/+spec/hdp-plugin-enable-hdfs-ha.

Description:

Configure and enable HDFS NameNode High Availability on Hadoop clusters deployed with 
HDP 2.* plugin.

Specification URL (additional information):

None

Comment 4 Luigi Toscano 2015-07-13 17:53:59 UTC
Following the upstream guidelines, an HDP 2.0.6 cluster setup according the following structure:

* master-ha-common (1 node)
   - AMBARI_SERVER
   - HISTORYSERVER
   - OOZIE_SERVER
   - RESOURCEMANAGER
   - SECONDARY_NAMENODE
   - ZOOKEEPER_SERVER
   - JOURNALNODE

 * master-ha-nn (2 nodes)
   - NAMENODE
   - ZOOKEEPER_SERVER
   - JOURNALNODE

* worker-ha (3 nodes)
   - DATANODE
   - HDFS_CLIENT
   - MAPREDUCE2_CLIENT
   - NODEMANAGER
   - OOZIE_CLIENT
   - PIG
   - YARN_CLIENT
   - ZOOKEEPER_CLIENT

and using the following configuration key:
"cluster_configs": {
   "HDFSHA": {
      "hdfs.nnha": true
   }
}

ends up with NameNode services configured in active/passive HA (two instances, one enabled, the other in failover mode). Jobs can be executed as Oozie points to the correct element.

Tested on:
openstack-sahara-api-2015.1.0-5.el7ost.noarch
openstack-sahara-engine-2015.1.0-5.el7ost.noarch
openstack-sahara-common-2015.1.0-5.el7ost.noarch

Comment 6 errata-xmlrpc 2015-08-05 13:14:11 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2015:1548


Note You need to log in before you can comment on or make changes to this bug.