Bug 1064248 - missing apps/hive/warehouse
Summary: missing apps/hive/warehouse
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Gluster Storage
Classification: Red Hat Storage
Component: rhs-hadoop-install
Version: unspecified
Hardware: Unspecified
OS: Unspecified
low
unspecified
Target Milestone: Release Candidate
: ---
Assignee: Jeff Vance
QA Contact: Ondřej Komárek
URL:
Whiteboard:
Depends On:
Blocks: 1159155
TreeView+ depends on / blocked
 
Reported: 2014-02-12 09:57 UTC by Martin Kudlej
Modified: 2014-11-24 11:53 UTC (History)
8 users (show)

Fixed In Version: 2.17-1
Doc Type: Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed: 2014-11-24 11:53:54 UTC
Embargoed:


Attachments (Terms of Use)


Links
System ID Private Priority Status Summary Last Updated
Red Hat Product Errata RHEA-2014:1275 0 normal SHIPPED_LIVE Red Hat Storage Server 3 Hadoop plug-in enhancement update 2014-11-24 16:53:36 UTC

Description Martin Kudlej 2014-02-12 09:57:10 UTC
Description of problem:
I've tested hive with RHS+Hadoop and "apps/hive/warehouse" directory was not created by rhs-hadoop-install script.

Version-Release number of selected component (if applicable):
glusterfs-3.4.0.44rhs-1.el6rhs.x86_64
glusterfs-fuse-3.4.0.44rhs-1.el6rhs.x86_64
glusterfs-geo-replication-3.4.0.44rhs-1.el6rhs.x86_64
glusterfs-libs-3.4.0.44rhs-1.el6rhs.x86_64
glusterfs-server-3.4.0.44rhs-1.el6rhs.x86_64
hadoop-2.2.0.2.0.6.0-101.el6.x86_64
hadoop-client-2.2.0.2.0.6.0-101.el6.x86_64
hadoop-hdfs-2.2.0.2.0.6.0-101.el6.x86_64
hadoop-libhdfs-2.2.0.2.0.6.0-101.el6.x86_64
hadoop-lzo-0.5.0-1.x86_64
hadoop-lzo-native-0.5.0-1.x86_64
hadoop-mapreduce-2.2.0.2.0.6.0-101.el6.x86_64
hadoop-mapreduce-historyserver-2.2.0.2.0.6.0-101.el6.x86_64
hadoop-yarn-2.2.0.2.0.6.0-101.el6.x86_64
hadoop-yarn-nodemanager-2.2.0.2.0.6.0-101.el6.x86_64
hadoop-yarn-resourcemanager-2.2.0.2.0.6.0-101.el6.x86_64
python-rhsm-1.8.17-1.el6_4.x86_64
redhat-storage-logos-60.0.17-1.el6rhs.noarch
rhs-hadoop-2.1.6-2.noarch
rhs-hadoop-install-0_65-2.el6rhs.noarch


How reproducible:
100%

Actual results:
apps/hive/warehouse is not there.

Expected results:
rhs-hadoop-install script creates apps/hive/warehouse directory.

Comment 1 Jeff Vance 2014-02-12 15:46:27 UTC
Hi Martin, Why do you think that rhs-hadoop-install needs to create this dir? According to Steve, Hive instructions, including instructions from Hortonworks, the user is expected to create this directory before running hive.

Comment 2 Daniel Horák 2014-02-13 10:43:34 UTC
Hi Jeff,
few notes:
  * I didn't found it in the Hortonworks instructions for Ambari[1] (but I maybe just miss it!) <- supported type of installation for rhs-hadoop
  * It is in the instructions from Hortonworks for *manual installation from RPM* [2] <- unsupported type of installation for rhs-hadoop
  * The instructions[2] are not precisely correct, because they start: "Login as $HDFS_USER" which doesn't make sense for GlusterFS environment.
  * rhs-hadoop-install script is already creating some other directories (mapred, mr-history, app-logs, hbase,...) which are documented in HDP documentation [3]

I'm not sure if creating this directory automatically in rhs-hadoop-install script is ok (hbase directory is the same case!), but it should be at least clarified in our documentation.

[1] http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0/bk_using_Ambari_book/content/ambari-include-setup.html
[2] http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0/bk_installing_manually_book/content/rpm-chap6-4.html
[3] http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0/bk_installing_manually_book/content/rpm-chap4-4.html

Comment 3 Vivek Agarwal 2014-04-07 11:40:26 UTC
Per bug triage, between dev, PM and QA, moving these out of denali

Comment 4 Scott Haines 2014-04-09 00:09:46 UTC
Per Apr-02 bug triage meeting, granting both devel and pm acks

Comment 5 Nagaprasad Sathyanarayana 2014-05-06 10:35:08 UTC
BZs not targeted for Denali.

Comment 8 Jeff Vance 2014-09-19 14:50:30 UTC
The 2.x version of the installer fixes this issue.

Comment 10 Ondřej Komárek 2014-11-05 15:18:15 UTC
Tested with versions:

glusterfs-3.6.0.30-1.el6rhs.x86_64
glusterfs-rdma-3.6.0.30-1.el6rhs.x86_64
glusterfs-libs-3.6.0.30-1.el6rhs.x86_64
glusterfs-fuse-3.6.0.30-1.el6rhs.x86_64
glusterfs-server-3.6.0.30-1.el6rhs.x86_64
glusterfs-cli-3.6.0.30-1.el6rhs.x86_64
glusterfs-geo-replication-3.6.0.30-1.el6rhs.x86_64
glusterfs-api-3.6.0.30-1.el6rhs.x86_64

glusterfs-hadoop-distribution-glusterfs-hadoop-setup_common-0.2-72.noarch
glusterfs-hadoop-distribution-glusterfs-hadoop-setup_gluster-0.2-54.noarch
glusterfs-hadoop-distribution-glusterfs-hadoop-setup_hadoop-0.1-84.noarch

hadoop-client-2.4.0.2.1.7.0-784.el6.x86_64
hadoop-mapreduce-2.4.0.2.1.7.0-784.el6.x86_64
hadoop-yarn-2.4.0.2.1.7.0-784.el6.x86_64
hadoop-hdfs-2.4.0.2.1.7.0-784.el6.x86_64
hadoop-2.4.0.2.1.7.0-784.el6.x86_64

rhs-hadoop-install-2_28-1.el6rhs.noarch
rhs-hadoop-2.3.3-3.el6rhs.noarch



grep -R /usr/share/rhs-hadoop-install "warehouse"
./bin/gen_dirs.sh:post_processing_dirs=....apps/hive/warehouse:0755:hive....

And directory indeed exist after installation.

-> VERIFIED

Comment 12 errata-xmlrpc 2014-11-24 11:53:54 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHEA-2014-1275.html


Note You need to log in before you can comment on or make changes to this bug.