Bug 1318243 - [Doc RFE] New Guide: Deployment Guide for Containerized Red Hat Gluster Storage
Summary: [Doc RFE] New Guide: Deployment Guide for Containerized Red Hat Gluster Storage
Keywords:
Status: CLOSED CURRENTRELEASE
Alias: None
Product: Red Hat Gluster Storage
Classification: Red Hat
Component: Documentation
Version: rhgs-3.1
Hardware: Unspecified
OS: Unspecified
unspecified
unspecified
Target Milestone: ---
: RHGS Container Converged 1.0
Assignee: Bhavana
QA Contact: storage-qa-internal@redhat.com
URL:
Whiteboard:
Depends On:
Blocks: 1332130
TreeView+ depends on / blocked
 
Reported: 2016-03-16 10:55 UTC by Anjana Suparna Sriram
Modified: 2016-10-14 13:45 UTC (History)
16 users (show)

Fixed In Version:
Doc Type: Enhancement
Doc Text:
Clone Of:
Environment:
Last Closed: 2016-10-14 13:45:28 UTC
Target Upstream Version:
hchiramm: needinfo-


Attachments (Terms of Use)

Description Anjana Suparna Sriram 2016-03-16 10:55:38 UTC
Additional information: Develop a comprehensive guide for Red Hat Gluster Storage for Containers that assists customers with understanding about containerized Gluster.

Comment 9 Prasanth 2016-07-27 15:54:15 UTC
On a quick check, I still see some major mismatches in the guide. See below for the corrections required in the guide:

#####
# subscription-manager repos --enable=rh-gluster-3-for-rhel-7-server-rpm ---> # subscription-manager repos --enable=rh-gluster-3-for-rhel-7-server-rpms
# yum install heketi-client heketi-template ---> # yum install heketi-client heketi-templates
# yum install atomic-openshift-clientyum install atomic-openshift ---> # yum install atomic-openshift-clients
A cluster-admin user must be created.  ---> No link to openshift guide for creating a cluster admin user
#####

Can you quickly re-check the same from your end and update it correctly?

Comment 10 Prasanth 2016-07-27 15:54:46 UTC
Anjana, can you check and do the needful?

Comment 12 Erin Boyd 2016-07-27 18:02:54 UTC
Yes, I agree. I think the instruction in Appendix C of the dev guide are easier to follow. IN addition, it's helpful to understand how the router works with the rest of the deployment (ie heketi api server values) as per my suggstions in this guide
https://docs.google.com/document/d/1b4U1QoKTgLDLKtonirpALi_B2iATay-I7bSFEQXQ8Ow/edit?ts=57912865#

Comment 13 Erin Boyd 2016-07-27 21:30:17 UTC
I think we also need to emphasize that on the router the user SHOULD NOT EDIT the /etc/dnsmasq.conf UNTIL the router has successfully started. Any changes to this file while it's trying to deploy (even if it's been assigned out to a server) will cause an unrecoverable error

Comment 14 Neha 2016-07-28 06:57:49 UTC
In Appendix A. Client Configuration using Port Forwarding

oc port-forward heketi pod name 8080:8080

For clarity it should be:

oc port-forward <heketi pod name> 8080:8080

I believe this is the convention we are following in complete doc.

Comment 15 Neha 2016-07-28 07:22:39 UTC
3.2.1.2. Setting up the Red Hat Enterprise Linux 7 Client for Installing Red Hat Gluster Storage Container Converged with OpenShift

Subscribe to the OpenShift Enterprise 3.2 repo

change

# subscription-manager repos --enable=rhel-7-server-ose-3.2-rpms/x86_64

to

# subscription-manager repos --enable=rhel-7-server-ose-3.2-rpms

Comment 17 Bhavana 2016-07-28 07:39:47 UTC
(In reply to Prasanth from comment #9)
> On a quick check, I still see some major mismatches in the guide. See below
> for the corrections required in the guide:
> 
> #####
> # subscription-manager repos --enable=rh-gluster-3-for-rhel-7-server-rpm
> ---> # subscription-manager repos
> --enable=rh-gluster-3-for-rhel-7-server-rpms
> # yum install heketi-client heketi-template ---> # yum install heketi-client
> heketi-templates
> # yum install atomic-openshift-clientyum install atomic-openshift ---> # yum
> install atomic-openshift-clients
> A cluster-admin user must be created.  ---> No link to openshift guide for
> creating a cluster admin user
> #####
> 
> Can you quickly re-check the same from your end and update it correctly?

Hi Prasanth,

The commands and the link to the cluster admin guide is updated. let me know if this looks ok.

 http://jenkinscat.gsslab.pnq.redhat.com:8080/job/doc-Red_Hat_Gluster_Storage-3.1-Deployment_Guide_for_Containerized_Red_Hat_Gluster_Storage%20%28html-single%29/lastStableBuild/artifact/tmp/en-US/html-single/index.html#chap-Documentation-Deployment_Guide_for_Containerized_Red_Hat_Gluster_Storage-Support_Requirements_2

Comment 19 Bhavana 2016-07-28 07:48:18 UTC
(In reply to Neha from comment #15)
> 3.2.1.2. Setting up the Red Hat Enterprise Linux 7 Client for Installing Red
> Hat Gluster Storage Container Converged with OpenShift
> 
> Subscribe to the OpenShift Enterprise 3.2 repo
> 
> change
> 
> # subscription-manager repos --enable=rhel-7-server-ose-3.2-rpms/x86_64
> 
> to
> 
> # subscription-manager repos --enable=rhel-7-server-ose-3.2-rpms

Hi Neha,

The command is now updated:

http://jenkinscat.gsslab.pnq.redhat.com:8080/job/doc-Red_Hat_Gluster_Storage-3.1-Deployment_Guide_for_Containerized_Red_Hat_Gluster_Storage%20%28html-single%29/lastStableBuild/artifact/tmp/en-US/html-single/index.html#idm139722086961568

Comment 20 Bhavana 2016-07-28 07:49:58 UTC
(In reply to Neha from comment #14)
> In Appendix A. Client Configuration using Port Forwarding
> 
> oc port-forward heketi pod name 8080:8080
> 
> For clarity it should be:
> 
> oc port-forward <heketi pod name> 8080:8080
> 
> I believe this is the convention we are following in complete doc.

Hi Neha,

The pod name is now witten within "< >":

http://jenkinscat.gsslab.pnq.redhat.com:8080/job/doc-Red_Hat_Gluster_Storage-3.1-Deployment_Guide_for_Containerized_Red_Hat_Gluster_Storage%20%28html-single%29/lastStableBuild/artifact/tmp/en-US/html-single/index.html#idm139722086961568

Comment 24 Erin Boyd 2016-07-28 15:20:12 UTC
A.2. Setting up the DNS
After the router is setup, the clients have to be setup to access the services in the OpenShift cluster. Execute the following steps to setup the DNS. 

***I would recommend saying 

"After the router is running"

You cannot change the DNS before the router is completely up, or it won't ever come up completely.

Comment 25 Erin Boyd 2016-07-28 15:38:20 UTC
Should we enhance this:
path: The Gluster volume that will be accessed from the Trusted Storage Pool. 

Tell the user how to find it

oc rch <glusterpod>
gluster volume info

i.e.
oc rsh glusterfs-dc-aplo19.rh72-1-8h7dc 

sh-4.2# gluster volume status
Status of volume: heketidbstorage <--- path

Comment 29 Bhavana 2016-07-29 05:17:07 UTC
(In reply to Erin Boyd from comment #24)
> A.2. Setting up the DNS
> After the router is setup, the clients have to be setup to access the
> services in the OpenShift cluster. Execute the following steps to setup the
> DNS. 
> 
> ***I would recommend saying 
> 
> "After the router is running"
> 
> You cannot change the DNS before the router is completely up, or it won't
> ever come up completely.

Updated the phrase accordingly.

http://jenkinscat.gsslab.pnq.redhat.com:8080/job/doc-Red_Hat_Gluster_Storage-3.1-Deployment_Guide_for_Containerized_Red_Hat_Gluster_Storage%20%28html-single%29/lastStableBuild/artifact/tmp/en-US/html-single/index.html#idm139999887218976

Comment 30 Bhavana 2016-07-29 12:37:28 UTC
(In reply to Erin Boyd from comment #25)
> Should we enhance this:
> path: The Gluster volume that will be accessed from the Trusted Storage
> Pool. 
> 
> Tell the user how to find it
> 
> oc rch <glusterpod>
> gluster volume info
> 
> i.e.
> oc rsh glusterfs-dc-aplo19.rh72-1-8h7dc 
> 
> sh-4.2# gluster volume status
> Status of volume: heketidbstorage <--- path

It was recommended I add a new chapter, where the gluster pod operations are described. I think that will cover this suggestion:

http://jenkinscat.gsslab.pnq.redhat.com:8080/job/doc-Red_Hat_Gluster_Storage-3.1-Deployment_Guide_for_Containerized_Red_Hat_Gluster_Storage%20%28html-single%29/lastStableBuild/artifact/tmp/en-US/html-single/index.html#chap-Documentation-Deployment_Guide_for_Containerized_Red_Hat_Gluster_Storage-Gluster_Pod_Operations

Comment 31 khartsoe@redhat.com 2016-07-29 14:25:36 UTC
The team gave approval to the docs but the last 2 changes we need ASAP are the following:

CHANGE #1

In Section "4.1. Preparing the Red Hat OpenShift Enterprise Cluster"

Move all of Step 1:

 On each of the OpenShift nodes that will host the Red Hat Gluster Storage container, add the following rules to /etc/sysconfig/iptables in order to open the required ports:

-A OS_FIREWALL_ALLOW -p tcp -m state --state NEW -m tcp --dport 24007 -j ACCEPT
-A OS_FIREWALL_ALLOW -p tcp -m state --state NEW -m tcp --dport 24008 -j ACCEPT
-A OS_FIREWALL_ALLOW -p tcp -m state --state NEW -m tcp --dport 2222 -j ACCEPT
-A OS_FIREWALL_ALLOW -p tcp -m state --state NEW -m multiport --dports 49152:49664 -j ACCEPT

    Execute the following command to reload the iptables:

    # systemctl reload iptables


from "4.1. Preparing the Red Hat OpenShift Enterprise Cluster" to "3.2.3. Red Hat OpenShift Enterprise Requirements" as its own separate bullet after "The OpenShift cluster must be up and running." bullet but before the "The OpenShift router must be created and the DNS must be setup. For more information see, Appendix A, OpenShift Router Setup" bullet.



CHANGE #2

Update the title and subtitle to the following text:

Title: Deployment Guide for Containerized Red Hat Gluster Storage in OpenShift Enterprise
Subtitle: Deploying Containerized Red Hat Gluster Storage in OpenShift Enterprise

Comment 32 Bhavana 2016-07-29 16:43:47 UTC
(In reply to khartsoe from comment #31)
> The team gave approval to the docs but the last 2 changes we need ASAP are
> the following:
> 
> CHANGE #1
> 
> In Section "4.1. Preparing the Red Hat OpenShift Enterprise Cluster"
> 
> Move all of Step 1:
> 
>  On each of the OpenShift nodes that will host the Red Hat Gluster Storage
> container, add the following rules to /etc/sysconfig/iptables in order to
> open the required ports:
> 
> -A OS_FIREWALL_ALLOW -p tcp -m state --state NEW -m tcp --dport 24007 -j
> ACCEPT
> -A OS_FIREWALL_ALLOW -p tcp -m state --state NEW -m tcp --dport 24008 -j
> ACCEPT
> -A OS_FIREWALL_ALLOW -p tcp -m state --state NEW -m tcp --dport 2222 -j
> ACCEPT
> -A OS_FIREWALL_ALLOW -p tcp -m state --state NEW -m multiport --dports
> 49152:49664 -j ACCEPT
> 
>     Execute the following command to reload the iptables:
> 
>     # systemctl reload iptables
> 
> 
> from "4.1. Preparing the Red Hat OpenShift Enterprise Cluster" to "3.2.3.
> Red Hat OpenShift Enterprise Requirements" as its own separate bullet after
> "The OpenShift cluster must be up and running." bullet but before the "The
> OpenShift router must be created and the DNS must be setup. For more
> information see, Appendix A, OpenShift Router Setup" bullet.
> 
> 
> 
> CHANGE #2
> 
> Update the title and subtitle to the following text:
> 
> Title: Deployment Guide for Containerized Red Hat Gluster Storage in
> OpenShift Enterprise
> Subtitle: Deploying Containerized Red Hat Gluster Storage in OpenShift
> Enterprise

Hi Ken,

Comment 1 is addressed. Comment 2 of changing the title is still under progress. Following is the updated bug:

http://jenkinscat.gsslab.pnq.redhat.com:8080/job/doc-Red_Hat_Gluster_Storage-3.1-Deployment_Guide_for_Containerized_Red_Hat_Gluster_Storage%20%28html-single%29/lastStableBuild/artifact/tmp/en-US/html-single/index.html#chap-Documentation-Deployment_Guide_for_Containerized_Red_Hat_Gluster_Storage-Setting_the_environment-Preparing_RHOE

Comment 33 Bhavana 2016-07-29 16:48:14 UTC
Hello Jeff,

Following is the updated link to the "Deployment Guide for Containerized Red Hat Gluster Storage" guide:

http://jenkinscat.gsslab.pnq.redhat.com:8080/job/doc-Red_Hat_Gluster_Storage-3.1-Deployment_Guide_for_Containerized_Red_Hat_Gluster_Storage%20%28html-single%29/lastStableBuild/artifact/tmp/en-US/html-single/index.html

Apart from the change of title suggestion in comment 31 (which will be addressed in a while), all the other comments are addressed in the documentation. You can use this document for your reference and let me know if you have any questions.

Thanks,
Bhavana

Comment 34 Anjana Suparna Sriram 2016-07-29 18:31:47 UTC
(In reply to khartsoe from comment #31)
> The team gave approval to the docs but the last 2 changes we need ASAP are
> the following:
> 
> CHANGE #1
> 
> In Section "4.1. Preparing the Red Hat OpenShift Enterprise Cluster"
> 
> Move all of Step 1:
> 
>  On each of the OpenShift nodes that will host the Red Hat Gluster Storage
> container, add the following rules to /etc/sysconfig/iptables in order to
> open the required ports:
> 
> -A OS_FIREWALL_ALLOW -p tcp -m state --state NEW -m tcp --dport 24007 -j
> ACCEPT
> -A OS_FIREWALL_ALLOW -p tcp -m state --state NEW -m tcp --dport 24008 -j
> ACCEPT
> -A OS_FIREWALL_ALLOW -p tcp -m state --state NEW -m tcp --dport 2222 -j
> ACCEPT
> -A OS_FIREWALL_ALLOW -p tcp -m state --state NEW -m multiport --dports
> 49152:49664 -j ACCEPT
> 
>     Execute the following command to reload the iptables:
> 
>     # systemctl reload iptables
> 
> 
> from "4.1. Preparing the Red Hat OpenShift Enterprise Cluster" to "3.2.3.
> Red Hat OpenShift Enterprise Requirements" as its own separate bullet after
> "The OpenShift cluster must be up and running." bullet but before the "The
> OpenShift router must be created and the DNS must be setup. For more
> information see, Appendix A, OpenShift Router Setup" bullet.
> 
> 
> 
> CHANGE #2
> 
> Update the title and subtitle to the following text:
> 
> Title: Deployment Guide for Containerized Red Hat Gluster Storage in
> OpenShift Enterprise
> Subtitle: Deploying Containerized Red Hat Gluster Storage in OpenShift
> Enterprise

Change #2 has been incorporated and here's the updated doc: http://jenkinscat.gsslab.pnq.redhat.com:8080/job/doc-Red_Hat_Gluster_Storage-3.1-Deployment_Guide_for_Containerized_Red_Hat_Gluster_Storage%20%28html-single%29/lastStableBuild/artifact/tmp/en-US/html-single/index.html

Comment 40 Jeff Vance 2016-08-03 16:34:29 UTC
(In reply to Bhavana from comment #33)
> Hello Jeff,
> 
> Following is the updated link to the "Deployment Guide for Containerized Red
> Hat Gluster Storage" guide:
> 
> http://jenkinscat.gsslab.pnq.redhat.com:8080/job/doc-Red_Hat_Gluster_Storage-
> 3.1-Deployment_Guide_for_Containerized_Red_Hat_Gluster_Storage%20%28html-
> single%29/lastStableBuild/artifact/tmp/en-US/html-single/index.html
> 
> Apart from the change of title suggestion in comment 31 (which will be
> addressed in a while), all the other comments are addressed in the
> documentation. You can use this document for your reference and let me know
> if you have any questions.
> 
> Thanks,
> Bhavana

Hello Bhavana,
The doc looks pretty good now. I have a couple of comments:
1) Section 3.2.3: second bullet are the itables rules which are not needed at this point in the doc since they are only needed once the reader is getting ready to run gluster. However, if you leave the iptables rules where they are then the last bullet in that section is wrong:

  "Ensure the nodes have the valid ports opened for communicating with Red Hat Gluster Storage. See the iptables configuration task in Step 1 of Section 4.1, “Preparing the Red Hat OpenShift Enterprise Cluster” for more information. "

The links takes you to "4.1. Preparing the Red Hat OpenShift Enterprise Cluster" which contains nothing about the gluster ports. I do not think you need this last bullet in section 3.2.3 since you have just mentioned the iptables rules a few bullets earlier in the same section.

2) section 4.1.3.b: "# oadm router storage-project-router --replicas=1". Is the router's name "storage-project-router" based on the project name? If yes then you might want do show this as you have in many other examples with the generic command first followed by a specific example:

Eg. # oadm router <router-name> --replicas=1
    For example:
    # oadm router storage-project-router --replicas=1

3) section 4.1.3.b: can you add a sentence on the purpose of the subdomain? Can the user make up any name they want? Is it related at all to LDAP setups?

4) section 4.4: formatting of beginning of sample json file is off:
{
    "clusters": [
               {
                  "nodes": [
                                {  #<---- indented too far to the right
                        "node": { ...
 
That is as far as I got in my testing...
Jeff

Comment 41 Neha 2016-08-03 17:41:11 UTC
There are some changes suggested in the comment #40. Based on that moving it back.

Comment 42 Anoop 2016-08-03 17:45:28 UTC
Jeff,

It will be good if you can change the state of the bug to "VERIFIED" once all the changes you want are incorporated in to the doc.

Comment 44 Jeff Vance 2016-08-03 19:22:09 UTC
(In reply to Anoop from comment #42)
> Jeff,
> 
> It will be good if you can change the state of the bug to "VERIFIED" once
> all the changes you want are incorporated in to the doc.

I will do that after reviewing the next iteration of the doc, thanks for the reminder.

Comment 45 Jeff Vance 2016-08-03 19:44:49 UTC
(In reply to Jeff Vance from comment #44)
> (In reply to Anoop from comment #42)
> > Jeff,
> > 
> > It will be good if you can change the state of the bug to "VERIFIED" once
> > all the changes you want are incorporated in to the doc.
> 
> I will do that after reviewing the next iteration of the doc, thanks for the
> reminder.

Just for the record, I do not consider any of my comments regarding the doc to be blockers.

Comment 46 Anoop 2016-08-04 02:39:05 UTC
Verified based on the discussions in the program meeting. All new changes will be taken up in the next release.


Note You need to log in before you can comment on or make changes to this bug.