Bug 1480091

Summary: Seeing option "not recognized" warnings when brick graph gets loaded
Product: [Red Hat Storage] Red Hat Gluster Storage Reporter: Nag Pavan Chilakam <nchilaka>
Component: coreAssignee: Mohit Agrawal <moagrawa>
Status: CLOSED ERRATA QA Contact: Nag Pavan Chilakam <nchilaka>
Severity: medium Docs Contact:
Priority: low    
Version: rhgs-3.3CC: amukherj, rhs-bugs, sheggodu, storage-qa-internal
Target Milestone: ---Keywords: EasyFix, Rebase
Target Release: RHGS 3.5.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: glusterfs-6.0-1 Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2019-10-30 12:19:37 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1696807    
Attachments:
Description Flags
onqa validation brick log none

Description Nag Pavan Chilakam 2017-08-10 06:52:26 UTC 
Description of problem:
=====================
When we make changes to change graph, like addbrick, or even on a new volume create, we can see in brick log that some of the options being loaded.
However , we can see that warnings are thrown with "option not recognized".


See in below case,  all tiering options from graph throw these warnings. While i assume that is still fine, because we now disable ctr by default and hence the options/params pertaining to tiering are of no meaning, hence these warnings are being thrown.

However , if we see below options from server xlator part:
148: volume shark-server
149:     type protocol/server
150:     option transport.socket.listen-port 49155
151:     option rpc-auth.auth-glusterfs on
152:     option rpc-auth.auth-unix on
153:     option rpc-auth.auth-null on
154:     option rpc-auth-allow-insecure on
155:     option transport-type tcp
156:     option transport.address-family inet
157:     option auth.login./rhs/brick3/shark.allow 98c4c757-a13b-436e-8e5f-7263f1f6d645
158:     option auth.login.98c4c757-a13b-436e-8e5f-7263f1f6d645.password ae8f4e08-e3f1-4ccb-864a-cc2a554f1e69
159:     option auth-path /rhs/brick3/shark
160:     option auth.addr./rhs/brick3/shark.allow *
161:     option transport.listen-backlog 10
162:     subvolumes /rhs/brick3/shark
163: end-volume


Even though we are enabling rpc-* options, still they are being thrown as "not recongnized"

Also,if i try to get these options from volume get <vname> all, I don't see these options

[2017-08-10 06:27:43.325934] I [MSGID: 101190] [event-epoll.c:602:event_dispatch_epoll_worker] 0-epoll: Started thread with index 1
[2017-08-10 06:27:43.381720] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-shark-server: adding option 'listen-port' for volume 'shark-server' with value '49155'
[2017-08-10 06:27:43.381768] I [MSGID: 101173] [graph.c:269:gf_add_cmdline_options] 0-shark-posix: adding option 'glusterd-uuid' for volume 'shark-posix' with value '67a6d2cc-b952-463b-874d-57b66c19ae42'
[2017-08-10 06:27:43.381968] I [MSGID: 115034] [server.c:409:_check_for_auth_option] 0-/rhs/brick3/shark: skip format check for non-addr auth option auth.login./rhs/brick3/shark.allow
[2017-08-10 06:27:43.381987] I [MSGID: 115034] [server.c:409:_check_for_auth_option] 0-/rhs/brick3/shark: skip format check for non-addr auth option auth.login.98c4c757-a13b-436e-8e5f-7263f1f6d645.password
[2017-08-10 06:27:43.383276] I [rpcsvc.c:2222:rpcsvc_set_outstanding_rpc_limit] 0-rpc-service: Configured rpc.outstanding-rpc-limit with value 64
[2017-08-10 06:27:43.383345] W [MSGID: 101002] [options.c:945:xl_opt_validate] 0-shark-server: option 'listen-port' is deprecated, preferred is 'transport.socket.listen-port', continuing with correction
[2017-08-10 06:27:43.383704] W [socket.c:3911:reconfigure] 0-shark-quota: disabling non-blocking IO
[2017-08-10 06:27:43.436586] I [MSGID: 121050] [ctr-helper.c:259:extract_ctr_options] 0-gfdbdatastore: CTR Xlator is disabled.
[2017-08-10 06:27:43.436611] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-shark-changetimerecorder: Failed to retrieve sql-db-pagesize from params.Assigning default value: 4096
[2017-08-10 06:27:43.436621] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-shark-changetimerecorder: Failed to retrieve sql-db-journalmode from params.Assigning default value: wal
[2017-08-10 06:27:43.436630] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-shark-changetimerecorder: Failed to retrieve sql-db-sync from params.Assigning default value: off
[2017-08-10 06:27:43.436637] W [MSGID: 101105] [gfdb_sqlite3.h:234:gfdb_set_sql_params] 0-shark-changetimerecorder: Failed to retrieve sql-db-autovacuum from params.Assigning default value: none
[2017-08-10 06:27:43.483307] I [trash.c:2414:init] 0-shark-trash: no option specified for 'eliminate', using NULL
[2017-08-10 06:27:43.514603] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-shark-server: option 'rpc-auth.auth-glusterfs' is not recognized
[2017-08-10 06:27:43.514651] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-shark-server: option 'rpc-auth.auth-unix' is not recognized
[2017-08-10 06:27:43.514698] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-shark-server: option 'rpc-auth.auth-null' is not recognized
[2017-08-10 06:27:43.514756] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-shark-server: option 'auth-path' is not recognized
[2017-08-10 06:27:43.514771] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-/rhs/brick3/shark: option 'auth.addr./rhs/brick3/shark.allow' is not recognized
[2017-08-10 06:27:43.514779] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-/rhs/brick3/shark: option 'auth-path' is not recognized
[2017-08-10 06:27:43.514786] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-/rhs/brick3/shark: option 'auth.login.98c4c757-a13b-436e-8e5f-7263f1f6d645.password' is not recognized
[2017-08-10 06:27:43.514793] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-/rhs/brick3/shark: option 'auth.login./rhs/brick3/shark.allow' is not recognized
[2017-08-10 06:27:43.514849] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-shark-quota: option 'timeout' is not recognized
[2017-08-10 06:27:43.514896] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-shark-trash: option 'brick-path' is not recognized





Graph as below:
[2017-08-10 06:27:43.514896] W [MSGID: 101174] [graph.c:360:_log_if_unknown_option] 0-shark-trash: option 'brick-path' is not recognized
Final graph:
+------------------------------------------------------------------------------+
  1: volume shark-posix
  2:     type storage/posix
  3:     option glusterd-uuid 67a6d2cc-b952-463b-874d-57b66c19ae42
  4:     option directory /rhs/brick3/shark
  5:     option volume-id 8fc0b487-cf26-44df-a2dc-6b96aaa337fe
  6:     option update-link-count-parent on
  7: end-volume
  8:  
  9: volume shark-trash
 10:     type features/trash
 11:     option trash-dir .trashcan
 12:     option brick-path /rhs/brick3/shark
 13:     option trash-internal-op off
 14:     subvolumes shark-posix
 15: end-volume
 16:  
 17: volume shark-changetimerecorder
 18:     type features/changetimerecorder
 19:     option db-type sqlite3
 20:     option hot-brick off
 21:     option db-name shark.db
 22:     option db-path /rhs/brick3/shark/.glusterfs/
 23:     option record-exit off
 24:     option ctr_link_consistency off
 25:     option ctr_lookupheal_link_timeout 300
 26:     option ctr_lookupheal_inode_timeout 300
 27:     option record-entry on
 28:     option ctr-enabled off
 29:     option record-counters off
 30:     option ctr-record-metadata-heat off
 31:     option sql-db-cachesize 12500
 32:     option sql-db-wal-autocheckpoint 25000
 33:     subvolumes shark-trash
 34: end-volume
 35:  
 36: volume shark-changelog
 37:     type features/changelog
 38:     option changelog-brick /rhs/brick3/shark
 39:     option changelog-dir /rhs/brick3/shark/.glusterfs/changelogs
 40:     option changelog-barrier-timeout 120
 41:     subvolumes shark-changetimerecorder
 42: end-volume
 43:  
 44: volume shark-bitrot-stub
 45:     type features/bitrot-stub
 46:     option export /rhs/brick3/shark
 47:     option bitrot disable
 48:     subvolumes shark-changelog
 49: end-volume
 50:  
 51: volume shark-access-control
 52:     type features/access-control
 53:     subvolumes shark-bitrot-stub
 54: end-volume
 55:  
 56: volume shark-locks
 57:     type features/locks
 58:     subvolumes shark-access-control
 59: end-volume
 60:  
 61: volume shark-worm
 62:     type features/worm
 63:     option worm off
 64:     option worm-file-level off
 65:     subvolumes shark-locks
 66: end-volume
 67:  
 68: volume shark-read-only
 69:     type features/read-only
 70:     option read-only off
 71:     subvolumes shark-worm
 72: end-volume
 73:  
 74: volume shark-leases
 75:     type features/leases
 76:     option leases off
 77:     subvolumes shark-read-only
 78: end-volume
 79:  
 80: volume shark-upcall
 81:     type features/upcall
 82:     option cache-invalidation off
 83:     subvolumes shark-leases
 84: end-volume
 85:  
 86: volume shark-io-threads
 87:     type performance/io-threads
 88:     subvolumes shark-upcall
 89: end-volume
 90:  
 91: volume shark-marker
 92:     type features/marker
 93:     option volume-uuid 8fc0b487-cf26-44df-a2dc-6b96aaa337fe
 94:     option timestamp-file /var/lib/glusterd/vols/shark/marker.tstamp
 95:     option quota-version 1
 96:     option xtime off
 97:     option gsync-force-xtime off
 98:     option quota on
 99:     option inode-quota on
100:     subvolumes shark-io-threads
101: end-volume
102:  
103: volume shark-barrier
104:     type features/barrier
105:     option barrier disable
106:     option barrier-timeout 120
107:     subvolumes shark-marker
108: end-volume
109:  
110: volume shark-index
111:     type features/index
112:     option index-base /rhs/brick3/shark/.glusterfs/indices
113:     option xattrop-dirty-watchlist trusted.afr.dirty
114:     option xattrop-pending-watchlist trusted.afr.shark-
115:     subvolumes shark-barrier
116: end-volume
117:  
118: volume shark-quota
119:     type features/quota
120:     option transport.socket.connect-path /var/run/gluster/quotad.socket
121:     option transport-type socket
122:     option transport.address-family unix
123:     option volume-uuid shark
124:     option server-quota on
125:     option timeout 0
126:     option deem-statfs on
127:     subvolumes shark-index
128: end-volume
129:  
130: volume shark-io-stats
131:     type debug/io-stats
132:     option unique-id /rhs/brick3/shark
133:     option log-level INFO
134:     option latency-measurement off
135:     option count-fop-hits off
136:     subvolumes shark-quota
137: end-volume
138:  
139: volume /rhs/brick3/shark
140:     type performance/decompounder
141:     option auth.addr./rhs/brick3/shark.allow *
142:     option auth-path /rhs/brick3/shark
143:     option auth.login.98c4c757-a13b-436e-8e5f-7263f1f6d645.password ae8f4e08-e3f1-4ccb-864a-cc2a554f1e69
144:     option auth.login./rhs/brick3/shark.allow 98c4c757-a13b-436e-8e5f-7263f1f6d645
145:     subvolumes shark-io-stats
146: end-volume
147:  
148: volume shark-server
149:     type protocol/server
150:     option transport.socket.listen-port 49155
151:     option rpc-auth.auth-glusterfs on
152:     option rpc-auth.auth-unix on
153:     option rpc-auth.auth-null on
154:     option rpc-auth-allow-insecure on
155:     option transport-type tcp
156:     option transport.address-family inet
157:     option auth.login./rhs/brick3/shark.allow 98c4c757-a13b-436e-8e5f-7263f1f6d645
158:     option auth.login.98c4c757-a13b-436e-8e5f-7263f1f6d645.password ae8f4e08-e3f1-4ccb-864a-cc2a554f1e69
159:     option auth-path /rhs/brick3/shark
160:     option auth.addr./rhs/brick3/shark.allow *
161:     option transport.listen-backlog 10
162:     subvolumes /rhs/brick3/shark
163: end-volume
164:  



Volume get all:
[root@dhcp37-158 ~]# gluster  v get shark all|grep rpc-auth.auth-glusterfs
[root@dhcp37-158 ~]# gluster  v get shark all|grep "rpc-auth.auth-null"
[root@dhcp37-158 ~]# gluster  v get shark all|grep "rpc-auth-allow-insecure"
[root@dhcp37-158 ~]# gluster v get shark all|grep "optimi"
cluster.lookup-optimize                 off                                     
cluster.readdir-optimize                off                                     
disperse.optimistic-change-log          on                                      
[root@dhcp37-158 ~]# gluster v get all^C
[root@dhcp37-158 ~]# gluster v get shark all|grep "transport.address-family"
transport.address-family                inet                                    
[root@dhcp37-158 ~]# gluster v get shark all|grep "rpc-auth-allow-insecure"
[root@dhcp37-158 ~]# gluster v get shark all|grep "transport.listen-backlog"
transport.listen-backlog                10                                      
[root@dhcp37-158 ~]# 


Version-Release number of selected component (if applicable):
============
3.8.4-39

How reproducible:
===========
always




Expected:
We should not be seeing these warnings, unless there is a strong purpose.
Comment 3 Amar Tumballi 2018-04-02 08:04:17 UTC 
Please check this patch: Will be provided in RHGS-4.0 version: https://review.gluster.org/#/c/19519/
Comment 5 Amar Tumballi 2019-03-26 12:39:28 UTC 
https://review.gluster.org/#/c/glusterfs/+/22053/
Comment 8 Nag Pavan Chilakam 2019-06-03 12:20:24 UTC 
Created attachment 1576616 [details]
onqa validation brick log
Comment 14 errata-xmlrpc 2019-10-30 12:19:37 UTC 
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHEA-2019:3249