Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1879423

Summary: Hosted engine restore from file fails if single sign on is used.
Product: Red Hat Enterprise Virtualization Manager Reporter: Siddhant Rao <sirao>
Component: ovirt-hosted-engine-setupAssignee: Sandro Bonazzola <sbonazzo>
Status: CLOSED DUPLICATE QA Contact: meital avital <mavital>
Severity: high Docs Contact:
Priority: unspecified    
Version: 2.3.0CC: lsurette
Target Milestone: ovirt-4.4.2   
Target Release: ---   
Hardware: x86_64   
OS: Linux   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2020-09-17 07:31:05 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: Integration RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description Siddhant Rao 2020-09-16 09:31:58 UTC
Description of problem:
When an environment is using Single sign on [1]

The engine backup will collect the /etc/httpd/conf.d/ovirt-sso.conf file.

While running with hosted-engine --deploy --restore-from-file, it fails while starting httpd during engine-setup

~~~
Deployment will fail with an error like this,

[...]

2020-09-16 04:11:01,575+0000 ERROR ansible failed {'status': 'FAILED', 'ansible_type': 'task', 'ansible_task': u'Run engine-setup with answerfile', 'ansible_result': u'type: <type \'dict\'>\nstr: {\'stderr_lines\': [], u\'changed\': True, u\'stdout\': u"[ INFO  ] Stage: Initializing\\n[ INFO  ] Stage: Environment setup\\n          Configuration files: [\'/etc/ovirt-engine-setup.conf.d/10-packaging-wsp.conf\', \'/etc/ovirt-engine-setup.conf.d/10-packaging.conf\', \'/etc/ovirt-engine-setup.conf.d/20-setup-', 'task_duration': 83, 'ansible_host': u'localhost', 'ansible_playbook': u'/usr/share/ovirt-hosted-engine-setup/ansible/trigger_role.yml'}


In the setup logs inside the HostedEngineLocal,

2020-09-16 04:11:00,196+0000 DEBUG otopi.plugins.otopi.services.systemd plugin.execute:926 execute-output: ('/usr/bin/systemctl', 'start', 'httpd.service') stderr:
Job for httpd.service failed because the control process exited with error code. See "systemctl status httpd.service" and "journalctl -xe" for details.

2020-09-16 04:11:00,197+0000 DEBUG otopi.context context._executeMethod:145 method exception
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/otopi/context.py", line 132, in _executeMethod
    method['method']()
  File "/usr/share/ovirt-engine/setup/bin/../plugins/ovirt-engine-common/ovirt-engine-common/system/apache.py", line 96, in _closeup
    state=state,
  File "/usr/share/otopi/plugins/otopi/services/systemd.py", line 181, in state
    service=name,
RuntimeError: Failed to start service 'httpd'
2020-09-16 04:11:00,200+0000 ERROR otopi.context context._executeMethod:154 Failed to execute stage 'Closing up': Failed to start service 'httpd'

and,

# systemctl status httpd -l
● httpd.service - The Apache HTTP Server
   Loaded: loaded (/usr/lib/systemd/system/httpd.service; enabled; vendor preset: disabled)
   Active: failed (Result: exit-code) since Wed 2020-09-16 04:11:00 UTC; 5h 5min ago
     Docs: man:httpd(8)
           man:apachectl(8)
  Process: 19018 ExecStart=/usr/sbin/httpd $OPTIONS -DFOREGROUND (code=exited, status=1/FAILURE)
 Main PID: 19018 (code=exited, status=1/FAILURE)

Sep 16 04:10:59 example-manager.test.example.com systemd[1]: Starting The Apache HTTP Server...
Sep 16 04:11:00 example-manager.test.example.com httpd[19018]: AH00526: Syntax error on line 14 of /etc/httpd/conf.d/ovirt-sso.conf:
Sep 16 04:11:00 example-manager.test.example.com httpd[19018]: Invalid command 'GssapiCredStore', perhaps misspelled or defined by a module not included in the server configuration
Sep 16 04:11:00 example-manager.test.example.com systemd[1]: httpd.service: main process exited, code=exited, status=1/FAILURE
Sep 16 04:11:00 example-manager.test.example.com systemd[1]: Failed to start The Apache HTTP Server.
Sep 16 04:11:00 example-manager.test.example.com systemd[1]: Unit httpd.service entered failed state.
Sep 16 04:11:00 example-manager.test.example.com systemd[1]: httpd.service failed.
~~~


I believe that some packages are missing in the Hosted Engine appliance. A customer reported that the packages missing are as follows,

mod_auth_gssapi
mod_session
apr-util-openssl (mod_session dependency)



[1]

https://access.redhat.com/documentation/en-us/red_hat_virtualization/4.3/html-single/administration_guide/index#Configuring_LDAP_and_Kerberos_for_Single_Sign-on

Version-Release number of selected component (if applicable):
rhvm-4.3.10.3-0.2.el7.noarch
vdsm-4.30.44-1.el7ev.x86_64
ovirt-ansible-hosted-engine-setup-1.0.32-1.el7ev.noarch
ovirt-hosted-engine-setup-2.3.13-1.el7ev.noarch


How reproducible:
Always

Steps to Reproduce:
1. Configure Single Sign on with RHV
2. Collect engine-backup
3. Run hosted-engine --deploy --restore-from-file using that engine-backup

Actual results:
Hosted engine deployment will fail during engine-setup while starting httpd

Expected results:
Hosted engine deployment should not fail.

Additional info:

Comment 1 Siddhant Rao 2020-09-16 09:34:30 UTC
While upgrading to RHV 4.4 as well, customer encounter this issue, since upgrading involves using hosted-engine --deploy --restore-from-file.
Therefore this is a blocker to upgrade to RHV 4.4

Comment 2 Sandro Bonazzola 2020-09-17 07:31:05 UTC
This seems to be a duplicate of bug #1867038. Closing accordingly.

*** This bug has been marked as a duplicate of bug 1867038 ***