Bugzilla will be upgraded to version 5.0. The upgrade date is tentatively scheduled for 2 December 2018, pending final testing and feedback.
Bug 1190636 - [hosted-engine] [iSCSI support] connectStoragePools fails with "SSLError: The read operation timed out" while adding a new host to the setup
[hosted-engine] [iSCSI support] connectStoragePools fails with "SSLError: The...
Status: CLOSED ERRATA
Product: Red Hat Enterprise Virtualization Manager
Classification: Red Hat
Component: ovirt-hosted-engine-setup (Show other bugs)
3.5.0
x86_64 Unspecified
high Severity urgent
: ---
: 3.5.1
Assigned To: Simone Tiraboschi
movciari
integration
: Reopened, ZStream
Depends On: 1169290 1173638 1190207
Blocks: 1193058 1197441
  Show dependency treegraph
 
Reported: 2015-02-09 05:22 EST by rhev-integ
Modified: 2015-04-28 14:46 EDT (History)
21 users (show)

See Also:
Fixed In Version: ovirt-hosted-engine-setup-1.2.2-3.el7
Doc Type: Bug Fix
Doc Text:
Previously, hosted engine used the vdsClient utility to communicate with VDSM, which meant that SSL would timeout on sync commands that would take more than 60 seconds to complete. Now, the vdscli library is used for storage operations, due to configurable timeout, and longer sync commands no longer fail due to SSL timeout.
Story Points: ---
Clone Of: 1169290
Environment:
Last Closed: 2015-04-28 14:46:37 EDT
Type: ---
Regression: ---
Mount Type: ---
Documentation: ---
CRM:
Verified Versions:
Category: ---
oVirt Team: ---
RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: ---
ylavi: Triaged+


Attachments (Terms of Use)
ovirt-hosted-engine-setup-20150312115314-ezn6al.log (271.35 KB, text/plain)
2015-03-12 07:00 EDT, Jiri Belka
no flags Details
vdsm.log (712.28 KB, text/plain)
2015-03-12 09:24 EDT, Jiri Belka
no flags Details


External Trackers
Tracker ID Priority Status Summary Last Updated
oVirt gerrit 38751 master MERGED vdscli: allow a connection with a configurable timeout Never
oVirt gerrit 38961 ovirt-hosted-engine-setup-1.2 MERGED packaging: setup: increasing vdscli SSL timeout Never
Red Hat Product Errata RHBA-2015:0910 normal SHIPPED_LIVE ovirt-hosted-engine-setup bug fix update 2015-04-28 18:49:43 EDT
Red Hat Product Errata RHSA-2015:0888 normal SHIPPED_LIVE Moderate: Red Hat Enterprise Virtualization Manager 3.5.1 update 2015-04-28 18:40:04 EDT

  None (edit)
Comment 1 Sandro Bonazzola 2015-02-20 06:07:55 EST
Automated message: can you please update doctext or set it as not required?
Comment 3 Jiri Belka 2015-03-12 07:00:54 EDT
Created attachment 1000930 [details]
ovirt-hosted-engine-setup-20150312115314-ezn6al.log

2015-03-12 11:57:26 DEBUG otopi.context context._executeMethod:152 method exception
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/otopi/context.py", line 142, in _executeMethod
    method['method']()
  File "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/ovirt-hosted-engine-setup/storage/storage.py", line 965, in _misc
    self._activateStorageDomain()
  File "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/ovirt-hosted-engine-setup/storage/storage.py", line 650, in _activateStorageDomain
    spUUID
  File "/usr/lib64/python2.7/xmlrpclib.py", line 1224, in __call__
    return self.__send(self.__name, args)
  File "/usr/lib64/python2.7/xmlrpclib.py", line 1578, in __request
    verbose=self.__verbose
  File "/usr/lib64/python2.7/xmlrpclib.py", line 1264, in request
    return self.single_request(host, handler, request_body, verbose)
  File "/usr/lib64/python2.7/xmlrpclib.py", line 1294, in single_request
    response = h.getresponse(buffering=True)
  File "/usr/lib64/python2.7/httplib.py", line 1045, in getresponse
    response.begin()
  File "/usr/lib64/python2.7/httplib.py", line 409, in begin
    version, status, reason = self._read_status()
  File "/usr/lib64/python2.7/httplib.py", line 365, in _read_status
    line = self.fp.readline(_MAXLINE + 1)
  File "/usr/lib64/python2.7/socket.py", line 476, in readline
    data = self._sock.recv(self._rbufsize)
  File "/usr/lib64/python2.7/ssl.py", line 241, in recv
    return self.read(buflen)
  File "/usr/lib64/python2.7/ssl.py", line 160, in read
    return self._sslobj.read(len)
SSLError: The read operation timed out
2015-03-12 11:57:26 ERROR otopi.context context._executeMethod:161 Failed to execute stage 'Misc configuration': The read operation timed out
2015-03-12 11:57:26 DEBUG otopi.transaction transaction.abort:131 aborting 'File transaction for '/etc/ovirt-hosted-engine/firewalld/hosted-console.xml''
2015-03-12 11:57:26 DEBUG otopi.transaction transaction.abort:131 aborting 'File transaction for '/etc/ovirt-hosted-engine/iptables.example''
2015-03-12 11:57:26 DEBUG otopi.transaction transaction.abort:131 aborting 'File transaction for '/etc/ovirt-hosted-engine-ha/broker.conf''
2015-03-12 11:57:26 DEBUG otopi.context context.dumpEnvironment:490 ENVIRONMENT DUMP - BEGIN
2015-03-12 11:57:26 DEBUG otopi.context context.dumpEnvironment:500 ENV BASE/error=bool:'True'
2015-03-12 11:57:26 DEBUG otopi.context context.dumpEnvironment:500 ENV BASE/exceptionInfo=list:'[(<class 'ssl.SSLError'>, SSLError('The read operation timed out',), <traceback object at 0x563b7e8>)]'
2015-03-12 11:57:26 DEBUG otopi.context context.dumpEnvironment:504 ENVIRONMENT DUMP - END
2015-03-12 11:57:26 INFO otopi.context context.runSequence:417 Stage: Clean up
2015-03-12 11:57:26 DEBUG otopi.context context.runSequence:421 STAGE cleanup
2015-03-12 11:57:26 DEBUG otopi.context context._executeMethod:138 Stage cleanup METHOD otopi.plugins.ovirt_hosted_engine_setup.core.remote_answerfile.Plugin._cleanup
[root@dell-r210ii-03 ovirt-hosted-engine-setup]# rpm -qa ovirt-hosted-engine-setup\*
ovirt-hosted-engine-setup-1.2.2-1.el7.noarch
Comment 4 Jiri Belka 2015-03-12 07:01:54 EDT
our env problem or related to this BZ?
Comment 5 Simone Tiraboschi 2015-03-12 08:30:21 EDT
No, the issue is still there and it's still the same:

2015-03-12 11:56:25 DEBUG otopi.plugins.ovirt_hosted_engine_setup.storage.storage storage._activateStorageDomain:645 activateStorageDomain
2015-03-12 11:57:26 DEBUG otopi.context context._executeMethod:152 method exception
Traceback (most recent call last):
  File "/usr/lib/python2.7/site-packages/otopi/context.py", line 142, in _executeMethod
    method['method']()
  File "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/ovirt-hosted-engine-setup/storage/storage.py", line 965, in _misc
    self._activateStorageDomain()
  File "/usr/share/ovirt-hosted-engine-setup/scripts/../plugins/ovirt-hosted-engine-setup/storage/storage.py", line 650, in _activateStorageDomain
    spUUID
  File "/usr/lib64/python2.7/xmlrpclib.py", line 1224, in __call__
    return self.__send(self.__name, args)
  File "/usr/lib64/python2.7/xmlrpclib.py", line 1578, in __request
    verbose=self.__verbose
  File "/usr/lib64/python2.7/xmlrpclib.py", line 1264, in request
    return self.single_request(host, handler, request_body, verbose)
  File "/usr/lib64/python2.7/xmlrpclib.py", line 1294, in single_request
    response = h.getresponse(buffering=True)
  File "/usr/lib64/python2.7/httplib.py", line 1045, in getresponse
    response.begin()
  File "/usr/lib64/python2.7/httplib.py", line 409, in begin
    version, status, reason = self._read_status()
  File "/usr/lib64/python2.7/httplib.py", line 365, in _read_status
    line = self.fp.readline(_MAXLINE + 1)
  File "/usr/lib64/python2.7/socket.py", line 476, in readline
    data = self._sock.recv(self._rbufsize)
  File "/usr/lib64/python2.7/ssl.py", line 241, in recv
    return self.read(buflen)
  File "/usr/lib64/python2.7/ssl.py", line 160, in read
    return self._sslobj.read(len)
SSLError: The read operation timed out

It sent activateStorageDomain command over vdscli at 11:56:25 and it failed at 2015-03-12 11:57:26, so 61 seconds after, for the 60 seconds SSL timeout as it was failing with vdsClient.
So moving from vdsClient to vdscli is not enough by itself so solve this.
We need to fix it within vdscli.
Comment 6 Simone Tiraboschi 2015-03-12 08:45:29 EDT
Could you please attach also VDSM logs?
Comment 7 Jiri Belka 2015-03-12 09:24:28 EDT
Created attachment 1000984 [details]
vdsm.log
Comment 10 errata-xmlrpc 2015-04-28 14:46:37 EDT
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://rhn.redhat.com/errata/RHSA-2015-0888.html

Note You need to log in before you can comment on or make changes to this bug.