Bug 1172556

Summary: Rest Timeout with publishing Content view
Product: Red Hat Satellite Reporter: Peter Vreman <peter.vreman>
Component: Content ViewsAssignee: David Davis <daviddavis>
Status: CLOSED DUPLICATE QA Contact: Jameer Pathan <jpathan>
Severity: high Docs Contact:
Priority: unspecified    
Version: 6.0.6CC: bbuckingham, bkearney, cwelton, ggatward, jason.berry, jberry86, peter.vreman, sauchter, sebastian.huber
Target Milestone: UnspecifiedKeywords: Triaged
Target Release: Unused   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2016-03-07 09:50:17 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Bug Depends On:    
Bug Blocks: 1122832    
Attachments:
Description Flags
stopped task details
none
Sat6.1.0Beta publish timeout none

Description Peter Vreman 2014-12-10 11:12:00 UTC
Created attachment 966743 [details]
stopped task details

Description of problem:
Rest Timeout with publishing Content view.

Exception:

RestClient::RequestTimeout: Request Timeout

Backtrace:

/opt/rh/ruby193/root/usr/share/gems/gems/rbovirt-0.0.29/lib/restclient_ext/request.rb:56:in `rescue in transmit'
/opt/rh/ruby193/root/usr/share/gems/gems/rbovirt-0.0.29/lib/restclient_ext/request.rb:11:in `transmit'
/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/request.rb:64:in `execute'
/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/request.rb:33:in `execute'
/opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/resource.rb:67:in `post'
/opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.1.0/lib/runcible/base.rb:96:in `get_response'
/opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.1.0/lib/runcible/base.rb:87:in `call'
/opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.1.0/lib/runcible/resources/repository.rb:140:in `unit_copy'
/opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.1.0/lib/runcible/extensions/unit.rb:139:in `copy'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-1.5.0/app/lib/actions/pulp/repository/abstract_copy_content.rb:30:in `invoke_external_task'
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action/polling.rb:70:in `initiate_external_action'
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action/polling.rb:12:in `run'
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.3/lib/dynflow/action/cancellable.rb:9:in `run'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-1.5.0/app/lib/actions/pulp/abstract_async_task.rb:57:in `run'


Version-Release number of selected component (if applicable):


How reproducible:
VM has 4 CPU, 16GB RAM

Content View RPM contents:

# hammer -c /opt/hoici/etc/hammer-hoici.yaml content-view info --organization-id=4 --id=3
ID:                 3
Name:               HOI-6.5.0-ci
Label:              HOI-6_5_0-ci
Composite:
Description:
Content Host Count:
Organization:       Hilti
Repositories:
 1) ID:    705
    Name:  HOICI-1.0.0-ci
    Label: HOICI-1_0_0-ci
 2) ID:    732
    Name:  HOIOS-6.5.0-ci
    Label: HOIOS-6_5_0-ci
 3) ID:    721
    Name:  HOIPRODUCTS-1.0.0-ci
    Label: HOIPRODUCTS-1_0_0-ci
 4) ID:    3
    Name:  Red Hat Enterprise Linux 6 Server - Extended Update Support - Optional RPMs x86_64 6.5
    Label: Red_Hat_Enterprise_Linux_6_Server_-_Extended_Update_Support_-_Optional_RPMs_x86_64_6_5
 5) ID:    6
    Name:  Red Hat Enterprise Linux 6 Server - Extended Update Support - Oracle Java RPMs x86_64 6.5
    Label: Red_Hat_Enterprise_Linux_6_Server_-_Extended_Update_Support_-_Oracle_Java_RPMs_x86_64_6_5
 6) ID:    2
    Name:  Red Hat Enterprise Linux 6 Server - Extended Update Support RPMs x86_64 6.5
    Label: Red_Hat_Enterprise_Linux_6_Server_-_Extended_Update_Support_RPMs_x86_64_6_5
 7) ID:    1
    Name:  Red Hat Enterprise Linux 6 Server Kickstart x86_64 6.5
    Label: Red_Hat_Enterprise_Linux_6_Server_Kickstart_x86_64_6_5
 8) ID:    14
    Name:  Red Hat Enterprise Linux 6 Server - RH Common RPMs x86_64 6.5
    Label: Red_Hat_Enterprise_Linux_6_Server_-_RH_Common_RPMs_x86_64_6_5
 9) ID:    5
    Name:  Red Hat Software Collections RPMs for Red Hat Enterprise Linux 6 RHEL 6 Server EUS x86_64 6.5
    Label: Red_Hat_Software_Collections_RPMs_for_Red_Hat_Enterprise_Linux_6_RHEL_6_Server_EUS_x86_64_6_5
Puppet modules
...

# hammer -c /opt/hoici/etc/hammer-hoici.yaml content-view filter list --organization-id=4 --content-view-id=3
----------|------------------------------------|---------|----------
FILTER ID | NAME                               | TYPE    | INCLUSION
----------|------------------------------------|---------|----------
15        | HOI-6.5.0-ci Freeze Date           | erratum | true
17        | HOI-6.5.0-ci Original Packages     | rpm     | true
16        | HOI-6.5.0-ci Post Freeze Additions | erratum | true
----------|------------------------------------|---------|----------
# hammer -c /opt/hoici/etc/hammer-hoici.yaml content-view filter info --organization-id=4 --content-view-id=3 --id=15
Filter ID:    15
Name:         HOI-6.5.0-ci Freeze Date
Type:         erratum
Inclusion:    true
Repositories:

Rules:
 1) ID:         10
    Start Date: 2000-01-01
    End Date:   2014-12-10
    Types:      enhancement, bugfix, security
    Created:    2014/11/06 14:44:30
    Updated:    2014/12/10 09:09:14

# hammer -c /opt/hoici/etc/hammer-hoici.yaml content-view filter info --organization-id=4 --content-view-id=3 --id=16
Filter ID:    16
Name:         HOI-6.5.0-ci Post Freeze Additions
Type:         erratum
Inclusion:    true
Repositories:

Rules:

# hammer -c /opt/hoici/etc/hammer-hoici.yaml content-view filter info --organization-id=4 --content-view-id=3 --id=17
Filter ID:    17
Name:         HOI-6.5.0-ci Original Packages
Type:         rpm
Inclusion:    true
Repositories:

Rules:



Steps to Reproduce:
1. Create content view with the above rules
2. Publish content view
3.

Actual results:


Expected results:


Additional info:

Comment 1 RHEL Program Management 2014-12-10 11:24:14 UTC
Since this issue was entered in Red Hat Bugzilla, the release flag has been
set to ? to ensure that it is properly evaluated for this release.

Comment 3 Bryan Kearney 2015-07-14 17:44:18 UTC
We are not seeing timeouts in our testing. We have some customers who have increased the timeout to work around this issue. We are moving this to 6.2. If you continue to see this on 6.1, please add the comments here and we will address it. Or, raise directly to me.

Comment 4 Peter Vreman 2015-07-23 14:09:24 UTC
Created attachment 1055392 [details]
Sat6.1.0Beta publish timeout

I had also with Sat6.1.0Beta a publish timeout.
Somehow i tries to do something with 60.000 RPMs. But the product repository has only 72 RPMs:

# hammer -c /opt/hoici/etc/sat6/hammer-hoici.yaml repository info --id=70
ID:                 70
Name:               HOICI-1.1.0-ci
Label:              HOICI-1_1_0-ci
Organization:       Hilti
Red Hat Repository: no
Content Type:       yum
Checksum Type:      sha256
URL:                http://li-lc-1016.hag.hilti.com/hoici/release/HOICI-1.1.0-ci/rpm
Publish Via HTTP:   yes
Published At:       http://li-lc-1578.hag.hilti.com/pulp/repos/Hilti/Library/custom/HOICI/HOICI-1_1_0-ci
Product:
    ID:   38
    Name: HOICI
GPG Key:

Sync:
    Status:
    Last Sync Date: 2015/07/22 14:52:09
Created:            2015/07/17 19:22:02
Updated:            2015/07/17 19:22:42
Content Counts:
    Packages: 72
    Errata:   0

Comment 5 Jason Berry 2015-10-26 15:44:39 UTC
Hitting the same issue with 6.1.1 on larger CV's, especially Composite Views.  When it times out, I immediately go to the Monitor -> Tasks tab, and it shows it planning/pending.

Comment 6 Sebastian Huber 2015-11-02 10:02:06 UTC
Facing the same issue with 6.1.3
Resuming the task by hand usually does make it finishing.

Comment 11 Peter Vreman 2015-12-30 08:48:58 UTC
The workaround mentioned in https://bugzilla.redhat.com/show_bug.cgi?id=1275183#c2 works:

If you're getting "Request Timeout" in the sub-tasks then the work around is as follows"
- Edit /etc/foreman/plugins/katello.yaml and set rest_client_timeout: 3600 (default is 120)
- katello-service restart

Note that is is not upgrade safe. After upgrading Satellite 6.1.x you  have to apply the workaround again

Comment 12 Peter Vreman 2016-03-07 09:50:17 UTC

*** This bug has been marked as a duplicate of bug 1275183 ***