Bug 1208615
| Summary: | Content view publish randomly fails with 404 on fetching task | ||||||
|---|---|---|---|---|---|---|---|
| Product: | Red Hat Satellite | Reporter: | Justin Sherrill <jsherril> | ||||
| Component: | Pulp | Assignee: | Partha Aji <paji> | ||||
| Status: | CLOSED CURRENTRELEASE | QA Contact: | Tazim Kolhar <tkolhar> | ||||
| Severity: | high | Docs Contact: | |||||
| Priority: | unspecified | ||||||
| Version: | 6.1.0 | CC: | bbuckingham, bmbouter, cwelton, daviddavis, dkliban, ehelms, ggainey, ipanova, jmatthew, jsherril, mhrivnak, mmccune, omaciel, paji, pcreech, rchan, tkolhar, tsanders, ttereshc | ||||
| Target Milestone: | Unspecified | Keywords: | Triaged | ||||
| Target Release: | Unused | ||||||
| Hardware: | Unspecified | ||||||
| OS: | Unspecified | ||||||
| Whiteboard: | |||||||
| Fixed In Version: | Doc Type: | Bug Fix | |||||
| Doc Text: | Story Points: | --- | |||||
| Clone Of: | Environment: | ||||||
| Last Closed: | 2015-08-12 13:55:30 UTC | Type: | Bug | ||||
| Regression: | --- | Mount Type: | --- | ||||
| Documentation: | --- | CRM: | |||||
| Verified Versions: | Category: | --- | |||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||
| Embargoed: | |||||||
| Bug Depends On: | |||||||
| Bug Blocks: | 1212602 | ||||||
| Attachments: |
|
||||||
|
Description
Justin Sherrill
2015-04-02 16:56:21 UTC
Ruby traceback showing the 404 comes from polling a task: - /opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/abstract_response.rb:48:in `return!' - /opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/base.rb:92:in `block in get_response' - /opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/request.rb:228:in `call' - /opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/request.rb:228:in `process_result' - /opt/rh/ruby193/root/usr/share/gems/gems/rbovirt-0.0.29/lib/restclient_ext/request.rb:50:in `block in transmit' - /opt/rh/ruby193/root/usr/share/ruby/net/http.rb:746:in `start' - /opt/rh/ruby193/root/usr/share/gems/gems/rbovirt-0.0.29/lib/restclient_ext/request.rb:44:in `transmit' - /opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/request.rb:64:in `execute' - /opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/request.rb:33:in `execute' - /opt/rh/ruby193/root/usr/share/gems/gems/rest-client-1.6.7/lib/restclient/resource.rb:51:in `get' - /opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/base.rb:91:in `get_response' - /opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/base.rb:82:in `call' - /opt/rh/ruby193/root/usr/share/gems/gems/runcible-1.3.0/lib/runcible/resources/task.rb:41:in `poll' Workaround: Go to the failed task under "Monitor > Tasks" and click 'resume' Moving to need_info, as this appears to be a pulp issue (possible race condition) And to note that RHCI can reproduce it pretty easily. Does this only happen for the unit association task? Or does it ever happen for other tasks? This is a mysterious problem. The code that creates the task record in the database saves it, and then reads it back from the DB, before returning anything. So the record should be available in mongo before the task ID is even returned to the client. https://github.com/pulp/pulp/blob/pulp-2.6.0-1/server/pulp/server/async/task_status_manager.py#L54 I'm not sure what to make of this. What you're seeing should theoretically be impossible, yet there it is. :) I am not sure if the needinfo is for someone in particular; however, when I have seen this issue it is typically on the task that is part of either a copy or remove (i.e. associate or unassociate) and it is most when the unit is for rpm or errata. For RHCI, I most frequently see the error during a 're-deploy' which means it can be publishing a new version of an existing content view and then promoting to an environment. The Pulp upstream bug status is at NEW. Updating the external tracker on this bug. The Pulp upstream bug priority is at High. Updating the external tracker on this bug. We have an upstream Katello issue that reflects this same issue (http://projects.theforeman.org/issues/10107). The user who reported seeing it in multiple scenarios tested this change (https://github.com/pulp/pulp/pull/1864) in their local environment and has reported no issues since applying that patch. The Pulp upstream bug status is at ASSIGNED. Updating the external tracker on this bug. Created attachment 1034314 [details]
patch for satellite 6.1
Hi, please provide verfication steps thanks There really isn't a simple set of verification steps because it would randomly occur. The only thing you can really do is attempt to publish a content view with lots of repositories full of content. The repositories there are the more likely to reproduce. Try publishing that content view a few times and if this issue does not occur I guess mark as verified. VERIFIED: rpm -qa | grep foreman ruby193-rubygem-foreman_discovery-2.0.0.15-1.el7sat.noarch foreman-libvirt-1.7.2.27-1.el7sat.noarch ruby193-rubygem-foreman_gutterball-0.0.1.9-1.el7sat.noarch ruby193-rubygem-foreman_docker-1.2.0.14-1.el7sat.noarch rubygem-hammer_cli_foreman_discovery-0.0.1.10-1.el7sat.noarch foreman-selinux-1.7.2.13-1.el7sat.noarch dell-pe1955-02.rhts.eng.bos.redhat.com-foreman-proxy-1.0-2.noarch foreman-compute-1.7.2.27-1.el7sat.noarch foreman-gce-1.7.2.27-1.el7sat.noarch ruby193-rubygem-foreman-redhat_access-0.2.0-8.el7sat.noarch rubygem-hammer_cli_foreman-0.1.4.14-1.el7sat.noarch foreman-debug-1.7.2.27-1.el7sat.noarch foreman-vmware-1.7.2.27-1.el7sat.noarch ruby193-rubygem-foreman-tasks-0.6.12.8-1.el7sat.noarch rubygem-hammer_cli_foreman_tasks-0.0.3.4-1.el7sat.noarch rubygem-hammer_cli_foreman_docker-0.0.3.7-1.el7sat.noarch foreman-proxy-1.7.2.5-1.el7sat.noarch dell-pe1955-02.rhts.eng.bos.redhat.com-foreman-client-1.0-1.noarch ruby193-rubygem-foreman_bootdisk-4.0.2.13-1.el7sat.noarch dell-pe1955-02.rhts.eng.bos.redhat.com-foreman-proxy-client-1.0-1.noarch foreman-ovirt-1.7.2.27-1.el7sat.noarch rubygem-hammer_cli_foreman_bootdisk-0.1.2.7-1.el7sat.noarch foreman-1.7.2.27-1.el7sat.noarch ruby193-rubygem-foreman_hooks-0.3.7-2.el7sat.noarch foreman-postgresql-1.7.2.27-1.el7sat.noarch steps: Try publishing that content view a few times No issues occur This bug is slated to be released with Satellite 6.1. This bug was fixed in version 6.1.1 of Satellite which was released on 12 August, 2015. The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug. The Pulp upstream bug status is at ON_QA. Updating the external tracker on this bug. Originally, Satellite received a custom patch to fix this issue, but the patch was not part of Pulp 2.6.x stream. Pulp 2.7.0 will contain a more generic fix that addresses this issue. The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug. |