Bug 2127180

Summary:	random failure of Inventory Sync
Product:	Red Hat Satellite	Reporter:	Gary Scarborough <gscarbor>
Component:	RH Cloud - Inventory	Assignee:	Shimon Shtein <sshtein>
Status:	CLOSED ERRATA	QA Contact:	Jameer Pathan <jpathan>
Severity:	high	Docs Contact:
Priority:	urgent
Version:	6.11.2	CC:	achadha, aganbat, ahumbe, aruzicka, bkielhol, dbomhof, jbhatia, jpathan, kwalsh, momran, ngupta, pcreech, pdwyer, peter.albrecht, peter.vreman, rcavalca, saydas, sshtein, vchepkov, wpinheir
Target Milestone:	6.13.0	Keywords:	PrioBumpGSS, Triaged
Target Release:	Unused
Hardware:	Unspecified
OS:	Unspecified
Whiteboard:
Fixed In Version:	rubygem-foreman_rh_cloud-6.0.44	Doc Type:	If docs needed, set a value
Doc Text:		Story Points:	---
Clone Of:
Clones:	2150112 (view as bug list)		Environment:
Last Closed:	2023-05-03 13:22:03 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description Gary Scarborough 2022-09-15 15:07:33 UTC

Description of problem:

Customer has new 6.11.2 satelliye that is seeing InventorySync::Async::InventoryScheduledSync fail on multiple occasions.  The failures seem to be at random.  Manual sync upload seems to work everytime.

When the InventorySync::Async::InventoryScheduledSync fails, here is the error:

 Error: RestClient::Unauthorized

401 Unauthorized

---
- "/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/abstract_response.rb:223:in
  `exception_with_response'"
- "/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/abstract_response.rb:103:in
  `return!'"
- "/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:809:in `process_result'"
- "/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:725:in `block
  in transmit'"
- "/usr/share/ruby/net/http.rb:933:in `start'"
- "/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:715:in `transmit'"
- "/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:145:in `execute'"
- "/usr/share/gems/gems/rest-client-2.0.2/lib/restclient/request.rb:52:in `execute'"
- "/usr/share/gems/gems/foreman_rh_cloud-5.0.41/app/services/foreman_rh_cloud/cloud_request.rb:11:in
  `execute_cloud_request'"
... 
...
...


Task export for the life of the server is attached. 

Sosreport in case.

Comment 2 Gary Scarborough 2022-09-15 15:21:35 UTC

Task export added.  Hopefully you can correlate the timestamps of the failures with events on the back end.

Comment 11 Ashish Humbe 2022-10-20 15:55:25 UTC

*** Bug 2128115 has been marked as a duplicate of this bug. ***

Comment 16 Ashish Humbe 2022-11-22 08:53:37 UTC

*** Bug 2126319 has been marked as a duplicate of this bug. ***

Comment 20 Jameer Pathan 2023-01-16 15:09:51 UTC

Verified:

Verified with:
- Satellite 6.13.0 snap 5
- rubygem-foreman_rh_cloud-6.0.44-1.el8sat.noarch

Test steps:
- Register satellite content hosts with insights.
- Check 'Wait and Inventory scheduled sync' on dynflow.

Observations:
- Random delay was added to the task.

Comment 21 Shimon Shtein 2023-01-25 17:58:53 UTC

*** Bug 2018879 has been marked as a duplicate of this bug. ***

Comment 25 errata-xmlrpc 2023-05-03 13:22:03 UTC

Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory (Important: Satellite 6.13 Release), and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2023:2097

Comment 26 Shimon Shtein 2023-07-09 11:30:10 UTC

*** Bug 2104673 has been marked as a duplicate of this bug. ***