Red Hat Satellite engineering is moving the tracking of its product development work on Satellite to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "Satellite project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs will be migrated starting at the end of May. If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "Satellite project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/SAT-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.
Bug 1430836 - Sync Plan tasks not showing updates in Tasks or sync status
Summary: Sync Plan tasks not showing updates in Tasks or sync status
Keywords:
Status: CLOSED ERRATA
Alias: None
Product: Red Hat Satellite
Classification: Red Hat
Component: Sync Plans
Version: 6.2.8
Hardware: Unspecified
OS: Unspecified
high
high
Target Milestone: 6.4.0
Assignee: Partha Aji
QA Contact: Peter Ondrejka
URL:
Whiteboard:
: 1393615 1452055 1579378 (view as bug list)
Depends On:
Blocks: 1724792 1546813
TreeView+ depends on / blocked
 
Reported: 2017-03-09 16:52 UTC by Dylan Gross
Modified: 2023-10-06 17:36 UTC (History)
37 users (show)

Fixed In Version: tfm-rubygem-katello-3.7.0.14-1
Doc Type: If docs needed, set a value
Doc Text:
Clone Of:
Environment:
Last Closed: 2018-10-16 19:21:28 UTC
Target Upstream Version:
Embargoed:


Attachments (Terms of Use)
python script to get a URL (139 bytes, text/plain)
2017-06-13 19:51 UTC, Michael Hrivnak
no flags Details


Links
System ID Private Priority Status Summary Last Updated
Foreman Issue Tracker 24083 0 Normal Closed Add an upgrade rake task for sync plans 2020-07-16 20:22:37 UTC
Pulp Redmine 3780 0 Normal CLOSED - CURRENTRELEASE As a user, I can specify a 'ca_path' for the HTTP Notifier to use 2018-09-18 18:32:25 UTC
Red Hat Knowledge Base (Solution) 3111611 0 None None None 2017-07-13 21:59:40 UTC

Description Dylan Gross 2017-03-09 16:52:36 UTC
Description of problem:

Since upgrading from 6.1 to 6.2, Sync plans have not been updating in the Satellite.


Version-Release number of selected component (if applicable):

   6.2.8


How reproducible:    Unknown


Actual results:

   Sync Plans actually execute based on logs and new content showing up, and are the sync plan is reflected in the mongodb.   
    However, the "Syncrhonize repoisitory" tasks don't show up in the foreman tasks, and the "Sync Status" page does not get updated to reflect the last sync.


Expected results:

    The foreman tasks should show up and the sync status page should be updated when a Repository sync happens via pulp.

Additional info:

    This affects not just sync plans created before upgrading to 6.2, but also newly created sync plans.

Comment 2 Michael Hrivnak 2017-03-12 16:38:15 UTC
Since the underlying Pulp tasks appear to be running fine, I'm switching the component over to one that Foreman devs monitor.

Comment 7 Brad Buckingham 2017-06-06 20:26:24 UTC
*** Bug 1452055 has been marked as a duplicate of this bug. ***

Comment 9 Harshad More 2017-06-08 10:45:58 UTC
In my case sync plan is working if run through API

Sat 6.2.2

# curl -u <satellite-admin-user>:<satellite-admin-user-password> -k -X PUT https://<satellite-fqdn>/katello/api/organizations/<org-id>/sync_plans/<sync-plan-id>/sync -H 'content-type: application/json'

e.g.

[root@satellite ~]# curl -u admin:admin-pass -k -X PUT https://mysatellite.com/katello/api/organizations/1/sync_plans/1/sync -H 'content-type: application/json'

To get the sync plan id, login to hammer shell and run the commands below

[root@satellite ~]# hammer shell
> organization list
> sync-plan list --organization-id <org-ID>
> exit

Comment 21 Michael Hrivnak 2017-06-13 19:51:31 UTC
Created attachment 1287441 [details]
python script to get a URL

This attached script will GET a URL using the same library as Pulp. It can be used to test if SSL trust is being established. Just change the value of the URL on line 5.

Comment 39 Mike McCune 2017-07-06 14:30:05 UTC
This bug has become a collection point for issues related to certificate errors and package misconfiguration issues (wrong python-requests version installed) that effect proper Sync Plan tasks from being handled properly. 

We are tracking a more appropriate bug https://bugzilla.redhat.com/show_bug.cgi?id=1466919 that will contain a fix for situations where synchronizations are interrupted during an outage and the tasks are not properly cleaned up. This bug is being moved out of active work by development but will be monitored if we determine if there are code changes necessary to prevent this issue.

Comment 40 Ilan Green 2017-07-09 05:16:38 UTC
(In reply to Mike McCune from comment #39)
> This bug has become a collection point for issues related to certificate
> errors and package misconfiguration issues (wrong python-requests version
> installed) that effect proper Sync Plan tasks from being handled properly. 
> 
> We are tracking a more appropriate bug
> https://bugzilla.redhat.com/show_bug.cgi?id=1466919 that will contain a fix
> for situations where synchronizations are interrupted during an outage and
> the tasks are not properly cleaned up. This bug is being moved out of active
> work by development but will be monitored if we determine if there are code
> changes necessary to prevent this issue.

At least for case 01681610, having in mind the long time taken to nail down the culprit (certificates)
Wouldn't it be possible to enhance Satelllite with
- An error message or other type of notification when an operation (or part of it) fails due to a certificate issue
- Some kind of a health check tool which will verify certificates validity

Comment 46 Brad Buckingham 2017-09-21 19:24:40 UTC
*** Bug 1393615 has been marked as a duplicate of this bug. ***

Comment 49 Michal Dekan 2018-02-17 15:21:31 UTC
I got the same issue on the internal satellite 

tls-ca-bundle.pem points to some custom cert, but I'm using Red Hat default self-signed certificates ....


# rct cat-cert /etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem

+-------------------------------------------+
	Identity Certificate
+-------------------------------------------+

Certificate:
	Path: /etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem
	Version: 1.0
	Serial: XXXXX
	Start Date: 2011-05-05 09:37:37+00:00
	End Date: 2030-12-31 09:37:37+00:00
	Alt Name: XXXX

Subject:
	C: ES
	CN: XXXX
	O: XXXX
	OU: XXX

Issuer:
	C: ES
	CN: XXX
	O: XXX
	OU: XXX

This fixed it:

# cp /etc/pki/katello/certs/katello-server-ca.crt /etc/pki/ca-trust/source/anchors/

# update-ca-trust
# katello-service restart


# rct cat-cert /etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem

+-------------------------------------------+
	Identity Certificate
+-------------------------------------------+

Certificate:
	Path: /etc/pki/ca-trust/extracted/pem/tls-ca-bundle.pem
	Version: 1.0
	Serial: 14773245178775375229
	Start Date: 2017-01-19 10:46:42+00:00
	End Date: 2038-01-18 10:46:42+00:00
	Alt Name: 

Subject:
	C: US
	CN: mdekan-rhel7-sat62.gsslab.brq.redhat.com
	L: Raleigh
	O: Katello
	OU: SomeOrgUnit
	ST: North Carolina

Issuer:
	C: US
	CN: mdekan-rhel7-sat62.gsslab.brq.redhat.com
	L: Raleigh
	O: Katello
	OU: SomeOrgUnit
	ST: North Carolina

No more post_sync request error when pulp is talking to katello after completed and successful repository sync:

Dec 23 12:00:01 mdekan-rhel7-sat62 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: Downloading additional units.
Dec 23 12:00:02 mdekan-rhel7-sat62 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com
Dec 23 12:00:04 mdekan-rhel7-sat62 pulp: requests.packages.urllib3.connectionpool:INFO: Starting new HTTPS connection (1): cdn.redhat.com
Dec 23 12:00:06 mdekan-rhel7-sat62 pulp: pulp_rpm.plugins.importers.yum.sync:INFO: Sync complete.

Got the same issue on my Satellite 6.1 installation, KCS updated.

Comment 55 Pablo Hess 2018-03-20 20:49:36 UTC
Faced this issue with a customer today, solution was in pip.

Root cause for the SSL failure: customer had installed the 'certifi' python package via pip.

As soon as we uninstalled 'certifi' the SSL failure was gone and sync plans started working perfectly again.

# pip uninstall certifi

Comment 59 pulp-infra@redhat.com 2018-06-22 00:17:54 UTC
The Pulp upstream bug status is at NEW. Updating the external tracker on this bug.

Comment 60 pulp-infra@redhat.com 2018-06-22 00:18:00 UTC
The Pulp upstream bug priority is at Normal. Updating the external tracker on this bug.

Comment 61 pulp-infra@redhat.com 2018-06-25 13:58:57 UTC
The Pulp upstream bug status is at ASSIGNED. Updating the external tracker on this bug.

Comment 62 pulp-infra@redhat.com 2018-06-25 23:56:17 UTC
The Pulp upstream bug status is at POST. Updating the external tracker on this bug.

Comment 65 pulp-infra@redhat.com 2018-06-26 20:01:37 UTC
The Pulp upstream bug status is at MODIFIED. Updating the external tracker on this bug.

Comment 66 pulp-infra@redhat.com 2018-06-26 20:11:25 UTC
All upstream Pulp bugs are at MODIFIED+. Moving this bug to POST.

Comment 67 Partha Aji 2018-06-26 21:07:23 UTC
Connecting redmine issue https://projects.theforeman.org/issues/24083 from this bug

Comment 68 Brad Buckingham 2018-07-24 16:22:58 UTC
*** Bug 1579378 has been marked as a duplicate of this bug. ***

Comment 70 Peter Ondrejka 2018-09-13 13:36:13 UTC
Verified on Sat 6.4 snap 21, scheduled sync is now correctly reflected on tasks and sync status page.

Comment 71 pulp-infra@redhat.com 2018-09-18 18:32:26 UTC
The Pulp upstream bug status is at CLOSED - CURRENTRELEASE. Updating the external tracker on this bug.

Comment 72 Bryan Kearney 2018-10-16 19:21:28 UTC
Since the problem described in this bug report should be
resolved in a recent advisory, it has been closed with a
resolution of ERRATA.

For information on the advisory, and where to find the updated
files, follow the link below.

If the solution does not work for you, open a new bug report.

https://access.redhat.com/errata/RHSA-2018:2927


Note You need to log in before you can comment on or make changes to this bug.