Bug 869347

Summary:	taskomatic fails during Errata import (ErrataMailer)
Product:	[Community] Spacewalk	Reporter:	JDavis4102
Component:	Server	Assignee:	Tomas Lestach <tlestach>
Status:	CLOSED INSUFFICIENT_DATA	QA Contact:	Red Hat Satellite QA List <satqe-list>
Severity:	high	Docs Contact:
Priority:	unspecified
Version:	1.8	CC:	JDavis4102, mmraka, tlestach
Target Milestone:	---
Target Release:	---
Hardware:	x86_64
OS:	Linux
Whiteboard:
Fixed In Version:		Doc Type:	Bug Fix
Doc Text:		Story Points:	---
Clone Of:		Environment:
Last Closed:	2019-09-16 09:55:59 UTC	Type:	Bug
Regression:	---	Mount Type:	---
Documentation:	---	CRM:
Verified Versions:		Category:	---
oVirt Team:	---	RHEL 7.3 requirements from Atomic Host:
Cloudforms Team:	---	Target Upstream Version:
Embargoed:

Description JDavis4102 2012-10-23 16:03:32 UTC

Description of problem: When importing Errata the taskomatic service fails and stops processing (with no error) during the erratamailer task.

Version-Release number of selected component (if applicable): 1.6 with PostgreSQL 9.1

How reproducible: Send a whole bunch of errata to Spacewalk. We have about 7000 machines and about 50 users in Spacewalk currently.

Actual results: Taskomatic fails without error and stops processing.

Expected results: Send email notifications and continue processing.

Additional info: We have disabled Errata-queue-bunch thinking this is the task that disables the errata mailer and it seems it was still generating email. Then we disabled the other errata tasks and found that for some reason the errata-cache-bunch is generating the emails. Without the errata-cache-bunch it seems that errata are of no use to us.

I did fine a bug report that may explain the issue but I am unable to see the bug. Below is what I found that I think is our issue.

Due to the ErrataMailer task being too slow, processing a large number of
errata may have caused a running ErrataMailer task to keep blocking next tasks
until all available resources were exhausted and the Taskomatic job scheduler
stopped working. When this happened, no tasks (including the repository
generation task) were executed. With this update, the underlying source code of
the ErrataMailer task has been rewritten so that it no longer prevents
Taskomatic from working. (BZ#711194)

If this bug has already been fixed in a later release is there anyway that we could patch 1.6 with the fix or do we need to upgrade Spacewalk in order to fix this issue?

Comment 1 JDavis4102 2012-11-19 20:39:58 UTC

Any updates as to this issue?

Comment 2 Jan Pazdziora 2013-03-08 15:27:18 UTC

(In reply to comment #0)

> I did fine a bug report that may explain the issue but I am unable to see
> the bug. Below is what I found that I think is our issue.
> 
> Due to the ErrataMailer task being too slow, processing a large number of
> errata may have caused a running ErrataMailer task to keep blocking next
> tasks
> until all available resources were exhausted and the Taskomatic job scheduler
> stopped working. When this happened, no tasks (including the repository
> generation task) were executed. With this update, the underlying source code
> of
> the ErrataMailer task has been rewritten so that it no longer prevents
> Taskomatic from working. (BZ#711194)
> 
> If this bug has already been fixed in a later release is there anyway that
> we could patch 1.6 with the fix or do we need to upgrade Spacewalk in order
> to fix this issue?

That bugzilla was fixed in Spacewalk 1.2 so if you see a problem in Spacewalk 1.6, it's a different issue.

Comment 3 Tomas Lestach 2013-03-08 15:34:33 UTC

I definitely wouldn't disable the taskomatic bunches you write about.
If you want to disable errata e-mail notifications, why don't you do it on the /rhn/account/UserPreferences.do page?

Comment 4 JDavis4102 2013-08-16 05:37:53 UTC

Sorry for the delay in reply. We have disabled the email notifications and that seems to have helped. Though it seems the Errata Cache runs all the time. In the Database I see a whole bunch of select distinct SQL queries regarding Errata. This increases load on the database server and slows down Spacewalk. This seems related to this issue as Errata processing is slowing the server down. We now have Spacewalk 1.8 installed and about 8400 servers using 21 different proxy servers. If you would like me to open a new ticket please let me know.

Comment 5 Tomas Lestach 2013-08-16 06:24:57 UTC

Just curious - what is the hardware you use for the server? I suppose you still use PostgreSQL as database backend. Does it run on a separate machine or on the same as Spacewalk?

Comment 6 JDavis4102 2013-08-26 17:26:06 UTC

The App server is a Dell PE R610 with 96G of RAM with Quad Core Xeon @ 1.87GHz.

Our PostgreSQL DB is on a separate machine that is a Dell PE R710 with 144G of RAM with a 2.27GHz Xeon.

Comment 8 Jan Pazdziora 2017-10-18 07:44:50 UTC

Is this still an active issue?

Comment 9 Michael Mráka 2019-09-16 09:55:59 UTC

This issue has been closed because it is missing requested data for a long time.
If you are still able to see it on your setup you are encouraged
to update the reproducer and reopen it.