Created attachment 756659 [details]
logs

Description of problem:

I ran some tests on LSM and had some tasks in async table that were not properly cleared. 
when I tried to upgrade my setup the installer detects the tasks and fails to clear them (so upgrade cannot be continued without GSS involvement. 

However, when I ran the taskcleaner manually (not with upgrade script) I was able to clear the tasks. 

Version-Release number of selected component (if applicable):

sf17.2 -> 17.4

How reproducible:

100%

Steps to Reproduce:
1. in sf17.2 run a vm as paused and start a LSM on the vm 
2. we will fail to clear the task with ArrayOutOfBound -1 error.
3. try to upgrade to sf17.4
4. after engine fails to clear the tasks, run taskcleaner manually and try to upgrade again

Actual results:

upgrade detects the tasks but fails to clear them
taskcleaner ran manually was able to clear teh tasks and I was able to upgrade the setup. 

Expected results:

we should be able to clear the tasks during upgrade. 

Additional info:


Info: The following tasks have been found running in the system: 

System Tasks:

---- Task ID: b230ab47-21d8-487f-a190-6a1278a58b52 ------- 
Task Name: LiveMigrateDisk               
Task Description: Migrating Live Disk           
Started at: 2013-06-03 15:51:29.047+03    
DC Name: iSCSI                         


---- Task ID: 01b8016a-706c-4681-91bc-91b98bd38ee4 ------- 
Task Name: LiveMigrateDisk               
Task Description: Migrating Live Disk           
Started at: 2013-06-02 14:48:13.137+03    
DC Name: iSCSI                         




[ Jun 04 11:29:52 ] Would you like to proceed and try to stop tasks automatically?
(Answering 'no' will stop the upgrade)? (yes|no): n
Starting DB related services...                      [ DONE ]
Starting ovirt-engine service...                     [ DONE ]

There are still running tasks: 

System Tasks:

---- Task ID: b230ab47-21d8-487f-a190-6a1278a58b52 ------- 
Task Name: LiveMigrateDisk               
Task Description: Migrating Live Disk           
Started at: 2013-06-03 15:51:29.047+03    
DC Name: iSCSI                         


---- Task ID: 01b8016a-706c-4681-91bc-91b98bd38ee4 ------- 
Task Name: LiveMigrateDisk               
Task Description: Migrating Live Disk           
Started at: 2013-06-02 14:48:13.137+03    
DC Name: iSCSI                         



Please make sure that there are no running system tasks before you continue. Stopping upgrade.
Starting ovirt-engine service...                     [ DONE ]
Error: Upgrade failed.
please check log at /var/log/ovirt-engine/ovirt-engine-upgrade_2013_06_04_11_26_05.log
[root@Dafna-32 tmp]# 


ngine=# SELECT * from async_tasks;
               task_id                | action_type | status | result |                               action_parameters                               |                      action_params_class                      |               step_i
d                |              command_id              |         started_at         |           storage_pool_id            | task_type |                                task_parameters                                |                   
    task_params_class                       
--------------------------------------+-------------+--------+--------+-------------------------------------------------------------------------------+---------------------------------------------------------------+---------------------
-----------------+--------------------------------------+----------------------------+--------------------------------------+-----------+-------------------------------------------------------------------------------+-------------------
--------------------------------------------
 b230ab47-21d8-487f-a190-6a1278a58b52 |        1010 |      2 |      0 | {                                                                             | org.ovirt.engine.core.common.action.LiveMigrateDiskParameters | 149a6f40-e139-4ff4-b
b6e-eea172e1cba5 | 1f960ca6-9f89-4e14-952b-e20466ec37e9 | 2013-06-03 15:51:29.047+03 | 7fd33b43-a9f4-4eb7-a885-e9583a929ceb |         8 | {                                                                             | org.ovirt.engine.c
ore.common.action.LiveMigrateDiskParameters
                                                                      :   "@class" : "org.ovirt.engine.core.common.action.LiveMigrateDiskParameters",                                                                                       
                                                                                                                                        :   "@class" : "org.ovirt.engine.core.common.action.LiveMigrateDiskParameters",   
                                                                      :   "commandId" : [ "org.ovirt.engine.core.compat.Guid", {                                




[root@Dafna-32 dbutils]# ./taskcleaner.sh -s localhost -p 5432 -d engine -u engine -R -l taskcleaner.sh.log
 This will remove all async_tasks table content!!! 
Caution, this operation should be used with care. Please contact support prior to running this command
Are you sure you want to proceed? [y/n]
y
NOTICE:  truncate cascades to table "async_tasks_entities"
TRUNCATE TABLE

[root@Dafna-32 dbutils]# psql -U postgres engine
Password for user postgres: 
psql (8.4.13)
Type "help" for help.

engine=# SELECT * from async_tasks;
 task_id | action_type | status | result | action_parameters | action_params_class | step_id | command_id | started_at | storage_pool_id | task_type | task_parameters | task_params_class 
---------+-------------+--------+--------+-------------------+---------------------+---------+------------+------------+-----------------+-----------+-----------------+-------------------
(0 rows)

engine=#