Bug 1230979

Summary: If Manage Subscription Manifest fails then Fusor should Fail the Deployment (WebUI Progress Shows: Error: A sub task failed; A sub task failed; A sub task failed; A sub task failed; A sub task failed; A sub task failed; A sub task failed; A sub task fai
Product: Red Hat Quickstart Cloud Installer Reporter: John Matthews <jmatthew>
Component: Installation - RHEVAssignee: John Matthews <jmatthew>
Status: VERIFIED --- QA Contact:
Severity: unspecified Docs Contact: Dan Macpherson <dmacpher>
Priority: unspecified    
Version: 1.0CC: bthurber, jcallaha, jmatthew, tcarlin
Target Milestone: TP2   
Target Release: 1.0   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:

Description John Matthews 2015-06-11 23:58:01 UTC
Description of problem:

The RHCI WebUI Progress was showing:
   Error: A sub task failed; A sub task failed; A sub task failed; A sub task failed; A sub task failed; A sub task failed; A sub task failed; A sub task failed


Root cause was a task failed for  'Manage Subscription Manifest'

Ran into an issue where the 'Manage Subscription Manifest' failed but the Deploy tried to continue instead of failing and flagging this error.

Action:
Actions::Katello::Provider::ManifestRefresh
Input:
{"provider"=>{"id"=>2, "name"=>"Red Hat"},
 "organization"=>
  {"id"=>1, "name"=>"Default Organization", "label"=>"Default_Organization"},
 "upstream"=>
  {"id"=>"ff8080814de2c26d014de2cdc5b40031",
   "uuid"=>"63170c3b-994d-4dd3-82ac-7cccf353206c",
   "name"=>"jmatthews-rhci",
   "idCert"=>
    {"key"=>
      "-----BEGIN RSA PRIVATE KEY-----\nMIIEpAIBAAKCAQEAo2G2Avcn6lz+HM0twAHCVsxWRwUL+6LVIhsrpFJGy7JF1G+q\n4UXbF9onn9Zp7UKXjsyjL+J3hSzbK5y82FVtdhgX17+rIUPUu9XcjXsixzcMKepP\n1xLCjvOy/NOrGo8hQt7Mm7zLsOF2tHovmkfrErO5XJqDjhrGVe6kUpvS64u7u5zx\nGV7SV9phZhCZm04QU2yMM+LiNyzOKc/YNc4mP5ITZZrPq917Y7egOz+B5paooX6M\nEx4J7vy43V+rcVKjYaVGHMujmghfEr7ut2d3NsIUJfbvYhPWy4xvztYhbym5nqDg\ng5YNRhSPDsn54IeaG3z8N8LydgQidlb+LNYK2QIDAQABAoIBAQCNSVg+5EEuWNCf\nU4e2vU60BOyvadvc9gld/yUUatoyGK5ucUrSmLhIviz5+k+MD8REhw6vwCYfkpTN\n+DMO2YFZWKh1uJhioef7r4uVBeEjaaUpMiltEhoRyQkFvn3+77uRul4yZ2e2RKOE\nmw1DW+IbQDSRskUFxH2znjWYAoy5h7BuzfI4LRlT45d4WkDbI0x5xe+gZWlQzqkj\nR0A77Ilom2z8gUyang80vh+7tWo0uS0nFtdT/3mhWoCetHywYATABA7B346irb5T\nDZWA89GwNSW3vsYsQgzMRz/07hiQbIWiCkeIAYuuQFW4PiUMJ3cK90gdo8Zj0NLk\nDHReOADpAoGBANtxT6PX4bCCcZz8kQm4SsWLqW0rTF3EFU4C6lwVnDS7+Fa7LJF5\nyeD+v3SlmYqmqV+uqsUjoXjKV0fw+Ryg98EnPH4OdaFn6hC65RtnSmQdEEZPnWnU\nmGKZA9dbrM/TYi5qwtsAia40gRjzPcsBBd7XCi73Wc45Gn5QrkKTnOEfAoGBAL6Z\nid73d1yRrR9QT/lPCH9c9XrrCquhLMtVjlEZlnEpPMllJ9pjEM2mgYgvYseH5UER\n0Hf91ENNJ5iKqhmHa1kLeS8XK4AvQwsUnDy/b2QChvuOExCei/RYUGb1yRuOFC4T\niNc4Qkwm8RBmGQmPj7zvzmckzYvzmGKVIAbLqL0HAoGAQao/lZy1GVd/XeWqFQmD\nvmdTdKp/OJPDeEuhC5sf2hvhbTqnVIToJx6z9djUAExs5Ifk7AcEe5u40HtIYAu+\n95qhHGuBQaJRxV3XzwJynVChHRkX1qJaUy7MmnYBWVM8zvz9gAFCMdHeS7QF6qhM\ntGkO0A0OX4pw5hmIe72mNSsCgYBe+cFi8qtu3ESJUwrW75QLazYDzzWc+o6IsBRf\nw0FdGDBrJtXqE+1enLb1Nq+hP810VD0uXbS06LBvacGDQSCz2WzEk2Yg1OwyjE2i\nU75c9olutog3gtm4o31FIPramTzjDObmX+lhaxI6mrWlNv1oJ5MRgJxQPc1Uanzw\nBfIKZwKBgQCoN0CCfkpRYrRmUVT4Ujs8cbj1thiAkm6xge+LisElO1rMgAXJaFIJ\ns2dj4dv9XFQAI7wXZJ/qqyFHhUWyoEYozjW5mZw/5eaynpiriJcZUyJuDnFM9Fo5\nued6ogMfiKXplVrhr9r3mRXdK4CBowgzrqgMVyQFqz45XYFyyTmxpw==\n-----END RSA PRIVATE KEY-----\n",
     "cert"=>
      "-----BEGIN CERTIFICATE-----\nMIIFrzCCA5egAwIBAgIIAUl0T5HhljowDQYJKoZIhvcNAQEFBQAwgaQxCzAJBgNV\nBAYTAlVTMRcwFQYDVQQIDA5Ob3J0aCBDYXJvbGluYTEWMBQGA1UECgwNUmVkIEhh\ndCwgSW5jLjEYMBYGA1UECwwPUmVkIEhhdCBOZXR3b3JrMSQwIgYDVQQDDBtSZWQg\nSGF0IENhbmRsZXBpbiBBdXRob3JpdHkxJDAiBgkqhkiG9w0BCQEWFWNhLXN1cHBv\ncnRAcmVkaGF0LmNvbTAeFw0xNTA0MDMxNjUzMTZaFw0xNjA0MDMxNjUzMTZaMC8x\nLTArBgNVBAMTJDYzMTcwYzNiLTk5NGQtNGRkMy04MmFjLTdjY2NmMzUzMjA2YzCC\nASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAKNhtgL3J+pc/hzNLcABwlbM\nVkcFC/ui1SIbK6RSRsuyRdRvquFF2xfaJ5/Wae1Cl47Moy/id4Us2yucvNhVbXYY\nF9e/qyFD1LvV3I17Isc3DCnqT9cSwo7zsvzTqxqPIULezJu8y7DhdrR6L5pH6xKz\nuVyag44axlXupFKb0uuLu7uc8Rle0lfaYWYQmZtOEFNsjDPi4jcszinP2DXOJj+S\nE2Waz6vde2O3oDs/geaWqKF+jBMeCe78uN1fq3FSo2GlRhzLo5oIXxK+7rdndzbC\nFCX272IT1suMb87WIW8puZ6g4IOWDUYUjw7J+eCHmht8/DfC8nYEInZW/izWCtkC\nAwEAAaOCAVcwggFTMBEGCWCGSAGG+EIBAQQEAwIFoDALBgNVHQ8EBAMCBLAwgd4G\nA1UdIwSB1jCB04AUdy6lzTcNqOHT6mHFVmdD6JHHbRyhgbekgbQwgbExCzAJBgNV\nBAYTAlVTMRcwFQYDVQQIDA5Ob3J0aCBDYXJvbGluYTEWMBQGA1UECgwNUmVkIEhh\ndCwgSW5jLjEYMBYGA1UECwwPUmVkIEhhdCBOZXR3b3JrMTEwLwYDVQQDDChSZWQg\nSGF0IEVudGl0bGVtZW50IE9wZXJhdGlvbnMgQXV0aG9yaXR5MSQwIgYJKoZIhvcN\nAQkBFhVjYS1zdXBwb3J0QHJlZGhhdC5jb22CAT8wHQYDVR0OBBYEFEvljEAkX1/R\n2xDyEsCGOOd8sVhbMBMGA1UdJQQMMAoGCCsGAQUFBwMCMBwGA1UdEQQVMBOGEUNO\nPWptYXR0aGV3cy1yaGNpMA0GCSqGSIb3DQEBBQUAA4ICAQBgrctq5k7fLKmLU4C4\nDSFj+m94t5w9vJdHoJVyTGvXTIJtujN28sEvVPXKKxmmjmgcnM5/W152Q2/MFTU+\nc1905sw368V3YOfW+Oq8TQ3uwXWmsPtzrMZr4rQ5C9PRNMvQ8nsgdPPNdAAdUeQ9\n2FlTet4cECveGAJQwozt0V9jBFJy7QjJU3bRoVA/oHmHCD1825xKiaRXVBaa+Mk6\n7SRasYP8cJ0SdQnMQ5ht9AJXGk78KHLkoKgHUeiuLmqbNy4KfdZ27kzTjUkb+eph\nkm8fP94oIwtuIzqyzYF/7wo7f7mPiq7JaGqTaubIuLl3mHR+NBMHO0tCANSQI09x\nLfMXJnaO7luOSHNxQdXrRPjfFLIZVAjF2ox+peS44CX8ikSQdmvwmkumnIhjnp1E\n5NLdWwV/3VK3rkNn08iWbayWdZ56E8Kf/yYn/b8vvMVCnww4xOoDZBZ5Bd18ba3Q\nbbA3Zso/fQ/il0m8B/Ejt0YJP4Z/vn2E1I2HUzDd9tx/P99FlMv26Y/mZ7liM9MI\nO9WTF32DbXklhdmpBupvJ3Tx1ZLXlekKLnZ6NQ0NrJazzbrduJj+QT8vxj5zSTRX\nYY/1BAigHSqbc18ipfsoxuBK637GBhySqV1/rP/zHSQwLhU1Ei7Wu8/vERi6/zkw\nQIl4OiZ5ei+pIjPP/pzpFefegQ==\n-----END CERTIFICATE-----\n",
     "id"=>"ff8080814de2c26d014de2cdc5a80030",
     "serial"=>
      {"id"=>1937440147915695096,
       "revoked"=>false,
       "collected"=>false,
       "expiration"=>"2016-04-03T16:53:16.000+0000",
       "serial"=>1937440147915695096,
       "created"=>"2015-06-11T13:27:25.858+0000",
       "updated"=>"2015-06-11T13:27:25.858+0000"},
     "created"=>"2015-06-11T13:27:25.864+0000",
     "updated"=>"2015-06-11T13:27:25.864+0000"},
   "type"=>
    {"id"=>"ff8080814de2c26d014de2cdc51f000a",
     "label"=>"satellite",
     "manifest"=>true,
     "created"=>"2015-06-11T13:27:25.727+0000",
     "updated"=>"2015-06-11T13:27:25.727+0000"},
   "ownerId"=>"ff8080814de2c26d014de2c383e10001",
   "webUrl"=>"access.redhat.com/management/distributors/",
   "apiUrl"=>"https://subscription.rhn.redhat.com/subscription/consumers/",
   "created"=>"2015-06-11T13:27:25.876+0000",
   "updated"=>"2015-06-11T13:27:25.876+0000"},
 "remote_user"=>"admin-632b6612",
 "remote_cp_user"=>"admin",
 "locale"=>"en"}
Output:
{}
Exception:
NoMethodError: undefined method `[]' for nil:NilClass
Backtrace:
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/models/katello/glue/pulp/repo.rb:34:in `block (2 levels) in included'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/lib/katello/lazy_accessor.rb:175:in `instance_eval'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/lib/katello/lazy_accessor.rb:175:in `run_initializer'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/lib/katello/lazy_accessor.rb:154:in `lazy_attribute_get'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/lib/katello/lazy_accessor.rb:74:in `block (2 levels) in lazy_accessor'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/models/katello/glue/pulp/repo.rb:210:in `refresh_pulp_repo'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/models/katello/glue/pulp/repos.rb:300:in `block in update_repositories'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/delegation.rb:6:in `each'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/relation/delegation.rb:6:in `each'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/models/katello/glue/pulp/repos.rb:291:in `update_repositories'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/models/katello/glue/provider.rb:268:in `block in refresh_existing_products'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/associations/collection_proxy.rb:89:in `each'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/associations/collection_proxy.rb:89:in `method_missing'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/models/katello/glue/provider.rb:268:in `refresh_existing_products'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/models/katello/glue.rb:176:in `execute'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/models/katello/glue.rb:126:in `block in process'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/models/katello/glue.rb:113:in `each'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/models/katello/glue.rb:113:in `process'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/models/katello/glue.rb:35:in `on_save'
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:214:in `_conditional_callback_around_11626'
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:403:in `_run__1945868550047336703__save__3081764908908888903__callbacks'
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:405:in `__run_callback'
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:385:in `_run_save_callbacks'
/opt/rh/ruby193/root/usr/share/gems/gems/activesupport-3.2.8/lib/active_support/callbacks.rb:81:in `run_callbacks'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/callbacks.rb:264:in `create_or_update'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/persistence.rb:104:in `save!'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/validations.rb:56:in `save!'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/attribute_methods/dirty.rb:33:in `save!'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/transactions.rb:246:in `block in save!'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/transactions.rb:295:in `block in with_transaction_returning_status'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/connection_adapters/abstract/database_statements.rb:192:in `transaction'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/transactions.rb:208:in `transaction'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/transactions.rb:293:in `with_transaction_returning_status'
/opt/rh/ruby193/root/usr/share/gems/gems/activerecord-3.2.8/lib/active_record/transactions.rb:246:in `save!'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/models/katello/glue/provider.rb:260:in `queue_import_manifest'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/models/katello/glue/provider.rb:40:in `refresh_manifest'
/opt/rh/ruby193/root/usr/share/gems/gems/katello-2.2.0.46/app/lib/actions/katello/provider/manifest_refresh.rb:37:in `run'
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.7.7/lib/dynflow/action.rb:481:in `block (3 levels) in execute_run'
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.7.7/lib/dynflow/middleware/stack.rb:26:in `call'
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.7.7/lib/dynflow/middleware/stack.rb:26:in `pass'
/opt/rh/ruby193/root/usr/share/gems/gems/dynflow-0.7.7.7/lib/dynflow/middleware.rb:16:in

Comment 1 John Matthews 2015-08-12 18:57:02 UTC
Moving to ON_QA, I haven't seen this in a few weeks.

Comment 2 Thom Carlin 2015-08-24 21:40:59 UTC
Need reproducer steps

Comment 3 John Matthews 2015-08-25 11:16:23 UTC
Thom,

I'm not sure what the reproducer steps are.  This is an intermittent issue we hit several times a few months back.  Haven't seen it in ~2 months now.

Comment 4 Thom Carlin 2015-08-25 16:34:32 UTC
*** Bug 1226435 has been marked as a duplicate of this bug. ***

Comment 5 jcallaha 2015-08-25 18:00:14 UTC
This bug is the duplicate, but we can keep this one as the active one.

Comment 6 Thom Carlin 2015-08-25 18:43:49 UTC
Reproducer:
Fail a sub task in web UI (AFTER subscription management)

Comment 7 Antonin Pagac 2016-02-15 10:17:26 UTC
I haven't seen this in a long time.

If a sub task of Manage Content fails, it does not try to continue the deployment, as seen in bug 1302280. This occurs after subscription managemet.

Marking as verified.
TP2 RC9
RHCI-6.0-RHEL-7-20160208.1-RHCI-x86_64-dvd1.iso