Bug 1026438

Summary: Frequent error happening in stage
Product: OpenShift Online Reporter: Dan McPherson <dmcphers>
Component: PodAssignee: Abhishek Gupta <abhgupta>
Status: CLOSED CURRENTRELEASE QA Contact: libra bugs <libra-bugs>
Severity: medium Docs Contact:
Priority: unspecified    
Version: 2.xCC: jhou
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: Bug Fix
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2014-01-24 03:28:45 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:

Description Dan McPherson 2013-11-04 16:12:45 UTC 
Error message
OpenShift::OOException: The application 'jbosseap' requires 'jenkins-client-1.4' but a matching cartridge could not be found

Stack trace (show Rails)
…igin-controller-1.16.11/app/helpers/cartridge_cache.rb:  86:in `find_cartridge_or_raise_exception'
…ntroller-1.16.11/app/rest_models/rest_application10.rb: 161:in `block (3 levels) in initialize'
…ems/gems/mongoid-3.0.21/lib/mongoid/relations/proxy.rb: 143:in `each'
…ems/gems/mongoid-3.0.21/lib/mongoid/relations/proxy.rb: 143:in `method_missing'
…/mongoid-3.0.21/lib/mongoid/relations/embedded/many.rb: 396:in `method_missing'
…ntroller-1.16.11/app/rest_models/rest_application10.rb: 160:in `block (2 levels) in initialize'
…ongoid-3.0.21/lib/mongoid/relations/referenced/many.rb: 167:in `block in each'
…oid-3.0.21/lib/mongoid/relations/targets/enumerable.rb: 169:in `block in each'
…ms/gems/mongoid-3.0.21/lib/mongoid/contextual/mongo.rb: 577:in `yield_document'
…ms/gems/mongoid-3.0.21/lib/mongoid/contextual/mongo.rb: 133:in `block (2 levels) in each'
…oot/usr/share/gems/gems/moped-1.3.2/lib/moped/query.rb:  78:in `block in each'
…ot/usr/share/gems/gems/moped-1.3.2/lib/moped/cursor.rb:  26:in `block in each'
…ot/usr/share/gems/gems/moped-1.3.2/lib/moped/cursor.rb:  26:in `each'
…ot/usr/share/gems/gems/moped-1.3.2/lib/moped/cursor.rb:  26:in `each'
…oot/usr/share/gems/gems/moped-1.3.2/lib/moped/query.rb:  77:in `each'
…oot/usr/share/gems/gems/moped-1.3.2/lib/moped/query.rb:  77:in `each'
…ms/gems/mongoid-3.0.21/lib/mongoid/contextual/mongo.rb: 132:in `block in each'
…ms/gems/mongoid-3.0.21/lib/mongoid/contextual/mongo.rb: 556:in `selecting'
…ms/gems/mongoid-3.0.21/lib/mongoid/contextual/mongo.rb: 131:in `each'
…are/gems/gems/mongoid-3.0.21/lib/mongoid/contextual.rb:  18:in `each'
…oid-3.0.21/lib/mongoid/relations/targets/enumerable.rb: 166:in `each'
…ongoid-3.0.21/lib/mongoid/relations/referenced/many.rb: 167:in `each'
…ntroller-1.16.11/app/rest_models/rest_application10.rb: 159:in `block in initialize'
…ntroller-1.16.11/app/rest_models/rest_application10.rb: 156:in `each'
…ntroller-1.16.11/app/rest_models/rest_application10.rb: 156:in `initialize'
…in-controller-1.16.11/app/helpers/rest_model_helper.rb:  31:in `new'
…in-controller-1.16.11/app/helpers/rest_model_helper.rb:  31:in `get_rest_application'
…ler-1.16.11/app/controllers/applications_controller.rb:  34:in `show'
…troller-1.16.11/lib/openshift/controller/action_log.rb:  80:in `set_logged_request'
…sr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:  68:in `block in call'
…sr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:  56:in `each'
…sr/share/gems/gems/journey-1.0.4/lib/journey/router.rb:  56:in `call'
…per-0.11.1/lib/mongo_mapper/middleware/identity_map.rb:  10:in `call'
…oid-3.0.21/lib/rack/mongoid/middleware/identity_map.rb:  34:in `block in call'
…e/gems/gems/mongoid-3.0.21/lib/mongoid/unit_of_work.rb:  39:in `unit_of_work'
…oid-3.0.21/lib/rack/mongoid/middleware/identity_map.rb:  34:in `call'
…3/root/usr/share/gems/gems/rack-1.4.1/lib/rack/etag.rb:  23:in `call'
…/share/gems/gems/rack-1.4.1/lib/rack/conditionalget.rb:  25:in `call'
…e/gems/gems/rack-1.4.1/lib/rack/session/abstract/id.rb: 205:in `context'
…e/gems/gems/rack-1.4.1/lib/rack/session/abstract/id.rb: 200:in `call'
…/share/gems/gems/rack-1.4.1/lib/rack/methodoverride.rb:  21:in `call'
…oot/usr/share/gems/gems/rack-1.4.1/lib/rack/runtime.rb:  17:in `call'
…3/root/usr/share/gems/gems/rack-1.4.1/lib/rack/lock.rb:  15:in `call'
…are/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb: 136:in `forward'
…are/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb: 245:in `fetch'
…are/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb: 185:in `lookup'
…are/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:  66:in `call!'
…are/gems/gems/rack-cache-1.2/lib/rack/cache/context.rb:  51:in `call'
…r-3.0.21/lib/phusion_passenger/rack/request_handler.rb:  97:in `process_request'
…0.21/lib/phusion_passenger/abstract_request_handler.rb: 521:in `accept_and_process_next_request'
…0.21/lib/phusion_passenger/abstract_request_handler.rb: 274:in `main_loop'
…0.21/lib/phusion_passenger/rack/application_spawner.rb: 206:in `start_request_handler'
…0.21/lib/phusion_passenger/rack/application_spawner.rb:  79:in `block in spawn_application'
…s/gems/passenger-3.0.21/lib/phusion_passenger/utils.rb: 470:in `safe_fork'
…0.21/lib/phusion_passenger/rack/application_spawner.rb:  64:in `spawn_application'
…assenger-3.0.21/lib/phusion_passenger/spawn_manager.rb: 264:in `spawn_rack_application'
…assenger-3.0.21/lib/phusion_passenger/spawn_manager.rb: 137:in `spawn_application'
…assenger-3.0.21/lib/phusion_passenger/spawn_manager.rb: 275:in `handle_spawn_application'
…senger-3.0.21/lib/phusion_passenger/abstract_server.rb: 357:in `server_main_loop'
…senger-3.0.21/lib/phusion_passenger/abstract_server.rb: 206:in `start_synchronously'
Comment 1 Abhishek Gupta 2013-11-04 23:10:29 UTC 
With the latest stage push, the feature to list the non-rpm based cartridges was introduced on the nodes. This caused older nodes that still had the older version carts present to return them to the broker. However, new nodes (new 'large' profile nodes were created) would return the correct list since they didn't have the older versions installed/present. 

Due to this, every time the cache expired (1 day expiration), the cartridge list fetched from the node could either contain the older version carts or not (depending upon which node the cart list was fetched from). 

This is being fixed on the nodes (the older version carts are being removed).
Comment 2 Jianwei Hou 2013-11-05 05:43:04 UTC 
Run 'rhc cartridge-list' and didn't see the old versions cartridges.
This bug can not be verified from QE side, @abhgupta, can you please help verify or close this bug once the stage nodes are fixed? Thanks.
Comment 3 Jianwei Hou 2013-11-06 03:05:42 UTC 
Mark as verified now that the old version cartridges have been removed.