Hide Forgot
Report came in from a thread: https://www.openshift.com/forums/openshift/poor-performance-throughput-response-time-apdex-score-in-comparison-to-heroku#comment-34960 The user is throttled (which makes sense if he was load testing). I did some load tests on this gear as well. The problem is it's never un-throttling: Oct 11 13:49:46 ex-std-nodeXX rhc-watchman[24473]: Throttler: REFUSED restore => XXXXXXXXXXXXXXXXXXXXXXXX (still over threshold (104.731)) The threshold number is going up and down. During that time the gear had a rails app but wasn't serving requests (in fact the most CPU was being detected from running top). When setting it to a default template, cgroups continued to throw messages like that, though there was also this odd one: Oct 11 13:50:48 ex-std-nodeXXX rhc-watchman[24473]: Throttler: REFUSED restore => XXXXXXXXXXXXXXXXXXXXXXXXX (still over threshold (84.362)) Oct 11 13:51:51 ex-std-nodeXXX rhc-watchman[24473]: Throttler: restore => XXXXXXXXXXXXXXXXXXXXXXXX (44.199) Oct 11 13:51:51 ex-std-nodeXXX rhc-watchman[24473]: Throttler: throttle => XXXXXXXXXXXXXXXXXXXXX (44.199) Oct 11 13:52:53 ex-std-nodeXXX rhc-watchman[24473]: Throttler: REFUSED restore => XXXXXXXXXXXXXXXXXX (still over threshold (70.621)) Notice how the restore and throttle there happened at the same time.
Reassigning this to the node team.
Commit pushed to master at https://github.com/openshift/origin-server https://github.com/openshift/origin-server/commit/94d0f7f85cb675eb152b53c1e3833c7a4aa92a0c Bug 1018342 - Stop restore/throttle flapping
Tried on devenv_4357 several times, gear which restored will not be throttled when the cpu usage is down. Feb 11 01:06:28 ip-10-16-155-161 watchman[1969]: Throttler: restore => 353849463692895929237504 (48.113) Feb 11 01:19:10 ip-10-16-155-161 watchman[1969]: Throttler: restore => 52f99837c7ca5d728c00003e (58.398) Feb 11 01:22:10 ip-10-16-155-161 watchman[1969]: Throttler: restore => 52f99837c7ca5d728c00003e (39.226) Move bug to verified.