Bug 1084009
| Summary: | The connection timed out exception when applying a patch on slow environments | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| Product: | [JBoss] JBoss Operations Network | Reporter: | Filip Brychta <fbrychta> | ||||||
| Component: | Upgrade, Launch Scripts | Assignee: | Simeon Pinder <spinder> | ||||||
| Status: | CLOSED CURRENTRELEASE | QA Contact: | Filip Brychta <fbrychta> | ||||||
| Severity: | high | Docs Contact: | |||||||
| Priority: | unspecified | ||||||||
| Version: | JON 3.2 | CC: | ahovsepy, dowoods, jshaughn, loleary, mkoci, myarboro, spinder | ||||||
| Target Milestone: | CR01 | Keywords: | Triaged | ||||||
| Target Release: | JON 3.3.1 | ||||||||
| Hardware: | Unspecified | ||||||||
| OS: | Unspecified | ||||||||
| Whiteboard: | |||||||||
| Fixed In Version: | Doc Type: | Bug Fix | |||||||
| Doc Text: | Story Points: | --- | |||||||
| Clone Of: | Environment: | ||||||||
| Last Closed: | 2015-02-27 19:58:19 UTC | Type: | Bug | ||||||
| Regression: | --- | Mount Type: | --- | ||||||
| Documentation: | --- | CRM: | |||||||
| Verified Versions: | Category: | --- | |||||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||||
| Embargoed: | |||||||||
| Attachments: |
|
||||||||
|
Description
Filip Brychta
2014-04-03 11:55:26 UTC
Workaround: edit apply-updates.sh, find a line sleep 10; and increase this sleep to sleep 30; visible in windows as well -> http://pastebin.test.redhat.com/201293 The apply-updates.sh/bat scripts were modified to wait 10s for EAP instance to start up before trying to launch the CLI configuration updates. This seems pessimistic enough for any moderate/large sized JON Server box that the 'update' is being applied to. To be clear this is just the EAP server startup not necessarily all of the N applications that may be deployed on the same. I think this should be fixed for 3.2.2 Possible fixes: i)Applying a longer wait is possible by extending the wait time(requires script modification). ii)Modify the wait time to be changeable via environment variable. Take default otherwise whatever been set by customer. iii)Modify both scripts to test eap instance for fully started up, before attempting to run the script. iv)Fix eap instance to support admin-only startup, then do iii) v)other options. Productization would like this process to remain as automated as possible. Automated application should minimize patch application issues for large and small environments alike. Windows: Open apply-updates.bat and see following lines rem use a ping loop to wait ~10s, enough start time to bring up the jboss-cli ping -n 11 127.0.0.1 > nul "%SERVER_PATCH_HOME%\bin\rhqctl.bat" start --server >> "%LOG_FILE%" 2>>&1 echo Starting JBoss CLI and applying patches... set NOPAUSE=true "%SERVER_PATCH_HOME%\jbossas\bin\jboss-cli.bat" --controller=localhost:6999 --connect --file="%JBOSS_CLI_COMMANDS_FILE%" >> "%LOG_FILE%" 2>>&1 set NOPAUSE= Waiting (command ping) is on incorrect line. *** Bug 1120090 has been marked as a duplicate of this bug. *** Created attachment 923024 [details]
applicable to 3.2.2 windows
I've attached an updated version of apply-updates.bat that should solve issues in 3.2.2 and has been checked into JON master as commit e403df337ee. It can be tested on windows (see Bug 1120090) by unzipping the 3.2.2 patch and overlaying this version of the .bat script. Work on the .sh script is still pending (see spinder for that) After using Jay's improved apply-updates.bat file from Comment 9 the upgrade process (JON 3.2.0 -> CP2) finishes correctly with no errors and/or exceptions being logged in 'update.log' file (I am attaching the update.log file). Tested on 64bit Windows 2008 Server. Created attachment 924511 [details]
update.log JON 3.2.0 GA -> CP2
*** Bug 1132020 has been marked as a duplicate of this bug. *** Moving into CR01 target milestone as missed ER01 cutoff. This is mostly fixed with the following commits: 9df4fc4ad9a 382ec89885f Still needs some more testing on Windows after merging with latest changes. One more commit: 97d67b6e286a14d. Moving to MODIFIED to test with next brew build. Moving to ON_QA as available to test with latest CP build: http://download.devel.redhat.com/brewroot/packages/org.jboss.on-jboss-on-parent/3.3.0.GA/16/maven/org/jboss/on/jon-server-patch/3.3.0.GA/jon-server-patch-3.3.0.GA.zip *Note: jon-server-patch-3.3.0.GA.zip maps to CR01 build of jon-server-3.3.0.GA-update-01.zip. Verified on Version : 3.3.0.GA Update 01 Build Number : ab9ebbd:884011b |