| Summary: | Web Admin unresponsive after loss of one dns domain server | ||||||
|---|---|---|---|---|---|---|---|
| Product: | [Retired] oVirt | Reporter: | Ryan Womer <ryan.womer> | ||||
| Component: | ovirt-engine-core | Assignee: | Ravi Nori <rnori> | ||||
| Status: | CLOSED INSUFFICIENT_DATA | QA Contact: | bugs <bugs> | ||||
| Severity: | unspecified | Docs Contact: | |||||
| Priority: | unspecified | ||||||
| Version: | 3.3 | CC: | acathrow, bazulay, emesika, iheim, ryan.womer, yeylon, yzaslavs | ||||
| Target Milestone: | --- | Flags: | bazulay:
needinfo?
(ryan.womer) |
||||
| Target Release: | 3.4.0 | ||||||
| Hardware: | Unspecified | ||||||
| OS: | Unspecified | ||||||
| Whiteboard: | infra | ||||||
| Fixed In Version: | Doc Type: | Bug Fix | |||||
| Doc Text: | Story Points: | --- | |||||
| Clone Of: | Environment: | ||||||
| Last Closed: | 2014-03-03 14:10:33 UTC | Type: | Bug | ||||
| Regression: | --- | Mount Type: | --- | ||||
| Documentation: | --- | CRM: | |||||
| Verified Versions: | Category: | --- | |||||
| oVirt Team: | --- | RHEL 7.3 requirements from Atomic Host: | |||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||
| Attachments: |
|
||||||
|
Description
Ryan Womer
2013-12-06 17:16:05 UTC
Can you provide the relevant engine log This has happened several times. Would you like a historical or just the most recent around the time it has occurred? The most recent would be sufficient Created attachment 851683 [details]
Most recent crash. Took 12 hours to get back up.
Comment on attachment 851683 [details]
Most recent crash. Took 12 hours to get back up.
This is the requested engine.log
Also of note, these crashes occurred during host migrations. (Two occurred during this 12 hour period.) This caused several guests to be listed as "UNKNOWN". I had to edit the entries in postgres to get them back online. I was able to reproduce it on my environment. The issue seems to be that engine can no longer find the host on which the database is installed. The cause of all exceptions seems to be: java.sql.SQLException: javax.resource.ResourceException: IJ000453: Unable to get managed connection for java:/ENGINEDataSource I was able to fix it by specifying the actual ip address of the database host instead of FQDN in /etc/ovirt-engine/engine.conf.d/10-setup-database.conf ENGINE_DB_HOST="<ip of db host>" ENGINE_DB_PORT="5432" .... domain is such a loaded term, changing bug summary I also looked at the logs, and you also have connections errors to the hosts, once again - due to the DNS issues. Any chance we can also see the resolv.conf file? if both DNS servers are in the /etc/resolve.conf and both can resolve the db it should be O.K. than (or the workaround suggested in comment #7. Ryan can you please verify that ? The system in question is a production cluster. I'll schedule an outage to test it as soon as possible. I planned on adding a bare-metal ADS as a back-up, so I'll add the test in line with that. Reduced urgency as this looks like a system/environmental issue. Ryan - when do you think you'll get back with the answers ? |