Bug 1390484
| Summary: | Postgres DB overloads the CPU when specific bookmarks queries are triggered. | ||||||
|---|---|---|---|---|---|---|---|
| Product: | Red Hat Enterprise Virtualization Manager | Reporter: | Roman Hodain <rhodain> | ||||
| Component: | ovirt-engine | Assignee: | Martin Perina <mperina> | ||||
| Status: | CLOSED ERRATA | QA Contact: | Lucie Leistnerova <lleistne> | ||||
| Severity: | high | Docs Contact: | |||||
| Priority: | unspecified | ||||||
| Version: | 4.0.3 | CC: | emesika, lleistne, lsurette, lsvaty, mgoldboi, mperina, oourfali, pstehlik, rbalakri, rgolan, Rhev-m-bugs, srevivo, ykaul | ||||
| Target Milestone: | ovirt-4.1.0-alpha | Keywords: | Performance, ZStream | ||||
| Target Release: | --- | ||||||
| Hardware: | Unspecified | ||||||
| OS: | Unspecified | ||||||
| Whiteboard: | |||||||
| Fixed In Version: | Doc Type: | If docs needed, set a value | |||||
| Doc Text: | Story Points: | --- | |||||
| Clone Of: | |||||||
| : | 1398550 (view as bug list) | Environment: | |||||
| Last Closed: | 2017-04-25 00:56:01 UTC | Type: | Bug | ||||
| Regression: | --- | Mount Type: | --- | ||||
| Documentation: | --- | CRM: | |||||
| Verified Versions: | Category: | --- | |||||
| oVirt Team: | Infra | RHEL 7.3 requirements from Atomic Host: | |||||
| Cloudforms Team: | --- | Target Upstream Version: | |||||
| Embargoed: | |||||||
| Bug Depends On: | |||||||
| Bug Blocks: | 1388462, 1398550 | ||||||
| Attachments: |
|
||||||
Eli, could you please take a look? testing on engine 4.1 with 8GB memory, 2 CPU events count 200 000 users 300 vms 1000 time 40-50s for query in Search input and query from already saved bookmark That seems reasonable against minutes. But there is another problem and engine runs more then one search at one time and to show result then takes minutes. Sometimes it shows result of other search first. Steps to Reproduce: 1. restart engine 2. have already saved bookmark with query - Events: Users=test-144 or vm=test1-144 3. run this bookmark, search takes 40-50s and runs one postgres process 4. change string in Search input to - Events: Users=test-155 or vm=test1-155 and run it, search takes 2min and more search postgres processes are running tested in ovirt-engine-4.1.0.2-0.1.el7.noarch see running processes and queries in postgres in attachment Created attachment 1245927 [details]
processes_queries
(In reply to Lucie Leistnerova from comment #8) > testing on engine 4.1 with 8GB memory, 2 CPU > events count 200 000 > users 300 > vms 1000 For 1000 VMs, 8GB and 2 CPU (physical engine?) is REALLY low. What is the storage that is being used? Did you reproduce the issues previously with the same DB and query and setup and could not see a difference in performance? > > time 40-50s for query in Search input and query from already saved bookmark > That seems reasonable against minutes. > > But there is another problem and engine runs more then one search at one > time and to show result then takes minutes. Sometimes it shows result of > other search first. > > Steps to Reproduce: > 1. restart engine > 2. have already saved bookmark with query - Events: Users=test-144 or > vm=test1-144 > 3. run this bookmark, search takes 40-50s and runs one postgres process > 4. change string in Search input to - Events: Users=test-155 or > vm=test1-155 and run it, search takes 2min and more search postgres > processes are running > > tested in ovirt-engine-4.1.0.2-0.1.el7.noarch > > see running processes and queries in postgres in attachment Running bookmark is about 5s faster on engine with 16GB memory, 2 CPU/2 cores and NFS storage. I tested the progress in ovirt with not the same database but similar number of events and vms. And it went from about 1.5 min to 30 s, so that is by my opinion alright. Still there are running searches that should not run (when I change the search from bookmark in search input) and it is then slower. Should I create another BZ for it? After talking with Yaniv, I will create new BZ for the multiple search problem. I tested the search in engine on virtual machine. I think the time is appropriate to it and it is real progress. verified in ovirt-engine-4.1.0.2-0.1.el7.noarch Feel free to reopen the bug if the time is still not reasonable for you. |
Description of problem: When the following bookmark is chosen Events: Users=xxx or vm=yyyy the postgres DB gets overloaded in case of high amount of VMs. Version-Release number of selected component (if applicable): rhv-m 4.0.4.4-0.1.el7ev How reproducible: 100% Steps to Reproduce: 1. Create 100VMs 2. Run the query above Actual results: Postgres consumes 100% of CPU and the query is returned in minutes. Expected results: The records are returned in reasonable time