Note: This bug is displayed in read-only format because the product is no longer active in Red Hat Bugzilla.

Bug 1635395

Summary: heat-engine got killed on an undercloud with 8 vCPUs and 16GB of RAM
Product: Red Hat OpenStack Reporter: Marius Cornea <mcornea>
Component: rhosp-directorAssignee: RHOS Maint <rhos-maint>
Status: CLOSED DUPLICATE QA Contact: Gurenko Alex <agurenko>
Severity: high Docs Contact:
Priority: unspecified    
Version: 14.0 (Rocky)CC: dbecker, mburns, morazi, ramishra
Target Milestone: ---   
Target Release: ---   
Hardware: Unspecified   
OS: Unspecified   
Whiteboard:
Fixed In Version: Doc Type: If docs needed, set a value
Doc Text:
Story Points: ---
Clone Of: Environment:
Last Closed: 2018-10-03 05:14:52 UTC Type: Bug
Regression: --- Mount Type: ---
Documentation: --- CRM:
Verified Versions: Category: ---
oVirt Team: --- RHEL 7.3 requirements from Atomic Host:
Cloudforms Team: --- Target Upstream Version:
Embargoed:
Attachments:
Description Flags
sosreport-undercloud-0.redhat.local-20181002154544.tar.xz
none
stack.tar.gz
none
dmesg output none

Description Marius Cornea 2018-10-02 19:59:47 UTC
Created attachment 1489604 [details]
sosreport-undercloud-0.redhat.local-20181002154544.tar.xz

Description of problem:

heat-engine got killed on an undercloud with 8 vCPUs and 16GB of RAM:

(undercloud) [stack@undercloud-0 ~]$ lscpu
Architecture:          x86_64
CPU op-mode(s):        32-bit, 64-bit
Byte Order:            Little Endian
CPU(s):                8
On-line CPU(s) list:   0-7
Thread(s) per core:    1
Core(s) per socket:    1
Socket(s):             8
NUMA node(s):          1
Vendor ID:             GenuineIntel
CPU family:            6
Model:                 79
Model name:            Intel(R) Xeon(R) CPU E5-2630 v4 @ 2.20GHz
Stepping:              1
CPU MHz:               2199.998
BogoMIPS:              4399.99
Virtualization:        VT-x
Hypervisor vendor:     KVM
Virtualization type:   full
L1d cache:             32K
L1i cache:             32K
L2 cache:              4096K
NUMA node0 CPU(s):     0-7
Flags:                 fpu vme de pse tsc msr pae mce cx8 apic sep mtrr pge mca cmov pat pse36 clflush mmx fxsr sse sse2 ss syscall nx pdpe1gb rdtscp lm constant_tsc arch_perfmon rep_good nopl eagerfpu pni pclmulqdq vmx ssse3 fma cx16 pcid sse4_1 sse4_2 x2apic movbe popcnt tsc_deadline_timer aes xsave avx f16c rdrand hypervisor lahf_lm abm 3dnowprefetch ssbd ibrs ibpb stibp tpr_shadow vnmi flexpriority ept vpid fsgsbase tsc_adjust bmi1 hle avx2 smep bmi2 erms invpcid rtm rdseed adx smap xsaveopt spec_ctrl intel_stibp

(undercloud) [stack@undercloud-0 ~]$ lsmem --summary
Memory block size:       128M
Total online memory:      16G
Total offline memory:      0B

(undercloud) [stack@undercloud-0 ~]$ free -m
              total        used        free      shared  buff/cache   available
Mem:          15885       12674        1942         300        1268        2340
Swap:             0           0           0

Version-Release number of selected component (if applicable):
openstack-tripleo-heat-templates-9.0.0-0.20180919080941.0rc1.0rc1.el7ost.noarch

How reproducible:
not always

Steps to Reproduce:
1. Run job:

https://rhos-qe-jenkins.rhev-ci-vms.eng.rdu2.redhat.com/view/DF%20Current%20release/job/DFG-df-splitstack-14-7.5-virsh-3cont_2comp_3ceph-blacklist-1compute-1control-compute-replacement/

Actual results:
At some point the Heat stack seems to be stuck:

(undercloud) [stack@undercloud-0 ~]$ openstack stack list
+--------------------------------------+------------+----------------------------------+--------------------+----------------------+----------------------+
| ID                                   | Stack Name | Project                          | Stack Status       | Creation Time        | Updated Time         |
+--------------------------------------+------------+----------------------------------+--------------------+----------------------+----------------------+
| b889e031-4de3-4703-bba2-b90bc9e02bc6 | overcloud  | 42aab94045744b728969c845b937257d | UPDATE_IN_PROGRESS | 2018-10-02T17:08:05Z | 2018-10-02T18:11:28Z |
+--------------------------------------+------------+----------------------------------+--------------------+----------------------+----------------------+

Expected results:

According to the docs the minimum requirements for undercloud are:
 - An 8-core 64-bit x86 processor with support for the Intel 64 or AMD64 CPU extensions.
 - A minimum of 16 GB of RAM.

Additional info:

Attaching the undercloud sosreport.

Comment 1 Marius Cornea 2018-10-02 20:01:23 UTC
Created attachment 1489605 [details]
stack.tar.gz

Comment 2 Marius Cornea 2018-10-02 20:05:42 UTC
Created attachment 1489606 [details]
dmesg output