1148467 – interim libvirt process between libvirtd and qemu segfaults when virt_use_sanlock is off

RHEL Engineering is moving the tracking of its product development work on RHEL 6 through RHEL 9 to Red Hat Jira (issues.redhat.com). If you're a Red Hat customer, please continue to file support cases via the Red Hat customer portal. If you're not, please head to the "RHEL project" in Red Hat Jira and file new tickets here. Individual Bugzilla bugs in the statuses "NEW", "ASSIGNED", and "POST" are being migrated throughout September 2023. Bugs of Red Hat partners with an assigned Engineering Partner Manager (EPM) are migrated in late September as per pre-agreed dates. Bugs against components "kernel", "kernel-rt", and "kpatch" are only migrated if still in "NEW" or "ASSIGNED". If you cannot log in to RH Jira, please consult article #7032570. That failing, please send an e-mail to the RH Jira admins at rh-issues@redhat.com to troubleshoot your issue as a user management inquiry. The email creates a ServiceNow ticket with Red Hat. Individual Bugzilla bugs that are migrated will be moved to status "CLOSED", resolution "MIGRATED", and set with "MigratedToJIRA" in "Keywords". The link to the successor Jira issue will be found under "Links", have a little "two-footprint" icon next to it, and direct you to the "RHEL project" in Red Hat Jira (issue links are of type "https://issues.redhat.com/browse/RHEL-XXXX", where "X" is a digit). This same link will be available in a blue banner at the top of the page informing you that that bug has been migrated.

Bug 1148467 - interim libvirt process between libvirtd and qemu segfaults when virt_use_sanlock is off

Summary: interim libvirt process between libvirtd and qemu segfaults when virt_use_san...

Keywords:
Status:	CLOSED DUPLICATE of bug 1136788
Alias:	None
Product:	Red Hat Enterprise Linux 6
Classification:	Red Hat
Component:	libvirt
Sub Component:
Version:	6.6
Hardware:	Unspecified
OS:	Unspecified
Priority:	unspecified
Severity:	unspecified
Target Milestone:	rc
Target Release:	---
Assignee:	Michal Privoznik
QA Contact:	Virtualization Bugs
Docs Contact:
URL:
Whiteboard:
Duplicates (1):	1148470 (view as bug list)
Depends On:
Blocks:
TreeView+	depends on / blocked

Reported:	2014-10-01 14:04 UTC by Meni Yakove
Modified:	2014-12-15 15:07 UTC (History)
CC List:	23 users (show)
Fixed In Version:
Doc Type:	Bug Fix
Doc Text:
Clone Of:
Environment:
Last Closed:	2014-10-08 12:27:53 UTC
Target Upstream Version:
Embargoed:

Attachments	(Terms of Use)
engine, vdsm and libvirt logs (3.66 MB, application/zip) 2014-10-01 14:04 UTC, Meni Yakove	no flags	Details
messages log file (627.47 KB, text/plain) 2014-10-02 06:02 UTC, Meni Yakove	no flags	Details
coredump (2.96 MB, application/zip) 2014-10-02 09:33 UTC, Meni Yakove	no flags	Details
View All

Description Meni Yakove 2014-10-01 14:04:58 UTC

Created attachment 943063 [details]
engine, vdsm and libvirt logs

Description of problem:
Cannot start VM (start or runonce) got error:
libvirtError: Child quit during startup handshake: Input/output error

Version-Release number of selected component (if applicable):
rhevm-3.4.2-1.1.el6ev.noarch
vdsm-4.14.13-2.el6ev.x86_64
VDS: Red Hat Enterprise Linux Server release 6.6 Beta (Santiago)

How reproducible:
100%

Steps to Reproduce:
1. Create new VM
2.Start the VM


Actual results:
Fail to start VM

Expected results:
VM started

Additional info:
From VDSM:
Traceback (most recent call last):
  File "/usr/share/vdsm/vm.py", line 2277, in _startUnderlyingVm
    self._run()
  File "/usr/share/vdsm/vm.py", line 3224, in _run
    self._connection.createXML(domxml, flags),
  File "/usr/lib64/python2.6/site-packages/vdsm/libvirtconnection.py", line 92, in wrapper
    ret = f(*args, **kwargs)
  File "/usr/lib64/python2.6/site-packages/libvirt.py", line 2709, in createXML
    if ret is None:raise libvirtError('virDomainCreateXML() failed', conn=self)
libvirtError: Child quit during startup handshake: Input/output error


From rhevm:
2014-10-01 16:57:31,190 WARN  [org.ovirt.engine.core.bll.RunVmCommand] (org.ovirt.thread.pool-4-thread-28) CanDoAction of action RunVm failed. Reasons:VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,VAR__ACTION__RUN,VAR__TYPE__VM,SCHEDULING_ALL_HOSTS_FILTERED_OUT

Comment 1 Meni Yakove 2014-10-01 14:08:48 UTC

Libvirt version: libvirt-0.10.2-45.el6.x86_64

Comment 3 Petr Beňas 2014-10-01 14:59:59 UTC

*** Bug 1148470 has been marked as a duplicate of this bug. ***

Comment 4 Dan Kenigsberg 2014-10-01 22:44:02 UTC

Meni, could you specify the version of qemu-kvm?
Do all VM starrtup fail? Or can you pinpoint something special in this VM's definition, which causes its failure?


Michal, maybe you can guess where this can come from?:

2014-10-01 13:48:11.827+0000: 3640: debug : virCommandRunAsync:2250 : Command result 0, with PID 6681
2014-10-01 13:48:11.829+0000: 3640: debug : virCommandRun:2045 : Result status 0, stdout: '(null)' stderr: '(null)'
2014-10-01 13:48:11.829+0000: 3640: debug : qemuProcessStart:4110 : Writing early domain status to disk
2014-10-01 13:48:11.918+0000: 3640: debug : qemuProcessStart:4115 : Waiting for handshake from child
2014-10-01 13:48:11.918+0000: 3640: debug : virCommandHandshakeWait:2427 : Wait for handshake on 28
2014-10-01 13:48:11.918+0000: 3640: error : virCommandHandshakeWait:2434 : Child quit during startup handshake: Input/output error

Comment 5 Meni Yakove 2014-10-02 05:59:56 UTC

Seems like selinux issue.
setenforce 0 solve the problem


qemu version qemu-kvm-rhev-0.12.1.2-2.448.el6.x86_64

Comment 6 Meni Yakove 2014-10-02 06:01:49 UTC

Oct  2 09:00:40 rose09 kernel: type=1400 audit(1412229640.889:61): avc:  denied  { connectto } for  pid=11345 comm="libvirtd" path="/var/run/sanlock/sanlock.sock" scontext=system_u:system_r:svirt_t:s0:c432,c814 tcontext=system_u:system_r:sanlock_t:s0-s0:c0.c1023 tclass=unix_stream_socket
Oct  2 09:00:40 rose09 kernel: type=1400 audit(1412229640.889:62): avc:  denied  { connectto } for  pid=11345 comm="libvirtd" path="/var/run/sanlock/sanlock.sock" scontext=system_u:system_r:svirt_t:s0:c432,c814 tcontext=system_u:system_r:sanlock_t:s0-s0:c0.c1023 tclass=unix_stream_socket

Comment 7 Meni Yakove 2014-10-02 06:02:18 UTC

Created attachment 943280 [details]
messages log file

Comment 8 Omer Frenkel 2014-10-02 07:04:16 UTC

danken, isn't this a result of Bug 1139873 ?

Comment 9 Michal Privoznik 2014-10-02 07:19:42 UTC

(In reply to Meni Yakove from comment #7)
> Created attachment 943280 [details]
> messages log file

Oct  2 08:57:20 rose09 kernel: type=1400 audit(1412229440.201:49): avc:  denied  { connectto } for  pid=10660 comm="libvirtd" path="/var/run/sanlock/sanlock.sock" scontext=system_u:system_r:svirt_t:s0:c141,c298 tcontext=system_u:system_r:sanlock_t:s0-s0:c0.c1023 tclass=unix_stream_socket
Oct  2 08:57:20 rose09 kernel: type=1400 audit(1412229440.201:50): avc:  denied  { connectto } for  pid=10660 comm="libvirtd" path="/var/run/sanlock/sanlock.sock" scontext=system_u:system_r:svirt_t:s0:c141,c298 tcontext=system_u:system_r:sanlock_t:s0-s0:c0.c1023 tclass=unix_stream_socket
Oct  2 08:57:20 rose09 kernel: libvirtd[10660]: segfault at fffffffffffffffc ip 000000349367b53c sp 00007f7bf98ee938 error 4 in libc-2.12.so[3493600000+18a000]

Ouch. Even though this is caused by selinux, libvirtd should not had sefaulted. Meni, do you happen to have a coredump hidden somewhere in your pocket so I can take a look?

Comment 12 Miroslav Grepl 2014-10-02 09:14:32 UTC

#!!!! This avc can be allowed using the boolean 'virt_use_sanlock'
allow svirt_t sanlock_t:unix_stream_socket connectto;

Comment 13 Fabian Deutsch 2014-10-02 09:18:32 UTC

(In reply to Omer Frenkel from comment #8)
> danken, isn't this a result of Bug 1139873 ?

I agree with Omer, that this is a cause of the bug given by him. It seems there is a fix.

my 2ct.

Comment 14 Meni Yakove 2014-10-02 09:33:15 UTC

Found 4 coredump, please check if they are relevant

Comment 15 Meni Yakove 2014-10-02 09:33:43 UTC

Created attachment 943338 [details]
coredump

Comment 17 Michal Skrivanek 2014-10-02 13:08:58 UTC

no more relevant to RHEV once bug 1139873 is fixed.
Moving to libvirt for addressing the crash in comment #9

Comment 20 Michal Privoznik 2014-10-02 15:51:50 UTC

I'm still unable to see what's happening. All I see is this chunk:

Program terminated with signal 11, Segmentation fault.
#0  __libc_free (mem=0x4) at malloc.c:3714
3714     if (chunk_is_mmapped(p))                       /* release mmapped memory. */

Can you please re-run libvirt under valgrind (on the destination I presume where the SIGSEGV occurs) and post its findings? Thanks.

valgrind --leak-check=full --read-var-info=yes $(which libvirtd)

Comment 22 Nikolai Sednev 2014-10-05 10:10:34 UTC

I have the same error message, while running guest-image of RHEL7 over RHEL6.6 host, in opposite on RHEL7.0 host it's working like a charm...

Comment 27 Michal Skrivanek 2014-10-07 07:37:49 UTC

Meni, this bug is for libvirt fix not relevant to RHEV, as per comment #17

Comment 28 dyuan 2014-10-08 06:32:08 UTC

# getsebool virt_use_sanlock
virt_use_sanlock --> off

# service libvirtd status
libvirtd (pid  32562) is running...

# virsh start rhel6
error: Failed to start domain rhel6
error: Child quit during startup handshake: Input/output error

# service libvirtd status
libvirtd (pid  32562) is running...

==> libvirtd didn't crash.

type=AVC msg=audit(1412749746.008:8483): avc:  denied  { connectto } for  pid=2184 comm="libvirtd" path="/var/run/sanlock/sanlock.sock" scontext=unconfined_u:system_r:svirt_t:s0:c286,c491 tcontext=unconfined_u:system_r:sanlock_t:s0-s0:c0.c1023 tclass=unix_stream_socket
type=SYSCALL msg=audit(1412749746.008:8483): arch=c000003e syscall=42 success=no exit=-13 a0=3 a1=7f31f7d1e580 a2=6e a3=0 items=0 ppid=1 pid=2184 auid=0 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=(none) ses=1329 comm="libvirtd" exe="/usr/sbin/libvirtd" subj=unconfined_u:system_r:virtd_t:s0-s0:c0.c1023 key=(null)
type=AVC msg=audit(1412749746.009:8484): avc:  denied  { connectto } for  pid=2184 comm="libvirtd" path="/var/run/sanlock/sanlock.sock" scontext=unconfined_u:system_r:svirt_t:s0:c286,c491 tcontext=unconfined_u:system_r:sanlock_t:s0-s0:c0.c1023 tclass=unix_stream_socket

# setsebool virt_use_sanlock=1

# getsebool virt_use_sanlock
virt_use_sanlock --> on

type=MAC_CONFIG_CHANGE msg=audit(1412749837.840:8499): bool=virt_use_sanlock val=1 old_val=0 auid=0 ses=1329
type=SYSCALL msg=audit(1412749837.840:8499): arch=c000003e syscall=1 success=yes exit=2 a0=3 a1=7fff2c9aa300 a2=2 a3=0 items=0 ppid=1975 pid=2938 auid=0 uid=0 gid=0 euid=0 suid=0 fsuid=0 egid=0 sgid=0 fsgid=0 tty=pts12 ses=1329 comm="setsebool" exe="/usr/sbin/setsebool" subj=unconfined_u:unconfined_r:setsebool_t:s0-s0:c0.c1023 key=(null)

# virsh start rhel6
Domain rhel6 started

# virsh list
 Id    Name                           State
----------------------------------------------------
 3     rhel6                          running

Comment 29 Michal Privoznik 2014-10-08 06:48:10 UTC

(In reply to dyuan from comment #28)
> # getsebool virt_use_sanlock
> virt_use_sanlock --> off
> 
> # service libvirtd status
> libvirtd (pid  32562) is running...
> 
> # virsh start rhel6
> error: Failed to start domain rhel6
> error: Child quit during startup handshake: Input/output error

1: this ^^^

> 
> # service libvirtd status
> libvirtd (pid  32562) is running...

The problem is not about libvirtd but about the child that quit during handshake. The [1] is what this bug is about. Can you please run libvirtd under valgrind and reproduce? See comment 20 for more info. Thanks!

Comment 30 dyuan 2014-10-08 09:33:45 UTC

The error is different from the comment 28 when run libvirtd under valgrind.

# virsh start rhel6
error: Failed to start domain rhel6
error: internal error Failed to open socket to sanlock daemon: Permission denied

# valgrind --leak-check=full --read-var-info=yes $(which libvirtd)
==9000== Memcheck, a memory error detector
==9000== Copyright (C) 2002-2012, and GNU GPL'd, by Julian Seward et al.
==9000== Using Valgrind-3.8.1 and LibVEX; rerun with -h for copyright info
==9000== Command: /usr/sbin/libvirtd
==9000== 
==9000== Thread 12:
==9000== Syscall param socketcall.sendto(msg) points to uninitialised byte(s)
==9000==    at 0x35B960ECDC: send (send.c:33)
==9000==    by 0x151DE6BB: cmd_lockspace (client.c:134)
==9000==    by 0x14FCD1A5: virLockManagerSanlockSetupLockspace (lock_driver_sanlock.c:337)
==9000==    by 0x14FCDC18: virLockManagerSanlockInit (lock_driver_sanlock.c:422)
==9000==    by 0x3003F0EC33: virLockManagerPluginNew (lock_manager.c:175)
==9000==    by 0x4AFA90: qemudLoadDriverConfig (qemu_conf.c:589)
==9000==    by 0x44CA56: qemudStartup (qemu_driver.c:767)
==9000==    by 0x3003EF6B8A: virStateInitialize (libvirt.c:796)
==9000==    by 0x423380: daemonRunStateInit (libvirtd.c:739)
==9000==    by 0x3003E64428: virThreadHelper (threads-pthread.c:161)
==9000==    by 0x35B96079D0: start_thread (pthread_create.c:301)
==9000==    by 0x35B8EE89DC: clone (clone.S:115)
==9000==  Location 0x131a425c is 60 bytes inside local var "ls"
==9000==  declared at lock_driver_sanlock.c:200, in frame #2 of thread 12
==9000== 
==9000== Warning: noted but unhandled ioctl 0x89a2 with no size/direction hints
==9000==    This could cause spurious value errors to appear.
==9000==    See README_MISSING_SYSCALL_OR_IOCTL for guidance on writing a proper wrapper.
==9134== 
==9134== HEAP SUMMARY:
==9134==     in use at exit: 1,649,231 bytes in 14,406 blocks
==9134==   total heap usage: 170,494 allocs, 156,088 frees, 722,520,171 bytes allocated
==9134== 
==9135== Thread 6:
==9135== Conditional jump or move depends on uninitialised value(s)
==9135==    at 0x4A063E3: free (vg_replace_malloc.c:446)
==9135==    by 0x3003E59DD8: virFree (memory.c:419)
==9135==    by 0x14FCC686: virLockManagerSanlockAcquire (lock_driver_sanlock.c:1051)
==9135==    by 0x3003F0F96A: virDomainLockProcessStart (domain_lock.c:178)
==9135==    by 0x4AA631: qemuProcessHook (qemu_process.c:2851)
==9135==    by 0x3003E48BC2: virCommandHook (command.c:2088)
==9135==    by 0x3003E4AC8C: virExecWithHook.clone.0 (command.c:630)
==9135==    by 0x3003E4B52E: virCommandRunAsync (command.c:2232)
==9135==    by 0x3003E4B968: virCommandRun (command.c:2018)
==9135==    by 0x4ACBDD: qemuProcessStart (qemu_process.c:4081)
==9135==    by 0x46C83D: qemuDomainObjStart (qemu_driver.c:6124)
==9135==    by 0x46CE71: qemuDomainStartWithFlags (qemu_driver.c:6181)
==9135== 
==9135== Invalid free() / delete / delete[] / realloc()
==9135==    at 0x4A06430: free (vg_replace_malloc.c:446)
==9135==    by 0x3003E59DD8: virFree (memory.c:419)
==9135==    by 0x14FCC686: virLockManagerSanlockAcquire (lock_driver_sanlock.c:1051)
==9135==    by 0x3003F0F96A: virDomainLockProcessStart (domain_lock.c:178)
==9135==    by 0x4AA631: qemuProcessHook (qemu_process.c:2851)
==9135==    by 0x3003E48BC2: virCommandHook (command.c:2088)
==9135==    by 0x3003E4AC8C: virExecWithHook.clone.0 (command.c:630)
==9135==    by 0x3003E4B52E: virCommandRunAsync (command.c:2232)
==9135==    by 0x3003E4B968: virCommandRun (command.c:2018)
==9135==    by 0x4ACBDD: qemuProcessStart (qemu_process.c:4081)
==9135==    by 0x46C83D: qemuDomainObjStart (qemu_driver.c:6124)
==9135==    by 0x46CE71: qemuDomainStartWithFlags (qemu_driver.c:6181)
==9135==  Address 0x4 is not stack'd, malloc'd or (recently) free'd
==9135== 
==9134== Thread 1:
==9134== 5 bytes in 1 blocks are possibly lost in loss record 104 of 1,676
==9134==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9134==    by 0x35B8E80E91: strdup (strdup.c:43)
==9134==    by 0x35CEE2C71B: add_proto_name (netlink-local.h:140)
==9134==    by 0x35CEE2C7E4: init_proto_names (route_utils.c:108)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 5 bytes in 1 blocks are possibly lost in loss record 105 of 1,676
==9134==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9134==    by 0x35B8E80E91: strdup (strdup.c:43)
==9134==    by 0x35CEE2C43B: add_routing_table_name (netlink-local.h:140)
==9134==    by 0x35CEE2C4F3: init_routing_table_names (route_utils.c:62)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 6 bytes in 1 blocks are possibly lost in loss record 134 of 1,676
==9134==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9134==    by 0x35B8E80E91: strdup (strdup.c:43)
==9134==    by 0x35CEE2C43B: add_routing_table_name (netlink-local.h:140)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 7 bytes in 1 blocks are possibly lost in loss record 169 of 1,676
==9134==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9134==    by 0x35B8E80E91: strdup (strdup.c:43)
==9134==    by 0x35CEE2C71B: add_proto_name (netlink-local.h:140)
==9134==    by 0x35CEE2C7B1: init_proto_names (route_utils.c:105)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 7 bytes in 1 blocks are possibly lost in loss record 170 of 1,676
==9134==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9134==    by 0x35B8E80E91: strdup (strdup.c:43)
==9134==    by 0x35CEE2C71B: add_proto_name (netlink-local.h:140)
==9134==    by 0x35CEE2C7D3: init_proto_names (route_utils.c:107)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 7 bytes in 1 blocks are possibly lost in loss record 171 of 1,676
==9134==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9134==    by 0x35B8E80E91: strdup (strdup.c:43)
==9134==    by 0x35CEE2C71B: add_proto_name (netlink-local.h:140)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 7 bytes in 1 blocks are possibly lost in loss record 172 of 1,676
==9134==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9134==    by 0x35B8E80E91: strdup (strdup.c:43)
==9134==    by 0x35CEE2C43B: add_routing_table_name (netlink-local.h:140)
==9134==    by 0x35CEE2C4D1: init_routing_table_names (route_utils.c:60)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 8 bytes in 1 blocks are possibly lost in loss record 233 of 1,676
==9134==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9134==    by 0x35B8E80E91: strdup (strdup.c:43)
==9134==    by 0x35CEE2C43B: add_routing_table_name (netlink-local.h:140)
==9134==    by 0x35CEE2C4E2: init_routing_table_names (route_utils.c:61)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 9 bytes in 1 blocks are possibly lost in loss record 269 of 1,676
==9134==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9134==    by 0x35B8E80E91: strdup (strdup.c:43)
==9134==    by 0x35CEE2C71B: add_proto_name (netlink-local.h:140)
==9134==    by 0x35CEE2C7C2: init_proto_names (route_utils.c:106)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 32 bytes in 1 blocks are possibly lost in loss record 657 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE2C707: add_proto_name (netlink-local.h:135)
==9134==    by 0x35CEE2C7B1: init_proto_names (route_utils.c:105)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 32 bytes in 1 blocks are possibly lost in loss record 658 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE2C707: add_proto_name (netlink-local.h:135)
==9134==    by 0x35CEE2C7C2: init_proto_names (route_utils.c:106)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 32 bytes in 1 blocks are possibly lost in loss record 659 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE2C707: add_proto_name (netlink-local.h:135)
==9134==    by 0x35CEE2C7D3: init_proto_names (route_utils.c:107)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 32 bytes in 1 blocks are possibly lost in loss record 660 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE2C707: add_proto_name (netlink-local.h:135)
==9134==    by 0x35CEE2C7E4: init_proto_names (route_utils.c:108)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 32 bytes in 1 blocks are possibly lost in loss record 661 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE2C707: add_proto_name (netlink-local.h:135)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 32 bytes in 1 blocks are possibly lost in loss record 662 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE2C427: add_routing_table_name (netlink-local.h:135)
==9134==    by 0x35CEE2C4D1: init_routing_table_names (route_utils.c:60)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 32 bytes in 1 blocks are possibly lost in loss record 663 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE2C427: add_routing_table_name (netlink-local.h:135)
==9134==    by 0x35CEE2C4E2: init_routing_table_names (route_utils.c:61)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 32 bytes in 1 blocks are possibly lost in loss record 664 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE2C427: add_routing_table_name (netlink-local.h:135)
==9134==    by 0x35CEE2C4F3: init_routing_table_names (route_utils.c:62)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 32 bytes in 1 blocks are possibly lost in loss record 665 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE2C427: add_routing_table_name (netlink-local.h:135)
==9134==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9134==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9134== 
==9134== 40 bytes in 1 blocks are possibly lost in loss record 776 of 1,676
==9134==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9134==    by 0x35C820D60B: _PR_Getfd (prfdcach.c:112)
==9134==    by 0x35C8225094: pt_SetMethods (ptio.c:3303)
==9134==    by 0x35C8225468: PR_OpenFile (ptio.c:3581)
==9134==    by 0x4E8A9D7: blapi_SHVerifyFile (shvfy.c:356)
==9134==    by 0x4E8AD6E: blapi_SHVerify (shvfy.c:290)
==9134==    by 0x4E75338: bl_startup_tests (fipsfreebl.c:1541)
==9134==    by 0x4EB3E55: ??? (in /lib64/libfreebl3.so)
==9134==    by 0x4E629C2: ??? (in /lib64/libfreebl3.so)
==9134== 
==9134== 48 bytes in 1 blocks are possibly lost in loss record 852 of 1,676
==9134==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9134==    by 0x35C820D5F9: _PR_Getfd (prfdcach.c:109)
==9134==    by 0x35C8225094: pt_SetMethods (ptio.c:3303)
==9134==    by 0x35C8225468: PR_OpenFile (ptio.c:3581)
==9134==    by 0x4E8A9D7: blapi_SHVerifyFile (shvfy.c:356)
==9134==    by 0x4E8AD6E: blapi_SHVerify (shvfy.c:290)
==9134==    by 0x4E75338: bl_startup_tests (fipsfreebl.c:1541)
==9134==    by 0x4EB3E55: ??? (in /lib64/libfreebl3.so)
==9134==    by 0x4E629C2: ??? (in /lib64/libfreebl3.so)
==9134== 
==9134== 48 bytes in 2 blocks are possibly lost in loss record 853 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE15C0E: nl_addr_alloc (addr.c:168)
==9134==    by 0x35CEE16357: nl_addr_build (addr.c:191)
==9134==    by 0x35CEE214AD: addr_msg_parser (addr.c:263)
==9134==    by 0x35CEE17B3A: nl_cache_parse (cache.c:636)
==9134==    by 0x35CEE1C641: nl_recvmsgs (netlink-local.h:342)
==9134==    by 0x35CEE17E95: __cache_pickup (cache.c:479)
==9134==    by 0x35CEE1807B: nl_cache_pickup (cache.c:512)
==9134==    by 0x35CEE21304: rtnl_addr_alloc_cache (addr.c:650)
==9134==    by 0x3000C068F2: netlink_init (dutil_linux.c:96)
==9134==    by 0x3000C0A5EE: drv_init (drv_redhat.c:372)
==9134==    by 0x4F8318: interfaceOpenInterface (interface_backend_netcf.c:166)
==9134== 
==9134== 80 bytes in 1 blocks are definitely lost in loss record 985 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x3003E59E7D: virAlloc (memory.c:100)
==9134==    by 0x3003E71CA7: virLastErrorObject (virterror.c:204)
==9134==    by 0x3003E725E8: virResetLastError (virterror.c:355)
==9134==    by 0x3003EF5689: virConnectGetURI (libvirt.c:1702)
==9134==    by 0x4378D2: remoteDispatchGetURIHelper (remote_dispatch.h:7317)
==9134==    by 0x3003F457B1: virNetServerProgramDispatch (virnetserverprogram.c:431)
==9134==    by 0x3003F43FFD: virNetServerProcessMsg (virnetserver.c:170)
==9134==    by 0x3003F4469B: virNetServerHandleJob (virnetserver.c:191)
==9134==    by 0x3003E64B3B: virThreadPoolWorker (threadpool.c:144)
==9134==    by 0x3003E64428: virThreadHelper (threads-pthread.c:161)
==9134==    by 0x35B96079D0: start_thread (pthread_create.c:301)
==9134== 
==9134== 80 bytes in 1 blocks are definitely lost in loss record 986 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x3003E59E7D: virAlloc (memory.c:100)
==9134==    by 0x3003E71CA7: virLastErrorObject (virterror.c:204)
==9134==    by 0x3003E725E8: virResetLastError (virterror.c:355)
==9134==    by 0x3003EF0AC2: virDomainLookupByName (libvirt.c:2119)
==9134==    by 0x43F4FD: remoteDispatchDomainLookupByNameHelper (remote_dispatch.h:3105)
==9134==    by 0x3003F457B1: virNetServerProgramDispatch (virnetserverprogram.c:431)
==9134==    by 0x3003F43FFD: virNetServerProcessMsg (virnetserver.c:170)
==9134==    by 0x3003F4469B: virNetServerHandleJob (virnetserver.c:191)
==9134==    by 0x3003E64B3B: virThreadPoolWorker (threadpool.c:144)
==9134==    by 0x3003E64428: virThreadHelper (threads-pthread.c:161)
==9134==    by 0x35B96079D0: start_thread (pthread_create.c:301)
==9134== 
==9134== 104 bytes in 4 blocks are possibly lost in loss record 1,052 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE15C0E: nl_addr_alloc (addr.c:168)
==9134==    by 0x35CEE16357: nl_addr_build (addr.c:191)
==9134==    by 0x35CEE24EED: link_msg_parser (link.c:335)
==9134==    by 0x35CEE17B3A: nl_cache_parse (cache.c:636)
==9134==    by 0x35CEE1C641: nl_recvmsgs (netlink-local.h:342)
==9134==    by 0x35CEE17E95: __cache_pickup (cache.c:479)
==9134==    by 0x35CEE1807B: nl_cache_pickup (cache.c:512)
==9134==    by 0x35CEE24144: rtnl_link_alloc_cache (link.c:877)
==9134==    by 0x3000C068DA: netlink_init (dutil_linux.c:82)
==9134==    by 0x3000C0A5EE: drv_init (drv_redhat.c:372)
==9134==    by 0x4F8318: interfaceOpenInterface (interface_backend_netcf.c:166)
==9134== 
==9134== 104 bytes in 4 blocks are possibly lost in loss record 1,053 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE15C0E: nl_addr_alloc (addr.c:168)
==9134==    by 0x35CEE16357: nl_addr_build (addr.c:191)
==9134==    by 0x35CEE24F25: link_msg_parser (link.c:344)
==9134==    by 0x35CEE17B3A: nl_cache_parse (cache.c:636)
==9134==    by 0x35CEE1C641: nl_recvmsgs (netlink-local.h:342)
==9134==    by 0x35CEE17E95: __cache_pickup (cache.c:479)
==9134==    by 0x35CEE1807B: nl_cache_pickup (cache.c:512)
==9134==    by 0x35CEE24144: rtnl_link_alloc_cache (link.c:877)
==9134==    by 0x3000C068DA: netlink_init (dutil_linux.c:82)
==9134==    by 0x3000C0A5EE: drv_init (drv_redhat.c:372)
==9134==    by 0x4F8318: interfaceOpenInterface (interface_backend_netcf.c:166)
==9134== 
==9134== 144 bytes in 5 blocks are possibly lost in loss record 1,139 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE15C0E: nl_addr_alloc (addr.c:168)
==9134==    by 0x35CEE16357: nl_addr_build (addr.c:191)
==9134==    by 0x35CEE21452: addr_msg_parser (addr.c:241)
==9134==    by 0x35CEE17B3A: nl_cache_parse (cache.c:636)
==9134==    by 0x35CEE1C641: nl_recvmsgs (netlink-local.h:342)
==9134==    by 0x35CEE17E95: __cache_pickup (cache.c:479)
==9134==    by 0x35CEE1807B: nl_cache_pickup (cache.c:512)
==9134==    by 0x35CEE21304: rtnl_addr_alloc_cache (addr.c:650)
==9134==    by 0x3000C068F2: netlink_init (dutil_linux.c:96)
==9134==    by 0x3000C0A5EE: drv_init (drv_redhat.c:372)
==9134==    by 0x4F8318: interfaceOpenInterface (interface_backend_netcf.c:166)
==9134== 
==9134== 160 bytes in 2 blocks are definitely lost in loss record 1,146 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x3003E59E7D: virAlloc (memory.c:100)
==9134==    by 0x3003E71CA7: virLastErrorObject (virterror.c:204)
==9134==    by 0x3003E725E8: virResetLastError (virterror.c:355)
==9134==    by 0x3003EF6A4E: virConnectOpen (libvirt.c:1332)
==9134==    by 0x4411D7: remoteDispatchOpenHelper (remote.c:792)
==9134==    by 0x3003F457B1: virNetServerProgramDispatch (virnetserverprogram.c:431)
==9134==    by 0x3003F43FFD: virNetServerProcessMsg (virnetserver.c:170)
==9134==    by 0x3003F4469B: virNetServerHandleJob (virnetserver.c:191)
==9134==    by 0x3003E64B3B: virThreadPoolWorker (threadpool.c:144)
==9134==    by 0x3003E64428: virThreadHelper (threads-pthread.c:161)
==9134==    by 0x35B96079D0: start_thread (pthread_create.c:301)
==9134== 
==9134== 240 bytes in 3 blocks are definitely lost in loss record 1,319 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x3003E59E7D: virAlloc (memory.c:100)
==9134==    by 0x3003E71CA7: virLastErrorObject (virterror.c:204)
==9134==    by 0x3003E725E8: virResetLastError (virterror.c:355)
==9134==    by 0x3003F05B15: virDomainGetState (libvirt.c:4267)
==9134==    by 0x42F1A4: remoteDispatchDomainGetStateHelper (remote.c:3364)
==9134==    by 0x3003F457B1: virNetServerProgramDispatch (virnetserverprogram.c:431)
==9134==    by 0x3003F43FFD: virNetServerProcessMsg (virnetserver.c:170)
==9134==    by 0x3003F4469B: virNetServerHandleJob (virnetserver.c:191)
==9134==    by 0x3003E64B3B: virThreadPoolWorker (threadpool.c:144)
==9134==    by 0x3003E64428: virThreadHelper (threads-pthread.c:161)
==9134==    by 0x35B96079D0: start_thread (pthread_create.c:301)
==9134== 
==9134== 368 bytes in 1 blocks are possibly lost in loss record 1,385 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35B8A118F2: _dl_allocate_tls (dl-tls.c:322)
==9134==    by 0x35B96071E8: pthread_create@@GLIBC_2.2.5 (allocatestack.c:571)
==9134==    by 0x3003E64530: virThreadCreate (threads-pthread.c:188)
==9134==    by 0x3003E64E93: virThreadPoolNew (threadpool.c:203)
==9134==    by 0x3003F44C39: virNetServerNew (virnetserver.c:376)
==9134==    by 0x423E26: main (libvirtd.c:1089)
==9134== 
==9134== 720 bytes in 5 blocks are possibly lost in loss record 1,487 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE1D350: nl_object_alloc (object.c:49)
==9134==    by 0x35CEE21364: addr_msg_parser (addr.c:194)
==9134==    by 0x35CEE17B3A: nl_cache_parse (cache.c:636)
==9134==    by 0x35CEE1C641: nl_recvmsgs (netlink-local.h:342)
==9134==    by 0x35CEE17E95: __cache_pickup (cache.c:479)
==9134==    by 0x35CEE1807B: nl_cache_pickup (cache.c:512)
==9134==    by 0x35CEE21304: rtnl_addr_alloc_cache (addr.c:650)
==9134==    by 0x3000C068F2: netlink_init (dutil_linux.c:96)
==9134==    by 0x3000C0A5EE: drv_init (drv_redhat.c:372)
==9134==    by 0x4F8318: interfaceOpenInterface (interface_backend_netcf.c:166)
==9134==    by 0x3003EF5DFA: do_open (libvirt.c:1212)
==9134== 
==9134== 1,600 bytes in 4 blocks are possibly lost in loss record 1,558 of 1,676
==9134==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9134==    by 0x35CEE1D350: nl_object_alloc (object.c:49)
==9134==    by 0x35CEE24D37: link_msg_parser (link.c:266)
==9134==    by 0x35CEE17B3A: nl_cache_parse (cache.c:636)
==9134==    by 0x35CEE1C641: nl_recvmsgs (netlink-local.h:342)
==9134==    by 0x35CEE17E95: __cache_pickup (cache.c:479)
==9134==    by 0x35CEE1807B: nl_cache_pickup (cache.c:512)
==9134==    by 0x35CEE24144: rtnl_link_alloc_cache (link.c:877)
==9134==    by 0x3000C068DA: netlink_init (dutil_linux.c:82)
==9134==    by 0x3000C0A5EE: drv_init (drv_redhat.c:372)
==9134==    by 0x4F8318: interfaceOpenInterface (interface_backend_netcf.c:166)
==9134==    by 0x3003EF5DFA: do_open (libvirt.c:1212)
==9134== 
==9134== 1,936 bytes in 2 blocks are definitely lost in loss record 1,573 of 1,676
==9134==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9134==    by 0x3007EA44A4: xmlGetGlobalState (threads.c:582)
==9134==    by 0x3007EA35E4: __xmlGenericError (globals.c:868)
==9134==    by 0x3007EE7BA6: xmlRelaxNGNewParserCtxt (relaxng.c:6737)
==9134==    by 0x3000C059FC: rng_parse (dutil.c:262)
==9134==    by 0x3000C04C25: ncf_init (netcf.c:84)
==9134==    by 0x4F8318: interfaceOpenInterface (interface_backend_netcf.c:166)
==9134==    by 0x3003EF5DFA: do_open (libvirt.c:1212)
==9134==    by 0x3003EF6A5A: virConnectOpen (libvirt.c:1333)
==9134==    by 0x4411D7: remoteDispatchOpenHelper (remote.c:792)
==9134==    by 0x3003F457B1: virNetServerProgramDispatch (virnetserverprogram.c:431)
==9134==    by 0x3003F43FFD: virNetServerProcessMsg (virnetserver.c:170)
==9134== 
==9134== LEAK SUMMARY:
==9134==    definitely lost: 2,496 bytes in 9 blocks
==9134==    indirectly lost: 0 bytes in 0 blocks
==9134==      possibly lost: 3,525 bytes in 45 blocks
==9134==    still reachable: 1,643,210 bytes in 14,352 blocks
==9134==         suppressed: 0 bytes in 0 blocks
==9134== Reachable blocks (those to which a pointer was found) are not shown.
==9134== To see them, rerun with: --leak-check=full --show-reachable=yes
==9134== 
==9134== For counts of detected and suppressed errors, rerun with: -v
==9134== Use --track-origins=yes to see where uninitialised values come from
==9134== ERROR SUMMARY: 33 errors from 33 contexts (suppressed: 34 from 9)
==9135== 
==9135== HEAP SUMMARY:
==9135==     in use at exit: 1,649,352 bytes in 14,409 blocks
==9135==   total heap usage: 170,629 allocs, 156,221 frees, 722,534,005 bytes allocated
==9135== 
==9135== Thread 1:
==9135== 5 bytes in 1 blocks are possibly lost in loss record 105 of 1,679
==9135==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9135==    by 0x35B8E80E91: strdup (strdup.c:43)
==9135==    by 0x35CEE2C71B: add_proto_name (netlink-local.h:140)
==9135==    by 0x35CEE2C7E4: init_proto_names (route_utils.c:108)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 5 bytes in 1 blocks are possibly lost in loss record 106 of 1,679
==9135==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9135==    by 0x35B8E80E91: strdup (strdup.c:43)
==9135==    by 0x35CEE2C43B: add_routing_table_name (netlink-local.h:140)
==9135==    by 0x35CEE2C4F3: init_routing_table_names (route_utils.c:62)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 6 bytes in 1 blocks are possibly lost in loss record 135 of 1,679
==9135==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9135==    by 0x35B8E80E91: strdup (strdup.c:43)
==9135==    by 0x35CEE2C43B: add_routing_table_name (netlink-local.h:140)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 7 bytes in 1 blocks are possibly lost in loss record 170 of 1,679
==9135==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9135==    by 0x35B8E80E91: strdup (strdup.c:43)
==9135==    by 0x35CEE2C71B: add_proto_name (netlink-local.h:140)
==9135==    by 0x35CEE2C7B1: init_proto_names (route_utils.c:105)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 7 bytes in 1 blocks are possibly lost in loss record 171 of 1,679
==9135==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9135==    by 0x35B8E80E91: strdup (strdup.c:43)
==9135==    by 0x35CEE2C71B: add_proto_name (netlink-local.h:140)
==9135==    by 0x35CEE2C7D3: init_proto_names (route_utils.c:107)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 7 bytes in 1 blocks are possibly lost in loss record 172 of 1,679
==9135==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9135==    by 0x35B8E80E91: strdup (strdup.c:43)
==9135==    by 0x35CEE2C71B: add_proto_name (netlink-local.h:140)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 7 bytes in 1 blocks are possibly lost in loss record 173 of 1,679
==9135==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9135==    by 0x35B8E80E91: strdup (strdup.c:43)
==9135==    by 0x35CEE2C43B: add_routing_table_name (netlink-local.h:140)
==9135==    by 0x35CEE2C4D1: init_routing_table_names (route_utils.c:60)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 8 bytes in 1 blocks are possibly lost in loss record 234 of 1,679
==9135==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9135==    by 0x35B8E80E91: strdup (strdup.c:43)
==9135==    by 0x35CEE2C43B: add_routing_table_name (netlink-local.h:140)
==9135==    by 0x35CEE2C4E2: init_routing_table_names (route_utils.c:61)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 9 bytes in 1 blocks are possibly lost in loss record 270 of 1,679
==9135==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9135==    by 0x35B8E80E91: strdup (strdup.c:43)
==9135==    by 0x35CEE2C71B: add_proto_name (netlink-local.h:140)
==9135==    by 0x35CEE2C7C2: init_proto_names (route_utils.c:106)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 32 bytes in 1 blocks are possibly lost in loss record 658 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE2C707: add_proto_name (netlink-local.h:135)
==9135==    by 0x35CEE2C7B1: init_proto_names (route_utils.c:105)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 32 bytes in 1 blocks are possibly lost in loss record 659 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE2C707: add_proto_name (netlink-local.h:135)
==9135==    by 0x35CEE2C7C2: init_proto_names (route_utils.c:106)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 32 bytes in 1 blocks are possibly lost in loss record 660 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE2C707: add_proto_name (netlink-local.h:135)
==9135==    by 0x35CEE2C7D3: init_proto_names (route_utils.c:107)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 32 bytes in 1 blocks are possibly lost in loss record 661 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE2C707: add_proto_name (netlink-local.h:135)
==9135==    by 0x35CEE2C7E4: init_proto_names (route_utils.c:108)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 32 bytes in 1 blocks are possibly lost in loss record 662 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE2C707: add_proto_name (netlink-local.h:135)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 32 bytes in 1 blocks are possibly lost in loss record 663 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE2C427: add_routing_table_name (netlink-local.h:135)
==9135==    by 0x35CEE2C4D1: init_routing_table_names (route_utils.c:60)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 32 bytes in 1 blocks are possibly lost in loss record 664 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE2C427: add_routing_table_name (netlink-local.h:135)
==9135==    by 0x35CEE2C4E2: init_routing_table_names (route_utils.c:61)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 32 bytes in 1 blocks are possibly lost in loss record 665 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE2C427: add_routing_table_name (netlink-local.h:135)
==9135==    by 0x35CEE2C4F3: init_routing_table_names (route_utils.c:62)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 32 bytes in 1 blocks are possibly lost in loss record 666 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE2C427: add_routing_table_name (netlink-local.h:135)
==9135==    by 0x35CEE3ADB5: ??? (in /lib64/libnl.so.1.1.4)
==9135==    by 0x35CEE13782: ??? (in /lib64/libnl.so.1.1.4)
==9135== 
==9135== 40 bytes in 1 blocks are possibly lost in loss record 777 of 1,679
==9135==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9135==    by 0x35C820D60B: _PR_Getfd (prfdcach.c:112)
==9135==    by 0x35C8225094: pt_SetMethods (ptio.c:3303)
==9135==    by 0x35C8225468: PR_OpenFile (ptio.c:3581)
==9135==    by 0x4E8A9D7: blapi_SHVerifyFile (shvfy.c:356)
==9135==    by 0x4E8AD6E: blapi_SHVerify (shvfy.c:290)
==9135==    by 0x4E75338: bl_startup_tests (fipsfreebl.c:1541)
==9135==    by 0x4EB3E55: ??? (in /lib64/libfreebl3.so)
==9135==    by 0x4E629C2: ??? (in /lib64/libfreebl3.so)
==9135== 
==9135== 48 bytes in 1 blocks are possibly lost in loss record 853 of 1,679
==9135==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9135==    by 0x35C820D5F9: _PR_Getfd (prfdcach.c:109)
==9135==    by 0x35C8225094: pt_SetMethods (ptio.c:3303)
==9135==    by 0x35C8225468: PR_OpenFile (ptio.c:3581)
==9135==    by 0x4E8A9D7: blapi_SHVerifyFile (shvfy.c:356)
==9135==    by 0x4E8AD6E: blapi_SHVerify (shvfy.c:290)
==9135==    by 0x4E75338: bl_startup_tests (fipsfreebl.c:1541)
==9135==    by 0x4EB3E55: ??? (in /lib64/libfreebl3.so)
==9135==    by 0x4E629C2: ??? (in /lib64/libfreebl3.so)
==9135== 
==9135== 48 bytes in 2 blocks are possibly lost in loss record 854 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE15C0E: nl_addr_alloc (addr.c:168)
==9135==    by 0x35CEE16357: nl_addr_build (addr.c:191)
==9135==    by 0x35CEE214AD: addr_msg_parser (addr.c:263)
==9135==    by 0x35CEE17B3A: nl_cache_parse (cache.c:636)
==9135==    by 0x35CEE1C641: nl_recvmsgs (netlink-local.h:342)
==9135==    by 0x35CEE17E95: __cache_pickup (cache.c:479)
==9135==    by 0x35CEE1807B: nl_cache_pickup (cache.c:512)
==9135==    by 0x35CEE21304: rtnl_addr_alloc_cache (addr.c:650)
==9135==    by 0x3000C068F2: netlink_init (dutil_linux.c:96)
==9135==    by 0x3000C0A5EE: drv_init (drv_redhat.c:372)
==9135==    by 0x4F8318: interfaceOpenInterface (interface_backend_netcf.c:166)
==9135== 
==9135== 80 bytes in 1 blocks are definitely lost in loss record 988 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x3003E59E7D: virAlloc (memory.c:100)
==9135==    by 0x3003E71CA7: virLastErrorObject (virterror.c:204)
==9135==    by 0x3003E725E8: virResetLastError (virterror.c:355)
==9135==    by 0x3003EF5689: virConnectGetURI (libvirt.c:1702)
==9135==    by 0x4378D2: remoteDispatchGetURIHelper (remote_dispatch.h:7317)
==9135==    by 0x3003F457B1: virNetServerProgramDispatch (virnetserverprogram.c:431)
==9135==    by 0x3003F43FFD: virNetServerProcessMsg (virnetserver.c:170)
==9135==    by 0x3003F4469B: virNetServerHandleJob (virnetserver.c:191)
==9135==    by 0x3003E64B3B: virThreadPoolWorker (threadpool.c:144)
==9135==    by 0x3003E64428: virThreadHelper (threads-pthread.c:161)
==9135==    by 0x35B96079D0: start_thread (pthread_create.c:301)
==9135== 
==9135== 80 bytes in 1 blocks are definitely lost in loss record 989 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x3003E59E7D: virAlloc (memory.c:100)
==9135==    by 0x3003E71CA7: virLastErrorObject (virterror.c:204)
==9135==    by 0x3003E725E8: virResetLastError (virterror.c:355)
==9135==    by 0x3003EF0AC2: virDomainLookupByName (libvirt.c:2119)
==9135==    by 0x43F4FD: remoteDispatchDomainLookupByNameHelper (remote_dispatch.h:3105)
==9135==    by 0x3003F457B1: virNetServerProgramDispatch (virnetserverprogram.c:431)
==9135==    by 0x3003F43FFD: virNetServerProcessMsg (virnetserver.c:170)
==9135==    by 0x3003F4469B: virNetServerHandleJob (virnetserver.c:191)
==9135==    by 0x3003E64B3B: virThreadPoolWorker (threadpool.c:144)
==9135==    by 0x3003E64428: virThreadHelper (threads-pthread.c:161)
==9135==    by 0x35B96079D0: start_thread (pthread_create.c:301)
==9135== 
==9135== 104 bytes in 4 blocks are possibly lost in loss record 1,055 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE15C0E: nl_addr_alloc (addr.c:168)
==9135==    by 0x35CEE16357: nl_addr_build (addr.c:191)
==9135==    by 0x35CEE24EED: link_msg_parser (link.c:335)
==9135==    by 0x35CEE17B3A: nl_cache_parse (cache.c:636)
==9135==    by 0x35CEE1C641: nl_recvmsgs (netlink-local.h:342)
==9135==    by 0x35CEE17E95: __cache_pickup (cache.c:479)
==9135==    by 0x35CEE1807B: nl_cache_pickup (cache.c:512)
==9135==    by 0x35CEE24144: rtnl_link_alloc_cache (link.c:877)
==9135==    by 0x3000C068DA: netlink_init (dutil_linux.c:82)
==9135==    by 0x3000C0A5EE: drv_init (drv_redhat.c:372)
==9135==    by 0x4F8318: interfaceOpenInterface (interface_backend_netcf.c:166)
==9135== 
==9135== 104 bytes in 4 blocks are possibly lost in loss record 1,056 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE15C0E: nl_addr_alloc (addr.c:168)
==9135==    by 0x35CEE16357: nl_addr_build (addr.c:191)
==9135==    by 0x35CEE24F25: link_msg_parser (link.c:344)
==9135==    by 0x35CEE17B3A: nl_cache_parse (cache.c:636)
==9135==    by 0x35CEE1C641: nl_recvmsgs (netlink-local.h:342)
==9135==    by 0x35CEE17E95: __cache_pickup (cache.c:479)
==9135==    by 0x35CEE1807B: nl_cache_pickup (cache.c:512)
==9135==    by 0x35CEE24144: rtnl_link_alloc_cache (link.c:877)
==9135==    by 0x3000C068DA: netlink_init (dutil_linux.c:82)
==9135==    by 0x3000C0A5EE: drv_init (drv_redhat.c:372)
==9135==    by 0x4F8318: interfaceOpenInterface (interface_backend_netcf.c:166)
==9135== 
==9135== 144 bytes in 5 blocks are possibly lost in loss record 1,142 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE15C0E: nl_addr_alloc (addr.c:168)
==9135==    by 0x35CEE16357: nl_addr_build (addr.c:191)
==9135==    by 0x35CEE21452: addr_msg_parser (addr.c:241)
==9135==    by 0x35CEE17B3A: nl_cache_parse (cache.c:636)
==9135==    by 0x35CEE1C641: nl_recvmsgs (netlink-local.h:342)
==9135==    by 0x35CEE17E95: __cache_pickup (cache.c:479)
==9135==    by 0x35CEE1807B: nl_cache_pickup (cache.c:512)
==9135==    by 0x35CEE21304: rtnl_addr_alloc_cache (addr.c:650)
==9135==    by 0x3000C068F2: netlink_init (dutil_linux.c:96)
==9135==    by 0x3000C0A5EE: drv_init (drv_redhat.c:372)
==9135==    by 0x4F8318: interfaceOpenInterface (interface_backend_netcf.c:166)
==9135== 
==9135== 160 bytes in 2 blocks are definitely lost in loss record 1,149 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x3003E59E7D: virAlloc (memory.c:100)
==9135==    by 0x3003E71CA7: virLastErrorObject (virterror.c:204)
==9135==    by 0x3003E725E8: virResetLastError (virterror.c:355)
==9135==    by 0x3003EF6A4E: virConnectOpen (libvirt.c:1332)
==9135==    by 0x4411D7: remoteDispatchOpenHelper (remote.c:792)
==9135==    by 0x3003F457B1: virNetServerProgramDispatch (virnetserverprogram.c:431)
==9135==    by 0x3003F43FFD: virNetServerProcessMsg (virnetserver.c:170)
==9135==    by 0x3003F4469B: virNetServerHandleJob (virnetserver.c:191)
==9135==    by 0x3003E64B3B: virThreadPoolWorker (threadpool.c:144)
==9135==    by 0x3003E64428: virThreadHelper (threads-pthread.c:161)
==9135==    by 0x35B96079D0: start_thread (pthread_create.c:301)
==9135== 
==9135== 240 bytes in 3 blocks are definitely lost in loss record 1,322 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x3003E59E7D: virAlloc (memory.c:100)
==9135==    by 0x3003E71CA7: virLastErrorObject (virterror.c:204)
==9135==    by 0x3003E725E8: virResetLastError (virterror.c:355)
==9135==    by 0x3003F05B15: virDomainGetState (libvirt.c:4267)
==9135==    by 0x42F1A4: remoteDispatchDomainGetStateHelper (remote.c:3364)
==9135==    by 0x3003F457B1: virNetServerProgramDispatch (virnetserverprogram.c:431)
==9135==    by 0x3003F43FFD: virNetServerProcessMsg (virnetserver.c:170)
==9135==    by 0x3003F4469B: virNetServerHandleJob (virnetserver.c:191)
==9135==    by 0x3003E64B3B: virThreadPoolWorker (threadpool.c:144)
==9135==    by 0x3003E64428: virThreadHelper (threads-pthread.c:161)
==9135==    by 0x35B96079D0: start_thread (pthread_create.c:301)
==9135== 
==9135== 368 bytes in 1 blocks are possibly lost in loss record 1,388 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35B8A118F2: _dl_allocate_tls (dl-tls.c:322)
==9135==    by 0x35B96071E8: pthread_create@@GLIBC_2.2.5 (allocatestack.c:571)
==9135==    by 0x3003E64530: virThreadCreate (threads-pthread.c:188)
==9135==    by 0x3003E64E93: virThreadPoolNew (threadpool.c:203)
==9135==    by 0x3003F44C39: virNetServerNew (virnetserver.c:376)
==9135==    by 0x423E26: main (libvirtd.c:1089)
==9135== 
==9135== 720 bytes in 5 blocks are possibly lost in loss record 1,490 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE1D350: nl_object_alloc (object.c:49)
==9135==    by 0x35CEE21364: addr_msg_parser (addr.c:194)
==9135==    by 0x35CEE17B3A: nl_cache_parse (cache.c:636)
==9135==    by 0x35CEE1C641: nl_recvmsgs (netlink-local.h:342)
==9135==    by 0x35CEE17E95: __cache_pickup (cache.c:479)
==9135==    by 0x35CEE1807B: nl_cache_pickup (cache.c:512)
==9135==    by 0x35CEE21304: rtnl_addr_alloc_cache (addr.c:650)
==9135==    by 0x3000C068F2: netlink_init (dutil_linux.c:96)
==9135==    by 0x3000C0A5EE: drv_init (drv_redhat.c:372)
==9135==    by 0x4F8318: interfaceOpenInterface (interface_backend_netcf.c:166)
==9135==    by 0x3003EF5DFA: do_open (libvirt.c:1212)
==9135== 
==9135== 1,600 bytes in 4 blocks are possibly lost in loss record 1,561 of 1,679
==9135==    at 0x4A057BB: calloc (vg_replace_malloc.c:593)
==9135==    by 0x35CEE1D350: nl_object_alloc (object.c:49)
==9135==    by 0x35CEE24D37: link_msg_parser (link.c:266)
==9135==    by 0x35CEE17B3A: nl_cache_parse (cache.c:636)
==9135==    by 0x35CEE1C641: nl_recvmsgs (netlink-local.h:342)
==9135==    by 0x35CEE17E95: __cache_pickup (cache.c:479)
==9135==    by 0x35CEE1807B: nl_cache_pickup (cache.c:512)
==9135==    by 0x35CEE24144: rtnl_link_alloc_cache (link.c:877)
==9135==    by 0x3000C068DA: netlink_init (dutil_linux.c:82)
==9135==    by 0x3000C0A5EE: drv_init (drv_redhat.c:372)
==9135==    by 0x4F8318: interfaceOpenInterface (interface_backend_netcf.c:166)
==9135==    by 0x3003EF5DFA: do_open (libvirt.c:1212)
==9135== 
==9135== 1,936 bytes in 2 blocks are definitely lost in loss record 1,576 of 1,679
==9135==    at 0x4A06A2E: malloc (vg_replace_malloc.c:270)
==9135==    by 0x3007EA44A4: xmlGetGlobalState (threads.c:582)
==9135==    by 0x3007EA35E4: __xmlGenericError (globals.c:868)
==9135==    by 0x3007EE7BA6: xmlRelaxNGNewParserCtxt (relaxng.c:6737)
==9135==    by 0x3000C059FC: rng_parse (dutil.c:262)
==9135==    by 0x3000C04C25: ncf_init (netcf.c:84)
==9135==    by 0x4F8318: interfaceOpenInterface (interface_backend_netcf.c:166)
==9135==    by 0x3003EF5DFA: do_open (libvirt.c:1212)
==9135==    by 0x3003EF6A5A: virConnectOpen (libvirt.c:1333)
==9135==    by 0x4411D7: remoteDispatchOpenHelper (remote.c:792)
==9135==    by 0x3003F457B1: virNetServerProgramDispatch (virnetserverprogram.c:431)
==9135==    by 0x3003F43FFD: virNetServerProcessMsg (virnetserver.c:170)
==9135== 
==9135== LEAK SUMMARY:
==9135==    definitely lost: 2,496 bytes in 9 blocks
==9135==    indirectly lost: 0 bytes in 0 blocks
==9135==      possibly lost: 3,525 bytes in 45 blocks
==9135==    still reachable: 1,643,331 bytes in 14,355 blocks
==9135==         suppressed: 0 bytes in 0 blocks
==9135== Reachable blocks (those to which a pointer was found) are not shown.
==9135== To see them, rerun with: --leak-check=full --show-reachable=yes
==9135== 
==9135== For counts of detected and suppressed errors, rerun with: -v
==9135== Use --track-origins=yes to see where uninitialised values come from
==9135== ERROR SUMMARY: 35 errors from 35 contexts (suppressed: 34 from 9)
2014-10-08 09:31:05.979+0000: 9013: info : libvirt version: 0.10.2, package: 46.el6 (Red Hat, Inc. <http://bugzilla.redhat.com/bugzilla>, 2014-09-09-07:49:04, x86-022.build.eng.bos.redhat.com)
2014-10-08 09:31:05.979+0000: 9013: error : virCommandHandshakeWait:2460 : internal error Failed to open socket to sanlock daemon: Permission denied

Comment 31 Michal Privoznik 2014-10-08 12:27:53 UTC

(In reply to dyuan from comment #30)
> The error is different from the comment 28 when run libvirtd under valgrind.
> 
> # virsh start rhel6
> error: Failed to start domain rhel6
> error: internal error Failed to open socket to sanlock daemon: Permission
> denied
> 
> # valgrind --leak-check=full --read-var-info=yes $(which libvirtd)
> ==9000== Memcheck, a memory error detector
> ==9000== Copyright (C) 2002-2012, and GNU GPL'd, by Julian Seward et al.
> ==9000== Using Valgrind-3.8.1 and LibVEX; rerun with -h for copyright info
> ==9000== Command: /usr/sbin/libvirtd
> ==9000== 
> ==9000== Thread 12:
> ==9000== Syscall param socketcall.sendto(msg) points to uninitialised byte(s)
> ==9000==    at 0x35B960ECDC: send (send.c:33)
> ==9000==    by 0x151DE6BB: cmd_lockspace (client.c:134)
> ==9000==    by 0x14FCD1A5: virLockManagerSanlockSetupLockspace
> (lock_driver_sanlock.c:337)
> ==9000==    by 0x14FCDC18: virLockManagerSanlockInit
> (lock_driver_sanlock.c:422)
> ==9000==    by 0x3003F0EC33: virLockManagerPluginNew (lock_manager.c:175)
> ==9000==    by 0x4AFA90: qemudLoadDriverConfig (qemu_conf.c:589)
> ==9000==    by 0x44CA56: qemudStartup (qemu_driver.c:767)
> ==9000==    by 0x3003EF6B8A: virStateInitialize (libvirt.c:796)
> ==9000==    by 0x423380: daemonRunStateInit (libvirtd.c:739)
> ==9000==    by 0x3003E64428: virThreadHelper (threads-pthread.c:161)
> ==9000==    by 0x35B96079D0: start_thread (pthread_create.c:301)
> ==9000==    by 0x35B8EE89DC: clone (clone.S:115)
> ==9000==  Location 0x131a425c is 60 bytes inside local var "ls"
> ==9000==  declared at lock_driver_sanlock.c:200, in frame #2 of thread 12
> ==9000== 
> ==9000== Warning: noted but unhandled ioctl 0x89a2 with no size/direction
> hints
> ==9000==    This could cause spurious value errors to appear.
> ==9000==    See README_MISSING_SYSCALL_OR_IOCTL for guidance on writing a
> proper wrapper.
> ==9134== 
> ==9134== HEAP SUMMARY:
> ==9134==     in use at exit: 1,649,231 bytes in 14,406 blocks
> ==9134==   total heap usage: 170,494 allocs, 156,088 frees, 722,520,171
> bytes allocated
> ==9134== 
> ==9135== Thread 6:
> ==9135== Conditional jump or move depends on uninitialised value(s)
> ==9135==    at 0x4A063E3: free (vg_replace_malloc.c:446)
> ==9135==    by 0x3003E59DD8: virFree (memory.c:419)
> ==9135==    by 0x14FCC686: virLockManagerSanlockAcquire
> (lock_driver_sanlock.c:1051)
> ==9135==    by 0x3003F0F96A: virDomainLockProcessStart (domain_lock.c:178)
> ==9135==    by 0x4AA631: qemuProcessHook (qemu_process.c:2851)
> ==9135==    by 0x3003E48BC2: virCommandHook (command.c:2088)
> ==9135==    by 0x3003E4AC8C: virExecWithHook.clone.0 (command.c:630)
> ==9135==    by 0x3003E4B52E: virCommandRunAsync (command.c:2232)
> ==9135==    by 0x3003E4B968: virCommandRun (command.c:2018)
> ==9135==    by 0x4ACBDD: qemuProcessStart (qemu_process.c:4081)
> ==9135==    by 0x46C83D: qemuDomainObjStart (qemu_driver.c:6124)
> ==9135==    by 0x46CE71: qemuDomainStartWithFlags (qemu_driver.c:6181)
> ==9135== 
> ==9135== Invalid free() / delete / delete[] / realloc()
> ==9135==    at 0x4A06430: free (vg_replace_malloc.c:446)
> ==9135==    by 0x3003E59DD8: virFree (memory.c:419)
> ==9135==    by 0x14FCC686: virLockManagerSanlockAcquire
> (lock_driver_sanlock.c:1051)
> ==9135==    by 0x3003F0F96A: virDomainLockProcessStart (domain_lock.c:178)
> ==9135==    by 0x4AA631: qemuProcessHook (qemu_process.c:2851)
> ==9135==    by 0x3003E48BC2: virCommandHook (command.c:2088)
> ==9135==    by 0x3003E4AC8C: virExecWithHook.clone.0 (command.c:630)
> ==9135==    by 0x3003E4B52E: virCommandRunAsync (command.c:2232)
> ==9135==    by 0x3003E4B968: virCommandRun (command.c:2018)
> ==9135==    by 0x4ACBDD: qemuProcessStart (qemu_process.c:4081)
> ==9135==    by 0x46C83D: qemuDomainObjStart (qemu_driver.c:6124)
> ==9135==    by 0x46CE71: qemuDomainStartWithFlags (qemu_driver.c:6181)
> ==9135==  Address 0x4 is not stack'd, malloc'd or (recently) free'd

Yeah, this is the very same stacktrace as in 1136788#c0. I'm closing this one.

*** This bug has been marked as a duplicate of bug 1136788 ***

Note You need to log in before you can comment on or make changes to this bug.

bazulay
danken
dyuan
ecohen
eedri
gklein
iheim
jdenemar
lpeer
lsurette
mgrepl
michal.skrivanek
mmalik
mpavlik
mprivozn
myakove
mzhan
nsednev
ofrenkel
pzhang
rbalakri
xuzhang
yeylon