[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [Xen-users] xen/libvirt freeze while attching network-device to vmÂs
Hi, first sorry for the cross-posting, but i don Ìt known exactly if my problem belongs to xen or libvirt. I have an VM-Host with Xen 4.6.0 und libvirt 1.2.19. The Job of the Host is to resume in parallel 20 VM Ìs (HVM WinXp) attach a block-device to each VM , wait 60 Seconds, kill the VM and start from beginning. For that, a python script create for each vm a thread and each thread get a connection to the Libvirt-Daemon via "libvirt.open(None)" and do the resume, attach and so on in a loop. This Setup works fine, it do several thousand cycle without any problems. If i complement this setup, so that each vm get , additonal to the blockdevice an network-interface after resume, via "attachDevice" call from the python-script, i observe that libvirtd/xen freeze after 20 to 100 cycle. Their are no error-messages, no crash, noting in "dmesg" or "xl dmesg". When i attached to the libvirtd via gdb and do a "info thread", i get the following: Id Target Id Frame 21 Thread 0x7f792a92c700 (LWP 1312) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 20 Thread 0x7f792a12b700 (LWP 1313) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 19 Thread 0x7f792992a700 (LWP 1314) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 18 Thread 0x7f7929129700 (LWP 1315) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 17 Thread 0x7f7928928700 (LWP 1316) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 16 Thread 0x7f791bfff700 (LWP 1317) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 15 Thread 0x7f791b7fe700 (LWP 1318) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 14 Thread 0x7f791affd700 (LWP 1319) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 13 Thread 0x7f791a7fc700 (LWP 1320) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 12 Thread 0x7f7919ffb700 (LWP 1321) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 11 Thread 0x7f78fd6ff700 (LWP 1334) "libvirtd" pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 10 Thread 0x7f78fcefe700 (LWP 1335) "libvirtd" pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 9 Thread 0x7f78f3fff700 (LWP 1336) "libvirtd" pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 8 Thread 0x7f78ebfff700 (LWP 1337) "libvirtd" pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 7 Thread 0x7f78f37fe700 (LWP 1338) "libvirtd" pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 6 Thread 0x7f793bf94700 (LWP 1494) "libvirtd" 0x00007f79375c87fd in read () at ../sysdeps/unix/syscall-template.S:81 5 Thread 0x7f78f241d700 (LWP 17709) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 4 Thread 0x7f78f1c1c700 (LWP 17717) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 3 Thread 0x7f78f141b700 (LWP 17722) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 2 Thread 0x7f78f0c1a700 (LWP 17751) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 * 1 Thread 0x7f793c0428c0 (LWP 1269) "libvirtd" __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 i start to examine at thread 1 and get the fowlling bt: #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b71d7 in virDomainObjListFindByID (doms=0x7f78d80edd20, id=1) at conf/domain_conf.c:1237 #6 0x00007f78fe3f7eb3 in libxlDomainEventHandler (data=0x7f78d81ce940, event=0x7f793c30c2e0) at libxl/libxl_domain.c:534 #7 0x00007f793806f7c0 in egc_run_callbacks (egc=egc@entry=0x7ffdb79c7490) at libxl_event.c:1405 #8 0x00007f793806fb9d in libxl__egc_cleanup (egc=0x7ffdb79c7490) at libxl_event.c:1436 #9 libxl_osevent_occurred_fd (ctx=<optimized out>, for_libxl=0x7f78d80ec220, fd=27, events_ign=<optimized out>, revents_ign=<optimized out>) at libxl_event.c:1339 #10 0x00007f78fe3f9ac5 in libxlFDEventCallback (watch=11, fd=27, vir_events=1, fd_info=0x7f78d811c430) at libxl/libxl_driver.c:134 #11 0x00007f793b04a9c4 in virEventPollDispatchHandles (nfds=31, fds=0x7f793c30b510) at util/vireventpoll.c:509 #12 0x00007f793b04b224 in virEventPollRunOnce () at util/vireventpoll.c:658 #13 0x00007f793b0490cd in virEventRunDefaultImpl () at util/virevent.c:308 #14 0x00007f793b1f5ab6 in virNetDaemonRun (dmn=0x7f793c2e1b80) at rpc/virnetdaemon.c:701 #15 0x00007f793be0bc27 in main (argc=1, argv=0x7ffdb79c7d78) at libvirtd.c:1577 i select frame 3 and look who holds the lock: (gdb) frame 3 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 89 pthread_mutex_lock(&m->lock); (gdb) p *m $5 = {lock = {__data = {__lock = 2, __count = 0, __owner = 1312, __nusers = 1, __kind = 512, __spins = 0, __elision = 0, __list = {__prev = 0x0, __next = 0x0}}, __size = "\002\000\000\000\000\000\000\000 \005\000\000\001\000\000\000\000\002", '\000' <repeats 21 times>, __align = 2}} i switch to frame 21 (LWP1312) i taek a look to the bt: (gdb) bt #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f79140099d0) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f79140099d0) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f79140099c0) at util/virobject.c:323 #5 0x00007f793b0b717f in virDomainObjListSearchID (payload=0x7f79140099c0, name=0x7f791400f7c0, data=0x7f792a92b464) at conf/domain_conf.c:1225 #6 0x00007f793b055f1e in virHashSearch (ctable=0x7f78d81ccc40, iter=0x7f793b0b7148 <virDomainObjListSearchID>, data=0x7f792a92b464) at util/virhash.c:724 #7 0x00007f793b0b71f2 in virDomainObjListFindByID (doms=0x7f78d80edd20, id=2) at conf/domain_conf.c:1238 #8 0x00007f78fe3f7eb3 in libxlDomainEventHandler (data=0x7f78d81ce940, event=0x7f791c005610) at libxl/libxl_domain.c:534 #9 0x00007f793806f7c0 in egc_run_callbacks (egc=egc@entry=0x7f792a92b580) at libxl_event.c:1405 #10 0x00007f7938070f8b in libxl__egc_cleanup (egc=0x7f792a92b580) at libxl_event.c:1436 #11 libxl__ao_inprogress (ao=ao@entry=0x7f791c00c6e0, file=file@entry=0x7f793808d512 "libxl.c", line=line@entry=4226, func=func@entry=0x7f7938090150 <__func__.20288> "libxl_device_nic_add") at libxl_event.c:2014 #12 0x00007f7938048fa6 in libxl_device_nic_add (ctx=0x7f78d8112830, domid=19, nic=0x7f792a92b6b0, ao_how=<optimized out>) at libxl.c:4226 #13 0x00007f78fe402baa in libxlDomainAttachNetDevice (driver=0x7f78d81ce940, vm=0x7f79140099c0, net=0x7f791c003610) at libxl/libxl_driver.c:3199 #14 0x00007f78fe402d12 in libxlDomainAttachDeviceLive (driver=0x7f78d81ce940, vm=0x7f79140099c0, dev=0x7f791c001350) at libxl/libxl_driver.c:3231 #15 0x00007f78fe404135 in libxlDomainAttachDeviceFlags (dom=0x7f791c009150, xml=0x7f791c009230 "<interface type=\"bridge\">\n <source bridge=\"xenbr0\" />\n <model type=\"rtl8139\" />\n <mac address=\"00:27:0e:0c:01:09\" />\n </interface>", flags=1) at libxl/libxl_driver.c:3707 #16 0x00007f78fe404239 in libxlDomainAttachDevice (dom=0x7f791c009150, xml=0x7f791c009230 "<interface type=\"bridge\">\n <source bridge=\"xenbr0\" />\n <model type=\"rtl8139\" />\n <mac address=\"00:27:0e:0c:01:09\" />\n </interface>") at libxl/libxl_driver.c:3745 #17 0x00007f793b18422c in virDomainAttachDevice (domain=0x7f791c009150, xml=0x7f791c009230 "<interface type=\"bridge\">\n <source bridge=\"xenbr0\" />\n <model type=\"rtl8139\" />\n <mac address=\"00:27:0e:0c:01:09\" />\n </interface>") at libvirt-domain.c:8351 #18 0x00007f793be11a1f in remoteDispatchDomainAttachDevice (server=0x7f793c2e0a90, client=0x7f793c2f34c0, msg=0x7f793c2feca0, rerr=0x7f792a92bab0, args=0x7f791c009190) at remote_dispatch.h:2850 #19 0x00007f793be11923 in remoteDispatchDomainAttachDeviceHelper (server=0x7f793c2e0a90, client=0x7f793c2f34c0, msg=0x7f793c2feca0, rerr=0x7f792a92bab0, args=0x7f791c009190, ret=0x7f791c009130) at remote_dispatch.h:2826 #20 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f34c0, msg=0x7f793c2feca0) at rpc/virnetserverprogram.c:437 #21 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f34c0, msg=0x7f793c2feca0) at rpc/virnetserverprogram.c:307 #22 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f34c0, prog=0x7f793c2eefd0, msg=0x7f793c2feca0) at rpc/virnetserver.c:135 #23 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c302c60, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #24 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0750) at util/virthreadpool.c:145 #25 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2eced0) at util/virthread.c:206 #26 0x00007f79375c1ee5 in start_thread (arg=0x7f792a92c700) at pthread_create.c:309 #27 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 here i select frame 3 and look who holds the lock: (gdb) frame 3 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f79140099d0) at util/virthread.c:89 89 pthread_mutex_lock(&m->lock); $6 = {lock = {__data = {__lock = 2, __count = 0, __owner = 1312, __nusers = 1, __kind = 512, __spins = 0, __elision = 0, __list = {__prev = 0x0, __next = 0x0}}, __size = "\002\000\000\000\000\000\000\000 \005\000\000\001\000\000\000\000\002", '\000' <repeats 21 times>, __align = 2}} so i see that thread 21 waits for a lock that holds by thread 21 from frame 4 i see, that the process want a lock for vm object: #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f79140099c0) at util/virobject.c:323 further down in the bt i see in frame 14: #14 0x00007f78fe402d12 in libxlDomainAttachDeviceLive (driver=0x7f78d81ce940, vm=0x7f79140099c0, dev=0x7f791c001350) at libxl/libxl_driver.c:3231 that vm-object 0x7f79140099c0 is the object for that also a network-device should be attached. And from that i know that there is a lock on the vm-object. so i go up in the bt an see that libxlDomainAttachDeviceLive(libvirtd) (frame14) calls libxlDomainAttachNetDevice(libvirtd) (frame13), that calls libxl_device_nic_add(libxl/xen) (frame12) from info frame for frame12 i see that he calls frame 0x7f792a92b5f0: (gdb) info f Stack level 12, frame at 0x7f792a92b670: rip = 0x7f7938048fa6 in libxl_device_nic_add (libxl.c:4226); saved rip = 0x7f78fe402baa called by frame at 0x7f792a92b760, caller of frame at 0x7f792a92b5f0 source language c. Arglist at 0x7f792a92b5e8, args: ctx=0x7f78d8112830, domid=19, nic=0x7f792a92b6b0, ao_how=<optimized out> Locals at 0x7f792a92b5e8, Previous frame's sp is 0x7f792a92b670 Saved registers: rbx at 0x7f792a92b640, rbp at 0x7f792a92b648, r12 at 0x7f792a92b650, r13 at 0x7f792a92b658, r14 at 0x7f792a92b660, rip at 0x7f792a92b668 and this is frame 11 libxl__ao_inprogress (ao=ao@entry=0x7f791c00c6e0, file=file@entry=0x7f793808d512 "libxl.c", line=line@entry=4226, func=func@entry=0x7f7938090150 <__func__.20288> "libxl_device_nic_add") at libxl_event.c:2014 so further i see that libxl__ao_inprogress calls libxl__egc_cleanup and that calls egc_run_callbacks, frame 9 info frame for frame 9 gives: (gdb) info f Stack level 9, frame at 0x7f792a92b540: rip = 0x7f793806f7c0 in egc_run_callbacks (libxl_event.c:1405); saved rip = 0x7f7938070f8b called by frame at 0x7f792a92b5f0, caller of frame at 0x7f792a92b500 source language c. Arglist at 0x7f792a92b4f8, args: egc=egc@entry=0x7f792a92b580 Locals at 0x7f792a92b4f8, Previous frame's sp is 0x7f792a92b540 Saved registers: rbx at 0x7f792a92b520, rbp at 0x7f792a92b528, r12 at 0x7f792a92b530, rip at 0x7f792a92b538 and list gives: (gdb) list 1400 1401 LIBXL_TAILQ_FOREACH_SAFE(ev, &egc->occurred_for_callback, link, ev_tmp) { 1402 LIBXL_TAILQ_REMOVE(&egc->occurred_for_callback, ev, link); 1403 LOG(DEBUG,"event %p callback type=%s", 1404 ev, libxl_event_type_to_string(ev->type)); 1405 CTX->event_hooks->event_occurs(CTX->event_hooks_user, ev); 1406 } 1407 1408 LIBXL_TAILQ_FOREACH_SAFE(aop, &egc->aops_for_callback, entry, aop_tmp) { 1409 LIBXL_TAILQ_REMOVE(&egc->aops_for_callback, aop, entry); from here i see that egc_run_callbacks is at line 1405 " CTX->event_hooks->event_occurs(CTX->event_hooks_user, ev);" , but i have no idea what he is doing there and while it "hangs" here!?! if i see it correctly, the systems freeze/hangs because it waits of the release of the lock for the vm which actuall attach a network-device, and the process of attaching the network-device didn Ìt finished and hold the lock. as i say at the geginning of my mail, if i only attach a block-device to the vm`s every thing runs, and with additional attaching a network-device after 20 to 100 resume , it freezeÂs. i am gratefull for any help,hints and tips for further debugging. all the best max for completness , here are the output of "(gdb) thread apply all bt full": Thread 21 (Thread 0x7f792a92c700 (LWP 1312)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f79140099d0) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f79140099d0) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f79140099c0) at util/virobject.c:323 #5 0x00007f793b0b717f in virDomainObjListSearchID (payload=0x7f79140099c0, name=0x7f791400f7c0, data=0x7f792a92b464) at conf/domain_conf.c:1225 #6 0x00007f793b055f1e in virHashSearch (ctable=0x7f78d81ccc40, iter=0x7f793b0b7148 <virDomainObjListSearchID>, data=0x7f792a92b464) at util/virhash.c:724 #7 0x00007f793b0b71f2 in virDomainObjListFindByID (doms=0x7f78d80edd20, id=2) at conf/domain_conf.c:1238 #8 0x00007f78fe3f7eb3 in libxlDomainEventHandler (data=0x7f78d81ce940, event=0x7f791c005610) at libxl/libxl_domain.c:534 #9 0x00007f793806f7c0 in egc_run_callbacks (egc=egc@entry=0x7f792a92b580) at libxl_event.c:1405 #10 0x00007f7938070f8b in libxl__egc_cleanup (egc=0x7f792a92b580) at libxl_event.c:1436 #11 libxl__ao_inprogress (ao=ao@entry=0x7f791c00c6e0, file=file@entry=0x7f793808d512 "libxl.c", line=line@entry=4226, func=func@entry=0x7f7938090150 <__func__.20288> "libxl_device_nic_add") at libxl_event.c:2014 #12 0x00007f7938048fa6 in libxl_device_nic_add (ctx=0x7f78d8112830, domid=19, nic=0x7f792a92b6b0, ao_how=<optimized out>) at libxl.c:4226 #13 0x00007f78fe402baa in libxlDomainAttachNetDevice (driver=0x7f78d81ce940, vm=0x7f79140099c0, net=0x7f791c003610) at libxl/libxl_driver.c:3199 #14 0x00007f78fe402d12 in libxlDomainAttachDeviceLive (driver=0x7f78d81ce940, vm=0x7f79140099c0, dev=0x7f791c001350) at libxl/libxl_driver.c:3231 #15 0x00007f78fe404135 in libxlDomainAttachDeviceFlags (dom=0x7f791c009150, xml=0x7f791c009230 "<interface type=\"bridge\">\n <source bridge=\"xenbr0\" />\n <model type=\"rtl8139\" />\n <mac address=\"00:27:0e:0c:01:09\" />\n </interface>", flags=1) at libxl/libxl_driver.c:3707 #16 0x00007f78fe404239 in libxlDomainAttachDevice (dom=0x7f791c009150, xml=0x7f791c009230 "<interface type=\"bridge\">\n <source bridge=\"xenbr0\" />\n <model type=\"rtl8139\" />\n <mac address=\"00:27:0e:0c:01:09\" />\n </interface>") at libxl/libxl_driver.c:3745 #17 0x00007f793b18422c in virDomainAttachDevice (domain=0x7f791c009150, xml=0x7f791c009230 "<interface type=\"bridge\">\n <source bridge=\"xenbr0\" />\n <model type=\"rtl8139\" />\n <mac address=\"00:27:0e:0c:01:09\" />\n </interface>") at libvirt-domain.c:8351 #18 0x00007f793be11a1f in remoteDispatchDomainAttachDevice (server=0x7f793c2e0a90, client=0x7f793c2f34c0, msg=0x7f793c2feca0, rerr=0x7f792a92bab0, args=0x7f791c009190) at remote_dispatch.h:2850 #19 0x00007f793be11923 in remoteDispatchDomainAttachDeviceHelper (server=0x7f793c2e0a90, client=0x7f793c2f34c0, msg=0x7f793c2feca0, rerr=0x7f792a92bab0, args=0x7f791c009190, ret=0x7f791c009130) at remote_dispatch.h:2826 #20 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f34c0, msg=0x7f793c2feca0) at rpc/virnetserverprogram.c:437 #21 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f34c0, msg=0x7f793c2feca0) at rpc/virnetserverprogram.c:307 #22 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f34c0, prog=0x7f793c2eefd0, msg=0x7f793c2feca0) at rpc/virnetserver.c:135 #23 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c302c60, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #24 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0750) at util/virthreadpool.c:145 #25 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2eced0) at util/virthread.c:206 #26 0x00007f79375c1ee5 in start_thread (arg=0x7f792a92c700) at pthread_create.c:309 #27 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 20 (Thread 0x7f792a12b700 (LWP 1313)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f7924005a74 "]g\327\022\026\212H4\224\223\026+\305c\252\232", ref=false) at conf/domain_conf.c:1259 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f7924005a74 "]g\327\022\026\212H4\224\223\026+\305c\252\232") at conf/domain_conf.c:1285 #7 0x00007f78fe3f9f49 in libxlDomObjFromDomain (dom=0x7f7924005a50) at libxl/libxl_driver.c:294 #8 0x00007f78fe40672b in libxlDomainIsActive (dom=0x7f7924005a50) at libxl/libxl_driver.c:4581 #9 0x00007f793b185494 in virDomainIsActive (dom=0x7f7924005a50) at libvirt-domain.c:8731 #10 0x00007f793be184b2 in remoteDispatchDomainIsActive (server=0x7f793c2e0a90, client=0x7f793c2f7be0, msg=0x7f793c2fa030, rerr=0x7f792a12aab0, args=0x7f7924005a90, ret=0x7f792400ba90) at remote_dispatch.h:5991 #11 0x00007f793be183bd in remoteDispatchDomainIsActiveHelper (server=0x7f793c2e0a90, client=0x7f793c2f7be0, msg=0x7f793c2fa030, rerr=0x7f792a12aab0, args=0x7f7924005a90, ret=0x7f792400ba90) at remote_dispatch.h:5965 #12 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f7be0, msg=0x7f793c2fa030) at rpc/virnetserverprogram.c:437 #13 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f7be0, msg=0x7f793c2fa030) at rpc/virnetserverprogram.c:307 #14 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f7be0, prog=0x7f793c2eefd0, msg=0x7f793c2fa030) at rpc/virnetserver.c:135 #15 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c3042e0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #16 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0910) at util/virthreadpool.c:145 #17 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ecea0) at util/virthread.c:206 #18 0x00007f79375c1ee5 in start_thread (arg=0x7f792a12b700) at pthread_create.c:309 #19 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 19 (Thread 0x7f792992a700 (LWP 1314)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f792000d5b4 "\215\317o\371\003 L\243\207\031l\200>\224uf", ref=false) at conf/domain_conf.c:1259 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f792000d5b4 "\215\317o\371\003 L\243\207\031l\200>\224uf") at conf/domain_conf.c:1285 #7 0x00007f78fe3f9f49 in libxlDomObjFromDomain (dom=0x7f792000d590) at libxl/libxl_driver.c:294 #8 0x00007f78fe40672b in libxlDomainIsActive (dom=0x7f792000d590) at libxl/libxl_driver.c:4581 #9 0x00007f793b185494 in virDomainIsActive (dom=0x7f792000d590) at libvirt-domain.c:8731 #10 0x00007f793be184b2 in remoteDispatchDomainIsActive (server=0x7f793c2e0a90, client=0x7f793c2f4c60, msg=0x7f793c3018c0, rerr=0x7f7929929ab0, args=0x7f792000d5d0, ret=0x7f792000d570) at remote_dispatch.h:5991 #11 0x00007f793be183bd in remoteDispatchDomainIsActiveHelper (server=0x7f793c2e0a90, client=0x7f793c2f4c60, msg=0x7f793c3018c0, rerr=0x7f7929929ab0, args=0x7f792000d5d0, ret=0x7f792000d570) at remote_dispatch.h:5965 #12 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f4c60, msg=0x7f793c3018c0) at rpc/virnetserverprogram.c:437 #13 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f4c60, msg=0x7f793c3018c0) at rpc/virnetserverprogram.c:307 #14 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f4c60, prog=0x7f793c2eefd0, msg=0x7f793c3018c0) at rpc/virnetserver.c:135 #15 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c304e70, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #16 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0590) at util/virthreadpool.c:145 #17 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ece70) at util/virthread.c:206 #18 0x00007f79375c1ee5 in start_thread (arg=0x7f792992a700) at pthread_create.c:309 #19 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 18 (Thread 0x7f7929129700 (LWP 1315)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f791400a394 "z\016\370*I-Mx\271\277f:\024\251\257\002", ref=false) at conf/domain_conf.c:1259 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f791400a394 "z\016\370*I-Mx\271\277f:\024\251\257\002") at conf/domain_conf.c:1285 #7 0x00007f78fe3f9f49 in libxlDomObjFromDomain (dom=0x7f791400a370) at libxl/libxl_driver.c:294 #8 0x00007f78fe40672b in libxlDomainIsActive (dom=0x7f791400a370) at libxl/libxl_driver.c:4581 #9 0x00007f793b185494 in virDomainIsActive (dom=0x7f791400a370) at libvirt-domain.c:8731 #10 0x00007f793be184b2 in remoteDispatchDomainIsActive (server=0x7f793c2e0a90, client=0x7f793c2fa450, msg=0x7f793c2f73c0, rerr=0x7f7929128ab0, args=0x7f791400a3b0, ret=0x7f791400a350) at remote_dispatch.h:5991 #11 0x00007f793be183bd in remoteDispatchDomainIsActiveHelper (server=0x7f793c2e0a90, client=0x7f793c2fa450, msg=0x7f793c2f73c0, rerr=0x7f7929128ab0, args=0x7f791400a3b0, ret=0x7f791400a350) at remote_dispatch.h:5965 #12 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2fa450, msg=0x7f793c2f73c0) at rpc/virnetserverprogram.c:437 #13 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2fa450, msg=0x7f793c2f73c0) at rpc/virnetserverprogram.c:307 #14 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2fa450, prog=0x7f793c2eefd0, msg=0x7f793c2f73c0) at rpc/virnetserver.c:135 #15 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c2f9940, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #16 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c274120) at util/virthreadpool.c:145 #17 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ecea0) at util/virthread.c:206 #18 0x00007f79375c1ee5 in start_thread (arg=0x7f7929129700) at pthread_create.c:309 #19 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 17 (Thread 0x7f7928928700 (LWP 1316)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f791000f224 "\251\204\033\250\240\321A\252\215(E\363~\211\210\255", ref=false) at conf/domain_conf.c:1259 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f791000f224 "\251\204\033\250\240\321A\252\215(E\363~\211\210\255") at conf/domain_conf.c:1285 #7 0x00007f78fe3f9f49 in libxlDomObjFromDomain (dom=0x7f791000f200) at libxl/libxl_driver.c:294 #8 0x00007f78fe40672b in libxlDomainIsActive (dom=0x7f791000f200) at libxl/libxl_driver.c:4581 #9 0x00007f793b185494 in virDomainIsActive (dom=0x7f791000f200) at libvirt-domain.c:8731 #10 0x00007f793be184b2 in remoteDispatchDomainIsActive (server=0x7f793c2e0a90, client=0x7f793c2f7fa0, msg=0x7f793c3019f0, rerr=0x7f7928927ab0, args=0x7f791000f240, ret=0x7f791000f1e0) at remote_dispatch.h:5991 #11 0x00007f793be183bd in remoteDispatchDomainIsActiveHelper (server=0x7f793c2e0a90, client=0x7f793c2f7fa0, msg=0x7f793c3019f0, rerr=0x7f7928927ab0, args=0x7f791000f240, ret=0x7f791000f1e0) at remote_dispatch.h:5965 #12 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f7fa0, msg=0x7f793c3019f0) at rpc/virnetserverprogram.c:437 #13 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f7fa0, msg=0x7f793c3019f0) at rpc/virnetserverprogram.c:307 #14 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f7fa0, prog=0x7f793c2eefd0, msg=0x7f793c3019f0) at rpc/virnetserver.c:135 #15 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c2f55f0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #16 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0910) at util/virthreadpool.c:145 #17 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ece70) at util/virthread.c:206 #18 0x00007f79375c1ee5 in start_thread (arg=0x7f7928928700) at pthread_create.c:309 #19 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 16 (Thread 0x7f791bfff700 (LWP 1317)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f7908001530 "\274\362i\375\344DI\275\260[;HM@\372K", ref=false) at conf/domain_conf.c:1259 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f7908001530 "\274\362i\375\344DI\275\260[;HM@\372K") at conf/domain_conf.c:1285 #7 0x00007f78fe3fbebf in libxlDomainLookupByUUID (conn=0x7f790c002660, uuid=0x7f7908001530 "\274\362i\375\344DI\275\260[;HM@\372K") at libxl/libxl_driver.c:1048 #8 0x00007f793b16688e in virDomainLookupByUUID (conn=0x7f790c002660, uuid=0x7f7908001530 "\274\362i\375\344DI\275\260[;HM@\372K") at libvirt-domain.c:349 #9 0x00007f793be18ec3 in remoteDispatchDomainLookupByUUID (server=0x7f793c2e0a90, client=0x7f793c2f7120, msg=0x7f793c2f5440, rerr=0x7f791bffeab0, args=0x7f7908001530, ret=0x7f7908001810) at remote_dispatch.h:6306 #10 0x00007f793be18e06 in remoteDispatchDomainLookupByUUIDHelper (server=0x7f793c2e0a90, client=0x7f793c2f7120, msg=0x7f793c2f5440, rerr=0x7f791bffeab0, args=0x7f7908001530, ret=0x7f7908001810) at remote_dispatch.h:6284 #11 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f7120, msg=0x7f793c2f5440) at rpc/virnetserverprogram.c:437 #12 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f7120, msg=0x7f793c2f5440) at rpc/virnetserverprogram.c:307 #13 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f7120, prog=0x7f793c2eefd0, msg=0x7f793c2f5440) at rpc/virnetserver.c:135 #14 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c30d240, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #15 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c274120) at util/virthreadpool.c:145 #16 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2eced0) at util/virthread.c:206 #17 0x00007f79375c1ee5 in start_thread (arg=0x7f791bfff700) at pthread_create.c:309 #18 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 15 (Thread 0x7f791b7fe700 (LWP 1318)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f790c001c14 "5\272S\302erO<\232\061\213\357$\271\367N", ref=false) at conf/domain_conf.c:1259 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f790c001c14 "5\272S\302erO<\232\061\213\357$\271\367N") at conf/domain_conf.c:1285 #7 0x00007f78fe3f9f49 in libxlDomObjFromDomain (dom=0x7f790c001bf0) at libxl/libxl_driver.c:294 #8 0x00007f78fe40672b in libxlDomainIsActive (dom=0x7f790c001bf0) at libxl/libxl_driver.c:4581 #9 0x00007f793b185494 in virDomainIsActive (dom=0x7f790c001bf0) at libvirt-domain.c:8731 #10 0x00007f793be184b2 in remoteDispatchDomainIsActive (server=0x7f793c2e0a90, client=0x7f793c2f8bc0, msg=0x7f793c2f7300, rerr=0x7f791b7fdab0, args=0x7f790c001c30, ret=0x7f790c001bd0) at remote_dispatch.h:5991 #11 0x00007f793be183bd in remoteDispatchDomainIsActiveHelper (server=0x7f793c2e0a90, client=0x7f793c2f8bc0, msg=0x7f793c2f7300, rerr=0x7f791b7fdab0, args=0x7f790c001c30, ret=0x7f790c001bd0) at remote_dispatch.h:5965 #12 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f8bc0, msg=0x7f793c2f7300) at rpc/virnetserverprogram.c:437 #13 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f8bc0, msg=0x7f793c2f7300) at rpc/virnetserverprogram.c:307 #14 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f8bc0, prog=0x7f793c2eefd0, msg=0x7f793c2f7300) at rpc/virnetserver.c:135 #15 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c30bdf0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #16 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0750) at util/virthreadpool.c:145 #17 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ece70) at util/virthread.c:206 #18 0x00007f79375c1ee5 in start_thread (arg=0x7f791b7fe700) at pthread_create.c:309 #19 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 14 (Thread 0x7f791affd700 (LWP 1319)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f7900000e50 "\306\060W\177\005\034G\362\236GcfKU", <incomplete sequence \373>, ref=false) at conf/domain_conf.c:1259 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f7900000e50 "\306\060W\177\005\034G\362\236GcfKU", <incomplete sequence \373>) at conf/domain_conf.c:1285 #7 0x00007f78fe3fbebf in libxlDomainLookupByUUID (conn=0x7f7908000be0, uuid=0x7f7900000e50 "\306\060W\177\005\034G\362\236GcfKU", <incomplete sequence \373>) at libxl/libxl_driver.c:1048 #8 0x00007f793b16688e in virDomainLookupByUUID (conn=0x7f7908000be0, uuid=0x7f7900000e50 "\306\060W\177\005\034G\362\236GcfKU", <incomplete sequence \373>) at libvirt-domain.c:349 #9 0x00007f793be18ec3 in remoteDispatchDomainLookupByUUID (server=0x7f793c2e0a90, client=0x7f793c2f3730, msg=0x7f793c2fed10, rerr=0x7f791affcab0, args=0x7f7900000e50, ret=0x7f7900000eb0) at remote_dispatch.h:6306 #10 0x00007f793be18e06 in remoteDispatchDomainLookupByUUIDHelper (server=0x7f793c2e0a90, client=0x7f793c2f3730, msg=0x7f793c2fed10, rerr=0x7f791affcab0, args=0x7f7900000e50, ret=0x7f7900000eb0) at remote_dispatch.h:6284 #11 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f3730, msg=0x7f793c2fed10) at rpc/virnetserverprogram.c:437 #12 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f3730, msg=0x7f793c2fed10) at rpc/virnetserverprogram.c:307 #13 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f3730, prog=0x7f793c2eefd0, msg=0x7f793c2fed10) at rpc/virnetserver.c:135 #14 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c2ff580, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #15 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0910) at util/virthreadpool.c:145 #16 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2eced0) at util/virthread.c:206 #17 0x00007f79375c1ee5 in start_thread (arg=0x7f791affd700) at pthread_create.c:309 #18 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 13 (Thread 0x7f791a7fc700 (LWP 1320)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f7904000920 "\223n[\200\020\264BC\242\060ááá)#@", ref=false) at conf/domain_conf.c:1259 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f7904000920 "\223n[\200\020\264BC\242\060ááá)#@") at conf/domain_conf.c:1285 #7 0x00007f78fe3fbebf in libxlDomainLookupByUUID (conn=0x7f7910000a80, uuid=0x7f7904000920 "\223n[\200\020\264BC\242\060ááá)#@") at libxl/libxl_driver.c:1048 #8 0x00007f793b16688e in virDomainLookupByUUID (conn=0x7f7910000a80, uuid=0x7f7904000920 "\223n[\200\020\264BC\242\060ááá)#@") at libvirt-domain.c:349 #9 0x00007f793be18ec3 in remoteDispatchDomainLookupByUUID (server=0x7f793c2e0a90, client=0x7f793c2e1d10, msg=0x7f793c301070, rerr=0x7f791a7fbab0, args=0x7f7904000920, ret=0x7f7904000960) at remote_dispatch.h:6306 #10 0x00007f793be18e06 in remoteDispatchDomainLookupByUUIDHelper (server=0x7f793c2e0a90, client=0x7f793c2e1d10, msg=0x7f793c301070, rerr=0x7f791a7fbab0, args=0x7f7904000920, ret=0x7f7904000960) at remote_dispatch.h:6284 #11 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2e1d10, msg=0x7f793c301070) at rpc/virnetserverprogram.c:437 #12 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2e1d10, msg=0x7f793c301070) at rpc/virnetserverprogram.c:307 #13 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2e1d10, prog=0x7f793c2eefd0, msg=0x7f793c301070) at rpc/virnetserver.c:135 #14 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c30b3a0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #15 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0750) at util/virthreadpool.c:145 #16 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ece70) at util/virthread.c:206 #17 0x00007f79375c1ee5 in start_thread (arg=0x7f791a7fc700) at pthread_create.c:309 #18 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 12 (Thread 0x7f7919ffb700 (LWP 1321)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f78f8000924 "!\037\207\266G\220KZ\211\024_~\325\022\327\"", ref=false) at conf/domain_conf.c:1259 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f78f8000924 "!\037\207\266G\220KZ\211\024_~\325\022\327\"") at conf/domain_conf.c:1285 #7 0x00007f78fe3f9f49 in libxlDomObjFromDomain (dom=0x7f78f8000900) at libxl/libxl_driver.c:294 #8 0x00007f78fe40672b in libxlDomainIsActive (dom=0x7f78f8000900) at libxl/libxl_driver.c:4581 #9 0x00007f793b185494 in virDomainIsActive (dom=0x7f78f8000900) at libvirt-domain.c:8731 #10 0x00007f793be184b2 in remoteDispatchDomainIsActive (server=0x7f793c2e0a90, client=0x7f793c2f2de0, msg=0x7f793c302ba0, rerr=0x7f7919ffaab0, args=0x7f78f8000940, ret=0x7f78f8000cb0) at remote_dispatch.h:5991 #11 0x00007f793be183bd in remoteDispatchDomainIsActiveHelper (server=0x7f793c2e0a90, client=0x7f793c2f2de0, msg=0x7f793c302ba0, rerr=0x7f7919ffaab0, args=0x7f78f8000940, ret=0x7f78f8000cb0) at remote_dispatch.h:5965 #12 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f2de0, msg=0x7f793c302ba0) at rpc/virnetserverprogram.c:437 #13 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f2de0, msg=0x7f793c302ba0) at rpc/virnetserverprogram.c:307 #14 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f2de0, prog=0x7f793c2eefd0, msg=0x7f793c302ba0) at rpc/virnetserver.c:135 #15 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c2f5580, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #16 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c274120) at util/virthreadpool.c:145 #17 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2eced0) at util/virthread.c:206 #18 0x00007f79375c1ee5 in start_thread (arg=0x7f7919ffb700) at pthread_create.c:309 #19 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 11 (Thread 0x7f78fd6ff700 (LWP 1334)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007f793b09ce68 in virCondWait (c=0x7f793c2ef638, m=0x7f793c2ef610) at util/virthread.c:154 #2 0x00007f793b09d83e in virThreadPoolWorker (opaque=0x7f793c2ef3c0) at util/virthreadpool.c:105 #3 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ef3e0) at util/virthread.c:206 #4 0x00007f79375c1ee5 in start_thread (arg=0x7f78fd6ff700) at pthread_create.c:309 #5 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 10 (Thread 0x7f78fcefe700 (LWP 1335)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007f793b09ce68 in virCondWait (c=0x7f793c2ef638, m=0x7f793c2ef610) at util/virthread.c:154 #2 0x00007f793b09d83e in virThreadPoolWorker (opaque=0x7f793c2ef2e0) at util/virthreadpool.c:105 #3 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ef890) at util/virthread.c:206 #4 0x00007f79375c1ee5 in start_thread (arg=0x7f78fcefe700) at pthread_create.c:309 #5 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 9 (Thread 0x7f78f3fff700 (LWP 1336)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007f793b09ce68 in virCondWait (c=0x7f793c2ef638, m=0x7f793c2ef610) at util/virthread.c:154 #2 0x00007f793b09d83e in virThreadPoolWorker (opaque=0x7f793c2ef350) at util/virthreadpool.c:105 #3 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ef3e0) at util/virthread.c:206 #4 0x00007f79375c1ee5 in start_thread (arg=0x7f78f3fff700) at pthread_create.c:309 #5 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 8 (Thread 0x7f78ebfff700 (LWP 1337)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007f793b09ce68 in virCondWait (c=0x7f793c2ef638, m=0x7f793c2ef610) at util/virthread.c:154 #2 0x00007f793b09d83e in virThreadPoolWorker (opaque=0x7f793c2ef3c0) at util/virthreadpool.c:105 #3 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ef890) at util/virthread.c:206 #4 0x00007f79375c1ee5 in start_thread (arg=0x7f78ebfff700) at pthread_create.c:309 #5 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 7 (Thread 0x7f78f37fe700 (LWP 1338)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 #1 0x00007f793b09ce68 in virCondWait (c=0x7f793c2ef638, m=0x7f793c2ef610) at util/virthread.c:154 #2 0x00007f793b09d83e in virThreadPoolWorker (opaque=0x7f793c2ef240) at util/virthreadpool.c:105 #3 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ef3e0) at util/virthread.c:206 #4 0x00007f79375c1ee5 in start_thread (arg=0x7f78f37fe700) at pthread_create.c:309 #5 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 6 (Thread 0x7f793bf94700 (LWP 1494)): #0 0x00007f79375c87fd in read () at ../sysdeps/unix/syscall-template.S:81 #1 0x00007f793237676d in read_all (fd=24, data=data@entry=0x7f78cc000fe0, len=len@entry=16, nonblocking=0) at xs.c:377 #2 0x00007f79323767f2 in read_all (nonblocking=0, len=16, data=0x7f78cc000fe0, fd=<optimized out>) at xs.c:1149 #3 read_message (h=h@entry=0x7f78d80eaaf0, nonblocking=0) at xs.c:1149 #4 0x00007f7932376a01 in read_thread (arg=0x7f78d80eaaf0) at xs.c:1221 #5 0x00007f79375c1ee5 in start_thread (arg=0x7f793bf94700) at pthread_create.c:309 #6 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 5 (Thread 0x7f78f241d700 (LWP 17709)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f78d81fb5d4 "\343\371\307On!A\217\272;\223\025\344\343w\v", ref=false) at conf/domain_conf.c:1259 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f78d81fb5d4 "\343\371\307On!A\217\272;\223\025\344\343w\v") at conf/domain_conf.c:1285 #7 0x00007f78fe3f9f49 in libxlDomObjFromDomain (dom=0x7f78d81fb5b0) at libxl/libxl_driver.c:294 #8 0x00007f78fe40672b in libxlDomainIsActive (dom=0x7f78d81fb5b0) at libxl/libxl_driver.c:4581 #9 0x00007f793b185494 in virDomainIsActive (dom=0x7f78d81fb5b0) at libvirt-domain.c:8731 #10 0x00007f793be184b2 in remoteDispatchDomainIsActive (server=0x7f793c2e0a90, client=0x7f793c2f8d60, msg=0x7f793c2f66f0, rerr=0x7f78f241cab0, args=0x7f78d81db4b0, ret=0x7f78d82370d0) at remote_dispatch.h:5991 #11 0x00007f793be183bd in remoteDispatchDomainIsActiveHelper (server=0x7f793c2e0a90, client=0x7f793c2f8d60, msg=0x7f793c2f66f0, rerr=0x7f78f241cab0, args=0x7f78d81db4b0, ret=0x7f78d82370d0) at remote_dispatch.h:5965 #12 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f8d60, msg=0x7f793c2f66f0) at rpc/virnetserverprogram.c:437 #13 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f8d60, msg=0x7f793c2f66f0) at rpc/virnetserverprogram.c:307 #14 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f8d60, prog=0x7f793c2eefd0, msg=0x7f793c2f66f0) at rpc/virnetserver.c:135 #15 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c2f74a0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #16 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c30be60) at util/virthreadpool.c:145 #17 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2e0970) at util/virthread.c:206 #18 0x00007f79375c1ee5 in start_thread (arg=0x7f78f241d700) at pthread_create.c:309 #19 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 4 (Thread 0x7f78f1c1c700 (LWP 17717)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f78d00009a0 "\230\212\207\340\376\240LÖ\242Ã\212\207\207", <incomplete sequence \343>, ref=false) at conf/domain_conf.c:1259 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f78d00009a0 "\230\212\207\340\376\240LÖ\242Ã\212\207\207", <incomplete sequence \343>) at conf/domain_conf.c:1285 #7 0x00007f78fe3fbebf in libxlDomainLookupByUUID (conn=0x7f7914000a80, uuid=0x7f78d00009a0 "\230\212\207\340\376\240LÖ\242Ã\212\207\207", <incomplete sequence \343>) at libxl/libxl_driver.c:1048 #8 0x00007f793b16688e in virDomainLookupByUUID (conn=0x7f7914000a80, uuid=0x7f78d00009a0 "\230\212\207\340\376\240LÖ\242Ã\212\207\207", <incomplete sequence \343>) at libvirt-domain.c:349 #9 0x00007f793be18ec3 in remoteDispatchDomainLookupByUUID (server=0x7f793c2e0a90, client=0x7f793c2f25c0, msg=0x7f793c301170, rerr=0x7f78f1c1bab0, args=0x7f78d00009a0, ret=0x7f78d0000900) at remote_dispatch.h:6306 #10 0x00007f793be18e06 in remoteDispatchDomainLookupByUUIDHelper (server=0x7f793c2e0a90, client=0x7f793c2f25c0, msg=0x7f793c301170, rerr=0x7f78f1c1bab0, args=0x7f78d00009a0, ret=0x7f78d0000900) at remote_dispatch.h:6284 #11 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f25c0, msg=0x7f793c301170) at rpc/virnetserverprogram.c:437 #12 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f25c0, msg=0x7f793c301170) at rpc/virnetserverprogram.c:307 #13 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f25c0, prog=0x7f793c2eefd0, msg=0x7f793c301170) at rpc/virnetserver.c:135 #14 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c3009e0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #15 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2f7510) at util/virthreadpool.c:145 #16 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2fee10) at util/virthread.c:206 #17 0x00007f79375c1ee5 in start_thread (arg=0x7f78f1c1c700) at pthread_create.c:309 #18 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 3 (Thread 0x7f78f141b700 (LWP 17722)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f78c40009a0 "\"\036F\275\324\337L\027\235\201\227 L\207\300\256", ref=false) at conf/domain_conf.c:1259 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f78c40009a0 "\"\036F\275\324\337L\027\235\201\227 L\207\300\256") at conf/domain_conf.c:1285 #7 0x00007f78fe3fbebf in libxlDomainLookupByUUID (conn=0x7f7924000be0, uuid=0x7f78c40009a0 "\"\036F\275\324\337L\027\235\201\227 L\207\300\256") at libxl/libxl_driver.c:1048 #8 0x00007f793b16688e in virDomainLookupByUUID (conn=0x7f7924000be0, uuid=0x7f78c40009a0 "\"\036F\275\324\337L\027\235\201\227 L\207\300\256") at libvirt-domain.c:349 #9 0x00007f793be18ec3 in remoteDispatchDomainLookupByUUID (server=0x7f793c2e0a90, client=0x7f793c2f6760, msg=0x7f793c2f4a70, rerr=0x7f78f141aab0, args=0x7f78c40009a0, ret=0x7f78c4000900) at remote_dispatch.h:6306 #10 0x00007f793be18e06 in remoteDispatchDomainLookupByUUIDHelper (server=0x7f793c2e0a90, client=0x7f793c2f6760, msg=0x7f793c2f4a70, rerr=0x7f78f141aab0, args=0x7f78c40009a0, ret=0x7f78c4000900) at remote_dispatch.h:6284 #11 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f6760, msg=0x7f793c2f4a70) at rpc/virnetserverprogram.c:437 #12 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f6760, msg=0x7f793c2f4a70) at rpc/virnetserverprogram.c:307 #13 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f6760, prog=0x7f793c2eefd0, msg=0x7f793c2f4a70) at rpc/virnetserver.c:135 #14 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c309fa0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #15 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c300a50) at util/virthreadpool.c:145 #16 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2fee10) at util/virthread.c:206 #17 0x00007f79375c1ee5 in start_thread (arg=0x7f78f141b700) at pthread_create.c:309 #18 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 2 (Thread 0x7f78f0c1a700 (LWP 17751)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f78c80009a0 "\036\037\304M\345\nG\265\231É\272a!", <incomplete sequence \304>, ref=false) at conf/domain_conf.c:1259 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f78c80009a0 "\036\037\304M\345\nG\265\231É\272a!", <incomplete sequence \304>) at conf/domain_conf.c:1285 #7 0x00007f78fe3fbebf in libxlDomainLookupByUUID (conn=0x7f790c000a80, uuid=0x7f78c80009a0 "\036\037\304M\345\nG\265\231É\272a!", <incomplete sequence \304>) at libxl/libxl_driver.c:1048 #8 0x00007f793b16688e in virDomainLookupByUUID (conn=0x7f790c000a80, uuid=0x7f78c80009a0 "\036\037\304M\345\nG\265\231É\272a!", <incomplete sequence \304>) at libvirt-domain.c:349 #9 0x00007f793be18ec3 in remoteDispatchDomainLookupByUUID (server=0x7f793c2e0a90, client=0x7f793c2f5350, msg=0x7f793c3052e0, rerr=0x7f78f0c19ab0, args=0x7f78c80009a0, ret=0x7f78c8000900) at remote_dispatch.h:6306 #10 0x00007f793be18e06 in remoteDispatchDomainLookupByUUIDHelper (server=0x7f793c2e0a90, client=0x7f793c2f5350, msg=0x7f793c3052e0, rerr=0x7f78f0c19ab0, args=0x7f78c80009a0, ret=0x7f78c8000900) at remote_dispatch.h:6284 #11 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f5350, msg=0x7f793c3052e0) at rpc/virnetserverprogram.c:437 #12 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f5350, msg=0x7f793c3052e0) at rpc/virnetserverprogram.c:307 #13 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f5350, prog=0x7f793c2eefd0, msg=0x7f793c3052e0) at rpc/virnetserver.c:135 #14 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c30c5d0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 #15 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c30c640) at util/virthreadpool.c:145 #16 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2f6b20) at util/virthread.c:206 #17 0x00007f79375c1ee5 in start_thread (arg=0x7f78f0c1a700) at pthread_create.c:309 #18 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 Thread 1 (Thread 0x7f793c0428c0 (LWP 1269)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 #5 0x00007f793b0b71d7 in virDomainObjListFindByID (doms=0x7f78d80edd20, id=1) at conf/domain_conf.c:1237 #6 0x00007f78fe3f7eb3 in libxlDomainEventHandler (data=0x7f78d81ce940, event=0x7f793c30c2e0) at libxl/libxl_domain.c:534 #7 0x00007f793806f7c0 in egc_run_callbacks (egc=egc@entry=0x7ffdb79c7490) at libxl_event.c:1405 #8 0x00007f793806fb9d in libxl__egc_cleanup (egc=0x7ffdb79c7490) at libxl_event.c:1436 #9 libxl_osevent_occurred_fd (ctx=<optimized out>, for_libxl=0x7f78d80ec220, fd=27, events_ign=<optimized out>, revents_ign=<optimized out>) at libxl_event.c:1339 #10 0x00007f78fe3f9ac5 in libxlFDEventCallback (watch=11, fd=27, vir_events=1, fd_info=0x7f78d811c430) at libxl/libxl_driver.c:134 #11 0x00007f793b04a9c4 in virEventPollDispatchHandles (nfds=31, fds=0x7f793c30b510) at util/vireventpoll.c:509 #12 0x00007f793b04b224 in virEventPollRunOnce () at util/vireventpoll.c:658 #13 0x00007f793b0490cd in virEventRunDefaultImpl () at util/virevent.c:308 #14 0x00007f793b1f5ab6 in virNetDaemonRun (dmn=0x7f793c2e1b80) at rpc/virnetdaemon.c:701 #15 0x00007f793be0bc27 in main (argc=1, argv=0x7ffdb79c7d78) at libvirtd.c:1577 Thread 21 (Thread 0x7f792a92c700 (LWP 1312)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f79140099d0) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f79140099d0) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f79140099c0) at util/virobject.c:323 obj = 0x7f79140099c0 __func__ = "virObjectLock" #5 0x00007f793b0b717f in virDomainObjListSearchID (payload=0x7f79140099c0, name=0x7f791400f7c0, data=0x7f792a92b464) at conf/domain_conf.c:1225 obj = 0x7f79140099c0 id = 0x7f792a92b464 want = 0 #6 0x00007f793b055f1e in virHashSearch (ctable=0x7f78d81ccc40, iter=0x7f793b0b7148 <virDomainObjListSearchID>, data=0x7f792a92b464) at util/virhash.c:724 entry = 0x7f7914007580 i = 24 table = 0x7f78d81ccc40 __func__ = "virHashSearch" #7 0x00007f793b0b71f2 in virDomainObjListFindByID (doms=0x7f78d80edd20, id=2) at conf/domain_conf.c:1238 obj = 0x0 #8 0x00007f78fe3f7eb3 in libxlDomainEventHandler (data=0x7f78d81ce940, event=0x7f791c005610) at libxl/libxl_domain.c:534 driver = 0x7f78d81ce940 vm = 0x0 xl_reason = LIBXL_SHUTDOWN_REASON_REBOOT shutdown_info = 0x0 thread = {thread = 0} cfg = 0x3 __func__ = "libxlDomainEventHandler" __FUNCTION__ = "libxlDomainEventHandler" #9 0x00007f793806f7c0 in egc_run_callbacks (egc=egc@entry=0x7f792a92b580) at libxl_event.c:1405 gc = 0x7f792a92b580 ev = 0x7f791c005610 ev_tmp = 0x0 aop = <optimized out> aop_tmp = <optimized out> __func__ = "egc_run_callbacks" __PRETTY_FUNCTION__ = "egc_run_callbacks" ao = <optimized out> ao_tmp = <optimized out> #10 0x00007f7938070f8b in libxl__egc_cleanup (egc=0x7f792a92b580) at libxl_event.c:1436 gc = 0x7f792a92b580 #11 libxl__ao_inprogress (ao=ao@entry=0x7f791c00c6e0, file=file@entry=0x7f793808d512 "libxl.c", line=line@entry=4226, func=func@entry=0x7f7938090150 <__func__.20288> "libxl_device_nic_add") at libxl_event.c:2014 egc = {gc = {alloc_maxsize = 0, alloc_ptrs = 0x0, owner = 0x7f78d8112830}, occurred_for_callback = {tqh_first = 0x0, tqh_last = 0x7f792a92b598}, aos_for_callback = {tqh_first = 0x0, tqh_last = 0x7f792a92b5a8}, aops_for_callback = {tqh_first = 0x0, tqh_last = 0x7f792a92b5b8}} gc = 0x7f791c00c720 rc = <optimized out> __PRETTY_FUNCTION__ = "libxl__ao_inprogress" __func__ = "libxl__ao_inprogress" #12 0x00007f7938048fa6 in libxl_device_nic_add (ctx=0x7f78d8112830, domid=19, nic=0x7f792a92b6b0, ao_how=<optimized out>) at libxl.c:4226 ao__ctx = 0x7f78d8112830 ao__rc = <optimized out> ao = 0x7f791c00c6e0 __func__ = "libxl_device_nic_add" egc = {{gc = {alloc_maxsize = 0, alloc_ptrs = 0x0, owner = 0x7f78d8112830}, occurred_for_callback = {tqh_first = 0x0, tqh_last = 0x7f792a92b608}, aos_for_callback = {tqh_first = 0x0, tqh_last = 0x7f792a92b618}, aops_for_callback = {tqh_first = 0x0, tqh_last = 0x7f792a92b628}}} gc = 0x7f791c00c720 aodev = <optimized out> #13 0x00007f78fe402baa in libxlDomainAttachNetDevice (driver=0x7f78d81ce940, vm=0x7f79140099c0, net=0x7f791c003610) at libxl/libxl_driver.c:3199 cfg = 0x7f78d81cf790 actualType = 7 nic = {backend_domid = 0, backend_domname = 0x0, devid = 0, mtu = 1492, model = 0x7f791c0092d0 "rtl8139", mac = "\000'\016\f\001\t", ip = 0x0, bridge = 0x7f791c001b10 "xenbr0", ifname = 0x0, script = 0x7f791c0055c0 "/etc/xen/scripts/vif-bridge", nictype = LIBXL_NIC_TYPE_VIF_IOEMU, rate_bytes_per_interval = 0, rate_interval_usecs = 0, gatewaydev = 0x0} ret = -1 mac = "\000oÌ*y\177\000\000\005x\r;y\177\000\000=1" __FUNCTION__ = "libxlDomainAttachNetDevice" #14 0x00007f78fe402d12 in libxlDomainAttachDeviceLive (driver=0x7f78d81ce940, vm=0x7f79140099c0, dev=0x7f791c001350) at libxl/libxl_driver.c:3231 ret = -1 __FUNCTION__ = "libxlDomainAttachDeviceLive" #15 0x00007f78fe404135 in libxlDomainAttachDeviceFlags (dom=0x7f791c009150, xml=0x7f791c009230 "<interface type=\"bridge\">\n <source bridge=\"xenbr0\" />\n <model type=\"rtl8139\" />\n <mac address=\"00:27:0e:0c:01:09\" />\n </interface>", flags=1) at libxl/libxl_driver.c:3707 driver = 0x7f78d81ce940 cfg = 0x7f78d81cf790 vm = 0x7f79140099c0 vmdef = 0x0 dev = 0x7f791c001350 ret = -1 __FUNCTION__ = "libxlDomainAttachDeviceFlags" #16 0x00007f78fe404239 in libxlDomainAttachDevice (dom=0x7f791c009150, xml=0x7f791c009230 "<interface type=\"bridge\">\n <source bridge=\"xenbr0\" />\n <model type=\"rtl8139\" />\n <mac address=\"00:27:0e:0c:01:09\" />\n </interface>") at libxl/libxl_driver.c:3745 No locals. #17 0x00007f793b18422c in virDomainAttachDevice (domain=0x7f791c009150, xml=0x7f791c009230 "<interface type=\"bridge\">\n <source bridge=\"xenbr0\" />\n <model type=\"rtl8139\" />\n <mac address=\"00:27:0e:0c:01:09\" />\n </interface>") at libvirt-domain.c:8351 ret = 1 conn = 0x7f7920000be0 __func__ = "virDomainAttachDevice" __FUNCTION__ = "virDomainAttachDevice" #18 0x00007f793be11a1f in remoteDispatchDomainAttachDevice (server=0x7f793c2e0a90, client=0x7f793c2f34c0, msg=0x7f793c2feca0, rerr=0x7f792a92bab0, args=0x7f791c009190) at remote_dispatch.h:2850 rv = -1 dom = 0x7f791c009150 priv = 0x7f793c2f3de0 __FUNCTION__ = "remoteDispatchDomainAttachDevice" #19 0x00007f793be11923 in remoteDispatchDomainAttachDeviceHelper (server=0x7f793c2e0a90, client=0x7f793c2f34c0, msg=0x7f793c2feca0, rerr=0x7f792a92bab0, args=0x7f791c009190, ret=0x7f791c009130) at remote_dispatch.h:2826 rv = 0 __func__ = "remoteDispatchDomainAttachDeviceHelper" #20 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f34c0, msg=0x7f793c2feca0) at rpc/virnetserverprogram.c:437 arg = 0x7f791c009190 "\300\220" ret = 0x7f791c009130 "" rv = -1 dispatcher = 0x7f793c0762a0 <remoteProcs+384> rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} i = 0 identity = 0x7f7924000a20 __FUNCTION__ = "virNetServerProgramDispatchCall" #21 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f34c0, msg=0x7f793c2feca0) at rpc/virnetserverprogram.c:307 ret = -1 rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} __func__ = "virNetServerProgramDispatch" __FUNCTION__ = "virNetServerProgramDispatch" #22 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f34c0, prog=0x7f793c2eefd0, msg=0x7f793c2feca0) at rpc/virnetserver.c:135 ret = -1 __func__ = "virNetServerProcessMsg" #23 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c302c60, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 srv = 0x7f793c2e0a90 job = 0x7f793c302c60 __func__ = "virNetServerHandleJob" #24 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0750) at util/virthreadpool.c:145 data = 0x0 pool = 0x7f793c2e0be0 cond = 0x7f793c2e0c48 priority = false job = 0x7f793c2f9b30 #25 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2eced0) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c2e0750} #26 0x00007f79375c1ee5 in start_thread (arg=0x7f792a92c700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f792a92c700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140158382032640, 4958827372110045735, 0, 0, 140158382033344, 140158382032640, -5034146845709147609, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #27 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 20 (Thread 0x7f792a12b700 (LWP 1313)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 obj = 0x7f78d80edd20 __func__ = "virObjectLock" #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f7924005a74 "]g\327\022\026\212H4\224\223\026+\305c\252\232", ref=false) at conf/domain_conf.c:1259 uuidstr = "\227*1;y\177", '\000' <repeats 11 times>, "V1;y\177\000\000O\005\061;y\177\000\000\023\"\000\000\001" obj = 0x7f792a12a820 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f7924005a74 "]g\327\022\026\212H4\224\223\026+\305c\252\232") at conf/domain_conf.c:1285 No locals. #7 0x00007f78fe3f9f49 in libxlDomObjFromDomain (dom=0x7f7924005a50) at libxl/libxl_driver.c:294 vm = 0x7f793b09d2b9 <virThreadLocalGet+25> driver = 0x7f78d81ce940 uuidstr = "\000\251\022*y\177\000\000\272U\002;y\177\000\000Ð\022*y\177\000\000\370\t\000$y\177\000\000\060\320.<y" __FUNCTION__ = "libxlDomObjFromDomain" #8 0x00007f78fe40672b in libxlDomainIsActive (dom=0x7f7924005a50) at libxl/libxl_driver.c:4581 obj = 0x7f7924000db0 ret = -1 #9 0x00007f793b185494 in virDomainIsActive (dom=0x7f7924005a50) at libvirt-domain.c:8731 ret = 0 __func__ = "virDomainIsActive" __FUNCTION__ = "virDomainIsActive" #10 0x00007f793be184b2 in remoteDispatchDomainIsActive (server=0x7f793c2e0a90, client=0x7f793c2f7be0, msg=0x7f793c2fa030, rerr=0x7f792a12aab0, args=0x7f7924005a90, ret=0x7f792400ba90) at remote_dispatch.h:5991 rv = -1 dom = 0x7f7924005a50 active = 32633 priv = 0x7f793c2f6430 __FUNCTION__ = "remoteDispatchDomainIsActive" #11 0x00007f793be183bd in remoteDispatchDomainIsActiveHelper (server=0x7f793c2e0a90, client=0x7f793c2f7be0, msg=0x7f793c2fa030, rerr=0x7f792a12aab0, args=0x7f7924005a90, ret=0x7f792400ba90) at remote_dispatch.h:5965 rv = 0 __func__ = "remoteDispatchDomainIsActiveHelper" #12 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f7be0, msg=0x7f793c2fa030) at rpc/virnetserverprogram.c:437 arg = 0x7f7924005a90 " \272" ret = 0x7f792400ba90 "" rv = -1 dispatcher = 0x7f793c077d40 <remoteProcs+7200> rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} i = 0 identity = 0x7f7904000cd0 __FUNCTION__ = "virNetServerProgramDispatchCall" #13 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f7be0, msg=0x7f793c2fa030) at rpc/virnetserverprogram.c:307 ret = -1 rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} __func__ = "virNetServerProgramDispatch" __FUNCTION__ = "virNetServerProgramDispatch" #14 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f7be0, prog=0x7f793c2eefd0, msg=0x7f793c2fa030) at rpc/virnetserver.c:135 ret = -1 __func__ = "virNetServerProcessMsg" #15 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c3042e0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 srv = 0x7f793c2e0a90 job = 0x7f793c3042e0 __func__ = "virNetServerHandleJob" #16 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0910) at util/virthreadpool.c:145 data = 0x0 pool = 0x7f793c2e0be0 cond = 0x7f793c2e0c48 priority = false job = 0x7f793c2f3890 #17 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ecea0) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c2e0910} #18 0x00007f79375c1ee5 in start_thread (arg=0x7f792a12b700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f792a12b700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140158373639936, 4958827372110045735, 0, 0, 140158373640640, 140158373639936, -5034145746734390745, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #19 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 19 (Thread 0x7f792992a700 (LWP 1314)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 obj = 0x7f78d80edd20 __func__ = "virObjectLock" #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f792000d5b4 "\215\317o\371\003 L\243\207\031l\200>\224uf", ref=false) at conf/domain_conf.c:1259 uuidstr = "\227*1;y\177", '\000' <repeats 11 times>, "V1;y\177\000\000O\005\061;y\177\000\000\023\"\000\000\001" obj = 0x7f7929929820 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f792000d5b4 "\215\317o\371\003 L\243\207\031l\200>\224uf") at conf/domain_conf.c:1285 No locals. #7 0x00007f78fe3f9f49 in libxlDomObjFromDomain (dom=0x7f792000d590) at libxl/libxl_driver.c:294 vm = 0x7f793b09d2b9 <virThreadLocalGet+25> driver = 0x7f78d81ce940 uuidstr = "\000\231\222)y\177\000\000\272U\002;y\177\000\000Ð\222)y\177\000\000\370\t\000 y\177\000\000\060\320.<y" __FUNCTION__ = "libxlDomObjFromDomain" #8 0x00007f78fe40672b in libxlDomainIsActive (dom=0x7f792000d590) at libxl/libxl_driver.c:4581 obj = 0x7f7900000a80 ret = -1 #9 0x00007f793b185494 in virDomainIsActive (dom=0x7f792000d590) at libvirt-domain.c:8731 ret = 0 __func__ = "virDomainIsActive" __FUNCTION__ = "virDomainIsActive" #10 0x00007f793be184b2 in remoteDispatchDomainIsActive (server=0x7f793c2e0a90, client=0x7f793c2f4c60, msg=0x7f793c3018c0, rerr=0x7f7929929ab0, args=0x7f792000d5d0, ret=0x7f792000d570) at remote_dispatch.h:5991 rv = -1 dom = 0x7f792000d590 active = 32633 priv = 0x7f793c2f4da0 __FUNCTION__ = "remoteDispatchDomainIsActive" #11 0x00007f793be183bd in remoteDispatchDomainIsActiveHelper (server=0x7f793c2e0a90, client=0x7f793c2f4c60, msg=0x7f793c3018c0, rerr=0x7f7929929ab0, args=0x7f792000d5d0, ret=0x7f792000d570) at remote_dispatch.h:5965 rv = 0 __func__ = "remoteDispatchDomainIsActiveHelper" #12 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f4c60, msg=0x7f793c3018c0) at rpc/virnetserverprogram.c:437 arg = 0x7f792000d5d0 "" ret = 0x7f792000d570 "" rv = -1 dispatcher = 0x7f793c077d40 <remoteProcs+7200> rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} i = 0 identity = 0x7f7920001550 __FUNCTION__ = "virNetServerProgramDispatchCall" #13 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f4c60, msg=0x7f793c3018c0) at rpc/virnetserverprogram.c:307 ret = -1 rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} __func__ = "virNetServerProgramDispatch" __FUNCTION__ = "virNetServerProgramDispatch" #14 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f4c60, prog=0x7f793c2eefd0, msg=0x7f793c3018c0) at rpc/virnetserver.c:135 ret = -1 __func__ = "virNetServerProcessMsg" #15 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c304e70, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 srv = 0x7f793c2e0a90 job = 0x7f793c304e70 __func__ = "virNetServerHandleJob" #16 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0590) at util/virthreadpool.c:145 data = 0x0 pool = 0x7f793c2e0be0 cond = 0x7f793c2e0c48 priority = false job = 0x7f793c2f31a0 #17 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ece70) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c2e0590} #18 0x00007f79375c1ee5 in start_thread (arg=0x7f792992a700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f792992a700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140158365247232, 4958827372110045735, 0, 0, 140158365247936, 140158365247232, -5034153441705172441, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #19 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 18 (Thread 0x7f7929129700 (LWP 1315)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 obj = 0x7f78d80edd20 __func__ = "virObjectLock" #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f791400a394 "z\016\370*I-Mx\271\277f:\024\251\257\002", ref=false) at conf/domain_conf.c:1259 uuidstr = "\227*1;y\177", '\000' <repeats 11 times>, "V1;y\177\000\000O\005\061;y\177\000\000\023\"\000\000\001" obj = 0x7f7929128820 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f791400a394 "z\016\370*I-Mx\271\277f:\024\251\257\002") at conf/domain_conf.c:1285 No locals. #7 0x00007f78fe3f9f49 in libxlDomObjFromDomain (dom=0x7f791400a370) at libxl/libxl_driver.c:294 vm = 0x7f793b09d2b9 <virThreadLocalGet+25> driver = 0x7f78d81ce940 uuidstr = "\000\211\022)y\177\000\000\272U\002;y\177\000\000Ð\022)y\177\000\000X\n\000\024y\177\000\000\060\320.<y" __FUNCTION__ = "libxlDomObjFromDomain" #8 0x00007f78fe40672b in libxlDomainIsActive (dom=0x7f791400a370) at libxl/libxl_driver.c:4581 obj = 0x7f7910002670 ret = -1 #9 0x00007f793b185494 in virDomainIsActive (dom=0x7f791400a370) at libvirt-domain.c:8731 ret = 0 __func__ = "virDomainIsActive" __FUNCTION__ = "virDomainIsActive" #10 0x00007f793be184b2 in remoteDispatchDomainIsActive (server=0x7f793c2e0a90, client=0x7f793c2fa450, msg=0x7f793c2f73c0, rerr=0x7f7929128ab0, args=0x7f791400a3b0, ret=0x7f791400a350) at remote_dispatch.h:5991 rv = -1 dom = 0x7f791400a370 active = 32633 priv = 0x7f793c2f9e50 __FUNCTION__ = "remoteDispatchDomainIsActive" #11 0x00007f793be183bd in remoteDispatchDomainIsActiveHelper (server=0x7f793c2e0a90, client=0x7f793c2fa450, msg=0x7f793c2f73c0, rerr=0x7f7929128ab0, args=0x7f791400a3b0, ret=0x7f791400a350) at remote_dispatch.h:5965 rv = 0 __func__ = "remoteDispatchDomainIsActiveHelper" #12 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2fa450, msg=0x7f793c2f73c0) at rpc/virnetserverprogram.c:437 arg = 0x7f791400a3b0 <incomplete sequence \340\242> ret = 0x7f791400a350 "" rv = -1 dispatcher = 0x7f793c077d40 <remoteProcs+7200> rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} i = 0 identity = 0x7f79140009a0 __FUNCTION__ = "virNetServerProgramDispatchCall" #13 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2fa450, msg=0x7f793c2f73c0) at rpc/virnetserverprogram.c:307 ret = -1 rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} __func__ = "virNetServerProgramDispatch" __FUNCTION__ = "virNetServerProgramDispatch" #14 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2fa450, prog=0x7f793c2eefd0, msg=0x7f793c2f73c0) at rpc/virnetserver.c:135 ret = -1 __func__ = "virNetServerProcessMsg" #15 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c2f9940, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 srv = 0x7f793c2e0a90 job = 0x7f793c2f9940 __func__ = "virNetServerHandleJob" #16 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c274120) at util/virthreadpool.c:145 data = 0x0 pool = 0x7f793c2e0be0 cond = 0x7f793c2e0c48 priority = false job = 0x7f793c2f99b0 #17 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ecea0) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c274120} #18 0x00007f79375c1ee5 in start_thread (arg=0x7f7929129700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f7929129700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140158356854528, 4958827372110045735, 0, 0, 140158356855232, 140158356854528, -5034152342730415577, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #19 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 17 (Thread 0x7f7928928700 (LWP 1316)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 obj = 0x7f78d80edd20 __func__ = "virObjectLock" #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f791000f224 "\251\204\033\250\240\321A\252\215(E\363~\211\210\255", ref=false) at conf/domain_conf.c:1259 uuidstr = "\227*1;y\177", '\000' <repeats 11 times>, "V1;y\177\000\000O\005\061;y\177\000\000\023\"\000\000\001" obj = 0x7f7928927820 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f791000f224 "\251\204\033\250\240\321A\252\215(E\363~\211\210\255") at conf/domain_conf.c:1285 No locals. #7 0x00007f78fe3f9f49 in libxlDomObjFromDomain (dom=0x7f791000f200) at libxl/libxl_driver.c:294 vm = 0x7f793b09d2b9 <virThreadLocalGet+25> driver = 0x7f78d81ce940 uuidstr = "\000y\222(y\177\000\000\272U\002;y\177\000\000\320x\222(y\177\000\000X\n\000\020y\177\000\000\060\320.<y" __FUNCTION__ = "libxlDomObjFromDomain" #8 0x00007f78fe40672b in libxlDomainIsActive (dom=0x7f791000f200) at libxl/libxl_driver.c:4581 obj = 0x7f7910000d90 ret = -1 #9 0x00007f793b185494 in virDomainIsActive (dom=0x7f791000f200) at libvirt-domain.c:8731 ret = 0 __func__ = "virDomainIsActive" __FUNCTION__ = "virDomainIsActive" #10 0x00007f793be184b2 in remoteDispatchDomainIsActive (server=0x7f793c2e0a90, client=0x7f793c2f7fa0, msg=0x7f793c3019f0, rerr=0x7f7928927ab0, args=0x7f791000f240, ret=0x7f791000f1e0) at remote_dispatch.h:5991 rv = -1 dom = 0x7f791000f200 active = 32633 priv = 0x7f793c2f8090 __FUNCTION__ = "remoteDispatchDomainIsActive" #11 0x00007f793be183bd in remoteDispatchDomainIsActiveHelper (server=0x7f793c2e0a90, client=0x7f793c2f7fa0, msg=0x7f793c3019f0, rerr=0x7f7928927ab0, args=0x7f791000f240, ret=0x7f791000f1e0) at remote_dispatch.h:5965 rv = 0 __func__ = "remoteDispatchDomainIsActiveHelper" #12 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f7fa0, msg=0x7f793c3019f0) at rpc/virnetserverprogram.c:437 arg = 0x7f791000f240 "\300", <incomplete sequence \313> ret = 0x7f791000f1e0 "" rv = -1 dispatcher = 0x7f793c077d40 <remoteProcs+7200> rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} i = 0 identity = 0x7f78f8000a20 __FUNCTION__ = "virNetServerProgramDispatchCall" #13 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f7fa0, msg=0x7f793c3019f0) at rpc/virnetserverprogram.c:307 ret = -1 rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} __func__ = "virNetServerProgramDispatch" __FUNCTION__ = "virNetServerProgramDispatch" #14 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f7fa0, prog=0x7f793c2eefd0, msg=0x7f793c3019f0) at rpc/virnetserver.c:135 ret = -1 __func__ = "virNetServerProcessMsg" #15 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c2f55f0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 srv = 0x7f793c2e0a90 job = 0x7f793c2f55f0 __func__ = "virNetServerHandleJob" #16 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0910) at util/virthreadpool.c:145 data = 0x0 pool = 0x7f793c2e0be0 cond = 0x7f793c2e0c48 priority = false job = 0x7f793c300820 #17 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ece70) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c2e0910} #18 0x00007f79375c1ee5 in start_thread (arg=0x7f7928928700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f7928928700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140158348461824, 4958827372110045735, 0, 0, 140158348462528, 140158348461824, -5034151250198109657, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #19 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 16 (Thread 0x7f791bfff700 (LWP 1317)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 obj = 0x7f78d80edd20 __func__ = "virObjectLock" #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f7908001530 "\274\362i\375\344DI\275\260[;HM@\372K", ref=false) at conf/domain_conf.c:1259 uuidstr = "[\000\000\000\001\000\000\000;\000\000\000y\177\000\000H\000\000\000\002\000\000\000\271\322\t;y\177\000\000@\000\000\000\266" obj = 0x7f79000000b0 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f7908001530 "\274\362i\375\344DI\275\260[;HM@\372K") at conf/domain_conf.c:1285 No locals. #7 0x00007f78fe3fbebf in libxlDomainLookupByUUID (conn=0x7f790c002660, uuid=0x7f7908001530 "\274\362i\375\344DI\275\260[;HM@\372K") at libxl/libxl_driver.c:1048 driver = 0x7f78d81ce940 vm = 0x7f790c002660 dom = 0x0 __FUNCTION__ = "libxlDomainLookupByUUID" #8 0x00007f793b16688e in virDomainLookupByUUID (conn=0x7f790c002660, uuid=0x7f7908001530 "\274\362i\375\344DI\275\260[;HM@\372K") at libvirt-domain.c:349 ret = 0x7f793c2f7120 __func__ = "virDomainLookupByUUID" __FUNCTION__ = "virDomainLookupByUUID" #9 0x00007f793be18ec3 in remoteDispatchDomainLookupByUUID (server=0x7f793c2e0a90, client=0x7f793c2f7120, msg=0x7f793c2f5440, rerr=0x7f791bffeab0, args=0x7f7908001530, ret=0x7f7908001810) at remote_dispatch.h:6306 rv = -1 dom = 0x0 priv = 0x7f793c2f4e20 __FUNCTION__ = "remoteDispatchDomainLookupByUUID" #10 0x00007f793be18e06 in remoteDispatchDomainLookupByUUIDHelper (server=0x7f793c2e0a90, client=0x7f793c2f7120, msg=0x7f793c2f5440, rerr=0x7f791bffeab0, args=0x7f7908001530, ret=0x7f7908001810) at remote_dispatch.h:6284 rv = 0 __func__ = "remoteDispatchDomainLookupByUUIDHelper" #11 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f7120, msg=0x7f793c2f5440) at rpc/virnetserverprogram.c:437 arg = 0x7f7908001530 "\274\362i\375\344DI\275\260[;HM@\372K" ret = 0x7f7908001810 "" rv = -1 dispatcher = 0x7f793c0765a0 <remoteProcs+1152> rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} i = 0 identity = 0x7f7908001550 __FUNCTION__ = "virNetServerProgramDispatchCall" #12 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f7120, msg=0x7f793c2f5440) at rpc/virnetserverprogram.c:307 ret = -1 rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} __func__ = "virNetServerProgramDispatch" __FUNCTION__ = "virNetServerProgramDispatch" #13 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f7120, prog=0x7f793c2eefd0, msg=0x7f793c2f5440) at rpc/virnetserver.c:135 ret = -1 __func__ = "virNetServerProcessMsg" #14 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c30d240, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 srv = 0x7f793c2e0a90 job = 0x7f793c30d240 __func__ = "virNetServerHandleJob" #15 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c274120) at util/virthreadpool.c:145 data = 0x0 pool = 0x7f793c2e0be0 cond = 0x7f793c2e0ce0 priority = true job = 0x7f793c30bdc0 #16 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2eced0) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c274120} #17 0x00007f79375c1ee5 in start_thread (arg=0x7f791bfff700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f791bfff700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140158137530112, 4958827372110045735, 0, 0, 140158137530816, 140158137530112, -5034042764156050905, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #18 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 15 (Thread 0x7f791b7fe700 (LWP 1318)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 obj = 0x7f78d80edd20 __func__ = "virObjectLock" #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f790c001c14 "5\272S\302erO<\232\061\213\357$\271\367N", ref=false) at conf/domain_conf.c:1259 uuidstr = "\227*1;y\177", '\000' <repeats 11 times>, "V1;y\177\000\000O\005\061;y\177\000\000\023\"\000\000\001" obj = 0x7f791b7fd820 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f790c001c14 "5\272S\302erO<\232\061\213\357$\271\367N") at conf/domain_conf.c:1285 No locals. #7 0x00007f78fe3f9f49 in libxlDomObjFromDomain (dom=0x7f790c001bf0) at libxl/libxl_driver.c:294 vm = 0x7f793b09d2b9 <virThreadLocalGet+25> driver = 0x7f78d81ce940 uuidstr = "\000\331\177\033y\177\000\000\272U\002;y\177\000\000\320\330\177\033y\177\000\000X\n\000\fy\177\000\000\060\320.<y" __FUNCTION__ = "libxlDomObjFromDomain" #8 0x00007f78fe40672b in libxlDomainIsActive (dom=0x7f790c001bf0) at libxl/libxl_driver.c:4581 obj = 0x7f78f8000d30 ret = -1 #9 0x00007f793b185494 in virDomainIsActive (dom=0x7f790c001bf0) at libvirt-domain.c:8731 ret = 0 __func__ = "virDomainIsActive" __FUNCTION__ = "virDomainIsActive" #10 0x00007f793be184b2 in remoteDispatchDomainIsActive (server=0x7f793c2e0a90, client=0x7f793c2f8bc0, msg=0x7f793c2f7300, rerr=0x7f791b7fdab0, args=0x7f790c001c30, ret=0x7f790c001bd0) at remote_dispatch.h:5991 rv = -1 dom = 0x7f790c001bf0 active = 32633 priv = 0x7f793c2f7f10 __FUNCTION__ = "remoteDispatchDomainIsActive" #11 0x00007f793be183bd in remoteDispatchDomainIsActiveHelper (server=0x7f793c2e0a90, client=0x7f793c2f8bc0, msg=0x7f793c2f7300, rerr=0x7f791b7fdab0, args=0x7f790c001c30, ret=0x7f790c001bd0) at remote_dispatch.h:5965 rv = 0 __func__ = "remoteDispatchDomainIsActiveHelper" #12 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f8bc0, msg=0x7f793c2f7300) at rpc/virnetserverprogram.c:437 arg = 0x7f790c001c30 "`\033" ret = 0x7f790c001bd0 "" rv = -1 dispatcher = 0x7f793c077d40 <remoteProcs+7200> rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} i = 0 identity = 0x7f791c0012f0 __FUNCTION__ = "virNetServerProgramDispatchCall" #13 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f8bc0, msg=0x7f793c2f7300) at rpc/virnetserverprogram.c:307 ret = -1 rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} __func__ = "virNetServerProgramDispatch" __FUNCTION__ = "virNetServerProgramDispatch" #14 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f8bc0, prog=0x7f793c2eefd0, msg=0x7f793c2f7300) at rpc/virnetserver.c:135 ret = -1 __func__ = "virNetServerProcessMsg" #15 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c30bdf0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 srv = 0x7f793c2e0a90 job = 0x7f793c30bdf0 __func__ = "virNetServerHandleJob" #16 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0750) at util/virthreadpool.c:145 data = 0x0 pool = 0x7f793c2e0be0 cond = 0x7f793c2e0ce0 priority = true job = 0x7f793c3050c0 #17 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ece70) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c2e0750} #18 0x00007f79375c1ee5 in start_thread (arg=0x7f791b7fe700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f791b7fe700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140158129137408, 4958827372110045735, 0, 0, 140158129138112, 140158129137408, -5034041663033810393, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #19 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 14 (Thread 0x7f791affd700 (LWP 1319)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 obj = 0x7f78d80edd20 __func__ = "virObjectLock" #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f7900000e50 "\306\060W\177\005\034G\362\236GcfKU", <incomplete sequence \373>, ref=false) at conf/domain_conf.c:1259 uuidstr = "G\000\000\000\001\000\000\000c\000\000\000y\177\000\000f\000\000\000\002\000\000\000\271\322\t;y\177\000\000U\000\000\000\266" obj = 0x7f790000009e #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f7900000e50 "\306\060W\177\005\034G\362\236GcfKU", <incomplete sequence \373>) at conf/domain_conf.c:1285 No locals. #7 0x00007f78fe3fbebf in libxlDomainLookupByUUID (conn=0x7f7908000be0, uuid=0x7f7900000e50 "\306\060W\177\005\034G\362\236GcfKU", <incomplete sequence \373>) at libxl/libxl_driver.c:1048 driver = 0x7f78d81ce940 vm = 0x7f7908000be0 dom = 0x0 __FUNCTION__ = "libxlDomainLookupByUUID" #8 0x00007f793b16688e in virDomainLookupByUUID (conn=0x7f7908000be0, uuid=0x7f7900000e50 "\306\060W\177\005\034G\362\236GcfKU", <incomplete sequence \373>) at libvirt-domain.c:349 ret = 0x7f793c2f3730 __func__ = "virDomainLookupByUUID" __FUNCTION__ = "virDomainLookupByUUID" #9 0x00007f793be18ec3 in remoteDispatchDomainLookupByUUID (server=0x7f793c2e0a90, client=0x7f793c2f3730, msg=0x7f793c2fed10, rerr=0x7f791affcab0, args=0x7f7900000e50, ret=0x7f7900000eb0) at remote_dispatch.h:6306 rv = -1 dom = 0x0 priv = 0x7f793c2e1c90 __FUNCTION__ = "remoteDispatchDomainLookupByUUID" #10 0x00007f793be18e06 in remoteDispatchDomainLookupByUUIDHelper (server=0x7f793c2e0a90, client=0x7f793c2f3730, msg=0x7f793c2fed10, rerr=0x7f791affcab0, args=0x7f7900000e50, ret=0x7f7900000eb0) at remote_dispatch.h:6284 rv = 0 __func__ = "remoteDispatchDomainLookupByUUIDHelper" #11 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f3730, msg=0x7f793c2fed10) at rpc/virnetserverprogram.c:437 arg = 0x7f7900000e50 "\306\060W\177\005\034G\362\236GcfKU", <incomplete sequence \373> ret = 0x7f7900000eb0 "" rv = -1 dispatcher = 0x7f793c0765a0 <remoteProcs+1152> rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} i = 0 identity = 0x7f78f80009c0 __FUNCTION__ = "virNetServerProgramDispatchCall" #12 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f3730, msg=0x7f793c2fed10) at rpc/virnetserverprogram.c:307 ret = -1 rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} __func__ = "virNetServerProgramDispatch" __FUNCTION__ = "virNetServerProgramDispatch" #13 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f3730, prog=0x7f793c2eefd0, msg=0x7f793c2fed10) at rpc/virnetserver.c:135 ret = -1 __func__ = "virNetServerProcessMsg" #14 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c2ff580, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 srv = 0x7f793c2e0a90 job = 0x7f793c2ff580 __func__ = "virNetServerHandleJob" #15 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0910) at util/virthreadpool.c:145 data = 0x0 pool = 0x7f793c2e0be0 cond = 0x7f793c2e0ce0 priority = true job = 0x7f793c2f3420 #16 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2eced0) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c2e0910} #17 0x00007f79375c1ee5 in start_thread (arg=0x7f791affd700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f791affd700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140158120744704, 4958827372110045735, 0, 0, 140158120745408, 140158120744704, -5034040564059053529, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #18 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 13 (Thread 0x7f791a7fc700 (LWP 1320)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 obj = 0x7f78d80edd20 __func__ = "virObjectLock" #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f7904000920 "\223n[\200\020\264BC\242\060ááá)#@", ref=false) at conf/domain_conf.c:1259 uuidstr = "0\000\000\000\001\000\000\000\354\000\000\000y\177\000\000\247\000\000\000\002\000\000\000\271\322\t;y\177\000\000)\000\000\000\266" obj = 0x7f79000000a2 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f7904000920 "\223n[\200\020\264BC\242\060ááá)#@") at conf/domain_conf.c:1285 No locals. #7 0x00007f78fe3fbebf in libxlDomainLookupByUUID (conn=0x7f7910000a80, uuid=0x7f7904000920 "\223n[\200\020\264BC\242\060ááá)#@") at libxl/libxl_driver.c:1048 driver = 0x7f78d81ce940 vm = 0x7f7910000a80 dom = 0x0 __FUNCTION__ = "libxlDomainLookupByUUID" #8 0x00007f793b16688e in virDomainLookupByUUID (conn=0x7f7910000a80, uuid=0x7f7904000920 "\223n[\200\020\264BC\242\060ááá)#@") at libvirt-domain.c:349 ret = 0x7f793c2e1d10 __func__ = "virDomainLookupByUUID" __FUNCTION__ = "virDomainLookupByUUID" #9 0x00007f793be18ec3 in remoteDispatchDomainLookupByUUID (server=0x7f793c2e0a90, client=0x7f793c2e1d10, msg=0x7f793c301070, rerr=0x7f791a7fbab0, args=0x7f7904000920, ret=0x7f7904000960) at remote_dispatch.h:6306 rv = -1 dom = 0x0 priv = 0x7f793c2f54b0 __FUNCTION__ = "remoteDispatchDomainLookupByUUID" #10 0x00007f793be18e06 in remoteDispatchDomainLookupByUUIDHelper (server=0x7f793c2e0a90, client=0x7f793c2e1d10, msg=0x7f793c301070, rerr=0x7f791a7fbab0, args=0x7f7904000920, ret=0x7f7904000960) at remote_dispatch.h:6284 rv = 0 __func__ = "remoteDispatchDomainLookupByUUIDHelper" #11 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2e1d10, msg=0x7f793c301070) at rpc/virnetserverprogram.c:437 arg = 0x7f7904000920 "\223n[\200\020\264BC\242\060ááá)#@" ret = 0x7f7904000960 "" rv = -1 dispatcher = 0x7f793c0765a0 <remoteProcs+1152> rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} i = 0 identity = 0x7f79040009c0 __FUNCTION__ = "virNetServerProgramDispatchCall" #12 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2e1d10, msg=0x7f793c301070) at rpc/virnetserverprogram.c:307 ret = -1 rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} __func__ = "virNetServerProgramDispatch" __FUNCTION__ = "virNetServerProgramDispatch" #13 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2e1d10, prog=0x7f793c2eefd0, msg=0x7f793c301070) at rpc/virnetserver.c:135 ret = -1 __func__ = "virNetServerProcessMsg" #14 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c30b3a0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 srv = 0x7f793c2e0a90 job = 0x7f793c30b3a0 __func__ = "virNetServerHandleJob" #15 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2e0750) at util/virthreadpool.c:145 data = 0x0 pool = 0x7f793c2e0be0 cond = 0x7f793c2e0ce0 priority = true job = 0x7f793c2f8710 #16 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ece70) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c2e0750} #17 0x00007f79375c1ee5 in start_thread (arg=0x7f791a7fc700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f791a7fc700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140158112352000, 4958827372110045735, 0, 0, 140158112352704, 140158112352000, -5034039462936813017, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #18 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 12 (Thread 0x7f7919ffb700 (LWP 1321)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 obj = 0x7f78d80edd20 __func__ = "virObjectLock" #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f78f8000924 "!\037\207\266G\220KZ\211\024_~\325\022\327\"", ref=false) at conf/domain_conf.c:1259 uuidstr = "\227*1;y\177", '\000' <repeats 11 times>, "V1;y\177\000\000O\005\061;y\177\000\000\023\"\000\000\001" obj = 0x7f7919ffa820 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f78f8000924 "!\037\207\266G\220KZ\211\024_~\325\022\327\"") at conf/domain_conf.c:1285 No locals. #7 0x00007f78fe3f9f49 in libxlDomObjFromDomain (dom=0x7f78f8000900) at libxl/libxl_driver.c:294 vm = 0x7f793b09d2b9 <virThreadLocalGet+25> driver = 0x7f78d81ce940 uuidstr = "\000\251\377\031y\177\000\000\272U\002;y\177\000\000Ð\377\031y\177\000\000\b\r\000\370x\177\000\000\060\320.<y" __FUNCTION__ = "libxlDomObjFromDomain" #8 0x00007f78fe40672b in libxlDomainIsActive (dom=0x7f78f8000900) at libxl/libxl_driver.c:4581 obj = 0x7f791c000be0 ret = -1 #9 0x00007f793b185494 in virDomainIsActive (dom=0x7f78f8000900) at libvirt-domain.c:8731 ret = 0 __func__ = "virDomainIsActive" __FUNCTION__ = "virDomainIsActive" #10 0x00007f793be184b2 in remoteDispatchDomainIsActive (server=0x7f793c2e0a90, client=0x7f793c2f2de0, msg=0x7f793c302ba0, rerr=0x7f7919ffaab0, args=0x7f78f8000940, ret=0x7f78f8000cb0) at remote_dispatch.h:5991 rv = -1 dom = 0x7f78f8000900 active = 32633 priv = 0x7f793c2f3610 __FUNCTION__ = "remoteDispatchDomainIsActive" #11 0x00007f793be183bd in remoteDispatchDomainIsActiveHelper (server=0x7f793c2e0a90, client=0x7f793c2f2de0, msg=0x7f793c302ba0, rerr=0x7f7919ffaab0, args=0x7f78f8000940, ret=0x7f78f8000cb0) at remote_dispatch.h:5965 rv = 0 __func__ = "remoteDispatchDomainIsActiveHelper" #12 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f2de0, msg=0x7f793c302ba0) at rpc/virnetserverprogram.c:437 arg = 0x7f78f8000940 "\360\021" ret = 0x7f78f8000cb0 "" rv = -1 dispatcher = 0x7f793c077d40 <remoteProcs+7200> rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} i = 0 identity = 0x7f7920000a20 __FUNCTION__ = "virNetServerProgramDispatchCall" #13 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f2de0, msg=0x7f793c302ba0) at rpc/virnetserverprogram.c:307 ret = -1 rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} __func__ = "virNetServerProgramDispatch" __FUNCTION__ = "virNetServerProgramDispatch" #14 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f2de0, prog=0x7f793c2eefd0, msg=0x7f793c302ba0) at rpc/virnetserver.c:135 ret = -1 __func__ = "virNetServerProcessMsg" #15 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c2f5580, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 srv = 0x7f793c2e0a90 job = 0x7f793c2f5580 __func__ = "virNetServerHandleJob" #16 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c274120) at util/virthreadpool.c:145 data = 0x0 pool = 0x7f793c2e0be0 cond = 0x7f793c2e0ce0 priority = true job = 0x7f793c2f8b00 #17 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2eced0) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c274120} #18 0x00007f79375c1ee5 in start_thread (arg=0x7f7919ffb700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f7919ffb700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140158103959296, 4958827372110045735, 0, 0, 140158103960000, 140158103959296, -5034047160055078361, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #19 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 11 (Thread 0x7f78fd6ff700 (LWP 1334)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 No locals. #1 0x00007f793b09ce68 in virCondWait (c=0x7f793c2ef638, m=0x7f793c2ef610) at util/virthread.c:154 ret = 32633 #2 0x00007f793b09d83e in virThreadPoolWorker (opaque=0x7f793c2ef3c0) at util/virthreadpool.c:105 data = 0x0 pool = 0x7f793c2ef5d0 cond = 0x7f793c2ef638 priority = false job = 0x0 #3 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ef3e0) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c2ef3c0} #4 0x00007f79375c1ee5 in start_thread (arg=0x7f78fd6ff700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f78fd6ff700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140157624776448, 4958827372110045735, 0, 0, 140157624777152, 140157624776448, -5034828777530957273, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #5 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 10 (Thread 0x7f78fcefe700 (LWP 1335)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 No locals. #1 0x00007f793b09ce68 in virCondWait (c=0x7f793c2ef638, m=0x7f793c2ef610) at util/virthread.c:154 ret = 32633 #2 0x00007f793b09d83e in virThreadPoolWorker (opaque=0x7f793c2ef2e0) at util/virthreadpool.c:105 data = 0x0 pool = 0x7f793c2ef5d0 cond = 0x7f793c2ef638 priority = false job = 0x0 #3 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ef890) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c2ef2e0} #4 0x00007f79375c1ee5 in start_thread (arg=0x7f78fcefe700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f78fcefe700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140157616383744, 4958827372110045735, 0, 0, 140157616384448, 140157616383744, -5034827676408716761, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #5 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 9 (Thread 0x7f78f3fff700 (LWP 1336)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 No locals. #1 0x00007f793b09ce68 in virCondWait (c=0x7f793c2ef638, m=0x7f793c2ef610) at util/virthread.c:154 ret = 32633 #2 0x00007f793b09d83e in virThreadPoolWorker (opaque=0x7f793c2ef350) at util/virthreadpool.c:105 data = 0x0 pool = 0x7f793c2ef5d0 cond = 0x7f793c2ef638 priority = false job = 0x0 #3 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ef3e0) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c2ef350} #4 0x00007f79375c1ee5 in start_thread (arg=0x7f78f3fff700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f78f3fff700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140157466441472, 4958827372110045735, 0, 0, 140157466442176, 140157466441472, -5034834412528049625, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #5 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 8 (Thread 0x7f78ebfff700 (LWP 1337)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 No locals. #1 0x00007f793b09ce68 in virCondWait (c=0x7f793c2ef638, m=0x7f793c2ef610) at util/virthread.c:154 ret = 32633 #2 0x00007f793b09d83e in virThreadPoolWorker (opaque=0x7f793c2ef3c0) at util/virthreadpool.c:105 data = 0x0 pool = 0x7f793c2ef5d0 cond = 0x7f793c2ef638 priority = false job = 0x0 #3 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ef890) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c2ef3c0} #4 0x00007f79375c1ee5 in start_thread (arg=0x7f78ebfff700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f78ebfff700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140157332223744, 4958827372110045735, 0, 0, 140157332224448, 140157332223744, -5034852004714094041, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #5 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 7 (Thread 0x7f78f37fe700 (LWP 1338)): #0 pthread_cond_wait@@GLIBC_2.3.2 () at ../nptl/sysdeps/unix/sysv/linux/x86_64/pthread_cond_wait.S:185 No locals. #1 0x00007f793b09ce68 in virCondWait (c=0x7f793c2ef638, m=0x7f793c2ef610) at util/virthread.c:154 ret = 32633 #2 0x00007f793b09d83e in virThreadPoolWorker (opaque=0x7f793c2ef240) at util/virthreadpool.c:105 data = 0x0 pool = 0x7f793c2ef5d0 cond = 0x7f793c2ef638 priority = false job = 0x0 #3 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2ef3e0) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c2ef240} #4 0x00007f79375c1ee5 in start_thread (arg=0x7f78f37fe700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f78f37fe700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140157458048768, 4958827372110045735, 0, 0, 140157458049472, 140157458048768, -5034833311405809113, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #5 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 6 (Thread 0x7f793bf94700 (LWP 1494)): #0 0x00007f79375c87fd in read () at ../sysdeps/unix/syscall-template.S:81 No locals. #1 0x00007f793237676d in read_all (fd=24, data=data@entry=0x7f78cc000fe0, len=len@entry=16, nonblocking=0) at xs.c:377 done = <optimized out> #2 0x00007f79323767f2 in read_all (nonblocking=0, len=16, data=0x7f78cc000fe0, fd=<optimized out>) at xs.c:1149 No locals. #3 read_message (h=h@entry=0x7f78d80eaaf0, nonblocking=0) at xs.c:1149 msg = 0x7f78cc000fd0 body = 0x0 saved_errno = 0 ret = -1 #4 0x00007f7932376a01 in read_thread (arg=0x7f78d80eaaf0) at xs.c:1221 h = 0x7f78d80eaaf0 fd = <optimized out> #5 0x00007f79375c1ee5 in start_thread (arg=0x7f793bf94700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f793bf94700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140158673962752, 4958827372110045735, 0, 0, 140158673963456, 140158673962752, -5034113117330972121, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #6 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 5 (Thread 0x7f78f241d700 (LWP 17709)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 obj = 0x7f78d80edd20 __func__ = "virObjectLock" #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f78d81fb5d4 "\343\371\307On!A\217\272;\223\025\344\343w\v", ref=false) at conf/domain_conf.c:1259 uuidstr = "\227*1;y\177\000\000 \000\000\330x\177\000\000\000\004\000\000\000\000\000\000P", '\000' <repeats 11 times> obj = 0x7f78f241c820 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f78d81fb5d4 "\343\371\307On!A\217\272;\223\025\344\343w\v") at conf/domain_conf.c:1285 No locals. #7 0x00007f78fe3f9f49 in libxlDomObjFromDomain (dom=0x7f78d81fb5b0) at libxl/libxl_driver.c:294 vm = 0x7f793b5c1228 <virLastErr> driver = 0x7f78d81ce940 uuidstr = "P\000\000\000\000\000\000\000\272U\002;y\177\000\000\320\310A\362x\177\000\000\270\267#\330x\177\000\000\000\000\000\000" __FUNCTION__ = "libxlDomObjFromDomain" #8 0x00007f78fe40672b in libxlDomainIsActive (dom=0x7f78d81fb5b0) at libxl/libxl_driver.c:4581 obj = 0x7f7900001740 ret = -1 #9 0x00007f793b185494 in virDomainIsActive (dom=0x7f78d81fb5b0) at libvirt-domain.c:8731 ret = 0 __func__ = "virDomainIsActive" __FUNCTION__ = "virDomainIsActive" #10 0x00007f793be184b2 in remoteDispatchDomainIsActive (server=0x7f793c2e0a90, client=0x7f793c2f8d60, msg=0x7f793c2f66f0, rerr=0x7f78f241cab0, args=0x7f78d81db4b0, ret=0x7f78d82370d0) at remote_dispatch.h:5991 rv = -1 dom = 0x7f78d81fb5b0 active = 32633 priv = 0x7f793c2f87c0 __FUNCTION__ = "remoteDispatchDomainIsActive" #11 0x00007f793be183bd in remoteDispatchDomainIsActiveHelper (server=0x7f793c2e0a90, client=0x7f793c2f8d60, msg=0x7f793c2f66f0, rerr=0x7f78f241cab0, args=0x7f78d81db4b0, ret=0x7f78d82370d0) at remote_dispatch.h:5965 rv = 0 __func__ = "remoteDispatchDomainIsActiveHelper" #12 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f8d60, msg=0x7f793c2f66f0) at rpc/virnetserverprogram.c:437 arg = 0x7f78d81db4b0 "`\n" ret = 0x7f78d82370d0 "" rv = -1 dispatcher = 0x7f793c077d40 <remoteProcs+7200> rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} i = 0 identity = 0x7f790c0010b0 __FUNCTION__ = "virNetServerProgramDispatchCall" #13 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f8d60, msg=0x7f793c2f66f0) at rpc/virnetserverprogram.c:307 ret = -1 rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} __func__ = "virNetServerProgramDispatch" __FUNCTION__ = "virNetServerProgramDispatch" #14 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f8d60, prog=0x7f793c2eefd0, msg=0x7f793c2f66f0) at rpc/virnetserver.c:135 ret = -1 __func__ = "virNetServerProcessMsg" #15 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c2f74a0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 srv = 0x7f793c2e0a90 job = 0x7f793c2f74a0 __func__ = "virNetServerHandleJob" #16 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c30be60) at util/virthreadpool.c:145 data = 0x0 pool = 0x7f793c2e0be0 cond = 0x7f793c2e0c48 priority = false job = 0x7f793c3007f0 #17 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2e0970) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c30be60} #18 0x00007f79375c1ee5 in start_thread (arg=0x7f78f241d700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f78f241d700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140157437204224, 4958827372110045735, 0, 0, 140157437204928, 140157437204224, -5034831164459032025, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #19 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 4 (Thread 0x7f78f1c1c700 (LWP 17717)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 obj = 0x7f78d80edd20 __func__ = "virObjectLock" #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f78d00009a0 "\230\212\207\340\376\240LÖ\242Ã\212\207\207", <incomplete sequence \343>, ref=false) at conf/domain_conf.c:1259 uuidstr = "\000\000\000\000\000\000\000\000\337\322\t;y\177\000\000\060\n\000\320x\177\000\000(\022\\;y\177\000\000P\000\000\000" obj = 0x0 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f78d00009a0 "\230\212\207\340\376\240LÖ\242Ã\212\207\207", <incomplete sequence \343>) at conf/domain_conf.c:1285 No locals. #7 0x00007f78fe3fbebf in libxlDomainLookupByUUID (conn=0x7f7914000a80, uuid=0x7f78d00009a0 "\230\212\207\340\376\240LÖ\242Ã\212\207\207", <incomplete sequence \343>) at libxl/libxl_driver.c:1048 driver = 0x7f78d81ce940 vm = 0x7f7914000a80 dom = 0x0 __FUNCTION__ = "libxlDomainLookupByUUID" #8 0x00007f793b16688e in virDomainLookupByUUID (conn=0x7f7914000a80, uuid=0x7f78d00009a0 "\230\212\207\340\376\240LÖ\242Ã\212\207\207", <incomplete sequence \343>) at libvirt-domain.c:349 ret = 0x7f793c2f25c0 __func__ = "virDomainLookupByUUID" __FUNCTION__ = "virDomainLookupByUUID" #9 0x00007f793be18ec3 in remoteDispatchDomainLookupByUUID (server=0x7f793c2e0a90, client=0x7f793c2f25c0, msg=0x7f793c301170, rerr=0x7f78f1c1bab0, args=0x7f78d00009a0, ret=0x7f78d0000900) at remote_dispatch.h:6306 rv = -1 dom = 0x0 priv = 0x7f793c2e1e00 __FUNCTION__ = "remoteDispatchDomainLookupByUUID" #10 0x00007f793be18e06 in remoteDispatchDomainLookupByUUIDHelper (server=0x7f793c2e0a90, client=0x7f793c2f25c0, msg=0x7f793c301170, rerr=0x7f78f1c1bab0, args=0x7f78d00009a0, ret=0x7f78d0000900) at remote_dispatch.h:6284 rv = 0 __func__ = "remoteDispatchDomainLookupByUUIDHelper" #11 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f25c0, msg=0x7f793c301170) at rpc/virnetserverprogram.c:437 arg = 0x7f78d00009a0 "\230\212\207\340\376\240LÖ\242Ã\212\207\207", <incomplete sequence \343> ret = 0x7f78d0000900 "" rv = -1 dispatcher = 0x7f793c0765a0 <remoteProcs+1152> rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} i = 0 identity = 0x7f791c000a20 __FUNCTION__ = "virNetServerProgramDispatchCall" #12 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f25c0, msg=0x7f793c301170) at rpc/virnetserverprogram.c:307 ret = -1 rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} __func__ = "virNetServerProgramDispatch" __FUNCTION__ = "virNetServerProgramDispatch" #13 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f25c0, prog=0x7f793c2eefd0, msg=0x7f793c301170) at rpc/virnetserver.c:135 ret = -1 __func__ = "virNetServerProcessMsg" #14 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c3009e0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 srv = 0x7f793c2e0a90 job = 0x7f793c3009e0 __func__ = "virNetServerHandleJob" #15 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c2f7510) at util/virthreadpool.c:145 data = 0x0 pool = 0x7f793c2e0be0 cond = 0x7f793c2e0c48 priority = false job = 0x7f793c2f86a0 #16 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2fee10) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c2f7510} #17 0x00007f79375c1ee5 in start_thread (arg=0x7f78f1c1c700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f78f1c1c700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140157428811520, 4958827372110045735, 0, 0, 140157428812224, 140157428811520, -5034838859429813721, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #18 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 3 (Thread 0x7f78f141b700 (LWP 17722)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 obj = 0x7f78d80edd20 __func__ = "virObjectLock" #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f78c40009a0 "\"\036F\275\324\337L\027\235\201\227 L\207\300\256", ref=false) at conf/domain_conf.c:1259 uuidstr = "\000\000\000\000\000\000\000\000\337\322\t;y\177\000\000\060\n\000\304x\177\000\000(\022\\;y\177\000\000P\000\000\000" obj = 0x0 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f78c40009a0 "\"\036F\275\324\337L\027\235\201\227 L\207\300\256") at conf/domain_conf.c:1285 No locals. #7 0x00007f78fe3fbebf in libxlDomainLookupByUUID (conn=0x7f7924000be0, uuid=0x7f78c40009a0 "\"\036F\275\324\337L\027\235\201\227 L\207\300\256") at libxl/libxl_driver.c:1048 driver = 0x7f78d81ce940 vm = 0x7f7924000be0 dom = 0x0 __FUNCTION__ = "libxlDomainLookupByUUID" #8 0x00007f793b16688e in virDomainLookupByUUID (conn=0x7f7924000be0, uuid=0x7f78c40009a0 "\"\036F\275\324\337L\027\235\201\227 L\207\300\256") at libvirt-domain.c:349 ret = 0x7f793c2f6760 __func__ = "virDomainLookupByUUID" __FUNCTION__ = "virDomainLookupByUUID" #9 0x00007f793be18ec3 in remoteDispatchDomainLookupByUUID (server=0x7f793c2e0a90, client=0x7f793c2f6760, msg=0x7f793c2f4a70, rerr=0x7f78f141aab0, args=0x7f78c40009a0, ret=0x7f78c4000900) at remote_dispatch.h:6306 rv = -1 dom = 0x0 priv = 0x7f793c2f5710 __FUNCTION__ = "remoteDispatchDomainLookupByUUID" #10 0x00007f793be18e06 in remoteDispatchDomainLookupByUUIDHelper (server=0x7f793c2e0a90, client=0x7f793c2f6760, msg=0x7f793c2f4a70, rerr=0x7f78f141aab0, args=0x7f78c40009a0, ret=0x7f78c4000900) at remote_dispatch.h:6284 rv = 0 __func__ = "remoteDispatchDomainLookupByUUIDHelper" #11 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f6760, msg=0x7f793c2f4a70) at rpc/virnetserverprogram.c:437 arg = 0x7f78c40009a0 "\"\036F\275\324\337L\027\235\201\227 L\207\300\256" ret = 0x7f78c4000900 "" rv = -1 dispatcher = 0x7f793c0765a0 <remoteProcs+1152> rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} i = 0 identity = 0x7f79100013f0 __FUNCTION__ = "virNetServerProgramDispatchCall" #12 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f6760, msg=0x7f793c2f4a70) at rpc/virnetserverprogram.c:307 ret = -1 rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} __func__ = "virNetServerProgramDispatch" __FUNCTION__ = "virNetServerProgramDispatch" #13 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f6760, prog=0x7f793c2eefd0, msg=0x7f793c2f4a70) at rpc/virnetserver.c:135 ret = -1 __func__ = "virNetServerProcessMsg" #14 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c309fa0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 srv = 0x7f793c2e0a90 job = 0x7f793c309fa0 __func__ = "virNetServerHandleJob" #15 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c300a50) at util/virthreadpool.c:145 data = 0x0 pool = 0x7f793c2e0be0 cond = 0x7f793c2e0c48 priority = false job = 0x7f793c3094a0 #16 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2fee10) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c300a50} #17 0x00007f79375c1ee5 in start_thread (arg=0x7f78f141b700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f78f141b700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140157420418816, 4958827372110045735, 0, 0, 140157420419520, 140157420418816, -5034837760455056857, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #18 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 2 (Thread 0x7f78f0c1a700 (LWP 17751)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 obj = 0x7f78d80edd20 __func__ = "virObjectLock" #5 0x00007f793b0b726e in virDomainObjListFindByUUIDInternal (doms=0x7f78d80edd20, uuid=0x7f78c80009a0 "\036\037\304M\345\nG\265\231É\272a!", <incomplete sequence \304>, ref=false) at conf/domain_conf.c:1259 uuidstr = "\000\000\000\000\000\000\000\000\337\322\t;y\177\000\000\060\n\000\310x\177\000\000(\022\\;y\177\000\000P\000\000\000" obj = 0x0 #6 0x00007f793b0b735b in virDomainObjListFindByUUID (doms=0x7f78d80edd20, uuid=0x7f78c80009a0 "\036\037\304M\345\nG\265\231É\272a!", <incomplete sequence \304>) at conf/domain_conf.c:1285 No locals. #7 0x00007f78fe3fbebf in libxlDomainLookupByUUID (conn=0x7f790c000a80, uuid=0x7f78c80009a0 "\036\037\304M\345\nG\265\231É\272a!", <incomplete sequence \304>) at libxl/libxl_driver.c:1048 driver = 0x7f78d81ce940 vm = 0x7f790c000a80 dom = 0x0 __FUNCTION__ = "libxlDomainLookupByUUID" #8 0x00007f793b16688e in virDomainLookupByUUID (conn=0x7f790c000a80, uuid=0x7f78c80009a0 "\036\037\304M\345\nG\265\231É\272a!", <incomplete sequence \304>) at libvirt-domain.c:349 ret = 0x7f793c2f5350 __func__ = "virDomainLookupByUUID" __FUNCTION__ = "virDomainLookupByUUID" #9 0x00007f793be18ec3 in remoteDispatchDomainLookupByUUID (server=0x7f793c2e0a90, client=0x7f793c2f5350, msg=0x7f793c3052e0, rerr=0x7f78f0c19ab0, args=0x7f78c80009a0, ret=0x7f78c8000900) at remote_dispatch.h:6306 rv = -1 dom = 0x0 priv = 0x7f793c2f4010 __FUNCTION__ = "remoteDispatchDomainLookupByUUID" #10 0x00007f793be18e06 in remoteDispatchDomainLookupByUUIDHelper (server=0x7f793c2e0a90, client=0x7f793c2f5350, msg=0x7f793c3052e0, rerr=0x7f78f0c19ab0, args=0x7f78c80009a0, ret=0x7f78c8000900) at remote_dispatch.h:6284 rv = 0 __func__ = "remoteDispatchDomainLookupByUUIDHelper" #11 0x00007f793b1fccfc in virNetServerProgramDispatchCall (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f5350, msg=0x7f793c3052e0) at rpc/virnetserverprogram.c:437 arg = 0x7f78c80009a0 "\036\037\304M\345\nG\265\231É\272a!", <incomplete sequence \304> ret = 0x7f78c8000900 "" rv = -1 dispatcher = 0x7f793c0765a0 <remoteProcs+1152> rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} i = 0 identity = 0x7f79080009c0 __FUNCTION__ = "virNetServerProgramDispatchCall" #12 0x00007f793b1fc863 in virNetServerProgramDispatch (prog=0x7f793c2eefd0, server=0x7f793c2e0a90, client=0x7f793c2f5350, msg=0x7f793c3052e0) at rpc/virnetserverprogram.c:307 ret = -1 rerr = {code = 0, domain = 0, message = 0x0, level = 0, dom = 0x0, str1 = 0x0, str2 = 0x0, str3 = 0x0, int1 = 0, int2 = 0, net = 0x0} __func__ = "virNetServerProgramDispatch" __FUNCTION__ = "virNetServerProgramDispatch" #13 0x00007f793b1f5e6d in virNetServerProcessMsg (srv=0x7f793c2e0a90, client=0x7f793c2f5350, prog=0x7f793c2eefd0, msg=0x7f793c3052e0) at rpc/virnetserver.c:135 ret = -1 __func__ = "virNetServerProcessMsg" #14 0x00007f793b1f5f3a in virNetServerHandleJob (jobOpaque=0x7f793c30c5d0, opaque=0x7f793c2e0a90) at rpc/virnetserver.c:156 srv = 0x7f793c2e0a90 job = 0x7f793c30c5d0 __func__ = "virNetServerHandleJob" #15 0x00007f793b09d9f7 in virThreadPoolWorker (opaque=0x7f793c30c640) at util/virthreadpool.c:145 data = 0x0 pool = 0x7f793c2e0be0 cond = 0x7f793c2e0c48 priority = false job = 0x7f793c306dd0 #16 0x00007f793b09d00a in virThreadHelper (data=0x7f793c2f6b20) at util/virthread.c:206 args = 0x0 local = {func = 0x7f793b09d794 <virThreadPoolWorker>, funcName = 0x7f793b3227cb "virNetServerHandleJob", worker = true, opaque = 0x7f793c30c640} #17 0x00007f79375c1ee5 in start_thread (arg=0x7f78f0c1a700) at pthread_create.c:309 __res = <optimized out> pd = 0x7f78f0c1a700 now = <optimized out> unwind_buf = {cancel_jmp_buf = {{jmp_buf = {140157412026112, 4958827372110045735, 0, 0, 140157412026816, 140157412026112, -5034836659332816345, -5034138722820398553}, mask_was_saved = 0}}, priv = {pad = {0x0, 0x0, 0x0, 0x0}, data = {prev = 0x0, cleanup = 0x0, canceltype = 0}}} not_first_call = <optimized out> pagesize_m1 = <optimized out> sp = <optimized out> freesize = <optimized out> #18 0x00007f79372f0d1d in clone () at ../sysdeps/unix/sysv/linux/x86_64/clone.S:111 No locals. Thread 1 (Thread 0x7f793c0428c0 (LWP 1269)): #0 __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:135 No locals. #1 0x00007f79375c411b in _L_lock_812 () from /lib64/libpthread.so.0 No symbol table info available. #2 0x00007f79375c3fe8 in __GI___pthread_mutex_lock (mutex=0x7f78d80edd30) at ../nptl/pthread_mutex_lock.c:79 type = 0 id = <optimized out> #3 0x00007f793b09cd0c in virMutexLock (m=0x7f78d80edd30) at util/virthread.c:89 No locals. #4 0x00007f793b07d831 in virObjectLock (anyobj=0x7f78d80edd20) at util/virobject.c:323 obj = 0x7f78d80edd20 __func__ = "virObjectLock" #5 0x00007f793b0b71d7 in virDomainObjListFindByID (doms=0x7f78d80edd20, id=1) at conf/domain_conf.c:1237 obj = 0x7ffdb79c7444 #6 0x00007f78fe3f7eb3 in libxlDomainEventHandler (data=0x7f78d81ce940, event=0x7f793c30c2e0) at libxl/libxl_domain.c:534 driver = 0x7f78d81ce940 vm = 0x0 xl_reason = LIBXL_SHUTDOWN_REASON_REBOOT shutdown_info = 0x0 thread = {thread = 140156997845968} cfg = 0x7f793c042700 __func__ = "libxlDomainEventHandler" __FUNCTION__ = "libxlDomainEventHandler" #7 0x00007f793806f7c0 in egc_run_callbacks (egc=egc@entry=0x7ffdb79c7490) at libxl_event.c:1405 gc = 0x7ffdb79c7490 ev = 0x7f793c30c2e0 ev_tmp = 0x0 aop = <optimized out> aop_tmp = <optimized out> __func__ = "egc_run_callbacks" __PRETTY_FUNCTION__ = "egc_run_callbacks" ao = <optimized out> ao_tmp = <optimized out> #8 0x00007f793806fb9d in libxl__egc_cleanup (egc=0x7ffdb79c7490) at libxl_event.c:1436 gc = 0x7ffdb79c7490 #9 libxl_osevent_occurred_fd (ctx=<optimized out>, for_libxl=0x7f78d80ec220, fd=27, events_ign=<optimized out>, revents_ign=<optimized out>) at libxl_event.c:1339 egc = {{gc = {alloc_maxsize = 0, alloc_ptrs = 0x0, owner = 0x7f78d8112830}, occurred_for_callback = {tqh_first = 0x0, tqh_last = 0x7ffdb79c74a8}, aos_for_callback = {tqh_first = 0x0, tqh_last = 0x7ffdb79c74b8}, aops_for_callback = {tqh_first = 0x0, tqh_last = 0x7ffdb79c74c8}}} gc = 0x7ffdb79c7490 __PRETTY_FUNCTION__ = "libxl_osevent_occurred_fd" ev = <optimized out> #10 0x00007f78fe3f9ac5 in libxlFDEventCallback (watch=11, fd=27, vir_events=1, fd_info=0x7f78d811c430) at libxl/libxl_driver.c:134 info = 0x7f78d811c430 events = 1 #11 0x00007f793b04a9c4 in virEventPollDispatchHandles (nfds=31, fds=0x7f793c30b510) at util/vireventpoll.c:509 cb = 0x7f78fe3f9a41 <libxlFDEventCallback> watch = 11 opaque = 0x7f78d811c430 hEvents = 1 i = 10 n = 9 __func__ = "virEventPollDispatchHandles" #12 0x00007f793b04b224 in virEventPollRunOnce () at util/vireventpoll.c:658 fds = 0x7f793c30b510 ret = 1 timeout = 38594 nfds = 31 __func__ = "virEventPollRunOnce" __FUNCTION__ = "virEventPollRunOnce" #13 0x00007f793b0490cd in virEventRunDefaultImpl () at util/virevent.c:308 __func__ = "virEventRunDefaultImpl" #14 0x00007f793b1f5ab6 in virNetDaemonRun (dmn=0x7f793c2e1b80) at rpc/virnetdaemon.c:701 timerid = -1 timerActive = false i = 2 __FUNCTION__ = "virNetDaemonRun" __func__ = "virNetDaemonRun" #15 0x00007f793be0bc27 in main (argc=1, argv=0x7ffdb79c7d78) at libvirtd.c:1577 dmn = 0x7f793c2e1b80 srv = 0x7f793c2e0a90 srvAdm = 0x7f793c2ef410 remote_config_file = 0x7f793c2e0430 "/etc/libvirt/libvirtd.conf" statuswrite = -1 ret = 1 pid_file_fd = 5 pid_file = 0x7f793c2e0830 "/var/run/libvirtd.pid" sock_file = 0x7f793c2ecfd0 "/var/run/libvirt/libvirt-sock" sock_file_ro = 0x7f793c2ecfa0 "/var/run/libvirt/libvirt-sock-ro" sock_file_adm = 0x7f793c2ecf30 "/var/run/libvirt/libvirt-admin-sock" timeout = -1 verbose = 0 godaemon = 0 ipsock = 0 config = 0x7f793c2e0270 privileged = true implicit_conf = true run_dir = 0x7f793c2e07c0 "/var/run/libvirt" old_umask = 18 opts = {{name = 0x7f793be56f8a "verbose", has_arg = 0, flag = 0x7ffdb79c76c8, val = 118}, {name = 0x7f793be56f92 "daemon", has_arg = 0, flag = 0x7ffdb79c76cc, val = 100}, {name = 0x7f793be56f99 "listen", has_arg = 0, flag = 0x7ffdb79c76d0, val = 108}, { name = 0x7f793be56fa0 "config", has_arg = 1, flag = 0x0, val = 102}, {name = 0x7f793be56fa7 "timeout", has_arg = 1, flag = 0x0, val = 116}, {name = 0x7f793be56faf "pid-file", has_arg = 1, flag = 0x0, val = 112}, {name = 0x7f793be56fb8 "version", has_arg = 0, flag = 0x0, val = 86}, {name = 0x7f793be56fc0 "help", has_arg = 0, flag = 0x0, val = 104}, {name = 0x0, has_arg = 0, flag = 0x0, val = 0}} __func__ = "main" _______________________________________________ Xen-users mailing list Xen-users@xxxxxxxxxxxxx http://lists.xen.org/xen-users
|
Lists.xenproject.org is hosted with RackSpace, monitoring our |