Re: [Xen-users] xl save -c, how to make it work

[Robin Lee <robinlee.sysu@xxxxxxxxx>]

On Mon, Apr 17, 2017 at 11:14 AM, Robin Lee <robinlee.sysu@xxxxxxxxx> wrote:

Hi, all

I ran 'xl save -c cpf 4' on a running hvm domU. But the domU never resumed after command line exited.

I am running CentOS7.3.1611 with xen from the CentOS-xen46 repo.

The system is just installed. So I doubted that anything I missed to prepare to make this command work.

# xl -vvvvv save -c 2 cpf 
libxl: error: libxl_dom.c:1884:libxl__userdata_path: unable to find domain info for domain 2: No such file or directory
unable to retrieve domain configuration
xc: debug: hypercall buffer: total allocations:8 total releases:8
xc: debug: hypercall buffer: current allocations:0 maximum allocations:2
xc: debug: hypercall buffer: cache current size:2
xc: debug: hypercall buffer: cache hits:6 misses:2 toobig:0
[root@localhost ~]#
[root@localhost ~]# xl list
Name                                        ID   Mem VCPUs    State    Time(s)
Domain-0                                     0  1024     2     r-----     307.7
lirbvm                                       4   480     1     ------     155.5
[root@localhost ~]# xl -vvvvv save -c 4 cpf 
libxl: debug: libxl.c:6802:libxl_retrieve_domain_configuration: no nic from xenstore for domain 4
libxl: debug: libxl.c:6804:libxl_retrieve_domain_configuration: no vtpm from xenstore for domain 4
libxl: debug: libxl.c:6806:libxl_retrieve_domain_configuration: no pci from xenstore for domain 4
Saving to cpf new xl format (info 0x3/0x0/1249)
libxl: debug: libxl.c:968:libxl_domain_suspend: ao 0x126bb30: create: how=(nil) callback=(nil) poller=0x126ba20
libxl: debug: libxl.c:6597:libxl__fd_flags_modify_save: fnctl F_GETFL flags for fd 7 are 0x8001
libxl: debug: libxl.c:6605:libxl__fd_flags_modify_save: fnctl F_SETFL of fd 7 to 0x8001
libxl: debug: libxl.c:995:libxl_domain_suspend: ao 0x126bb30: inprogress: poller=0x126ba20, flags=i
libxl-save-helper: debug: starting save: Success
xc: detail: fd 7, dom 4, max_iters 0, max_factor 0, flags 4, hvm 1
xc: info: Saving domain 4, type x86 HVM
libxl: debug: libxl_qmp.c:706:libxl__qmp_initialize: connected to /var/run/xen/qmp-libxl-4
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: qmp
libxl: debug: libxl_qmp.c:555:qmp_send_prepare: next qmp command: '{
    "execute": "qmp_capabilities",
    "id": 1
}
'
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: return
libxl: debug: libxl_qmp.c:555:qmp_send_prepare: next qmp command: '{
    "execute": "xen-set-global-dirty-log",
    "id": 2,
    "arguments": {
        "enable": true
    }
}
'
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: return
libxl: debug: libxl_dom_suspend.c:144:domain_suspend_callback_common: issuing PVHVM suspend request via XenBus control node
libxl: debug: libxl_event.c:639:libxl__ev_xswatch_register: watch w=0x1261210 wpath=/local/domain/4/control/shutdown token=3/0: register slotnum=3
libxl: debug: libxl_event.c:576:watchfd_callback: watch w=0x1261210 wpath=/local/domain/4/control/shutdown token=3/0: event epath=/local/domain/4/control/shutdown
libxl: debug: libxl_event.c:576:watchfd_callback: watch w=0x1261210 wpath=/local/domain/4/control/shutdown token=3/0: event epath=/local/domain/4/control/shutdown
libxl: debug: libxl_event.c:677:libxl__ev_xswatch_deregister: watch w=0x1261210 wpath=/local/domain/4/control/shutdown token=3/0: deregister slotnum=3
libxl: debug: libxl_dom_suspend.c:226:domain_suspend_common_pvcontrol_suspending: guest acknowledged suspend request
libxl: debug: libxl_dom_suspend.c:245:domain_suspend_common_wait_guest: wait for the guest to suspend
libxl: debug: libxl_event.c:639:libxl__ev_xswatch_register: watch w=0x1261228 wpath=@releaseDomain token=3/1: register slotnum=3
libxl: debug: libxl_event.c:576:watchfd_callback: watch w=0x1261228 wpath=@releaseDomain token=3/1: event epath=@releaseDomain
libxl: debug: libxl_event.c:576:watchfd_callback: watch w=0x1261228 wpath=@releaseDomain token=3/1: event epath=@releaseDomain
libxl: debug: libxl_dom_suspend.c:304:suspend_common_wait_guest_check: guest has suspended
libxl: debug: libxl_event.c:677:libxl__ev_xswatch_deregister: watch w=0x1261228 wpath=@releaseDomain token=3/1: deregister slotnum=3
libxl: debug: libxl_qmp.c:706:libxl__qmp_initialize: connected to /var/run/xen/qmp-libxl-4
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: qmp
libxl: debug: libxl_qmp.c:555:qmp_send_prepare: next qmp command: '{
    "execute": "qmp_capabilities",
    "id": 1
}
'
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: return
libxl: debug: libxl_qmp.c:555:qmp_send_prepare: next qmp command: '{
    "execute": "stop",
    "id": 2
}
'
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: event
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: return
libxl: debug: libxl_qmp.c:706:libxl__qmp_initialize: connected to /var/run/xen/qmp-libxl-4
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: qmp
libxl: debug: libxl_qmp.c:555:qmp_send_prepare: next qmp command: '{
    "execute": "qmp_capabilities",
    "id": 1
}
'
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: return
libxl: debug: libxl_qmp.c:555:qmp_send_prepare: next qmp command: '{
    "execute": "xen-save-devices-state",
    "id": 2,
    "arguments": {
        "filename": "/var/lib/xen/qemu-save.4"
    }
}
'
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: return
libxl: debug: libxl_event.c:691:libxl__ev_xswatch_deregister: watch w=0x1261228: deregister unregistered
xc: Frames: 1044481/1044481  100%
xc: End of stream: 0/0    0%
libxl: debug: libxl_qmp.c:706:libxl__qmp_initialize: connected to /var/run/xen/qmp-libxl-4
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: qmp
libxl: debug: libxl_qmp.c:555:qmp_send_prepare: next qmp command: '{
    "execute": "qmp_capabilities",
    "id": 1
}
'
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: return
libxl: debug: libxl_qmp.c:555:qmp_send_prepare: next qmp command: '{
    "execute": "xen-set-global-dirty-log",
    "id": 2,
    "arguments": {
        "enable": false
    }
}
'
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: return
libxl-save-helper: debug: complete r=0: Success
libxl: debug: libxl.c:6624:libxl__fd_flags_restore: fnctl F_SETFL of fd 7 to 0x8001
libxl: debug: libxl_event.c:1874:libxl__ao_complete: ao 0x126bb30: complete, rc=0
libxl: debug: libxl_event.c:1843:libxl__ao__destroy: ao 0x126bb30: destroy
libxl: debug: libxl.c:526:libxl_domain_resume: ao 0x126bb30: create: how=(nil) callback=(nil) poller=0x126ba20
libxl: debug: libxl_qmp.c:706:libxl__qmp_initialize: connected to /var/run/xen/qmp-libxl-4
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: qmp
libxl: debug: libxl_qmp.c:555:qmp_send_prepare: next qmp command: '{
    "execute": "qmp_capabilities",
    "id": 1
}
'
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: return
libxl: debug: libxl_qmp.c:555:qmp_send_prepare: next qmp command: '{
    "execute": "cont",
    "id": 2
}
'
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: event
libxl: debug: libxl_qmp.c:296:qmp_handle_response: message type: return
libxl: debug: libxl_event.c:1874:libxl__ao_complete: ao 0x126bb30: complete, rc=0
libxl: debug: libxl.c:529:libxl_domain_resume: ao 0x126bb30: inprogress: poller=0x126ba20, flags=ic
libxl: debug: libxl_event.c:1843:libxl__ao__destroy: ao 0x126bb30: destroy
xc: debug: hypercall buffer: total allocations:39 total releases:39
xc: debug: hypercall buffer: current allocations:0 maximum allocations:2
xc: debug: hypercall buffer: cache current size:2
xc: debug: hypercall buffer: cache hits:32 misses:2 toobig:5

# cat newvm.conf
name="lirbvm"
description="lirbqvm"
#uuid="6e9f1030-a486-6c8e-df0a-60b3e63663fd"
memory=480
maxmem=480
vcpus=1
_on_poweroff_="destroy"
_on_reboot_="destroy"
_on_crash_="destroy"
localtime=0
keymap="en-us"
vnc=1
vnclisten="0.0.0.0"
acpi=1
apic=1
#xen_platform_pci=0
builder="hvm"
device_model_version="qemu-xen"
#device_model_override="/usr/lib64/xen/bin/qemu-dm"
#kernel="/usr/libexec/xen/boot/hvmloader"
boot="c"
disk=[ '/tmp/nfs/CentOS-7-x86_64-Minimal-1611.iso,,hdc,cdrom,backendtype=qdisk']
#vif=[ 'mac=fe:82:e7:5f:dd:36,bridge=xenbr1,model=rtl8139']
serial='pty'

# xl info 
host                   : localhost.localdomain
release                : 4.9.13-22.el7.x86_64
version                : #1 SMP Sun Feb 26 22:15:59 UTC 2017
machine                : x86_64
nr_cpus                : 2
max_cpu_id             : 1
nr_nodes               : 1
cores_per_socket       : 1
threads_per_core       : 1
cpu_mhz                : 3621
hw_caps                : 0f8bfbff:2c100800:00000000:00000d00:f7fa3223:00000000:00000021:000007ab
virt_caps              : hvm
total_memory           : 2047
free_memory            : 513
sharing_freed_memory   : 0
sharing_used_memory    : 0
outstanding_claims     : 0
free_cpus              : 0
xen_major              : 4
xen_minor              : 6
xen_extra              : .3-12.el7
xen_version            : 4.6.3-12.el7
xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler          : credit
xen_pagesize           : 4096
platform_params        : virt_start=0xffff800000000000
xen_changeset          : Tue Apr 4 12:38:28 2017 +0100 git:d4fc453-dirty
xen_commandline        : placeholder dom0_mem=1024M,max:1024M cpuinfo com1=115200,8n1 console=com1,tty loglvl=all guest_loglvl=all
cc_compiler            : gcc (GCC) 4.8.5 20150623 (Red Hat 4.8.5-11)
cc_compile_by          : mockbuild
cc_compile_domain      : centos.org
cc_compile_date        : Tue Apr  4 12:19:17 UTC 2017
xend_config_format     : 4

-robin

After a git bisect work, I found the commit fix this issue:
http://xenbits.xen.org/gitweb/?p=xen.git;a=commit;h=e298344e4a43ce72999cb7efaa0132d0077da08d

In other word, the issue was just fixed in release 4.8.1.

_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxx
https://lists.xen.org/xen-users