[Xen-users] Stall on CPU

[Ian <murrayie@xxxxxxxxxxx>]

Hi,

I have been receiving messages on a new DomU's kern.log. I've done a lot 
of googling, but haven't came up with anything very useful, at least not 
in a Xen context.
I was wondering if anyone had any suggestions about what could be wrong. 
> From everything I have read, there should be a stack trace included, but 
I am not seeing one.

Thanks in advance,

Ian.

on Xen 4.1.2...
Sep  6 13:04:07 davical kernel: [12008.080091] INFO: rcu_sched detected 
stall on CPU 1 (t=50460 jiffies)
Sep  6 13:04:07 davical kernel: [12008.084081] sending NMI to all CPUs:
Sep  6 13:04:07 davical kernel: [11806.576064] INFO: rcu_sched detected 
stalls on CPUs/tasks: { 1} (detected by 0, t=566314 jiffies)
Sep  6 13:04:07 davical kernel: [75644.150936] INFO: rcu_sched detected 
stall on  CPU 0 (t=15393163 jiffies)
Sep  6 13:04:07 davical kernel: [75644.304186] sched: RT throttling 
activated
on Xen 4.1.3...
Sep  8 11:39:40 davical kernel: [62220.039363] INFO: rcu_sched detected 
stall on CPU 1 (t=355732 jiffies)
Sep  8 11:39:40 davical kernel: [62220.039363] sending NMI to all CPUs:
Sep  8 11:39:40 davical kernel: [124714.197152] INFO: rcu_sched detected 
stalls on CPUs/tasks: { 1} (detected by 0, t=355732 jiffies)
Sep  8 11:39:48 davical kernel: [124721.756263] INFO: rcu_sched detected 
stall on CPU 1 (t=15751455 jiffies)
Sep  8 11:39:48 davical kernel: [124721.756328] sending NMI to all CPUs:
Sep  8 11:39:48 davical kernel: [124721.760199] INFO: rcu_sched detected 
stalls on CPUs/tasks: { 1} (detected by 0, t=15751455 jiffies)
Sep  8 11:39:52 davical kernel: [124725.855952] ipv6_create_tempaddr(): 
retry temporary address regeneration.
Sep  8 11:40:08 davical kernel: [124721.760226] INFO: rcu_bh detected 
stall on CPU 1 (t=15395723 jiffies)
Sep  8 11:40:08 davical kernel: [124721.760226] sending NMI to all CPUs:
Sep  8 11:40:08 davical kernel: [124742.485888] sched: RT throttling 
activated


I have tried it on two Xen Dom0 installations, one of 4.1.2 and the 
other on 4.1.3.
The 4.1.2 Dom0 machine is a scientific linux installation using a custom 
compiled kernel, 3.4.0+.
The 4.1.3 Dom0 machine is using a standard Ubuntu server kernel 
3.2.0-29-generic-pae
The domU is an Ubuntu 12.04.1 server based using a standard Ubuntu 
12.04.1 kernel, also 3.2.0-29-generic-pae.
xl info of the 4.1.2 machine:

host                   : xen3
release                : 3.4.0+
version                : #1 SMP Mon Jun 4 12:41:14 BST 2012
machine                : x86_64
nr_cpus                : 4
nr_nodes               : 1
cores_per_socket       : 4
threads_per_core       : 1
cpu_mhz                : 2300
hw_caps                : 
178bf3ff:efd3fbff:00000000:00001310:00802001:00000000:000007ff:00000000
virt_caps              : hvm
total_memory           : 8159
free_memory            : 3866
free_cpus              : 0
xen_major              : 4
xen_minor              : 1
xen_extra              : .2
xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 
hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler          : credit
xen_pagesize           : 4096
platform_params        : virt_start=0xffff800000000000
xen_changeset          : unavailable
xen_commandline        : loglvl=all guesloglvl=all
cc_compiler            : gcc version 4.4.5 20110214 (Red Hat 4.4.5-6) (GCC)
cc_compile_by          : root
cc_compile_domain      : (none)
cc_compile_date        : Sun Jan 22 01:18:42 GMT 2012
xend_config_format     : 4


xl info of the 4.1.3 machine:

host                   : xen5
release                : 3.2.0-29-generic-pae
version                : #46-Ubuntu SMP Fri Jul 27 17:25:43 UTC 2012
machine                : i686
nr_cpus                : 2
nr_nodes               : 1
cores_per_socket       : 2
threads_per_core       : 1
cpu_mhz                : 1995
hw_caps                : 
bfe9fbff:00100000:00000000:00000940:0000c1a9:00000000:00000000:00000000
virt_caps              :
total_memory           : 3062
free_memory            : 173
free_cpus              : 0
xen_major              : 4
xen_minor              : 1
xen_extra              : .3
xen_caps               : xen-3.0-x86_32p
xen_scheduler          : credit
xen_pagesize           : 4096
platform_params        : virt_start=0xf5800000
xen_changeset          : unavailable
xen_commandline        : placeholder
cc_compiler            : gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5)
cc_compile_by          : root
cc_compile_domain      : local
cc_compile_date        : Thu Sep  6 01:53:48 BST 2012
xend_config_format     : 4

DomU config file:

cat ubuntu-calendar
name      = "ubuntu-calendar"
memory    = 1024
disk      = ['phy:/dev/xen5/ubuntu-calendar,xvda,w']
vif = [ 'mac=00:16:31:50:01:03' ]
bootloader="/usr/bin/pygrub"
vfb = [ "type=vnc,vncunused=1,vnclisten=0.0.0.0" ]
vcpus     = 2
on_reboot = 'restart'
on_crash  = 'restart'

DomU's grub.lst....

menuentry 'Ubuntu, with Linux 3.2.0-29-generic' --class ubuntu --class 
gnu-linux
 --class gnu --class os {
        recordfail
        insmod ext2
        set root='(hd0,1)'
        search --no-floppy --fs-uuid --set=root 
70149f72-3c4f-4608-bebd-06825b91
ce29
        linux   /boot/vmlinuz-3.2.0-29-generic-pae 
root=UUID=70149f72-3c4f-4608-
bebd-06825b91ce29 ro   quiet splash set default="0"
set timeout=5
menuentry 'Ubuntu GNU/Linux, with Xen 4.1-amd64 and Linux 
3.2.0-23-generic' --class ubuntu --class gnu-linux --class gnu --class 
os --class xen {
    insmod part_msdos
    insmod ext2
    set root='(hd0,msdos1)'
    search --no-floppy --fs-uuid --set=root 
1b478986-8c02-4a79-ad61-cf8f418e35ad
    echo    'Loading Xen 4.1-amd64 ...'
    multiboot    /xen.gz placeholder
    echo    'Loading Linux 3.2.0-29-generic-pae ...'
    module    /vmlinuz-3.2.0-29-generic-pae placeholder 
root=/dev/mapper/xen5-root ro
    echo    'Loading initial ramdisk ...'
    module    /initrd.img-3.2.0-29-generic-pae
}
xen-fbfront.video=16,1024,768 $vt_handoff
        initrd  /boot/initrd.img-3.2.0-29-generic-pae


Dom0's grub.lst (4.1.3)...

set default="0"
set timeout=5
menuentry 'Ubuntu GNU/Linux, with Xen 4.1-amd64 and Linux 
3.2.0-23-generic' --class ubuntu --class gnu-linux --class gnu --class 
os --class xen {
    insmod part_msdos
    insmod ext2
    set root='(hd0,msdos1)'
    search --no-floppy --fs-uuid --set=root 
1b478986-8c02-4a79-ad61-cf8f418e35ad
    echo    'Loading Xen 4.1-amd64 ...'
    multiboot    /xen.gz placeholder
    echo    'Loading Linux 3.2.0-29-generic-pae ...'
    module    /vmlinuz-3.2.0-29-generic-pae placeholder 
root=/dev/mapper/xen5-root ro
    echo    'Loading initial ramdisk ...'
    module    /initrd.img-3.2.0-29-generic-pae
}









_______________________________________________
Xen-users mailing list
Xen-users@xxxxxxxxxxxxx
http://lists.xen.org/xen-users