Re: [Xen-devel] Kernel panic on Xen virtualisation in Debian

[Ingo Jürgensmann <ij@xxxxxxxxxxxxxxxxxx>]

On 18.07.2016 18:44, Andreas Ziegler wrote:

> did the information that Ingo provided (i cited his message to the list
> below) maybe help in narrowing down the possible issue?
> If you need additional information we can try getting it for you, as
> Ingo might be able to reproduce the kernel panic, although not 
> reliably.
In the meanwhile, I activated IPv6 again on Tuesday evening and today 
the server crashed again some minutes ago. Here's the output from 
netconsole:
Jul 22 10:27:55 31.172.31.251 [171182.273973] BUG: unable to handle 
kernel
Jul 22 10:27:55 31.172.31.251  at ffff88025b2d0000
Jul 22 10:27:55 31.172.31.251 [171182.274039] IP:
Jul 22 10:27:55 31.172.31.251  [<ffffffff812b7a16>] memcpy+0x6/0x110
Jul 22 10:27:55 31.172.31.251 [171182.274080] PGD 1814067
Jul 22 10:27:55 31.172.31.251
Jul 22 10:27:55 31.172.31.251 [171182.274130] Oops: 0000 [#1]
Jul 22 10:27:55 31.172.31.251
Jul 22 10:27:55 31.172.31.251 [171182.274171] Modules linked in:
Jul 22 10:27:55 31.172.31.251  nls_utf8
Jul 22 10:27:55 31.172.31.251  btrfs
Jul 22 10:27:55 31.172.31.251  xor
Jul 22 10:27:55 31.172.31.251  raid6_pq
Jul 22 10:27:55 31.172.31.251  ufs
Jul 22 10:27:55 31.172.31.251  qnx4
Jul 22 10:27:55 31.172.31.251  hfsplus
Jul 22 10:27:55 31.172.31.251  hfs
Jul 22 10:27:55 31.172.31.251  minix
Jul 22 10:27:55 31.172.31.251  ntfs
Jul 22 10:27:55 31.172.31.251  vfat
Jul 22 10:27:55 31.172.31.251  msdos
Jul 22 10:27:55 31.172.31.251  fat
Jul 22 10:27:55 31.172.31.251  jfs
Jul 22 10:27:55 31.172.31.251  authenc
Jul 22 10:27:55 31.172.31.251  xfrm6_mode_tunnel
Jul 22 10:27:55 31.172.31.251  xfrm4_mode_tunnel
Jul 22 10:27:55 31.172.31.251  xt_physdev
Jul 22 10:27:55 31.172.31.251  xen_netback
Jul 22 10:27:55 31.172.31.251  tun
Jul 22 10:27:55 31.172.31.251  xen_blkback
Jul 22 10:27:55 31.172.31.251  xt_multiport
Jul 22 10:27:55 31.172.31.251  twofish_generic
Jul 22 10:27:55 31.172.31.251  twofish_avx_x86_64
Jul 22 10:27:55 31.172.31.251  twofish_x86_64_3way
Jul 22 10:27:55 31.172.31.251  twofish_x86_64
Jul 22 10:27:55 31.172.31.251  twofish_common
Jul 22 10:27:55 31.172.31.251  serpent_avx_x86_64
Jul 22 10:27:55 31.172.31.251  serpent_sse2_x86_64
Jul 22 10:27:55 31.172.31.251  serpent_generic
Jul 22 10:27:55 31.172.31.251  blowfish_generic
Jul 22 10:27:55 31.172.31.251  blowfish_x86_64
Jul 22 10:27:55 31.172.31.251  blowfish_common
Jul 22 10:27:55 31.172.31.251  cast5_avx_x86_64
Jul 22 10:27:55 31.172.31.251  cast5_generic
Jul 22 10:27:55 31.172.31.251  cast_common
Jul 22 10:27:55 31.172.31.251  seqiv
Jul 22 10:27:55 31.172.31.251  ctr
Jul 22 10:27:55 31.172.31.251  ecb
Jul 22 10:27:55 31.172.31.251  des_generic
Jul 22 10:27:55 31.172.31.251  cbc
Jul 22 10:27:55 31.172.31.251  algif_skcipher
Jul 22 10:27:55 31.172.31.251  camellia_generic
Jul 22 10:27:55 31.172.31.251  camellia_aesni_avx_x86_64
Jul 22 10:27:55 31.172.31.251  camellia_x86_64
Jul 22 10:27:55 31.172.31.251  xts
Jul 22 10:27:55 31.172.31.251  xcbc
Jul 22 10:27:55 31.172.31.251  hmac
Jul 22 10:27:55 31.172.31.251  sha512_ssse3
Jul 22 10:27:55 31.172.31.251  sha512_generic
Jul 22 10:27:55 31.172.31.251  sha256_ssse3
Jul 22 10:27:55 31.172.31.251  sha256_generic
Jul 22 10:27:55 31.172.31.251  md4
Jul 22 10:27:55 31.172.31.251  algif_hash
Jul 22 10:27:55 31.172.31.251  af_alg
Jul 22 10:27:55 31.172.31.251  ipt_ULOG
Jul 22 10:27:55 31.172.31.251  xfrm_user
Jul 22 10:27:55 31.172.31.251  xfrm4_tunnel
Jul 22 10:27:55 31.172.31.251  xen_gntdev
Jul 22 10:27:55 31.172.31.251  tunnel4
Jul 22 10:27:55 31.172.31.251  xen_evtchn
Jul 22 10:27:55 31.172.31.251  xenfs
Jul 22 10:27:55 31.172.31.251  xen_privcmd
Jul 22 10:27:55 31.172.31.251  ipcomp
Jul 22 10:27:55 31.172.31.251  xfrm_ipcomp
Jul 22 10:27:55 31.172.31.251  esp4
Jul 22 10:27:55 31.172.31.251  ah4
Jul 22 10:27:55 31.172.31.251  af_key
Jul 22 10:27:55 31.172.31.251  xfrm_algo
Jul 22 10:27:55 31.172.31.251  ipmi_poweroff
Jul 22 10:27:55 31.172.31.251  video
Jul 22 10:27:55 31.172.31.251  thermal
Jul 22 10:27:55 31.172.31.251  fan
Jul 22 10:27:55 31.172.31.251  ac
Jul 22 10:27:55 31.172.31.251  battery
Jul 22 10:27:55 31.172.31.251  ip6t_REJECT
Jul 22 10:27:55 31.172.31.251  ip6table_filter
Jul 22 10:27:55 31.172.31.251  ip6_tables
Jul 22 10:27:55 31.172.31.251  bridge
Jul 22 10:27:55 31.172.31.251  stp
Jul 22 10:27:55 31.172.31.251  llc
Jul 22 10:27:55 31.172.31.251  ipt_REJECT
Jul 22 10:27:55 31.172.31.251  xt_tcpudp
Jul 22 10:27:55 31.172.31.251  iptable_filter
Jul 22 10:27:55 31.172.31.251  ip_tables
Jul 22 10:27:55 31.172.31.251  x_tables
Jul 22 10:27:55 31.172.31.251  ext4
Jul 22 10:27:55 31.172.31.251  crc16
Jul 22 10:27:55 31.172.31.251  mbcache
Jul 22 10:27:55 31.172.31.251  jbd2
Jul 22 10:27:55 31.172.31.251  fuse
Jul 22 10:27:55 31.172.31.251  ipmi_devintf
Jul 22 10:27:55 31.172.31.251  ipmi_watchdog
Jul 22 10:27:55 31.172.31.251  w83627ehf
Jul 22 10:27:55 31.172.31.251  hwmon_vid
Jul 22 10:27:55 31.172.31.251  nf_conntrack_ipv4
Jul 22 10:27:55 31.172.31.251  nf_defrag_ipv4
Jul 22 10:27:55 31.172.31.251  nf_conntrack
Jul 22 10:27:55 31.172.31.251  loop
Jul 22 10:27:55 31.172.31.251  x86_pkg_temp_thermal
Jul 22 10:27:55 31.172.31.251  intel_powerclamp
Jul 22 10:27:55 31.172.31.251  evdev
Jul 22 10:27:55 31.172.31.251  joydev
Jul 22 10:27:55 31.172.31.251  coretemp
Jul 22 10:27:55 31.172.31.251  crc32_pclmul
Jul 22 10:27:55 31.172.31.251  ttm
Jul 22 10:27:55 31.172.31.251  drm_kms_helper
Jul 22 10:27:55 31.172.31.251  drm
Jul 22 10:27:55 31.172.31.251  aesni_intel
Jul 22 10:27:55 31.172.31.251  serio_raw
Jul 22 10:27:55 31.172.31.251  iTCO_wdt
Jul 22 10:27:55 31.172.31.251  aes_x86_64
Jul 22 10:27:55 31.172.31.251  iTCO_vendor_support
Jul 22 10:27:55 31.172.31.251  lrw
Jul 22 10:27:55 31.172.31.251  gf128mul
Jul 22 10:27:55 31.172.31.251  glue_helper
Jul 22 10:27:55 31.172.31.251  ablk_helper
Jul 22 10:27:55 31.172.31.251  cryptd
Jul 22 10:27:55 31.172.31.251  pcspkr
Jul 22 10:27:55 31.172.31.251  sb_edac
Jul 22 10:27:55 31.172.31.251  tpm_tis
Jul 22 10:27:55 31.172.31.251  edac_core
Jul 22 10:27:55 31.172.31.251  tpm
Jul 22 10:27:55 31.172.31.251  wmi
Jul 22 10:27:55 31.172.31.251  ipmi_si
Jul 22 10:27:55 31.172.31.251  ipmi_msghandler
Jul 22 10:27:55 31.172.31.251  shpchp
Jul 22 10:27:55 31.172.31.251  processor
Jul 22 10:27:55 31.172.31.251  thermal_sys
Jul 22 10:27:55 31.172.31.251  mei_me
Jul 22 10:27:55 31.172.31.251  i2c_i801
Jul 22 10:27:55 31.172.31.251  lpc_ich
Jul 22 10:27:55 31.172.31.251  mfd_core
Jul 22 10:27:55 31.172.31.251  mei
Jul 22 10:27:55 31.172.31.251  ioatdma
Jul 22 10:27:55 31.172.31.251  button
Jul 22 10:27:55 31.172.31.251  xfs
Jul 22 10:27:55 31.172.31.251  libcrc32c
Jul 22 10:27:55 31.172.31.251  dm_mod
Jul 22 10:27:55 31.172.31.251  raid10
Jul 22 10:27:55 31.172.31.251  raid1
Jul 22 10:27:55 31.172.31.251  md_mod
Jul 22 10:27:55 31.172.31.251  usb_storage
Jul 22 10:27:55 31.172.31.251  hid_generic
Jul 22 10:27:55 31.172.31.251  usbhid
Jul 22 10:27:55 31.172.31.251  hid
Jul 22 10:27:55 31.172.31.251  netconsole
Jul 22 10:27:55 31.172.31.251  configfs
Jul 22 10:27:55 31.172.31.251  sg
Jul 22 10:27:55 31.172.31.251  sd_mod
Jul 22 10:27:55 31.172.31.251  crc_t10dif
Jul 22 10:27:55 31.172.31.251  crct10dif_generic
Jul 22 10:27:55 31.172.31.251  crct10dif_pclmul
Jul 22 10:27:55 31.172.31.251  crct10dif_common
Jul 22 10:27:55 31.172.31.251  crc32c_intel
Jul 22 10:27:55 31.172.31.251  ahci
Jul 22 10:27:55 31.172.31.251  libahci
Jul 22 10:27:55 31.172.31.251  psmouse
Jul 22 10:27:55 31.172.31.251  ehci_pci
Jul 22 10:27:55 31.172.31.251  libata
Jul 22 10:27:55 31.172.31.251  ehci_hcd
Jul 22 10:27:55 31.172.31.251  igb
Jul 22 10:27:55 31.172.31.251  scsi_mod
Jul 22 10:27:55 31.172.31.251  usbcore
Jul 22 10:27:55 31.172.31.251  i2c_algo_bit
Jul 22 10:27:55 31.172.31.251  usb_common
Jul 22 10:27:55 31.172.31.251  i2c_core
Jul 22 10:27:55 31.172.31.251  dca
Jul 22 10:27:55 31.172.31.251  ptp
Jul 22 10:27:55 31.172.31.251  pps_core
Jul 22 10:27:55 31.172.31.251
Jul 22 10:27:55 31.172.31.251 [171182.275532] CPU: 0 PID: 0 Comm: 
swapper/0 Not tainted 3.16.0-4-amd64 #1 Debian 3.16.7-ckt25-2+deb8u3
Jul 22 10:27:55 31.172.31.251 [171182.275584] Hardware name: Supermicro 
X9SRE/X9SRE-3F/X9SRi/X9SRi-3F/X9SRE/X9SRE-3F/X9SRi/X9SRi-3F, BIOS 3.0a 
01/03/2014
Jul 22 10:27:55 31.172.31.251 [171182.275638] task: ffffffff8181a460 ti: 
ffffffff81800000 task.ti: ffffffff81800000
Jul 22 10:27:55 31.172.31.251 [171182.275685] RIP: 
e030:[<ffffffff812b7a16>]
Jul 22 10:27:55 31.172.31.251  [<ffffffff812b7a16>] memcpy+0x6/0x110
Jul 22 10:27:55 31.172.31.251 [171182.275737] RSP: e02b:ffff880280e03b58 
 EFLAGS: 00010286
Jul 22 10:27:55 31.172.31.251 [171182.275770] RAX: ffff88024e0c4070 RBX: 
ffff880244759c00 RCX: 00000000000002ee
Jul 22 10:27:55 31.172.31.251 [171182.275819] RDX: 00000000000004a0 RSI: 
ffff88025b2d0000 RDI: ffff88024e0c4222
Jul 22 10:27:55 31.172.31.251 [171182.275866] RBP: ffff880280e03c38 R08: 
00000000000006c0 R09: ffff88024e0c4062
Jul 22 10:27:55 31.172.31.251 [171182.275913] R10: 0100000000000000 R11: 
00000000ef5ffb2e R12: ffff88024eb03d00
Jul 22 10:27:55 31.172.31.251 [171182.275960] R13: ffff88025b2cfe66 R14: 
ffff88025c4441c0 R15: 00000000000004a8
Jul 22 10:27:55 31.172.31.251 [171182.276010] FS:  
0000000000000000(0000) GS:ffff880280e00000(0000) knlGS:ffff880280e00000
Jul 22 10:27:55 31.172.31.251 [171182.276059] CS:  e033 DS: 0000 ES: 
0000 CR0: 0000000080050033
Jul 22 10:27:55 31.172.31.251 [171182.276089] CR2: ffff88025b2d0000 CR3: 
000000026c8e1000 CR4: 0000000000042660
Jul 22 10:27:55 31.172.31.251 [171182.281365] Stack:
Jul 22 10:27:55 31.172.31.251 [171182.281391]  ffffffff814d319f
Jul 22 10:27:55 31.172.31.251  ffff880077790000
Jul 22 10:27:55 31.172.31.251  ffff880280e03ba8
Jul 22 10:27:55 31.172.31.251  9401294600a7012a
Jul 22 10:27:55 31.172.31.251
Jul 22 10:27:55 31.172.31.251 [171182.281452]  0100000000000000
Jul 22 10:27:55 31.172.31.251  ffffffff814a000a
Jul 22 10:27:55 31.172.31.251  00000000750c7e90
Jul 22 10:27:55 31.172.31.251  00000000000080fe
Jul 22 10:27:55 31.172.31.251
Jul 22 10:27:55 31.172.31.251 [171182.281514]  1ad902feff7ac40e
Jul 22 10:27:55 31.172.31.251  ffff8800775bb080
Jul 22 10:27:55 31.172.31.251  ffff224afc3e1600
Jul 22 10:27:55 31.172.31.251  ffff88024eb03d00
Jul 22 10:27:55 31.172.31.251
Jul 22 10:27:55 31.172.31.251 [171182.281575] Call Trace:
Jul 22 10:27:55 31.172.31.251 [171182.281601]  <IRQ>
Jul 22 10:27:55 31.172.31.251
Jul 22 10:27:55 31.172.31.251 [171182.281607]
Jul 22 10:27:55 31.172.31.251  [<ffffffff814d319f>] ? 
ndisc_send_redirect+0x3bf/0x410
Jul 22 10:27:55 31.172.31.251 [171182.281751]  [<ffffffff814a000a>] ? 
reg_vif_xmit+0xca/0xf0
Jul 22 10:27:55 31.172.31.251 [171182.281786]  [<ffffffff814bbffc>] ? 
ip6_forward+0x71c/0x850
Jul 22 10:27:55 31.172.31.251 [171182.281817]  [<ffffffff814c9704>] ? 
ip6_route_input+0xa4/0xd0
Jul 22 10:27:55 31.172.31.251 [171182.281852]  [<ffffffff8141eae3>] ? 
__netif_receive_skb_core+0x543/0x750
Jul 22 10:27:55 31.172.31.251 [171182.281885]  [<ffffffff8141ed6f>] ? 
netif_receive_skb_internal+0x1f/0x80
Jul 22 10:27:55 31.172.31.251 [171182.281930]  [<ffffffffa053feb2>] ? 
br_handle_frame_finish+0x1c2/0x3c0 [bridge]
Jul 22 10:27:55 31.172.31.251 [171182.281982]  [<ffffffffa05401f7>] ? 
br_handle_frame+0x147/0x240 [bridge]
Jul 22 10:27:55 31.172.31.251 [171182.282014]  [<ffffffff8141e764>] ? 
__netif_receive_skb_core+0x1c4/0x750
Jul 22 10:27:55 31.172.31.251 [171182.282051]  [<ffffffff81009f9c>] ? 
xen_clocksource_get_cycles+0x1c/0x20
Jul 22 10:27:55 31.172.31.251 [171182.282083]  [<ffffffff8141ed6f>] ? 
netif_receive_skb_internal+0x1f/0x80
Jul 22 10:27:55 31.172.31.251 [171182.282122]  [<ffffffffa073250f>] ? 
xenvif_tx_action+0x49f/0x920 [xen_netback]
Jul 22 10:27:55 31.172.31.251 [171182.282172]  [<ffffffff81362a25>] ? 
is_xen_swiotlb_buffer+0x75/0x150
Jul 22 10:27:55 31.172.31.251 [171182.282205]  [<ffffffffa07352f8>] ? 
xenvif_poll+0x28/0x70 [xen_netback]
Jul 22 10:27:55 31.172.31.251 [171182.282240]  [<ffffffff8141f0f0>] ? 
net_rx_action+0x140/0x240
Jul 22 10:27:55 31.172.31.251 [171182.282275]  [<ffffffff8106c621>] ? 
__do_softirq+0xf1/0x290
Jul 22 10:27:55 31.172.31.251 [171182.282305]  [<ffffffff8106c9f5>] ? 
irq_exit+0x95/0xa0
Jul 22 10:27:55 31.172.31.251 [171182.282337]  [<ffffffff81359d75>] ? 
xen_evtchn_do_upcall+0x35/0x50
Jul 22 10:27:55 31.172.31.251 [171182.282372]  [<ffffffff81515e9e>] ? 
xen_do_hypervisor_callback+0x1e/0x30
Jul 22 10:27:55 31.172.31.251 [171182.282403]  <EOI>
Jul 22 10:27:55 31.172.31.251
Jul 22 10:27:55 31.172.31.251 [171182.282410]
Jul 22 10:27:55 31.172.31.251  [<ffffffff810013aa>] ? 
xen_hypercall_sched_op+0xa/0x20
Jul 22 10:27:55 31.172.31.251 [171182.282467]  [<ffffffff810013aa>] ? 
xen_hypercall_sched_op+0xa/0x20
Jul 22 10:27:55 31.172.31.251 [171182.282501]  [<ffffffff81009e7c>] ? 
xen_safe_halt+0xc/0x20
Jul 22 10:27:55 31.172.31.251 [171182.282537]  [<ffffffff8101c8e9>] ? 
default_idle+0x19/0xb0
Jul 22 10:27:55 31.172.31.251 [171182.282577]  [<ffffffff810a8330>] ? 
cpu_startup_entry+0x340/0x400
Jul 22 10:27:55 31.172.31.251 [171182.282615]  [<ffffffff81903076>] ? 
start_kernel+0x497/0x4a2
Jul 22 10:27:55 31.172.31.251 [171182.282645]  [<ffffffff81902a04>] ? 
set_init_arg+0x4e/0x4e
Jul 22 10:27:55 31.172.31.251 [171182.282678]  [<ffffffff81904f63>] ? 
xen_start_kernel+0x569/0x573
Jul 22 10:27:55 31.172.31.251 [171182.282708] Code:
Jul 22 10:27:55 31.172.31.251  <f3>
Jul 22 10:27:55 31.172.31.251
Jul 22 10:27:55 31.172.31.251 [171182.283036] RIP
Jul 22 10:27:55 31.172.31.251  [<ffffffff812b7a16>] memcpy+0x6/0x110
Jul 22 10:27:55 31.172.31.251 [171182.283068]  RSP <ffff880280e03b58>
Jul 22 10:27:55 31.172.31.251 [171182.283093] CR2: ffff88025b2d0000
Jul 22 10:27:55 31.172.31.251 [171182.283353] ---[ end trace 
1af688b6502ee191 ]---
Jul 22 10:27:55 31.172.31.251 [171182.288133] Kernel panic - not 
syncing: Fatal exception in interrupt
Jul 22 10:27:55 31.172.31.251 [171182.293798] Kernel Offset: 0x0 from 
0xffffffff81000000 (relocation range: 
0xffffffff80000000-0xffffffff9fffffff)

--
Ciao...          //        http://blog.windfluechter.net
      Ingo     \X/     XMPP: ij@xxxxxxxxxxxxxxxxxxxxxxxx


gpg pubkey:  http://www.juergensmann.de/ij_public_key.asc

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxx
https://lists.xen.org/xen-devel