Xen project Mailing List

Re: [Xen-users] Booting Xen on ARM Juno r0

To: Ian Campbell <ian.campbell@xxxxxxxxxx>

From: John Paul Walters <jpnwalters@xxxxxxxxx>

Date: Wed, 15 Jul 2015 16:41:07 -0400

Delivery-date: Wed, 15 Jul 2015 20:42:41 +0000

List-id: Xen user discussion <xen-users.lists.xen.org>

I've included the output of building xen with debug=y and CONFIG_EARLY_PRINTK=juno. It's not obvious to me why the additional CPUs aren't coming up, but I noticed an error message early in the Xen output: (XEN) Error: PSCI version 0x10000 is not supported. Then the dom0 kernel appears to crash inside of some PSCI initialization: (XEN) DOM0: [<ffffffc00008be20>] __invoke_psci_fn_smc+0x0/0x10 (XEN) DOM0: [<ffffffc000817ea8>] psci_init+0x2c/0x40 (XEN) DOM0: [<ffffffc000817870>] setup_arch+0x420/0x5ac (XEN) DOM0: [<ffffffc00081566c>] start_kernel+0xa0/0x3a4 Any suggestions would be welcome. thanks, JP FS2:\> xen -cfg=cfg 3hXen 4.5.1 (c/s Mon Jun 22 14:12:56 2015 +0100 git:6e865a4-dirty) EFI loader junoX: 0x00000009faf87000-0x00000009faf89b89 ImageX: 0x00000009fa3be000-0x00000009fabf7000 - UART enabled - - CPU 00000100 booting - - Current EL 00000008 - - Xen starting at EL2 - - Zero BSS - - Setting up control registers - - Turning on paging - - Ready - (XEN) Checking for initrd in /chosen (XEN) RAM: 0000000080000000 - 00000000dfffffff (XEN) RAM: 00000000e00f0000 - 00000000feb2ffff (XEN) RAM: 00000000feba0000 - 00000000febabfff (XEN) RAM: 00000000febac000 - 00000000feffffff (XEN) RAM: 0000000880000000 - 00000009fa3bdfff (XEN) RAM: 00000009fade9000 - 00000009faecffff (XEN) RAM: 00000009faf80000 - 00000009faf82fff (XEN) RAM: 00000009faf87000 - 00000009faf8afff (XEN) RAM: 00000009faf8c000 - 00000009febe3fff (XEN) RAM: 00000009febe4000 - 00000009ff142fff (XEN) RAM: 00000009ff143000 - 00000009ff144fff (XEN) RAM: 00000009ff145000 - 00000009ff16dfff (XEN) RAM: 00000009ff16e000 - 00000009ff170fff (XEN) RAM: 00000009ff171000 - 00000009ffdbffff (XEN) RAM: 00000009ffdc0000 - 00000009ffe44fff (XEN) RAM: 00000009ffe45000 - 00000009fff4ffff (XEN) RAM: 00000009fff90000 - 00000009fff9ffff (XEN) RAM: 00000009ffff0000 - 00000009ffffefff (XEN) RAM: 00000009fffff000 - 00000009ffffffff (XEN) (XEN) MODULE[0]: 00000009faf83000 - 00000009faf87000 Device Tree (XEN) MODULE[1]: 00000009fa3be000 - 00000009fabf7000 Kernel console=hvc0 earlycon=pl011,0x7ff80000 rootwait root=/dev/sda3 (XEN) (XEN) Command line: xen console=dtuart dtuart=serial0 conswitch=x (XEN) Placing Xen at 0x00000000dfe00000-0x00000000e0000000 (XEN) Update BOOTMOD_XEN from 00000009fabf7000-00000009fad01d81 => 00000000dfe00000-00000000dff0ad81 (XEN) PFN compression on bits 21...22 (XEN) Domain heap initialised (XEN) Looking for UART console serial0 Xen 4.5.1 (XEN) Xen version 4.5.1 (root@xxxxxxxxxxxxxxxxx) (gcc (Debian/Linaro 4.9.2-20) 4.9.2) debug=y Wed Jul 15 20:13:08 UTC 2015 (XEN) Latest ChangeSet: Mon Jun 22 14:12:56 2015 +0100 git:6e865a4-dirty (XEN) Processor: 410fd030: "ARM Limited", variant: 0x0, part 0xd03, rev 0x0 (XEN) 64-bit Execution: (XEN) Processor Features: 0000000000002222 0000000000000000 (XEN) Exception Levels: EL3:64+32 EL2:64+32 EL1:64+32 EL0:64+32 (XEN) Extensions: FloatingPoint AdvancedSIMD (XEN) Debug Features: 0000000010305106 0000000000000000 (XEN) Auxiliary Features: 0000000000000000 0000000000000000 (XEN) Memory Model Features: 0000000000001122 0000000000000000 (XEN) ISA Features: 0000000000011120 0000000000000000 (XEN) 32-bit Execution: (XEN) Processor Features: 00000131:00011011 (XEN) Instruction Sets: AArch32 A32 Thumb Thumb-2 Jazelle (XEN) Extensions: GenericTimer Security (XEN) Debug Features: 03010066 (XEN) Auxiliary Features: 00000000 (XEN) Memory Model Features: 10101105 40000000 01260000 02102211 (XEN) ISA Features: 02101110 13112111 21232042 01112131 00011142 00011121 (XEN) Platform: VERSATILE EXPRESS (XEN) Error: PSCI version 0x10000 is not supported. (XEN) Generic Timer IRQ: phys=30 hyp=26 virt=27 (XEN) Using generic timer at 50000 KHz (XEN) GICv2 initialization: (XEN) gic_dist_addr=000000002c010000 (XEN) gic_cpu_addr=000000002c02f000 (XEN) gic_hyp_addr=000000002c04f000 (XEN) gic_vcpu_addr=000000002c06f000 (XEN) gic_maintenance_irq=25 (XEN) GICv2: 352 lines, 6 cpus, secure (IID 0200143b). (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) I/O virtualisation disabled (XEN) Allocated console ring of 64 KiB. (XEN) Bringing up CPU1 (XEN) Failed to bring up CPU1 (XEN) Failed to bring up CPU 1 (error -1) (XEN) Bringing up CPU2 (XEN) Failed to bring up CPU2 (XEN) Failed to bring up CPU 2 (error -1) (XEN) Bringing up CPU3 (XEN) Failed to bring up CPU3 (XEN) Failed to bring up CPU 3 (error -1) (XEN) Bringing up CPU4 (XEN) Failed to bring up CPU4 (XEN) Failed to bring up CPU 4 (error -1) (XEN) Bringing up CPU5 (XEN) Failed to bring up CPU5 (XEN) Failed to bring up CPU 5 (error -1) (XEN) Brought up 1 CPUs (XEN) P2M: 40-bit IPA with 40-bit PA (XEN) P2M: 3 levels with order-1 root, VTCR 0x80023558 (XEN) *** LOADING DOMAIN 0 *** (XEN) Loading kernel from boot module @ 00000009fa3be000 (XEN) Allocating 1:1 mappings totalling 128MB for dom0: (XEN) BANK[0] 0x000000d0000000-0x000000d8000000 (128MB) (XEN) Loading zImage from 00000009fa3be000 to 00000000d0080000-00000000d08b9000 (XEN) Loading dom0 DTB to 0x00000000d7e00000-0x00000000d7e0204f (XEN) Scrubbing Free RAM on 1 nodes using 1 CPUs (XEN) ................................................................done. (XEN) Initial low memory virq threshold set at 0x4000 pages. (XEN) Std. Loglevel: All (XEN) Guest Loglevel: All (XEN) *** Serial input -> DOM0 (type 'CTRL-x' three times to switch input to Xen) (XEN) Freed 284kB init memory. (XEN) DOM0: Booting Linux on physical CPU 0x0 (XEN) DOM0: Initializing cgroup subsys cpu (XEN) DOM0: Linux version 4.0.0Xen+ (root@arm64) (gcc version 4.9.2 (Debian/Linaro 4.9.2-20) ) #1 SMP PREEMPT Tue Jul 14 18:10:53 UTC 2015 (XEN) DOM0: (XEN) DOM0: CPU: AArch64 Processor [410fd030] revision 0 (XEN) DOM0: Detected VIPT I-cache on CPU0 (XEN) DOM0: alternatives: enabling workaround for ARM errata 826319, 827319, 824069 (XEN) DOM0: Early serial console at MMIO 0x7ff80000 (options '') (XEN) DOM0: bootconsole [uart0] enabled (XEN) DOM0: efi: Getting EFI parameters from FDT: (XEN) DOM0: efi: UEFI not found. (XEN) DOM0: cma: Reserved 64 MiB at 0x00000000d3c00000 (XEN) DOM0: psci: probing for conduit method from DT. (XEN) DOM0: swapper[0]: undefined instruction: pc=ffffffc00008be20 (XEN) DOM0: Code: d4000002 d65f03c0 d503201f d503201f (d4000003) (XEN) DOM0: Internal error: Oops - undefined instruction: 0 [#1] PREEMPT SMP (XEN) DOM0: Modules linked in: (XEN) DOM0: CPU: 0 PID: 0 Comm: swapper Not tainted 4.0.0Xen+ #1 (XEN) DOM0: Hardware name: ARM Juno development board (r0) (DT) (XEN) DOM0: task: ffffffc00086d2b0 ti: ffffffc000860000 task.ti: ffffffc000860000 (XEN) DOM0: PC is at __invoke_psci_fn_smc+0x0/0x10 (XEN) DOM0: LR is at psci_0_2_init+0x3c/0x170 (XEN) DOM0: pc : [<ffffffc00008be20>] lr : [<ffffffc000817c30>] pstate: 400000c5 (XEN) DOM0: sp : ffffffc000863ee0 (XEN) DOM0: x29: ffffffc000863ee0 x28: 00000040d0000000 (XEN) DOM0: x27: ffffffc000081230 x26: ffffffc0008cb9a0 (XEN) DOM0: x25: 0000000080000200 x24: ffffffc00076b100 (XEN) DOM0: x23: ffffffc000866000 x22: ffffffc00087b000 (XEN) DOM0: x21: ffffffc00086e000 x20: ffffffc0008bc000 (XEN) DOM0: x19: 0000000000000000 x18: 0000000000000409 (XEN) DOM0: x17: 0000000000001000 x16: 0000000000000000 (XEN) DOM0: x15: 664e321b1f041800 x14: ffffffffffffffff (XEN) DOM0: x13: 0000000000000018 x12: 0101010101010101 (XEN) DOM0: x11: 0000000000000018 x10: 0101010101010101 (XEN) DOM0: x9 : 7f7f7f7f7f7f7f7f x8 : 7f7f7f7f7f7f7f7f (XEN) DOM0: x7 : fefefefeff626c72 x6 : 0000008080808082 (XEN) DOM0: x5 : 0200000000000000 x4 : ffffffc00008be20 (XEN) DOM0: x3 : 0000000000000000 x2 : 0000000000000000 (XEN) DOM0: x1 : 0000000000000000 x0 : 0000000084000000 (XEN) DOM0: (XEN) DOM0: Process swapper (pid: 0, stack limit = 0xffffffc000860028) (XEN) DOM0: Stack: (0xffffffc000863ee0 to 0xffffffc000864000) (XEN) DOM0: 3ee0: 00863f10 ffffffc0 00817eac ffffffc0 00000000 00000000 008bc000 ffffffc0 (XEN) DOM0: 3f00: 0086e000 ffffffc0 0087b000 ffffffc0 00863f30 ffffffc0 00817874 ffffffc0 (XEN) DOM0: 3f20: 07ffd2c0 ffffffc0 0084cfc0 ffffffc0 00863fa0 ffffffc0 00815670 ffffffc0 (XEN) DOM0: 3f40: 00844738 ffffffc0 008bc000 ffffffc0 008bc000 ffffffc0 00866000 ffffffc0 (XEN) DOM0: 3f60: d086ea10 00000000 d0000000 00000000 d08ee000 00000000 d08f0000 00000000 (XEN) DOM0: 3f80: 00000000 00000000 00000000 80000000 00000080 00000000 64667467 ff616b73 (XEN) DOM0: 3fa0: 00000000 00000000 d0082700 00000000 00000000 00000000 00000e11 00000000 (XEN) DOM0: 3fc0: d7e00000 00000000 410fd030 00000000 d086ea10 00000000 d0000000 00000000 (XEN) DOM0: 3fe0: 00000000 00000000 00844738 ffffffc0 00000000 00000000 00000000 00000000 (XEN) DOM0: Call trace: (XEN) DOM0: [<ffffffc00008be20>] __invoke_psci_fn_smc+0x0/0x10 (XEN) DOM0: [<ffffffc000817ea8>] psci_init+0x2c/0x40 (XEN) DOM0: [<ffffffc000817870>] setup_arch+0x420/0x5ac (XEN) DOM0: [<ffffffc00081566c>] start_kernel+0xa0/0x3a4 (XEN) DOM0: Code: d4000002 d65f03c0 d503201f d503201f (d4000003) (XEN) DOM0: ---[ end trace cb88537fdc8fa200 ]--- (XEN) DOM0: Kernel panic - not syncing: Attempted to kill the idle task! (XEN) DOM0: ---[ end Kernel panic - not syncing: Attempted to kill the idle task! On Wed, Jul 15, 2015 at 11:54 AM, John Paul Walters <jpnwalters@xxxxxxxxx> wrote: > Hi Ian, > >> >> Building Xen with CONFIG_EARLY_PRINTK=juno might get some useful extra >> info. It would also be useful to see your file "cfg", in particular the >> various command lines which it will contain. >> > I'll follow up with an update after enabling CONFIG_EARLY_PRINTK, but > to answer your other questions, my cfg file: > > [global] > default=default > > [default] > options=console=dtuart dtuart=serial0 conswitch=x > kernel=ImageX console=hvc0 earlycon=pl011,0x7ff80000 rootwait > root=/dev/sda3 > dtb=junoX > > I copied that from the link I referenced earlier, I believe. The only > differences are that I differentiated my default kernel and dtb from > the Xen ones by calling the Xen kernel and dtb ImageX and junoX. My > root device is indeed /dev/sda3. > > > >> I take it your dom0 kernel binary boot successfully with all CPUs >> natively? > > Yes, my dom0 kernel boots all CPUs successfully. I didn't really > exercise them, but I can see all six of them. > >> >>> >>> thanks, >>> JP >>> > > > > > >>> UEFI firmware (version v3.0-rc0 built at 21:19:44 on Apr 8 2015) >>> [1] Linux from NOR Flash >>> [2] Debian ARMv8 >>> [3] KVM >>> [4] Xen from NOR Flash >>> [5] Shell >>> [6] Boot Manager >>> Start: 5 >>> UEFI Interactive Shell v2.1 >>> EDK II >>> UEFI v2.40 (ARM Juno EFI Apr 8 2015 21:19:51, 0x00000000) >>> Mapping table >>> FS2: Alias(s):F10:;BLK1: >>> VenHw(E7223039-5836-41E1-B542-D7EC736C5E59) >>> FS0: Alias(s):F3: >>> MemoryMapped(0xB,0xE0000000,0xE00EFFFF) >>> FS1: Alias(s):F4: >>> MemoryMapped(0xB,0xFEBC2000,0xFEDC693F) >>> BLK0: Alias(s): >>> VenHw(02118005-9DA7-443A-92D5-781F022AEDBB) >>> Shell> fs2: >>> FS2:\> xen -cfg=cfg >>> 3hXen 4.5.1 (c/s Mon Jun 22 14:12:56 2015 +0100 git:6e865a4) EFI loader >>> junoX: 0x00000009faf87000-0x00000009faf89b89 >>> ImageX: 0x00000009fa3ce000-0x00000009fac07000 >>> Xen 4.5.1 >>> (XEN) Xen version 4.5.1 (root@xxxxxxxxxxxxxxxxx) (gcc (Debian/Linaro >>> 4.9.2-20) 4.9.2) debug=n Tue Jul 14 18:20:46 UTC 2015 >>> (XEN) Latest ChangeSet: Mon Jun 22 14:12:56 2015 +0100 git:6e865a4 >>> (XEN) Processor: 410fd030: "ARM Limited", variant: 0x0, part 0xd03, rev 0x0 >>> (XEN) 64-bit Execution: >>> (XEN) Processor Features: 0000000000002222 0000000000000000 >>> (XEN) Exception Levels: EL3:64+32 EL2:64+32 EL1:64+32 EL0:64+32 >>> (XEN) Extensions: FloatingPoint AdvancedSIMD >>> (XEN) Debug Features: 0000000010305106 0000000000000000 >>> (XEN) Auxiliary Features: 0000000000000000 0000000000000000 >>> (XEN) Memory Model Features: 0000000000001122 0000000000000000 >>> (XEN) ISA Features: 0000000000011120 0000000000000000 >>> (XEN) 32-bit Execution: >>> (XEN) Processor Features: 00000131:00011011 >>> (XEN) Instruction Sets: AArch32 A32 Thumb Thumb-2 Jazelle >>> (XEN) Extensions: GenericTimer Security >>> (XEN) Debug Features: 03010066 >>> (XEN) Auxiliary Features: 00000000 >>> (XEN) Memory Model Features: 10101105 40000000 01260000 02102211 >>> (XEN) ISA Features: 02101110 13112111 21232042 01112131 00011142 00011121 >>> (XEN) Error: PSCI version 0x10000 is not supported. >>> (XEN) Generic Timer IRQ: phys=30 hyp=26 virt=27 >>> (XEN) Using generic timer at 50000 KHz >>> (XEN) GICv2 initialization: >>> (XEN) gic_dist_addr=000000002c010000 >>> (XEN) gic_cpu_addr=000000002c02f000 >>> (XEN) gic_hyp_addr=000000002c04f000 >>> (XEN) gic_vcpu_addr=000000002c06f000 >>> (XEN) gic_maintenance_irq=25 >>> (XEN) GICv2: 352 lines, 6 cpus, secure (IID 0200143b). >>> (XEN) Using scheduler: SMP Credit Scheduler (credit) >>> (XEN) I/O virtualisation disabled >>> (XEN) Allocated console ring of 16 KiB. >>> (XEN) Bringing up CPU1 >>> (XEN) Failed to bring up CPU1 >>> (XEN) Failed to bring up CPU 1 (error -1) >>> (XEN) Bringing up CPU2 >>> (XEN) Failed to bring up CPU2 >>> (XEN) Failed to bring up CPU 2 (error -1) >>> (XEN) Bringing up CPU3 >>> (XEN) Failed to bring up CPU3 >>> (XEN) Failed to bring up CPU 3 (error -1) >>> (XEN) Bringing up CPU4 >>> (XEN) Failed to bring up CPU4 >>> (XEN) Failed to bring up CPU 4 (error -1) >>> (XEN) Bringing up CPU5 >>> (XEN) Failed to bring up CPU5 >>> (XEN) Failed to bring up CPU 5 (error -1) >>> (XEN) Brought up 1 CPUs >>> (XEN) P2M: 40-bit IPA with 40-bit PA >>> (XEN) P2M: 3 levels with order-1 root, VTCR 0x80023558 >>> (XEN) *** LOADING DOMAIN 0 *** >>> (XEN) Loading kernel from boot module @ 00000009fa3ce000 >>> (XEN) Allocating 1:1 mappings totalling 128MB for dom0: >>> (XEN) BANK[0] 0x000000d0000000-0x000000d8000000 (128MB) >>> (XEN) Loading zImage from 00000009fa3ce000 to >>> 00000000d0080000-00000000d08b9000 >>> (XEN) Loading dom0 DTB to 0x00000000d7e00000-0x00000000d7e0204f >>> (XEN) Scrubbing Free RAM on 1 nodes using 1 CPUs >>> (XEN) ................................................................done. >>> (XEN) Initial low memory virq threshold set at 0x4000 pages. >>> (XEN) Std. Loglevel: Errors and warnings >>> (XEN) Guest Loglevel: Nothing (Rate-limited: Errors and warnings) >>> (XEN) *** Serial input -> DOM0 (type 'CTRL-x' three times to switch >>> input to Xen) >>> (XEN) Freed 280kB init memory. >>> (XEN) *** Serial input -> Xen (type 'CTRL-x' three times to switch >>> input to DOM0) >>> >>> _______________________________________________ >>> Xen-users mailing list >>> Xen-users@xxxxxxxxxxxxx >>> http://lists.xen.org/xen-users >> >> _______________________________________________ Xen-users mailing list Xen-users@xxxxxxxxxxxxx http://lists.xen.org/xen-users

©2013 Xen Project, A Linux Foundation Collaborative Project. All Rights Reserved.
Linux Foundation is a registered trademark of The Linux Foundation.
Xen Project is a trademark of The Linux Foundation.