On 5/28/2019 12:41 AM, Roger Pau Monné
wrote:
On Mon, May 27, 2019 at 03:35:21PM -0700, John L. Poole wrote:
On 5/27/2019 9:18 AM, Roger Pau Monné wrote:
On Mon, Apr 29, 2019 at 05:27:34PM +0200, Roger Pau Monné wrote:
IMO it would be better if you can build directly from the upstream git
repository [0], that way you could use git-bisect(1) in order to figure
out which commit broke your system. For example:
# git clone git://xenbits.xen.org/xen.git
# cd xen
# git checkout RELEASE-4.7.0
# make xen -j8
That should give you a set of Xen binaries in the xen/ directory, IIRC
you are booting from EFI so you likely need xen/xen.efi.
If that works, then you can test RELEASE-4.8.0 and if that fails to
boot you should have a range of commits that you can bisect in order
to find the culprit.
FWIW, I've been unable to find a box with the same CPU model (C2750)
that you are using. I've found a couple of old Atom boxes using
different CPUs but they all seem to boot fine using latest
xen-unstable. I've looked on eBay for that CPU but everything
containing it is server-grade and >200$ which I'm sadly not going to
pay.
Unless you are able to bisect the tree and give us the bad commit
that's causing your issues I'm afraid at least myself I won't be able
to progress this any further, sorry.
Roger.
I attempted to work backwards and ran into a nightmare with Gentoo. I kept
getting compiler errors which I suspect was a result of having a newer
version
of GCC and other things. It's not an easy thing to travel
back in time in Gentoo because everything keeps getting upgraded. I just
cannot make the time now to unravel this as I have some demands on my time
and will be engaged for the next four to six weeks.
IMO your best bet is to build Xen using Debian stretch, that's used by
the Xen test system, and is likely to be able to build the different
Xen versions, stable-* branches tested by osstest should build on
stretch.
What I've done in the past if that also triggers compiler errors is to
build a chroot with an older version of Debian and then build Xen
inside of it. You can do this in a box different from the one you are
testing, ie: you could create a Debian VM and build Xen from there.
Note that in order to bisect this issue you only need to build the Xen
kernel (make xen, no need to run ./configure), there's no need to
build the tools, hence you need almost no dependencies installed on
the builder.
I've done a build of the stable-4.7 branch myself and uploaded the
hypervisor binaries to:
http://xenbits.xen.org/people/royger/stable-4.7/
Could you give those a try (I wasn't sure whether you need xen.gz or
xen.efi so I've uploaded both) and see if you still have issues
booting?
Testing those binaries should be as simple as placing them in /boot/
and fixing your bootloader configuration to boot from those. Please
send the serial log when booting from the provided binaries.
How much would it cost for you to obtain the machine you need? I may
consider paying for it. I bought this Atom server just to economically run
Xen so the machine has marginal value to me if I cannot run Xen on it.
Even if we go that route, there's no guarantee that I would be able to
fix the issue, and there's also the possibility that the hardware you
have is somehow broken, and that the new one won't exhibit this issue.
Roger.
I
downloaded these files and placed accordingly:
xen.efi
=> /boot/efi/gentoo/roger0528.efi
xen.gz
=> /boot/efit/gentoo/roger0528_xen.gz
I
created /boot/efi/gentoo/roger0528.cfg which has:
============== BEGIN CFG =================
zeta
/home/jlpoole # cat /boot/efi/gentoo/roger0528.cfg
[global]
default=abc
[abc]
options=console=vga,com1 com1=115200,8n1 console_timestamps
console_to_ring conring_size=64 log_buf_len=16M loglvl=all
guest_loglvl=all sync_console=true sched_debug iommu=verbose
apic_verbosity=debug efi=no-rs reboot=kbd cpuinfo watchdog
mwait-idle=no
#kernel=xen-4.13-unstable.gz root=/dev/sda4
vga=gfx-1024x768x16 com1=115200,8n1 console=com1
console_timestamps=date console_to_ring conring_size=16k
loglvl=all guest_loglvl=all sync_console=true iommu=debug
apic_verbosity=debug
#
# 4/4/19 jlpoole: trying Gentoo 4.12.0 per request in
# https://bugs.gentoo.org/show_bug.cgi?id=679824
#
kernel=roger0528_xen.gz root=/dev/sda4 vga=gfx-1024x768x16
com1=115200,8n1 console=com1 console_timestamps=date
console_to_ring conring_size=16k loglvl=all guest_loglvl=all
sync_console=true iommu=debug apic_verbosity=debug
initramfs=initramfs-genkernel-x86_64-4.19.23-gentoo
zeta /home/jlpoole
==============
END CFG =================
Here's
is the log from my serial console:
============== BEGIN BOOT LOG
=================
fs0:\efi\gentoo>
roger0528.efi2,655,559 man_xen_gentoo-4.12.0.efi
23 File(s) 39,839,728 bytes
3 Dir(s)
Xen 4.7.6 (c/s Wed Feb 27 10:33:42 2019 +0000 git:206d3f65f7)
EFI loader
Using configuration file 'roger0528.cfg'
roger0528_xen.gz: 0x000000005ad63000-0x000000005ae49f80
0x0000:0x02:0x00.0x0: ROM: 0x8000 bytes at 0x7c8bc028
Xen 4.7.6
(XEN) Xen version 4.7.6 (root@) (gcc (Debian 6.3.0-18+deb9u1)
6.3.0 20170516) debug=n Tue May 28 09:25:50 CEST 2019
(XEN) Latest ChangeSet: Wed Feb 27 10:33:42 2019 +0000
git:206d3f65f7
(XEN) Console output is synchronous.
(XEN) Bootloader: EFI
(XEN) Command line: console=vga,com1 com1=115200,8n1
console_timestamps console_to_ring conring_size=64
log_buf_len=16M loglvl=all guest_loglvl=all sync_console=true
sched_debug iommu=verbose apic_verbosity=debug efi=no-rs
reboot=kbd cpuinfo watchdog mwait-idle=no
(XEN) Video information:
(XEN) VGA is graphics mode 800x600, 32 bpp
(XEN) Disc information:
(XEN) Found 0 MBR signatures
(XEN) Found 1 EDD information structures
(XEN) EFI RAM map:
(XEN) 0000000000000000 - 00000000000a0000 (usable)
(XEN) 0000000000100000 - 000000007e16b000 (usable)
(XEN) 000000007e16b000 - 000000007eba2000 (reserved)
(XEN) 000000007eba2000 - 000000007ed0d000 (usable)
(XEN) 000000007ed0d000 - 000000007f28d000 (ACPI NVS)
(XEN) 000000007f28d000 - 000000007f648000 (reserved)
(XEN) 000000007f648000 - 000000007f800000 (usable)
(XEN) 00000000e0000000 - 00000000e4000000 (reserved)
(XEN) 00000000fed01000 - 00000000fed04000 (reserved)
(XEN) 00000000fed08000 - 00000000fed09000 (reserved)
(XEN) 00000000fed0c000 - 00000000fed10000 (reserved)
(XEN) 00000000fed1c000 - 00000000fed1d000 (reserved)
(XEN) 00000000fef00000 - 00000000ff000000 (reserved)
(XEN) 00000000ff800000 - 0000000100000000 (reserved)
(XEN) 0000000100000000 - 0000000ff0000000 (usable)
(XEN) ACPI: RSDP 7ED55000, 0024 (r2 ALASKA)
(XEN) ACPI: XSDT 7ED55098, 00B4 (r1 ALASKA A M I 1072009
AMI 10013)
(XEN) ACPI: FACP 7ED58690, 010C (r5 ALASKA A M I 1072009
AMI 10013)
(XEN) ACPI: DSDT 7ED551E8, 34A1 (r2 ALASKA A M I 1072009
INTL 20061109)
(XEN) ACPI: FACS 7F28AF80, 0040
(XEN) ACPI: FPDT 7ED587A0, 0044 (r1 ALASKA A M I 1072009
AMI 10013)
(XEN) ACPI: FIDT 7ED587E8, 009C (r1 ALASKA A M I 1072009
AMI 10013)
(XEN) ACPI: SPMI 7ED58888, 0040 (r5 ALASKA A M I 0
AMI. 0)
(XEN) ACPI: MCFG 7ED588C8, 003C (r1 ALASKA A M I 1072009
MSFT 97)
(XEN) ACPI: WDAT 7ED58908, 01AC (r1 ALASKA A M I 1072009
MSFT 10013)
(XEN) ACPI: UEFI 7ED58AB8, 0042 (r1
0 0)
(XEN) ACPI: APIC 7ED58B00, 0098 (r3 INTEL TIANO 1
MSFT 0)
(XEN) ACPI: BDAT 7ED58B98, 0030 (r1
0 0)
(XEN) ACPI: HPET 7ED58BC8, 0038 (r1 INTEL 1
MSFT 1000013)
(XEN) ACPI: SSDT 7ED58C00, 09F1 (r1 PmRef CpuPm 3000
INTL 20061109)
(XEN) ACPI: SSDT 7ED595F8, 0259 (r1 PmRef Cpu0Tst 3000
INTL 20061109)
(XEN) ACPI: SSDT 7ED59858, 0357 (r1 PmRef ApTst 3000
INTL 20061109)
(XEN) ACPI: SPCR 7ED59BB0, 0050 (r1 A M I APTIO V 1072009
AMI. 5)
(XEN) ACPI: HEST 7ED59C00, 00A8 (r1 INTEL AVOTON B 1
INTL 1)
(XEN) ACPI: BERT 7ED59CA8, 0030 (r1 INTEL AVOTON B 1
INTL 1)
(XEN) ACPI: ERST 7ED59CD8, 0230 (r1 INTEL AVOTON B 1
INTL 1)
(XEN) ACPI: EINJ 7ED59F08, 0150 (r1 INTEL AVOTON B 1
INTL 1)
(XEN) System RAM: 63204MB (64721080kB)
(XEN) No NUMA configuration found
(XEN) Faking a node at 0000000000000000-0000000ff0000000
(XEN) Domain heap initialised
(XEN) Allocated console ring of 64 KiB.
(XEN) vesafb: framebuffer at 0xde000000, mapped to
0xffff82c000201000, using 1920k, total 1920k
(XEN) vesafb: mode is 800x600x32, linelength=3200, font 8x8
(XEN) vesafb: Truecolor: size=8:8:8:8, shift=24:16:8:0
(XEN) SMBIOS 2.8 present.
(XEN) DMI 2.7 present.
(XEN) APIC boot state is 'xapic'
(XEN) Using APIC driver default
(XEN) ACPI: PM-Timer IO Port: 0x408
(XEN) ACPI: v5 SLEEP INFO: control[0:0], status[0:0]
(XEN) ACPI: SLEEP INFO: pm1x_cnt[1:404,1:0],
pm1x_evt[1:400,1:0]
(XEN) ACPI: 32/64X FACS address mismatch in FADT -
7f28af80/0000000000000000, using 32
(XEN) ACPI: wakeup_vec[7f28af8c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x00] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x04] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x06] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x08] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x0a] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x0c] enabled)
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x0e] enabled)
(XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
(XEN) ACPI: IOAPIC (id[0x02] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_id 2, version 32, address 0xfec00000,
GSI 0-23
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high
level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enabling APIC mode: Flat. Using 1 I/O APICs
(XEN) ACPI: HPET id: 0x8086a201 base: 0xfed00000
(XEN) Xen ERST support is initialized.
(XEN) HEST: Table parsing has been initialized
(XEN) Using ACPI (MADT) for SMP configuration information
(XEN) SMP: Allowing 8 CPUs (0 hotplug CPUs)
(XEN) mapped APIC to ffff82cfffffb000 (fee00000)
(XEN) mapped IOAPIC to ffff82cfffffa000 (fec00000)
(XEN) IRQ limits: 24 GSI, 1528 MSI/MSI-X
(XEN) Levelling caps: 0x1
(XEN) CPU: Physical Processor ID: 0
(XEN) CPU: Processor Core ID: 0
(XEN) CPU: L1 I cache: 32K, L1 D cache: 24K
(XEN) CPU: L2 cache: 1024K
(XEN) CMCI: CPU0 has no CMCI support
(XEN) CPU0: Thermal monitoring enabled (TM1)
(XEN) Intel machine check reporting enabled
(XEN) Unrecognised CPU model 0x4d - assuming not reptpoline
safe
(XEN) Speculative mitigation facilities:
(XEN) Hardware features:
(XEN) Compiled-in support: INDIRECT_THUNK SHADOW_PAGING
(XEN) Xen settings: BTI-Thunk RETPOLINE, SPEC_CTRL: No,
Other:
(XEN) Support for VMs: PV: RSB, HVM: RSB
(XEN) XPTI (64-bit PV only): Dom0 enabled, DomU enabled
(XEN) PV L1TF shadowing: Dom0 disabled, DomU disabled
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) Initializing CPU#0
(XEN) Detected 2400.528 MHz processor.
(XEN) EFI memory map:
(XEN) 0000000000000-0000000007fff type=3
attr=000000000000000f
(XEN) 0000000008000-000000003cfff type=7
attr=000000000000000f
(XEN) 000000003d000-000000003ffff type=2
attr=000000000000000f
(XEN) 0000000040000-000000009ffff type=3
attr=000000000000000f
(XEN) 0000000100000-00000001fffff type=7
attr=000000000000000f
(XEN) 0000000200000-000000023ffff type=4
attr=000000000000000f
(XEN) 0000000240000-000005ad62fff type=7
attr=000000000000000f
(XEN) 000005ad63000-000005ae53fff type=2
attr=000000000000000f
(XEN) 000005ae54000-000005c110fff type=1
attr=000000000000000f
(XEN) 000005c111000-000007ad5afff type=2
attr=000000000000000f
(XEN) 000007ad5b000-000007ad5dfff type=7
attr=000000000000000f
(XEN) 000007ad5e000-000007ad63fff type=2
attr=000000000000000f
(XEN) 000007ad64000-000007ad65fff type=7
attr=000000000000000f
(XEN) 000007ad66000-000007ad66fff type=2
attr=000000000000000f
(XEN) 000007ad67000-000007ad67fff type=7
attr=000000000000000f
(XEN) 000007ad68000-000007ad6afff type=2
attr=000000000000000f
(XEN) 000007ad6b000-000007ad73fff type=7
attr=000000000000000f
(XEN) 000007ad74000-000007ad7efff type=2
attr=000000000000000f
(XEN) 000007ad7f000-000007db6afff type=4
attr=000000000000000f
(XEN) 000007db6b000-000007df0ffff type=7
attr=000000000000000f
(XEN) 000007df10000-000007e16afff type=3
attr=000000000000000f
(XEN) 000007e16b000-000007eba1fff type=0
attr=000000000000000f
(XEN) 000007eba2000-000007ed0cfff type=7
attr=000000000000000f
(XEN) 000007ed0d000-000007f28cfff type=10
attr=000000000000000f
(XEN) 000007f28d000-000007f5f2fff type=6
attr=800000000000000f
(XEN) 000007f5f3000-000007f647fff type=5
attr=800000000000000f
(XEN) 000007f648000-000007f7fffff type=4
attr=000000000000000f
(XEN) 0000100000000-0000fefffffff type=7
attr=000000000000000f
(XEN) 00000e0000000-00000e3ffffff type=11
attr=8000000000000001
(XEN) 00000fed01000-00000fed03fff type=11
attr=8000000000000001
(XEN) 00000fed08000-00000fed08fff type=11
attr=8000000000000001
(XEN) 00000fed0c000-00000fed0ffff type=11
attr=8000000000000001
(XEN) 00000fed1c000-00000fed1cfff type=11
attr=8000000000000001
(XEN) 00000fef00000-00000feffffff type=11
attr=8000000000000001
(XEN) 00000ff800000-00000ffffffff type=11
attr=8000000000000001
(XEN) Initing memory sharing.
(XEN) alt table ffff82d080652710 -> ffff82d080654060
(XEN) PCI: MCFG configuration 0: base e0000000 segment 0000
buses 00 - ff
(XEN) PCI: MCFG area at e0000000 reserved in E820
(XEN) PCI: updated MCFG configuration 0: base e0000000 segment
0 buses 0 - 63
(XEN) PCI: Using MCFG for segment 0000 bus 00-3f
(XEN) I/O virtualisation disabled
(XEN) CPU0: Intel(R) Atom(TM) CPU C2750 @ 2.40GHz stepping
08
(XEN) nr_sockets: 1
(XEN) Getting VERSION: 50014
(XEN) Getting VERSION: 50014
(XEN) Getting ID: 0
(XEN) Getting LVT0: 700
(XEN) Getting LVT1: 400
(XEN) enabled ExtINT on CPU#0
(XEN) ENABLING IO-APIC IRQs
(XEN) -> Using new ACK method
(XEN) init IO_APIC IRQs
(XEN) IO-APIC (apicid-pin) 2-0, 2-16, 2-17, 2-18, 2-19, 2-20,
2-21, 2-22, 2-23 not connected.
(XEN) ..TIMER: vector=0xF0 apic1=0 pin1=2 apic2=-1 pin2=-1
(XEN) number of MP IRQ sources: 15.
(XEN) number of IO-APIC #2 registers: 24.
(XEN) testing the IO APIC.......................
(XEN) IO APIC #2......
(XEN) .... register #00: 02000000
(XEN) ....... : physical APIC id: 02
(XEN) ....... : Delivery Type: 0
(XEN) ....... : LTS : 0
(XEN) .... register #01: 00170020
(XEN) ....... : max redirection entries: 0017
(XEN) ....... : PRQ implemented: 0
(XEN) ....... : IO APIC version: 0020
(XEN) .... IRQ redirection table:
(XEN) NR Log Phy Mask Trig IRR Pol Stat Dest Deli Vect:
(XEN) 00 000 00 1 0 0 0 0 0 0 00
(XEN) 01 001 01 0 0 0 0 0 1 1 28
(XEN) 02 001 01 0 0 0 0 0 1 1 F0
(XEN) 03 001 01 0 0 0 0 0 1 1 30
(XEN) 04 001 01 0 0 0 0 0 1 1 F1
(XEN) 05 001 01 0 0 0 0 0 1 1 38
(XEN) 06 001 01 0 0 0 0 0 1 1 40
(XEN) 07 001 01 0 0 0 0 0 1 1 48
(XEN) 08 001 01 0 0 0 0 0 1 1 50
(XEN) 09 001 01 1 1 0 0 0 1 1 58
(XEN) 0a 001 01 0 0 0 0 0 1 1 60
(XEN) 0b 001 01 0 0 0 0 0 1 1 68
(XEN) 0c 001 01 0 0 0 0 0 1 1 70
(XEN) 0d 001 01 0 0 0 0 0 1 1 78
(XEN) 0e 001 01 0 0 0 0 0 1 1 88
(XEN) 0f 001 01 0 0 0 0 0 1 1 90
(XEN) 10 000 00 1 0 0 0 0 0 0 00
(XEN) 11 000 00 1 0 0 0 0 0 0 00
(XEN) 12 000 00 1 0 0 0 0 0 0 00
(XEN) 13 000 00 1 0 0 0 0 0 0 00
(XEN) 14 000 00 1 0 0 0 0 0 0 00
(XEN) 15 000 00 1 0 0 0 0 0 0 00
(XEN) 16 000 00 1 0 0 0 0 0 0 00
(XEN) 17 000 00 1 0 0 0 0 0 0 00
(XEN) Using vector-based indexing
(XEN) IRQ to pin mappings:
(XEN) IRQ240 -> 0:2
(XEN) IRQ40 -> 0:1
(XEN) IRQ48 -> 0:3
(XEN) IRQ241 -> 0:4
(XEN) IRQ56 -> 0:5
(XEN) IRQ64 -> 0:6
(XEN) IRQ72 -> 0:7
(XEN) IRQ80 -> 0:8
(XEN) IRQ88 -> 0:9
(XEN) IRQ96 -> 0:10
(XEN) IRQ104 -> 0:11
(XEN) IRQ112 -> 0:12
(XEN) IRQ120 -> 0:13
(XEN) IRQ136 -> 0:14
(XEN) IRQ144 -> 0:15
(XEN) .................................... done.
(XEN) Using local APIC timer interrupts.
(XEN) calibrating APIC timer ...
(XEN) ..... CPU clock speed is 2400.0808 MHz.
(XEN) ..... host bus clock speed is 100.0036 MHz.
(XEN) ..... bus_scale = 0x6669
(XEN) TSC deadline timer enabled
(XEN) [2019-05-28 14:24:11] Platform timer appears to have
unexpectedly wrapped 1 times.
(XEN) [2019-05-28 14:24:11] Platform timer is 14.318MHz HPET
(XEN) [2019-05-28 14:24:11] mwait-idle: disabled
(XEN) [2019-05-28 14:24:11] VMX: Supported advanced features:
(XEN) [2019-05-28 14:24:11] - APIC MMIO access virtualisation
(XEN) [2019-05-28 14:24:11] - APIC TPR shadow
(XEN) [2019-05-28 14:24:11] - Extended Page Tables (EPT)
(XEN) [2019-05-28 14:24:11] - Virtual-Processor Identifiers
(VPID)
(XEN) [2019-05-28 14:24:11] - Virtual NMI
(XEN) [2019-05-28 14:24:11] - MSR direct-access bitmap
(XEN) [2019-05-28 14:24:11] - Unrestricted Guest
(XEN) [2019-05-28 14:24:11] - VM Functions
(XEN) [2019-05-28 14:24:11] HVM: ASIDs enabled.
(XEN) [2019-05-28 14:24:11] HVM: VMX enabled
(XEN) [2019-05-28 14:24:11] HVM: Hardware Assisted Paging
(HAP) detected
(XEN) [2019-05-28 14:24:11] HVM: HAP page sizes: 4kB, 2MB
(XEN) [2019-05-28 14:24:11] Booting processor 1/2 eip 3d000
(XEN) [2019-05-28 14:24:11] Initializing CPU#1
(XEN) [2019-05-28 14:24:11] masked ExtINT on CPU#1
(XEN) [2019-05-28 14:24:11] CPU: Physical Processor ID: 0
(XEN) [2019-05-28 14:24:12] CPU: Processor Core ID: 1
(XEN) [2019-05-28 14:24:12] CPU: L1 I cache: 32K, L1 D cache:
24K
(XEN) [2019-05-28 14:24:12] CPU: L2 cache: 1024K
(XEN) [2019-05-28 14:24:12] CMCI: CPU1 has no CMCI support
(XEN) [2019-05-28 14:24:12] CPU1: Thermal monitoring enabled
(TM1)
(XEN) [2019-05-28 14:24:12] CPU1: Intel(R) Atom(TM) CPU
C2750 @ 2.40GHz stepping 08
(XEN) [2019-05-28 14:24:12] Booting processor 2/4 eip 3d000
[hangs]
============== END BOOT LOG
=================
Note: My procedure is to
start the machine, then drop into an EFI shell,
navigate to the
/boot/efi/gentoo directory and then launch the efi with:
roger0528.efi
The above log has some
distortion of character overlap at the top due
to a misalignment of the
serial console (PuTTY) vs. output.
Thank you,
John
