Re: [Xen-devel] Xen Hypervisor start fail when system memory more than 64GB, and free xen memory over 32 GB

[Pasi Kärkkäinen <pasik@xxxxxx>]

On Mon, Aug 16, 2010 at 06:41:03PM +0800, benian wrote:
>    hi Pasi,
>    I 've tried it before, but 4.0.1-rc6 andà 4.0.1-rc5 à also boot fail, but
>    different from the previous problem à error occur after XEN startup
>    ÃÅÂclose to finish and all XEN message is cleared , Ã these two version
>    hang on during à XEN is still starting , and the final message isà "(XEN)
>    Dom0 Ã has maximum 16 vcpus " Ã
>    On the other hand, Ã 4.0.1-rc4 and 4.0.0 boot smoothlyÃ
>    Moreover, i found thatà à 4.0.1-rc4 and 4.0.0à à takes much time on this
>    message à "(XEN) brought up 16cpu" à , whereà 4.0.1-rc6 andà 4.0.1-rc5
>    justà fleet.Ã
>

Can you please post the full/complete bootlogs with Xen 4.0.1-rc6
so we can figure it out.. Thanks!

-- Pasi


>    Regards,
>    Ben
>    2010/8/16 Pasi KÃârkkÃâinen <[1]pasik@xxxxxx>
> 
>      On Mon, Aug 16, 2010 at 12:55:55PM +0300, Pasi KÃârkkÃâinen wrote:
>      > On Mon, Aug 16, 2010 at 05:46:24PM +0800, benian wrote:
>      > > Ã  Ã Hi Pasi
>      > > à à I finally boot up successfully by simply modified à the kernel
>      config
>      > > Ã  Ã  item CONFIG_XEN_MAX_DOMAIN_MEMORY=32 to
>      CONFIG_XEN_MAX_DOMAIN_MEMORY=128
>      > > Ã  Ã (just choose a random value >72 ),
>      > > Ã  Ã then rebuild the kernel-2.6.32 , and everything is ok.
>      > > Ã  Ã By the way, i 've done many test and i finally found that
>      > > Ã  Ã if unallocated memory(total - dom0 ) >32GB, boot up would be
>      failed in my
>      > > Ã  Ã environment.
>      > > Ã  Ã for example, after I modified the kernel config, hypervisor
>      boot normally
>      > > Ã  Ã and dom0 get 72GB.
>      > > Ã  Ã If i add dom0_mem= 32G(unallocated 40G) to grub option,
>      hypervisor boot
>      > > Ã  Ã fail again,
>      > > Ã  Ã and if dom0_mem= 41G(unallocated 31G), hypervisor boot normally
>      again.
>      > > Ã  Ã So , might it be a problem of xen-4.0 that unable to handle
>      unallocated
>      > > Ã  Ã memory >32GB?
>      > >
>      >
>      > Sounds like a bug yeah.. How does it fail in the dom0_mem=32G case?
>      What's the error?
>      >
>      > Can you please paste the full bootlog of the failing boot from a
>      serial console?
>      > [2]http://wiki.xensource.com/xenwiki/XenSerialConsole
>      >
> 
>      Oh, one more thing, could you also try with Xen 4.0.1-rc6?
> 
>      Thanks!
>      -- Pasi
> 
>      >
>      >
>      > > Ã  Ã Regards,
>      > > Ã  Ã Ben
>      > > Ã  Ã 2010/8/12 Pasi KÃârkkÃâinen <[1][3]pasik@xxxxxx>
>      > >
>      > > Ã  Ã  Ã On Thu, Aug 12, 2010 at 03:08:25PM +0800, benian wrote:
>      > > Ã  Ã  Ã >
>      > > Ã  Ã  Ã >
>      > > Ã  Ã  Ã > Ã  Ã My environment is xen-4.0.0 + pvops2.6.32 kernel +
>      fedora12
>      > > Ã  Ã  Ã >
>      > > Ã  Ã  Ã > Ã  Ã I can run xen hypervisor smoothly when system memory
>      below 64G
>      > > Ã  Ã  Ã >
>      > > Ã  Ã  Ã > Ã  Ã But if I plug 4GB more memory to my server, XEN
>      hypervisor start
>      > > Ã  Ã  Ã fail then
>      > > Ã  Ã  Ã > Ã  Ã crash and restart automatically.
>      > > Ã  Ã  Ã >
>      > > Ã  Ã  Ã > Ã  Ã The final screen is some message about memory address
>      which will
>      > > Ã  Ã  Ã not be
>      > > Ã  Ã  Ã > Ã  Ã displayed in normal process
>      > > Ã  Ã  Ã >
>      > > Ã  Ã  Ã >
>      > > Ã  Ã  Ã >
>      > > Ã  Ã  Ã > Ã  Ã I read from XEN 4.0.0 features that Xen support 1 TB
>      of RAM per
>      > > Ã  Ã  Ã host, so I
>      > > Ã  Ã  Ã > Ã  Ã am not sure what *s wrong with this situation.
>      > > Ã  Ã  Ã >
>      > > Ã  Ã  Ã >
>      > > Ã  Ã  Ã >
>      > > Ã  Ã  Ã > Ã  Ã Any idea is appreciated and welcome
>      > > Ã  Ã  Ã >
>      > > Ã  Ã  Ã >
>      > >
>      > > Ã  Ã  Ã How much memory does your dom0 have? ie. what's your
>      dom0_mem= option
>      > > Ã  Ã  Ã for xen.gz in grub.conf.
>      > > Ã  Ã  Ã Have you tried different values? ie. 2GB, 4GB, 8GB?
>      > >
>      > > Ã  Ã  Ã Also setup a serial console so you can figure out if it's
>      the Xen
>      > > Ã  Ã  Ã hypervisor or dom0 kernel crashing:
>      > > Ã  Ã  Ã [2][4]http://wiki.xensource.com/xenwiki/XenSerialConsole
>      > >
>      > > Ã  Ã  Ã and more info about troubleshooting pvops dom0 kernels (also
>      an example
>      > > Ã  Ã  Ã about serial console with pvops dom0):
>      > > Ã  Ã  Ã [3][5]http://wiki.xensource.com/xenwiki/XenParavirtOps
>      > >
>      > > Ã  Ã  Ã Those should help.
>      > > Ã  Ã  Ã -- Pasi
>      > >
>      > > References
>      > >
>      > > Ã  Ã Visible links
>      > > Ã  Ã 1. mailto:[6]pasik@xxxxxx
>      > > Ã  Ã 2. [7]http://wiki.xensource.com/xenwiki/XenSerialConsole
>      > > Ã  Ã 3. [8]http://wiki.xensource.com/xenwiki/XenParavirtOps
>      >
>      > _______________________________________________
>      > Xen-devel mailing list
>      > [9]Xen-devel@xxxxxxxxxxxxxxxxxxx
>      > [10]http://lists.xensource.com/xen-devel
> 
> References
> 
>    Visible links
>    1. mailto:pasik@xxxxxx
>    2. http://wiki.xensource.com/xenwiki/XenSerialConsole
>    3. mailto:pasik@xxxxxx
>    4. http://wiki.xensource.com/xenwiki/XenSerialConsole
>    5. http://wiki.xensource.com/xenwiki/XenParavirtOps
>    6. mailto:pasik@xxxxxx
>    7. http://wiki.xensource.com/xenwiki/XenSerialConsole
>    8. http://wiki.xensource.com/xenwiki/XenParavirtOps
>    9. mailto:Xen-devel@xxxxxxxxxxxxxxxxxxx
>   10. http://lists.xensource.com/xen-devel

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel