[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-devel] xend crash



Make a debug build of Xen, then when a domain gets in this stuck
state:
 Switch your serial input to Xen rather than DOM0 (triple CTRL-a).
 Hit 'q'.
 Send us the output.

Probably a reference to the control-interface memory page is keeping
it alive. When you stop xend is it really dead? Does it disappear from
the process list?

Are your guest OSes configured with writable page tables (it's an
option under the Xen submenu in 'make *config')?

 -- Keir

> I am finding that something is going wrong sometimes when I try to kill a 
> domain. the domain will sit in a state with it's memory usage listed as 0 in 
> 'xm list'. xend will stop but will not restart again. an orderly reboot of 
> xen0 will cause an oops.
> 
> It seems to happen when the domain i'm trying to kill is writing lots of 
> information to the console.
> 
> here's the crash I get when I try to restart xend:
> 
> # xend start
> XendRoot>configure>
> XendRoot>set_config> config_path= /etc/xen/xend-config.sxp
> XendRoot>set_config> loading
> XendRoot> config= ['xend-config', ['xend-port', '8000'], ['xend-address', 
> ''], ['network-script', '/bin/true'], ['vif-bridge', 'xen-br0'], 
> ['vif-script', 'vif-bridge'], ['vif-antispoof', 'no']]
> [xend] INFO (SrvDaemon:604) Xend Daemon started
> Traceback (most recent call last):
>   File "/usr/sbin/xend", line 115, in ?
>     sys.exit(main())
>   File "/usr/sbin/xend", line 103, in main
>     return daemon.start()
>   File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvDaemon.py", line 
> 519, in start
>     self.run()
>   File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvDaemon.py", line 
> 610, in run
>     SrvServer.create(bridge=1)
>   File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvServer.py", line 
> 47, in create
>     xend = SrvRoot()
>   File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvRoot.py", line 
> 29, in __init__
>     self.get(name)
>   File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvDir.py", line 69, 
> in get
>     val = val.getobj()
>   File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvDir.py", line 39, 
> in getobj
>     self.obj = klassobj()
>   File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvDomainDir.py", 
> line 23, in __init__
>     self.xd = XendDomain.instance()
>   File "/usr/lib/python2.3/site-packages/xen/xend/XendDomain.py", line 802, 
> in instance
>     inst = XendDomain()
>   File "/usr/lib/python2.3/site-packages/xen/xend/XendDomain.py", line 65, in 
> __init__
>     self.initial_refresh()
>   File "/usr/lib/python2.3/site-packages/xen/xend/XendDomain.py", line 153, 
> in initial_refresh
>     d_dom = self._new_domain(config, doms[domid])
>   File "/usr/lib/python2.3/site-packages/xen/xend/XendDomain.py", line 188, 
> in _new_domain
>     deferred = XendDomainInfo.vm_recreate(savedinfo, info)
>   File "/usr/lib/python2.3/site-packages/xen/xend/XendDomainInfo.py", line 
> 290, in vm_recreate
>     d = vm.construct(config)
>   File "/usr/lib/python2.3/site-packages/xen/xend/XendDomainInfo.py", line 
> 509, in construct
>     image_handler(self, image)
>   File "/usr/lib/python2.3/site-packages/xen/xend/XendDomainInfo.py", line 
> 1015, in vm_image_linux
>     vm.create_domain("linux", kernel, ramdisk, cmdline, len(vifs))
>   File "/usr/lib/python2.3/site-packages/xen/xend/XendDomainInfo.py", line 
> 768, in create_domain
>     self.console = xendConsole.console_create(self.dom, 
> console_port=self.console_port)
>   File "/usr/lib/python2.3/site-packages/xen/xend/XendConsole.py", line 36, 
> in console_create
>     consinfo = daemon.console_create(dom, console_port=console_port)
>   File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvDaemon.py", line 
> 711, in console_create
>     console = self.consoleCF.createInstance(dom, console_port)
>   File "/usr/lib/python2.3/site-packages/xen/xend/server/console.py", line 
> 90, in createInstance
>     console = ConsoleController(self, dom, console_port)
>   File "/usr/lib/python2.3/site-packages/xen/xend/server/console.py", line 
> 124, in __init__
>     self.registerChannel()
>   File "/usr/lib/python2.3/site-packages/xen/xend/server/controller.py", line 
> 220, in registerChannel
>     self.channel = self.channelFactory.domChannel(self.dom)
>   File "/usr/lib/python2.3/site-packages/xen/xend/server/channel.py", line 
> 58, in domChannel
>     chan = Channel(self, dom)
>   File "/usr/lib/python2.3/site-packages/xen/xend/server/channel.py", line 
> 212, in __init__
>     self.port = self.factory.createPort(dom)
>   File "/usr/lib/python2.3/site-packages/xen/xend/server/channel.py", line 
> 97, in createPort
>     return xu.port(dom)
> xen.lowlevel.xu.PortError: Failed to map domain control interface
 -=- MIME -=- 
--_D8FBE013-FBA5-45B7-A8D7-E3DBBB1EDC32_
Content-Type: text/plain;
        charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

I am finding that something is going wrong sometimes when I try to kill a d=
omain. the domain will sit in a state with it's memory usage listed as 0 in=
 'xm list'. xend will stop but will not restart again. an orderly reboot of=
 xen0 will cause an oops.

It seems to happen when the domain i'm trying to kill is writing lots of in=
formation to the console.

here's the crash I get when I try to restart xend:

# xend start
XendRoot>configure>
XendRoot>set_config> config_path=3D /etc/xen/xend-config.sxp
XendRoot>set_config> loading
XendRoot> config=3D ['xend-config', ['xend-port', '8000'], ['xend-address',=
 ''], ['network-script', '/bin/true'], ['vif-bridge', 'xen-br0'], ['vif-scr=
ipt', 'vif-bridge'], ['vif-antispoof', 'no']]
[xend] INFO (SrvDaemon:604) Xend Daemon started
Traceback (most recent call last):
  File "/usr/sbin/xend", line 115, in ?
    sys.exit(main())
  File "/usr/sbin/xend", line 103, in main
    return daemon.start()
  File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvDaemon.py", lin=
e 519, in start
    self.run()
  File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvDaemon.py", lin=
e 610, in run
    SrvServer.create(bridge=3D1)
  File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvServer.py", lin=
e 47, in create
    xend =3D SrvRoot()
  File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvRoot.py", line =
29, in __init__
    self.get(name)
  File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvDir.py", line 6=
9, in get
    val =3D val.getobj()
  File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvDir.py", line 3=
9, in getobj
    self.obj =3D klassobj()
  File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvDomainDir.py", =
line 23, in __init__
    self.xd =3D XendDomain.instance()
  File "/usr/lib/python2.3/site-packages/xen/xend/XendDomain.py", line 802,=
 in instance
    inst =3D XendDomain()
  File "/usr/lib/python2.3/site-packages/xen/xend/XendDomain.py", line 65, =
in __init__
    self.initial_refresh()
  File "/usr/lib/python2.3/site-packages/xen/xend/XendDomain.py", line 153,=
 in initial_refresh
    d_dom =3D self._new_domain(config, doms[domid])
  File "/usr/lib/python2.3/site-packages/xen/xend/XendDomain.py", line 188,=
 in _new_domain
    deferred =3D XendDomainInfo.vm_recreate(savedinfo, info)
  File "/usr/lib/python2.3/site-packages/xen/xend/XendDomainInfo.py", line =
290, in vm_recreate
    d =3D vm.construct(config)
  File "/usr/lib/python2.3/site-packages/xen/xend/XendDomainInfo.py", line =
509, in construct
    image_handler(self, image)
  File "/usr/lib/python2.3/site-packages/xen/xend/XendDomainInfo.py", line =
1015, in vm_image_linux
    vm.create_domain("linux", kernel, ramdisk, cmdline, len(vifs))
  File "/usr/lib/python2.3/site-packages/xen/xend/XendDomainInfo.py", line =
768, in create_domain
    self.console =3D xendConsole.console_create(self.dom, console_port=3Dse=
lf.console_port)
  File "/usr/lib/python2.3/site-packages/xen/xend/XendConsole.py", line 36,=
 in console_create
    consinfo =3D daemon.console_create(dom, console_port=3Dconsole_port)
  File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvDaemon.py", lin=
e 711, in console_create
    console =3D self.consoleCF.createInstance(dom, console_port)
  File "/usr/lib/python2.3/site-packages/xen/xend/server/console.py", line =
90, in createInstance
    console =3D ConsoleController(self, dom, console_port)
  File "/usr/lib/python2.3/site-packages/xen/xend/server/console.py", line =
124, in __init__
    self.registerChannel()
  File "/usr/lib/python2.3/site-packages/xen/xend/server/controller.py", li=
ne 220, in registerChannel
    self.channel =3D self.channelFactory.domChannel(self.dom)
  File "/usr/lib/python2.3/site-packages/xen/xend/server/channel.py", line =
58, in domChannel
    chan =3D Channel(self, dom)
  File "/usr/lib/python2.3/site-packages/xen/xend/server/channel.py", line =
212, in __init__
    self.port =3D self.factory.createPort(dom)
  File "/usr/lib/python2.3/site-packages/xen/xend/server/channel.py", line =
97, in createPort
    return xu.port(dom)
xen.lowlevel.xu.PortError: Failed to map domain control interface

--_D8FBE013-FBA5-45B7-A8D7-E3DBBB1EDC32_
Content-Type: text/html;
        charset="iso-8859-1"
Content-Transfer-Encoding: quoted-printable

<HTML dir=3Dltr><HEAD></HEAD>
<BODY>
<DIV><FONT face=3DArial color=3D#000000 size=3D2>I am finding that&nbsp;som=
ething is going wrong sometimes when I try to kill a domain. the domain wil=
l sit in a state with it's memory usage listed as 0 in 'xm list'. xend will=
 stop but will not restart again. an orderly reboot of xen0 will cause an o=
ops.</FONT></DIV>
<DIV><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
<DIV><FONT face=3DArial size=3D2>It seems to happen when the domain i'm try=
ing to kill is writing lots of information to the console.</FONT></DIV>
<DIV><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
<DIV><FONT face=3DArial size=3D2>here's the crash I get when I try to resta=
rt xend:</FONT></DIV>
<DIV><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
<DIV><FONT face=3DArial size=3D2># xend start<BR>XendRoot&gt;configure&gt;<=
BR>XendRoot&gt;set_config&gt; config_path=3D /etc/xen/xend-config.sxp<BR>Xe=
ndRoot&gt;set_config&gt; loading<BR>XendRoot&gt; config=3D ['xend-config', =
['xend-port', '8000'], ['xend-address', ''], ['network-script', '/bin/true'=
], ['vif-bridge', 'xen-br0'], ['vif-script', 'vif-bridge'], ['vif-antispoof=
', 'no']]<BR>[xend] INFO (SrvDaemon:604) Xend Daemon started<BR>Traceback (=
most recent call last):<BR>&nbsp; File "/usr/sbin/xend", line 115, in ?<BR>=
&nbsp;&nbsp;&nbsp; sys.exit(main())<BR>&nbsp; File "/usr/sbin/xend", line 1=
03, in main<BR>&nbsp;&nbsp;&nbsp; return daemon.start()<BR>&nbsp; File "/us=
r/lib/python2.3/site-packages/xen/xend/server/SrvDaemon.py", line 519, in s=
tart<BR>&nbsp;&nbsp;&nbsp; self.run()<BR>&nbsp; File "/usr/lib/python2.3/si=
te-packages/xen/xend/server/SrvDaemon.py", line 610, in run<BR>&nbsp;&nbsp;=
&nbsp; SrvServer.create(bridge=3D1)<BR>&nbsp; File "/usr/lib/python2.3/site=
-packages/xen/xend/server/SrvServer.py", line 47, in create<BR>&nbsp;&nbsp;=
&nbsp; xend =3D SrvRoot()<BR>&nbsp; File "/usr/lib/python2.3/site-packages/=
xen/xend/server/SrvRoot.py", line 29, in __init__<BR>&nbsp;&nbsp;&nbsp; sel=
f.get(name)<BR>&nbsp; File "/usr/lib/python2.3/site-packages/xen/xend/serve=
r/SrvDir.py", line 69, in get<BR>&nbsp;&nbsp;&nbsp; val =3D val.getobj()<BR=
>&nbsp; File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvDir.py", =
line 39, in getobj<BR>&nbsp;&nbsp;&nbsp; self.obj =3D klassobj()<BR>&nbsp; =
File "/usr/lib/python2.3/site-packages/xen/xend/server/SrvDomainDir.py", li=
ne 23, in __init__<BR>&nbsp;&nbsp;&nbsp; self.xd =3D XendDomain.instance()<=
BR>&nbsp; File "/usr/lib/python2.3/site-packages/xen/xend/XendDomain.py", l=
ine 802, in instance<BR>&nbsp;&nbsp;&nbsp; inst =3D XendDomain()<BR>&nbsp; =
File "/usr/lib/python2.3/site-packages/xen/xend/XendDomain.py", line 65, in=
 __init__<BR>&nbsp;&nbsp;&nbsp; self.initial_refresh()<BR>&nbsp; File "/usr=
/lib/python2.3/site-packages/xen/xend/XendDomain.py", line 153, in initial_=
refresh<BR>&nbsp;&nbsp;&nbsp; d_dom =3D self._new_domain(config, doms[domid=
])<BR>&nbsp; File "/usr/lib/python2.3/site-packages/xen/xend/XendDomain.py"=
, line 188, in _new_domain<BR>&nbsp;&nbsp;&nbsp; deferred =3D XendDomainInf=
o.vm_recreate(savedinfo, info)<BR>&nbsp; File "/usr/lib/python2.3/site-pack=
ages/xen/xend/XendDomainInfo.py", line 290, in vm_recreate<BR>&nbsp;&nbsp;&=
nbsp; d =3D vm.construct(config)<BR>&nbsp; File "/usr/lib/python2.3/site-pa=
ckages/xen/xend/XendDomainInfo.py", line 509, in construct<BR>&nbsp;&nbsp;&=
nbsp; image_handler(self, image)<BR>&nbsp; File "/usr/lib/python2.3/site-pa=
ckages/xen/xend/XendDomainInfo.py", line 1015, in vm_image_linux<BR>&nbsp;&=
nbsp;&nbsp; vm.create_domain("linux", kernel, ramdisk, cmdline, len(vifs))<=
BR>&nbsp; File "/usr/lib/python2.3/site-packages/xen/xend/XendDomainInfo.py=
", line 768, in create_domain<BR>&nbsp;&nbsp;&nbsp; self.console =3D xendCo=
nsole.console_create(self.dom, console_port=3Dself.console_port)<BR>&nbsp; =
File "/usr/lib/python2.3/site-packages/xen/xend/XendConsole.py", line 36, i=
n console_create<BR>&nbsp;&nbsp;&nbsp; consinfo =3D daemon.console_create(d=
om, console_port=3Dconsole_port)<BR>&nbsp; File "/usr/lib/python2.3/site-pa=
ckages/xen/xend/server/SrvDaemon.py", line 711, in console_create<BR>&nbsp;=
&nbsp;&nbsp; console =3D self.consoleCF.createInstance(dom, console_port)<B=
R>&nbsp; File "/usr/lib/python2.3/site-packages/xen/xend/server/console.py"=
, line 90, in createInstance<BR>&nbsp;&nbsp;&nbsp; console =3D ConsoleContr=
oller(self, dom, console_port)<BR>&nbsp; File "/usr/lib/python2.3/site-pack=
ages/xen/xend/server/console.py", line 124, in __init__<BR>&nbsp;&nbsp;&nbs=
p; self.registerChannel()<BR>&nbsp; File "/usr/lib/python2.3/site-packages/=
xen/xend/server/controller.py", line 220, in registerChannel<BR>&nbsp;&nbsp=
;&nbsp; self.channel =3D self.channelFactory.domChannel(self.dom)<BR>&nbsp;=
 File "/usr/lib/python2.3/site-packages/xen/xend/server/channel.py", line 5=
8, in domChannel<BR>&nbsp;&nbsp;&nbsp; chan =3D Channel(self, dom)<BR>&nbsp=
; File "/usr/lib/python2.3/site-packages/xen/xend/server/channel.py", line =
212, in __init__<BR>&nbsp;&nbsp;&nbsp; self.port =3D self.factory.createPor=
t(dom)<BR>&nbsp; File "/usr/lib/python2.3/site-packages/xen/xend/server/cha=
nnel.py", line 97, in createPort<BR>&nbsp;&nbsp;&nbsp; return xu.port(dom)<=
BR>xen.lowlevel.xu.PortError: Failed to map domain control interface</FONT>=
</DIV>
<DIV><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
<DIV><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV>
<DIV><FONT face=3DArial size=3D2></FONT>&nbsp;</DIV></BODY></HTML>

--_D8FBE013-FBA5-45B7-A8D7-E3DBBB1EDC32_--


-------------------------------------------------------
This SF.Net email is sponsored by BEA Weblogic Workshop
FREE Java Enterprise J2EE developer tools!
Get your free copy of BEA WebLogic Workshop 8.1 today.
http://ads.osdn.com/?ad_id=5047&alloc_id=10808&op=click
_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxxxx
https://lists.sourceforge.net/lists/listinfo/xen-devel



-------------------------------------------------------
This SF.Net email is sponsored by BEA Weblogic Workshop
FREE Java Enterprise J2EE developer tools!
Get your free copy of BEA WebLogic Workshop 8.1 today.
http://ads.osdn.com/?ad_id=5047&alloc_id=10808&op=click
_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxxxx
https://lists.sourceforge.net/lists/listinfo/xen-devel


 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.