From xen-users-bounces@lists.xen.org Sun Dec 01 12:06:09 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 01 Dec 2013 12:06:09 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vn5lo-0001c7-9r; Sun, 01 Dec 2013 12:05:04 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vn5ln-0001c2-3k for xen-users@lists.xen.org; Sun, 01 Dec 2013 12:05:03 +0000 Received: from [193.109.254.147:59165] by server-13.bemta-14.messagelabs.com id 3A/43-19374-EE52B925; Sun, 01 Dec 2013 12:05:02 +0000 X-Env-Sender: rafaelweingartner@gmail.com X-Msg-Ref: server-12.tower-27.messagelabs.com!1385899500!1963691!1 X-Originating-IP: [209.85.220.175] X-SpamReason: No, hits=1.2 required=7.0 tests=HTML_20_30,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 31866 invoked from network); 1 Dec 2013 12:05:01 -0000 Received: from mail-vc0-f175.google.com (HELO mail-vc0-f175.google.com) (209.85.220.175) by server-12.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 1 Dec 2013 12:05:01 -0000 Received: by mail-vc0-f175.google.com with SMTP id ld13so7539125vcb.6 for ; Sun, 01 Dec 2013 04:05:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=1kCybtI7IiUeSwV8IsNfDiLlm5NChHnojf3aliaQwqM=; b=Zv8NmgcAGD1uOzbr6UTzTkQCk0rWuJj+nAWD3HaajKwqMlTNkSdiCwx5DyZ2/ali+z QSTQeUPbUdhepBNSQGJH3jj8wQBdMM2Vcdi66v2LjaWdhj+VF/+kRLxE2uNhfm+MpciH WRzYWgDH5pVem4zIgeyqKrT8GX5MgBkt42CmcJZkAS4wruxLVjQ5CQlX3I+UP1Woex2R C3z6OQd+NXEEgrQ8fvGvqqj5xyELPzpm/ueLuUlsTgVcFG4NdoUmfbYKLLGPEaMHfUG+ gy/O3ZS4rHqU07kZ5bWyF+QiceXDSGrHvj4pkC+m5hI/XU5JtA7KK7bDEXPkmkpNS9td IiYA== MIME-Version: 1.0 X-Received: by 10.58.96.15 with SMTP id do15mr68063veb.56.1385899500272; Sun, 01 Dec 2013 04:05:00 -0800 (PST) Received: by 10.58.19.97 with HTTP; Sun, 1 Dec 2013 04:05:00 -0800 (PST) Date: Sun, 1 Dec 2013 10:05:00 -0200 Message-ID: From: Rafael Weingartner To: xen-users@lists.xen.org Subject: [Xen-users] SR_BACKEND_FAILURE_40 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============7639952631493275012==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============7639952631493275012== Content-Type: multipart/alternative; boundary=089e0122f5d468807804ec77df8b --089e0122f5d468807804ec77df8b Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi all, I am getting this annoying "SR_BACKEND_FAILURE_40", have any of you seen some error like this before? I found a post here: http://discussions.citrix.com/topic/283705-internal-error-when-scanning-sr/ But, following those steps did not work out to me. I am using XCP 1.6 over, hen hypervisor 4.1.1 on Ubuntu 12.10. And as the management tool, I am using Cloudstack 4.1.1. The error started when I tried to create a template from a VM image, I guess something went wrong at the time that Cloudstack was copying the VHDs. Would you have any ideas in how to work this around? -- Rafael Weing=E4rtner --089e0122f5d468807804ec77df8b Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi all,

I am getting this annoying "SR_BACKEN= D_FAILURE_40", have any of you seen some error like this before?=A0I found a post here:

But, following those steps did not work out to me.=A0
I am using XCP 1.6 over, hen hypervisor 4.1.1 on Ubuntu 12.10. And= as the management tool, I am using Cloudstack 4.1.1.
The error s= tarted when I tried to create a template from a VM image, I guess something= went wrong at the time that Cloudstack was copying the VHDs.=A0
Would you have any ideas in how to work this around?

=A0--
=
Rafael Weing=E4rtner
--089e0122f5d468807804ec77df8b-- --===============7639952631493275012== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============7639952631493275012==-- From xen-users-bounces@lists.xen.org Sun Dec 01 12:06:09 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 01 Dec 2013 12:06:09 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vn5lo-0001c7-9r; Sun, 01 Dec 2013 12:05:04 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vn5ln-0001c2-3k for xen-users@lists.xen.org; Sun, 01 Dec 2013 12:05:03 +0000 Received: from [193.109.254.147:59165] by server-13.bemta-14.messagelabs.com id 3A/43-19374-EE52B925; Sun, 01 Dec 2013 12:05:02 +0000 X-Env-Sender: rafaelweingartner@gmail.com X-Msg-Ref: server-12.tower-27.messagelabs.com!1385899500!1963691!1 X-Originating-IP: [209.85.220.175] X-SpamReason: No, hits=1.2 required=7.0 tests=HTML_20_30,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 31866 invoked from network); 1 Dec 2013 12:05:01 -0000 Received: from mail-vc0-f175.google.com (HELO mail-vc0-f175.google.com) (209.85.220.175) by server-12.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 1 Dec 2013 12:05:01 -0000 Received: by mail-vc0-f175.google.com with SMTP id ld13so7539125vcb.6 for ; Sun, 01 Dec 2013 04:05:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=1kCybtI7IiUeSwV8IsNfDiLlm5NChHnojf3aliaQwqM=; b=Zv8NmgcAGD1uOzbr6UTzTkQCk0rWuJj+nAWD3HaajKwqMlTNkSdiCwx5DyZ2/ali+z QSTQeUPbUdhepBNSQGJH3jj8wQBdMM2Vcdi66v2LjaWdhj+VF/+kRLxE2uNhfm+MpciH WRzYWgDH5pVem4zIgeyqKrT8GX5MgBkt42CmcJZkAS4wruxLVjQ5CQlX3I+UP1Woex2R C3z6OQd+NXEEgrQ8fvGvqqj5xyELPzpm/ueLuUlsTgVcFG4NdoUmfbYKLLGPEaMHfUG+ gy/O3ZS4rHqU07kZ5bWyF+QiceXDSGrHvj4pkC+m5hI/XU5JtA7KK7bDEXPkmkpNS9td IiYA== MIME-Version: 1.0 X-Received: by 10.58.96.15 with SMTP id do15mr68063veb.56.1385899500272; Sun, 01 Dec 2013 04:05:00 -0800 (PST) Received: by 10.58.19.97 with HTTP; Sun, 1 Dec 2013 04:05:00 -0800 (PST) Date: Sun, 1 Dec 2013 10:05:00 -0200 Message-ID: From: Rafael Weingartner To: xen-users@lists.xen.org Subject: [Xen-users] SR_BACKEND_FAILURE_40 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============7639952631493275012==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============7639952631493275012== Content-Type: multipart/alternative; boundary=089e0122f5d468807804ec77df8b --089e0122f5d468807804ec77df8b Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Hi all, I am getting this annoying "SR_BACKEND_FAILURE_40", have any of you seen some error like this before? I found a post here: http://discussions.citrix.com/topic/283705-internal-error-when-scanning-sr/ But, following those steps did not work out to me. I am using XCP 1.6 over, hen hypervisor 4.1.1 on Ubuntu 12.10. And as the management tool, I am using Cloudstack 4.1.1. The error started when I tried to create a template from a VM image, I guess something went wrong at the time that Cloudstack was copying the VHDs. Would you have any ideas in how to work this around? -- Rafael Weing=E4rtner --089e0122f5d468807804ec77df8b Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi all,

I am getting this annoying "SR_BACKEN= D_FAILURE_40", have any of you seen some error like this before?=A0I found a post here:

But, following those steps did not work out to me.=A0
I am using XCP 1.6 over, hen hypervisor 4.1.1 on Ubuntu 12.10. And= as the management tool, I am using Cloudstack 4.1.1.
The error s= tarted when I tried to create a template from a VM image, I guess something= went wrong at the time that Cloudstack was copying the VHDs.=A0
Would you have any ideas in how to work this around?

=A0--
=
Rafael Weing=E4rtner
--089e0122f5d468807804ec77df8b-- --===============7639952631493275012== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============7639952631493275012==-- From xen-users-bounces@lists.xen.org Sun Dec 01 13:33:21 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 01 Dec 2013 13:33:21 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vn78A-0004k4-AB; Sun, 01 Dec 2013 13:32:14 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vn788-0004jz-Dl for xen-users@lists.xen.org; Sun, 01 Dec 2013 13:32:12 +0000 Received: from [85.158.143.35:33311] by server-3.bemta-4.messagelabs.com id CA/F3-32360-B5A3B925; Sun, 01 Dec 2013 13:32:11 +0000 X-Env-Sender: rafaelweingartner@gmail.com X-Msg-Ref: server-9.tower-21.messagelabs.com!1385904729!2405569!1 X-Originating-IP: [209.85.128.173] X-SpamReason: No, hits=0.9 required=7.0 tests=HTML_40_50,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 9237 invoked from network); 1 Dec 2013 13:32:10 -0000 Received: from mail-ve0-f173.google.com (HELO mail-ve0-f173.google.com) (209.85.128.173) by server-9.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 1 Dec 2013 13:32:10 -0000 Received: by mail-ve0-f173.google.com with SMTP id oz11so7911289veb.4 for ; Sun, 01 Dec 2013 05:32:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=uNvxGDa7GHa5q//RGNjWwU662rEru2AKgLHbjE1vNsE=; b=xkVqjMPikxvOctGLi/fAc9nbFmcN1vJK+RV2vqzSdeNRfEADnnwcs2Awqi105g2DQT v2aQgG/0F6vpHAvb5VeHMriNP4pVHLn6sBjP8RMAgO/B2RO6Wb17BeWXw1LqF14ImP4K FQ/bBnenTNt9m7LB1FoaxAwZyAy/r4PsGX0y66tqvITDVsvJvs9lJbvdE81V9Z7sa0Yd QvX3fYMW3Y7qY3gAelDyOINPoEDngW4KYb7GB3QbGsqe2c9AHglrEm34XIbcC4iCWGC0 P70hrHdCPFUsv0wFDzhEpXlEBeYH1ag/ztWAoyHenHYScVKsqtaJ7aaxnukuf0G3pGsP OQvw== MIME-Version: 1.0 X-Received: by 10.52.31.227 with SMTP id d3mr81527vdi.38.1385904729309; Sun, 01 Dec 2013 05:32:09 -0800 (PST) Received: by 10.58.19.97 with HTTP; Sun, 1 Dec 2013 05:32:09 -0800 (PST) In-Reply-To: References: Date: Sun, 1 Dec 2013 11:32:09 -0200 Message-ID: From: Rafael Weingartner To: xen-users@lists.xen.org Subject: Re: [Xen-users] SR_BACKEND_FAILURE_40 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6403512381946534405==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6403512381946534405== Content-Type: multipart/alternative; boundary=bcaec53144251545ee04ec79176b --bcaec53144251545ee04ec79176b Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Never mind, I noticed that there were some .VHDs on the NFS storage that were not being used by any VM anymore. Removing them the sr-scan worked perfectly. 2013/12/1 Rafael Weingartner > Hi all, > > I am getting this annoying "SR_BACKEND_FAILURE_40", have any of you seen > some error like this before? > I found a post here: > http://discussions.citrix.com/topic/283705-internal-error-when-scanning-s= r/ > > But, following those steps did not work out to me. > I am using XCP 1.6 over, hen hypervisor 4.1.1 on Ubuntu 12.10. And as the > management tool, I am using Cloudstack 4.1.1. > The error started when I tried to create a template from a VM image, I > guess something went wrong at the time that Cloudstack was copying the > VHDs. > Would you have any ideas in how to work this around? > > -- > Rafael Weing=E4rtner > --=20 Rafael Weing=E4rtner --bcaec53144251545ee04ec79176b Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Never mind,=A0
I noticed that there were some .VHDs on the NFS storag= e that were not being used by any VM anymore.= Removing them the sr-scan worked perfectly.<= br>


2013/12/1 Rafael Weingartner <rafaelweingartner@gmail.com= >
Hi all,

I am gettin= g this annoying "SR_BACKEND_FAILURE_40", have any of you seen som= e error like this before?=A0
I found a post here:

But, following those steps did not work out to me.=A0
I am using XCP 1.6 over, hen hypervisor 4.1.1 on Ubuntu 12.10. And= as the management tool, I am using Cloudstack 4.1.1.
The error s= tarted when I tried to create a template from a VM image, I guess something= went wrong at the time that Cloudstack was copying the VHDs.=A0
Would you have any ideas in how to work this around?

=A0--
=
Rafael Weing=E4rtner



--
Rafael Weing=E4rtner
--bcaec53144251545ee04ec79176b-- --===============6403512381946534405== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6403512381946534405==-- From xen-users-bounces@lists.xen.org Sun Dec 01 13:33:21 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 01 Dec 2013 13:33:21 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vn78A-0004k4-AB; Sun, 01 Dec 2013 13:32:14 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vn788-0004jz-Dl for xen-users@lists.xen.org; Sun, 01 Dec 2013 13:32:12 +0000 Received: from [85.158.143.35:33311] by server-3.bemta-4.messagelabs.com id CA/F3-32360-B5A3B925; Sun, 01 Dec 2013 13:32:11 +0000 X-Env-Sender: rafaelweingartner@gmail.com X-Msg-Ref: server-9.tower-21.messagelabs.com!1385904729!2405569!1 X-Originating-IP: [209.85.128.173] X-SpamReason: No, hits=0.9 required=7.0 tests=HTML_40_50,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 9237 invoked from network); 1 Dec 2013 13:32:10 -0000 Received: from mail-ve0-f173.google.com (HELO mail-ve0-f173.google.com) (209.85.128.173) by server-9.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 1 Dec 2013 13:32:10 -0000 Received: by mail-ve0-f173.google.com with SMTP id oz11so7911289veb.4 for ; Sun, 01 Dec 2013 05:32:09 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=uNvxGDa7GHa5q//RGNjWwU662rEru2AKgLHbjE1vNsE=; b=xkVqjMPikxvOctGLi/fAc9nbFmcN1vJK+RV2vqzSdeNRfEADnnwcs2Awqi105g2DQT v2aQgG/0F6vpHAvb5VeHMriNP4pVHLn6sBjP8RMAgO/B2RO6Wb17BeWXw1LqF14ImP4K FQ/bBnenTNt9m7LB1FoaxAwZyAy/r4PsGX0y66tqvITDVsvJvs9lJbvdE81V9Z7sa0Yd QvX3fYMW3Y7qY3gAelDyOINPoEDngW4KYb7GB3QbGsqe2c9AHglrEm34XIbcC4iCWGC0 P70hrHdCPFUsv0wFDzhEpXlEBeYH1ag/ztWAoyHenHYScVKsqtaJ7aaxnukuf0G3pGsP OQvw== MIME-Version: 1.0 X-Received: by 10.52.31.227 with SMTP id d3mr81527vdi.38.1385904729309; Sun, 01 Dec 2013 05:32:09 -0800 (PST) Received: by 10.58.19.97 with HTTP; Sun, 1 Dec 2013 05:32:09 -0800 (PST) In-Reply-To: References: Date: Sun, 1 Dec 2013 11:32:09 -0200 Message-ID: From: Rafael Weingartner To: xen-users@lists.xen.org Subject: Re: [Xen-users] SR_BACKEND_FAILURE_40 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6403512381946534405==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6403512381946534405== Content-Type: multipart/alternative; boundary=bcaec53144251545ee04ec79176b --bcaec53144251545ee04ec79176b Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Never mind, I noticed that there were some .VHDs on the NFS storage that were not being used by any VM anymore. Removing them the sr-scan worked perfectly. 2013/12/1 Rafael Weingartner > Hi all, > > I am getting this annoying "SR_BACKEND_FAILURE_40", have any of you seen > some error like this before? > I found a post here: > http://discussions.citrix.com/topic/283705-internal-error-when-scanning-s= r/ > > But, following those steps did not work out to me. > I am using XCP 1.6 over, hen hypervisor 4.1.1 on Ubuntu 12.10. And as the > management tool, I am using Cloudstack 4.1.1. > The error started when I tried to create a template from a VM image, I > guess something went wrong at the time that Cloudstack was copying the > VHDs. > Would you have any ideas in how to work this around? > > -- > Rafael Weing=E4rtner > --=20 Rafael Weing=E4rtner --bcaec53144251545ee04ec79176b Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Never mind,=A0
I noticed that there were some .VHDs on the NFS storag= e that were not being used by any VM anymore.= Removing them the sr-scan worked perfectly.<= br>


2013/12/1 Rafael Weingartner <rafaelweingartner@gmail.com= >
Hi all,

I am gettin= g this annoying "SR_BACKEND_FAILURE_40", have any of you seen som= e error like this before?=A0
I found a post here:

But, following those steps did not work out to me.=A0
I am using XCP 1.6 over, hen hypervisor 4.1.1 on Ubuntu 12.10. And= as the management tool, I am using Cloudstack 4.1.1.
The error s= tarted when I tried to create a template from a VM image, I guess something= went wrong at the time that Cloudstack was copying the VHDs.=A0
Would you have any ideas in how to work this around?

=A0--
=
Rafael Weing=E4rtner



--
Rafael Weing=E4rtner
--bcaec53144251545ee04ec79176b-- --===============6403512381946534405== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6403512381946534405==-- From xen-users-bounces@lists.xen.org Mon Dec 02 04:26:47 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 02 Dec 2013 04:26:47 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnL4b-0005Ce-9a; Mon, 02 Dec 2013 04:25:29 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnL4Z-0005CZ-6w for xen-users@lists.xen.org; Mon, 02 Dec 2013 04:25:27 +0000 Received: from [85.158.143.35:11452] by server-1.bemta-4.messagelabs.com id 2F/C9-02132-6BB0C925; Mon, 02 Dec 2013 04:25:26 +0000 X-Env-Sender: frank@frankwmiller.net X-Msg-Ref: server-16.tower-21.messagelabs.com!1385958325!2432166!1 X-Originating-IP: [209.17.115.57] X-SpamReason: No, hits=0.3 required=7.0 tests=HTML_60_70,HTML_MESSAGE X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 31292 invoked from network); 2 Dec 2013 04:25:25 -0000 Received: from atl4mhob17.myregisteredsite.com (HELO atl4mhob17.myregisteredsite.com) (209.17.115.57) by server-16.tower-21.messagelabs.com with SMTP; 2 Dec 2013 04:25:25 -0000 Received: from mailpod1.hostingplatform.com ([10.30.71.116]) by atl4mhob17.myregisteredsite.com (8.14.4/8.14.4) with ESMTP id rB24POas014877 for ; Sun, 1 Dec 2013 23:25:24 -0500 Received: (qmail 4285 invoked by uid 0); 2 Dec 2013 04:25:24 -0000 X-TCPREMOTEIP: 174.51.92.116 X-Authenticated-UID: frankwmiller@frankwmiller.net Received: from unknown (HELO FrankWMillerPC) (frankwmiller@frankwmiller.net@174.51.92.116) by 0 with ESMTPA; 2 Dec 2013 04:25:24 -0000 From: "Frank W. Miller" To: Date: Sun, 1 Dec 2013 21:25:23 -0700 Message-ID: MIME-Version: 1.0 X-Mailer: Microsoft Office Outlook 11 Thread-Index: Ac7vFoTmVaXESTWeRi+aH6AwGPT+0w== X-MimeOLE: Produced By Microsoft MimeOLE V6.1.7601.17609 Subject: [Xen-users] Xen on Freescale i.MX6Q X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============7980686033490429848==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a multi-part message in MIME format. --===============7980686033490429848== Content-Type: multipart/alternative; boundary="----=_NextPart_000_0044_01CEEEDB.D8F1B210" This is a multi-part message in MIME format. ------=_NextPart_000_0044_01CEEEDB.D8F1B210 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Greetings, I'm interested in getting Xen to work on a Freescale i.MX6Q ARM7 based board. I'm a little confused by the wiki. As I understand it, I'll need to use PV. However, its not clear to me whether this capability has been folded into the current code base or whether I need to look at the older code. I'm running Ubuntu 11.10. Thanks in advance for any suggestions. FM Frank W. Miller ------=_NextPart_000_0044_01CEEEDB.D8F1B210 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable
 
Greetings,
 
I'm = interested in=20 getting Xen to work on a Freescale i.MX6Q ARM7 based board.  I'm a = little=20 confused by the wiki.  As I understand it, I'll need to use = PV. =20 However, its not clear to me whether this capability has been folded = into the=20 current code base or whether I need to look at the older code.  I'm = running=20 Ubuntu 11.10.  Thanks in advance for any = suggestions.
 
FM
 
Frank = W.=20 Miller
------=_NextPart_000_0044_01CEEEDB.D8F1B210-- --===============7980686033490429848== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============7980686033490429848==-- From xen-users-bounces@lists.xen.org Mon Dec 02 04:26:47 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 02 Dec 2013 04:26:47 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnL4b-0005Ce-9a; Mon, 02 Dec 2013 04:25:29 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnL4Z-0005CZ-6w for xen-users@lists.xen.org; Mon, 02 Dec 2013 04:25:27 +0000 Received: from [85.158.143.35:11452] by server-1.bemta-4.messagelabs.com id 2F/C9-02132-6BB0C925; Mon, 02 Dec 2013 04:25:26 +0000 X-Env-Sender: frank@frankwmiller.net X-Msg-Ref: server-16.tower-21.messagelabs.com!1385958325!2432166!1 X-Originating-IP: [209.17.115.57] X-SpamReason: No, hits=0.3 required=7.0 tests=HTML_60_70,HTML_MESSAGE X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 31292 invoked from network); 2 Dec 2013 04:25:25 -0000 Received: from atl4mhob17.myregisteredsite.com (HELO atl4mhob17.myregisteredsite.com) (209.17.115.57) by server-16.tower-21.messagelabs.com with SMTP; 2 Dec 2013 04:25:25 -0000 Received: from mailpod1.hostingplatform.com ([10.30.71.116]) by atl4mhob17.myregisteredsite.com (8.14.4/8.14.4) with ESMTP id rB24POas014877 for ; Sun, 1 Dec 2013 23:25:24 -0500 Received: (qmail 4285 invoked by uid 0); 2 Dec 2013 04:25:24 -0000 X-TCPREMOTEIP: 174.51.92.116 X-Authenticated-UID: frankwmiller@frankwmiller.net Received: from unknown (HELO FrankWMillerPC) (frankwmiller@frankwmiller.net@174.51.92.116) by 0 with ESMTPA; 2 Dec 2013 04:25:24 -0000 From: "Frank W. Miller" To: Date: Sun, 1 Dec 2013 21:25:23 -0700 Message-ID: MIME-Version: 1.0 X-Mailer: Microsoft Office Outlook 11 Thread-Index: Ac7vFoTmVaXESTWeRi+aH6AwGPT+0w== X-MimeOLE: Produced By Microsoft MimeOLE V6.1.7601.17609 Subject: [Xen-users] Xen on Freescale i.MX6Q X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============7980686033490429848==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a multi-part message in MIME format. --===============7980686033490429848== Content-Type: multipart/alternative; boundary="----=_NextPart_000_0044_01CEEEDB.D8F1B210" This is a multi-part message in MIME format. ------=_NextPart_000_0044_01CEEEDB.D8F1B210 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Greetings, I'm interested in getting Xen to work on a Freescale i.MX6Q ARM7 based board. I'm a little confused by the wiki. As I understand it, I'll need to use PV. However, its not clear to me whether this capability has been folded into the current code base or whether I need to look at the older code. I'm running Ubuntu 11.10. Thanks in advance for any suggestions. FM Frank W. Miller ------=_NextPart_000_0044_01CEEEDB.D8F1B210 Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable
 
Greetings,
 
I'm = interested in=20 getting Xen to work on a Freescale i.MX6Q ARM7 based board.  I'm a = little=20 confused by the wiki.  As I understand it, I'll need to use = PV. =20 However, its not clear to me whether this capability has been folded = into the=20 current code base or whether I need to look at the older code.  I'm = running=20 Ubuntu 11.10.  Thanks in advance for any = suggestions.
 
FM
 
Frank = W.=20 Miller
------=_NextPart_000_0044_01CEEEDB.D8F1B210-- --===============7980686033490429848== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============7980686033490429848==-- From xen-users-bounces@lists.xen.org Mon Dec 02 09:34:52 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 02 Dec 2013 09:34:52 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnPsx-00081o-It; Mon, 02 Dec 2013 09:33:47 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnPsw-00081j-6v for xen-users@lists.xen.org; Mon, 02 Dec 2013 09:33:46 +0000 Received: from [85.158.143.35:46014] by server-1.bemta-4.messagelabs.com id C7/F4-02132-9F35C925; Mon, 02 Dec 2013 09:33:45 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-4.tower-21.messagelabs.com!1385976823!2579612!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11741 invoked from network); 2 Dec 2013 09:33:44 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-4.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 2 Dec 2013 09:33:44 -0000 X-IronPort-AV: E=Sophos;i="4.93,809,1378857600"; d="scan'208";a="77243237" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 02 Dec 2013 09:33:43 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL02.citrite.net (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Mon, 2 Dec 2013 04:33:42 -0500 Message-ID: <1385976821.7108.6.camel@kazak.uk.xensource.com> From: Ian Campbell To: "Frank W. Miller" Date: Mon, 2 Dec 2013 09:33:41 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA2 Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] Xen on Freescale i.MX6Q X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Sun, 2013-12-01 at 21:25 -0700, Frank W. Miller wrote: > > Greetings, > > I'm interested in getting Xen to work on a Freescale i.MX6Q ARM7 based > board. I'm a little confused by the wiki. As I understand it, I'll > need to use PV. However, its not clear to me whether this capability > has been folded into the current code base or whether I need to look > at the older code. I'm running Ubuntu 11.10. Thanks in advance for > any suggestions. The ARM support in the mainline Xen repos ("xen.git") requires the v7 hardware extensions or v8 hardware. The PV port has not been incorporated into mainline. There is very little activity around this port these days. You are extremely unlikely to get any response or input from its authors. Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 02 09:34:52 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 02 Dec 2013 09:34:52 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnPsx-00081o-It; Mon, 02 Dec 2013 09:33:47 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnPsw-00081j-6v for xen-users@lists.xen.org; Mon, 02 Dec 2013 09:33:46 +0000 Received: from [85.158.143.35:46014] by server-1.bemta-4.messagelabs.com id C7/F4-02132-9F35C925; Mon, 02 Dec 2013 09:33:45 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-4.tower-21.messagelabs.com!1385976823!2579612!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11741 invoked from network); 2 Dec 2013 09:33:44 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-4.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 2 Dec 2013 09:33:44 -0000 X-IronPort-AV: E=Sophos;i="4.93,809,1378857600"; d="scan'208";a="77243237" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 02 Dec 2013 09:33:43 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL02.citrite.net (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Mon, 2 Dec 2013 04:33:42 -0500 Message-ID: <1385976821.7108.6.camel@kazak.uk.xensource.com> From: Ian Campbell To: "Frank W. Miller" Date: Mon, 2 Dec 2013 09:33:41 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA2 Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] Xen on Freescale i.MX6Q X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Sun, 2013-12-01 at 21:25 -0700, Frank W. Miller wrote: > > Greetings, > > I'm interested in getting Xen to work on a Freescale i.MX6Q ARM7 based > board. I'm a little confused by the wiki. As I understand it, I'll > need to use PV. However, its not clear to me whether this capability > has been folded into the current code base or whether I need to look > at the older code. I'm running Ubuntu 11.10. Thanks in advance for > any suggestions. The ARM support in the mainline Xen repos ("xen.git") requires the v7 hardware extensions or v8 hardware. The PV port has not been incorporated into mainline. There is very little activity around this port these days. You are extremely unlikely to get any response or input from its authors. Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 02 09:44:37 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 02 Dec 2013 09:44:37 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnQ37-0000Go-Q0; Mon, 02 Dec 2013 09:44:17 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnQ36-0000Gf-Gj for xen-users@lists.xen.org; Mon, 02 Dec 2013 09:44:16 +0000 Received: from [193.109.254.147:16647] by server-9.bemta-14.messagelabs.com id 26/ED-13957-F665C925; Mon, 02 Dec 2013 09:44:15 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-7.tower-27.messagelabs.com!1385977453!2142736!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 2769 invoked from network); 2 Dec 2013 09:44:15 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-7.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 2 Dec 2013 09:44:15 -0000 X-IronPort-AV: E=Sophos;i="4.93,809,1378857600"; d="scan'208";a="77245815" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 02 Dec 2013 09:44:13 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL03.citrite.net (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Mon, 2 Dec 2013 04:44:12 -0500 Message-ID: <1385977452.7108.7.camel@kazak.uk.xensource.com> From: Ian Campbell To: Gabriel Queiroz Silva Date: Mon, 2 Dec 2013 09:44:12 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA2 Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] XCP 1.6 - Upgrading and hotfixing X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Fri, 2013-11-29 at 15:05 -0200, Gabriel Queiroz Silva wrote: > I am pretty much a newbie to XCP, trying to find my way around things. This list deals primarily with users of the toolstacks which ship with Xen. For XCP issues you would be better off on the xen-api@ list or one of the www.xenserver.org lists (XCP now comes under that umbrella). Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 02 09:44:37 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 02 Dec 2013 09:44:37 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnQ37-0000Go-Q0; Mon, 02 Dec 2013 09:44:17 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnQ36-0000Gf-Gj for xen-users@lists.xen.org; Mon, 02 Dec 2013 09:44:16 +0000 Received: from [193.109.254.147:16647] by server-9.bemta-14.messagelabs.com id 26/ED-13957-F665C925; Mon, 02 Dec 2013 09:44:15 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-7.tower-27.messagelabs.com!1385977453!2142736!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 2769 invoked from network); 2 Dec 2013 09:44:15 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-7.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 2 Dec 2013 09:44:15 -0000 X-IronPort-AV: E=Sophos;i="4.93,809,1378857600"; d="scan'208";a="77245815" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 02 Dec 2013 09:44:13 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL03.citrite.net (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Mon, 2 Dec 2013 04:44:12 -0500 Message-ID: <1385977452.7108.7.camel@kazak.uk.xensource.com> From: Ian Campbell To: Gabriel Queiroz Silva Date: Mon, 2 Dec 2013 09:44:12 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA2 Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] XCP 1.6 - Upgrading and hotfixing X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Fri, 2013-11-29 at 15:05 -0200, Gabriel Queiroz Silva wrote: > I am pretty much a newbie to XCP, trying to find my way around things. This list deals primarily with users of the toolstacks which ship with Xen. For XCP issues you would be better off on the xen-api@ list or one of the www.xenserver.org lists (XCP now comes under that umbrella). Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 02 17:15:21 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 02 Dec 2013 17:15:21 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnX4f-0005zG-Ci; Mon, 02 Dec 2013 17:14:21 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnX4c-0005ya-Jb; Mon, 02 Dec 2013 17:14:18 +0000 Received: from [85.158.139.211:55566] by server-10.bemta-5.messagelabs.com id 88/21-01405-9EFBC925; Mon, 02 Dec 2013 17:14:17 +0000 X-Env-Sender: iwj@xenbits.xen.org X-Msg-Ref: server-13.tower-206.messagelabs.com!1386004455!1718903!1 X-Originating-IP: [50.57.168.107] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 3742 invoked from network); 2 Dec 2013 17:14:16 -0000 Received: from mail.xen.org (HELO mail.xen.org) (50.57.168.107) by server-13.tower-206.messagelabs.com with AES256-SHA encrypted SMTP; 2 Dec 2013 17:14:16 -0000 Received: from xenbits.xen.org ([50.57.170.242]) by mail.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnX4T-0006cM-FN; Mon, 02 Dec 2013 17:14:09 +0000 Received: from iwj by xenbits.xen.org with local (Exim 4.72) (envelope-from ) id 1VnX4T-0000AR-1P; Mon, 02 Dec 2013 17:14:09 +0000 Date: Mon, 02 Dec 2013 17:14:09 +0000 Message-Id: Content-Type: multipart/mixed; boundary="=separator"; charset="utf-8" Content-Transfer-Encoding: binary MIME-Version: 1.0 X-Mailer: MIME-tools 5.428 (Entity 5.428) To: xen-announce@lists.xen.org, xen-devel@lists.xen.org, xen-users@lists.xen.org, oss-security@lists.openwall.com From: Xen.org security team Cc: "Xen.org security team" Subject: [Xen-users] Xen Security Advisory 82 (CVE-2013-6885) - Guest triggerable AMD CPU erratum may cause host hang X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --=separator Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Xen Security Advisory CVE-2013-6885 / XSA-82 version 3 Guest triggerable AMD CPU erratum may cause host hang UPDATES IN VERSION 3 ==================== Early public release. This issue was predisclosed under embargo by the Xen Project Security team, on the 27th of November. We treated the issue as not publicly known because it was not evident from the public sources that this erratum constitutes a vulnerability (particularly, that it was a vulnerability in relation to some Xen configurations). Since then, the fact that this CPU erratum is likely to constitute a security problem has been publicly disclosed, on the oss-security mailing list. Under the circumstances, and in accordance with the Xen Project security vulnerability policy, it has been decided that it is no longer appropriate to retain the embargo, as the key facts are now in the open. ISSUE DESCRIPTION ================= AMD CPU erratum 793 "Specific Combination of Writes to Write Combined Memory Types and Locked Instructions May Cause Core Hang" describes a situation under which a CPU core may hang. IMPACT ====== A malicious guest administrator can mount a denial of service attack affecting the whole system. VULNERABLE SYSTEMS ================== The vulnerability is applicable only to family 16h model 00h-0fh AMD CPUs. Such CPUs running Xen versions 3.3 onwards are vulnerable. We have not checked earlier versions of Xen. HVM guests can always exploit the vulnerability if it is present. PV guests can exploit the vulnerability only if they have been granted access to physical device(s). Non-AMD CPUs are not vulnerable. CREDITS ======= This issue's security impact was discovered by Jan Beulich. MITIGATION ========== This issue can be avoided by neither running HVM guests, nor assigning PCI devices to PV guests. RESOLUTION ========== The attached patch contains a software workaround which resolves this issue. Alternatively, the recommended workaround can be implemented in firmware, so a suitable firmware update will resolve the issue. If you require a firmware update please consult your vendor. xsa82.patch Xen 4.1.x, Xen 4.2.x, Xen 4.3.x, xen-unstable $ sha256sum xsa82*.patch 0a58f3564ca91fd2668c202446c607fdb1ec8643e558a3921046d43675f58c08 xsa82.patch $ -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) iQEcBAEBAgAGBQJSnL+JAAoJEIP+FMlX6CvZw6gIAKqUkevFcn14iRT7g6iiTjbw Fq9oiu/RtSmPDS/8FkAW6vdhYTe5cA6wCxUbErp/oZ6IwtlAmbZUQ2oVrfw8Tep/ G1hpLDkGLeRD4sqPB3Yj/RS8MUWlZhX3H9FwJLzhDqFaGiVAOHe3zl/OgwMFEnUx PYSxdgPeiU3gavpJcDd5JamID+wLkihXMOHFKtdziOZsEAuv2lhIBSCamOVc638m vRMtE4LbcUCv80EvvMxtrUDkt+M+TS2JfQK+09mr5/hFkyicoeEawYLgeWUbuNhj CWbcKdyat6GauvhL46NE/aWlbUqSXHc8jcIdCDM2pRK1NR86qJiMC5av5EcPjOo= =V/Az -----END PGP SIGNATURE----- --=separator Content-Type: application/octet-stream; name="xsa82.patch" Content-Disposition: attachment; filename="xsa82.patch" Content-Transfer-Encoding: base64 eDg2L0FNRDogd29yayBhcm91bmQgZXJyYXR1bSA3OTMKClRoZSByZWNvbW1l bmRhdGlvbiBpcyB0byBzZXQgYSBiaXQgaW4gYW4gTVNSIC0gZG8gdGhpcyBp ZiB0aGUgZmlybXdhcmUKZGlkbid0LCBjb25zaWRlcmluZyB0aGF0IG90aGVy d2lzZSB3ZSBleHBvc2Ugb3Vyc2VsdmVzIHRvIGEgZ3Vlc3QKaW5kdWNlZCBE b1MuCgpUaGlzIGlzIENWRS0yMDEzLTY4ODUgLyBYU0EtODIuCgpTaWduZWQt b2ZmLWJ5OiBKYW4gQmV1bGljaCA8amJldWxpY2hAc3VzZS5jb20+CkFja2Vk LWJ5OiBTdXJhdmVlIFN1dGhpa3VscGFuaXQgPHN1cmF2ZWUuc3V0aGlrdWxw YW5pdEBhbWQuY29tPgoKLS0tIGEveGVuL2FyY2gveDg2L2NwdS9hbWQuYwor KysgYi94ZW4vYXJjaC94ODYvY3B1L2FtZC5jCkBAIC00NzYsNiArNDc2LDIw IEBAIHN0YXRpYyB2b2lkIF9fZGV2aW5pdCBpbml0X2FtZChzdHJ1Y3QgY3AK IAkJICAgICAgICIqKiogUGFzcyBcImFsbG93X3Vuc2FmZVwiIGlmIHlvdSdy ZSB0cnVzdGluZyIKIAkJICAgICAgICIgYWxsIHlvdXIgKFBWKSBndWVzdCBr ZXJuZWxzLiAqKipcbiIpOwogCisJaWYgKGMtPng4NiA9PSAweDE2ICYmIGMt Png4Nl9tb2RlbCA8PSAweGYpIHsKKwkJcmRtc3JsKE1TUl9BTUQ2NF9MU19D RkcsIHZhbHVlKTsKKwkJaWYgKCEodmFsdWUgJiAoMSA8PCAxNSkpKSB7CisJ CQlzdGF0aWMgYm9vbF90IHdhcm5lZDsKKworCQkJaWYgKGMgPT0gJmJvb3Rf Y3B1X2RhdGEgfHwgb3B0X2NwdV9pbmZvIHx8CisJCQkgICAgIXRlc3RfYW5k X3NldF9ib29sKHdhcm5lZCkpCisJCQkJcHJpbnRrKEtFUk5fV0FSTklORwor CQkJCSAgICAgICAiQ1BVJXU6IEFwcGx5aW5nIHdvcmthcm91bmQgZm9yIGVy cmF0dW0gNzkzXG4iLAorCQkJCSAgICAgICBzbXBfcHJvY2Vzc29yX2lkKCkp OworCQkJd3Jtc3JsKE1TUl9BTUQ2NF9MU19DRkcsIHZhbHVlIHwgKDEgPDwg MTUpKTsKKwkJfQorCX0KKwogCS8qIEFNRCBDUFVzIGRvIG5vdCBzdXBwb3J0 IFNZU0VOVEVSIG91dHNpZGUgb2YgbGVnYWN5IG1vZGUuICovCiAJY2xlYXJf Yml0KFg4Nl9GRUFUVVJFX1NFUCwgYy0+eDg2X2NhcGFiaWxpdHkpOwogCi0t LSBhL3hlbi9pbmNsdWRlL2FzbS14ODYvbXNyLWluZGV4LmgKKysrIGIveGVu L2luY2x1ZGUvYXNtLXg4Ni9tc3ItaW5kZXguaApAQCAtMjEzLDYgKzIxMyw3 IEBACiAKIC8qIEFNRDY0IE1TUnMgKi8KICNkZWZpbmUgTVNSX0FNRDY0X05C X0NGRwkJMHhjMDAxMDAxZgorI2RlZmluZSBNU1JfQU1ENjRfTFNfQ0ZHCQkw eGMwMDExMDIwCiAjZGVmaW5lIE1TUl9BTUQ2NF9JQ19DRkcJCTB4YzAwMTEw MjEKICNkZWZpbmUgTVNSX0FNRDY0X0RDX0NGRwkJMHhjMDAxMTAyMgogI2Rl ZmluZSBBTUQ2NF9OQl9DRkdfQ0Y4X0VYVF9FTkFCTEVfQklUCTQ2Cg== --=separator Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --=separator-- From xen-users-bounces@lists.xen.org Mon Dec 02 17:15:21 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 02 Dec 2013 17:15:21 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnX4f-0005zG-Ci; Mon, 02 Dec 2013 17:14:21 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnX4c-0005ya-Jb; Mon, 02 Dec 2013 17:14:18 +0000 Received: from [85.158.139.211:55566] by server-10.bemta-5.messagelabs.com id 88/21-01405-9EFBC925; Mon, 02 Dec 2013 17:14:17 +0000 X-Env-Sender: iwj@xenbits.xen.org X-Msg-Ref: server-13.tower-206.messagelabs.com!1386004455!1718903!1 X-Originating-IP: [50.57.168.107] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 3742 invoked from network); 2 Dec 2013 17:14:16 -0000 Received: from mail.xen.org (HELO mail.xen.org) (50.57.168.107) by server-13.tower-206.messagelabs.com with AES256-SHA encrypted SMTP; 2 Dec 2013 17:14:16 -0000 Received: from xenbits.xen.org ([50.57.170.242]) by mail.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnX4T-0006cM-FN; Mon, 02 Dec 2013 17:14:09 +0000 Received: from iwj by xenbits.xen.org with local (Exim 4.72) (envelope-from ) id 1VnX4T-0000AR-1P; Mon, 02 Dec 2013 17:14:09 +0000 Date: Mon, 02 Dec 2013 17:14:09 +0000 Message-Id: Content-Type: multipart/mixed; boundary="=separator"; charset="utf-8" Content-Transfer-Encoding: binary MIME-Version: 1.0 X-Mailer: MIME-tools 5.428 (Entity 5.428) To: xen-announce@lists.xen.org, xen-devel@lists.xen.org, xen-users@lists.xen.org, oss-security@lists.openwall.com From: Xen.org security team Cc: "Xen.org security team" Subject: [Xen-users] Xen Security Advisory 82 (CVE-2013-6885) - Guest triggerable AMD CPU erratum may cause host hang X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --=separator Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Xen Security Advisory CVE-2013-6885 / XSA-82 version 3 Guest triggerable AMD CPU erratum may cause host hang UPDATES IN VERSION 3 ==================== Early public release. This issue was predisclosed under embargo by the Xen Project Security team, on the 27th of November. We treated the issue as not publicly known because it was not evident from the public sources that this erratum constitutes a vulnerability (particularly, that it was a vulnerability in relation to some Xen configurations). Since then, the fact that this CPU erratum is likely to constitute a security problem has been publicly disclosed, on the oss-security mailing list. Under the circumstances, and in accordance with the Xen Project security vulnerability policy, it has been decided that it is no longer appropriate to retain the embargo, as the key facts are now in the open. ISSUE DESCRIPTION ================= AMD CPU erratum 793 "Specific Combination of Writes to Write Combined Memory Types and Locked Instructions May Cause Core Hang" describes a situation under which a CPU core may hang. IMPACT ====== A malicious guest administrator can mount a denial of service attack affecting the whole system. VULNERABLE SYSTEMS ================== The vulnerability is applicable only to family 16h model 00h-0fh AMD CPUs. Such CPUs running Xen versions 3.3 onwards are vulnerable. We have not checked earlier versions of Xen. HVM guests can always exploit the vulnerability if it is present. PV guests can exploit the vulnerability only if they have been granted access to physical device(s). Non-AMD CPUs are not vulnerable. CREDITS ======= This issue's security impact was discovered by Jan Beulich. MITIGATION ========== This issue can be avoided by neither running HVM guests, nor assigning PCI devices to PV guests. RESOLUTION ========== The attached patch contains a software workaround which resolves this issue. Alternatively, the recommended workaround can be implemented in firmware, so a suitable firmware update will resolve the issue. If you require a firmware update please consult your vendor. xsa82.patch Xen 4.1.x, Xen 4.2.x, Xen 4.3.x, xen-unstable $ sha256sum xsa82*.patch 0a58f3564ca91fd2668c202446c607fdb1ec8643e558a3921046d43675f58c08 xsa82.patch $ -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) iQEcBAEBAgAGBQJSnL+JAAoJEIP+FMlX6CvZw6gIAKqUkevFcn14iRT7g6iiTjbw Fq9oiu/RtSmPDS/8FkAW6vdhYTe5cA6wCxUbErp/oZ6IwtlAmbZUQ2oVrfw8Tep/ G1hpLDkGLeRD4sqPB3Yj/RS8MUWlZhX3H9FwJLzhDqFaGiVAOHe3zl/OgwMFEnUx PYSxdgPeiU3gavpJcDd5JamID+wLkihXMOHFKtdziOZsEAuv2lhIBSCamOVc638m vRMtE4LbcUCv80EvvMxtrUDkt+M+TS2JfQK+09mr5/hFkyicoeEawYLgeWUbuNhj CWbcKdyat6GauvhL46NE/aWlbUqSXHc8jcIdCDM2pRK1NR86qJiMC5av5EcPjOo= =V/Az -----END PGP SIGNATURE----- --=separator Content-Type: application/octet-stream; name="xsa82.patch" Content-Disposition: attachment; filename="xsa82.patch" Content-Transfer-Encoding: base64 eDg2L0FNRDogd29yayBhcm91bmQgZXJyYXR1bSA3OTMKClRoZSByZWNvbW1l bmRhdGlvbiBpcyB0byBzZXQgYSBiaXQgaW4gYW4gTVNSIC0gZG8gdGhpcyBp ZiB0aGUgZmlybXdhcmUKZGlkbid0LCBjb25zaWRlcmluZyB0aGF0IG90aGVy d2lzZSB3ZSBleHBvc2Ugb3Vyc2VsdmVzIHRvIGEgZ3Vlc3QKaW5kdWNlZCBE b1MuCgpUaGlzIGlzIENWRS0yMDEzLTY4ODUgLyBYU0EtODIuCgpTaWduZWQt b2ZmLWJ5OiBKYW4gQmV1bGljaCA8amJldWxpY2hAc3VzZS5jb20+CkFja2Vk LWJ5OiBTdXJhdmVlIFN1dGhpa3VscGFuaXQgPHN1cmF2ZWUuc3V0aGlrdWxw YW5pdEBhbWQuY29tPgoKLS0tIGEveGVuL2FyY2gveDg2L2NwdS9hbWQuYwor KysgYi94ZW4vYXJjaC94ODYvY3B1L2FtZC5jCkBAIC00NzYsNiArNDc2LDIw IEBAIHN0YXRpYyB2b2lkIF9fZGV2aW5pdCBpbml0X2FtZChzdHJ1Y3QgY3AK IAkJICAgICAgICIqKiogUGFzcyBcImFsbG93X3Vuc2FmZVwiIGlmIHlvdSdy ZSB0cnVzdGluZyIKIAkJICAgICAgICIgYWxsIHlvdXIgKFBWKSBndWVzdCBr ZXJuZWxzLiAqKipcbiIpOwogCisJaWYgKGMtPng4NiA9PSAweDE2ICYmIGMt Png4Nl9tb2RlbCA8PSAweGYpIHsKKwkJcmRtc3JsKE1TUl9BTUQ2NF9MU19D RkcsIHZhbHVlKTsKKwkJaWYgKCEodmFsdWUgJiAoMSA8PCAxNSkpKSB7CisJ CQlzdGF0aWMgYm9vbF90IHdhcm5lZDsKKworCQkJaWYgKGMgPT0gJmJvb3Rf Y3B1X2RhdGEgfHwgb3B0X2NwdV9pbmZvIHx8CisJCQkgICAgIXRlc3RfYW5k X3NldF9ib29sKHdhcm5lZCkpCisJCQkJcHJpbnRrKEtFUk5fV0FSTklORwor CQkJCSAgICAgICAiQ1BVJXU6IEFwcGx5aW5nIHdvcmthcm91bmQgZm9yIGVy cmF0dW0gNzkzXG4iLAorCQkJCSAgICAgICBzbXBfcHJvY2Vzc29yX2lkKCkp OworCQkJd3Jtc3JsKE1TUl9BTUQ2NF9MU19DRkcsIHZhbHVlIHwgKDEgPDwg MTUpKTsKKwkJfQorCX0KKwogCS8qIEFNRCBDUFVzIGRvIG5vdCBzdXBwb3J0 IFNZU0VOVEVSIG91dHNpZGUgb2YgbGVnYWN5IG1vZGUuICovCiAJY2xlYXJf Yml0KFg4Nl9GRUFUVVJFX1NFUCwgYy0+eDg2X2NhcGFiaWxpdHkpOwogCi0t LSBhL3hlbi9pbmNsdWRlL2FzbS14ODYvbXNyLWluZGV4LmgKKysrIGIveGVu L2luY2x1ZGUvYXNtLXg4Ni9tc3ItaW5kZXguaApAQCAtMjEzLDYgKzIxMyw3 IEBACiAKIC8qIEFNRDY0IE1TUnMgKi8KICNkZWZpbmUgTVNSX0FNRDY0X05C X0NGRwkJMHhjMDAxMDAxZgorI2RlZmluZSBNU1JfQU1ENjRfTFNfQ0ZHCQkw eGMwMDExMDIwCiAjZGVmaW5lIE1TUl9BTUQ2NF9JQ19DRkcJCTB4YzAwMTEw MjEKICNkZWZpbmUgTVNSX0FNRDY0X0RDX0NGRwkJMHhjMDAxMTAyMgogI2Rl ZmluZSBBTUQ2NF9OQl9DRkdfQ0Y4X0VYVF9FTkFCTEVfQklUCTQ2Cg== --=separator Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --=separator-- From xen-users-bounces@lists.xen.org Mon Dec 02 22:51:42 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 02 Dec 2013 22:51:42 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VncK0-0005FJ-RG; Mon, 02 Dec 2013 22:50:32 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VncJz-0005FE-4k for xen-users@lists.xensource.com; Mon, 02 Dec 2013 22:50:31 +0000 Received: from [85.158.139.211:18905] by server-3.bemta-5.messagelabs.com id 2C/92-05884-6BE0D925; Mon, 02 Dec 2013 22:50:30 +0000 X-Env-Sender: arkady.me@gmail.com X-Msg-Ref: server-13.tower-206.messagelabs.com!1386024628!1770747!1 X-Originating-IP: [216.139.236.26] X-SpamReason: No, hits=0.0 required=7.0 tests=ML_RADAR_SPEW_LINKS_14, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 13727 invoked from network); 2 Dec 2013 22:50:29 -0000 Received: from sam.nabble.com (HELO sam.nabble.com) (216.139.236.26) by server-13.tower-206.messagelabs.com with AES256-SHA encrypted SMTP; 2 Dec 2013 22:50:29 -0000 Received: from [192.168.236.26] (helo=sam.nabble.com) by sam.nabble.com with esmtp (Exim 4.72) (envelope-from ) id 1VncJv-0005g1-NB for xen-users@lists.xensource.com; Mon, 02 Dec 2013 14:50:27 -0800 Date: Mon, 2 Dec 2013 14:50:27 -0800 (PST) From: RKDTOO To: xen-users@lists.xensource.com Message-ID: <1386024627643-5720205.post@n5.nabble.com> In-Reply-To: References: MIME-Version: 1.0 Subject: Re: [Xen-users] Is Xen really a Type 1 Hypervisor? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org As of ESXI VMware stoped using RedHat for the management console VM. They say now that the management is inbeded into the hypervisor and it's based on BusyBox. -- View this message in context: http://xen.1045712.n5.nabble.com/Is-Xen-really-a-Type-1-Hypervisor-tp5643400p5720205.html Sent from the Xen - User mailing list archive at Nabble.com. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 02 22:51:42 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 02 Dec 2013 22:51:42 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VncK0-0005FJ-RG; Mon, 02 Dec 2013 22:50:32 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VncJz-0005FE-4k for xen-users@lists.xensource.com; Mon, 02 Dec 2013 22:50:31 +0000 Received: from [85.158.139.211:18905] by server-3.bemta-5.messagelabs.com id 2C/92-05884-6BE0D925; Mon, 02 Dec 2013 22:50:30 +0000 X-Env-Sender: arkady.me@gmail.com X-Msg-Ref: server-13.tower-206.messagelabs.com!1386024628!1770747!1 X-Originating-IP: [216.139.236.26] X-SpamReason: No, hits=0.0 required=7.0 tests=ML_RADAR_SPEW_LINKS_14, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 13727 invoked from network); 2 Dec 2013 22:50:29 -0000 Received: from sam.nabble.com (HELO sam.nabble.com) (216.139.236.26) by server-13.tower-206.messagelabs.com with AES256-SHA encrypted SMTP; 2 Dec 2013 22:50:29 -0000 Received: from [192.168.236.26] (helo=sam.nabble.com) by sam.nabble.com with esmtp (Exim 4.72) (envelope-from ) id 1VncJv-0005g1-NB for xen-users@lists.xensource.com; Mon, 02 Dec 2013 14:50:27 -0800 Date: Mon, 2 Dec 2013 14:50:27 -0800 (PST) From: RKDTOO To: xen-users@lists.xensource.com Message-ID: <1386024627643-5720205.post@n5.nabble.com> In-Reply-To: References: MIME-Version: 1.0 Subject: Re: [Xen-users] Is Xen really a Type 1 Hypervisor? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org As of ESXI VMware stoped using RedHat for the management console VM. They say now that the management is inbeded into the hypervisor and it's based on BusyBox. -- View this message in context: http://xen.1045712.n5.nabble.com/Is-Xen-really-a-Type-1-Hypervisor-tp5643400p5720205.html Sent from the Xen - User mailing list archive at Nabble.com. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 03 11:19:13 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 03 Dec 2013 11:19:13 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnnzX-0000fr-9u; Tue, 03 Dec 2013 11:18:11 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnnzW-0000fa-40 for xen-users@lists.xen.org; Tue, 03 Dec 2013 11:18:10 +0000 Received: from [193.109.254.147:2905] by server-9.bemta-14.messagelabs.com id 41/ED-13957-1FDBD925; Tue, 03 Dec 2013 11:18:09 +0000 X-Env-Sender: klaus.mailinglists@pernau.at X-Msg-Ref: server-11.tower-27.messagelabs.com!1386069488!255869!1 X-Originating-IP: [88.198.53.113] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 8300 invoked from network); 3 Dec 2013 11:18:08 -0000 Received: from ds3000.pernau.at (HELO ds3000.pernau.at) (88.198.53.113) by server-11.tower-27.messagelabs.com with SMTP; 3 Dec 2013 11:18:08 -0000 Received: from [10.10.0.51] (nat.labs.nic.at [83.136.33.3]) by ds3000.pernau.at (Postfix) with ESMTPSA id 784451080001 for ; Tue, 3 Dec 2013 12:17:08 +0100 (CET) Message-ID: <529DBDB3.3060303@pernau.at> Date: Tue, 03 Dec 2013 12:17:07 +0100 From: Klaus Darilion User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/20130801 Thunderbird/17.0.8 MIME-Version: 1.0 To: "xen-users@lists.xen.org" Subject: [Xen-users] domU fails to reboot if disks use drbd resources X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi! dom0: Ubuntu 10.4 64bit, Xen 4.0.1, Kernel 2.6.32.24-xen, DRBD 8.3.7 domU: Ubuntu 10.4 64bit, Kernel 2.6.32-33-server I never had any issues when executing "reboot" in the domU - the domU was just rebooted. Recently I changed the domU config to use the DRBD disk handler: disk = [ - 'phy:/dev/drbd6,xvda2,w', + 'drbd:cc-stat-ha,xvda2,w', ] Startup of the domU works as expected, but when I execute "reboot" in the domU the domU either is shutdown, or hangs with "Will restart now" as last line in the console. I suspect a problem when detaching/reattaching to the DRBD device, but I didn't found any errors in syslog. Any hints are appreciated. Thanks Klaus _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 03 11:19:13 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 03 Dec 2013 11:19:13 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnnzX-0000fr-9u; Tue, 03 Dec 2013 11:18:11 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnnzW-0000fa-40 for xen-users@lists.xen.org; Tue, 03 Dec 2013 11:18:10 +0000 Received: from [193.109.254.147:2905] by server-9.bemta-14.messagelabs.com id 41/ED-13957-1FDBD925; Tue, 03 Dec 2013 11:18:09 +0000 X-Env-Sender: klaus.mailinglists@pernau.at X-Msg-Ref: server-11.tower-27.messagelabs.com!1386069488!255869!1 X-Originating-IP: [88.198.53.113] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 8300 invoked from network); 3 Dec 2013 11:18:08 -0000 Received: from ds3000.pernau.at (HELO ds3000.pernau.at) (88.198.53.113) by server-11.tower-27.messagelabs.com with SMTP; 3 Dec 2013 11:18:08 -0000 Received: from [10.10.0.51] (nat.labs.nic.at [83.136.33.3]) by ds3000.pernau.at (Postfix) with ESMTPSA id 784451080001 for ; Tue, 3 Dec 2013 12:17:08 +0100 (CET) Message-ID: <529DBDB3.3060303@pernau.at> Date: Tue, 03 Dec 2013 12:17:07 +0100 From: Klaus Darilion User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:17.0) Gecko/20130801 Thunderbird/17.0.8 MIME-Version: 1.0 To: "xen-users@lists.xen.org" Subject: [Xen-users] domU fails to reboot if disks use drbd resources X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi! dom0: Ubuntu 10.4 64bit, Xen 4.0.1, Kernel 2.6.32.24-xen, DRBD 8.3.7 domU: Ubuntu 10.4 64bit, Kernel 2.6.32-33-server I never had any issues when executing "reboot" in the domU - the domU was just rebooted. Recently I changed the domU config to use the DRBD disk handler: disk = [ - 'phy:/dev/drbd6,xvda2,w', + 'drbd:cc-stat-ha,xvda2,w', ] Startup of the domU works as expected, but when I execute "reboot" in the domU the domU either is shutdown, or hangs with "Will restart now" as last line in the console. I suspect a problem when detaching/reattaching to the DRBD device, but I didn't found any errors in syslog. Any hints are appreciated. Thanks Klaus _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 03 12:17:31 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 03 Dec 2013 12:17:31 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vnotw-0005ww-Th; Tue, 03 Dec 2013 12:16:28 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vnotv-0005wr-J8 for xen-users@lists.xensource.com; Tue, 03 Dec 2013 12:16:27 +0000 Received: from [85.158.137.68:39567] by server-10.bemta-3.messagelabs.com id 07/30-23989-A9BCD925; Tue, 03 Dec 2013 12:16:26 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-12.tower-31.messagelabs.com!1386072984!1301327!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 2302 invoked from network); 3 Dec 2013 12:16:25 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-12.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 3 Dec 2013 12:16:25 -0000 X-IronPort-AV: E=Sophos;i="4.93,817,1378857600"; d="scan'208";a="77688275" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 03 Dec 2013 12:16:07 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Tue, 3 Dec 2013 07:16:07 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1Vnotb-000266-C1; Tue, 03 Dec 2013 12:16:07 +0000 Date: Tue, 3 Dec 2013 12:16:07 +0000 From: Wei Liu To: RKDTOO Message-ID: <20131203121607.GA27492@zion.uk.xensource.com> References: <1386024627643-5720205.post@n5.nabble.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <1386024627643-5720205.post@n5.nabble.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA2 Cc: wei.liu2@citrix.com, xen-users@lists.xensource.com Subject: Re: [Xen-users] Is Xen really a Type 1 Hypervisor? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Mon, Dec 02, 2013 at 02:50:27PM -0800, RKDTOO wrote: > As of ESXI VMware stoped using RedHat for the management console VM. They say > now that the management is inbeded into the hypervisor and it's based on > BusyBox. > Sorry I am not able to get what you mean. I think you can easily find the definition of type 1 hypervisor on Wikipedia.org. http://en.wikipedia.org/wiki/Hypervisor Wei. > > > -- > View this message in context: http://xen.1045712.n5.nabble.com/Is-Xen-really-a-Type-1-Hypervisor-tp5643400p5720205.html > Sent from the Xen - User mailing list archive at Nabble.com. > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 03 12:17:31 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 03 Dec 2013 12:17:31 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vnotw-0005ww-Th; Tue, 03 Dec 2013 12:16:28 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vnotv-0005wr-J8 for xen-users@lists.xensource.com; Tue, 03 Dec 2013 12:16:27 +0000 Received: from [85.158.137.68:39567] by server-10.bemta-3.messagelabs.com id 07/30-23989-A9BCD925; Tue, 03 Dec 2013 12:16:26 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-12.tower-31.messagelabs.com!1386072984!1301327!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 2302 invoked from network); 3 Dec 2013 12:16:25 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-12.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 3 Dec 2013 12:16:25 -0000 X-IronPort-AV: E=Sophos;i="4.93,817,1378857600"; d="scan'208";a="77688275" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 03 Dec 2013 12:16:07 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Tue, 3 Dec 2013 07:16:07 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1Vnotb-000266-C1; Tue, 03 Dec 2013 12:16:07 +0000 Date: Tue, 3 Dec 2013 12:16:07 +0000 From: Wei Liu To: RKDTOO Message-ID: <20131203121607.GA27492@zion.uk.xensource.com> References: <1386024627643-5720205.post@n5.nabble.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <1386024627643-5720205.post@n5.nabble.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA2 Cc: wei.liu2@citrix.com, xen-users@lists.xensource.com Subject: Re: [Xen-users] Is Xen really a Type 1 Hypervisor? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Mon, Dec 02, 2013 at 02:50:27PM -0800, RKDTOO wrote: > As of ESXI VMware stoped using RedHat for the management console VM. They say > now that the management is inbeded into the hypervisor and it's based on > BusyBox. > Sorry I am not able to get what you mean. I think you can easily find the definition of type 1 hypervisor on Wikipedia.org. http://en.wikipedia.org/wiki/Hypervisor Wei. > > > -- > View this message in context: http://xen.1045712.n5.nabble.com/Is-Xen-really-a-Type-1-Hypervisor-tp5643400p5720205.html > Sent from the Xen - User mailing list archive at Nabble.com. > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 03 13:46:07 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 03 Dec 2013 13:46:07 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnqHh-0002Lu-IS; Tue, 03 Dec 2013 13:45:05 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnqHf-0002LY-13 for xen-users@lists.xensource.com; Tue, 03 Dec 2013 13:45:04 +0000 Received: from [85.158.143.35:12192] by server-2.bemta-4.messagelabs.com id 29/40-11386-E50ED925; Tue, 03 Dec 2013 13:45:02 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-4.tower-21.messagelabs.com!1386078300!3003638!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11648 invoked from network); 3 Dec 2013 13:45:01 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-4.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 3 Dec 2013 13:45:01 -0000 X-IronPort-AV: E=Sophos;i="4.93,818,1378857600"; d="scan'208";a="80083470" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 03 Dec 2013 13:45:00 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL01.citrite.net (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Tue, 3 Dec 2013 08:44:59 -0500 Message-ID: <1386078298.13256.32.camel@kazak.uk.xensource.com> From: Ian Campbell To: Wei Liu Date: Tue, 3 Dec 2013 13:44:58 +0000 In-Reply-To: <20131203121607.GA27492@zion.uk.xensource.com> References: <1386024627643-5720205.post@n5.nabble.com> <20131203121607.GA27492@zion.uk.xensource.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA1 Cc: RKDTOO , xen-users@lists.xensource.com Subject: Re: [Xen-users] Is Xen really a Type 1 Hypervisor? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, 2013-12-03 at 12:16 +0000, Wei Liu wrote: > On Mon, Dec 02, 2013 at 02:50:27PM -0800, RKDTOO wrote: > > As of ESXI VMware stoped using RedHat for the management console VM. They say > > now that the management is inbeded into the hypervisor and it's based on > > BusyBox. > > > > Sorry I am not able to get what you mean. I think you can easily find > the definition of type 1 hypervisor on Wikipedia.org. > > http://en.wikipedia.org/wiki/Hypervisor This thread is more than a year old, I don't think there is any need to revive it here, it is barely on topic IMHO. Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 03 13:46:07 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 03 Dec 2013 13:46:07 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnqHh-0002Lu-IS; Tue, 03 Dec 2013 13:45:05 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnqHf-0002LY-13 for xen-users@lists.xensource.com; Tue, 03 Dec 2013 13:45:04 +0000 Received: from [85.158.143.35:12192] by server-2.bemta-4.messagelabs.com id 29/40-11386-E50ED925; Tue, 03 Dec 2013 13:45:02 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-4.tower-21.messagelabs.com!1386078300!3003638!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11648 invoked from network); 3 Dec 2013 13:45:01 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-4.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 3 Dec 2013 13:45:01 -0000 X-IronPort-AV: E=Sophos;i="4.93,818,1378857600"; d="scan'208";a="80083470" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 03 Dec 2013 13:45:00 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL01.citrite.net (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Tue, 3 Dec 2013 08:44:59 -0500 Message-ID: <1386078298.13256.32.camel@kazak.uk.xensource.com> From: Ian Campbell To: Wei Liu Date: Tue, 3 Dec 2013 13:44:58 +0000 In-Reply-To: <20131203121607.GA27492@zion.uk.xensource.com> References: <1386024627643-5720205.post@n5.nabble.com> <20131203121607.GA27492@zion.uk.xensource.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA1 Cc: RKDTOO , xen-users@lists.xensource.com Subject: Re: [Xen-users] Is Xen really a Type 1 Hypervisor? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, 2013-12-03 at 12:16 +0000, Wei Liu wrote: > On Mon, Dec 02, 2013 at 02:50:27PM -0800, RKDTOO wrote: > > As of ESXI VMware stoped using RedHat for the management console VM. They say > > now that the management is inbeded into the hypervisor and it's based on > > BusyBox. > > > > Sorry I am not able to get what you mean. I think you can easily find > the definition of type 1 hypervisor on Wikipedia.org. > > http://en.wikipedia.org/wiki/Hypervisor This thread is more than a year old, I don't think there is any need to revive it here, it is barely on topic IMHO. Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 03 23:24:42 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 03 Dec 2013 23:24:42 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnzJN-0007tn-Gf; Tue, 03 Dec 2013 23:23:25 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnzJL-0007ti-2z for xen-users@lists.xen.org; Tue, 03 Dec 2013 23:23:23 +0000 Received: from [85.158.137.68:21427] by server-3.bemta-3.messagelabs.com id AB/4F-10658-AE76E925; Tue, 03 Dec 2013 23:23:22 +0000 X-Env-Sender: jhom@softlayer.com X-Msg-Ref: server-12.tower-31.messagelabs.com!1386112999!1445505!1 X-Originating-IP: [173.192.119.25] X-SpamReason: No, hits=0.0 required=7.0 tests=HTML_MESSAGE, UNPARSEABLE_RELAY X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 14901 invoked from network); 3 Dec 2013 23:23:20 -0000 Received: from mx.softlayer.com (HELO mx.softlayer.com) (173.192.119.25) by server-12.tower-31.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 3 Dec 2013 23:23:20 -0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=softlayer.com; s=ex13; h=MIME-Version:Content-Type:In-Reply-To:References:Message-ID:Date:Subject:CC:To:From; bh=n63irfrBABmRuWGcm2nS1fXZfYRpWemkQUIlyV8OZEk=; b=sXr1HTgOs1veigHYLhpEBf/+arCsKMmSERw6rfAzQFRlyIRR11wPjlEH7v1d2DQ4xPBoMoHNJQ5BwH9jZO6siqJj6Pj8Wi1HZ22wU+mI50Z8OonrJGXIjohoBbspEP6MQ3jlFNgL60smiqtRIvo7nhYAMgzGHUW8MufxUqQxIeGH7ANAzEqANw18yEfMCBgxu63ElDnU0O2/ICZa4zCqzc3KbVm2T6R2wwExWfhAb3dnmfuER+OmvdRaqkyZFR5HMLeb1+6vL7qjpBOf29B3crjAQUsuZBgXqM9r8JYWm+qhGEI8zCrLgJLANUjlz6FvHO6f5Vy59TiLYYy47GURMw==; Received: from mail.softlayer.com by mx.softlayer.com with esmtp (Exim) (envelope-from ) id 1VnzJG-0005TP-Jd; Tue, 03 Dec 2013 17:23:18 -0600 Received: from SM-CAS152.softlayer.local (172.18.18.40) by SM-TMG152.softlayer.local (172.18.18.52) with Microsoft SMTP Server (TLS) id 14.2.342.3; Tue, 3 Dec 2013 17:23:18 -0600 Received: from SM-DAG151.softlayer.local ([fe80::1588:d55b:b866:2177]) by SM-CAS152.softlayer.local ([fe80::1d67:e0d0:b649:4ab5%12]) with mapi id 14.02.0342.003; Tue, 3 Dec 2013 17:23:17 -0600 From: Joseph Hom To: Sean Lin , Ph.T Thread-Topic: [Xen-users] How can I take/revert snapshot of a VHD image Thread-Index: AQHO6nYGyFYX7Xqv9E+q4ZU+GbI2dJo4r0uAgAAH+gCACm9P0A== Date: Tue, 3 Dec 2013 23:23:18 +0000 Message-ID: <602C5EB92F9AFB4D89D11B9F5B7F13552063D251@SM-DAG151.softlayer.local> References: <52944845.7040104@gmail.com> <5295512A.3050702@gmail.com> In-Reply-To: <5295512A.3050702@gmail.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.30.176.179] MIME-Version: 1.0 Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] How can I take/revert snapshot of a VHD image X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6248874399204560382==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6248874399204560382== Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_602C5EB92F9AFB4D89D11B9F5B7F13552063D251SMDAG151softlay_" --_000_602C5EB92F9AFB4D89D11B9F5B7F13552063D251SMDAG151softlay_ Content-Type: text/plain; charset="iso-2022-jp" Content-Transfer-Encoding: quoted-printable Take two snapshots vhd-util snapshot -n child1.vhd -p parent.vhd vhd-util snapshot -n child2.vhd -p parent.vhd Use child1.vhd as your new disk. When you want to revert, you point your co= nfig to child2.vhd or rename it to child1.vhd after deleting/renaming child= 1.vhd In xenserver the parent vhd file gets renamed with a new uuid and made hidd= en. Two snapshots are made and the disk that will be used is named with the= old parent uuid. The second snapshot is the point in time. When a revert h= appens, the 1st child gets deleted, and the point in time snapshot gets ren= amed to the old parent uuid. Vhd-util can give you lineage and other attributes: vhd-util scan -m *.vhd -p vhd=3Dparent.vhd capacity=3D26843545600 size=3D2798916096 hidden=3D0 parent= =3Dnone vhd=3Dchild1.vhd capacity=3D26843545600 size=3D57344 hidden=3D0 parent= =3Dparent.vhd vhd=3Dchild2.vhd capacity=3D26843545600 size=3D57344 hidden=3D0 parent= =3Dparent.vhd From: xen-users-bounces@lists.xen.org [mailto:xen-users-bounces@lists.xen.o= rg] On Behalf Of Sean Lin Sent: Tuesday, November 26, 2013 7:56 PM To: Ph.T Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] How can I take/revert snapshot of a VHD image Aha, that is actually my post on stackoverflow. And I have talked with Thanos who offered me generous help yesterday that I= have already tried the method, but it did not work, qemu complains that "N= o bootable device found". And later I did some research, it turns out that [vhd-util snapshot] will = create a backing file chain which by now qemu does not support, so simply p= assing the snapshot to qemu would never work. And I did notice that in some product like XenServer, the backing file chai= n system seems to be working somehow, just can't figure out how.. =1B$BP2=1B(B 2013/11/27 9:27, Ph.T =1B$B> wrote: Hi there, I'm running several VMs within Xen, and now I'm trying to create/revert sna= pshots of my VMs. Along with Xen and blktap2, another utility, vhd-util is also delivered, an= d according to its description, i guess I can use it to create/revert VM sn= apshots. To create a snapshot is actually easy, I just call vhd-util snapshot -n aSnapShot.vhd -p theVMtoBackup.vhd But when it comes to reverting a snapshot, things get really annoying The "revert" command requires a mandatory argument "journal", like this: vhd-util revert -n aSnapShot.vhd -j someThingCalledJournalOfWhichIHaveCompl= etelyNoIdea And vhd-util expects some info from the journal, which means it's not some = empty file you can write logs in. But I've went through the code and the internet, still get no idea where th= is Journal comes from ?? Similar question is asked http://xen.1045712.n5.nabble.com/snapshots-with-v= hd-util-blktap2-td4639476.html but poor guy never get answered. Hope someone here could help me out!! Really appreciate it! _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users -- Americium Dream Documents "(real opportunity starts with real documentation) --_000_602C5EB92F9AFB4D89D11B9F5B7F13552063D251SMDAG151softlay_ Content-Type: text/html; charset="iso-2022-jp" Content-Transfer-Encoding: quoted-printable

Take two snapshots

 <= /p>

vhd-util snapshot -n chil= d1.vhd -p parent.vhd

vhd-util snapshot -n chil= d2.vhd -p parent.vhd

 <= /p>

Use child1.vhd as your ne= w disk. When you want to revert, you point your config to child2.vhd or ren= ame it to child1.vhd after deleting/renaming child1.vhd

 <= /p>

In xenserver the parent v= hd file gets renamed with a new uuid and made hidden. Two snapshots are mad= e and the disk that will be used is named with the old parent uuid. The second snapshot is the point in time. When a revert happens, the= 1st child gets deleted, and the point in time snapshot gets ren= amed to the old parent uuid.

 <= /p>

Vhd-util can give you lin= eage and other attributes:

 <= /p>

vhd-util scan -m *.vhd -p=

vhd=3Dparent.vhd capacity= =3D26843545600 size=3D2798916096 hidden=3D0 parent=3Dnone=

   vhd=3Dchild1= .vhd capacity=3D26843545600 size=3D57344 hidden=3D0 parent=3Dparent.vhd

   vhd=3Dchild2= .vhd capacity=3D26843545600 size=3D57344 hidden=3D0 parent=3Dparent.vhd

 <= /p>

From: xen-users-bounces@lists.xen.org [mailto:xen-users= -bounces@lists.xen.org] On Behalf Of Sean Lin
Sent: Tuesday, November 26, 2013 7:56 PM
To: Ph.T
Cc: xen-users@lists.xen.org
Subject: Re: [Xen-users] How can I take/revert snapshot of a VHD ima= ge

 

Aha, that is actually= my post on stackoverflow.

And I have talked with Thanos who offered me generous help yesterday that I= have already tried the method, but it did not work, qemu complains that &q= uot;No bootable device found".

And later I did some research, it turns out that [vhd-util snapshot]  = will create a backing file chain which by now qemu does not support, so sim= ply passing the snapshot to qemu would never work.

And I did notice that in some product like XenServer, the backing file chai= n system seems to be working somehow, just can't figure out how..

=1B$BP2=1B(B 2013/11/27 9:2= 7, Ph.T =1B$B:

this question did get a response here:

what did you think of that one?

 

On Tue, Nov 26, 2013 at 12:05 AM, Sean Lin <iamlinix@gmail.com&g= t; wrote:

Hi there,


I'm running several VMs within Xen, and now I'm trying to create= /revert snapshots of my VMs.

Along with Xen and blktap2, another utility, vhd-util is also de= livered, and according to its description, i guess I can use it to create/r= evert VM snapshots.

To create a snapshot is actually easy, I just call

vhd-=
util snapshot -n aSnapShot.vhd -p theVMtoBackup.vhd

But when it comes to reverting a snapshot, things get really ann= oying

The "revert" command requires a mandatory argument &qu= ot;journal", like this:

vhd-=
util revert -n aSnapShot.vhd -j someThingCalledJournalOfWhichIHaveCompletel=
yNoIdea

And vhd-util expects some info from the journal, which means it'= s not some empty file you can write logs in.

But I've went through the code and the internet, still get no id= ea where this Journal comes from ??

Similar question is asked http://xen.1045712.n5.nabble.com/snapshots-with-vhd-util= -blktap2-td4639476.html but poor guy never get answered.

Hope someone here could help me out!!

Really appreciate it!


_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.x= en.org/xen-users



 

--
Americium Dream Documents
"(real opportunity starts with real documentation)

 

--_000_602C5EB92F9AFB4D89D11B9F5B7F13552063D251SMDAG151softlay_-- --===============6248874399204560382== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6248874399204560382==-- From xen-users-bounces@lists.xen.org Tue Dec 03 23:24:42 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 03 Dec 2013 23:24:42 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnzJN-0007tn-Gf; Tue, 03 Dec 2013 23:23:25 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VnzJL-0007ti-2z for xen-users@lists.xen.org; Tue, 03 Dec 2013 23:23:23 +0000 Received: from [85.158.137.68:21427] by server-3.bemta-3.messagelabs.com id AB/4F-10658-AE76E925; Tue, 03 Dec 2013 23:23:22 +0000 X-Env-Sender: jhom@softlayer.com X-Msg-Ref: server-12.tower-31.messagelabs.com!1386112999!1445505!1 X-Originating-IP: [173.192.119.25] X-SpamReason: No, hits=0.0 required=7.0 tests=HTML_MESSAGE, UNPARSEABLE_RELAY X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 14901 invoked from network); 3 Dec 2013 23:23:20 -0000 Received: from mx.softlayer.com (HELO mx.softlayer.com) (173.192.119.25) by server-12.tower-31.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 3 Dec 2013 23:23:20 -0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=softlayer.com; s=ex13; h=MIME-Version:Content-Type:In-Reply-To:References:Message-ID:Date:Subject:CC:To:From; bh=n63irfrBABmRuWGcm2nS1fXZfYRpWemkQUIlyV8OZEk=; b=sXr1HTgOs1veigHYLhpEBf/+arCsKMmSERw6rfAzQFRlyIRR11wPjlEH7v1d2DQ4xPBoMoHNJQ5BwH9jZO6siqJj6Pj8Wi1HZ22wU+mI50Z8OonrJGXIjohoBbspEP6MQ3jlFNgL60smiqtRIvo7nhYAMgzGHUW8MufxUqQxIeGH7ANAzEqANw18yEfMCBgxu63ElDnU0O2/ICZa4zCqzc3KbVm2T6R2wwExWfhAb3dnmfuER+OmvdRaqkyZFR5HMLeb1+6vL7qjpBOf29B3crjAQUsuZBgXqM9r8JYWm+qhGEI8zCrLgJLANUjlz6FvHO6f5Vy59TiLYYy47GURMw==; Received: from mail.softlayer.com by mx.softlayer.com with esmtp (Exim) (envelope-from ) id 1VnzJG-0005TP-Jd; Tue, 03 Dec 2013 17:23:18 -0600 Received: from SM-CAS152.softlayer.local (172.18.18.40) by SM-TMG152.softlayer.local (172.18.18.52) with Microsoft SMTP Server (TLS) id 14.2.342.3; Tue, 3 Dec 2013 17:23:18 -0600 Received: from SM-DAG151.softlayer.local ([fe80::1588:d55b:b866:2177]) by SM-CAS152.softlayer.local ([fe80::1d67:e0d0:b649:4ab5%12]) with mapi id 14.02.0342.003; Tue, 3 Dec 2013 17:23:17 -0600 From: Joseph Hom To: Sean Lin , Ph.T Thread-Topic: [Xen-users] How can I take/revert snapshot of a VHD image Thread-Index: AQHO6nYGyFYX7Xqv9E+q4ZU+GbI2dJo4r0uAgAAH+gCACm9P0A== Date: Tue, 3 Dec 2013 23:23:18 +0000 Message-ID: <602C5EB92F9AFB4D89D11B9F5B7F13552063D251@SM-DAG151.softlayer.local> References: <52944845.7040104@gmail.com> <5295512A.3050702@gmail.com> In-Reply-To: <5295512A.3050702@gmail.com> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.30.176.179] MIME-Version: 1.0 Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] How can I take/revert snapshot of a VHD image X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6248874399204560382==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6248874399204560382== Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_602C5EB92F9AFB4D89D11B9F5B7F13552063D251SMDAG151softlay_" --_000_602C5EB92F9AFB4D89D11B9F5B7F13552063D251SMDAG151softlay_ Content-Type: text/plain; charset="iso-2022-jp" Content-Transfer-Encoding: quoted-printable Take two snapshots vhd-util snapshot -n child1.vhd -p parent.vhd vhd-util snapshot -n child2.vhd -p parent.vhd Use child1.vhd as your new disk. When you want to revert, you point your co= nfig to child2.vhd or rename it to child1.vhd after deleting/renaming child= 1.vhd In xenserver the parent vhd file gets renamed with a new uuid and made hidd= en. Two snapshots are made and the disk that will be used is named with the= old parent uuid. The second snapshot is the point in time. When a revert h= appens, the 1st child gets deleted, and the point in time snapshot gets ren= amed to the old parent uuid. Vhd-util can give you lineage and other attributes: vhd-util scan -m *.vhd -p vhd=3Dparent.vhd capacity=3D26843545600 size=3D2798916096 hidden=3D0 parent= =3Dnone vhd=3Dchild1.vhd capacity=3D26843545600 size=3D57344 hidden=3D0 parent= =3Dparent.vhd vhd=3Dchild2.vhd capacity=3D26843545600 size=3D57344 hidden=3D0 parent= =3Dparent.vhd From: xen-users-bounces@lists.xen.org [mailto:xen-users-bounces@lists.xen.o= rg] On Behalf Of Sean Lin Sent: Tuesday, November 26, 2013 7:56 PM To: Ph.T Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] How can I take/revert snapshot of a VHD image Aha, that is actually my post on stackoverflow. And I have talked with Thanos who offered me generous help yesterday that I= have already tried the method, but it did not work, qemu complains that "N= o bootable device found". And later I did some research, it turns out that [vhd-util snapshot] will = create a backing file chain which by now qemu does not support, so simply p= assing the snapshot to qemu would never work. And I did notice that in some product like XenServer, the backing file chai= n system seems to be working somehow, just can't figure out how.. =1B$BP2=1B(B 2013/11/27 9:27, Ph.T =1B$B> wrote: Hi there, I'm running several VMs within Xen, and now I'm trying to create/revert sna= pshots of my VMs. Along with Xen and blktap2, another utility, vhd-util is also delivered, an= d according to its description, i guess I can use it to create/revert VM sn= apshots. To create a snapshot is actually easy, I just call vhd-util snapshot -n aSnapShot.vhd -p theVMtoBackup.vhd But when it comes to reverting a snapshot, things get really annoying The "revert" command requires a mandatory argument "journal", like this: vhd-util revert -n aSnapShot.vhd -j someThingCalledJournalOfWhichIHaveCompl= etelyNoIdea And vhd-util expects some info from the journal, which means it's not some = empty file you can write logs in. But I've went through the code and the internet, still get no idea where th= is Journal comes from ?? Similar question is asked http://xen.1045712.n5.nabble.com/snapshots-with-v= hd-util-blktap2-td4639476.html but poor guy never get answered. Hope someone here could help me out!! Really appreciate it! _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users -- Americium Dream Documents "(real opportunity starts with real documentation) --_000_602C5EB92F9AFB4D89D11B9F5B7F13552063D251SMDAG151softlay_ Content-Type: text/html; charset="iso-2022-jp" Content-Transfer-Encoding: quoted-printable

Take two snapshots

 <= /p>

vhd-util snapshot -n chil= d1.vhd -p parent.vhd

vhd-util snapshot -n chil= d2.vhd -p parent.vhd

 <= /p>

Use child1.vhd as your ne= w disk. When you want to revert, you point your config to child2.vhd or ren= ame it to child1.vhd after deleting/renaming child1.vhd

 <= /p>

In xenserver the parent v= hd file gets renamed with a new uuid and made hidden. Two snapshots are mad= e and the disk that will be used is named with the old parent uuid. The second snapshot is the point in time. When a revert happens, the= 1st child gets deleted, and the point in time snapshot gets ren= amed to the old parent uuid.

 <= /p>

Vhd-util can give you lin= eage and other attributes:

 <= /p>

vhd-util scan -m *.vhd -p=

vhd=3Dparent.vhd capacity= =3D26843545600 size=3D2798916096 hidden=3D0 parent=3Dnone=

   vhd=3Dchild1= .vhd capacity=3D26843545600 size=3D57344 hidden=3D0 parent=3Dparent.vhd

   vhd=3Dchild2= .vhd capacity=3D26843545600 size=3D57344 hidden=3D0 parent=3Dparent.vhd

 <= /p>

From: xen-users-bounces@lists.xen.org [mailto:xen-users= -bounces@lists.xen.org] On Behalf Of Sean Lin
Sent: Tuesday, November 26, 2013 7:56 PM
To: Ph.T
Cc: xen-users@lists.xen.org
Subject: Re: [Xen-users] How can I take/revert snapshot of a VHD ima= ge

 

Aha, that is actually= my post on stackoverflow.

And I have talked with Thanos who offered me generous help yesterday that I= have already tried the method, but it did not work, qemu complains that &q= uot;No bootable device found".

And later I did some research, it turns out that [vhd-util snapshot]  = will create a backing file chain which by now qemu does not support, so sim= ply passing the snapshot to qemu would never work.

And I did notice that in some product like XenServer, the backing file chai= n system seems to be working somehow, just can't figure out how..

=1B$BP2=1B(B 2013/11/27 9:2= 7, Ph.T =1B$B:

this question did get a response here:

what did you think of that one?

 

On Tue, Nov 26, 2013 at 12:05 AM, Sean Lin <iamlinix@gmail.com&g= t; wrote:

Hi there,


I'm running several VMs within Xen, and now I'm trying to create= /revert snapshots of my VMs.

Along with Xen and blktap2, another utility, vhd-util is also de= livered, and according to its description, i guess I can use it to create/r= evert VM snapshots.

To create a snapshot is actually easy, I just call

vhd-=
util snapshot -n aSnapShot.vhd -p theVMtoBackup.vhd

But when it comes to reverting a snapshot, things get really ann= oying

The "revert" command requires a mandatory argument &qu= ot;journal", like this:

vhd-=
util revert -n aSnapShot.vhd -j someThingCalledJournalOfWhichIHaveCompletel=
yNoIdea

And vhd-util expects some info from the journal, which means it'= s not some empty file you can write logs in.

But I've went through the code and the internet, still get no id= ea where this Journal comes from ??

Similar question is asked http://xen.1045712.n5.nabble.com/snapshots-with-vhd-util= -blktap2-td4639476.html but poor guy never get answered.

Hope someone here could help me out!!

Really appreciate it!


_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.x= en.org/xen-users



 

--
Americium Dream Documents
"(real opportunity starts with real documentation)

 

--_000_602C5EB92F9AFB4D89D11B9F5B7F13552063D251SMDAG151softlay_-- --===============6248874399204560382== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6248874399204560382==-- From xen-users-bounces@lists.xen.org Wed Dec 04 01:04:40 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 04 Dec 2013 01:04:40 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vo0sQ-0000cZ-Ul; Wed, 04 Dec 2013 01:03:42 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vo0sO-0000cH-T2 for xen-users@lists.xen.org; Wed, 04 Dec 2013 01:03:41 +0000 Received: from [85.158.143.35:34656] by server-2.bemta-4.messagelabs.com id 67/E3-11386-C6F7E925; Wed, 04 Dec 2013 01:03:40 +0000 X-Env-Sender: bradleyfamily.jami@gmail.com X-Msg-Ref: server-16.tower-21.messagelabs.com!1386119016!3055299!1 X-Originating-IP: [209.85.223.176] X-SpamReason: No, hits=1.7 required=7.0 tests=BODY_RANDOM_LONG, HTML_20_30, HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14, RCVD_BY_IP, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 3531 invoked from network); 4 Dec 2013 01:03:38 -0000 Received: from mail-ie0-f176.google.com (HELO mail-ie0-f176.google.com) (209.85.223.176) by server-16.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 4 Dec 2013 01:03:38 -0000 Received: by mail-ie0-f176.google.com with SMTP id at1so24342534iec.7 for ; Tue, 03 Dec 2013 17:03:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=1EPzg0azP7nuXpNtUex8ptR42yajE29Wnh472EXYdtA=; b=I8+gIa8GzOR87q7TtfGQeemZVLyFTqicrbe+OxeeyaCNA8KtLQD0MHe6hBAL4IbZgc 0wttjqIa7HZgkehTTL/0/gzOx2ADmGTSLnJhBeJ3lD4SmWpgKffUeaHeSq/yYVZl3bYW OQUEKra8sH7IqqLV+CTSREXTzbASl1uhPR31HGRGhFFtHgOh1AROGGSiAt6UMrN8I7ew RP6xW+SfOYHlRqgb6gzv8WIYM5/UJHKx41XMjS7yEYVEdmWoXms0JEm3OUeCyiBpd95x wol0bt8GLLYDH/TBVVggD4BD7lRPM/UEu8wNVnsw1WSmAH22V2ffGiPyXh4d1jw1I1rU UXkg== MIME-Version: 1.0 X-Received: by 10.43.151.12 with SMTP id kq12mr4325778icc.55.1386119016661; Tue, 03 Dec 2013 17:03:36 -0800 (PST) Received: by 10.64.240.232 with HTTP; Tue, 3 Dec 2013 17:03:36 -0800 (PST) Date: Tue, 3 Dec 2013 18:03:36 -0700 Message-ID: From: Jami Bradley To: xen-users@lists.xen.org Subject: [Xen-users] I/O virtualisation disabled - ACPI issue? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============7824085491773436570==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============7824085491773436570== Content-Type: multipart/alternative; boundary=001a11c2f8b89acff604ecaafb00 --001a11c2f8b89acff604ecaafb00 Content-Type: text/plain; charset=ISO-8859-1 I just started using Xen and am trying to come up to speed. I am trying to configure a desktop PC to boot Xen, then passthrough VGA, Keyboard, and Mouse to a VM for development. I have a Win7 DomU working beautifully without the passthrough, so I have the basics working. Here is my configuration (please let me know if I missed something important): ASUS P9X79 Pro motherboard, current BIOS, with VT-D enabled. Intel I7-4930K processor I installed CentOS 6.5 minimal for Dom0, plus a couple packages to get things working (e.g., Perl). I have xend turned off and I am trying to do everything using the XL toolkit. I have installed Xen 4.2.3 stable and have built and installed the current head from GIT (post 4.3.1) with identical results. After some debugging, I believe it is failing to parse the ACPI table (acpi_drhd_units is empty in intel_vtd_setup) and disabling IOMMU. Any tips on how to proceed? Thanks! Here is xl info: host : r4 release : 3.10.20-11.el6.centos.alt.x86_64 version : #1 SMP Sat Nov 23 23:08:56 UTC 2013 machine : x86_64 nr_cpus : 12 max_cpu_id : 11 nr_nodes : 1 cores_per_socket : 6 threads_per_core : 2 cpu_mhz : 3400 hw_caps : bfebfbff:2c100800:00000000:00007f00:77bee3bf:00000000:00000001:00000281 virt_caps : hvm total_memory : 65477 free_memory : 63740 sharing_freed_memory : 0 sharing_used_memory : 0 outstanding_claims : 0 free_cpus : 0 xen_major : 4 xen_minor : 4 xen_extra : -unstable xen_version : 4.4-unstable xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 xen_scheduler : credit xen_pagesize : 4096 platform_params : virt_start=0xffff800000000000 xen_changeset : Mon Nov 25 11:20:06 2013 +0100 git:e439e0b-dirty xen_commandline : dom0_mem=1024M,max:1024M loglvl=all guest_loglvl=all iommu=on,verbose acpi=verbose apic=bigsmp,verbose apic_verbosity=debug cc_compiler : gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-4) cc_compile_by : root cc_compile_domain : (none) cc_compile_date : Mon Dec 2 22:36:29 MST 2013 xend_config_format : 4 Here is my current grub.conf: default=0 timeout=5 splashimage=(hd0,0)/grub/splash.xpm.gz hiddenmenu title CentOS (3.10.20-11.el6.centos.alt.x86_64) root (hd0,0) kernel /xen.gz dom0_mem=1024M,max:1024M loglvl=all guest_loglvl=all iommu=on,verbose acpi=verbose apic=bigsmp,verbose apic_verbosity=debug module /vmlinuz-3.10.20-11.el6.centos.alt.x86_64 ro root=UUID=65dee24c-3094-49aa-b64c-2859e964052f rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD SYSFONT=latarcyrheb-sun16 crashkernel=auto KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rhgb quiet xen-pciback.hide=(01:00.0)(01:00.1) module /initramfs-3.10.20-11.el6.centos.alt.x86_64.img And finally the rather verbose xl dmesg: (XEN) Xen version 4.4-unstable (root@(none)) (gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-4)) debug=y Mon Dec 2 22:36:29 MST 2013 (XEN) Latest ChangeSet: Mon Nov 25 11:20:06 2013 +0100 git:e439e0b-dirty (XEN) Bootloader: GNU GRUB 0.97 (XEN) Command line: dom0_mem=1024M,max:1024M loglvl=all guest_loglvl=all iommu=on,verbose acpi=verbose apic=bigsmp,verbose apic_verbosity=debug (XEN) Video information: (XEN) VGA is text mode 80x25, font 8x16 (XEN) VBE/DDC methods: V2; EDID transfer time: 1 seconds (XEN) Disc information: (XEN) Found 2 MBR signatures (XEN) Found 2 EDD information structures (XEN) Xen-e820 RAM map: (XEN) 0000000000000000 - 000000000009e800 (usable) (XEN) 000000000009e800 - 00000000000a0000 (reserved) (XEN) 00000000000e0000 - 0000000000100000 (reserved) (XEN) 0000000000100000 - 00000000cc15f000 (usable) (XEN) 00000000cc15f000 - 00000000cc445000 (reserved) (XEN) 00000000cc445000 - 00000000cc553000 (ACPI data) (XEN) 00000000cc553000 - 00000000cc777000 (ACPI NVS) (XEN) 00000000cc777000 - 00000000cd721000 (reserved) (XEN) 00000000cd721000 - 00000000cd722000 (usable) (XEN) 00000000cd722000 - 00000000cd7a8000 (ACPI NVS) (XEN) 00000000cd7a8000 - 00000000cdbe8000 (usable) (XEN) 00000000cdbe8000 - 00000000cdff4000 (reserved) (XEN) 00000000cdff4000 - 00000000ce000000 (usable) (XEN) 00000000e0000000 - 00000000f0000000 (reserved) (XEN) 00000000fed1c000 - 00000000fed20000 (reserved) (XEN) 00000000ff000000 - 0000000100000000 (reserved) (XEN) 0000000100000000 - 0000001030000000 (usable) (XEN) ACPI: RSDP 000F0490, 0024 (r2 ALASKA) (XEN) ACPI: XSDT CC47B070, 005C (r1 ALASKA A M I 1072009 AMI 10013) (XEN) ACPI: FACP CC485108, 010C (r5 ALASKA A M I 1072009 AMI 10013) (XEN) ACPI: DSDT CC47B168, 9F9A (r2 ALASKA A M I 16 INTL 20051117) (XEN) ACPI: FACS CC76E080, 0040 (XEN) ACPI: APIC CC485218, 0100 (r3 ALASKA A M I 1072009 AMI 10013) (XEN) ACPI: FPDT CC485318, 0044 (r1 ALASKA A M I 1072009 AMI 10013) (XEN) ACPI: MCFG CC485360, 003C (r1 ALASKA OEMMCFG. 1072009 MSFT 97) (XEN) ACPI: HPET CC4853A0, 0038 (r1 ALASKA A M I 1072009 AMI. 5) (XEN) ACPI: BGRT CC552558, 0038 (r0 ALASKA A M I 1072009 AMI 10013) (XEN) ACPI: SSDT CC485430, CD128 (r2 INTEL CpuPm 4000 INTL 20051117) (XEN) System RAM: 65477MB (67048744kB) (XEN) No NUMA configuration found (XEN) Faking a node at 0000000000000000-0000001030000000 (XEN) Domain heap initialised (XEN) found SMP MP-table at 000fd8b0 (XEN) DMI 2.7 present. (XEN) APIC boot state is 'xapic' (XEN) Using APIC driver default (XEN) ACPI: PM-Timer IO Port: 0x408 (XEN) ACPI: v5 SLEEP INFO: control[0:0], status[0:0] (XEN) ACPI: SLEEP INFO: pm1x_cnt[404,0], pm1x_evt[400,0] (XEN) ACPI: 32/64X FACS address mismatch in FADT - cc76e080/0000000000000000, using 32 (XEN) ACPI: wakeup_vec[cc76e08c], vec_size[20] (XEN) ACPI: Local APIC address 0xfee00000 (XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) (XEN) Processor #0 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) (XEN) Processor #2 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] enabled) (XEN) Processor #4 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled) (XEN) Processor #6 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x08] enabled) (XEN) Processor #8 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x0a] enabled) (XEN) Processor #10 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) (XEN) Processor #1 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled) (XEN) Processor #3 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] enabled) (XEN) Processor #5 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled) (XEN) Processor #7 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x09] enabled) (XEN) Processor #9 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x0b] enabled) (XEN) Processor #11 7:14 APIC version 21 (XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x0a] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x09] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x0b] high edge lint[0x1]) (XEN) Overriding APIC driver with bigsmp (XEN) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) (XEN) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23 (XEN) ACPI: IOAPIC (id[0x02] address[0xfec01000] gsi_base[24]) (XEN) IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) (XEN) ACPI: IRQ0 used by override. (XEN) ACPI: IRQ2 used by override. (XEN) ACPI: IRQ9 used by override. (XEN) Enabling APIC mode: Phys. Using 2 I/O APICs (XEN) ACPI: HPET id: 0x8086a701 base: 0xfed00000 (XEN) ERST table was not found (XEN) Using ACPI (MADT) for SMP configuration information (XEN) SMP: Allowing 12 CPUs (0 hotplug CPUs) (XEN) mapped APIC to ffff82cfffdfb000 (fee00000) (XEN) mapped IOAPIC to ffff82cfffdfa000 (fec00000) (XEN) mapped IOAPIC to ffff82cfffdf9000 (fec01000) (XEN) IRQ limits: 48 GSI, 2272 MSI/MSI-X (XEN) Not enabling x2APIC: depends on iommu_supports_eim. (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Detected 3400.165 MHz processor. (XEN) Initing memory sharing. (XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7 (XEN) mce_intel.c:717: MCA Capability: BCAST 1 SER 0 CMCI 1 firstbank 0 extended MCE MSR 0 (XEN) Intel machine check reporting enabled (XEN) PCI: MCFG configuration 0: base e0000000 segment 0000 buses 00 - ff (XEN) PCI: MCFG area at e0000000 reserved in E820 (XEN) PCI: Using MCFG for segment 0000 bus 00-ff (XEN) I/O virtualisation disabled ... --001a11c2f8b89acff604ecaafb00 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
I just started using Xen and am trying to come up to speed= . =A0I am trying to configure a desktop PC to boot Xen, then passthrough VG= A, Keyboard, and Mouse to a VM for development. =A0I have a Win7 DomU worki= ng beautifully without the passthrough, so I have the basics working.

Here is my configuration (please let me know if I missed som= ething important):
ASUS P9X79 Pro motherboard, current BIOS, with= VT-D enabled.
Intel I7-4930K processor

I installed CentOS 6.5 minimal for Dom0, plus a couple packages to get thin= gs working (e.g., Perl). =A0I have xend turned off and I am trying to do ev= erything using the XL toolkit.

I have installed Xe= n 4.2.3 stable and have built and installed the current head from GIT (post= 4.3.1) with identical results.

After some debugging, I believe it is failing to parse = the ACPI table (acpi_drhd_units is empty in intel_vtd_setup) and disabling = IOMMU.

Any tips on how to proceed?

Thanks!

Here is xl info:
host =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 : r4
release =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0: 3.10.20-11.el6.centos.alt.x86_64
version= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0: #1 SMP Sat Nov 23 23:08:56 UTC 2013
machine =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0: x86_64
nr_cpus =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0: 12
max_cpu_id =A0 =A0 =A0 =A0 =A0 = =A0 : 11
nr_nodes =A0 =A0 =A0 =A0 =A0 =A0 =A0 : 1
cores= _per_socket =A0 =A0 =A0 : 6
threads_per_core =A0 =A0 =A0 : 2
cpu_mhz =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0: 3400
hw_caps =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0: bfebfbff:2c100800:00000000:00007f00:77bee3bf:0= 0000000:00000001:00000281
virt_caps =A0 =A0 =A0 =A0 =A0 =A0 =A0: = hvm
total_memory =A0 =A0 =A0 =A0 =A0 : 65477
free_memory =A0 =A0 =A0 =A0 =A0 =A0: 63740
sharing_freed_mem= ory =A0 : 0
sharing_used_memory =A0 =A0: 0
outstanding_= claims =A0 =A0 : 0
free_cpus =A0 =A0 =A0 =A0 =A0 =A0 =A0: 0
=
xen_major =A0 =A0 =A0 =A0 =A0 =A0 =A0: 4
xen_minor =A0 =A0 =A0 =A0 =A0 =A0 =A0: 4
xen_extra =A0 =A0 = =A0 =A0 =A0 =A0 =A0: -unstable
xen_version =A0 =A0 =A0 =A0 =A0 = =A0: 4.4-unstable
xen_caps =A0 =A0 =A0 =A0 =A0 =A0 =A0 : xen-3.0-= x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler =A0 =A0 =A0 =A0 =A0: credit
xen_pagesize =A0 = =A0 =A0 =A0 =A0 : 4096
platform_params =A0 =A0 =A0 =A0: virt_star= t=3D0xffff800000000000
xen_changeset =A0 =A0 =A0 =A0 =A0: Mon Nov= 25 11:20:06 2013 +0100 git:e439e0b-dirty
xen_commandline =A0 =A0 =A0 =A0: dom0_mem=3D1024M,max:1024M loglvl=3Da= ll guest_loglvl=3Dall iommu=3Don,verbose acpi=3Dverbose apic=3Dbigsmp,verbo= se apic_verbosity=3Ddebug
cc_compiler =A0 =A0 =A0 =A0 =A0 =A0: gc= c (GCC) 4.4.7 20120313 (Red Hat 4.4.7-4)
cc_compile_by =A0 =A0 =A0 =A0 =A0: root
cc_compile_domain = =A0 =A0 =A0: (none)
cc_compile_date =A0 =A0 =A0 =A0: Mon Dec =A02= 22:36:29 MST 2013
xend_config_format =A0 =A0 : 4


Here is my current grub.conf:
default=3D0
timeout= =3D5
splashimage=3D(hd0,0)/grub/splash.xpm.gz
hiddenmen= u
title CentOS (3.10.20-11.el6.centos.alt.x86_64)
=A0 = =A0 =A0 =A0 root (hd0,0)
=A0 =A0 =A0 =A0 kernel /xen.gz dom0_mem=3D1024M,max:1024M loglvl=3Dall= guest_loglvl=3Dall iommu=3Don,verbose acpi=3Dverbose apic=3Dbigsmp,verbose= apic_verbosity=3Ddebug
=A0 =A0 =A0 =A0 module /vmlinuz-3.10.20-1= 1.el6.centos.alt.x86_64 ro root=3DUUID=3D65dee24c-3094-49aa-b64c-2859e96405= 2f rd_NO_LUKS rd_NO_LVM LANG=3Den_US.UTF-8 rd_NO_MD SYSFONT=3Dlatarcyrheb-s= un16 crashkernel=3Dauto =A0KEYBOARDTYPE=3Dpc KEYTABLE=3Dus rd_NO_DM rhgb qu= iet xen-pciback.hide=3D(01:00.0)(01:00.1)
=A0 =A0 =A0 =A0 module /initramfs-3.10.20-11.el6.centos.alt.x86_64.img=

And finally the rather verbose xl dmesg:

(XEN) Xen version 4.4-unstable (root@(none)) (g= cc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-4)) debug=3Dy Mon Dec =A02 22:36:29 = MST 2013
(XEN) Latest ChangeSet: Mon Nov 25 11:20:06 2013 +0100 git:e439e0b-dir= ty
(XEN) Bootloader: GNU GRUB 0.97
(XEN) Command line: = dom0_mem=3D1024M,max:1024M loglvl=3Dall guest_loglvl=3Dall iommu=3Don,verbo= se acpi=3Dverbose apic=3Dbigsmp,verbose apic_verbosity=3Ddebug
(XEN) Video information:
(XEN) =A0VGA is text mode 80x25, fo= nt 8x16
(XEN) =A0VBE/DDC methods: V2; EDID transfer time: 1 secon= ds
(XEN) Disc information:
(XEN) =A0Found 2 MBR signatu= res
(XEN) =A0Found 2 EDD information structures
(XEN) Xen-e820 R= AM map:
(XEN) =A00000000000000000 - 000000000009e800 (usable)
(XEN) =A0000000000009e800 - 00000000000a0000 (reserved)
(X= EN) =A000000000000e0000 - 0000000000100000 (reserved)
(XEN) =A00000000000100000 - 00000000cc15f000 (usable)
(XEN) = =A000000000cc15f000 - 00000000cc445000 (reserved)
(XEN) =A0000000= 00cc445000 - 00000000cc553000 (ACPI data)
(XEN) =A000000000cc5530= 00 - 00000000cc777000 (ACPI NVS)
(XEN) =A000000000cc777000 - 00000000cd721000 (reserved)
(XEN= ) =A000000000cd721000 - 00000000cd722000 (usable)
(XEN) =A0000000= 00cd722000 - 00000000cd7a8000 (ACPI NVS)
(XEN) =A000000000cd7a800= 0 - 00000000cdbe8000 (usable)
(XEN) =A000000000cdbe8000 - 00000000cdff4000 (reserved)
(XEN= ) =A000000000cdff4000 - 00000000ce000000 (usable)
(XEN) =A0000000= 00e0000000 - 00000000f0000000 (reserved)
(XEN) =A000000000fed1c00= 0 - 00000000fed20000 (reserved)
(XEN) =A000000000ff000000 - 0000000100000000 (reserved)
(XEN= ) =A00000000100000000 - 0000001030000000 (usable)
(XEN) ACPI: RSD= P 000F0490, 0024 (r2 ALASKA)
(XEN) ACPI: XSDT CC47B070, 005C (r1 = ALASKA =A0 =A0A M I =A01072009 AMI =A0 =A0 10013)
(XEN) ACPI: FACP CC485108, 010C (r5 ALASKA =A0 =A0A M I =A01072009 AMI= =A0 =A0 10013)
(XEN) ACPI: DSDT CC47B168, 9F9A (r2 ALASKA =A0 = =A0A M I =A0 =A0 =A0 16 INTL 20051117)
(XEN) ACPI: FACS CC76E080,= 0040
(XEN) ACPI: APIC CC485218, 0100 (r3 ALASKA =A0 =A0A M I =A0= 1072009 AMI =A0 =A0 10013)
(XEN) ACPI: FPDT CC485318, 0044 (r1 ALASKA =A0 =A0A M I =A01072009 AMI= =A0 =A0 10013)
(XEN) ACPI: MCFG CC485360, 003C (r1 ALASKA OEMMCF= G. =A01072009 MSFT =A0 =A0 =A0 97)
(XEN) ACPI: HPET CC4853A0, 003= 8 (r1 ALASKA =A0 =A0A M I =A01072009 AMI. =A0 =A0 =A0 =A05)
(XEN) ACPI: BGRT CC552558, 0038 (r0 ALASKA =A0 =A0A M I =A01072009 AMI= =A0 =A0 10013)
(XEN) ACPI: SSDT CC485430, CD128 (r2 =A0INTEL =A0= =A0CpuPm =A0 =A0 4000 INTL 20051117)
(XEN) System RAM: 65477MB (= 67048744kB)
(XEN) No NUMA configuration found
(XEN) Faking a node at 000= 0000000000000-0000001030000000
(XEN) Domain heap initialised
(XEN) found SMP MP-table at 000fd8b0
(XEN) DMI 2.7 present.=
(XEN) APIC boot state is 'xapic'
(XEN) Using APIC dr= iver default
(XEN) ACPI: PM-Timer IO Port: 0x408
(XEN) = ACPI: v5 SLEEP INFO: control[0:0], status[0:0]
(XEN) ACPI: SLEEP = INFO: pm1x_cnt[404,0], pm1x_evt[400,0]
(XEN) ACPI: 32/64X FACS address mismatch in FADT - cc76e080/0000000000= 000000, using 32
(XEN) ACPI: =A0 =A0 =A0 =A0 =A0 =A0 wakeup_vec[c= c76e08c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000<= /div>
(XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
(XEN) Pr= ocessor #0 7:14 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] = lapic_id[0x02] enabled)
(XEN) Processor #2 7:14 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] enabled)
(XE= N) Processor #4 7:14 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0= x06] lapic_id[0x06] enabled)
(XEN) Processor #6 7:14 APIC version= 21
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x08] enabled)
(XE= N) Processor #8 7:14 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0= x0a] lapic_id[0x0a] enabled)
(XEN) Processor #10 7:14 APIC versio= n 21
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
(XE= N) Processor #1 7:14 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0= x03] lapic_id[0x03] enabled)
(XEN) Processor #3 7:14 APIC version= 21
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] enabled)
(XE= N) Processor #5 7:14 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0= x07] lapic_id[0x07] enabled)
(XEN) Processor #7 7:14 APIC version= 21
(XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x09] enabled)
(XE= N) Processor #9 7:14 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0= x0b] lapic_id[0x0b] enabled)
(XEN) Processor #11 7:14 APIC versio= n 21
(XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
(X= EN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
(XEN) ACP= I: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
(XEN) ACPI: LAPI= C_NMI (acpi_id[0x06] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])
(X= EN) ACPI: LAPIC_NMI (acpi_id[0x0a] high edge lint[0x1])
(XEN) ACP= I: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
(XEN) ACPI: LAPI= C_NMI (acpi_id[0x03] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
(X= EN) ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
(XEN) ACP= I: LAPIC_NMI (acpi_id[0x09] high edge lint[0x1])
(XEN) ACPI: LAPI= C_NMI (acpi_id[0x0b] high edge lint[0x1])
(XEN) Overriding APIC driver with bigsmp
(XEN) ACPI: IOAPIC = (id[0x00] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_= id 0, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: IOAPIC= (id[0x02] address[0xfec01000] gsi_base[24])
(XEN) IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47<= /div>
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by = override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enab= ling APIC mode: =A0Phys. =A0Using 2 I/O APICs
(XEN) ACPI: HPET id= : 0x8086a701 base: 0xfed00000
(XEN) ERST table was not found
(XEN) Using ACPI (MADT) for S= MP configuration information
(XEN) SMP: Allowing 12 CPUs (0 hotpl= ug CPUs)
(XEN) mapped APIC to ffff82cfffdfb000 (fee00000)
(XEN) mapped IOAPIC to ffff82cfffdfa000 (fec00000)
(XEN) map= ped IOAPIC to ffff82cfffdf9000 (fec01000)
(XEN) IRQ limits: 48 GS= I, 2272 MSI/MSI-X
(XEN) Not enabling x2APIC: depends on iommu_sup= ports_eim.
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) D= etected 3400.165 MHz processor.
(XEN) Initing memory sharing.
(XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
(XEN) mce_intel.c:717: MCA Capability: BCAST 1 SER 0 CMCI 1 firstbank = 0 extended MCE MSR 0
(XEN) Intel machine check reporting enabled<= /div>
(XEN) PCI: MCFG configuration 0: base e0000000 segment 0000 buses= 00 - ff
(XEN) PCI: MCFG area at e0000000 reserved in E820
(XEN) PCI:= Using MCFG for segment 0000 bus 00-ff
(XEN) I/O virtualisation d= isabled
...


--001a11c2f8b89acff604ecaafb00-- --===============7824085491773436570== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============7824085491773436570==-- From xen-users-bounces@lists.xen.org Wed Dec 04 01:04:40 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 04 Dec 2013 01:04:40 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vo0sQ-0000cZ-Ul; Wed, 04 Dec 2013 01:03:42 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vo0sO-0000cH-T2 for xen-users@lists.xen.org; Wed, 04 Dec 2013 01:03:41 +0000 Received: from [85.158.143.35:34656] by server-2.bemta-4.messagelabs.com id 67/E3-11386-C6F7E925; Wed, 04 Dec 2013 01:03:40 +0000 X-Env-Sender: bradleyfamily.jami@gmail.com X-Msg-Ref: server-16.tower-21.messagelabs.com!1386119016!3055299!1 X-Originating-IP: [209.85.223.176] X-SpamReason: No, hits=1.7 required=7.0 tests=BODY_RANDOM_LONG, HTML_20_30, HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14, RCVD_BY_IP, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 3531 invoked from network); 4 Dec 2013 01:03:38 -0000 Received: from mail-ie0-f176.google.com (HELO mail-ie0-f176.google.com) (209.85.223.176) by server-16.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 4 Dec 2013 01:03:38 -0000 Received: by mail-ie0-f176.google.com with SMTP id at1so24342534iec.7 for ; Tue, 03 Dec 2013 17:03:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=1EPzg0azP7nuXpNtUex8ptR42yajE29Wnh472EXYdtA=; b=I8+gIa8GzOR87q7TtfGQeemZVLyFTqicrbe+OxeeyaCNA8KtLQD0MHe6hBAL4IbZgc 0wttjqIa7HZgkehTTL/0/gzOx2ADmGTSLnJhBeJ3lD4SmWpgKffUeaHeSq/yYVZl3bYW OQUEKra8sH7IqqLV+CTSREXTzbASl1uhPR31HGRGhFFtHgOh1AROGGSiAt6UMrN8I7ew RP6xW+SfOYHlRqgb6gzv8WIYM5/UJHKx41XMjS7yEYVEdmWoXms0JEm3OUeCyiBpd95x wol0bt8GLLYDH/TBVVggD4BD7lRPM/UEu8wNVnsw1WSmAH22V2ffGiPyXh4d1jw1I1rU UXkg== MIME-Version: 1.0 X-Received: by 10.43.151.12 with SMTP id kq12mr4325778icc.55.1386119016661; Tue, 03 Dec 2013 17:03:36 -0800 (PST) Received: by 10.64.240.232 with HTTP; Tue, 3 Dec 2013 17:03:36 -0800 (PST) Date: Tue, 3 Dec 2013 18:03:36 -0700 Message-ID: From: Jami Bradley To: xen-users@lists.xen.org Subject: [Xen-users] I/O virtualisation disabled - ACPI issue? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============7824085491773436570==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============7824085491773436570== Content-Type: multipart/alternative; boundary=001a11c2f8b89acff604ecaafb00 --001a11c2f8b89acff604ecaafb00 Content-Type: text/plain; charset=ISO-8859-1 I just started using Xen and am trying to come up to speed. I am trying to configure a desktop PC to boot Xen, then passthrough VGA, Keyboard, and Mouse to a VM for development. I have a Win7 DomU working beautifully without the passthrough, so I have the basics working. Here is my configuration (please let me know if I missed something important): ASUS P9X79 Pro motherboard, current BIOS, with VT-D enabled. Intel I7-4930K processor I installed CentOS 6.5 minimal for Dom0, plus a couple packages to get things working (e.g., Perl). I have xend turned off and I am trying to do everything using the XL toolkit. I have installed Xen 4.2.3 stable and have built and installed the current head from GIT (post 4.3.1) with identical results. After some debugging, I believe it is failing to parse the ACPI table (acpi_drhd_units is empty in intel_vtd_setup) and disabling IOMMU. Any tips on how to proceed? Thanks! Here is xl info: host : r4 release : 3.10.20-11.el6.centos.alt.x86_64 version : #1 SMP Sat Nov 23 23:08:56 UTC 2013 machine : x86_64 nr_cpus : 12 max_cpu_id : 11 nr_nodes : 1 cores_per_socket : 6 threads_per_core : 2 cpu_mhz : 3400 hw_caps : bfebfbff:2c100800:00000000:00007f00:77bee3bf:00000000:00000001:00000281 virt_caps : hvm total_memory : 65477 free_memory : 63740 sharing_freed_memory : 0 sharing_used_memory : 0 outstanding_claims : 0 free_cpus : 0 xen_major : 4 xen_minor : 4 xen_extra : -unstable xen_version : 4.4-unstable xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64 xen_scheduler : credit xen_pagesize : 4096 platform_params : virt_start=0xffff800000000000 xen_changeset : Mon Nov 25 11:20:06 2013 +0100 git:e439e0b-dirty xen_commandline : dom0_mem=1024M,max:1024M loglvl=all guest_loglvl=all iommu=on,verbose acpi=verbose apic=bigsmp,verbose apic_verbosity=debug cc_compiler : gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-4) cc_compile_by : root cc_compile_domain : (none) cc_compile_date : Mon Dec 2 22:36:29 MST 2013 xend_config_format : 4 Here is my current grub.conf: default=0 timeout=5 splashimage=(hd0,0)/grub/splash.xpm.gz hiddenmenu title CentOS (3.10.20-11.el6.centos.alt.x86_64) root (hd0,0) kernel /xen.gz dom0_mem=1024M,max:1024M loglvl=all guest_loglvl=all iommu=on,verbose acpi=verbose apic=bigsmp,verbose apic_verbosity=debug module /vmlinuz-3.10.20-11.el6.centos.alt.x86_64 ro root=UUID=65dee24c-3094-49aa-b64c-2859e964052f rd_NO_LUKS rd_NO_LVM LANG=en_US.UTF-8 rd_NO_MD SYSFONT=latarcyrheb-sun16 crashkernel=auto KEYBOARDTYPE=pc KEYTABLE=us rd_NO_DM rhgb quiet xen-pciback.hide=(01:00.0)(01:00.1) module /initramfs-3.10.20-11.el6.centos.alt.x86_64.img And finally the rather verbose xl dmesg: (XEN) Xen version 4.4-unstable (root@(none)) (gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-4)) debug=y Mon Dec 2 22:36:29 MST 2013 (XEN) Latest ChangeSet: Mon Nov 25 11:20:06 2013 +0100 git:e439e0b-dirty (XEN) Bootloader: GNU GRUB 0.97 (XEN) Command line: dom0_mem=1024M,max:1024M loglvl=all guest_loglvl=all iommu=on,verbose acpi=verbose apic=bigsmp,verbose apic_verbosity=debug (XEN) Video information: (XEN) VGA is text mode 80x25, font 8x16 (XEN) VBE/DDC methods: V2; EDID transfer time: 1 seconds (XEN) Disc information: (XEN) Found 2 MBR signatures (XEN) Found 2 EDD information structures (XEN) Xen-e820 RAM map: (XEN) 0000000000000000 - 000000000009e800 (usable) (XEN) 000000000009e800 - 00000000000a0000 (reserved) (XEN) 00000000000e0000 - 0000000000100000 (reserved) (XEN) 0000000000100000 - 00000000cc15f000 (usable) (XEN) 00000000cc15f000 - 00000000cc445000 (reserved) (XEN) 00000000cc445000 - 00000000cc553000 (ACPI data) (XEN) 00000000cc553000 - 00000000cc777000 (ACPI NVS) (XEN) 00000000cc777000 - 00000000cd721000 (reserved) (XEN) 00000000cd721000 - 00000000cd722000 (usable) (XEN) 00000000cd722000 - 00000000cd7a8000 (ACPI NVS) (XEN) 00000000cd7a8000 - 00000000cdbe8000 (usable) (XEN) 00000000cdbe8000 - 00000000cdff4000 (reserved) (XEN) 00000000cdff4000 - 00000000ce000000 (usable) (XEN) 00000000e0000000 - 00000000f0000000 (reserved) (XEN) 00000000fed1c000 - 00000000fed20000 (reserved) (XEN) 00000000ff000000 - 0000000100000000 (reserved) (XEN) 0000000100000000 - 0000001030000000 (usable) (XEN) ACPI: RSDP 000F0490, 0024 (r2 ALASKA) (XEN) ACPI: XSDT CC47B070, 005C (r1 ALASKA A M I 1072009 AMI 10013) (XEN) ACPI: FACP CC485108, 010C (r5 ALASKA A M I 1072009 AMI 10013) (XEN) ACPI: DSDT CC47B168, 9F9A (r2 ALASKA A M I 16 INTL 20051117) (XEN) ACPI: FACS CC76E080, 0040 (XEN) ACPI: APIC CC485218, 0100 (r3 ALASKA A M I 1072009 AMI 10013) (XEN) ACPI: FPDT CC485318, 0044 (r1 ALASKA A M I 1072009 AMI 10013) (XEN) ACPI: MCFG CC485360, 003C (r1 ALASKA OEMMCFG. 1072009 MSFT 97) (XEN) ACPI: HPET CC4853A0, 0038 (r1 ALASKA A M I 1072009 AMI. 5) (XEN) ACPI: BGRT CC552558, 0038 (r0 ALASKA A M I 1072009 AMI 10013) (XEN) ACPI: SSDT CC485430, CD128 (r2 INTEL CpuPm 4000 INTL 20051117) (XEN) System RAM: 65477MB (67048744kB) (XEN) No NUMA configuration found (XEN) Faking a node at 0000000000000000-0000001030000000 (XEN) Domain heap initialised (XEN) found SMP MP-table at 000fd8b0 (XEN) DMI 2.7 present. (XEN) APIC boot state is 'xapic' (XEN) Using APIC driver default (XEN) ACPI: PM-Timer IO Port: 0x408 (XEN) ACPI: v5 SLEEP INFO: control[0:0], status[0:0] (XEN) ACPI: SLEEP INFO: pm1x_cnt[404,0], pm1x_evt[400,0] (XEN) ACPI: 32/64X FACS address mismatch in FADT - cc76e080/0000000000000000, using 32 (XEN) ACPI: wakeup_vec[cc76e08c], vec_size[20] (XEN) ACPI: Local APIC address 0xfee00000 (XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled) (XEN) Processor #0 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x02] lapic_id[0x02] enabled) (XEN) Processor #2 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] enabled) (XEN) Processor #4 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x06] lapic_id[0x06] enabled) (XEN) Processor #6 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x08] enabled) (XEN) Processor #8 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x0a] lapic_id[0x0a] enabled) (XEN) Processor #10 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled) (XEN) Processor #1 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x03] lapic_id[0x03] enabled) (XEN) Processor #3 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] enabled) (XEN) Processor #5 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x07] lapic_id[0x07] enabled) (XEN) Processor #7 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x09] enabled) (XEN) Processor #9 7:14 APIC version 21 (XEN) ACPI: LAPIC (acpi_id[0x0b] lapic_id[0x0b] enabled) (XEN) Processor #11 7:14 APIC version 21 (XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x06] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x0a] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x03] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x09] high edge lint[0x1]) (XEN) ACPI: LAPIC_NMI (acpi_id[0x0b] high edge lint[0x1]) (XEN) Overriding APIC driver with bigsmp (XEN) ACPI: IOAPIC (id[0x00] address[0xfec00000] gsi_base[0]) (XEN) IOAPIC[0]: apic_id 0, version 32, address 0xfec00000, GSI 0-23 (XEN) ACPI: IOAPIC (id[0x02] address[0xfec01000] gsi_base[24]) (XEN) IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47 (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl) (XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level) (XEN) ACPI: IRQ0 used by override. (XEN) ACPI: IRQ2 used by override. (XEN) ACPI: IRQ9 used by override. (XEN) Enabling APIC mode: Phys. Using 2 I/O APICs (XEN) ACPI: HPET id: 0x8086a701 base: 0xfed00000 (XEN) ERST table was not found (XEN) Using ACPI (MADT) for SMP configuration information (XEN) SMP: Allowing 12 CPUs (0 hotplug CPUs) (XEN) mapped APIC to ffff82cfffdfb000 (fee00000) (XEN) mapped IOAPIC to ffff82cfffdfa000 (fec00000) (XEN) mapped IOAPIC to ffff82cfffdf9000 (fec01000) (XEN) IRQ limits: 48 GSI, 2272 MSI/MSI-X (XEN) Not enabling x2APIC: depends on iommu_supports_eim. (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Detected 3400.165 MHz processor. (XEN) Initing memory sharing. (XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7 (XEN) mce_intel.c:717: MCA Capability: BCAST 1 SER 0 CMCI 1 firstbank 0 extended MCE MSR 0 (XEN) Intel machine check reporting enabled (XEN) PCI: MCFG configuration 0: base e0000000 segment 0000 buses 00 - ff (XEN) PCI: MCFG area at e0000000 reserved in E820 (XEN) PCI: Using MCFG for segment 0000 bus 00-ff (XEN) I/O virtualisation disabled ... --001a11c2f8b89acff604ecaafb00 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
I just started using Xen and am trying to come up to speed= . =A0I am trying to configure a desktop PC to boot Xen, then passthrough VG= A, Keyboard, and Mouse to a VM for development. =A0I have a Win7 DomU worki= ng beautifully without the passthrough, so I have the basics working.

Here is my configuration (please let me know if I missed som= ething important):
ASUS P9X79 Pro motherboard, current BIOS, with= VT-D enabled.
Intel I7-4930K processor

I installed CentOS 6.5 minimal for Dom0, plus a couple packages to get thin= gs working (e.g., Perl). =A0I have xend turned off and I am trying to do ev= erything using the XL toolkit.

I have installed Xe= n 4.2.3 stable and have built and installed the current head from GIT (post= 4.3.1) with identical results.

After some debugging, I believe it is failing to parse = the ACPI table (acpi_drhd_units is empty in intel_vtd_setup) and disabling = IOMMU.

Any tips on how to proceed?

Thanks!

Here is xl info:
host =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0 : r4
release =A0 =A0 = =A0 =A0 =A0 =A0 =A0 =A0: 3.10.20-11.el6.centos.alt.x86_64
version= =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0: #1 SMP Sat Nov 23 23:08:56 UTC 2013
machine =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0: x86_64
nr_cpus =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0: 12
max_cpu_id =A0 =A0 =A0 =A0 =A0 = =A0 : 11
nr_nodes =A0 =A0 =A0 =A0 =A0 =A0 =A0 : 1
cores= _per_socket =A0 =A0 =A0 : 6
threads_per_core =A0 =A0 =A0 : 2
cpu_mhz =A0 =A0 =A0 =A0 =A0 =A0 =A0 =A0: 3400
hw_caps =A0 = =A0 =A0 =A0 =A0 =A0 =A0 =A0: bfebfbff:2c100800:00000000:00007f00:77bee3bf:0= 0000000:00000001:00000281
virt_caps =A0 =A0 =A0 =A0 =A0 =A0 =A0: = hvm
total_memory =A0 =A0 =A0 =A0 =A0 : 65477
free_memory =A0 =A0 =A0 =A0 =A0 =A0: 63740
sharing_freed_mem= ory =A0 : 0
sharing_used_memory =A0 =A0: 0
outstanding_= claims =A0 =A0 : 0
free_cpus =A0 =A0 =A0 =A0 =A0 =A0 =A0: 0
=
xen_major =A0 =A0 =A0 =A0 =A0 =A0 =A0: 4
xen_minor =A0 =A0 =A0 =A0 =A0 =A0 =A0: 4
xen_extra =A0 =A0 = =A0 =A0 =A0 =A0 =A0: -unstable
xen_version =A0 =A0 =A0 =A0 =A0 = =A0: 4.4-unstable
xen_caps =A0 =A0 =A0 =A0 =A0 =A0 =A0 : xen-3.0-= x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler =A0 =A0 =A0 =A0 =A0: credit
xen_pagesize =A0 = =A0 =A0 =A0 =A0 : 4096
platform_params =A0 =A0 =A0 =A0: virt_star= t=3D0xffff800000000000
xen_changeset =A0 =A0 =A0 =A0 =A0: Mon Nov= 25 11:20:06 2013 +0100 git:e439e0b-dirty
xen_commandline =A0 =A0 =A0 =A0: dom0_mem=3D1024M,max:1024M loglvl=3Da= ll guest_loglvl=3Dall iommu=3Don,verbose acpi=3Dverbose apic=3Dbigsmp,verbo= se apic_verbosity=3Ddebug
cc_compiler =A0 =A0 =A0 =A0 =A0 =A0: gc= c (GCC) 4.4.7 20120313 (Red Hat 4.4.7-4)
cc_compile_by =A0 =A0 =A0 =A0 =A0: root
cc_compile_domain = =A0 =A0 =A0: (none)
cc_compile_date =A0 =A0 =A0 =A0: Mon Dec =A02= 22:36:29 MST 2013
xend_config_format =A0 =A0 : 4


Here is my current grub.conf:
default=3D0
timeout= =3D5
splashimage=3D(hd0,0)/grub/splash.xpm.gz
hiddenmen= u
title CentOS (3.10.20-11.el6.centos.alt.x86_64)
=A0 = =A0 =A0 =A0 root (hd0,0)
=A0 =A0 =A0 =A0 kernel /xen.gz dom0_mem=3D1024M,max:1024M loglvl=3Dall= guest_loglvl=3Dall iommu=3Don,verbose acpi=3Dverbose apic=3Dbigsmp,verbose= apic_verbosity=3Ddebug
=A0 =A0 =A0 =A0 module /vmlinuz-3.10.20-1= 1.el6.centos.alt.x86_64 ro root=3DUUID=3D65dee24c-3094-49aa-b64c-2859e96405= 2f rd_NO_LUKS rd_NO_LVM LANG=3Den_US.UTF-8 rd_NO_MD SYSFONT=3Dlatarcyrheb-s= un16 crashkernel=3Dauto =A0KEYBOARDTYPE=3Dpc KEYTABLE=3Dus rd_NO_DM rhgb qu= iet xen-pciback.hide=3D(01:00.0)(01:00.1)
=A0 =A0 =A0 =A0 module /initramfs-3.10.20-11.el6.centos.alt.x86_64.img=

And finally the rather verbose xl dmesg:

(XEN) Xen version 4.4-unstable (root@(none)) (g= cc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-4)) debug=3Dy Mon Dec =A02 22:36:29 = MST 2013
(XEN) Latest ChangeSet: Mon Nov 25 11:20:06 2013 +0100 git:e439e0b-dir= ty
(XEN) Bootloader: GNU GRUB 0.97
(XEN) Command line: = dom0_mem=3D1024M,max:1024M loglvl=3Dall guest_loglvl=3Dall iommu=3Don,verbo= se acpi=3Dverbose apic=3Dbigsmp,verbose apic_verbosity=3Ddebug
(XEN) Video information:
(XEN) =A0VGA is text mode 80x25, fo= nt 8x16
(XEN) =A0VBE/DDC methods: V2; EDID transfer time: 1 secon= ds
(XEN) Disc information:
(XEN) =A0Found 2 MBR signatu= res
(XEN) =A0Found 2 EDD information structures
(XEN) Xen-e820 R= AM map:
(XEN) =A00000000000000000 - 000000000009e800 (usable)
(XEN) =A0000000000009e800 - 00000000000a0000 (reserved)
(X= EN) =A000000000000e0000 - 0000000000100000 (reserved)
(XEN) =A00000000000100000 - 00000000cc15f000 (usable)
(XEN) = =A000000000cc15f000 - 00000000cc445000 (reserved)
(XEN) =A0000000= 00cc445000 - 00000000cc553000 (ACPI data)
(XEN) =A000000000cc5530= 00 - 00000000cc777000 (ACPI NVS)
(XEN) =A000000000cc777000 - 00000000cd721000 (reserved)
(XEN= ) =A000000000cd721000 - 00000000cd722000 (usable)
(XEN) =A0000000= 00cd722000 - 00000000cd7a8000 (ACPI NVS)
(XEN) =A000000000cd7a800= 0 - 00000000cdbe8000 (usable)
(XEN) =A000000000cdbe8000 - 00000000cdff4000 (reserved)
(XEN= ) =A000000000cdff4000 - 00000000ce000000 (usable)
(XEN) =A0000000= 00e0000000 - 00000000f0000000 (reserved)
(XEN) =A000000000fed1c00= 0 - 00000000fed20000 (reserved)
(XEN) =A000000000ff000000 - 0000000100000000 (reserved)
(XEN= ) =A00000000100000000 - 0000001030000000 (usable)
(XEN) ACPI: RSD= P 000F0490, 0024 (r2 ALASKA)
(XEN) ACPI: XSDT CC47B070, 005C (r1 = ALASKA =A0 =A0A M I =A01072009 AMI =A0 =A0 10013)
(XEN) ACPI: FACP CC485108, 010C (r5 ALASKA =A0 =A0A M I =A01072009 AMI= =A0 =A0 10013)
(XEN) ACPI: DSDT CC47B168, 9F9A (r2 ALASKA =A0 = =A0A M I =A0 =A0 =A0 16 INTL 20051117)
(XEN) ACPI: FACS CC76E080,= 0040
(XEN) ACPI: APIC CC485218, 0100 (r3 ALASKA =A0 =A0A M I =A0= 1072009 AMI =A0 =A0 10013)
(XEN) ACPI: FPDT CC485318, 0044 (r1 ALASKA =A0 =A0A M I =A01072009 AMI= =A0 =A0 10013)
(XEN) ACPI: MCFG CC485360, 003C (r1 ALASKA OEMMCF= G. =A01072009 MSFT =A0 =A0 =A0 97)
(XEN) ACPI: HPET CC4853A0, 003= 8 (r1 ALASKA =A0 =A0A M I =A01072009 AMI. =A0 =A0 =A0 =A05)
(XEN) ACPI: BGRT CC552558, 0038 (r0 ALASKA =A0 =A0A M I =A01072009 AMI= =A0 =A0 10013)
(XEN) ACPI: SSDT CC485430, CD128 (r2 =A0INTEL =A0= =A0CpuPm =A0 =A0 4000 INTL 20051117)
(XEN) System RAM: 65477MB (= 67048744kB)
(XEN) No NUMA configuration found
(XEN) Faking a node at 000= 0000000000000-0000001030000000
(XEN) Domain heap initialised
(XEN) found SMP MP-table at 000fd8b0
(XEN) DMI 2.7 present.=
(XEN) APIC boot state is 'xapic'
(XEN) Using APIC dr= iver default
(XEN) ACPI: PM-Timer IO Port: 0x408
(XEN) = ACPI: v5 SLEEP INFO: control[0:0], status[0:0]
(XEN) ACPI: SLEEP = INFO: pm1x_cnt[404,0], pm1x_evt[400,0]
(XEN) ACPI: 32/64X FACS address mismatch in FADT - cc76e080/0000000000= 000000, using 32
(XEN) ACPI: =A0 =A0 =A0 =A0 =A0 =A0 wakeup_vec[c= c76e08c], vec_size[20]
(XEN) ACPI: Local APIC address 0xfee00000<= /div>
(XEN) ACPI: LAPIC (acpi_id[0x00] lapic_id[0x00] enabled)
(XEN) Pr= ocessor #0 7:14 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x02] = lapic_id[0x02] enabled)
(XEN) Processor #2 7:14 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0x04] lapic_id[0x04] enabled)
(XE= N) Processor #4 7:14 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0= x06] lapic_id[0x06] enabled)
(XEN) Processor #6 7:14 APIC version= 21
(XEN) ACPI: LAPIC (acpi_id[0x08] lapic_id[0x08] enabled)
(XE= N) Processor #8 7:14 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0= x0a] lapic_id[0x0a] enabled)
(XEN) Processor #10 7:14 APIC versio= n 21
(XEN) ACPI: LAPIC (acpi_id[0x01] lapic_id[0x01] enabled)
(XE= N) Processor #1 7:14 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0= x03] lapic_id[0x03] enabled)
(XEN) Processor #3 7:14 APIC version= 21
(XEN) ACPI: LAPIC (acpi_id[0x05] lapic_id[0x05] enabled)
(XE= N) Processor #5 7:14 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0= x07] lapic_id[0x07] enabled)
(XEN) Processor #7 7:14 APIC version= 21
(XEN) ACPI: LAPIC (acpi_id[0x09] lapic_id[0x09] enabled)
(XE= N) Processor #9 7:14 APIC version 21
(XEN) ACPI: LAPIC (acpi_id[0= x0b] lapic_id[0x0b] enabled)
(XEN) Processor #11 7:14 APIC versio= n 21
(XEN) ACPI: LAPIC_NMI (acpi_id[0x00] high edge lint[0x1])
(X= EN) ACPI: LAPIC_NMI (acpi_id[0x02] high edge lint[0x1])
(XEN) ACP= I: LAPIC_NMI (acpi_id[0x04] high edge lint[0x1])
(XEN) ACPI: LAPI= C_NMI (acpi_id[0x06] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x08] high edge lint[0x1])
(X= EN) ACPI: LAPIC_NMI (acpi_id[0x0a] high edge lint[0x1])
(XEN) ACP= I: LAPIC_NMI (acpi_id[0x01] high edge lint[0x1])
(XEN) ACPI: LAPI= C_NMI (acpi_id[0x03] high edge lint[0x1])
(XEN) ACPI: LAPIC_NMI (acpi_id[0x05] high edge lint[0x1])
(X= EN) ACPI: LAPIC_NMI (acpi_id[0x07] high edge lint[0x1])
(XEN) ACP= I: LAPIC_NMI (acpi_id[0x09] high edge lint[0x1])
(XEN) ACPI: LAPI= C_NMI (acpi_id[0x0b] high edge lint[0x1])
(XEN) Overriding APIC driver with bigsmp
(XEN) ACPI: IOAPIC = (id[0x00] address[0xfec00000] gsi_base[0])
(XEN) IOAPIC[0]: apic_= id 0, version 32, address 0xfec00000, GSI 0-23
(XEN) ACPI: IOAPIC= (id[0x02] address[0xfec01000] gsi_base[24])
(XEN) IOAPIC[1]: apic_id 2, version 32, address 0xfec01000, GSI 24-47<= /div>
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 0 global_irq 2 dfl dfl)
(XEN) ACPI: INT_SRC_OVR (bus 0 bus_irq 9 global_irq 9 high level)
(XEN) ACPI: IRQ0 used by override.
(XEN) ACPI: IRQ2 used by = override.
(XEN) ACPI: IRQ9 used by override.
(XEN) Enab= ling APIC mode: =A0Phys. =A0Using 2 I/O APICs
(XEN) ACPI: HPET id= : 0x8086a701 base: 0xfed00000
(XEN) ERST table was not found
(XEN) Using ACPI (MADT) for S= MP configuration information
(XEN) SMP: Allowing 12 CPUs (0 hotpl= ug CPUs)
(XEN) mapped APIC to ffff82cfffdfb000 (fee00000)
(XEN) mapped IOAPIC to ffff82cfffdfa000 (fec00000)
(XEN) map= ped IOAPIC to ffff82cfffdf9000 (fec01000)
(XEN) IRQ limits: 48 GS= I, 2272 MSI/MSI-X
(XEN) Not enabling x2APIC: depends on iommu_sup= ports_eim.
(XEN) Using scheduler: SMP Credit Scheduler (credit)
(XEN) D= etected 3400.165 MHz processor.
(XEN) Initing memory sharing.
(XEN) xstate_init: using cntxt_size: 0x340 and states: 0x7
(XEN) mce_intel.c:717: MCA Capability: BCAST 1 SER 0 CMCI 1 firstbank = 0 extended MCE MSR 0
(XEN) Intel machine check reporting enabled<= /div>
(XEN) PCI: MCFG configuration 0: base e0000000 segment 0000 buses= 00 - ff
(XEN) PCI: MCFG area at e0000000 reserved in E820
(XEN) PCI:= Using MCFG for segment 0000 bus 00-ff
(XEN) I/O virtualisation d= isabled
...


--001a11c2f8b89acff604ecaafb00-- --===============7824085491773436570== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============7824085491773436570==-- From xen-users-bounces@lists.xen.org Wed Dec 04 02:19:26 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 04 Dec 2013 02:19:26 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vo22m-0005G9-6S; Wed, 04 Dec 2013 02:18:28 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vo22k-0005FZ-Sx for xen-users@lists.xensource.com; Wed, 04 Dec 2013 02:18:27 +0000 Received: from [85.158.143.35:61621] by server-2.bemta-4.messagelabs.com id 61/81-11386-2F09E925; Wed, 04 Dec 2013 02:18:26 +0000 X-Env-Sender: arkady.me@gmail.com X-Msg-Ref: server-9.tower-21.messagelabs.com!1386123504!3132979!1 X-Originating-IP: [216.139.236.26] X-SpamReason: No, hits=0.1 required=7.0 tests=HTML_50_60,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 16335 invoked from network); 4 Dec 2013 02:18:25 -0000 Received: from sam.nabble.com (HELO sam.nabble.com) (216.139.236.26) by server-9.tower-21.messagelabs.com with AES256-SHA encrypted SMTP; 4 Dec 2013 02:18:25 -0000 Received: from [192.168.236.26] (helo=sam.nabble.com) by sam.nabble.com with esmtp (Exim 4.72) (envelope-from ) id 1Vo22h-0001TH-9z for xen-users@lists.xensource.com; Tue, 03 Dec 2013 18:18:23 -0800 Date: Tue, 3 Dec 2013 18:18:23 -0800 (PST) From: RKDTOO To: xen-users@lists.xensource.com Message-ID: <1386123503301-5720212.post@n5.nabble.com> In-Reply-To: <20131203121607.GA27492@zion.uk.xensource.com> References: <1386024627643-5720205.post@n5.nabble.com> <20131203121607.GA27492@zion.uk.xensource.com> MIME-Version: 1.0 Subject: Re: [Xen-users] Is Xen really a Type 1 Hypervisor? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============3231780066931446482==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============3231780066931446482== Content-Type: multipart/alternative; boundary="----=_Part_20642_24197233.1386123503303" ------=_Part_20642_24197233.1386123503303 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit My apologies; I was merely commenting on this post . Not many people know that the new ESXi (not ESX) console is based on BusyBox, not RedHat. -- View this message in context: http://xen.1045712.n5.nabble.com/Is-Xen-really-a-Type-1-Hypervisor-tp5643400p5720212.html Sent from the Xen - User mailing list archive at Nabble.com. ------=_Part_20642_24197233.1386123503303 Content-Type: text/html; charset=us-ascii Content-Transfer-Encoding: 7bit My apologies; I was merely commenting on this post. Not many people know that the new ESXi (not ESX) console is based on BusyBox, not RedHat.
View this message in context: Re: Is Xen really a Type 1 Hypervisor?
Sent from the Xen - User mailing list archive at Nabble.com.
------=_Part_20642_24197233.1386123503303-- --===============3231780066931446482== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============3231780066931446482==-- From xen-users-bounces@lists.xen.org Wed Dec 04 02:19:26 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 04 Dec 2013 02:19:26 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vo22m-0005G9-6S; Wed, 04 Dec 2013 02:18:28 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vo22k-0005FZ-Sx for xen-users@lists.xensource.com; Wed, 04 Dec 2013 02:18:27 +0000 Received: from [85.158.143.35:61621] by server-2.bemta-4.messagelabs.com id 61/81-11386-2F09E925; Wed, 04 Dec 2013 02:18:26 +0000 X-Env-Sender: arkady.me@gmail.com X-Msg-Ref: server-9.tower-21.messagelabs.com!1386123504!3132979!1 X-Originating-IP: [216.139.236.26] X-SpamReason: No, hits=0.1 required=7.0 tests=HTML_50_60,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 16335 invoked from network); 4 Dec 2013 02:18:25 -0000 Received: from sam.nabble.com (HELO sam.nabble.com) (216.139.236.26) by server-9.tower-21.messagelabs.com with AES256-SHA encrypted SMTP; 4 Dec 2013 02:18:25 -0000 Received: from [192.168.236.26] (helo=sam.nabble.com) by sam.nabble.com with esmtp (Exim 4.72) (envelope-from ) id 1Vo22h-0001TH-9z for xen-users@lists.xensource.com; Tue, 03 Dec 2013 18:18:23 -0800 Date: Tue, 3 Dec 2013 18:18:23 -0800 (PST) From: RKDTOO To: xen-users@lists.xensource.com Message-ID: <1386123503301-5720212.post@n5.nabble.com> In-Reply-To: <20131203121607.GA27492@zion.uk.xensource.com> References: <1386024627643-5720205.post@n5.nabble.com> <20131203121607.GA27492@zion.uk.xensource.com> MIME-Version: 1.0 Subject: Re: [Xen-users] Is Xen really a Type 1 Hypervisor? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============3231780066931446482==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============3231780066931446482== Content-Type: multipart/alternative; boundary="----=_Part_20642_24197233.1386123503303" ------=_Part_20642_24197233.1386123503303 Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit My apologies; I was merely commenting on this post . Not many people know that the new ESXi (not ESX) console is based on BusyBox, not RedHat. -- View this message in context: http://xen.1045712.n5.nabble.com/Is-Xen-really-a-Type-1-Hypervisor-tp5643400p5720212.html Sent from the Xen - User mailing list archive at Nabble.com. ------=_Part_20642_24197233.1386123503303 Content-Type: text/html; charset=us-ascii Content-Transfer-Encoding: 7bit My apologies; I was merely commenting on this post. Not many people know that the new ESXi (not ESX) console is based on BusyBox, not RedHat.
View this message in context: Re: Is Xen really a Type 1 Hypervisor?
Sent from the Xen - User mailing list archive at Nabble.com.
------=_Part_20642_24197233.1386123503303-- --===============3231780066931446482== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============3231780066931446482==-- From xen-users-bounces@lists.xen.org Sun Dec 08 13:00:24 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 08 Dec 2013 13:00:24 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpdwt-0007xc-NI; Sun, 08 Dec 2013 12:59:03 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpdwr-0007xX-DY for xen-users@lists.xen.org; Sun, 08 Dec 2013 12:59:01 +0000 Received: from [85.158.143.35:29733] by server-1.bemta-4.messagelabs.com id 6F/DB-02132-41D64A25; Sun, 08 Dec 2013 12:59:00 +0000 X-Env-Sender: reklov@unitedklasens.de X-Msg-Ref: server-4.tower-21.messagelabs.com!1386507539!4158177!1 X-Originating-IP: [37.17.224.201] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 28890 invoked from network); 8 Dec 2013 12:59:00 -0000 Received: from mail.webgo24-server13.de (HELO mail.webgo24-server13.de) (37.17.224.201) by server-4.tower-21.messagelabs.com with SMTP; 8 Dec 2013 12:59:00 -0000 Received: from [192.168.42.13] (HSI-KBW-46-223-75-55.hsi.kabel-badenwuerttemberg.de [46.223.75.55]) by mail.webgo24-server13.de (Postfix) with ESMTPSA id 71B003040C3D for ; Sun, 8 Dec 2013 13:58:59 +0100 (CET) Message-ID: <52A46D13.4050806@unitedklasens.de> Date: Sun, 08 Dec 2013 13:58:59 +0100 From: Volker Klasen User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20131005 Icedove/17.0.9 MIME-Version: 1.0 To: xen-users@lists.xen.org X-Enigmail-Version: 1.6 Subject: [Xen-users] VGA Passthrough with Xen 4.3 and Qemu 1.7 on Debian Jessie X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, the short version: I can't get VGA passthrough working with Xen 4.3 and Qemu 1.7. The VM won't even display a bios screen. The long version: after successfully running Windows 7 64bit with a passthrough'd Radeon HD 7870 about 1.5 years with Xen 4.1 (xm/qemu-dm), I decided it was time to upgrade to Jessie's current Xen packages (4.3). Unexpectedly, I came across several issues related to switching from xm to xl and from qemu-dm to qemu, as well as non-functional VGA passthrough. I found 2 setups that at least would start the VM: 1) Using qemu-dm from Wheezy packages xen-utils-4.1 In this setup I can pass through all 4 PCI devices (USB controller, VGA card, HDMI audio and audio card), however, none is working. For the audio card error 10 is reported, for the graphics card error 43. 2) Using qemu In this setup PCI passthrough works as long as I do not passthrough my VGA card (the other three are working without problems). As soon as I passthrough the graphics card, the VM won't even startup at all (vnc is running but no bios is displayed, only black screen); the logs are empty, as well (the only line is "Waiting for domain ..." in /var/log/xen/xl-domain.log). I tried setting and unsetting the pci_* options in the domain config file but I had no luck. Here's my current config (left some unrelated things out) set up for 2) with VGA passthrough (01:00.0): # qemu device_model_version="qemu-xen" device_model_override = '/usr/bin/qemu-system-x86_64' # qemu-dm #device_model_version="qemu-xen-traditional" #device_model_override = '/usr/lib/xen-4.1/bin/qemu-dm' builder = 'hvm' viridian = 1 vga = 'stdvga' pci_msitranslate = 0 #pci = ['0000:00:1d.0','0000:01:00.1','0000:04:04.0'] pci = ['0000:00:1d.0','0000:01:00.0','0000:01:00.1','0000:04:04.0'] Has anyone an idea what I could try? Thanks, Volker -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.15 (GNU/Linux) Comment: Using GnuPG with Icedove - http://www.enigmail.net/ iEYEARECAAYFAlKkbRMACgkQgKD4KXUzSri9vQCgs5mf+tRxONXsP7Mmsc8OWW+e qmgAnRrlDZHv7CUihp8ekWl7CN2zxw51 =bLW7 -----END PGP SIGNATURE----- _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sun Dec 08 13:00:24 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 08 Dec 2013 13:00:24 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpdwt-0007xc-NI; Sun, 08 Dec 2013 12:59:03 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpdwr-0007xX-DY for xen-users@lists.xen.org; Sun, 08 Dec 2013 12:59:01 +0000 Received: from [85.158.143.35:29733] by server-1.bemta-4.messagelabs.com id 6F/DB-02132-41D64A25; Sun, 08 Dec 2013 12:59:00 +0000 X-Env-Sender: reklov@unitedklasens.de X-Msg-Ref: server-4.tower-21.messagelabs.com!1386507539!4158177!1 X-Originating-IP: [37.17.224.201] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 28890 invoked from network); 8 Dec 2013 12:59:00 -0000 Received: from mail.webgo24-server13.de (HELO mail.webgo24-server13.de) (37.17.224.201) by server-4.tower-21.messagelabs.com with SMTP; 8 Dec 2013 12:59:00 -0000 Received: from [192.168.42.13] (HSI-KBW-46-223-75-55.hsi.kabel-badenwuerttemberg.de [46.223.75.55]) by mail.webgo24-server13.de (Postfix) with ESMTPSA id 71B003040C3D for ; Sun, 8 Dec 2013 13:58:59 +0100 (CET) Message-ID: <52A46D13.4050806@unitedklasens.de> Date: Sun, 08 Dec 2013 13:58:59 +0100 From: Volker Klasen User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20131005 Icedove/17.0.9 MIME-Version: 1.0 To: xen-users@lists.xen.org X-Enigmail-Version: 1.6 Subject: [Xen-users] VGA Passthrough with Xen 4.3 and Qemu 1.7 on Debian Jessie X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hello, the short version: I can't get VGA passthrough working with Xen 4.3 and Qemu 1.7. The VM won't even display a bios screen. The long version: after successfully running Windows 7 64bit with a passthrough'd Radeon HD 7870 about 1.5 years with Xen 4.1 (xm/qemu-dm), I decided it was time to upgrade to Jessie's current Xen packages (4.3). Unexpectedly, I came across several issues related to switching from xm to xl and from qemu-dm to qemu, as well as non-functional VGA passthrough. I found 2 setups that at least would start the VM: 1) Using qemu-dm from Wheezy packages xen-utils-4.1 In this setup I can pass through all 4 PCI devices (USB controller, VGA card, HDMI audio and audio card), however, none is working. For the audio card error 10 is reported, for the graphics card error 43. 2) Using qemu In this setup PCI passthrough works as long as I do not passthrough my VGA card (the other three are working without problems). As soon as I passthrough the graphics card, the VM won't even startup at all (vnc is running but no bios is displayed, only black screen); the logs are empty, as well (the only line is "Waiting for domain ..." in /var/log/xen/xl-domain.log). I tried setting and unsetting the pci_* options in the domain config file but I had no luck. Here's my current config (left some unrelated things out) set up for 2) with VGA passthrough (01:00.0): # qemu device_model_version="qemu-xen" device_model_override = '/usr/bin/qemu-system-x86_64' # qemu-dm #device_model_version="qemu-xen-traditional" #device_model_override = '/usr/lib/xen-4.1/bin/qemu-dm' builder = 'hvm' viridian = 1 vga = 'stdvga' pci_msitranslate = 0 #pci = ['0000:00:1d.0','0000:01:00.1','0000:04:04.0'] pci = ['0000:00:1d.0','0000:01:00.0','0000:01:00.1','0000:04:04.0'] Has anyone an idea what I could try? Thanks, Volker -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.15 (GNU/Linux) Comment: Using GnuPG with Icedove - http://www.enigmail.net/ iEYEARECAAYFAlKkbRMACgkQgKD4KXUzSri9vQCgs5mf+tRxONXsP7Mmsc8OWW+e qmgAnRrlDZHv7CUihp8ekWl7CN2zxw51 =bLW7 -----END PGP SIGNATURE----- _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sun Dec 08 15:34:03 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 08 Dec 2013 15:34:03 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VpgLr-00051l-J1; Sun, 08 Dec 2013 15:32:59 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VpgLq-00051g-1p for xen-users@lists.xen.org; Sun, 08 Dec 2013 15:32:58 +0000 Received: from [193.109.254.147:22456] by server-5.bemta-14.messagelabs.com id 72/59-03510-92194A25; Sun, 08 Dec 2013 15:32:57 +0000 X-Env-Sender: cdelorme@gmail.com X-Msg-Ref: server-3.tower-27.messagelabs.com!1386516774!3723416!1 X-Originating-IP: [209.85.220.170] X-SpamReason: No, hits=1.2 required=7.0 tests=HTML_20_30,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 29783 invoked from network); 8 Dec 2013 15:32:55 -0000 Received: from mail-vc0-f170.google.com (HELO mail-vc0-f170.google.com) (209.85.220.170) by server-3.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 8 Dec 2013 15:32:55 -0000 Received: by mail-vc0-f170.google.com with SMTP id ht10so2654641vcb.29 for ; Sun, 08 Dec 2013 07:32:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=cm9vhDDD3XHkFSDWX0soLUMydpC0ZtXhhEwnUwola9I=; b=zGkBKA4/rYJpBRObEv8Nob0FLRU9ezymgK4OOhTJsknxhDW/lx7NXr9Xzj3FmFFzqN o+XgQRz40t6QzcqiTqxOZuHB5z2R5i3aWBtgVTItBFvH6BVkDRnzQIeatdRjQWuXsA4d eW4XsPRpgaJ0xna+7KhfDJjJa6BPNVniENrME0JOUGA+Hxq2f2/mO2lA0DlKi/1gUSCd CTVvy0D5Uqe0AFbPZTd2KxrquIiocfLvLRog04qr4H+yPaC4UjAp70KSRQbhE00JAjMw 4HCLAyUaxI/qY5SQpc9OQxQqAvaAZYkg02r1lVAFPotYqP/sYfxxVWzXiZkQOa1eck/O NuIQ== MIME-Version: 1.0 X-Received: by 10.52.173.208 with SMTP id bm16mr7426883vdc.14.1386516774274; Sun, 08 Dec 2013 07:32:54 -0800 (PST) Received: by 10.58.155.106 with HTTP; Sun, 8 Dec 2013 07:32:54 -0800 (PST) In-Reply-To: <52A46D13.4050806@unitedklasens.de> References: <52A46D13.4050806@unitedklasens.de> Date: Sun, 8 Dec 2013 10:32:54 -0500 Message-ID: From: Casey DeLorme To: Volker Klasen Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] VGA Passthrough with Xen 4.3 and Qemu 1.7 on Debian Jessie X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============3753700295103945869==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============3753700295103945869== Content-Type: multipart/alternative; boundary=bcaec5196dddce498b04ed0797eb --bcaec5196dddce498b04ed0797eb Content-Type: text/plain; charset=UTF-8 Hello Volker, Can you supply more information about the system. There are many possibilities, so it'll be hard to narrow it down with only what you have provided. - What does the domu.cfg look like (complete copy) - Can you supply your kernel config - Any notable hardware (eg. motherboard?) - run `xl -vvv create` and attach the output I have been using Xen 4.3 and 4.4 on Wheezy for some time now, but I have not yet tried with Jessie. Off the top of my head, three possibilities stand out. Could be a syntax error in your domu.cfg (review the latest man pages: http://xenbits.xen.org/docs/4.3-testing/man/xl.cfg.5.html). I still build pciback into my kernels as I have never had good luck with late device binding even with though the xl toolstack should do so; is pciback compiled into the kernel and your devices hidden by grub, or are you relying on late binding? There have been problems with larger amounts of memory. Have you tried dropping to 1~2 GB of ram in your config (yes I am aware that it is a very small amount for Windows to run well on, maybe try it just to confirm possible causes)? Send us more info. Cheers, Casey On Sun, Dec 8, 2013 at 7:58 AM, Volker Klasen wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hello, > > the short version: I can't get VGA passthrough working with Xen 4.3 > and Qemu 1.7. The VM won't even display a bios screen. > > The long version: after successfully running Windows 7 64bit with a > passthrough'd Radeon HD 7870 about 1.5 years with Xen 4.1 > (xm/qemu-dm), I decided it was time to upgrade to Jessie's current Xen > packages (4.3). > > Unexpectedly, I came across several issues related to switching from > xm to xl and from qemu-dm to qemu, as well as non-functional VGA > passthrough. I found 2 setups that at least would start the VM: > > 1) Using qemu-dm from Wheezy packages xen-utils-4.1 > In this setup I can pass through all 4 PCI devices (USB controller, > VGA card, HDMI audio and audio card), however, none is working. For > the audio card error 10 is reported, for the graphics card error 43. > > 2) Using qemu > In this setup PCI passthrough works as long as I do not passthrough my > VGA card (the other three are working without problems). As soon as I > passthrough the graphics card, the VM won't even startup at all (vnc > is running but no bios is displayed, only black screen); the logs are > empty, as well (the only line is "Waiting for domain ..." in > /var/log/xen/xl-domain.log). > > I tried setting and unsetting the pci_* options in the domain config > file but I had no luck. Here's my current config (left some unrelated > things out) set up for 2) with VGA passthrough (01:00.0): > > # qemu > device_model_version="qemu-xen" > device_model_override = '/usr/bin/qemu-system-x86_64' > # qemu-dm > #device_model_version="qemu-xen-traditional" > #device_model_override = '/usr/lib/xen-4.1/bin/qemu-dm' > > builder = 'hvm' > viridian = 1 > vga = 'stdvga' > pci_msitranslate = 0 > > #pci = ['0000:00:1d.0','0000:01:00.1','0000:04:04.0'] > pci = ['0000:00:1d.0','0000:01:00.0','0000:01:00.1','0000:04:04.0'] > > > Has anyone an idea what I could try? > > Thanks, > Volker > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.15 (GNU/Linux) > Comment: Using GnuPG with Icedove - http://www.enigmail.net/ > > iEYEARECAAYFAlKkbRMACgkQgKD4KXUzSri9vQCgs5mf+tRxONXsP7Mmsc8OWW+e > qmgAnRrlDZHv7CUihp8ekWl7CN2zxw51 > =bLW7 > -----END PGP SIGNATURE----- > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > --bcaec5196dddce498b04ed0797eb Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hello Volker,

Can you supply= more information about the system. =C2=A0There are many possibilities, so = it'll be hard to narrow it down with only what you have provided.
=

- What does the domu.cfg look like (complete copy)
- Can you supply your kernel config
- Any notable hardware (eg. = motherboard?)
- run `xl -vvv create` and attach the output


I have been using Xen 4.3 and 4.4 on Whe= ezy for some time now, but I have not yet tried with Jessie. =C2=A0Off the = top of my head, three possibilities stand out. =C2=A0Could be a syntax erro= r in your domu.cfg (review the latest man pages: http://xenbits.xen.org/docs/4.3= -testing/man/xl.cfg.5.html). =C2=A0I still build pciback into my kernel= s as I have never had good luck with late device binding even with though t= he xl toolstack should do so; is pciback compiled into the kernel and your = devices hidden by grub, or are you relying on late binding? =C2=A0There hav= e been problems with larger amounts of memory. =C2=A0Have you tried droppin= g to 1~2 GB of ram in your config (yes I am aware that it is a very small a= mount for Windows to run well on, maybe try it just to confirm possible cau= ses)?

Send us more info.

Cheers,

Casey


<= div class=3D"gmail_quote">On Sun, Dec 8, 2013 at 7:58 AM, Volker Klasen <reklov@unitedklasens.de> wrote:
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hello,

the short version: I can't get VGA passthrough working with Xen 4.3
and Qemu 1.7. The VM won't even display a bios screen.

The long version: after successfully running Windows 7 64bit with a
passthrough'd Radeon HD 7870 about 1.5 years with Xen 4.1
(xm/qemu-dm), I decided it was time to upgrade to Jessie's current Xen<= br> packages (4.3).

Unexpectedly, I came across several issues related to switching from
xm to xl and from qemu-dm to qemu, as well as non-functional VGA
passthrough. I found 2 setups that at least would start the VM:

1) Using qemu-dm from Wheezy packages xen-utils-4.1
In this setup I can pass through all 4 PCI devices (USB controller,
VGA card, HDMI audio and audio card), however, none is working. For
the audio card error 10 is reported, for the graphics card error 43.

2) Using qemu
In this setup PCI passthrough works as long as I do not passthrough my
VGA card (the other three are working without problems). As soon as I
passthrough the graphics card, the VM won't even startup at all (vnc is running but no bios is displayed, only black screen); the logs are
empty, as well (the only line is "Waiting for domain ..." in
/var/log/xen/xl-domain.log).

I tried setting and unsetting the pci_* options in the domain config
file but I had no luck. Here's my current config (left some unrelated things out) set up for 2) with VGA passthrough (01:00.0):

# qemu
device_model_version=3D"qemu-xen"
device_model_override =3D '/usr/bin/qemu-system-x86_64'
# qemu-dm
#device_model_version=3D"qemu-xen-traditional"
#device_model_override =3D '/usr/lib/xen-4.1/bin/qemu-dm'

builder =3D 'hvm'
viridian =3D 1
vga =3D 'stdvga'
pci_msitranslate =3D 0

#pci =3D ['0000:00:1d.0','0000:01:00.1','0000:04:04.0&#= 39;]
pci =3D ['0000:00:1d.0','0000:01:00.0','0000:01:00.1= 9;,'0000:04:04.0']


Has anyone an idea what I could try?

Thanks,
Volker
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.15 (GNU/Linux)
Comment: Using GnuPG with Icedove - http://www.enigmail.net/

iEYEARECAAYFAlKkbRMACgkQgKD4KXUzSri9vQCgs5mf+tRxONXsP7Mmsc8OWW+e
qmgAnRrlDZHv7CUihp8ekWl7CN2zxw51
=3DbLW7
-----END PGP SIGNATURE-----

_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.x= en.org/xen-users

--bcaec5196dddce498b04ed0797eb-- --===============3753700295103945869== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============3753700295103945869==-- From xen-users-bounces@lists.xen.org Sun Dec 08 15:34:03 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 08 Dec 2013 15:34:03 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VpgLr-00051l-J1; Sun, 08 Dec 2013 15:32:59 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VpgLq-00051g-1p for xen-users@lists.xen.org; Sun, 08 Dec 2013 15:32:58 +0000 Received: from [193.109.254.147:22456] by server-5.bemta-14.messagelabs.com id 72/59-03510-92194A25; Sun, 08 Dec 2013 15:32:57 +0000 X-Env-Sender: cdelorme@gmail.com X-Msg-Ref: server-3.tower-27.messagelabs.com!1386516774!3723416!1 X-Originating-IP: [209.85.220.170] X-SpamReason: No, hits=1.2 required=7.0 tests=HTML_20_30,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 29783 invoked from network); 8 Dec 2013 15:32:55 -0000 Received: from mail-vc0-f170.google.com (HELO mail-vc0-f170.google.com) (209.85.220.170) by server-3.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 8 Dec 2013 15:32:55 -0000 Received: by mail-vc0-f170.google.com with SMTP id ht10so2654641vcb.29 for ; Sun, 08 Dec 2013 07:32:54 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=cm9vhDDD3XHkFSDWX0soLUMydpC0ZtXhhEwnUwola9I=; b=zGkBKA4/rYJpBRObEv8Nob0FLRU9ezymgK4OOhTJsknxhDW/lx7NXr9Xzj3FmFFzqN o+XgQRz40t6QzcqiTqxOZuHB5z2R5i3aWBtgVTItBFvH6BVkDRnzQIeatdRjQWuXsA4d eW4XsPRpgaJ0xna+7KhfDJjJa6BPNVniENrME0JOUGA+Hxq2f2/mO2lA0DlKi/1gUSCd CTVvy0D5Uqe0AFbPZTd2KxrquIiocfLvLRog04qr4H+yPaC4UjAp70KSRQbhE00JAjMw 4HCLAyUaxI/qY5SQpc9OQxQqAvaAZYkg02r1lVAFPotYqP/sYfxxVWzXiZkQOa1eck/O NuIQ== MIME-Version: 1.0 X-Received: by 10.52.173.208 with SMTP id bm16mr7426883vdc.14.1386516774274; Sun, 08 Dec 2013 07:32:54 -0800 (PST) Received: by 10.58.155.106 with HTTP; Sun, 8 Dec 2013 07:32:54 -0800 (PST) In-Reply-To: <52A46D13.4050806@unitedklasens.de> References: <52A46D13.4050806@unitedklasens.de> Date: Sun, 8 Dec 2013 10:32:54 -0500 Message-ID: From: Casey DeLorme To: Volker Klasen Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] VGA Passthrough with Xen 4.3 and Qemu 1.7 on Debian Jessie X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============3753700295103945869==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============3753700295103945869== Content-Type: multipart/alternative; boundary=bcaec5196dddce498b04ed0797eb --bcaec5196dddce498b04ed0797eb Content-Type: text/plain; charset=UTF-8 Hello Volker, Can you supply more information about the system. There are many possibilities, so it'll be hard to narrow it down with only what you have provided. - What does the domu.cfg look like (complete copy) - Can you supply your kernel config - Any notable hardware (eg. motherboard?) - run `xl -vvv create` and attach the output I have been using Xen 4.3 and 4.4 on Wheezy for some time now, but I have not yet tried with Jessie. Off the top of my head, three possibilities stand out. Could be a syntax error in your domu.cfg (review the latest man pages: http://xenbits.xen.org/docs/4.3-testing/man/xl.cfg.5.html). I still build pciback into my kernels as I have never had good luck with late device binding even with though the xl toolstack should do so; is pciback compiled into the kernel and your devices hidden by grub, or are you relying on late binding? There have been problems with larger amounts of memory. Have you tried dropping to 1~2 GB of ram in your config (yes I am aware that it is a very small amount for Windows to run well on, maybe try it just to confirm possible causes)? Send us more info. Cheers, Casey On Sun, Dec 8, 2013 at 7:58 AM, Volker Klasen wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hello, > > the short version: I can't get VGA passthrough working with Xen 4.3 > and Qemu 1.7. The VM won't even display a bios screen. > > The long version: after successfully running Windows 7 64bit with a > passthrough'd Radeon HD 7870 about 1.5 years with Xen 4.1 > (xm/qemu-dm), I decided it was time to upgrade to Jessie's current Xen > packages (4.3). > > Unexpectedly, I came across several issues related to switching from > xm to xl and from qemu-dm to qemu, as well as non-functional VGA > passthrough. I found 2 setups that at least would start the VM: > > 1) Using qemu-dm from Wheezy packages xen-utils-4.1 > In this setup I can pass through all 4 PCI devices (USB controller, > VGA card, HDMI audio and audio card), however, none is working. For > the audio card error 10 is reported, for the graphics card error 43. > > 2) Using qemu > In this setup PCI passthrough works as long as I do not passthrough my > VGA card (the other three are working without problems). As soon as I > passthrough the graphics card, the VM won't even startup at all (vnc > is running but no bios is displayed, only black screen); the logs are > empty, as well (the only line is "Waiting for domain ..." in > /var/log/xen/xl-domain.log). > > I tried setting and unsetting the pci_* options in the domain config > file but I had no luck. Here's my current config (left some unrelated > things out) set up for 2) with VGA passthrough (01:00.0): > > # qemu > device_model_version="qemu-xen" > device_model_override = '/usr/bin/qemu-system-x86_64' > # qemu-dm > #device_model_version="qemu-xen-traditional" > #device_model_override = '/usr/lib/xen-4.1/bin/qemu-dm' > > builder = 'hvm' > viridian = 1 > vga = 'stdvga' > pci_msitranslate = 0 > > #pci = ['0000:00:1d.0','0000:01:00.1','0000:04:04.0'] > pci = ['0000:00:1d.0','0000:01:00.0','0000:01:00.1','0000:04:04.0'] > > > Has anyone an idea what I could try? > > Thanks, > Volker > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.15 (GNU/Linux) > Comment: Using GnuPG with Icedove - http://www.enigmail.net/ > > iEYEARECAAYFAlKkbRMACgkQgKD4KXUzSri9vQCgs5mf+tRxONXsP7Mmsc8OWW+e > qmgAnRrlDZHv7CUihp8ekWl7CN2zxw51 > =bLW7 > -----END PGP SIGNATURE----- > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > --bcaec5196dddce498b04ed0797eb Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
Hello Volker,

Can you supply= more information about the system. =C2=A0There are many possibilities, so = it'll be hard to narrow it down with only what you have provided.
=

- What does the domu.cfg look like (complete copy)
- Can you supply your kernel config
- Any notable hardware (eg. = motherboard?)
- run `xl -vvv create` and attach the output


I have been using Xen 4.3 and 4.4 on Whe= ezy for some time now, but I have not yet tried with Jessie. =C2=A0Off the = top of my head, three possibilities stand out. =C2=A0Could be a syntax erro= r in your domu.cfg (review the latest man pages: http://xenbits.xen.org/docs/4.3= -testing/man/xl.cfg.5.html). =C2=A0I still build pciback into my kernel= s as I have never had good luck with late device binding even with though t= he xl toolstack should do so; is pciback compiled into the kernel and your = devices hidden by grub, or are you relying on late binding? =C2=A0There hav= e been problems with larger amounts of memory. =C2=A0Have you tried droppin= g to 1~2 GB of ram in your config (yes I am aware that it is a very small a= mount for Windows to run well on, maybe try it just to confirm possible cau= ses)?

Send us more info.

Cheers,

Casey


<= div class=3D"gmail_quote">On Sun, Dec 8, 2013 at 7:58 AM, Volker Klasen <reklov@unitedklasens.de> wrote:
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hello,

the short version: I can't get VGA passthrough working with Xen 4.3
and Qemu 1.7. The VM won't even display a bios screen.

The long version: after successfully running Windows 7 64bit with a
passthrough'd Radeon HD 7870 about 1.5 years with Xen 4.1
(xm/qemu-dm), I decided it was time to upgrade to Jessie's current Xen<= br> packages (4.3).

Unexpectedly, I came across several issues related to switching from
xm to xl and from qemu-dm to qemu, as well as non-functional VGA
passthrough. I found 2 setups that at least would start the VM:

1) Using qemu-dm from Wheezy packages xen-utils-4.1
In this setup I can pass through all 4 PCI devices (USB controller,
VGA card, HDMI audio and audio card), however, none is working. For
the audio card error 10 is reported, for the graphics card error 43.

2) Using qemu
In this setup PCI passthrough works as long as I do not passthrough my
VGA card (the other three are working without problems). As soon as I
passthrough the graphics card, the VM won't even startup at all (vnc is running but no bios is displayed, only black screen); the logs are
empty, as well (the only line is "Waiting for domain ..." in
/var/log/xen/xl-domain.log).

I tried setting and unsetting the pci_* options in the domain config
file but I had no luck. Here's my current config (left some unrelated things out) set up for 2) with VGA passthrough (01:00.0):

# qemu
device_model_version=3D"qemu-xen"
device_model_override =3D '/usr/bin/qemu-system-x86_64'
# qemu-dm
#device_model_version=3D"qemu-xen-traditional"
#device_model_override =3D '/usr/lib/xen-4.1/bin/qemu-dm'

builder =3D 'hvm'
viridian =3D 1
vga =3D 'stdvga'
pci_msitranslate =3D 0

#pci =3D ['0000:00:1d.0','0000:01:00.1','0000:04:04.0&#= 39;]
pci =3D ['0000:00:1d.0','0000:01:00.0','0000:01:00.1= 9;,'0000:04:04.0']


Has anyone an idea what I could try?

Thanks,
Volker
-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.15 (GNU/Linux)
Comment: Using GnuPG with Icedove - http://www.enigmail.net/

iEYEARECAAYFAlKkbRMACgkQgKD4KXUzSri9vQCgs5mf+tRxONXsP7Mmsc8OWW+e
qmgAnRrlDZHv7CUihp8ekWl7CN2zxw51
=3DbLW7
-----END PGP SIGNATURE-----

_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.x= en.org/xen-users

--bcaec5196dddce498b04ed0797eb-- --===============3753700295103945869== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============3753700295103945869==-- From xen-users-bounces@lists.xen.org Sun Dec 08 17:25:36 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 08 Dec 2013 17:25:36 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpi5w-0000eY-S5; Sun, 08 Dec 2013 17:24:40 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpi5v-0000eT-0a for xen-users@lists.xen.org; Sun, 08 Dec 2013 17:24:39 +0000 Received: from [193.109.254.147:23735] by server-2.bemta-14.messagelabs.com id 56/CB-00361-65BA4A25; Sun, 08 Dec 2013 17:24:38 +0000 X-Env-Sender: reklov@unitedklasens.de X-Msg-Ref: server-3.tower-27.messagelabs.com!1386523473!3732919!1 X-Originating-IP: [37.17.224.201] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 26422 invoked from network); 8 Dec 2013 17:24:33 -0000 Received: from mail.webgo24-server13.de (HELO mail.webgo24-server13.de) (37.17.224.201) by server-3.tower-27.messagelabs.com with SMTP; 8 Dec 2013 17:24:33 -0000 Received: from [192.168.42.13] (HSI-KBW-46-223-75-55.hsi.kabel-badenwuerttemberg.de [46.223.75.55]) by mail.webgo24-server13.de (Postfix) with ESMTPSA id C08CC304060E for ; Sun, 8 Dec 2013 18:24:32 +0100 (CET) Message-ID: <52A4AB45.8080507@unitedklasens.de> Date: Sun, 08 Dec 2013 18:24:21 +0100 From: Volker Klasen User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20131005 Icedove/17.0.9 MIME-Version: 1.0 To: xen-users@lists.xen.org References: <52A46D13.4050806@unitedklasens.de> In-Reply-To: X-Enigmail-Version: 1.6 Content-Type: multipart/mixed; boundary="------------020709090402000802070905" Subject: Re: [Xen-users] VGA Passthrough with Xen 4.3 and Qemu 1.7 on Debian Jessie X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a multi-part message in MIME format. --------------020709090402000802070905 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi Casey, > Can you supply more information about the system. There are many > possibilities, so it'll be hard to narrow it down with only what > you have provided. I'll do: > - What does the domu.cfg look like (complete copy) I just did a new test without any disks so we can discard the guest OS as the cause. With my graphics card (0000:01:00.0) passed through the BIOS is not displayed; without (0000:01:00.1 is the HDMI device of the graphics card) it is and says that it cannot find anything to boot. Here's the complete config for those tests: name = 'test' builder = 'hvm' device_model_version = 'qemu-xen' device_model_override = '/usr/bin/qemu-system-x86_64' memory = 2048 # working #pci = ['0000:01:00.1'] # not working pci = ['0000:01:00.1','0000:01:00.0'] And here's the output from xl pci-assignable-list: 0000:00:1d.0 0000:01:00.0 0000:01:00.1 0000:04:04.0 > - Can you supply your kernel config see attachments (current Jessie kernel), pciback is a module and binds the devices at initramfs time via /etc/modprobe.d/: options xen-pciback hide=(0000:00:1d.0)(0000:01:00.0)(0000:01:00.1)(0000:04:04.0) install ehci_hcd /sbin/modprobe xen-pciback; /sbin/modprobe - --first-time --ignore-install ehci_hcd install radeon /sbin/modprobe xen-pciback; /sbin/modprobe --first-time - --ignore-install radeon install snd_hda_intel /sbin/modprobe xen-pciback; /sbin/modprobe - --first-time --ignore-install snd_hda_intel install snd_virtuoso /sbin/modprobe xen-pciback; /sbin/modprobe - --first-time --ignore-install snd_virtuoso > - Any notable hardware (eg. motherboard?) MSI Z77A-GD65, i7 3770 (non-k), Sapphire Radeon HD 7870 GHz Edition The hardware worked 18 month with VGA passthrough, so I would exclude it as cause, as well. > - run `xl -vvv create` and attach the output I attached the output from both test runs (with and w/o vga passthrough) and the cleaned diff (there were different memory addresses and domain ids) > I have been using Xen 4.3 and 4.4 on Wheezy for some time now, but > I have not yet tried with Jessie. Off the top of my head, three > possibilities stand out. Could be a syntax error in your domu.cfg > (review the latest man pages: > http://xenbits.xen.org/docs/4.3-testing/man/xl.cfg.5.html). I > still build pciback into my kernels as I have never had good luck > with late device binding even with though the xl toolstack should > do so; is pciback compiled into the kernel and your devices hidden > by grub, or are you relying on late binding? There have been > problems with larger amounts of memory. Have you tried dropping to > 1~2 GB of ram in your config (yes I am aware that it is a very > small amount for Windows to run well on, maybe try it just to > confirm possible causes)? I dropped the allocated RAM to 2GB, but no difference. > Send us more info. Hopefully, the info I now provided is more helpful. Cheers, Volker > On Sun, Dec 8, 2013 at 7:58 AM, Volker Klasen > wrote: > > Hello, > > the short version: I can't get VGA passthrough working with Xen > 4.3 and Qemu 1.7. The VM won't even display a bios screen. > > The long version: after successfully running Windows 7 64bit with > a passthrough'd Radeon HD 7870 about 1.5 years with Xen 4.1 > (xm/qemu-dm), I decided it was time to upgrade to Jessie's current > Xen packages (4.3). > > Unexpectedly, I came across several issues related to switching > from xm to xl and from qemu-dm to qemu, as well as non-functional > VGA passthrough. I found 2 setups that at least would start the > VM: > > 1) Using qemu-dm from Wheezy packages xen-utils-4.1 In this setup I > can pass through all 4 PCI devices (USB controller, VGA card, HDMI > audio and audio card), however, none is working. For the audio card > error 10 is reported, for the graphics card error 43. > > 2) Using qemu In this setup PCI passthrough works as long as I do > not passthrough my VGA card (the other three are working without > problems). As soon as I passthrough the graphics card, the VM won't > even startup at all (vnc is running but no bios is displayed, only > black screen); the logs are empty, as well (the only line is > "Waiting for domain ..." in /var/log/xen/xl-domain.log). > > I tried setting and unsetting the pci_* options in the domain > config file but I had no luck. Here's my current config (left some > unrelated things out) set up for 2) with VGA passthrough > (01:00.0): > > # qemu device_model_version="qemu-xen" device_model_override = > '/usr/bin/qemu-system-x86_64' # qemu-dm > #device_model_version="qemu-xen-traditional" #device_model_override > = '/usr/lib/xen-4.1/bin/qemu-dm' > > builder = 'hvm' viridian = 1 vga = 'stdvga' pci_msitranslate = 0 > > #pci = ['0000:00:1d.0','0000:01:00.1','0000:04:04.0'] pci = > ['0000:00:1d.0','0000:01:00.0','0000:01:00.1','0000:04:04.0'] > > > Has anyone an idea what I could try? > > Thanks, Volker >> >> _______________________________________________ Xen-users mailing >> list Xen-users@lists.xen.org http://lists.xen.org/xen-users >> > > > > _______________________________________________ Xen-users mailing > list Xen-users@lists.xen.org http://lists.xen.org/xen-users > -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.15 (GNU/Linux) Comment: Using GnuPG with Icedove - http://www.enigmail.net/ iEYEARECAAYFAlKkq0UACgkQgKD4KXUzSri9xwCgkDbPIZ3j5Ks1gxOllEmNM2p8 5JAAoIekcrJvY/O5j2OmgWI0jNtqPX2T =1A0F -----END PGP SIGNATURE----- --------------020709090402000802070905 Content-Type: application/x-gzip; name="config-3.11-2-amd64.gz" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="config-3.11-2-amd64.gz" H4sIADWnpFIAA4w8TXfbtrL7/gqd9C3uXaSxncRNzzteQCAkoSIJhgBlKRscx1ZSn/ojV7J7 k3//ZgB+DEDQeV005swABAYzg/mifv3l1xl7fnq8v3q6vb66u/sx+7p/2B+unvY3sy+3d/v/ nWVqViozE5k0vwFxfvvw/P3N9w/ns7e/nZ7+9mG23h8e9ncz/vjw5fbrM4y8fXz45ddfuCoX cmnP382lufjRPW4/nAMoeB4eZKlN3XAjVWkzwVUm6gGpGlM1xi5UXTBz8Wp/9+X83WtYxuvz d686GlbzFYxc+MeLV1eH679wqW+u3eKO+De83t7sv3hIPzJXfJ2JyuqmqlRNFqwN42tTMy7G uBXbCJszI0q+MyoxuCia4aEUIrNZwWzBKpzWiAinlw6di3JpVgNuKUpRS26lZogfI+bNMgm0 tYDFSVhjpWRpRK3HZKtLIZcrsmTHwoLt/OYqbhcZH7D1pRaF3fLVkmWZZflS1dKsivG8nOVy XsMe4ThytovmXzFtedW4BW5TOMZXwFlZAtPlJzExmjXA9FrNRXQiWpimspWoPVUtWMToDiWK OTwtZK2N5aumXE/QVWwp0mR+PXIu6pI5sa2U1nKex0vWja5EmU2hL1lp7KqBt1QFyMEK1pyi cMxluaM0+Xwg+aSAUyAbb8/IsAYU1g0ercVJqbaqMrIA9mageMBrWS6nKDOB4oRsYDloSsRv lK3cmu1Iza0uqhA2krRW/ixf5GypL169/oJG6PXx6p/9zevDze0sBBxjwM33CHAdAz5Ez39E z6cnMeA0tCdOAlDMUFwF0+OzbbnUOCqiZL0lAlHWYLPe3N1+fnP/ePN8tz+++Z+mZEU/55vf IoMk64/2UtVE1uaNzDM4MWHF1jAQIqu9sQFj++ts6az23ey4f3r+NphfOFZjRbmBpeIqCrDF b886JK9BHC1XRSVBJF+9gmk6jIdZI7SZ3R5nD49PODOxlizfgEEBkQ/GUYTTz8RgJzNr0BgQ muUnWUXS1GLmgDlLo/JP1ApSzPbT1Ag1hcC7qF8+WRVdeIx3a3uJAFeY2Dld5XiIennGd4kJ QcBYk4PpUNqgNF28+tfD48P+370U6UtG+Kt3eiMrPgLgv9zkAxzMlNza4mMjGpGGjoYsVqzM AsOG9id6xEFgQWIjdclMYKUc0NRCUD55aK6WsmwkmCy4W50WTElYf8OxOgNl0p2iwN+z4/Pn 44/j0/5+UJQEeXz/gkZG1w1F6ZW6HGPQ6oNhRYr0ML6iGoCQTBVMlnTrA9Rb4sSWkQRcIw7G 3KzgxssCa64rVmsRLoKjy6NVA2P8AWQqtv+UJGMm4Xo4c7QZHWvvBeAEYiNKk+AnQXrb9hOS WrGMM21eJiuASSz7s0nSFQqtdOZdLycN5vZ+fzimBMJIvrZwr8K5kqlKZVef0DwWKjgiAIK3 IFUmeeJ0/Cjp9aMf46GLJs+Tmu/QKemGCxOuDe2YX/dyDdfUG3N1/Hv2BFuaXT3czI5PV0/H 2dX19ePzw9Ptw9dob8454lw1pfHC0r95I2sToZGHyVWi4DkpGGgTa57rDHWHC7hvgJAwNMbY zdsBaZheo6esQ5D3KaOJHGKbgEkVbtNxq+bNTCcOHYyOBRzlRgWwojIITuwMoOjM53lCKBDX aHAiP+qJkQtWQlxzcf5uDIQ4gC0uTs/D6VqcgI2mLmZPAn6qEx66lm5n1sUyyaNEbKn4HI8+ fdZr/0fSI0AHZQFWUC7MxenvgSluIK7zDgu49ZlX1yknqmwgBJqznJV87JCiF6xRXIyn83+B kgZqFcyQWCtf1qqpNB3jQZPWtUUvgIefaEzaD9tITq4F4B/EIERoUcBtBbeWx4wmAHAouKDe 3uw6uQ0it0IUfBk92gyCQ2BwFsPb+7/f5wAFp9CNSB60J1vDP0l0u+o2DJnmF1jExWivTgaI 38BkbUPM8J4FmH1wKy5lZlZpkTV0bMrw5Ov2xXRiH88MuPQuV4KvXeSMx2FUnXI10OuC25VT t79BMSbP6GHRZxQE+lwKEzx7LUHvuVt4dyyFVZelE8B+lXD3LjBAAyvF4V5L8aAOI3DcNkis Cw1qchLumRUwm5c9dOy7GbLIUwdA5KADJPTLAUDdcYdX0XPgfHPeR6ToyrjIP7Gb2PEEg1jC 2lVGj8CbHZmdkuySHwimk4vKxerOEkZjKq6rdW2rnBnMNNH1iS3Ic8rodu+hZ4Jvat2iVCAA YL0rAhPUwWx6SFWDIAbRIDECIl+ApaBJg/E+unEQbDqfg6hgYwTJwohKUayWy5LlCyIozu+g AOd6UYBegekgRyQVXZm0HxtZr4Pdu1RMlhRffy7wRtt7ku4Kb/OO1f7w5fFwf/VwvZ+Jf/YP 4PIwcH44Oj3g2g13ezhFZAscEmyz3RQuxZFYx6bwo6lNDgJmZsBJXadENmfzQD7yJmU14ZZY yDy49ZyIOhtEhFt5QnFxP0zZwdolFhAVyioX2yl+9nOMZrVlIf0RD7h1n9noX/hnU1QW9iVS wgp6HOdCmvEUbiEuPwwyD1KGRo+jIzi1aLFYSC5xf00Zjoj8BDxIDCnA4wMHM4iB17UYrw19 NIA3dQnehJELSTfvc1ygXZi3RY8jTiXE03lo4j0t59PwdhoIOewiZZncxhxipdQ6QmLemBlT h5vqAx8NZ7USeZVMASMSQ5M2cIxmrsUSTFKZ+UR4y27LKplaQSW9OkW41SUohmD+Mo1whdzC KQ5o7d4YW/KfHxDRbpTgFDYxcaf2dbu9rCnifJTj+yDtkaQ5EtQYzRbgrRUV5sajGVqoT45N 4DLVTKSFW8uCToSP4ru8W4JW5RmhT21EC44EFjTdUB5Owf0iFdi7rXHStw7sk9eNcQg4Ibsl JiJEm+vGdHJyiWphwKGtDfFZCpU1OSgHCjVedujSENMF24Zrqk2yk/ix5UWLZ66y1F0fS642 rz9fHfc3s7/9TfLt8Pjl9s4Hyr2RQrI2CZf0EoNcEyoBVyuBe5y4B2S5oF4QmmrgLbUG7obW eA1dnET7jxniUz4gWFRtW1RTJsF+RALZilVgodsxuuZ9TnciWdFRJoNDjcWxgvGVLMmJz8Mw sHNL53qZBOZyPoZj6WFZS5Nwb8GaKWNyEvNXV4enW6xOzsyPb3vqGbDaSOcSsmwDYSONTxj4 VeVAQbkToSyHwLNkSfbEpALiu9TdHNNJrl96I8sW+v/1vkpdgu8qUm5NTFpLzeU2eKvcDvjU ba8XAYO6YQWoXBJhWC1TCBCRJFhnSqcQmDuCyHcdGeYCIpmt1c08MUSrHF6uXTEqgW5g5CWY qNS0eVak5QARU5kDvUzuFNyzmnKVLLApU+A1q4skM8VCpleFuf3zDy8enNPA1kh2SiLVTF// tccaFXWepfJRaakUTVe30Az8hjxQ7g7DFzTlvPjYhustOvTDfS2jm+uFcoefdDQS1/bCqO6d r66//KePbLvkXudV0DCdhTlvVyQFE1eBU4n2E1gXJNRbPPpQLf4lXHLsJZgyMTWYIsPR7grx CwMF7lIEXXTXJ628ETw8Xu+Px8fD7AmMoMsTf9lfPT0fqEHs6slELONK7vYMvD0eworKeSj0 bBAMrgNcy1hPb6PRpMlCSl9JzqtkCIAEfZoQ4ktV7zB7lDc07vVSpwqIKRY11lfb1gfiaOzA 6dtIrWq7bAQtE8DiGaa+6fo72FjBxyR4AK5iklq8IDoLD1jPOQkhEOFvIP5awvqjhTnsZrUp QlDBtl1ZyLPj4v3JCSXQ3oF3uavgUERbSLKL1FoLyWuF3TfhqtcQAHcLG2/+5zWAnjTK/5bK zpUyQcYAHkz0pmL9Ie15VJqnEZgRSZdpC2ZUkVhiXyiqmlCynQxhjqltTfFp7nNKkp9O44yO NKV1+6NOKCxQbSKVgrusaApXjVnAjZrvSLEACdw5cpMXmualgVqjmUV9GoNZkY2BHHxW1lBF qYSJEwEOJooGm57AeSW7ymjMtYRLB+xt0P4EsQ+Ady+Cu6S0ne86s01U+1KqoOvFD/FxbSAp bAvmKpWsde08+uL9ad8C4e2FLkxsQgoeiHl/TSQvpg69UTmIP2wnMXbCormg0I5tKVatRsBa wO1pfHp0Xqs16DGqjg0L1k5uaP6gBcTi0IEDceiAmAzQK5UnULL8U3BzcR9IOAQ9ELJAcMrB 2pAz+rAeCHvDkgDFixsQwfIGMAZ1Ti0XQa4kmtD6sGGQjQgtWJ3v0jaCLmBMR3kCqhcwA4RM ZgPIRbXVaqfBX89qa+KeSN+1iPmTJBpCYWCqXc4xYKZlg4Ze0LjIENL2YDFeyQjjkuXYFADO Ah6cjbLnroImgt5FPyK0bD5ad1c+2OtWd6NtDeiRPrf5iBw3117nEEWOMiwtKuq88DzFstoa zbzF/ASRuhzuUZDG9vK3G5Y34uLk+83+6uaE/Ner/EurGLYA4V3DUhjCKOwb7LKvMV99wqvb j9CCZsMII7emhj9SqA38r+iLdykKl722frWVNWop8IRfmGu8vCgwD8BuSzYY5sUXokZWZ4nh 7X4lRl5xjALXnasL46RTSd/WN7CYOHGEo6lXylR5s5yCt1tOoYHNakOrJqBhrhGx91kp43Jw KivjYya8Rvp7eI5MxwQARlI8jM9SMAiMaxaCXjAPnTNucWUXp/1LwdOihs97YeBLNTRNVDSJ hOlaE4ntwiMnV757Jqsvzt+/fxsp+s9c7yn46hLUULsiXXhvTCQEScvCGA/yfcl2Ka81SV2w DFx9Wpp3LY/tUpkxzDWeDWWcXLDSuXHJO2FRq9JgPSGJ/TRv0uV0dydgNdnOIQjFSl3dVBMx ub/mNYQomNe7JN5eYWpyhvgEDn4JsX3QkhDCW0PRG9+TCTLHOEyQo4/UEZ/SNfkUARWIRsOV UGHOxDEsi9BwHBCchNeRDgyHWMjgwWrTEPeuTUmTs+M+S481mM7NoA1YpycnKSPyyZ69P4lI 34ak0SzpaS5gmtBHXNXYSEX0SmwFp7LG9KorKZCGTiByBYWUIwlmQKJDCBuFQPTk+2l4UdUC /UUTGv9+kKuJjQd1dtBHNf1C0LBiTFZQgjRbfLD4U7I23b7JdLqXlRcus4NvTlUNndi0Ajtl 2tM0sR3HMgEEBRjaOF/GXVoy63Mgj//dH2b3Vw9XX/f3+4cnlwVBP2n2+A3zwyQTMmrwXwkW fJbSFh1GgHGzUDcLxpB5PgdB1mNkeCkUIAcZSe8NHRmIyoWoQmKEtKmaIfwoXCuJw6XzF4W9 ZGsxlbkAdI0xPXVIqiJ4b1Tzwze2efQeRd+GkX3HpvQL/UaSY92XOBB5Jrdy+dFnukmluDVm ycQ3LWI6N7ljKcmjAxTdzMk8e4/3b56mAqV3G/rZTL6IObFe+B+JKxAwh0tMQMAZQRtjQF5C 4EZmQkWwBYupsrA5D0HyLH5r27Gp6gguq0JGoND6JCexbLmEu4eZ0XxtWBlB22gm5B1vtFEg izqbZJ7veLK+FxEMRl1L6k56zuWgmPi5ht1BzAcXZviWqTy/3xBHEVLRdzAotWEWxa8XXAkm yxG841eb0osEdK5j9oZZdMqKAlx/ldIwv9El/VLNC1clYo1AkF2uaBQzwGG/go024FAjZzBc oaMR4BBO64InwW+uJmsrzn/omp9ni8P+P8/7h+sfs+P11V3Q7+yyZ7WgpYgWYqO7tIcv1Wbo 6I2R2JNMu28CBKwXDjZPq3lP2bnd+B7sQsDPGsuJxtzkIOxacJ2Hqf7L1AAF8Qy8I+ywTBEC Dv1P9+ngS5NHS59gojOLmIkeBDfA9/uYwJNlp89oWCzM4KQBP05FifgSS8Ts5nD7T1DXGqoO VfRJplNd7nLBTnSCDI9Xs59h4N95NCEyo1SXdv0hGlZkrQSJUsNlv8GadkAB16XItBE+U1vL UoX46p1PrBcq6/hw/OvqsL8ZOzXhdJghC1gff6fQwYa8RlZLbAiYEA5Hi2eTQygporR0jyxE GbijztPC9Ike6LhqqjzZFOjPrF2p22yxv388/Jh9c77d8eofOG5av/wdXH4/qVQMv+NkZUmz PANBx73587Fj3exfYOpm+6fr3/5NugY4MZZo+n2iLoQVhX8IoUFdxQ11ZRwdAAWG20E0310N OAIJQnIWZsERBE5Hnar5t+SjiNzBdVXE8yBs0gwTgi7DNx7cW4G0C9qTpS0h3VJVjHKMfWZC RyfiAfQ1L+0Cy7Mue9bGF+g2h/O5AHXQOizLcYnNJi4xgGFAj1yZsEaLw4MPWRAgabnHnWod 7aBiWmbxoLAwgLCuVcGHNyCrfz0en2bXjw9Ph8e7O1CIkeFrvyYPO/lcEnlOp8akHpWPgksW P7v+I8sl2RwO86Lbruj19dXhZvb5cHvzlRaad1h0GuZzj1aRtnIPqSVXqxhoZAwREFuahrYh tJRKQ3xFEuBVdv772R/De+WHs5M/zui+XDKzVPjhiqHMJiqY1sswqogxVs4LIiMEyydnRIz9 ZN6/f38yPbQrXaYp9Kri1F+p4dQzGQTp7pzE9/3189PV57u9++2HmWusfjrO3szE/fPdVXSN YC9bYbAfL0p3miTK6eqAaBNE2O1fUVPm0vmYNOl9EiT2YTftkvMTaV7LKjA5vpFQNakooB1U SE0YhS8M+z4le3vWVjmDeNzBceqLqMNh+/YsdRd2jTUhb7B412BhBrM1RVgDaL/HjUeuxU6P gG6jri+zUmsx7tBAu4QarqrwW5PRggCWy3INN7LWbYnJSUO5f/rv4+Fv9JtGLgQ4bGsR9E7g M1yBbDlwFrupSFIGu7JCgu2CfpqAT+43JUIC5yFGIN3MYde55LtouE+th90ObgDqsQZVTjZn IAXwHbON94RTyPcRgLyi90UoJ2Tl/aTwU1WA9jkRV8OtA9xCzi34dMJGXzt2k6HT5SKVEOer wZ6C0d8M6XHgps0VTYD3GJ4z7e+W4fu+ylZlsnAusKFYRtyR1RJVFRRlGyPQDKN7NaZPTZH4 tBc37taZAL3IkkoWurCb0xTwLPQ3q5RjqXdYx1FrKUKtgWk2huQ28NAtW0UAoasIEouVAzqB i1nkMEmgl2zMYfoiB/7swyTFyxPMhYjH5rWKIKGS+nXxKgVushiMhPDnMtFK26Pm9J7qobyZ 05u2h18KbS6VyhJDVvBXCqwn4Lt5zhLwjVgynYDj51suPTBG5an5N4IGZT14J6ic9GCZg9VV kry4729sOTHqcKzhBS90OHZTX7y6fv58e/2KvrLI3msahoA4n4dPrgGNUYvqoN5aYb16kcLY sKHdIfxnfGhtbcay0FCej5TmfKw152O1wXkLWZ3Hs02q0vkE9KfKdP4TbTp/UZ0o1jGo/abR uxLhfiDQH0PsefBRJkJLrK67IobZVSJCjpaIwMDQet5N20x8bzPHD8Rj8NgE98CfTJiyuOhn THwwBij8sRus+RXM/egNHeVQ1Wrn8qhwQxZVusMQSPvvV+h4D5wM/QaKsc2a1zJbimBmn3B8 POzRQQI3+QnCq4kfPxtmbn2s4PYLUf7nDF7A+19jeYEgV8QOl/hFaFm6T3bSUNtyOoUaziGF xY4EPYHzxZAJZPxTIAESD9f71lNYd/QTeCdZ0dTGfa6nbMbpdUAxoUNCEJqbiSFw5eXSiAme MkxVsgnkIp6zx6zenr2dQMmaT2AGtymNB7lw/QalniDQZTG1oKqaXKtm5dTutZwaZEZ7Nwmd oOBeHibQbd/nzxTG8lCiShbOWLoASAStPi14QngGVEoUBuxIhBCVkA8Ex9xBWHzwCIsZjLCI tT0b8DPT7S6F2bYmu010bl3Ef5xdP95/vn3Y38zanyhL2TGINp1hSM7qzvsFtHaXZfDOp6vD 1/3/UXZtzW3jyPqvqPZpT9VmRxdLlk5VHkiQlBDzZoKS5bywvB5n4xrHScXOzObfL7oBkmhc 6OxUJRl93QSBJi6NRqP7NfSqNmr2oGZjKCl/mZoF3WvEsXiDC/c8WUAoA9d0KwyufpqcZnyj 6olg3u83chzyN+hvVwIM2+oUcpINQohMM5A1xsPwdlUkBm5A0zzZmy8qs35B9Cz1BluFE9Dk sj9yw8Y+FW98sCbVlv5JLlnQGwwT43PgacjBmI/ll/qg3AEUQrzJI3VV0TY4x5BR+uXu9f7z xITQsgO6DaJ66n+JYorrbJLO8qNog51U81QFWs2mecoyvm3TUJNHLmU5f5MLIye+xTXxHUYm WyPzcNXHSbq1InkY0pOKHDPJFJ52FEPKymm6mH7+EInD23ILL+Mjy/T34bXcx+2n+53ck0x3 BR10d5LlzbYUpneOl/5G/1B7KrIj9XCVWWirMLBUYnqcqTuCUxzaujrJcrgVsqtN81y1b04K 18fKPATycExPy5onjfLQ8t9zsLfmDUtn8zBUaPeeZEE/grc40DzyBlcDl9enWCandc0CjntT DMeVcfDFa62kkd9wo+r9cr2x0JjDQt7x2uEfKGREUKJleFE0mDN8BWp86hmgTT9ZelqG5ClC +JWSyDOyPGsqeo/ZYjTnH/zZW+BM6/tJhAN8IlUq7iA/8X6x1Ne15cQ2e/1+9/zy7ev3Vwhh 8fr1/uvT7Onr3e+zf9093T3fw/nNy49vQDeOf7E4tVEBY+lPH0Hub/yESM3+XlqQEB38OI65 n0ZzXvr753Z1m8aW4Y0L5cxhcqE89mNOacnBRoSLmEqzgsrrXoXCFolDuFGyJw1fdWs8c/ft 29PjPRqUZp8fnr65T5J9n35vxlpHyqneNuqy//8X7FYZ2JSbCI15FyHDRJiEfqz2eaWsjWTi 9bD5JLhWIg+mPm9SpDbiHxUDR1NrE12ghLb1WR4Vx/AkQQd9n3rJEOLRtrrh1p2IhvAXkZD7 liZKUreeZIPkj8BJ66X2Ib69jTYXlEUN8WS4a0nw27+QYpt+AKQGql6s5T5PA+3Umrw1I490 ol0SivxONqWJbmxIbnuODXGSU3jUBDpYZPQPmzA2RY+RPzf/6yjZhEfJxnzjJjQINtYo8BHS I99cBGhQkQAJtnUB0iEPEKDe+q6Dn6EIVdInZ5PcOgSPmUNTAiUFB+bG3y83nk608feicQS7 n803hL0cZT0YupKUPT+8/kJvkowlmjXkoIxi8D0xveH7c4isS2O772iaJIBJ+GgqnwapdYRJ iMQualC282W38lKiojLVU5PS1F6ch+CNF7c2XAaFbqQMgrPdMGii9b/+lJt3IGgzmrTOb73E JCQwqFvnJ7mGI7N6oQLJAmPgxxDBMp7JWY5aDNQZPxtP9FVHlcCMMZ68OD3UXH7wOWBbTqmq A9fK0nBHwpuPt1nD9PX9sYI66Ofh7v4PK1Bb/9jEKR8yqIvkRGe3N32I9HxjQCUJdkm876r4 A/PHd0OO/hAfnUjANsvg8N2UQ5BPHKKFd90PPhEISIH8bg1CVHjvSG4SY3KRP+SfIqKI8q8Y /QmT8Mal5bXp7YFxDMFb9/12sVsQuJDDI+rMMG9Ra+zo5Q+pVXDy4h6DIDKcea9UAktOjqwA KeoqokjcLDfbC7twhcpeoiZPX+Tzpdl74Fd/z8tCzcD2CHD7udS0QJHpak+m1MKdX52JgO+l 6icgJBYJx6ipMOfp9cCN1ogjRRjussgtF4KFcddhxLr9qal9zF1BCGqBMwWslzzlYeITrblJ kz+IoeJM9eezjtHj7QFRbiwX4BcZ1XWeUpjXSVJbP7u0ZDSA+nm59lU0qg2/8PpQUYtCmqYg kPWFD+s2eXVT4xJkRLBhihiYx/rgaTj/Xf94+PEgJ8PfdNw2cvNJc3csvranOKn8tbEHzARz UTISe7BueOWiaMT0vK2xzpYQFJmnCiLzPN6m17kHjTMX3HtflQjH/oq4/Df1NC5pGk/brv1t ZofqKnXha19DGIYXceDsOkSRI7RJLTOfkj9cjdbLN3u6e3l5/KQtBrQDsNzyZZSAsy3UcMt4 maRnl4Cj9MLFsxsXIzZFDdjZADRquZn0LxOn2lMFiW48NYA4CQ7KrOD5JUauopmGRkxFFjBy YxkkZrsFaxxPmLwU0n4DL1LL0N0TMHyNj8CikideCq+FZYjGZkfE3wEOz8FzBYz5VlUBh5C4 5iKjnFxit4CCN86YApzXrQtSF4u+Cql9ho+w4LZwEb2K/ezMPuLHNnPzduAwnrjpl5gwo1VJ KTDDBmQqMxZOOcdFGALWh8HFYGMZHfHEtHEZeEk8OM0HAopSVaflSdxw6KFfPCAaa8ZlVp1E GLPCqcDIpaeCcQ+17J38SQiOHqU+vCDCopaC3QszVrF5j6DJMF0PCSdm3TOAmbIfhaTo5gxB am47mmcgvjZ/1Fn3gVs9Gca53hTSGwqz14eXV2fZk3vBfUqW1VKdcqNmH9ohNBCquCo52X0f okJu9zGLgY4kfP/Hw+usufv98etgczejRkg1gWiS8rfsKEUEIaC9l2rlu5vK6NoNOO3rqT06 /1NqHc+6rb8//Pl4/+Be6CquuLlGbGpyzBzX1yoQlNG1b1lVdBD7PEvOXvzgwevIKOM2MqrM zG20/EENLgDEjLJ3+5th+YrKWaJaltgtA86TU7rIHYgcRgLAopyBZR08cGmKK6DmaRK4pC2J BauX64UvRnOtpmWrNh8iiLriBeGundkbTJIvJKrBlhbCuXQ34pyCdRpdebk1wc/OScgaiV+d Ivj4Ln9+1iBpCeR69acGQyq7vCTBYoavfRTx7BFSdHy6u3+wvjY0T9KtNosEwCVFdW0dbmyd g25B+XdQiDhPjloNUC45dotVNByV9Ml3nYg36OGnTMnfk8g3Q/CGWJ14Q3cMDTi5kA2OLBOj RkeOMPEVzgUtfEDn0YWEYLmISJ5BScVEYQ1xlkbcWaDUa54/fYfr5O/woNGZhZBH8CY4P/Gm bW/let8MBqevz/9+enCPJpMKzbdDXVPBe2zcsLOWi1vh4G16BQGNHLjixWoptU2bAO6bagG0 CEW0kaPTRve8iXnuMsu5YrF02SFEZZzmV5C30W3Acj53i4L0ChAC3MFFEn38CFfvHcJuvRtR lGw28Rlk5+87qEYE30uNMs0hw7GxUAtGgRtexlWZUFAUkMWSWaxRzilwyoWN8IgCBRMUiE1r qOynmR4SNtS1JPp/28VlWhM+AGT5Tm6LnqSOwjxUVrS0pANPhoPU+OnHw+vXr6+fg6KGBxiP WzLf9KBIzH2kQo9R0/qw7nBB6tXDMTPP2g1C1B5WV14K0bhGeHXDTeVSV5IVy/nq7NS9lkuX i2aeZiZtvnCbvmIOlh9TfdN81Jh76UXepFuKfDqYqxRY35tT7gCdI2wloLHDZlIpbegd6R4L 6uvN+SoytkRwhbOhSTpAqDnJTtQjHQlXepOi77T5BRCCY3QLEvWtw8SNIAIs24PlaEHU3hwh jLtVWJE2x4VNPwjrWppXkPpcbicgKXhAR+r5IWhgMG/iWKgyXVtZF0dyODDWwKTse1EOb0y8 WQd7zhsi3ZzHvUgspGPNbd1K9jpIY2TzbxHbK2qNHsgheWi7nlGVHsGk9o3xtQdCwyAqp2gb Eh3ZQyXJ1U2GIcLnZDF99I6/fXl8fnn9/vDUfX79m8NYpOLgeR5UafPLDoSpL2sWChfP0dvZ utkVKBGjx3gEfMPBVe0L+amfyKFfv9+OG9grnhtThfrdN4SCvKyP1l50Z+1pdzUGYLVtgxLW hydkE7rzHFMZKibPfL07rQ86Vs/IqjG4nSmXwYkye0aIjGiaP7y+I8RbhHUlVfo1BOkOvO8C upyWHQWyfLj7PsseH54gOd+XLz+ee++mv8sn/k+voqaPuSynLterFa2N4GYEDYwQPBgLlF5p byNVuqeH54fvj/canlW2vnxUifOUO3KHt+nHaItyTmyLOrPyBiqsKyDlgTfrEVz1ySszHon8 Tvgaqekoa42V+Dq7wWAq9AbjwCz1SDcTVa8ln+XoGViNug9Fqjxnbrh8vZ3BkE4T0T9lexvv dgf08DGphlmykU5hYrskp3Nik1K/adBBiGMhDrJhCWQZzsZ7mBCkyek58p/SikM/RlY0oyO3 ROOQP3GN9ObEkDT5doy2D/E4DUuLSVLn+xD5TkXBfregxZMiMIshxnMNpeF1noAEMlUZilgv 2fsQq8geaEfUXA5tQCEeX+SIKNSlL0ye2YJDqYr3MsvvflI7kywhzq/k97RkoFrsQp0ZXyAz nbtK51fX3JgXvAm9yRL6uBBZQlQ2UQBDoNUVxEEhtcPEkFoEctf4W1MVv2VPdy+fZ/efH795 LGwg34zTQj6kScosnwLA95jRxXIh0CWgGbjCCNChbwQjII7kxhRzH3cL0mlt6nKSSpLseuiB tCqeSmx+ldMbDqdvPLcag9jSriSiF+F+DuTt1FsgQBw5VRmEXySiTVxczteRix5bnltj3TR6 IlBZQBQLddFABaa7+/bNiD0IQZVUB7u7h0xMVv+qCkjbCgKFg3s6WeGNC3V3jghDw9rjNiAU wdbLOTOPuAGV2ggSKNqK9XpuYSJm3f58tt8tpXm5OTeVP6kTcHB2mKSnIl5O0dnVdn4xWYJg 8RKi44tDoO2yla8PT3bV84uL+d5n4UWZMmugD4ZVKnoVAQ2SUN9KRSCg6MJ8UENGlyTxaVwo JQxoeIJcHI314jxqVZ+jtR9u3Tmalnh4+vQOgr/d4XVeye3aKGgrCrZeLwI1gyxoKFy7BgNB pyaT+gPPwkvTyF61PkcdnEeW63prdjz5+3xGrVVZK0mCWvz2ol2urREqcmeM1gcHkn9sDGyH bdVC/HX+MX1/Md9tLGraYHZOoC6WW7M4XOuWSqVQeujjyx/vqud3DMa6o5RS0VRsvwr1XUi+ mzJmS7/HwQY38WjwsZiFRotcRnXkW9+zSQq5l6cqyxNroUVUxfBzcci0WJXswJ1pzSKr5XSI 0TFVA89DCbpQzKffEMctduVgH1YPyK/l88wZGFiUpZ6Wwl9q9+KWOXEOhLNsHh0Ta3WSGwv9 gV1Qj0U1MO2ltefR6nmwsT1feLj2HMszyHkPw0nr5XkNE9Mn1Ka+qMisXn0K+WgTrjHTi0el OsbcAbqb3EhVZQ1YZIjTWB8aL62vD1SYVUKXLXqefX5MY1+Pl0o0vR6mgc70eOwxufniGMl8 DEc6cKOzgj8y6sgjjnKPxX3xnwwmd5XqiftAmryeHp2328vdZqJ4OeEZdugeLSts74iXNP1A WQ8mGxVe0Fmuavd4TD5FA2nqrL4O0GWJ1VjuTSXUs8N5pxAw+fN6tTybZuwc0vpcd+Yw6zHG hSAEBAQTvGsjMyJT/5okYrvNnBaER49FSsZ/j7PqRs+5E3XPIfeqUySgmLcHUy++33oKB2Nl lfuzow41bmIiSfjd6cSpGCU4lEJWPV7GiVu18mTePe3RSnhYxXnrgmR5NkDd1MXGR1Nr82a1 vXAlceY+EbCkAceGq5YlJ6NqBNZmB2HKlzLcOGmDNFsEIW1PkJTCdO+F4MFqG+0JHmwQIU8I oSkzI5B9HengWxcH8fg+UiNwFKityuPLvWtOgZDkVSPgXusqP82XZmq7ZL1cn7ukrlovaKWO MAiiJkbF5FgUtxAx2XeeHhddJIyuUB+isjU3XZBlmVfM8E5seVaoIxUKXZ7PhvWdM7FbLcXF nJyXRG0hVXEhfGpVWrK8EscmhfkcLVqGMbLueG4m2KgTsdvOl1Fu3r4S+XI3n69sxNyC9QJv JYVE/e0J8WFxuQ3glx4ca7IzD+0OBdus1oYvRSIWm+3SlBZMYpfrhYFpDzOd7szoSkU9367t 3/rbj11UoZbZuP+kGE/gSKzbcFStXd8yEe0utv6sQ1JzauWHkEptveoU5r9DIWcH3+hf0jVc /ZYdUrJHTbdc4AdQ4ZHTGrahjseCwmW/WRo9cATXDgjZCc3gChouovNme+my71bsvDElM+Dn 84VvxWbx5WLed/9xvkI0eFY3UuVoE8dC2ad6ha59+M/dy4zD0dAPyJn00mcXGC+fP8nd5ux3 OYU8foP/NTc5LZhXfLZjY2rR/UW5vMFNubtZVu+j2afH71/+kq+a/f71r2e8167iU5nlR3B2 H4EJp/Ze8sXNdZGS+K0a6sw1yvChtA4ZVKaY0VGGahlq2y31gX6j7fQRVBYKM4ppE/EEUtA1 xuwAXPSXlYYbVY59a/FoN056x0jofEKZq3FhTXUVVR7wv8vv9sc/Zq933x7+MWPJO9m9jFQH wyptLo+HRmGti1XCRIenGx8GUVMT01Q/FLz3vMz0jcUmDhOyheMthC4/lpbwGMZ0J8cAiOfV fk+uwiAqwN8rErfozDuKru37/Iv1gQUkrnE/aZexECw/pibRN3P82/eQiEQQz3ksIv8Ddi8C 9FBBpAozpqIiNbX/DRIP1TevbtQJ62i+V52V3DxECM8zxK3I7PLZeR+vFJOHcuGlxOV5GSSc pYQrUwVNlxZr3w9XN91Z/oeD0iroUIvIgiT37mxuHnrUFX5EMygoLGKe90ScXZJCNQBnOhDF odFnaOMZds8A+SIh7VAe3XaFeC9XrDH5X8+jJnYnRy+hFpG4eu88CQ4e6nwZfE3K1plleka5 A/deRdQsO7ttO0/bxgsYPcdbjdtNNm430bidv3FWvXcX1OitoXBWKpx9TqonUEEhOnHybzC1 srZ56r9kikzHwlkoalC3K7tXgblMDjYbbhhJW11IjQQXpDK92ZvZaQaC6Xw3ghHP4+rsodgq zkBwh4jUNJZBFJQiuRQoc6slKc2hp+6grOp25S1+9Wbxq18o/piJA7PHsgJtd2lCChv89Kwj 1a/antOOQtaGM6dQtKtjtmtPeVqpqU906lNn9nL9rppoT3xiY9MDBH+ak6j7q8tK8yqZVlvO q8VuYQsmjVp7MgVI9vf9Pk10jOOfLh3UmxSPxyCAqr34IAt8SVmMMOwCSjbHFvZrKsWS9e59 0toKhVwg7JHFa7v3QCZBbg81CYJTv/Nx6joKD3deBLuAaFN7iRG3xXrFtnL6WQYpfSb5VAjw XwePvzGVr83bR473yG3kGiQ7JiO2OQpe2QpM3TiSkJgKaTkhD8mS+JPjIv0aBwDYIueWBK7z qMtIYoECsKW7UAOnT2XI68wdWgDqJSTzur9gb2er3fo/9hCQ4NxW1VVSU4rVhU8fqIvtfL6w P3PjzAkZbTaCti+aUqIOaS54ZQ1gor319uPRmqvPNw/RYr005KjxzB5VGr/upykKqw5DjpaV UOxBmBy6JomcOeUANhZx48Jp4eGN8qM911QiUWOXRlcZaMfc/gqAJqga4GYVhhLtH8gQygra ElM8zFIqp1SZSK0wYCvUKVu6tGnMbRGQtE18rACAH+sq8SpeQKyLIbYaG7KBvcz+enz9LPmf 34ksmz3fvT7++TBexjH2NPjSg7WK9aB3DaNsUtZssVn6DtlVMZhnKyJe3EgQPDeNKQhl2bAJ k7W+t5tz/+Pl9euXmZz+fE2pE7kFI3Es8D3XgnYEfNHZenNcqE24erdE/BVANuMSIIif87Mj uwPfH8BZJiSU4mRVqLQBsP5wkTolN1KcoVKF6ceiEWEjpxsLOeb2lzlxW4Yn3sq1Zrh9Uv+q gGrsAeYLFFJYRzqANZGA22Q+x1jN0JraksJaKX0XrLeby7OFym3I5sIBxZp4xgzgau5UEGG/ f5Si39awIIeqL5fhxnqRVABXm40HvDw7bwf4vPTfwhsZfB4GSOXtdrlYWa9C0BbJh4KzxjT9 1krzauTakVtombbMg/LyQ2Rej1eo2F5eLNYWKjeU9gBSuNSNcZj7myOH+nK+dL4xzABV7vYt uNkrN0ih0pqEWQUJtljO7X5BLFMKkdp12kDuEmFTeL7ZOgVwm61PW2ihDc/y1G7cyT70lZi+ seWet/Lq3dfnp5/2IDUNquOomMMuJiScQn8f91u6QwS+WvCT2YklUfIf9ZVa4sD96e7p6V93 93/Mfps9Pfz77v6nz6mp7lfLwBo7Zkukj6hdq8/bIXEPeQvT9yKBLUpqjuIiQWvS3EEWLuIy Xaw3BBuTvJkoau9mgDI8hDSbpZAJo4NmSN/k0HbWcKSn4SiZHHEn4cyxkhQfM1NPBYSD8wcX 5iyTYGZYOUJacJ5PyB5S0vCAmyCijGpxqCjYHjj65J641IJLdeHXqab2WcZwIL4LKcZbtagt pCuuPSDL04iE3E4KDKpRUYhuAyQg9WhfhmxJ+Zg2VHCeHmKinRk+hxAEFROa2gii7kYY8TMK MDiQ5IgSApejlkJ2NIshdQY5l5X7NG45jwOW8fy/jF1N09soEv4r73H3sDWW/CUf5oAlbBHr KwLb8ntRZZLUJlWTmakkUzvz75cGJHUj5Mwhb6ynWwgQggaap7moKdbQWRv4NBzNizIJe/dj hl/nq0G15LGZYaerJDE/7bXbrqYYfsCghteZHIZXmKgkxd7sDisoE9SAzteg7KFszvlLtD5s Xv51+vz1413/+/d87+kkWm4OeH7xkb4mpvcI65qJAzA5pD6htcQ0rHgJUl/0RWqchMAdDcqc A1k/DhemVeAcI8tYozAXgSeAdY3dhortT/o49xPOXosaapjcAUGJibrX8ACibQwQcxBz6neh U4DBeYiDTg7EQeBY8ATmR4Waka45dwIGKQv0mIr7R0Bh7CasBMZHYrrkb6/aeH71ePyhVU4l 9tm1FGflHHGx7ALhpIhCW1+rrK2PolrUMCF9l6RwaP/G4Xv1GWEmHTiqdGQFeHiSCqcknQAo HEPm1hE5mJ56nl3jg/IT1mePipU41qTheTdHo/ExPYBgCFiKiGrk+lq1+gc+Oq6uKC834vbj vHfIh1QVJR7s5FV/ICU49aNZaJuSW+x1r+3QaA6utnOQcLE4LMU1OGB1eVj99dcSjvvjIWWh u++QvraR8ezJE1AHe1+Yoq8UaBhnH5oB6fcAENltdMyPTFCIV2Q5w0FPLKRBA0KL6w6kDXoy gBL0iHDClnmsla+WPY8k+GpKsLhuVOqJUqqNkJam5EDjEK/biaAVgqUiU/u9bgpUw6Cx8fsh uRnwH9TCqNamNz1zD7laELVwNll5ZFKyrG79bEySp1WT1614pe7pCH56q2CzogcIT/A71X2y bpPcv23ATRmXd+uIqoL9RtU+0Eo7kdu14RUpqsdbmvOFStUdWz0e6DNHiCfHnJnn9c1s/JMe xUJ06LMYjUJisJ+nIw7fv37+5c/vHz+8yP99/v7+0wv7+v7T5+8f33//82vwuIkjF+3LW5Lw Xdd1wcZGtVa7sOfXLK0eIvn1TXP9B+rROky162nF634X9bsQ66ch1Kpw7O8y8w+AW+eWfq17 ttmi+jrd7tFK44QmB1TfdUu2gdSjyYnzHXrKzIQaTCfoFU7CD7493FUoji1ePdGo6NTYIn1d Cj1Ui7P+xELzapwkni7riySKIur+2kB/T5aBbOmrMvUsYJxsG3LJxArwRmoyTBQx/oAwHQlc cXqJfVULnwOTZRysEhJCHPz7DpFtCUu0BSGqCpRna3bh5nHcoFahL2Co7NlVW5y84Jje0cnA bHwmR0DVYfossmtrXixmegf/Ge+yl62ob8RuQsWAGsLPmtEepLpSecb67qyr5XmtuL0q7BVm N68UeoMT1kfngOo6oLoJYbdT8MtI9bQRZcH/LLIq2OWjBDJOjUxtQgCBNaJEjqMVXnd2gO6A imkcsDehBxugL+9h/gUnLYNHRaywYvhsxYT1+V3PSnRLsNGqCUnApgv1gQMrVLJBpl5WHqIV amg6/W28m+8edobnLFj1mfNnHFIsYjRJ06Nf5mYI0/6Hw5YKjtLWEzRYQJ1aKo8rn0p1UO0Y sutljLv3W3cmOYBrt4Zk9rgXDCSU+un6Rih5nQ0Mp/L2Jkq6YI5y1HzyJsLr0EjLeLeilkv0 OGUqNJeYEf98JBe6UZR4fABIzxMJgD8g0ZEE9BX3LmcpGpCm6aCjBy18qSKJtx16paKhZXxT hse+YecCn5C7wSge2kW70PcN18teYCCEVWZY1p8a0OUR0yQey2EUcDZ1HllVowKWRbfpOZ4S W4BWmQHpapuBrKGJ1bZzta2vhjMkUkskNBblIpNkEwc7JBBtw8aWFemnhb6Ui3zVaXZ0puhl ojYHR1E+9BgdJ2+owRi49dGiDhCuohX2gRoQ2ihPnBVV+LOsmJK8RGkOwKQsk3UShz/XZH1Y zX0uOq9Xij0ST6fXpEu9V3UTGXbm0BONlGfci3M5aNcXgfOQ92dKXqHvq5dGbSCbBWrq6iww 3U3O9ECfoyw/dEOu7yd/BcnlwHmNjLe/LdiaeO+8LajNYq99q+Rt4UUDheNUlU927p4JYSMV J67zLHjeNYnWB7y6ANeqrnENOahvgv3HIDXLCOouJKEbHKRJFB9wZgA3i5mtc4UNpNwm0e5A +pUc3tbzTwD2NSfOnd1qQ3bskKLkPHQqC2sIsNmR+9chXq2jYHXT7lDIA/EFEjI64Gvi13RK DWHP3wRIMzhVUVF02UqVpUxnH5os00Ok84yGxEakviefvvMQBQmBjWiz8GlLZbop4rWjSrNO /KM3JPHhhZw1zaPkDDtxmIVCZM9CcPMKdzniGsyT4vlVYQPQXgdVsZq/xjoo3XAnA8yebS4q ahsN4JJ5BgrAO5jSYFzTM+7i1U61xzQt0t+3+k0FB5dRYb36wXDgDFG/YQAcY9/PU5ah+sj4 ibqGG2CphPJyQr2HHrWwCQ5zwPZaVTR64YT2BWxTmaWYkKOC4bw/UpOnyR+WLc6e7BTiRSOL XKVMJat15y06lxkFnLVEwYzdhCEGx+BbGPsoVABXJQb0xJXpySDBnCsRBeH7osgwZ/bQtEz2 nVcIkTbFVVLM9fkUrMych3ml0510tMJORMBky1W0iiIvT9YkcthkTWZwVleoI1viNbS3aUPo cNiGfVoKHCioaehFf5RQEx6oW2JBohAD6DPcAlY2jadl9oXp7EvDNQkAAwC5TdHn1zQoEiRr D1ERCBDD3jvVNimqLPKUygzDEfhRcTwOgABiuygPMxtK8Gs3+O4B5/gQM4B9ePfH9xk1csoU eiYgF3YnFhNgDT8ziXcSAWxVkUT4tO4ExhTU/4jJBpiJcNElSYT9lqjg0Ef7hM2laZZ63P5I 0nM8RGBBlS4IyqMISPSkfod3mwYcvs79tgvk2oyLQcm52MWrQEkq+LKS1VwA3/BxDpep3Cfr gH5bZcIebwsXUV6P0n8DwFpdbndrxKZm4CrexyuKWVJvT68t9Vdz7SjKG1lXcZIkFL6kcXTw EoW8vbJr67crk+cuidfRqp+1RBBeWFGKQG2+1V3w/Y7HbJDksp6rikpto857u1BRfiwrQx/e 5LN8SMHblvUz3Vuxw4PSnRiKbpht2QPv9+lRi7cKzkBpgwEILXF/OhMuTp/nmqQJMYHdZ8yR fzyzEnPITsooytR+l25X3TxtsoXpbr4X6y2lGgBHpzIY5gsq7zWjG7y0dd+JOWY6GvzpWGA/ AzyKW5aVyQIj8Z1QrZb3IsGU2SqfWKIwxmz4QDSbyp9ssOXbi6e8vTzdhAS5WV4LOTpbMVny 1tDhostCcqmRQN41elRpzTug2jGkADQVX9k+B+dNgyw/LuX8cHlKh2w1rAei/iYUH3wLwgWF UqnUqzwLhh4zGF2sLQ4R5ogYEK9djPC9IYGMRjy/t0HPOJ2L3YV8InDtUbA70H41uACAPn39 oLDslsfa7RYHqr4LPdJg70oH9EK2sOI1lXcQuLTJq49W9N3ra/9on0OfZn1UWG4AoLJcuuMG 789s1mDx4qBUGpHySIHlvaP1D/aO1rPDQOYBGd6VGTIBSx7evTMgf/TVHCqaOZZ7+aAtExDT +HCzBHDRL3Wz9k+jjtCz+pk0ntWS05rl0eFDTmcCb3EVCbx3OmTDq9BJuzcEcnqeYY760UpB WovU/+QZM7VBqU1LyoUKiDa7KceLxk7e5h4RPuV4B4XsGHqFYMlhbyV7PdFdo0J7or66hXlf nF6D93kHjLB/WIyGARLNPY6CqwogIacDHDAGFfvbF5jIYopE53ESe8wnvdZXORe+rQkd+QA/ MYe0imdKaWQ5DPO9uAvMdqyB7FaS69K7hhv6ujETL/3nWrCRqDv7+Muf//0v8OBO1OtT5t2t y93npAFOlE/6yEGxiXGF3v0OQCObw25LgPVhsx3WSz7/71e4fPkJfoHmDwuAvuon1mjAzCWm 44gGLWI3iM6t4SUu/lHhh1YyDeygZ5MlJy3eItZgDX1NVmyd3U938PSFc5bI1i+6KVWHqTKb YRX4uxQz2FnQC7BsdK/c4tCQdSuqOq1p5TbbzczuA2ym5A3uAC3QVmmJFzJCxd2KmOHxZrUi PYqGtjNoF/k6yfw2C+lf6zXe7SSS7ZJku3xPjOeiNnukTlq1X3sA3B2GFrLnJIHsWUkoe05i 75mWRUfZtbpU9T3ES2h1XLwM8mpMGAxzXj0k8Gt8wP2idk8SR6PSXGjJGIMiP4iKEy3GH1LF ONuaoCQ6xNh32kFyDmUetI/XzNdKEj6/Mb0SiI4SDvAr0oKevT/AT0ponhegIwba19AHCVPm KGrJQDdgy2F5IBfYyc4B3qRlQIFDdI56ZUvvcEhwdmDj/rlk3Quc0/j147dvL8evv7/78Mu7 3z7MWRdt7BoBvQfq1zBKGyWRBEPe3PHaS8Gqkmd42SjPcLh1uKJe4wNCF6EMah2lKHZqPcCu XE8DCmDhcOq6gnXdyQfqpnXeO0qem65XK1WHdlpOrKWLzZlMMTekuYSHOF4vH+5biQ87Fbgl wxWc6ME8oPJYhZoiCvE+uK9/CchO7MJzwhFltqvNeZEFalAnnFODluAygOaIjuKFxpaUGfHs gutebIK0eSBKGT76ZKBMp8lu5TEauQpaziTehYWb7DINMsKG1PpSZFnBaRc5SeFPPB77hKuX T+++frAUgPPYsMC4diu9hKYcHum4GpLeNk/vpidTPQX9l5hqnlg9fTpulKYgXM80Kz8z4sZm DwBMT5cEWepComZZBH9D79QI4aihyMIyIPpQgbKcxZmRxXQH2JaDwwE53JzbCHr8DBpHhser AS3hOEMIJUuq41MWOvv8AR/AF3I5ZHXo0gVRKW1RZeNDRVSLMYLMF4CetFR7S35KaWSJATXb bgGc9PEW1Y3n1Ar16uPaCubZCcc/szgsf1e8npXovtsdiDuahXVv8SboZuJSazAvi8MkG8O6 it/++PP7Ig2mF0rNXPank55+lCZS4hcqgSNWJKqzhWWju3h+8UKhWFnJVCu6i0fqPsY5+hUG 21DcYXc3nNwjROMU7xvJ8B6PJ5Vpy3UH3f0creLNc53Hz/tdQlXe1I9AYfnNgl45+S0cpRdq fymStr3zwh/HGkacsRQD0rOs2W6TBD/Nkx1CjnqjirocM+IVOEjeqmi1D62XII04wpTpo6C4 XCg1+Sg5e45WYQ3TiBYibI2KKmW7zUKAI6yUbKJwvKRRyba/ZyUtymRtFqnnN4NoHeLpQMl3 +/X2ELy7TMMLy5NC02pT+FnyFb8r3FOMgrrhFSyDyoBMqvrO7vjQ+CTSUzTMOj4KOkVw9I2g fhgu9ReHts9HqGdFIwOqcFRa6P+bJiTUFh9rlEiDdzqOlmCi4sSPdX0JycDMuRjuvZCUa0Nb 8TQP5oaDm7Yg+yso3fqa5hcR7ImN0hhRgqCsaQpu7vUlx7TcHvCJIwunD9YwH7zJrusYDXdk BP43R3M0VC/lffeFZEwbuz6pZaiCB6RnFdPvdLphEqyzEIrNlxFN62PLAvj5hA8WTHCLHVEI 3JdByVXoTqbEjBOjzASuZWlIJEXG76LKsPPGKFQlpp6ZkjNuvIsCU7vzWnTCGLs3jEJtirei DuWhZGfjex7KO1BS1O1xSQQ08SGZEtU5XN67yPRFQPKa8yq/ht5fdjyE3gYreVqHMq2uesJy btmJOO5NjUduV1Gogxw1YIy+BptA17BQewS4N9RlQQldPURvpLjoRqPHzMj/VBSw3KK+xl5b H5SUpzgTWCQacHMOic4KT96RIGeVnnefg7LLUV8EJXdGDvW4TEOHZC0flPMJ1J+t3CcbxHlD hftkv38iOzyT+YEIAhrh1V2iaIJClCagYDilKzh+d6kIHwTEqsdrrCct6x/qpY8kVeU5isL+ rVRVKdmYQxz/UHczUw6oAlNCgx1lsDBnZSNzcqwUiznHExosGc49LdSkKISun5AJhbXO1+p1 6cnFQo5N0+zvjlcz+HCrolvMD6tRW2JRlKxCvQVRS+V2RX3JibiUURRyACJK3nhOaqvinVgo b3nZ4/gdWKTNORO4eClfPNPzMrXtVqH4EljR/G7FOVfhB5nfd1EtPWj+zYTeSnnYY0dCX4Z5 DnxZFD+RrcMy4/5Wl00thVpoZMa778wK1i0n0bDqDd4E8+Xrclkm1BMhN+PYstx+HIvirEx7 JdNo9eTxrW1zywrZeHJmKRNAssaK/gcJnWugblwUv2GSnGmfVUXxpB54LJaFrw/V1pV4lrbS I1e62RKTyley399yGkw+ntSA+S2U5V8MfiD6RRlTPzzV9TTj1Sq0oj7X2i89TqooDsbvJWk0 crddYVdlN4ETksxmLKoH2WgTJnqwCseSRdugN4VdBUplcyEnI9zTSj0f34YHR6fRXNerJynr mU/Fi3nK5yYOc3YPYjg2LgoVWFug6asCFmpVNVvZYkr0LUwYeOyL9BxZG9CVE88zd+nUm9Ay zLBkdudtSZz/reChv1dw6/fgtIxWBx+82nW62aOb9JRs9+GwzKhq2lqx9gFnMetsgRhhaBld sX7aNEQp9VPDhB5DAdh6FfbFMXLYMbkcM7Kd4pxS8mG1VvxUv/jxXOCTQycK4LIXyWoT+6D+ S0NIWThVSZzusfOhxRvWkqUPh6aCLHRYtBBHQL0Hkm05C7kASDaJaWfKJi1jWF0OVqG7u01B K7Qir2dStHAD0ldyu00CeLEJgLy8RqtLFJCcysRYY3a359O7r+/ef//4db4fCgdFpkNmaFBN HauXalklCzZErRo1B4UQ1suCc3yi/h7UnuD+KCwr2+S6X4nukPSNeqCn6sbWKOk4FvVdwpB+ W/a3yTnHOd2pIPmsXd3BfOHIaaCG47Ze3LJHWrCMOu2kj1dYfQjGnK47ZmkCCrLHDbA5TEPo 4x9VSvuOAcEz4QHrcXyqqn6tS7KhhA8aepvO2qqXxN3fEilIQcmy0YG726XkxB/JBcD++vnd r/M9GFenSbxd4ReBYJ1k0+pJtOKZIazVtb/8bswNNt5pQDBrSCfRaWugLR4psELyMnwbjfeF H4Q39MiDJO0NBrxq+6t+kRIF1cHiVlv/ouROZxNS4R30luSwFZKWrNKtt25JLC0klzn4X4r2 7XJda8tOLUR9JFmVbDGN++ztV7//9h+QacQ0A8OBNe1E+cnoedx66QgpUQme/XUKp6zP5XX2 HiijIwLnrcMJ39APwKEyTasuHKXYaehXeeRtxoqF2BpWyw0TbxQ7w2v/B6o/UhOnbtcF6Rac AjAJQCKBUoX5nJywbeJZdWqMtGo/wZMs+qLxs+x0TBAHesC2aIb3ENJvyGZcfkudHwcaLjRm 2zcCOrzE5QBseQzDimWCTH2eStGUAlbesoLm1eDaLBRpb+h4g77H5egha8p6IqTBRkyoTQG4 M5XmGV5gt08CM7I+IboVPQiO/J6TF88AQgMEW8Lrjmdqlplmnqij/Z/BJNwAhukIhfLRYEah G4kh3K4POxzboWkKYRcrLTG68fV4eb9shIxDHO5zwQlP94X9hpy/ntAN9QYXLadb3eWd3bCX HbsPDW1SYZ3F+U3+HG9H+sC8wSvBcAWTImzQsOqc5hxWvuH9oKWM9EyrygCCmA8OgtWw0Ykg NDFMgd0kpUl5B+UAQn4I5BFSrdf+itsg5kVKCXrBsiJHs8hOE+TU7C9CDHmiY5ZzmPIwcLzy Ntc1XF5DXT1Icl5AsDo4CkJTkqXHLJzqDvRcH4Wag03KhhYHpR4nIcc/v6FhyrXIF52yxj/9 /u074uqfmzY2cRFt11v/iRrcrQNg54Nltses8xPWy02CgwM7CdD6UVAkKx8hgREsUnqVAkEE NhSqzHZVHAR1bg6JV0op9GzkMAd3+HSwww6Yigww0sc4wK5622C0EEcgWOEyNabt+Cq//f3t +8cvL7/oF+b0X/71Rb+5X/9++fjll48fPnz88PKT0/qPtlLef/r8x7/JOQJolLolLW2zglzb +OJcmbMtlLPJE1LPMy3j53il/Lb+5EG1t99vXlXKxrA/flJNxxZiRdiKL2Edz7unA6qBbmbC 8b909/ubtt20zk/2C3hnz+uHX0Qm6kL3tVe/L9BzbTpLQqCeXJNFaxApVks9vJYeKrShazet Te7q7590RqasoffttQ9FI1rbNwSuuYsbNZMKdBU/UNEtJWRAeUGimmUPa5CVzDER2amTbuv/ Z+zKmtvGlfVf0eNM3Tk3XMRFtyoPFEnJHJMSQ1C0nBeWxlZmVMe2UrZzTvLvbzdAUlgaSh6y qL8m0Ngaja27OrxhTV8CRkk3iZRkhY1oSXfweiEZcUjctWiXlIqTDAQs/RChssLXqWWtf7IV LUNbp4BDf/Qs/mUvsN5jFRaWujHoEIfaGUG8BV1eFqsVGrm6dHu8tG5N2ez3WnuNw9hc20ID 1a/n9/PD+WloKaNd4A9Ma9bU2zIPvT294rlhhZFlXTPzJl9dK7YC/LzyfGvT1shBpvzwdBLx xM0VGiYKFYxBP265/UKa6RNPmRVM8TEyIRc9QKWt971JtL8x5szh/fxqTsxtDYKfH/5NVAyU 1Q3iuB8tF6HRXg5/PR1nwivPDC8hbvIWgwPxF69YONYmVY2P2t7PIMVxBkoGlN7jCR+bgSbk ub39ry2foQuOlm0Dq667BMomNjFgbYSFxBcrk9nCd2qhmzRyTAKaS487J7SP9fod/4YHeDZq tTo+n19/zJ4PX7/CXMhTGDTn/8kNz1MYgvRcDzPHOYs2jkKXVqhirx6sA8sSXwib3lxJ/RrY 7eMgsMPlPazb9bisk73Ay3/8/hW6A1kD/LLfNbk5g0frEXH3MU0WgX+VAXf0rzAMV0LN8QF6 82fyDzbileqBCeIup++CC+mkTi1KXPbFVlG24sQhS33PNQ0J1Ja/VstXpKzS2vOZQ1/8HDh8 P46vNFQ037vh3BAvSRcRIZ8YKviAFk0LC47OjExoyPROMsPvXNxlGCd491//PQ2LjcvsceEU 1gC/xSrHdb4gGfPmspM+FYmV8wcZc+/oAXzhIdXwIC57OvznqErKSlg29+j4qFKkEXRW5ZUm igBQSktTKjyW+zkKj0dd1VU4fJeQjQO+VTpYDacNff9E5ossXvEVHkufVHnori/zxLlD3VGZ WJafvEj1PofbR9yPSnkvzxwy/Yq9UKNjOGSlR9QwMSQZrPYTNChpI7CFOfVKMsOn1+pJYaGr SWGhDMWRgS0Vg2kkY9V9t+j4kQevGkXO/JeYaB+8uNOx5uN6Hy8cumuPPGUdR150lcU69Y8M UKq5G9DTysgDiyd/Tuczlmm9LbNVwej5V/QlwymqhicdtUbSPFDzn7DsV94ZCOKwXrspzPck GxE4lzhm2rBtw/oElkC79a5RzgU0SFEDE5pFPnkpTGKYu3MiWaTHFD1VomBP5Mp1PNcGBDYg tAELC+DTeSw81evsBWqhAmxHMheeuUsfPMgcZM4AhJ4FiBwbQNUHS6OQqsHbuM2Vw9GR7jo0 sEoqN7gRnZbKZ6n4cJ/o7b4mcs9Y6BHcMAuTwhbBLcbeIYSK3NgJVjQQe6s1hQR+FDACACO7 ykz6GiayhOoFAJAL7xEuAzdmFZFgGXiOfow2QGiLrRI6Uu7IdFPchK5/rWfh7g3disWySnJC JqDX+Z4SqQCJuKa5kh+ub8w0/0znRB/mYUhlB9gTUMm7wBcq1d+BSvMSQwCohHBAJfRQWcVk bjGZW0zmRlVFWS3IdBdUBVULKrc2hQmLGBsIeC4lCQJzGxC6VGND3oHnX9PsnGNOycEBIjt+ D5lScwiETmj5JHQJZc2BMKZER2gRXZEcGMLQpxMNQ6qrciAgZwAOLWjjYOJJa98hn7ONHJu0 DSOqz27aVKwcCi3++4DXaRz5IdGlEJh7RA/k6+iF6tyx0vZnjRKwm9alrmtKOKWujcOOCaiq kGrvrMrdyCekzqvUnTvEcADAcy1AeKd4pbxkztJ5VF1BqNEosKW/IKSDCSMI93vDZ4+CU43B AZ+0UpjrUIOZPz/xSMsJgIgyIqAiYo8c5cUm8ZzF1ZZHlj19oUQwtDdVGhAdsK1qJbaORJ9T rYJ0qg+hw/W03tGzGIBhHCYE0LoepWq6Fv3TmvS72Id1EzHpI7CwAp4NIDokpwdUMwgEp/u0 bagtJomxjOKgJYwWAYUbwtABCDrfDWEcCSSnIP46k1Xpx6tnixN3WhdWi7C9dVz5dinXZ/J7 0IGgr3VGcpbz6OGwxurQzXnd3xVM8aRHMa6SohEXu+gVN/EJ+pQQLwKvfmJPnWCU5SXgS5Zy eaC7j1xXJcH4UPwaqeXSMfon442SlklFhQrZx2Ff3+L+Q1VLzcIbvD1+P7zNipe399dvz/zc Aw8Tn6nbitPNnB86ZbxXdtmrGYHN9i653+7M7ea7w/vDP4/nv62+Adh21RKXgZL00w6DPN9l cvjZrBOvmjVyWVR4AcGkRqB1VSpfWcRauqzGYA698h6RpWDNa2zLtF8VbZ16hMD5rtmaohXL yHF0UpUwaWDdJSvoNSpL6DtOjm8aFSrGmtRIIDJBmQJ5aO6E0Z53vZX+RRyplJuaKN9NDTz9 ht/0SrfqXWSWotMpNRFusbi+Stx0aiWHjl4iqGPQYlpaMIK0xuWxGWC69V1XTwAQP1pGeqFw 4lEIox41qQsLdbc2qHEUmawLg4jhiD6bnSmvwcjw5cqeRlaFTzs93nmpkY7vyLIpHmqdFv/6 6/B2fLwMt/Tw+iiNMrzmn5qNCmmI6xrjzv5PkgEOKhmGb862jBVLfrNUnICcX04PbzN2ejo9 nF9my8PDv78+HV6O0siXn+NjEgwdj0q9Cj3e4xmj8h6CcWd5PEKslKWJaukMLomXTZGtjQ/w +t3VFEcGlY5u2q58NsLKpQh8BWe7FIEYv4A3+f6lE1aZjOQFarnYILwma23F3cE9nJ9nb1+P D6cvp4cZRkS+tBT39/ysJGE0DKeK2kgLQnAFl2XmwCg0BihKK3oGVBhtG8GCSa9hcbD17en9 9OXbywOebFsj0uCV6uF+02UwIg3WPj594srhBm/w0KcniGfJwgk8q8NUZIE1EYYd+yUe20Nh 9MJeJ6xIqROisk7xUPnSkkhg6hUSzOTPZPMZWmGbWeoYeW7Bxihp5zb5Z7zdktDXxvHbrqjR f1vS0N8jS5O39NsrBGHNGzihT58m7NIlLC0d+00nnrx5bCujLRuj/ylfsWIehfvrKbMqsBzp Jst98DO5GCybrqD3LLVYhwi3BSwOfT/Y41PLJLO8JK9Z6DqWExLxvNL27H94e2nPHxk8l948 mRgWLn1SJDNcHQJ3petF/vV6LCs/sPQPUVNXHy1wlupK57dfvkA04eHgE+sYlXmuFrSKfdeu Dpp8jeuFLfnKCl1sTvbfs6T/no+Pp8Ps4fxKOEkTX6VJhQ8wDONRoMIrTt92NoasWBctPgyx cnDH41YwtSHwA6NSlPJDiK7Icn6ZSB6qgtjNSw/j7eD7y4R0s3HhM7+GlcaVY2LBsyr2OWjk YoNRDZPNOqcO/AQrxl5sZFsUiMvdCk+UCSp6zWdrAuhgQQfzLvVJtzSpnnZR90Kv8morB5i7 IJg31nRB5O9JAlC1DUvU4RkIUREgoSYOUpQw9i0ao32eczNQYcN3CCKofMMujmURQU8hVZGK ZmCjQVPxXm7M7U2qiQCESvbv36RidZM30t20smjk670NJ/TIpZI3+fS1Qm/SwEIPSfqfHZ0O 227urRmwz/Q3yeZ+SyJVmuPzZBPjdYCNKHsXT6WH40oy+Ub9XSg7piIf1e8W8GCMmUIVZ4X7 G7dqfe66baul1uRZk8iuZrGMbZMn1We5HYtmihCuZ1Ssd8kmUUhtCxIWahWU222Njm7lrl4I u7On/YYILcWDUk0KTGyBHP96ODybj3p4nCo+etIykR/maIDij/GHzLRm4k2HRKqCUAmBjuK0 nRPq4dDWZSyfM0yp9ct884miAyHX0xBAXSQuBeTttmIUgM9x6oJM7M8cLyj/SUIlOplYphkF 3kKSsqczCUFXGwmFVElDilc1C7wFQH6zuYsdUvBtF8gHWwrgz61AT35TJ6nnRBYk8vUGliCX bAmWz/V4XgOwWUBO8vmDjpGFBU1U7JdWhGw+/CtwyC4nIFpADgV2KLRDdKkQCq15uYGlMj4t LFIgkFoQ31J9uIVO9gk+VPVAhAO022A0QgpqQ9cn6VvFh5YEdHHgk52oSx3fI4WGGSGpKGBf NOJpYkGOv8+pr+ue+k6xIAaSdV9kxEk1OOhJ0EFaeT43fjjXc4aav8uXRkGY5wVa62LvVw68 REYAtd1oUCcvh6fz37O243diDf0uvqi7BlAjoYEsrqvrxRlBtOp+6KbWBGJ1FSvq+aJgvMmA Vc+3LdeeLw/DqVxdwYqtbo5ijbmKf1yF3ONF4nGeE9Xx4fH09+n98PSTakl2jnLuKVOFTa43 8d6D1dBe/2Igw5Rt+aBPSpbYvjLNZlj4hY5ZP4JKpjVAIikRc+gnNYB2qxa2YSBZx8CIJ7Es 2/RVseRz//IK1POTMcmXic6Rkh87EZXhrmp7xyWAdK8YeyO5WigzySV9WCt2Jr2rI0e+ciLT PSKddR3X7Nakb7YdKLteHX8jyK0+gp61LRgaOxPY1rAudk16slo4DiGtoBtG8wjXadvNA49A MgzyRUiWgpHTrO/7lpS6C1yqqVZNIT9Yn4T7DHZiRNRKnt5sCpbYaq0jaFhQ11IBPkXf3LOc KHeyC0OqU6GsDiFrmoeeT/DnqRvGRC8Bk5dovqJduD7Rqcoq9wJKnGpfuq7LVibStKUX7/da 3+EdrV/usrUcreCCKOtIVjHRno02LpZe6vWrMt+n25rSHjpu2QQXi5E/UDf9dlAU9u/X1HVe YcF01SeopFYcIELBDoi8phZLJ1z8a0snsY5/OHx9/0ZtWIkEq/w+H1Wv8sGHwzRBWz4tOln9 XGhkkVZLkv/ztkmMaZMT+yz1jZlEIGidOOa0KsDl7rMtPdfySVmVvn8FamwfJh0Lof70vaD+ Jt8Xu6pf51WxKSzgtiEMhmq/vNYYH/758dfr6fFKm6R717ALkGadyONYuYYz7FMKNzKWR7bT x0FMXuQb8ZiQJLZJAsCyTNLbZSFH1ZFQYjBwelf7TjAnoarO9Y24ftnGc029AckcnSxJItc3 0h3IZCFGzLSmRoQoA4e4fxN57+1iA+GLPTPqPYqddJGra1hB67csU00VoT+JLURKsY7MBUlO dNUqyDWea19RutqJEIVftd9g+dZutekzq1xXtx3qVgmLvUFXKGaxBaDSbrZ1LW/l8R3WtbJF xzPNhmPwS0POy+m56xQ1Srenk1Xep2mhbz+LK3380OCjsS/8M/dQ23T4lBqEIFQFswX8kWTS MpgYcu55qLRd9xq66k3f5TtLXvzZlqXwXdEVZunGzPFL7eG7uAMhNNzxcVZV6Qe8DzC6k5Av QFUiwKY65Q9T4uAy4jItahIs7z6lCf3AcWi1n+B3i0VIuVoWhzTTnvsPlY4noc5e3YwcaJrb CUG1rOqrJtZ3hDK2lDdieW5Vsi/4/3QAr+zdkkSPksPytPJSJJc6NUepbnNlEHHZk4XqzVsk 0+ZJEIW0p9IhI1CXkRPSb8vGRFZhHNLnpIJDHIIaHc685YeM8ffZqhpOQ2a/sXbGL/koDmAu qcbEY+apG69Or0cMIjj7DSPJzVx/Mf/dottXRZNn+uJuIOrhmMYDPrxuPbo/HE3Ah/PzM17X ENKfpxi4hhkwd40ZcNmmBq3t9AOmIf7KJX6mdQogZz45eIBC7jup9HyUF8kGerNSKxd6o3gw vtCJ0O3SPHt4eTg9PR1ef1w8/7x/e4F//wDOl7cz/ufkPfwx+/J6fnk/vjy+/a4f+OIhKcaG I+KMD7ZU2yayH+nBTm4GH1hi8+fb4+kMq4eH8yPP/OvrGZYRmD93OvF8+q70kLEtkp0yrAdy lkRz39gyA/IinptbMzmGUAqMaYnTPYO9YrU/Nzd4Uhb48pbDhVr6nmEn3VWx8r7jQpUfogxT R+1FrKr3Y001GZvqSa8Q6DmhiIPFWbvT4/FsZQajzzVyA2JgdEgghgbxljmuvAMg9V1zsSDI xGCqAzcwuLt673uXWIqiGNgNDkovIUofuRG1xReIdpdSO75cScNSrNhosSQDazMy5BfkKSh3 eng+vh6G8WRbIW+7KDRTqtpF57iTn+HV0+HtHykFqUCnZxgy/zmi1p6hfy4jg12dhXPHd43O KAD+lE0ohtPbwxGvWp7Rgdvx6SvoTTLFKvCixVSvTKiL2Te8AAoa9+380D+IkgvVousN7VKD RESnW7XsXFLGYBjHnvxszgDlLqCBLqCuFV3E8iM9BeTTsu1LDlq+rFrP2VsEQiy0lIRjvhXz 5AGpYa5vERSj2bmW/PbaQZ6KBcqetorNrVi1L+FD+VGtiUatBU3ncxY7thpI9p4rPxkz29m1 FGaVOo5rqSCOeVcwizhDjpYvc3sNrVLQTba+vAMT0bFIqu86ylgTC4d5l1tbb++gPQ+vj7Pf 3g7vx6en0/vx98uMrhperF068UKaGAZiaGwP42njwvluEEOYAL5b8n/g7qT+ZwYG3+sRzMwT bhxaJMmavbYpP47g1MuyMQOg/4v9SsFgHpgb2wWc6PkqsWp9V1tofy6h+PLTvAtRr6rgxlXs hrGqvDg2K9WhKtUzq59XKlX9jlFDsRP7ZrU5ThyarJ6+o93lzN0v9O+HLpe5hrgCElVr5grp 73X+xOxI4nNNPFZ4ynkd/5qBktI+zphvSFUt4zDRExS1ELlyx2nB3P2FnshqmBn06kfa3iiI Zxx4CaK+cdPsM5VShvModimR51oum31r9hvoswHRZ/1Aa5WsWGJ96Wd9Izk1yOggpyKpNSms 1sn54Y4mQ56SusQPI73mMg90mbYjxU9J9HMbQfTktk0HbWNtVezrsd6dRCk8siF0PSHGajSt YVoGeW5gqfvPLAHD5/RwePlwe349Hl5gZT31sg8p14GwjLNKBi3sOfqJ57YJ1FesI9H1tYZf ppVvHD2V66z1fT3RgRroVDWo7aTXHE0xJbs48DyK1huL94HezUsi4YuNW7Ds18flQm8o6Jox rQ48h33UDtilLMBiffoxE0vfD3VZqvnUpSazUHt4vu3oekGCJOM4T0c3yKP5PvsCiwE+eal5 lZtlrZeK07RqLhhoDL3hOFH/WhC1votGtK+3OovXuspN2mUVG8MNxkMYBtrUX8BCywm0VheG Sr/St5/juAFlrrcUP/KdViLt+fz0hn4locqOT+evs5fjf5WuoGym8/jskJGx07F+PXz9Bx+T GSdGyVryOQ4/0PNfOFdJwvO7QmIFUwnoifmyvbFO+qRZGgR+C3ld79hHN5Qhdle06U3ebKXX UJnsHA5+9Oq1CCDcVmxw6/1RPlQApNwmWQ/mYDbtSFEHCsDYtpMLeXxrMCyJZ9At6VUffiPc j4P2D1VxxB5pKc5xFHG4B+x9zddXi5jayuWyZKu9mmLjyssRTkkyzQ37hdrvKur6PDJstrsu T6RD9YEgdsY+BiR5fAr+0SeS6vFmr3DD/EMrbEy6duLQQrnjMFCwHZVm76t1orIx5Zim0WIL cI6kU1zncKbqbq1Gi71Q+9UyJR33IMu6Uu9ZDjSwOFQ5geYbxF1Wql8mrFUJULy1p6efFk2z Y/2nvNrpEn/aUy4QYNywVgkWNuyi7FoeW0u89bigN1klRaFZSYNzHCN8xMgsfSaHMYbfy+22 RZuBeNsCaLrC7emybJQN0AFIt/U95JEYQIGBipdloXSkAWvyDqNM5iXe4O6X9y01joGP3TM6 ZwTInBGw5bzaNnmx3vT5BhaUVB8Zc9zKccyxuvJV3jR51suvOoF+k6e7ZaLUJIPmQ2+9z0rO VYJvBslXMFj70pCTvoEPBjWoStMWJS9dKx6ai92z18PzcfbXty9fQLf9M4YvMF55YPXz/qjI XFee/htqfbXt0XnzdrMxmv1+mTfqBCdTee+S+ZMm1eojAX0KTUA7CeR9h7XU426AoH7l1Q9Q dthxFQonyBLkK2WI9BvFCR225DrRRGRuxt+TWkWM5pQ6BKTMYyeQXW1h5SQNdGOME7eRD9J5 11Dduk6kvsL45ZtiV/0/Y1e2HDeuZH9FcZ9mIqYjimStM9EPKJBVhIubCbIWvzDU7rKv4sqS Q1Lfac3XDxIgWVgSlB/arTonASb2PdOsFj0JXqk/twnG7THQcMqhxUOO+kMraJvDUGRDMop3 F0ZHjBvtO/eHatBcjJFwhDxNQpC2cEftzwI4mCPNKOYIchA625F7Pssjs4lHTg0fRymjBknQ +9bxJkEoTbCRACSY2VTF7y7SR6YBCxYGpsZR/VtH+QAROtKuqku68/RFIHbuPbOwrWil+r1Y aDlJKXpXZtalw0W/TC+AKDbH5x6aSqnk7Rp2LMu4LM2memzWy9AskaYWI2TRmHVDP/6WnVpk aSTaZM4K/E4ERJqjVgIgw3NO253ZZtXsQA+PGUrV87luWt00kHRJtbVcYhpjSAK+ccvcM1TC QjA8Wx2JwuT1m71VZQdOZbn+oW0tZtk8TTw2XCFv27I7BBv08gJ0phcxZhnvTpPzpSi5mshg lheGZgcNFrvRAbB68OV9RHmLQxc0rCmMEn33MBmLNAulp+FGcZKSGndGq4WPq/XaYw/aklp9 JJXl0TL6JSHcxJkmVK0XC/caA31+en1+FBOGh9efj/fDgTlyDXFPNDd5t/syeyL+UvaKOIWX yPBFbBIu17HUccNYk1yMEjuw9vMr5OCmsKrFVK++TMuC51u4NmHUp3KPujYp20K3cwY/u5Jz x7iTyXTgnzIjDHOzxo0Ii9h2+gVQRXMTSE9xUplQTU45i5kJfoJXmO86whMxJyio/QUBq7w3 YZEAsKxlRpGLeXkNlKOkF4T7e3tWGHfQDG1ACM+cLq2RHAF9e2JcrRpKOm+b9QSQs3T1ZnjZ LMZ+pRP9Mjx7NwMdwewGT/qx0U7IjWVFgzs+lVr5zNdAFKNTHw080CZDSlG9chf12IT7OgC5 Y5VjlUXgmLhnDJ0ENx84r+J8S06JLaHxva9g98t51c5nweBNElHJRI9nF4N3UvaTcZkJ9nVD VeG41TCQak3ghbL1YbEUdppP3lT6fVcFcd0doaqL0pFlGywXhvXHMfVWkxBVLCdFeJ4jyext 7YNzwfcJcqzzM0ORrWt2U8LBsovtbJEH94uz3VytWk/iYL3e2LnHjVdwPWYe9CqQLeYLK/li ZZdWVj6L7pedKwyTi1yr8yPteh3YnxJYiGDRzK7u5IQaqAbmSxNFhj1RAW4bddBlxCHBrjyC OcESHcdAipJZoG8VSixnho832RLOFzHfcOu9wq3wfB6uAwcznqgrbLGIZgi2sG6NSaI57yyd YlJnxM7QvTSSamIZubiCKvQcCT3HQlugqMDEQpgFJDQto72JgZPvfYlhdnoVGn/CZc+4sAU7 ztE10BYteBCtZhhoh+fBJlq72BLF7JugGqNu/BrM4LPdhoaOALb4rIE+jYnt+3WARXci99rt 8Qo4MdmRlk7EuvNL8vtybvNq8uIEE1MkCWA6wL7mNsFC3TjZVfwe4ALuECo1hVcL3nTIIaeD xIB1DQ+tbPr4WM72OTGOUEzeODsxKXPXdkzNRl/HmyH6jTsfCzYoSNF4eSJN006wUTjNyjHG JyHv6PizST7icdh+GYYU3AcjYeoMd4BY44hY/QUr/a7LCNo9kmwE6/MMR61oD2W9D0I73qzM rD4sOy/ny3liTZhzknCxjI9wFGvyYjruTK6KPFxYI09Fz6k1ia5Z1YgFtwXmSRQ60GaJQAtL DgxY0CPb2mlydl/UhIusQ3vY6kFs1Jf7ISW3uvLjOQwtLS75zhliuT2bhyNFG+iQoVE+2CaB 3XNKmJ/DiwtTwshnD4wVn4oqCMPMDbSEO//25AOIlO0Iuskhu3URCDxWW/1/j7rzjJHhVUIO SW2VHuOmz1WZn5Tbo5wy9Gmtmc6VmB4lVuAqlhlNd3bKeIlvhKrFNKzlsSTLqbHy5Cy3KlIW u/sSKdM9lbNYrJT0JVwLgdyoBTr2QcNlBrDyef8ov+KcnoA8mcMzcONjQsW6PSNQt9MWcBKt jKu/I6QbWJJgC8OSiW2T7MAKE4Oj9fpiY0z8skCxqo3ZIblwS1Y97zBBkXn7sqjBkveI3zAn TUnOO8MnPWBZQi2n9BLF9lwk80XoZkaRlplh9Er9dr6etsY7W4BEVE3Z2mV0uFgZ34q5vbGP DeBJTAb0paOsIZda7R8ZKKMktmJsTqxIiaNNwVmxb+zwGbWMyEswKcpj2TXVYRtbjNDVrXgD 2umT3RHU8wrAus23WVKROHSo/WY+c8BTmsABrZ3lcvs/L1tuJT9nYOi13DUWDJvZtV28uRjT GVJMhRhM9iYk1tNGRYDqLCY6oupnpf6aWAMdnaukIeD304pGtJSMxihoHKTrOHJEpNNZEnOc AWtrJgG7l5ZKdUkpsXKQE+bkACc5bwsrp7jT7kWXn8RggsiCGyhZ0e8lVtt3LCnJBlAnSSHW 9doEZ4TcBin3/jukfvBczGM+lRfzAzrqRNawY2m1sbLiIkkWmIoWltuYmCw3/Z7byOio87UT oaUVy4kx00IJgF+SujQTMSBOlF8usRgJ7Lav/EWIvms0BwDmJdCBTc0GnCqq3eboJZTlp/HC kxmZ8dwTHwtbwzifBtpbTnImBb6MU8K7lJqa/G7ZrpqyW0WKQgz8NOmK5KSZVdTe6QwPdSB3 nNeNKnrl0wKuSDBuKe5sERualY1PLye1J+OC2oB0dEt2dnpHwmNiRJbz8+vbB47cZSzL1Xk2 gxz26HlOKZMFYOkw4EqFPbivxiNIbhHYaA33gUT97BorUyXbNFBmXMw+YoS1bAHoX5r2Gy2L 5dyGwSyt7HQbQoxXQbA8fyizWjr558hEy3BSZif+ScPJgijRfCzHNLv5MXJc1AdvVvx6poHk VvxQF5vAVT0+08aEc/yYexSFi0ZZ0kubxd2iCW9hr8BBebYOAqy6joQoDp8iSoZyO2y9hqu6 Yn3gL5wTqmN6IpguoAVYyfdm3kdllkuh2OMqWKos1hucSENGqftwGfqH3hsMfbx/fXXXILLn pJaRPnkspY9zMuWxJdXcfBwVYlD77zuZtU0p5vbJ3Z/Xn3DxGF43itUfu/vjr7e7bXaAjrnj 8d2P+/fhTeb94+vz3R/Xu6fr9c/rn/8jlL8aMaXXx5/yAvgPsKT98PTt2dS+l3PqgYInh4xB Zti0G5PXA/KhdpWbtXSMmDRkR6yefCB3YkJjjP46yXgc2sYYBk78TRqc4nFczzZ+zrGr2HOf 2rziaemJlWRieU1wriwSa06tswdS556Awzt/kUXUk0Oi3nbtdhkuxov/UFnZj/vvD0/fcQu+ eUwdIxZylaDKzpwpnKjHaQGMhSkTc56EoO0F5jh4O2k5X4V2ucnTPAxztyM1jrCakm2WoAFJ fYiMN14aZy/bNYqmke5VUmNOqZjxp4lTsRQLpgHVTaqkt2GPxF2JYdS28NlTfVnna5ROTLtK GrNr4OyZlTjZFubaT+OOomevUYZV+maaTuDySbz3p3kgxbIBV3EdhLZp16Ho5VUwj4onHG9b FIddFrEUhW2wKR7nMo6rfii3LOu4bca5Z3PadK0vafLaGM6UfOVpH4oLFoOVHbRNgIxhdMLg RLdh7IlrZEGOuScHqiyM9IfRGlU2bLle4JX2MyUtXts/tySDJQxK8opW67PdDSsureZ4jJzs 3MHrRoksE4sx7xKrF2RJLhaBXV7h5S34uiawa5sltvnzQeSSb0u8I/PUf3lB+5My3O6yZ9HD OQNg3x2dPKWl7NHgVF6wIsHrKwSjnnBHseSvyGWqnz5zmXV43F88/dOJ8XRb2paKhkANjnPe Bs7A39erBm9uu4zwtD9yRKNs26LBVVRvdrTB1VwFo0NckrOlpYiAQmssInHbuO3jyO2Ovmal Y4c8S/aiLZ/s5GT2lDpLLGAYZ+hlRZeRzUkfjCbIYmvXSK6/YNBJMrsCym3zWCzgMnKx0sW4 +N9xb3c9AwwnpWZ3llmKN3BJPzmybU0ae9xi5YnUIpssGKycWYLyWGVnjR2XtrY9BSRfZDLP hlkuuYzgjMIf0WLms71FGrvBwn4fMgWkZziQsNZpCdlniRPFWc5oc1ubKr14lNiT3sigIa/Q CUcxthC880lw38yuKHaZUJM6blveyUOgEGGHGW3R5p26K8qF3NjqquvLw89/Xl/uH7VdGnt3 Zlc2ezHD6lqPLynZmvrVqVegOpPQ4zRKTpWPk9EDHfk3LsDt9Aa3kyarTh4vFtFy6gOi+w7D lT8Kya/xa8kyu8sDZk9QVvq9MuNhLgHk5eCpzRj1585fS2Aj1p/k1ue1TarU4GbnZEq6gvq3 X1S1mtBKzI0pDJQTIjlcWR9W0B+0gYbUe8/dfKWsGk/834I7pCquiUj6PQV/WcRUPhMpOWsm VO6K8sD8Gypwvpt3+US7V0dFE7y1n22x8XaPe9tTtHJ5gNXSk74OPsktIxOAnSUTYcF8rVtH z3Pj3Zv4OdEfAivWUDCDFMNmm3v8rwkpmh32pHHfgitDmsqWJjgndR0KQ2jpndLQUUHDPvna ZbZyn147+weDiP2VX0MzGAYn1fLvfWux8NjI2RHqKhsWq/Uyldn87kqDp25bwT6erNlhZQ4S py2PzY80bJd3PHaiQh2nqY8ovSg3I6LblWGhKpcXxIR4rpsmkXC7Na7gyrrBU0tq2PQysyXJ uZhdG/srA+Zz/nn98fzyzt8evv5Lm2S6ob21cxAEJ7Vj/XKi/rjshw/JHNf9I43MJ7l9VHTR +oywtRjwMBjLJzh0Ms9q4Vfvbqo/hRIIliFSULpRxMe+gV/OsavIkq0o2Sg3M2aoHvf7cJVS Hv+16rtVtJnPnYizarEIceebNx7fgBv5pTc5NEuOYIuWaQu2W3oWZzSdlpdSnY4JDcI5n+lW CSWxjcWEI7RA5f6d87mxSavUbqKFbgpExZ5kGUxetmV54I5qDSXgy3OyZBeLv/18CfZt/PQW juNzpxFCXWteHr5/N5qE0qhm+73pdk+DxwdFVjJ6Vix5YS/Zl9ODWJqI7nxr7Dga/O3Wg+9D tMK90hpCUzV3kBkOdeUGgcybh59vYFbo9e5NZRDE8NcT2PMorm/fHh7fwJ7H89O3h+93/wH5 +Hb/8v369p9Omx1zTCzwOEs8z8/NVPkscMP+K/hxtl7IkiC4dGLhCE+33adsTPxbsC3R34Td MNHFS/N/E6T66kTgJMe+1pE47pON0nmT6n7gbKbfmcBCsoo0KRrys34P0cS7mBJczZyXgdpx uV1ZcGnvGZEmS8/7beSJR3K/Gol2VzjPznO0DAWx+Khwi4R71BHMryhT0jrO8VJiVenJbcl0 FK8VihwKF1NNk5DnZ9Ma8rpClRB4g2vHDc+bJqEFScSAcEsB/IJtKUIvo4+w20tjIH252ZNw Kx2cb+rlISlw/MmKT76Qea40MfTq7SrZUUm0S+q6rCHKRC4AfREnq4Xuu0libB1ujAdcCjUN AvZY6GBn/Z2JklrM3ZAr03lCL4h8wnSg1AeOHIzb3hPqhsobye86MEyyNCilTSnK0gQF0JQp RSWH993/eHn7OvvHLfNBBJ/mCubu4UmMFd/ujZNKCCGmEDvb39yIw5NQBFY3rowPD3jXsgRe C+FrcKlifcRXS3B5CzRF5p1DuJgHkWeCoousPJb2byJLz+bOTSQKo2mRnJyXG890Z5Cp+YJG H3yK8SwIZ+tfkAmnIzoLEdz/+CBR0V0YhNP5J2TWvvmwIbP8BZn1tEw+DxrPLtogsv0chfir 40GCi9XIZobvswwyuzwKPEuWsajOQl18maCJzMLpHE7yaPZBBtdHIbKhoVP/YVn9Qf2HDNt8 nKebD+t/9EFNAZHNdIap+j9dJevNavZBnkILmU/XftkYp5OkavZ0ztTnuVXCMourx/u3b88v P6y8twLTvOR2n9dnVLhefpSXi2A6F0BkMa29EFnNp3Mb3G+uGjKdmfl83XygMIhE0/UDRBa4 xY1RhOfL8AONt5/n64+qULWgH9QhaFDTdTXm4Xw2d4r++ek3WLuZBT8+tVGm7z9qktqt5gZ/ xiOmrrc7vmP4G+oZtIVAfyHO+K5a8udMmkrA7LgoAVaSRs2Zb188ySDSbgeaW73AFAc7SSgP Lp1AAlGoglca+vQdbDwkxZ4V2voQMLlt+X5LPX18AG81t8ZYwDFYri2gCL8UtGvOPapnrj3F GBhq5Alpz/1RKrYRbhyoSxfv5rVnAVWiDuCb7D0Jd6tYjdufAJkYXEW5MpoE0c1DACBWCLTU LXPJb4Gho/FFl0aITNOdZ+wExMo8b7vmUiWByVhy1v3dAQOjN4iu8I4R85RVNzLi3qvFyxv4 +rC7WSVl7lP22BaeXJsGQnvGvr/b35//+vL8+vzt7S59/3l9+e149/2v6+sb8nBuMNVk/O7a hmXcQW9KyI+cr09eQ0FgzWoQf0dA2Kko60uXlg3YjjFlOK3bbVeRfcJNAqbWybGhqXYbQEVK D8pg1g3ccVNGmTTrGfNzYjWhUijvqRmc+A/OkjWTXBq5L8C1mfmZfU2KRioqH8nfSH5iZZNt QciMRRQ3iA9pMGKrREWiuQVCDyEXJQlX9+rGKgEsrGGzElv9ApvCm+rqKGq+dpzTkL0yJTks 5ZogCkyrGBmjuAmflm9ZZfngU9gRu3kt8LTk9tGvQP0HY6do0RbYfSqROTwPIbyx+qYptsUo ij+JjYasEO9ewUir3chtu5MGD7rD9vdwNl9PiIk5oS45s0RzxqnbQ/TkQf3feMTbU9tSrx09 aF486cHh0p6Nq3PhcDYLkXzgB9Qy3xAlOHD06LwOFwuz0+oJEot/TmCEIS73OEsgYsMTssMG M/1mo0sbN5YQWr+Yi9C6uR+XNiyvOHQ4rVoYTqoWBeEkvdCfpbv0GVUtg5JYiqW0j1udI2+4 dYDmhuQ2QYCpM3DY92BFwgLj0NPmdEOODofpclRVUR+lBy6vMgoMvNZBq6MUqGgYLaf5ZTTJ sxDTbCQjN7kURg/q1TwmfLZGPxk35n7fAF8K6RM6mCF1oC1YeT67LWovup20it2PMFqpSxYu Ixt+ODtQROfP25LUcYjp96nGc/AAZyKt+VRlyKKtHAgJR2rgyPkY/aq1weT+QDkWKrf8GY0w pNeBC9YtF7pDNR1HSgbw5QzHVziekW1F0bwsZNlg1UkxOcLUTbxA+hy+DN0+knOxYiwqNy+Y fln29kkxFzVmKuPAAXYjvGOHKAtRRMHSuCxhNAuEKGT161ainftZ6AjmHl7lKs7lsMRxmc8t US/tyecK4+UFNk8i42azDtyBQgSJW6T9SnhHkIFdUdLqkMMd88Ma6w5gdHbAndug9e5zquvE i8mby56qcoMJF/PrUt0eHuckFSnQ2Ui9DtYrbpwvZOtgE7YGYsye1O+O1peqESVL88rHNQfm 5U5J5XxUV2O9Ckwl+CKQ3rO0rRIJTUx04Xz2C0zcUFYsEroqFSsU7BQpY0WytGfCI9ixvGoz Lq/uVGXB/df1bo8moLLje1LHZrlcLLClLxBLY7PlLGKsnNUpEyvW17f+4Zi55US+fr0+Xl+e f1zfrK0mEjPRT4SeXbCBxbcPBxbfPh1YfCevZz17az0791z4YDzKZmHsMbxJCYzuTvaQp/vH 5+/SN0zvzOfr85PIJDdHVuHGlx2r5Qzf3xTUZoNfOhbUynMSISgxOfRRgeeiMWi49iZwSN0f D7/9+fBy/QoP/L1JbVaR+f3e/ejP+68ikqev11/KL7FY8KZh4U3Dau5+OZYaj+6W+PvT2z+v rw/WBxcbz4ELiTdrz9GapHw1dbP2pkBQ3gg3gTfUZuGeBgyp+v7+8vz69fnn9a53mOw2yJnH xHXfMJZu6RfXt/99fvmXrAXv/3d9+a879uPn9U9ZhtRTcCIfXY/e2cP3f75hmqmdaA4HhuFm FuBHAaZQiAs1gvSd3wH39+pvR638/vvT9U31YFPapTldrOdusohoCP++3l2fri/f3+9kNNBR MmpmSbJaeQ5LFOerQcDhiVWcrxdMVuuFe3hQX1+fH2EH8BdaX8g9h2lABb5Lc4oM3Ho03Ja7 ++1O+eB8fH66GocEsJcqBrQyZvT/KXuS5rZxZv+KK6eZqjcTa7V9yIEiIYkjbiZBSfaF5Tia RDWx5WfL9U3er3/dAEhiaTD5DilH3U3saDQavYiXCmXURR+vIs89puaVfgjE+XZfpVKn18l3 92VgOMrg74EDXqQOuPKkFAFBo+JBsqaN2cM9HzGa10Op+xX9HiE0hbd1HG6gaI9cUS1YM+YT 5ve+xogFA54JizBtdhjJiG4dH1FnXPVyePjn/QXXigg8//ZyODx+6/XHIlZdrQd5lICmusv4 GjqWcT3ni4vVJU8LW+Qwi15sHRW89GEXWeVDRSzkyWYAy/aG2tPBF9Q7lkU1UMOG3fn7nAx8 aLptW7hik9deLN8XpRfZxuXu+SW6pVUhRo5Cg+GgLIKo4SnsbdpUQKeHIgN0Gq1EBKMyjafU WEk9dtPGIu3FUMy+V408b6xtNs7LG5r1yexbEZ+MZvRzsCRY5XAfpXtS5Uk+35PZ05K4DF0F vIAu+PVYix4hYPEqL/G9pNYjEklMar4OCWARlMCxyJuUrDio9DicEmY53mpAaUGaxtyIYy8J dId9AbmPk7zzZg2ev7yejl+M8yCLynzAdWcHd0CvM5jgN80qSq/GHnaKr6RblkU5ZlzH1wva fytk0WjquVNEq5J2Heojag47WkW70O89t+App0KL76/nXcQfLSxWx9FZ2exSTR2EkHWkBWAU F+oEtosIZNj3dF3CBTxvUdSrMNrFdx/qQKPCFtIE+jV+Wf8V86omKjYx/nRQioxjmA2NqwRp jHmzlptYT1S6LmQEDANiNDOtYqczsKQCEcXWwYjXQbf3GFGP6BKCi1g9KVLWBxELkLvZxWGg ug0ilG8SBcZY+wGVA8ekEsO4DEK0P489frPEF79Ap9x80Aye6JpJK1hfvzpN5DrncCg1eNxq j42t9BsFhWUQLUw6WJbkO6JexljhTptY6+Z2QEi2MIHyY2vbQAudBWMAMNYgiE1upfgpz6t1 rOf+UwDY185iFR+EqX48K/sUawgWKeqWyDna56NZw9BlhTr5ZDRIp6XpPjW7JKvNgw0vpbNO v6RVEbfkMSXc7ZtVWu/dKSsrj8JKuuVgfMdQJhEkyYot7Mo4dCTEdZvEsHo5Pn8/Gb5p7aZN NmzL0VJ6NtEM3PFnI7zQfmiUiyTqKLvK0WVpkVNprKR1iJEmRoKcIIlBGkmUXnAHxMOdUxup p9hqgdcjGC7JAnWLfWnLZFWhgTWfmQFbKCRcJnlR3DU73f+ivG1KlgZFa3VUHp5O58PL6+mR MvmqOJPxu5sSbRDcG+HL09tX6sNCHGfL0pOGBsTj0Gx+P0vCVoTqmX4C4Q1OuvMbo9RBm3BB F9FsRLJLTLdjFKauiyxqi6Ww2jjiw0GeoXMk8LdC+BlJkrFHt9meXL3xnDjTmomhC9/sq4iW TMWdlbcfBfvYDSj33+gS51793vjGpzG4uvHYm6LazK+cvPLY7wJqeuVtxvU1LV+DLDiaeCyx 07CYjC9pGZHjg3J4eT1yV3Hw9PL9+PfRGaXrydzVBa6PX1o7SVRth6enp9MzOb9yjZgBVS10 u2is4NmKgomgFSC247W+3LgT3uV/P108yLn3Tfjscu7TEc0mXq3ebOLVEM+mHg9TQM3H09J2 mTY+nfpmHVA+ldRs5tXoz648lzVE+fvtX7KzucdeGNblxPPsAOty5rncwrKcXplm9CqP7+F/ 3w/Pjz86jfL/oYoriqqPRZK0ryShOA9XqCJ8OJ9eP0bHt/Pr8fM7atDNSb6xvBiksfe3h7fD HwmUcfhykZxOLxe/QeG/X/zdVf6mVW4WuJxOZq46579RGHvXD2J9Dgot1jcH+7KazijJRds7 q7syt3ir4qASYzPQnoqvJmNCiRXD+J8xW8DT4eHt/fXwdHg+X7w/H89Et6de9abAegYlzraY ZGx+ObvEtv66CjyI/oJ+TzwW960QLtTbHsa5DbNkaqnuiAMr6RIz/EzvHWyub66od0OtuDRY YQjLlGF8bnKqkMJz1v2SQlgENSnrgv9cG4zuYBSV3EOvhzecc8X43+x6KsxOySp6QWWcDiG7 TRmmuqDl5B2twYiLAEN0eL6CJrAuZ3zi6e0ydQ/A5fH1SYjfTpgGFhnzAj+bfLmkbvRt+nmQ 36R42Qq5qEEoF9p7eRRGC91SJ0rj2Mh/CwA5IZQIhwFr4fK05FClbqPbI/QGr/J8BZeZtnVO z9kyvviN/XuGeT1+/n7oRyJunQd/v6hse2f4qNkGem6VFtIUqDw3fU1NVCe9AytAyZ+YC9SQ /3g7H560eYjCIFyzZof5DpRfuO4Hu+fjxhNwCHATOoYWYKaNbjktADWm/UDhA8rULlqKuMEQ QJjaOXFRFQvrUjrI67VPvVqgvxaRYZyKv/0qo6pJF2IUNMsLhr7DgFkaV+sODMShx5WuJcFr DTojU2bEWvHNPuBck/91FDEkOloblrafbYu130Qhf3nGFOF+/Y74CpPgYjwUatr3Vu34+7bO uXZL3NMNQrCppkII7Cv6Jren2tnuy2U1NlqhAOIqj3r9KNHc2DFLq0neQpp8rMcw7sAYIKEC ZsmaMKnNtBAdjbis25VI9/c0qDYyFVzXGx1NbqcFL62RbSHGWPZPaS1WrFJxVq1wqul3t5a4 rLOmCjKgE+bg9J6X1L6xz+LEHk7fxkblh+5BgWH72inSoFWW83iprfDIBsQSIOZF+zDo6Prz ScEUm8O7dRpXVQyXbaIv1sIVP/E5AOOuyOMfk2v1BCLQmSLDhSv70VUuEb6Bk1heMo0F3S5T 3mxHNkAzABRfhTyxWonJgKVOWdMu1TxfViZTXgqGrNsgGmEzlQOUmjhlJ/P4Tfd5X1YW21SA bgP0Y68Qa2Ae+aoMaCGkpRp4+1YU+QJjIaBlFKU4FzQiEKTxdNFBByrQiMi2ynGI/ijz9GO0 jcSh6pypcZXfzOeXJivOk5hpM3IPRPoGqKOlQY+/s6QLIhXl1cdlwD9mnK4ScMbnaQVfGJCt TYK/W5kBY1mgp9Sn6eSKwsd5uAZRAzrw4f389/WHbsdz54wUIC+HQGS5a3tVvB3ev5wu/qZ6 JM5PfYQEYKNyqOuwbUoAQcwztoYAYhcxM0vMdQ8tK2IDTwvnJ8XEJMI6vtf1CnjEQi9AgUTl ulEv/rH4unDqEavvDo6WVH+xi5yBViAYTkovvLSKZsIE1SqiA4JwXVWBJ8vL2ioKfss0RfqJ xJz2CZBvISzs5jmSi32StBAVaebSge/gjGOu6rbHo1fVFnjaklICS7KqhjtGaUhU6mtrnjs4 KV61cgAhoCEKuTPe6uDoUcGvK5vk3gh3ImHJfW6DRHJ7t7dlvYhp0Uk1AFXvTZZnlI+1TlJg kGJHSuzx6KH203qWwTavS2g9URk01Jr5FoJeOhhBOZLDpXHKlsAYjw5qjhzIWsYRB+xc/13d 1kG1piD2hHdws/wObDSmL+ReH7kOPBUZUTAxincAO1qWLpgnFHxHsyyDVcpA/lDHL6ZUnnSM 35bL0ziDJWsIvamze9eFAFHCSrafWiUCaO6UoIA+DlASlUqY8GGNmsWdjAJJX7MsypRTA+SU l/O1dpcSWNiDC/OZr4NDodoBIi/g2nSqe3co47MR1SsCad7XHzZbc707oyAhkp/Rhh8Dw8r2 uVOghHnvv2NrNgUARTjj+FVk9r5owQQfbFEuGwQJaxuURqVBbbVCABYYRH2NKvBmNL4ynkYt tC8siFPMpe+pySKcjK/mV9TJinQVRuyruNOgtbxi+D6T9x5dLF9i4Mm84c186hRWRnQsRNmC oolxJgYo1js6FrXqaSN44SAFXhF8fQG0EgSs/izQDz3J88LpkG8FGm7fcMfa5eWGFoMya5Hg b/1KJH5P7N/mshSwqUlT7XTNoqRoRg5Ee2IvRFPErTW4M6wbBcaKjyxgcGmxaduaGmEzjCxc JIltMCRJngZx9unDP4fX58P3P0+vXz9YX7X7Cl2kWGIPkryaaVOQSe1FG/MuIq+9LdGGlRlL kMgs14rhCKDI6E0E0+EMd4RzYgMoqqnV3sjtJq0JR1J1UxmIkodzojVX/JSVaj2EZnXWGcY8 qRfX/pCvs9KwlRW/m5UeWVPB8ASCC1SW6dOkcGj92pgxGRXGXJQAgZHA4ptNuZg51NbMhKxY m7f72DwU8LfXrEQgdyzYNMUOU3Rqp6ZA1UUY6PZYAmidDAImjgULZky8gDjBI3soFS1YYvVm WL1KF97P+o3RTm1YmCwlFPc9lBk4SFKrzNBISSxch3niqqsksuJl7kJxBRmbSUBzEJIzQ1Oi ykAfAbjBUztUFpc4ZbE9LwPDbTQKzBPVvUIOMOWAGqwbc6zET4qEEgckwhUGzK4kVat0sFUN SdWpKZrpRPOXNjBXfszVzIO5nl16MWMvxl+arwXXc28985EX422Bng7Hwky9GG+r53Mv5saD uZn4vrnxjujNxNefm6mvnusrqz9xlV9fz26aa88Ho7G3fkBZQx1UYRzT5Y9o8JgGT2iwp+0z GjynwVc0+MbTbk9TRp62jKzGbPL4uikJWG3CMIoZ3Jb0tEotOGQJ18Nn9fCMs1rPJddhyhyE H7KsuzJOEqq0VcBoeMn0xJ4tOA4xB1REILI65p6+kU3idbmJq7WJqPlSW5H40KT/6E45ofrc CLHu4tvD4z/H56+92hN4OIYPLm+XSbCqNDtR8dXL6/H5/M/Fw/OXiy9Ph7evbkJr8Q6xaZRe qK1dqXGllk9EdkrYFoSRaUuxwFTN6tuIYTos/dlc5cCmg+uFp6eX4/fDH+fj0+Hi8dvh8Z83 0cBHCX912yjfuvBt1KilgzYli+qQVHmwDN+2xQsLfFCULAy4nj9a4dO64vL5S7uOwn1HfmmE XoLjOi6ACaSYC8+MS8mCSJQGSEp1lYGgHKkMepU+2PIlTy9qzTCV29C7sfyqkrIrKoJTjHhE ncuYNX2H4cFkh4pcvEaZzy06ZqC6ZV7CYpNynht8X5GmwSoW+vTytu+kBuxXV1BtPl3+ezn6 PDfHQl4m2jUss3lcRIfP71+/yrVvNQsZtfCRHGi6fAGir69qLOG+QGmzMXaZalfK0gQ6767C FjNUPEeLmbryOTRKqi390qWQccnrgPKrUo/FMrpdnMXcbaKaMBj1ghITtW6KluZbVi6TfOcW ZKB9JYlVh6PSbqqukA44NFZrKySjfNPCFXCBBoTvL5JlrB+ev+p5K0DArtHXh8NU6y8266CM XGT/8gDMDJ3WUp2wsP0DfkrcbIOkZp8uqYLR3fGXC7aJu4K7QcI+NGv0nOC4iRzG3aEEY0cV wmhMtqsn/IX+mrRudyUYHylyco0ZeLtTFSyKyL3ZCbDv2imSkHSvx9I2EW1UO15x8dub8uN4 +5+Lp/fz4d8D/Odwfvzzzz9/dxkJ3KzTmrO9x7OpRQuDh0FGWRVx5tVFq806UJGk2O1UdRVs NMx4MUArMmb5eWBRwoZtL6AkhSgAR3KgkoDneKxXCWO0i2LfFrScCQoM/pcsHfOQ7iQFRiLk F4KhSn7tZXXwDzjQIq+Ib4UiXET8Gmpk7HEgUhNIj5JECqVtDGfoAE0IMgmIrnGQuCajZVjT x1lV4KN5A/jBwxjxwMJApmROOH+NBLk9OvcnHRMYj8xCegrb8MysC+dooK8yXxvbiwik9Ki2 QzaUm0KzvPFq5vr1CnJcFt7RPqXi9FkHVXdilTEmq8ZcNWFe3EmxqqKONpKQEuYqyXjUAnb9 s7K8kONmHEOwCdu0jD/BrsqgWP8SzbKQ8TiHqmlSsR8owlZYX7Y70Y9sdjFfg5i7quzKjEpA yM7LyCJB+wqxFJFSLG6nENgu+lO6AIaqNFm0ZkxRSpM68yEOuU73ot9K+Ft86ER6Q/cGfziu 2Ar6FLoDrRUl2OrO0q465bXmT3ZBitBdIEuH81krg7a7Lm9BOlgOkciDdIBAzZaaEY8Tr/i8 qTKQFulEXurpC04W8aqBxgHGY6eCBxlsfbxzqQ88J15HDktkkFCK0W7v2lYl4qm8ES5Nxnre QBULJpeDZgZAQjWgeU9SI4dhTerC4b0dHUbH9jNNfW0tgImt06D0vFprlL5K5Yny/iyu0/zw drbOlGQTcfpSgSWJcxAETk+YFjlolW7oSdt59owQDnw/XblAo0U/Xpx5WxHzYYhMCiLzaSde 0FQiQn0ZxNHcX5QYBOT7Gd66k8J3qgu6DRDynHbrQxELo+Xl6zAeTW6mIqw+XsXoPdgGc0By dITNObNj+PeHEwboH/SlrzBUIvPe6+RtbBUtjIsY/CalMnEGwiYy0rphgAglcYkrQa0xQxaU yZ3SBuk16HB/SlwReoJHdUpHhxByeY5pwNzzWsJ9MlCrIuHoOVwDcynzbO8Wku29BeT1IlGP C85naLWX1BUtlLf+0b75ap20bV8dfdI6JkKFZcBBkynFSnITdPVI7ZxIONBc7q8v+wuXjWPR pxGNq6WGb0xjBeefODhRme4S3SMYHV6lo5D1DdN4jNF6A1StifodVUmsQn2Jt1p6t4eF3/ga LfBSjLQOV7zYtttWSyqNh1mTnD6lTeEgNqAkDgKrw9irw+P76/H8w1WKbtidcTbxEt0LIgEn 64STBq03CRKtxFZZJGxnrRq6h/UoZZVw8hKsguIhzqNdC9EthLrylAmHH9Psl2VKoEUaSCc4 Ad+TiUertEGHMDRnE5kpP80xFb1TJsxbnNV7suMK1+tEaGZskxMeVl5SVLPnBdHXliLYhrbD iEMjri0lu4Vp5ErPMhpoX5EncXgXLZDBCyNTX1i1/ss0CMmQIC0BHND5XU40USKExRT6VRS8 kWK/oWKniOso5vgQ8Wl0OZ4STVK0IBhwzekmyVGR/vOWqjFQ9J8+fHz7fHz+eD49nX6c/jg+ H88ffB8GILNvAyW3Syd69TX9WVDAykkNe3Ibpenc2smzSe8CPRePAZYiMjMcGWOPZMG8+mbJ Ru2l8mvEcmR+jbbt869RY/8GuH7PofTMnTb204duVvY42HiJ1M0ehNho5haRMNRcF3c2dJ+X Nqi4tSFSCsW7rJa5RUZ5bjWX4euPl/Pp4vH0erg4vV58O3x/ObxqYWdkSOglRu/5YQGDZGXE jDHAYxfO9Gy/GtAlhftUGBdrI3S+hXE/sgyAeqBLWmYrp2SAuYQFWnU7pALqEqdBFhhRUkz4 2LAAkihkGbQoYHza8nLX580kXy1H4+u0TpwWZ3XiAgvx1wHj0Xdbs5o5HRF/iDms+RqOeQdu 5WtRxHhXllcelEcc/Ao4j4mXMUrez98OcNt8fDgfvlyw50dcthhD+T/H87eL4O3t9HgUqOjh /OAs3zBM3YoIWMVu421b5UIEnng6fdGdydoCF253Q+4u15BXDozpHpsKlpQ7YnqISva8i0Gw fnj75mteGrifringnqpkKynbaBdwu3drKMPJmBgDAZYSkWHGp6GH1rsggJ4nVj5Za+rEVrfr TqMpAZu52zEO14HIqOe2v0wj2EEkWLeK6sHjmbuEATwZu9TVOhiRwKaqKjYhhguQUL5ED40a 0M1GY5eOKo1qwcxI2KA276oc3bjgXUERiwlpxKxhzoN2+uUBc3z5ZkYyazk/caKwSlxS5u5M Ikor2kJm9SJ2d1pQhm5BcPDuljGxflqEE7TIxntaGAYpS5I48CL6D51l31JAL6GTwXavaAf3 ivPRmPjK/gYtTuj+IW5GNg7gnja5lHNPCfNfKiFi7iwu6WNqsw7uCYGiwpCS1O6TcN/kVYwR ZbGyQA2tBw4bjo39BUqavtfUBu+Jfj53nLlLC+6p5FpWcN9Ut2hP2010M9kFd14ao3+dpRUG jDnqccG6+V3iE5pT2r2ZBE4divc5MWbJ/eCuAPSaCNT38Pzl9HSRvT99Pry2waSoBgZZFTdh QQmI4vEt0GOZWoiGPJY6bOWTadc7hxHiY0IRRKZ7hosTTHQID8xdH0K4FaQpQ/0JqlmElsqn B9xsNdVHC8GHoHAdFzSmKfOaG89THVY8aiy11zkEwqCEQkmMD+f4rGyiURNpfSCvOUuigrSK CSjqt0qWwEVeqPjx4t9TKbum+F5co42a+jEVXTPPHNGS1AxbKJpbS3UBpePatuGNoQ9orZ8a Dz+LOAtKpbJediYlx8+vD68/Ll5P7+fjsy7kyVudfttbxLxkqEbRhrB9Gqx4mcH9EdN6plb8 CZ0kYZkHi9GlZY5UB4UhiPBRAQ6VRcxdPCaBi3MjHlKL8oK19zCYMZzAXaU/CYCICPJ8zA22 HBqJD4GCjy6jeGnCYl435lcT606GwueAXlsRJDCPi7tr4lOJ8fEnQRKUu8DjMCkpFuQKApxm XA3c0hXAQ01uRX6K1hWC2f4woA4LBjbb+Xr3tAhFVb8Ln5Lw/T2C7d/iCqc/IEhoke/g5KON hhRJHHikH4UPSlqH1KP5uk7p0GOKBu1eKNszhV6EfxFN9776tEPSrO5jI/5Xh1gAYkxikntd r6YhhGc2RZ974NP/7+NadhgEgeA39dJwtQUTUhpSrF79DT9fZ0zoLJJeB10SHwvMzO71l6I/ azDOxBJgCc4pm82BouDtXf8GTPhn6HYXG0I4zqsBKb6HrS/lVgR/vLvwOAlOSVdTPuqdjHZ4 Qtb+QHeOPuuz+RBS8mBXIGYe28nto5WAyZaRVe9PFYn5EY8sMfrGRSKnMq9NR5pjvSpN343i eTz9kZK+xyfn6OGMiRPI7BpufqJJBNVlcX5k7Fivmh7wHqXE693mmghu4wveAeGPDl64PQIA --------------020709090402000802070905 Content-Type: text/plain; charset=UTF-8; name="xlcreate.txt" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="xlcreate.txt" UGFyc2luZyBjb25maWcgZnJvbSB0ZXN0LmNmZwpsaWJ4bDogZGVidWc6IGxpYnhsX2NyZWF0 ZS5jOjEyMzA6ZG9fZG9tYWluX2NyZWF0ZTogYW8gMHhkNDA4YjA6IGNyZWF0ZTogaG93PShu aWwpIGNhbGxiYWNrPShuaWwpIHBvbGxlcj0weGQ0MDkxMApsaWJ4bDogZGVidWc6IGxpYnhs X2NyZWF0ZS5jOjY3NTppbml0aWF0ZV9kb21haW5fY3JlYXRlOiBydW5uaW5nIGJvb3Rsb2Fk ZXIKbGlieGw6IGRlYnVnOiBsaWJ4bF9ib290bG9hZGVyLmM6MzIxOmxpYnhsX19ib290bG9h ZGVyX3J1bjogbm90IGEgUFYgZG9tYWluLCBza2lwcGluZyBib290bG9hZGVyCmxpYnhsOiBk ZWJ1ZzogbGlieGxfZXZlbnQuYzo2MDg6bGlieGxfX2V2X3hzd2F0Y2hfZGVyZWdpc3Rlcjog d2F0Y2ggdz0weGQzNjA5ODogZGVyZWdpc3RlciB1bnJlZ2lzdGVyZWQKbGlieGw6IGRlYnVn OiBsaWJ4bF9udW1hLmM6NDc1OmxpYnhsX19nZXRfbnVtYV9jYW5kaWRhdGU6IE5ldyBiZXN0 IE5VTUEgcGxhY2VtZW50IGNhbmRpZGF0ZSBmb3VuZDogbnJfbm9kZXM9MSwgbnJfY3B1cz04 LCBucl92Y3B1cz0xMywgZnJlZV9tZW1rYj0xOTY5OQpsaWJ4bDogZGV0YWlsOiBsaWJ4bF9k b20uYzoxOTU6bnVtYV9wbGFjZV9kb21haW46IE5VTUEgcGxhY2VtZW50IGNhbmRpZGF0ZSB3 aXRoIDEgbm9kZXMsIDggY3B1cyBhbmQgMTk2OTkgS0IgZnJlZSBzZWxlY3RlZAp4YzogZGV0 YWlsOiBlbGZfcGFyc2VfYmluYXJ5OiBwaGRyOiBwYWRkcj0weDEwMDAwMCBtZW1zej0weDll ZjY0CnhjOiBkZXRhaWw6IGVsZl9wYXJzZV9iaW5hcnk6IG1lbW9yeTogMHgxMDAwMDAgLT4g MHgxOWVmNjQKeGM6IGluZm86IFZJUlRVQUwgTUVNT1JZIEFSUkFOR0VNRU5UOgogIExvYWRl cjogICAgICAgIDAwMDAwMDAwMDAxMDAwMDAtPjAwMDAwMDAwMDAxOWVmNjQKICBNb2R1bGVz OiAgICAgICAwMDAwMDAwMDAwMDAwMDAwLT4wMDAwMDAwMDAwMDAwMDAwCiAgVE9UQUw6ICAg ICAgICAgMDAwMDAwMDAwMDAwMDAwMC0+MDAwMDAwMDA3ZjgwMDAwMAogIEVOVFJZIEFERFJF U1M6IDAwMDAwMDAwMDAxMDA2MDgKeGM6IGluZm86IFBIWVNJQ0FMIE1FTU9SWSBBTExPQ0FU SU9OOgogIDRLQiBQQUdFUzogMHgwMDAwMDAwMDAwMDAwMjAwCiAgMk1CIFBBR0VTOiAweDAw MDAwMDAwMDAwMDAzZmIKICAxR0IgUEFHRVM6IDB4MDAwMDAwMDAwMDAwMDAwMAp4YzogZGV0 YWlsOiBlbGZfbG9hZF9iaW5hcnk6IHBoZHIgMCBhdCAweDdmNjM4ZGZlMjAwMCAtPiAweDdm NjM4ZTA3N2RlZApsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6MTIwNjpsaWJ4bF9fc3Bhd25f bG9jYWxfZG06IFNwYXduaW5nIGRldmljZS1tb2RlbCAvdXNyL2Jpbi9xZW11LXN5c3RlbS14 ODZfNjQgd2l0aCBhcmd1bWVudHM6CmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4Omxp YnhsX19zcGF3bl9sb2NhbF9kbTogICAvdXNyL2Jpbi9xZW11LXN5c3RlbS14ODZfNjQKbGli eGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAgIC14 ZW4tZG9taWQKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xv Y2FsX2RtOiAgIDEzCmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19zcGF3 bl9sb2NhbF9kbTogICAtY2hhcmRldgpsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6MTIwODps aWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgc29ja2V0LGlkPWxpYnhsLWNtZCxwYXRoPS92YXIv cnVuL3hlbi9xbXAtbGlieGwtMTMsc2VydmVyLG5vd2FpdApsaWJ4bDogZGVidWc6IGxpYnhs X2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgLW1vbgpsaWJ4bDogZGVidWc6 IGxpYnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgY2hhcmRldj1saWJ4 bC1jbWQsbW9kZT1jb250cm9sCmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhs X19zcGF3bl9sb2NhbF9kbTogICAtbmFtZQpsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6MTIw ODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgdGVzdApsaWJ4bDogZGVidWc6IGxpYnhsX2Rt LmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgLXZuYwpsaWJ4bDogZGVidWc6IGxp YnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgMTI3LjAuMC4xOjAsdG89 OTkKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2Rt OiAgIC1nbG9iYWwKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXdu X2xvY2FsX2RtOiAgIGlzYS1mZGMuZHJpdmVBPQpsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6 MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgLXZnYQpsaWJ4bDogZGVidWc6IGxpYnhs X2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgY2lycnVzCmxpYnhsOiBkZWJ1 ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19zcGF3bl9sb2NhbF9kbTogICAtZ2xvYmFsCmxp YnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19zcGF3bl9sb2NhbF9kbTogICB2 Z2EudnJhbV9zaXplX21iPTgKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxf X3NwYXduX2xvY2FsX2RtOiAgIC1ib290CmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4 OmxpYnhsX19zcGF3bl9sb2NhbF9kbTogICBvcmRlcj1jZGEKbGlieGw6IGRlYnVnOiBsaWJ4 bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAgIC1uZXQKbGlieGw6IGRlYnVn OiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAgIG5vbmUKbGlieGw6 IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAgIC1NCmxp YnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19zcGF3bl9sb2NhbF9kbTogICB4 ZW5mdgpsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxf ZG06ICAgLW0KbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xv Y2FsX2RtOiAgIDIwNDAKbGlieGw6IGRlYnVnOiBsaWJ4bF9ldmVudC5jOjU1OTpsaWJ4bF9f ZXZfeHN3YXRjaF9yZWdpc3Rlcjogd2F0Y2ggdz0weGQzNjJkMCB3cGF0aD0vbG9jYWwvZG9t YWluLzAvZGV2aWNlLW1vZGVsLzEzL3N0YXRlIHRva2VuPTMvMDogcmVnaXN0ZXIgc2xvdG51 bT0zCmxpYnhsOiBkZWJ1ZzogbGlieGxfY3JlYXRlLmM6MTI0Mzpkb19kb21haW5fY3JlYXRl OiBhbyAweGQ0MDhiMDogaW5wcm9ncmVzczogcG9sbGVyPTB4ZDQwOTEwLCBmbGFncz1pCmxp YnhsOiBkZWJ1ZzogbGlieGxfZXZlbnQuYzo1MDM6d2F0Y2hmZF9jYWxsYmFjazogd2F0Y2gg dz0weGQzNjJkMCB3cGF0aD0vbG9jYWwvZG9tYWluLzAvZGV2aWNlLW1vZGVsLzEzL3N0YXRl IHRva2VuPTMvMDogZXZlbnQgZXBhdGg9L2xvY2FsL2RvbWFpbi8wL2RldmljZS1tb2RlbC8x My9zdGF0ZQpsaWJ4bDogZGVidWc6IGxpYnhsX2V2ZW50LmM6NTAzOndhdGNoZmRfY2FsbGJh Y2s6IHdhdGNoIHc9MHhkMzYyZDAgd3BhdGg9L2xvY2FsL2RvbWFpbi8wL2RldmljZS1tb2Rl bC8xMy9zdGF0ZSB0b2tlbj0zLzA6IGV2ZW50IGVwYXRoPS9sb2NhbC9kb21haW4vMC9kZXZp Y2UtbW9kZWwvMTMvc3RhdGUKbGlieGw6IGRlYnVnOiBsaWJ4bF9ldmVudC5jOjU5NjpsaWJ4 bF9fZXZfeHN3YXRjaF9kZXJlZ2lzdGVyOiB3YXRjaCB3PTB4ZDM2MmQwIHdwYXRoPS9sb2Nh bC9kb21haW4vMC9kZXZpY2UtbW9kZWwvMTMvc3RhdGUgdG9rZW49My8wOiBkZXJlZ2lzdGVy IHNsb3RudW09MwpsaWJ4bDogZGVidWc6IGxpYnhsX2V2ZW50LmM6NjA4OmxpYnhsX19ldl94 c3dhdGNoX2RlcmVnaXN0ZXI6IHdhdGNoIHc9MHhkMzYyZDA6IGRlcmVnaXN0ZXIgdW5yZWdp c3RlcmVkCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6NzA3OmxpYnhsX19xbXBfaW5pdGlh bGl6ZTogY29ubmVjdGVkIHRvIC92YXIvcnVuL3hlbi9xbXAtbGlieGwtMTMKbGlieGw6IGRl YnVnOiBsaWJ4bF9xbXAuYzoyOTk6cW1wX2hhbmRsZV9yZXNwb25zZTogbWVzc2FnZSB0eXBl OiBxbXAKbGlieGw6IGRlYnVnOiBsaWJ4bF9xbXAuYzo1NTU6cW1wX3NlbmRfcHJlcGFyZTog bmV4dCBxbXAgY29tbWFuZDogJ3sKICAgICJleGVjdXRlIjogInFtcF9jYXBhYmlsaXRpZXMi LAogICAgImlkIjogMQp9CicKbGlieGw6IGRlYnVnOiBsaWJ4bF9xbXAuYzoyOTk6cW1wX2hh bmRsZV9yZXNwb25zZTogbWVzc2FnZSB0eXBlOiByZXR1cm4KbGlieGw6IGRlYnVnOiBsaWJ4 bF9xbXAuYzo1NTU6cW1wX3NlbmRfcHJlcGFyZTogbmV4dCBxbXAgY29tbWFuZDogJ3sKICAg ICJleGVjdXRlIjogInF1ZXJ5LWNoYXJkZXYiLAogICAgImlkIjogMgp9CicKbGlieGw6IGRl YnVnOiBsaWJ4bF9xbXAuYzoyOTk6cW1wX2hhbmRsZV9yZXNwb25zZTogbWVzc2FnZSB0eXBl OiByZXR1cm4KbGlieGw6IGRlYnVnOiBsaWJ4bF9xbXAuYzo1NTU6cW1wX3NlbmRfcHJlcGFy ZTogbmV4dCBxbXAgY29tbWFuZDogJ3sKICAgICJleGVjdXRlIjogInF1ZXJ5LXZuYyIsCiAg ICAiaWQiOiAzCn0KJwpsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjI5OTpxbXBfaGFuZGxl X3Jlc3BvbnNlOiBtZXNzYWdlIHR5cGU6IHJldHVybgpsaWJ4bDogZGVidWc6IGxpYnhsX3Ft cC5jOjcwNzpsaWJ4bF9fcW1wX2luaXRpYWxpemU6IGNvbm5lY3RlZCB0byAvdmFyL3J1bi94 ZW4vcW1wLWxpYnhsLTEzCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5k bGVfcmVzcG9uc2U6IG1lc3NhZ2UgdHlwZTogcW1wCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1w LmM6NTU1OnFtcF9zZW5kX3ByZXBhcmU6IG5leHQgcW1wIGNvbW1hbmQ6ICd7CiAgICAiZXhl Y3V0ZSI6ICJxbXBfY2FwYWJpbGl0aWVzIiwKICAgICJpZCI6IDEKfQonCmxpYnhsOiBkZWJ1 ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1lc3NhZ2UgdHlwZTog cmV0dXJuCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6NTU1OnFtcF9zZW5kX3ByZXBhcmU6 IG5leHQgcW1wIGNvbW1hbmQ6ICd7CiAgICAiZXhlY3V0ZSI6ICJkZXZpY2VfYWRkIiwKICAg ICJpZCI6IDIsCiAgICAiYXJndW1lbnRzIjogewogICAgICAgICJkcml2ZXIiOiAieGVuLXBj aS1wYXNzdGhyb3VnaCIsCiAgICAgICAgImlkIjogInBjaS1wdC0wMV8wMC4xIiwKICAgICAg ICAiaG9zdGFkZHIiOiAiMDAwMDowMTowMC4xIgogICAgfQp9CicKbGlieGw6IGRlYnVnOiBs aWJ4bF9xbXAuYzoyOTk6cW1wX2hhbmRsZV9yZXNwb25zZTogbWVzc2FnZSB0eXBlOiByZXR1 cm4KbGlieGw6IGRlYnVnOiBsaWJ4bF9xbXAuYzo1NTU6cW1wX3NlbmRfcHJlcGFyZTogbmV4 dCBxbXAgY29tbWFuZDogJ3sKICAgICJleGVjdXRlIjogInF1ZXJ5LXBjaSIsCiAgICAiaWQi OiAzCn0KJwpsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjI5OTpxbXBfaGFuZGxlX3Jlc3Bv bnNlOiBtZXNzYWdlIHR5cGU6IHJldHVybgpsaWJ4bDogZGVidWc6IGxpYnhsX3BjaS5jOjgx OmxpYnhsX19jcmVhdGVfcGNpX2JhY2tlbmQ6IENyZWF0aW5nIHBjaSBiYWNrZW5kCmxpYnhs OiBkZWJ1ZzogbGlieGxfZXZlbnQuYzoxNzM3OmxpYnhsX19hb19wcm9ncmVzc19yZXBvcnQ6 IGFvIDB4ZDQwOGIwOiBwcm9ncmVzcyByZXBvcnQ6IGlnbm9yZWQKbGlieGw6IGRlYnVnOiBs aWJ4bF9ldmVudC5jOjE1Njk6bGlieGxfX2FvX2NvbXBsZXRlOiBhbyAweGQ0MDhiMDogY29t cGxldGUsIHJjPTAKbGlieGw6IGRlYnVnOiBsaWJ4bF9ldmVudC5jOjE1NDE6bGlieGxfX2Fv X19kZXN0cm95OiBhbyAweGQ0MDhiMDogZGVzdHJveQpEYWVtb24gcnVubmluZyB3aXRoIFBJ RCAxODU3NAp4YzogZGVidWc6IGh5cGVyY2FsbCBidWZmZXI6IHRvdGFsIGFsbG9jYXRpb25z OjEwNjIgdG90YWwgcmVsZWFzZXM6MTA2Mgp4YzogZGVidWc6IGh5cGVyY2FsbCBidWZmZXI6 IGN1cnJlbnQgYWxsb2NhdGlvbnM6MCBtYXhpbXVtIGFsbG9jYXRpb25zOjQKeGM6IGRlYnVn OiBoeXBlcmNhbGwgYnVmZmVyOiBjYWNoZSBjdXJyZW50IHNpemU6NAp4YzogZGVidWc6IGh5 cGVyY2FsbCBidWZmZXI6IGNhY2hlIGhpdHM6MTA1NCBtaXNzZXM6NCB0b29iaWc6NAo= --------------020709090402000802070905 Content-Type: text/plain; charset=UTF-8; name="xlcreatediff.txt" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="xlcreatediff.txt" K2xpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6NzA3OmxpYnhsX19xbXBfaW5pdGlhbGl6ZTog Y29ubmVjdGVkIHRvIC92YXIvcnVuL3hlbi9xbXAtbGlieGwtMTQKK2xpYnhsOiBkZWJ1Zzog bGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1lc3NhZ2UgdHlwZTogcW1w CitsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjU1NTpxbXBfc2VuZF9wcmVwYXJlOiBuZXh0 IHFtcCBjb21tYW5kOiAneworICAgICJleGVjdXRlIjogInFtcF9jYXBhYmlsaXRpZXMiLAor ICAgICJpZCI6IDEKK30KKycKK2xpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9o YW5kbGVfcmVzcG9uc2U6IG1lc3NhZ2UgdHlwZTogcmV0dXJuCitsaWJ4bDogZGVidWc6IGxp YnhsX3FtcC5jOjU1NTpxbXBfc2VuZF9wcmVwYXJlOiBuZXh0IHFtcCBjb21tYW5kOiAnewor ICAgICJleGVjdXRlIjogImRldmljZV9hZGQiLAorICAgICJpZCI6IDIsCisgICAgImFyZ3Vt ZW50cyI6IHsKKyAgICAgICAgImRyaXZlciI6ICJ4ZW4tcGNpLXBhc3N0aHJvdWdoIiwKKyAg ICAgICAgImlkIjogInBjaS1wdC0wMV8wMC4wIiwKKyAgICAgICAgImhvc3RhZGRyIjogIjAw MDA6MDE6MDAuMCIKKyAgICB9Cit9CisnCitsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjI5 OTpxbXBfaGFuZGxlX3Jlc3BvbnNlOiBtZXNzYWdlIHR5cGU6IHJldHVybgorbGlieGw6IGRl YnVnOiBsaWJ4bF9xbXAuYzo1NTU6cW1wX3NlbmRfcHJlcGFyZTogbmV4dCBxbXAgY29tbWFu ZDogJ3sKKyAgICAiZXhlY3V0ZSI6ICJxdWVyeS1wY2kiLAorICAgICJpZCI6IDMKK30KKycK K2xpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1l c3NhZ2UgdHlwZTogcmV0dXJuCg== --------------020709090402000802070905 Content-Type: text/plain; charset=UTF-8; name="xlcreatevga.txt" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="xlcreatevga.txt" UGFyc2luZyBjb25maWcgZnJvbSB0ZXN0LmNmZwpsaWJ4bDogZGVidWc6IGxpYnhsX2NyZWF0 ZS5jOjEyMzA6ZG9fZG9tYWluX2NyZWF0ZTogYW8gMHgxOWFiOGIwOiBjcmVhdGU6IGhvdz0o bmlsKSBjYWxsYmFjaz0obmlsKSBwb2xsZXI9MHgxOWFiOTEwCmxpYnhsOiBkZWJ1ZzogbGli eGxfY3JlYXRlLmM6Njc1OmluaXRpYXRlX2RvbWFpbl9jcmVhdGU6IHJ1bm5pbmcgYm9vdGxv YWRlcgpsaWJ4bDogZGVidWc6IGxpYnhsX2Jvb3Rsb2FkZXIuYzozMjE6bGlieGxfX2Jvb3Rs b2FkZXJfcnVuOiBub3QgYSBQViBkb21haW4sIHNraXBwaW5nIGJvb3Rsb2FkZXIKbGlieGw6 IGRlYnVnOiBsaWJ4bF9ldmVudC5jOjYwODpsaWJ4bF9fZXZfeHN3YXRjaF9kZXJlZ2lzdGVy OiB3YXRjaCB3PTB4MTlhMTA5ODogZGVyZWdpc3RlciB1bnJlZ2lzdGVyZWQKbGlieGw6IGRl YnVnOiBsaWJ4bF9udW1hLmM6NDc1OmxpYnhsX19nZXRfbnVtYV9jYW5kaWRhdGU6IE5ldyBi ZXN0IE5VTUEgcGxhY2VtZW50IGNhbmRpZGF0ZSBmb3VuZDogbnJfbm9kZXM9MSwgbnJfY3B1 cz04LCBucl92Y3B1cz0xMywgZnJlZV9tZW1rYj0xOTY5OQpsaWJ4bDogZGV0YWlsOiBsaWJ4 bF9kb20uYzoxOTU6bnVtYV9wbGFjZV9kb21haW46IE5VTUEgcGxhY2VtZW50IGNhbmRpZGF0 ZSB3aXRoIDEgbm9kZXMsIDggY3B1cyBhbmQgMTk2OTkgS0IgZnJlZSBzZWxlY3RlZAp4Yzog ZGV0YWlsOiBlbGZfcGFyc2VfYmluYXJ5OiBwaGRyOiBwYWRkcj0weDEwMDAwMCBtZW1zej0w eDllZjY0CnhjOiBkZXRhaWw6IGVsZl9wYXJzZV9iaW5hcnk6IG1lbW9yeTogMHgxMDAwMDAg LT4gMHgxOWVmNjQKeGM6IGluZm86IFZJUlRVQUwgTUVNT1JZIEFSUkFOR0VNRU5UOgogIExv YWRlcjogICAgICAgIDAwMDAwMDAwMDAxMDAwMDAtPjAwMDAwMDAwMDAxOWVmNjQKICBNb2R1 bGVzOiAgICAgICAwMDAwMDAwMDAwMDAwMDAwLT4wMDAwMDAwMDAwMDAwMDAwCiAgVE9UQUw6 ICAgICAgICAgMDAwMDAwMDAwMDAwMDAwMC0+MDAwMDAwMDA3ZjgwMDAwMAogIEVOVFJZIEFE RFJFU1M6IDAwMDAwMDAwMDAxMDA2MDgKeGM6IGluZm86IFBIWVNJQ0FMIE1FTU9SWSBBTExP Q0FUSU9OOgogIDRLQiBQQUdFUzogMHgwMDAwMDAwMDAwMDAwMjAwCiAgMk1CIFBBR0VTOiAw eDAwMDAwMDAwMDAwMDAzZmIKICAxR0IgUEFHRVM6IDB4MDAwMDAwMDAwMDAwMDAwMAp4Yzog ZGV0YWlsOiBlbGZfbG9hZF9iaW5hcnk6IHBoZHIgMCBhdCAweDdmMjM2MWY0MzAwMCAtPiAw eDdmMjM2MWZkOGRlZApsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6MTIwNjpsaWJ4bF9fc3Bh d25fbG9jYWxfZG06IFNwYXduaW5nIGRldmljZS1tb2RlbCAvdXNyL2Jpbi9xZW11LXN5c3Rl bS14ODZfNjQgd2l0aCBhcmd1bWVudHM6CmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4 OmxpYnhsX19zcGF3bl9sb2NhbF9kbTogICAvdXNyL2Jpbi9xZW11LXN5c3RlbS14ODZfNjQK bGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAg IC14ZW4tZG9taWQKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXdu X2xvY2FsX2RtOiAgIDE0CmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19z cGF3bl9sb2NhbF9kbTogICAtY2hhcmRldgpsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6MTIw ODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgc29ja2V0LGlkPWxpYnhsLWNtZCxwYXRoPS92 YXIvcnVuL3hlbi9xbXAtbGlieGwtMTQsc2VydmVyLG5vd2FpdApsaWJ4bDogZGVidWc6IGxp YnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgLW1vbgpsaWJ4bDogZGVi dWc6IGxpYnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgY2hhcmRldj1s aWJ4bC1jbWQsbW9kZT1jb250cm9sCmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4Omxp YnhsX19zcGF3bl9sb2NhbF9kbTogICAtbmFtZQpsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6 MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgdGVzdApsaWJ4bDogZGVidWc6IGxpYnhs X2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgLXZuYwpsaWJ4bDogZGVidWc6 IGxpYnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgMTI3LjAuMC4xOjAs dG89OTkKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2Fs X2RtOiAgIC1nbG9iYWwKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3Nw YXduX2xvY2FsX2RtOiAgIGlzYS1mZGMuZHJpdmVBPQpsaWJ4bDogZGVidWc6IGxpYnhsX2Rt LmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgLXZnYQpsaWJ4bDogZGVidWc6IGxp YnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgY2lycnVzCmxpYnhsOiBk ZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19zcGF3bl9sb2NhbF9kbTogICAtZ2xvYmFs CmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19zcGF3bl9sb2NhbF9kbTog ICB2Z2EudnJhbV9zaXplX21iPTgKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGli eGxfX3NwYXduX2xvY2FsX2RtOiAgIC1ib290CmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzox MjA4OmxpYnhsX19zcGF3bl9sb2NhbF9kbTogICBvcmRlcj1jZGEKbGlieGw6IGRlYnVnOiBs aWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAgIC1uZXQKbGlieGw6IGRl YnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAgIG5vbmUKbGli eGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAgIC1N CmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19zcGF3bl9sb2NhbF9kbTog ICB4ZW5mdgpsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9j YWxfZG06ICAgLW0KbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXdu X2xvY2FsX2RtOiAgIDIwNDAKbGlieGw6IGRlYnVnOiBsaWJ4bF9ldmVudC5jOjU1OTpsaWJ4 bF9fZXZfeHN3YXRjaF9yZWdpc3Rlcjogd2F0Y2ggdz0weDE5YTEyZDAgd3BhdGg9L2xvY2Fs L2RvbWFpbi8wL2RldmljZS1tb2RlbC8xNC9zdGF0ZSB0b2tlbj0zLzA6IHJlZ2lzdGVyIHNs b3RudW09MwpsaWJ4bDogZGVidWc6IGxpYnhsX2NyZWF0ZS5jOjEyNDM6ZG9fZG9tYWluX2Ny ZWF0ZTogYW8gMHgxOWFiOGIwOiBpbnByb2dyZXNzOiBwb2xsZXI9MHgxOWFiOTEwLCBmbGFn cz1pCmxpYnhsOiBkZWJ1ZzogbGlieGxfZXZlbnQuYzo1MDM6d2F0Y2hmZF9jYWxsYmFjazog d2F0Y2ggdz0weDE5YTEyZDAgd3BhdGg9L2xvY2FsL2RvbWFpbi8wL2RldmljZS1tb2RlbC8x NC9zdGF0ZSB0b2tlbj0zLzA6IGV2ZW50IGVwYXRoPS9sb2NhbC9kb21haW4vMC9kZXZpY2Ut bW9kZWwvMTQvc3RhdGUKbGlieGw6IGRlYnVnOiBsaWJ4bF9ldmVudC5jOjUwMzp3YXRjaGZk X2NhbGxiYWNrOiB3YXRjaCB3PTB4MTlhMTJkMCB3cGF0aD0vbG9jYWwvZG9tYWluLzAvZGV2 aWNlLW1vZGVsLzE0L3N0YXRlIHRva2VuPTMvMDogZXZlbnQgZXBhdGg9L2xvY2FsL2RvbWFp bi8wL2RldmljZS1tb2RlbC8xNC9zdGF0ZQpsaWJ4bDogZGVidWc6IGxpYnhsX2V2ZW50LmM6 NTk2OmxpYnhsX19ldl94c3dhdGNoX2RlcmVnaXN0ZXI6IHdhdGNoIHc9MHgxOWExMmQwIHdw YXRoPS9sb2NhbC9kb21haW4vMC9kZXZpY2UtbW9kZWwvMTQvc3RhdGUgdG9rZW49My8wOiBk ZXJlZ2lzdGVyIHNsb3RudW09MwpsaWJ4bDogZGVidWc6IGxpYnhsX2V2ZW50LmM6NjA4Omxp YnhsX19ldl94c3dhdGNoX2RlcmVnaXN0ZXI6IHdhdGNoIHc9MHgxOWExMmQwOiBkZXJlZ2lz dGVyIHVucmVnaXN0ZXJlZApsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjcwNzpsaWJ4bF9f cW1wX2luaXRpYWxpemU6IGNvbm5lY3RlZCB0byAvdmFyL3J1bi94ZW4vcW1wLWxpYnhsLTE0 CmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1l c3NhZ2UgdHlwZTogcW1wCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6NTU1OnFtcF9zZW5k X3ByZXBhcmU6IG5leHQgcW1wIGNvbW1hbmQ6ICd7CiAgICAiZXhlY3V0ZSI6ICJxbXBfY2Fw YWJpbGl0aWVzIiwKICAgICJpZCI6IDEKfQonCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6 Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1lc3NhZ2UgdHlwZTogcmV0dXJuCmxpYnhsOiBk ZWJ1ZzogbGlieGxfcW1wLmM6NTU1OnFtcF9zZW5kX3ByZXBhcmU6IG5leHQgcW1wIGNvbW1h bmQ6ICd7CiAgICAiZXhlY3V0ZSI6ICJxdWVyeS1jaGFyZGV2IiwKICAgICJpZCI6IDIKfQon CmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1l c3NhZ2UgdHlwZTogcmV0dXJuCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6NTU1OnFtcF9z ZW5kX3ByZXBhcmU6IG5leHQgcW1wIGNvbW1hbmQ6ICd7CiAgICAiZXhlY3V0ZSI6ICJxdWVy eS12bmMiLAogICAgImlkIjogMwp9CicKbGlieGw6IGRlYnVnOiBsaWJ4bF9xbXAuYzoyOTk6 cW1wX2hhbmRsZV9yZXNwb25zZTogbWVzc2FnZSB0eXBlOiByZXR1cm4KbGlieGw6IGRlYnVn OiBsaWJ4bF9xbXAuYzo3MDc6bGlieGxfX3FtcF9pbml0aWFsaXplOiBjb25uZWN0ZWQgdG8g L3Zhci9ydW4veGVuL3FtcC1saWJ4bC0xNApsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjI5 OTpxbXBfaGFuZGxlX3Jlc3BvbnNlOiBtZXNzYWdlIHR5cGU6IHFtcApsaWJ4bDogZGVidWc6 IGxpYnhsX3FtcC5jOjU1NTpxbXBfc2VuZF9wcmVwYXJlOiBuZXh0IHFtcCBjb21tYW5kOiAn ewogICAgImV4ZWN1dGUiOiAicW1wX2NhcGFiaWxpdGllcyIsCiAgICAiaWQiOiAxCn0KJwps aWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjI5OTpxbXBfaGFuZGxlX3Jlc3BvbnNlOiBtZXNz YWdlIHR5cGU6IHJldHVybgpsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjU1NTpxbXBfc2Vu ZF9wcmVwYXJlOiBuZXh0IHFtcCBjb21tYW5kOiAnewogICAgImV4ZWN1dGUiOiAiZGV2aWNl X2FkZCIsCiAgICAiaWQiOiAyLAogICAgImFyZ3VtZW50cyI6IHsKICAgICAgICAiZHJpdmVy IjogInhlbi1wY2ktcGFzc3Rocm91Z2giLAogICAgICAgICJpZCI6ICJwY2ktcHQtMDFfMDAu MSIsCiAgICAgICAgImhvc3RhZGRyIjogIjAwMDA6MDE6MDAuMSIKICAgIH0KfQonCmxpYnhs OiBkZWJ1ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1lc3NhZ2Ug dHlwZTogcmV0dXJuCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6NTU1OnFtcF9zZW5kX3By ZXBhcmU6IG5leHQgcW1wIGNvbW1hbmQ6ICd7CiAgICAiZXhlY3V0ZSI6ICJxdWVyeS1wY2ki LAogICAgImlkIjogMwp9CicKbGlieGw6IGRlYnVnOiBsaWJ4bF9xbXAuYzoyOTk6cW1wX2hh bmRsZV9yZXNwb25zZTogbWVzc2FnZSB0eXBlOiByZXR1cm4KbGlieGw6IGRlYnVnOiBsaWJ4 bF9xbXAuYzo3MDc6bGlieGxfX3FtcF9pbml0aWFsaXplOiBjb25uZWN0ZWQgdG8gL3Zhci9y dW4veGVuL3FtcC1saWJ4bC0xNApsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjI5OTpxbXBf aGFuZGxlX3Jlc3BvbnNlOiBtZXNzYWdlIHR5cGU6IHFtcApsaWJ4bDogZGVidWc6IGxpYnhs X3FtcC5jOjU1NTpxbXBfc2VuZF9wcmVwYXJlOiBuZXh0IHFtcCBjb21tYW5kOiAnewogICAg ImV4ZWN1dGUiOiAicW1wX2NhcGFiaWxpdGllcyIsCiAgICAiaWQiOiAxCn0KJwpsaWJ4bDog ZGVidWc6IGxpYnhsX3FtcC5jOjI5OTpxbXBfaGFuZGxlX3Jlc3BvbnNlOiBtZXNzYWdlIHR5 cGU6IHJldHVybgpsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjU1NTpxbXBfc2VuZF9wcmVw YXJlOiBuZXh0IHFtcCBjb21tYW5kOiAnewogICAgImV4ZWN1dGUiOiAiZGV2aWNlX2FkZCIs CiAgICAiaWQiOiAyLAogICAgImFyZ3VtZW50cyI6IHsKICAgICAgICAiZHJpdmVyIjogInhl bi1wY2ktcGFzc3Rocm91Z2giLAogICAgICAgICJpZCI6ICJwY2ktcHQtMDFfMDAuMCIsCiAg ICAgICAgImhvc3RhZGRyIjogIjAwMDA6MDE6MDAuMCIKICAgIH0KfQonCmxpYnhsOiBkZWJ1 ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1lc3NhZ2UgdHlwZTog cmV0dXJuCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6NTU1OnFtcF9zZW5kX3ByZXBhcmU6 IG5leHQgcW1wIGNvbW1hbmQ6ICd7CiAgICAiZXhlY3V0ZSI6ICJxdWVyeS1wY2kiLAogICAg ImlkIjogMwp9CicKbGlieGw6IGRlYnVnOiBsaWJ4bF9xbXAuYzoyOTk6cW1wX2hhbmRsZV9y ZXNwb25zZTogbWVzc2FnZSB0eXBlOiByZXR1cm4KbGlieGw6IGRlYnVnOiBsaWJ4bF9wY2ku Yzo4MTpsaWJ4bF9fY3JlYXRlX3BjaV9iYWNrZW5kOiBDcmVhdGluZyBwY2kgYmFja2VuZAps aWJ4bDogZGVidWc6IGxpYnhsX2V2ZW50LmM6MTczNzpsaWJ4bF9fYW9fcHJvZ3Jlc3NfcmVw b3J0OiBhbyAweDE5YWI4YjA6IHByb2dyZXNzIHJlcG9ydDogaWdub3JlZApsaWJ4bDogZGVi dWc6IGxpYnhsX2V2ZW50LmM6MTU2OTpsaWJ4bF9fYW9fY29tcGxldGU6IGFvIDB4MTlhYjhi MDogY29tcGxldGUsIHJjPTAKbGlieGw6IGRlYnVnOiBsaWJ4bF9ldmVudC5jOjE1NDE6bGli eGxfX2FvX19kZXN0cm95OiBhbyAweDE5YWI4YjA6IGRlc3Ryb3kKRGFlbW9uIHJ1bm5pbmcg d2l0aCBQSUQgMTg2NTEKeGM6IGRlYnVnOiBoeXBlcmNhbGwgYnVmZmVyOiB0b3RhbCBhbGxv Y2F0aW9uczoxMDY4IHRvdGFsIHJlbGVhc2VzOjEwNjgKeGM6IGRlYnVnOiBoeXBlcmNhbGwg YnVmZmVyOiBjdXJyZW50IGFsbG9jYXRpb25zOjAgbWF4aW11bSBhbGxvY2F0aW9uczo0Cnhj OiBkZWJ1ZzogaHlwZXJjYWxsIGJ1ZmZlcjogY2FjaGUgY3VycmVudCBzaXplOjQKeGM6IGRl YnVnOiBoeXBlcmNhbGwgYnVmZmVyOiBjYWNoZSBoaXRzOjEwNjAgbWlzc2VzOjQgdG9vYmln OjQK --------------020709090402000802070905 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --------------020709090402000802070905-- From xen-users-bounces@lists.xen.org Sun Dec 08 17:25:36 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 08 Dec 2013 17:25:36 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpi5w-0000eY-S5; Sun, 08 Dec 2013 17:24:40 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpi5v-0000eT-0a for xen-users@lists.xen.org; Sun, 08 Dec 2013 17:24:39 +0000 Received: from [193.109.254.147:23735] by server-2.bemta-14.messagelabs.com id 56/CB-00361-65BA4A25; Sun, 08 Dec 2013 17:24:38 +0000 X-Env-Sender: reklov@unitedklasens.de X-Msg-Ref: server-3.tower-27.messagelabs.com!1386523473!3732919!1 X-Originating-IP: [37.17.224.201] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 26422 invoked from network); 8 Dec 2013 17:24:33 -0000 Received: from mail.webgo24-server13.de (HELO mail.webgo24-server13.de) (37.17.224.201) by server-3.tower-27.messagelabs.com with SMTP; 8 Dec 2013 17:24:33 -0000 Received: from [192.168.42.13] (HSI-KBW-46-223-75-55.hsi.kabel-badenwuerttemberg.de [46.223.75.55]) by mail.webgo24-server13.de (Postfix) with ESMTPSA id C08CC304060E for ; Sun, 8 Dec 2013 18:24:32 +0100 (CET) Message-ID: <52A4AB45.8080507@unitedklasens.de> Date: Sun, 08 Dec 2013 18:24:21 +0100 From: Volker Klasen User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20131005 Icedove/17.0.9 MIME-Version: 1.0 To: xen-users@lists.xen.org References: <52A46D13.4050806@unitedklasens.de> In-Reply-To: X-Enigmail-Version: 1.6 Content-Type: multipart/mixed; boundary="------------020709090402000802070905" Subject: Re: [Xen-users] VGA Passthrough with Xen 4.3 and Qemu 1.7 on Debian Jessie X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a multi-part message in MIME format. --------------020709090402000802070905 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hi Casey, > Can you supply more information about the system. There are many > possibilities, so it'll be hard to narrow it down with only what > you have provided. I'll do: > - What does the domu.cfg look like (complete copy) I just did a new test without any disks so we can discard the guest OS as the cause. With my graphics card (0000:01:00.0) passed through the BIOS is not displayed; without (0000:01:00.1 is the HDMI device of the graphics card) it is and says that it cannot find anything to boot. Here's the complete config for those tests: name = 'test' builder = 'hvm' device_model_version = 'qemu-xen' device_model_override = '/usr/bin/qemu-system-x86_64' memory = 2048 # working #pci = ['0000:01:00.1'] # not working pci = ['0000:01:00.1','0000:01:00.0'] And here's the output from xl pci-assignable-list: 0000:00:1d.0 0000:01:00.0 0000:01:00.1 0000:04:04.0 > - Can you supply your kernel config see attachments (current Jessie kernel), pciback is a module and binds the devices at initramfs time via /etc/modprobe.d/: options xen-pciback hide=(0000:00:1d.0)(0000:01:00.0)(0000:01:00.1)(0000:04:04.0) install ehci_hcd /sbin/modprobe xen-pciback; /sbin/modprobe - --first-time --ignore-install ehci_hcd install radeon /sbin/modprobe xen-pciback; /sbin/modprobe --first-time - --ignore-install radeon install snd_hda_intel /sbin/modprobe xen-pciback; /sbin/modprobe - --first-time --ignore-install snd_hda_intel install snd_virtuoso /sbin/modprobe xen-pciback; /sbin/modprobe - --first-time --ignore-install snd_virtuoso > - Any notable hardware (eg. motherboard?) MSI Z77A-GD65, i7 3770 (non-k), Sapphire Radeon HD 7870 GHz Edition The hardware worked 18 month with VGA passthrough, so I would exclude it as cause, as well. > - run `xl -vvv create` and attach the output I attached the output from both test runs (with and w/o vga passthrough) and the cleaned diff (there were different memory addresses and domain ids) > I have been using Xen 4.3 and 4.4 on Wheezy for some time now, but > I have not yet tried with Jessie. Off the top of my head, three > possibilities stand out. Could be a syntax error in your domu.cfg > (review the latest man pages: > http://xenbits.xen.org/docs/4.3-testing/man/xl.cfg.5.html). I > still build pciback into my kernels as I have never had good luck > with late device binding even with though the xl toolstack should > do so; is pciback compiled into the kernel and your devices hidden > by grub, or are you relying on late binding? There have been > problems with larger amounts of memory. Have you tried dropping to > 1~2 GB of ram in your config (yes I am aware that it is a very > small amount for Windows to run well on, maybe try it just to > confirm possible causes)? I dropped the allocated RAM to 2GB, but no difference. > Send us more info. Hopefully, the info I now provided is more helpful. Cheers, Volker > On Sun, Dec 8, 2013 at 7:58 AM, Volker Klasen > wrote: > > Hello, > > the short version: I can't get VGA passthrough working with Xen > 4.3 and Qemu 1.7. The VM won't even display a bios screen. > > The long version: after successfully running Windows 7 64bit with > a passthrough'd Radeon HD 7870 about 1.5 years with Xen 4.1 > (xm/qemu-dm), I decided it was time to upgrade to Jessie's current > Xen packages (4.3). > > Unexpectedly, I came across several issues related to switching > from xm to xl and from qemu-dm to qemu, as well as non-functional > VGA passthrough. I found 2 setups that at least would start the > VM: > > 1) Using qemu-dm from Wheezy packages xen-utils-4.1 In this setup I > can pass through all 4 PCI devices (USB controller, VGA card, HDMI > audio and audio card), however, none is working. For the audio card > error 10 is reported, for the graphics card error 43. > > 2) Using qemu In this setup PCI passthrough works as long as I do > not passthrough my VGA card (the other three are working without > problems). As soon as I passthrough the graphics card, the VM won't > even startup at all (vnc is running but no bios is displayed, only > black screen); the logs are empty, as well (the only line is > "Waiting for domain ..." in /var/log/xen/xl-domain.log). > > I tried setting and unsetting the pci_* options in the domain > config file but I had no luck. Here's my current config (left some > unrelated things out) set up for 2) with VGA passthrough > (01:00.0): > > # qemu device_model_version="qemu-xen" device_model_override = > '/usr/bin/qemu-system-x86_64' # qemu-dm > #device_model_version="qemu-xen-traditional" #device_model_override > = '/usr/lib/xen-4.1/bin/qemu-dm' > > builder = 'hvm' viridian = 1 vga = 'stdvga' pci_msitranslate = 0 > > #pci = ['0000:00:1d.0','0000:01:00.1','0000:04:04.0'] pci = > ['0000:00:1d.0','0000:01:00.0','0000:01:00.1','0000:04:04.0'] > > > Has anyone an idea what I could try? > > Thanks, Volker >> >> _______________________________________________ Xen-users mailing >> list Xen-users@lists.xen.org http://lists.xen.org/xen-users >> > > > > _______________________________________________ Xen-users mailing > list Xen-users@lists.xen.org http://lists.xen.org/xen-users > -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.15 (GNU/Linux) Comment: Using GnuPG with Icedove - http://www.enigmail.net/ iEYEARECAAYFAlKkq0UACgkQgKD4KXUzSri9xwCgkDbPIZ3j5Ks1gxOllEmNM2p8 5JAAoIekcrJvY/O5j2OmgWI0jNtqPX2T =1A0F -----END PGP SIGNATURE----- --------------020709090402000802070905 Content-Type: application/x-gzip; name="config-3.11-2-amd64.gz" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="config-3.11-2-amd64.gz" H4sIADWnpFIAA4w8TXfbtrL7/gqd9C3uXaSxncRNzzteQCAkoSIJhgBlKRscx1ZSn/ojV7J7 k3//ZgB+DEDQeV005swABAYzg/mifv3l1xl7fnq8v3q6vb66u/sx+7p/2B+unvY3sy+3d/v/ nWVqViozE5k0vwFxfvvw/P3N9w/ns7e/nZ7+9mG23h8e9ncz/vjw5fbrM4y8fXz45ddfuCoX cmnP382lufjRPW4/nAMoeB4eZKlN3XAjVWkzwVUm6gGpGlM1xi5UXTBz8Wp/9+X83WtYxuvz d686GlbzFYxc+MeLV1eH679wqW+u3eKO+De83t7sv3hIPzJXfJ2JyuqmqlRNFqwN42tTMy7G uBXbCJszI0q+MyoxuCia4aEUIrNZwWzBKpzWiAinlw6di3JpVgNuKUpRS26lZogfI+bNMgm0 tYDFSVhjpWRpRK3HZKtLIZcrsmTHwoLt/OYqbhcZH7D1pRaF3fLVkmWZZflS1dKsivG8nOVy XsMe4ThytovmXzFtedW4BW5TOMZXwFlZAtPlJzExmjXA9FrNRXQiWpimspWoPVUtWMToDiWK OTwtZK2N5aumXE/QVWwp0mR+PXIu6pI5sa2U1nKex0vWja5EmU2hL1lp7KqBt1QFyMEK1pyi cMxluaM0+Xwg+aSAUyAbb8/IsAYU1g0ercVJqbaqMrIA9mageMBrWS6nKDOB4oRsYDloSsRv lK3cmu1Iza0uqhA2krRW/ixf5GypL169/oJG6PXx6p/9zevDze0sBBxjwM33CHAdAz5Ez39E z6cnMeA0tCdOAlDMUFwF0+OzbbnUOCqiZL0lAlHWYLPe3N1+fnP/ePN8tz+++Z+mZEU/55vf IoMk64/2UtVE1uaNzDM4MWHF1jAQIqu9sQFj++ts6az23ey4f3r+NphfOFZjRbmBpeIqCrDF b886JK9BHC1XRSVBJF+9gmk6jIdZI7SZ3R5nD49PODOxlizfgEEBkQ/GUYTTz8RgJzNr0BgQ muUnWUXS1GLmgDlLo/JP1ApSzPbT1Ag1hcC7qF8+WRVdeIx3a3uJAFeY2Dld5XiIennGd4kJ QcBYk4PpUNqgNF28+tfD48P+370U6UtG+Kt3eiMrPgLgv9zkAxzMlNza4mMjGpGGjoYsVqzM AsOG9id6xEFgQWIjdclMYKUc0NRCUD55aK6WsmwkmCy4W50WTElYf8OxOgNl0p2iwN+z4/Pn 44/j0/5+UJQEeXz/gkZG1w1F6ZW6HGPQ6oNhRYr0ML6iGoCQTBVMlnTrA9Rb4sSWkQRcIw7G 3KzgxssCa64rVmsRLoKjy6NVA2P8AWQqtv+UJGMm4Xo4c7QZHWvvBeAEYiNKk+AnQXrb9hOS WrGMM21eJiuASSz7s0nSFQqtdOZdLycN5vZ+fzimBMJIvrZwr8K5kqlKZVef0DwWKjgiAIK3 IFUmeeJ0/Cjp9aMf46GLJs+Tmu/QKemGCxOuDe2YX/dyDdfUG3N1/Hv2BFuaXT3czI5PV0/H 2dX19ePzw9Ptw9dob8454lw1pfHC0r95I2sToZGHyVWi4DkpGGgTa57rDHWHC7hvgJAwNMbY zdsBaZheo6esQ5D3KaOJHGKbgEkVbtNxq+bNTCcOHYyOBRzlRgWwojIITuwMoOjM53lCKBDX aHAiP+qJkQtWQlxzcf5uDIQ4gC0uTs/D6VqcgI2mLmZPAn6qEx66lm5n1sUyyaNEbKn4HI8+ fdZr/0fSI0AHZQFWUC7MxenvgSluIK7zDgu49ZlX1yknqmwgBJqznJV87JCiF6xRXIyn83+B kgZqFcyQWCtf1qqpNB3jQZPWtUUvgIefaEzaD9tITq4F4B/EIERoUcBtBbeWx4wmAHAouKDe 3uw6uQ0it0IUfBk92gyCQ2BwFsPb+7/f5wAFp9CNSB60J1vDP0l0u+o2DJnmF1jExWivTgaI 38BkbUPM8J4FmH1wKy5lZlZpkTV0bMrw5Ov2xXRiH88MuPQuV4KvXeSMx2FUnXI10OuC25VT t79BMSbP6GHRZxQE+lwKEzx7LUHvuVt4dyyFVZelE8B+lXD3LjBAAyvF4V5L8aAOI3DcNkis Cw1qchLumRUwm5c9dOy7GbLIUwdA5KADJPTLAUDdcYdX0XPgfHPeR6ToyrjIP7Gb2PEEg1jC 2lVGj8CbHZmdkuySHwimk4vKxerOEkZjKq6rdW2rnBnMNNH1iS3Ic8rodu+hZ4Jvat2iVCAA YL0rAhPUwWx6SFWDIAbRIDECIl+ApaBJg/E+unEQbDqfg6hgYwTJwohKUayWy5LlCyIozu+g AOd6UYBegekgRyQVXZm0HxtZr4Pdu1RMlhRffy7wRtt7ku4Kb/OO1f7w5fFwf/VwvZ+Jf/YP 4PIwcH44Oj3g2g13ezhFZAscEmyz3RQuxZFYx6bwo6lNDgJmZsBJXadENmfzQD7yJmU14ZZY yDy49ZyIOhtEhFt5QnFxP0zZwdolFhAVyioX2yl+9nOMZrVlIf0RD7h1n9noX/hnU1QW9iVS wgp6HOdCmvEUbiEuPwwyD1KGRo+jIzi1aLFYSC5xf00Zjoj8BDxIDCnA4wMHM4iB17UYrw19 NIA3dQnehJELSTfvc1ygXZi3RY8jTiXE03lo4j0t59PwdhoIOewiZZncxhxipdQ6QmLemBlT h5vqAx8NZ7USeZVMASMSQ5M2cIxmrsUSTFKZ+UR4y27LKplaQSW9OkW41SUohmD+Mo1whdzC KQ5o7d4YW/KfHxDRbpTgFDYxcaf2dbu9rCnifJTj+yDtkaQ5EtQYzRbgrRUV5sajGVqoT45N 4DLVTKSFW8uCToSP4ru8W4JW5RmhT21EC44EFjTdUB5Owf0iFdi7rXHStw7sk9eNcQg4Ibsl JiJEm+vGdHJyiWphwKGtDfFZCpU1OSgHCjVedujSENMF24Zrqk2yk/ix5UWLZ66y1F0fS642 rz9fHfc3s7/9TfLt8Pjl9s4Hyr2RQrI2CZf0EoNcEyoBVyuBe5y4B2S5oF4QmmrgLbUG7obW eA1dnET7jxniUz4gWFRtW1RTJsF+RALZilVgodsxuuZ9TnciWdFRJoNDjcWxgvGVLMmJz8Mw sHNL53qZBOZyPoZj6WFZS5Nwb8GaKWNyEvNXV4enW6xOzsyPb3vqGbDaSOcSsmwDYSONTxj4 VeVAQbkToSyHwLNkSfbEpALiu9TdHNNJrl96I8sW+v/1vkpdgu8qUm5NTFpLzeU2eKvcDvjU ba8XAYO6YQWoXBJhWC1TCBCRJFhnSqcQmDuCyHcdGeYCIpmt1c08MUSrHF6uXTEqgW5g5CWY qNS0eVak5QARU5kDvUzuFNyzmnKVLLApU+A1q4skM8VCpleFuf3zDy8enNPA1kh2SiLVTF// tccaFXWepfJRaakUTVe30Az8hjxQ7g7DFzTlvPjYhustOvTDfS2jm+uFcoefdDQS1/bCqO6d r66//KePbLvkXudV0DCdhTlvVyQFE1eBU4n2E1gXJNRbPPpQLf4lXHLsJZgyMTWYIsPR7grx CwMF7lIEXXTXJ628ETw8Xu+Px8fD7AmMoMsTf9lfPT0fqEHs6slELONK7vYMvD0eworKeSj0 bBAMrgNcy1hPb6PRpMlCSl9JzqtkCIAEfZoQ4ktV7zB7lDc07vVSpwqIKRY11lfb1gfiaOzA 6dtIrWq7bAQtE8DiGaa+6fo72FjBxyR4AK5iklq8IDoLD1jPOQkhEOFvIP5awvqjhTnsZrUp QlDBtl1ZyLPj4v3JCSXQ3oF3uavgUERbSLKL1FoLyWuF3TfhqtcQAHcLG2/+5zWAnjTK/5bK zpUyQcYAHkz0pmL9Ie15VJqnEZgRSZdpC2ZUkVhiXyiqmlCynQxhjqltTfFp7nNKkp9O44yO NKV1+6NOKCxQbSKVgrusaApXjVnAjZrvSLEACdw5cpMXmualgVqjmUV9GoNZkY2BHHxW1lBF qYSJEwEOJooGm57AeSW7ymjMtYRLB+xt0P4EsQ+Ady+Cu6S0ne86s01U+1KqoOvFD/FxbSAp bAvmKpWsde08+uL9ad8C4e2FLkxsQgoeiHl/TSQvpg69UTmIP2wnMXbCormg0I5tKVatRsBa wO1pfHp0Xqs16DGqjg0L1k5uaP6gBcTi0IEDceiAmAzQK5UnULL8U3BzcR9IOAQ9ELJAcMrB 2pAz+rAeCHvDkgDFixsQwfIGMAZ1Ti0XQa4kmtD6sGGQjQgtWJ3v0jaCLmBMR3kCqhcwA4RM ZgPIRbXVaqfBX89qa+KeSN+1iPmTJBpCYWCqXc4xYKZlg4Ze0LjIENL2YDFeyQjjkuXYFADO Ah6cjbLnroImgt5FPyK0bD5ad1c+2OtWd6NtDeiRPrf5iBw3117nEEWOMiwtKuq88DzFstoa zbzF/ASRuhzuUZDG9vK3G5Y34uLk+83+6uaE/Ner/EurGLYA4V3DUhjCKOwb7LKvMV99wqvb j9CCZsMII7emhj9SqA38r+iLdykKl722frWVNWop8IRfmGu8vCgwD8BuSzYY5sUXokZWZ4nh 7X4lRl5xjALXnasL46RTSd/WN7CYOHGEo6lXylR5s5yCt1tOoYHNakOrJqBhrhGx91kp43Jw KivjYya8Rvp7eI5MxwQARlI8jM9SMAiMaxaCXjAPnTNucWUXp/1LwdOihs97YeBLNTRNVDSJ hOlaE4ntwiMnV757Jqsvzt+/fxsp+s9c7yn46hLUULsiXXhvTCQEScvCGA/yfcl2Ka81SV2w DFx9Wpp3LY/tUpkxzDWeDWWcXLDSuXHJO2FRq9JgPSGJ/TRv0uV0dydgNdnOIQjFSl3dVBMx ub/mNYQomNe7JN5eYWpyhvgEDn4JsX3QkhDCW0PRG9+TCTLHOEyQo4/UEZ/SNfkUARWIRsOV UGHOxDEsi9BwHBCchNeRDgyHWMjgwWrTEPeuTUmTs+M+S481mM7NoA1YpycnKSPyyZ69P4lI 34ak0SzpaS5gmtBHXNXYSEX0SmwFp7LG9KorKZCGTiByBYWUIwlmQKJDCBuFQPTk+2l4UdUC /UUTGv9+kKuJjQd1dtBHNf1C0LBiTFZQgjRbfLD4U7I23b7JdLqXlRcus4NvTlUNndi0Ajtl 2tM0sR3HMgEEBRjaOF/GXVoy63Mgj//dH2b3Vw9XX/f3+4cnlwVBP2n2+A3zwyQTMmrwXwkW fJbSFh1GgHGzUDcLxpB5PgdB1mNkeCkUIAcZSe8NHRmIyoWoQmKEtKmaIfwoXCuJw6XzF4W9 ZGsxlbkAdI0xPXVIqiJ4b1Tzwze2efQeRd+GkX3HpvQL/UaSY92XOBB5Jrdy+dFnukmluDVm ycQ3LWI6N7ljKcmjAxTdzMk8e4/3b56mAqV3G/rZTL6IObFe+B+JKxAwh0tMQMAZQRtjQF5C 4EZmQkWwBYupsrA5D0HyLH5r27Gp6gguq0JGoND6JCexbLmEu4eZ0XxtWBlB22gm5B1vtFEg izqbZJ7veLK+FxEMRl1L6k56zuWgmPi5ht1BzAcXZviWqTy/3xBHEVLRdzAotWEWxa8XXAkm yxG841eb0osEdK5j9oZZdMqKAlx/ldIwv9El/VLNC1clYo1AkF2uaBQzwGG/go024FAjZzBc oaMR4BBO64InwW+uJmsrzn/omp9ni8P+P8/7h+sfs+P11V3Q7+yyZ7WgpYgWYqO7tIcv1Wbo 6I2R2JNMu28CBKwXDjZPq3lP2bnd+B7sQsDPGsuJxtzkIOxacJ2Hqf7L1AAF8Qy8I+ywTBEC Dv1P9+ngS5NHS59gojOLmIkeBDfA9/uYwJNlp89oWCzM4KQBP05FifgSS8Ts5nD7T1DXGqoO VfRJplNd7nLBTnSCDI9Xs59h4N95NCEyo1SXdv0hGlZkrQSJUsNlv8GadkAB16XItBE+U1vL UoX46p1PrBcq6/hw/OvqsL8ZOzXhdJghC1gff6fQwYa8RlZLbAiYEA5Hi2eTQygporR0jyxE GbijztPC9Ike6LhqqjzZFOjPrF2p22yxv388/Jh9c77d8eofOG5av/wdXH4/qVQMv+NkZUmz PANBx73587Fj3exfYOpm+6fr3/5NugY4MZZo+n2iLoQVhX8IoUFdxQ11ZRwdAAWG20E0310N OAIJQnIWZsERBE5Hnar5t+SjiNzBdVXE8yBs0gwTgi7DNx7cW4G0C9qTpS0h3VJVjHKMfWZC RyfiAfQ1L+0Cy7Mue9bGF+g2h/O5AHXQOizLcYnNJi4xgGFAj1yZsEaLw4MPWRAgabnHnWod 7aBiWmbxoLAwgLCuVcGHNyCrfz0en2bXjw9Ph8e7O1CIkeFrvyYPO/lcEnlOp8akHpWPgksW P7v+I8sl2RwO86Lbruj19dXhZvb5cHvzlRaad1h0GuZzj1aRtnIPqSVXqxhoZAwREFuahrYh tJRKQ3xFEuBVdv772R/De+WHs5M/zui+XDKzVPjhiqHMJiqY1sswqogxVs4LIiMEyydnRIz9 ZN6/f38yPbQrXaYp9Kri1F+p4dQzGQTp7pzE9/3189PV57u9++2HmWusfjrO3szE/fPdVXSN YC9bYbAfL0p3miTK6eqAaBNE2O1fUVPm0vmYNOl9EiT2YTftkvMTaV7LKjA5vpFQNakooB1U SE0YhS8M+z4le3vWVjmDeNzBceqLqMNh+/YsdRd2jTUhb7B412BhBrM1RVgDaL/HjUeuxU6P gG6jri+zUmsx7tBAu4QarqrwW5PRggCWy3INN7LWbYnJSUO5f/rv4+Fv9JtGLgQ4bGsR9E7g M1yBbDlwFrupSFIGu7JCgu2CfpqAT+43JUIC5yFGIN3MYde55LtouE+th90ObgDqsQZVTjZn IAXwHbON94RTyPcRgLyi90UoJ2Tl/aTwU1WA9jkRV8OtA9xCzi34dMJGXzt2k6HT5SKVEOer wZ6C0d8M6XHgps0VTYD3GJ4z7e+W4fu+ylZlsnAusKFYRtyR1RJVFRRlGyPQDKN7NaZPTZH4 tBc37taZAL3IkkoWurCb0xTwLPQ3q5RjqXdYx1FrKUKtgWk2huQ28NAtW0UAoasIEouVAzqB i1nkMEmgl2zMYfoiB/7swyTFyxPMhYjH5rWKIKGS+nXxKgVushiMhPDnMtFK26Pm9J7qobyZ 05u2h18KbS6VyhJDVvBXCqwn4Lt5zhLwjVgynYDj51suPTBG5an5N4IGZT14J6ic9GCZg9VV kry4729sOTHqcKzhBS90OHZTX7y6fv58e/2KvrLI3msahoA4n4dPrgGNUYvqoN5aYb16kcLY sKHdIfxnfGhtbcay0FCej5TmfKw152O1wXkLWZ3Hs02q0vkE9KfKdP4TbTp/UZ0o1jGo/abR uxLhfiDQH0PsefBRJkJLrK67IobZVSJCjpaIwMDQet5N20x8bzPHD8Rj8NgE98CfTJiyuOhn THwwBij8sRus+RXM/egNHeVQ1Wrn8qhwQxZVusMQSPvvV+h4D5wM/QaKsc2a1zJbimBmn3B8 POzRQQI3+QnCq4kfPxtmbn2s4PYLUf7nDF7A+19jeYEgV8QOl/hFaFm6T3bSUNtyOoUaziGF xY4EPYHzxZAJZPxTIAESD9f71lNYd/QTeCdZ0dTGfa6nbMbpdUAxoUNCEJqbiSFw5eXSiAme MkxVsgnkIp6zx6zenr2dQMmaT2AGtymNB7lw/QalniDQZTG1oKqaXKtm5dTutZwaZEZ7Nwmd oOBeHibQbd/nzxTG8lCiShbOWLoASAStPi14QngGVEoUBuxIhBCVkA8Ex9xBWHzwCIsZjLCI tT0b8DPT7S6F2bYmu010bl3Ef5xdP95/vn3Y38zanyhL2TGINp1hSM7qzvsFtHaXZfDOp6vD 1/3/UXZtzW3jyPqvqPZpT9VmRxdLlk5VHkiQlBDzZoKS5bywvB5n4xrHScXOzObfL7oBkmhc 6OxUJRl93QSBJi6NRqP7NfSqNmr2oGZjKCl/mZoF3WvEsXiDC/c8WUAoA9d0KwyufpqcZnyj 6olg3u83chzyN+hvVwIM2+oUcpINQohMM5A1xsPwdlUkBm5A0zzZmy8qs35B9Cz1BluFE9Dk sj9yw8Y+FW98sCbVlv5JLlnQGwwT43PgacjBmI/ll/qg3AEUQrzJI3VV0TY4x5BR+uXu9f7z xITQsgO6DaJ66n+JYorrbJLO8qNog51U81QFWs2mecoyvm3TUJNHLmU5f5MLIye+xTXxHUYm WyPzcNXHSbq1InkY0pOKHDPJFJ52FEPKymm6mH7+EInD23ILL+Mjy/T34bXcx+2n+53ck0x3 BR10d5LlzbYUpneOl/5G/1B7KrIj9XCVWWirMLBUYnqcqTuCUxzaujrJcrgVsqtN81y1b04K 18fKPATycExPy5onjfLQ8t9zsLfmDUtn8zBUaPeeZEE/grc40DzyBlcDl9enWCandc0CjntT DMeVcfDFa62kkd9wo+r9cr2x0JjDQt7x2uEfKGREUKJleFE0mDN8BWp86hmgTT9ZelqG5ClC +JWSyDOyPGsqeo/ZYjTnH/zZW+BM6/tJhAN8IlUq7iA/8X6x1Ne15cQ2e/1+9/zy7ev3Vwhh 8fr1/uvT7Onr3e+zf9093T3fw/nNy49vQDeOf7E4tVEBY+lPH0Hub/yESM3+XlqQEB38OI65 n0ZzXvr753Z1m8aW4Y0L5cxhcqE89mNOacnBRoSLmEqzgsrrXoXCFolDuFGyJw1fdWs8c/ft 29PjPRqUZp8fnr65T5J9n35vxlpHyqneNuqy//8X7FYZ2JSbCI15FyHDRJiEfqz2eaWsjWTi 9bD5JLhWIg+mPm9SpDbiHxUDR1NrE12ghLb1WR4Vx/AkQQd9n3rJEOLRtrrh1p2IhvAXkZD7 liZKUreeZIPkj8BJ66X2Ib69jTYXlEUN8WS4a0nw27+QYpt+AKQGql6s5T5PA+3Umrw1I490 ol0SivxONqWJbmxIbnuODXGSU3jUBDpYZPQPmzA2RY+RPzf/6yjZhEfJxnzjJjQINtYo8BHS I99cBGhQkQAJtnUB0iEPEKDe+q6Dn6EIVdInZ5PcOgSPmUNTAiUFB+bG3y83nk608feicQS7 n803hL0cZT0YupKUPT+8/kJvkowlmjXkoIxi8D0xveH7c4isS2O772iaJIBJ+GgqnwapdYRJ iMQualC282W38lKiojLVU5PS1F6ch+CNF7c2XAaFbqQMgrPdMGii9b/+lJt3IGgzmrTOb73E JCQwqFvnJ7mGI7N6oQLJAmPgxxDBMp7JWY5aDNQZPxtP9FVHlcCMMZ68OD3UXH7wOWBbTqmq A9fK0nBHwpuPt1nD9PX9sYI66Ofh7v4PK1Bb/9jEKR8yqIvkRGe3N32I9HxjQCUJdkm876r4 A/PHd0OO/hAfnUjANsvg8N2UQ5BPHKKFd90PPhEISIH8bg1CVHjvSG4SY3KRP+SfIqKI8q8Y /QmT8Mal5bXp7YFxDMFb9/12sVsQuJDDI+rMMG9Ra+zo5Q+pVXDy4h6DIDKcea9UAktOjqwA KeoqokjcLDfbC7twhcpeoiZPX+Tzpdl74Fd/z8tCzcD2CHD7udS0QJHpak+m1MKdX52JgO+l 6icgJBYJx6ipMOfp9cCN1ogjRRjussgtF4KFcddhxLr9qal9zF1BCGqBMwWslzzlYeITrblJ kz+IoeJM9eezjtHj7QFRbiwX4BcZ1XWeUpjXSVJbP7u0ZDSA+nm59lU0qg2/8PpQUYtCmqYg kPWFD+s2eXVT4xJkRLBhihiYx/rgaTj/Xf94+PEgJ8PfdNw2cvNJc3csvranOKn8tbEHzARz UTISe7BueOWiaMT0vK2xzpYQFJmnCiLzPN6m17kHjTMX3HtflQjH/oq4/Df1NC5pGk/brv1t ZofqKnXha19DGIYXceDsOkSRI7RJLTOfkj9cjdbLN3u6e3l5/KQtBrQDsNzyZZSAsy3UcMt4 maRnl4Cj9MLFsxsXIzZFDdjZADRquZn0LxOn2lMFiW48NYA4CQ7KrOD5JUauopmGRkxFFjBy YxkkZrsFaxxPmLwU0n4DL1LL0N0TMHyNj8CikideCq+FZYjGZkfE3wEOz8FzBYz5VlUBh5C4 5iKjnFxit4CCN86YApzXrQtSF4u+Cql9ho+w4LZwEb2K/ezMPuLHNnPzduAwnrjpl5gwo1VJ KTDDBmQqMxZOOcdFGALWh8HFYGMZHfHEtHEZeEk8OM0HAopSVaflSdxw6KFfPCAaa8ZlVp1E GLPCqcDIpaeCcQ+17J38SQiOHqU+vCDCopaC3QszVrF5j6DJMF0PCSdm3TOAmbIfhaTo5gxB am47mmcgvjZ/1Fn3gVs9Gca53hTSGwqz14eXV2fZk3vBfUqW1VKdcqNmH9ohNBCquCo52X0f okJu9zGLgY4kfP/Hw+usufv98etgczejRkg1gWiS8rfsKEUEIaC9l2rlu5vK6NoNOO3rqT06 /1NqHc+6rb8//Pl4/+Be6CquuLlGbGpyzBzX1yoQlNG1b1lVdBD7PEvOXvzgwevIKOM2MqrM zG20/EENLgDEjLJ3+5th+YrKWaJaltgtA86TU7rIHYgcRgLAopyBZR08cGmKK6DmaRK4pC2J BauX64UvRnOtpmWrNh8iiLriBeGundkbTJIvJKrBlhbCuXQ34pyCdRpdebk1wc/OScgaiV+d Ivj4Ln9+1iBpCeR69acGQyq7vCTBYoavfRTx7BFSdHy6u3+wvjY0T9KtNosEwCVFdW0dbmyd g25B+XdQiDhPjloNUC45dotVNByV9Ml3nYg36OGnTMnfk8g3Q/CGWJ14Q3cMDTi5kA2OLBOj RkeOMPEVzgUtfEDn0YWEYLmISJ5BScVEYQ1xlkbcWaDUa54/fYfr5O/woNGZhZBH8CY4P/Gm bW/let8MBqevz/9+enCPJpMKzbdDXVPBe2zcsLOWi1vh4G16BQGNHLjixWoptU2bAO6bagG0 CEW0kaPTRve8iXnuMsu5YrF02SFEZZzmV5C30W3Acj53i4L0ChAC3MFFEn38CFfvHcJuvRtR lGw28Rlk5+87qEYE30uNMs0hw7GxUAtGgRtexlWZUFAUkMWSWaxRzilwyoWN8IgCBRMUiE1r qOynmR4SNtS1JPp/28VlWhM+AGT5Tm6LnqSOwjxUVrS0pANPhoPU+OnHw+vXr6+fg6KGBxiP WzLf9KBIzH2kQo9R0/qw7nBB6tXDMTPP2g1C1B5WV14K0bhGeHXDTeVSV5IVy/nq7NS9lkuX i2aeZiZtvnCbvmIOlh9TfdN81Jh76UXepFuKfDqYqxRY35tT7gCdI2wloLHDZlIpbegd6R4L 6uvN+SoytkRwhbOhSTpAqDnJTtQjHQlXepOi77T5BRCCY3QLEvWtw8SNIAIs24PlaEHU3hwh jLtVWJE2x4VNPwjrWppXkPpcbicgKXhAR+r5IWhgMG/iWKgyXVtZF0dyODDWwKTse1EOb0y8 WQd7zhsi3ZzHvUgspGPNbd1K9jpIY2TzbxHbK2qNHsgheWi7nlGVHsGk9o3xtQdCwyAqp2gb Eh3ZQyXJ1U2GIcLnZDF99I6/fXl8fnn9/vDUfX79m8NYpOLgeR5UafPLDoSpL2sWChfP0dvZ utkVKBGjx3gEfMPBVe0L+amfyKFfv9+OG9grnhtThfrdN4SCvKyP1l50Z+1pdzUGYLVtgxLW hydkE7rzHFMZKibPfL07rQ86Vs/IqjG4nSmXwYkye0aIjGiaP7y+I8RbhHUlVfo1BOkOvO8C upyWHQWyfLj7PsseH54gOd+XLz+ee++mv8sn/k+voqaPuSynLterFa2N4GYEDYwQPBgLlF5p byNVuqeH54fvj/canlW2vnxUifOUO3KHt+nHaItyTmyLOrPyBiqsKyDlgTfrEVz1ySszHon8 Tvgaqekoa42V+Dq7wWAq9AbjwCz1SDcTVa8ln+XoGViNug9Fqjxnbrh8vZ3BkE4T0T9lexvv dgf08DGphlmykU5hYrskp3Nik1K/adBBiGMhDrJhCWQZzsZ7mBCkyek58p/SikM/RlY0oyO3 ROOQP3GN9ObEkDT5doy2D/E4DUuLSVLn+xD5TkXBfregxZMiMIshxnMNpeF1noAEMlUZilgv 2fsQq8geaEfUXA5tQCEeX+SIKNSlL0ye2YJDqYr3MsvvflI7kywhzq/k97RkoFrsQp0ZXyAz nbtK51fX3JgXvAm9yRL6uBBZQlQ2UQBDoNUVxEEhtcPEkFoEctf4W1MVv2VPdy+fZ/efH795 LGwg34zTQj6kScosnwLA95jRxXIh0CWgGbjCCNChbwQjII7kxhRzH3cL0mlt6nKSSpLseuiB tCqeSmx+ldMbDqdvPLcag9jSriSiF+F+DuTt1FsgQBw5VRmEXySiTVxczteRix5bnltj3TR6 IlBZQBQLddFABaa7+/bNiD0IQZVUB7u7h0xMVv+qCkjbCgKFg3s6WeGNC3V3jghDw9rjNiAU wdbLOTOPuAGV2ggSKNqK9XpuYSJm3f58tt8tpXm5OTeVP6kTcHB2mKSnIl5O0dnVdn4xWYJg 8RKi44tDoO2yla8PT3bV84uL+d5n4UWZMmugD4ZVKnoVAQ2SUN9KRSCg6MJ8UENGlyTxaVwo JQxoeIJcHI314jxqVZ+jtR9u3Tmalnh4+vQOgr/d4XVeye3aKGgrCrZeLwI1gyxoKFy7BgNB pyaT+gPPwkvTyF61PkcdnEeW63prdjz5+3xGrVVZK0mCWvz2ol2urREqcmeM1gcHkn9sDGyH bdVC/HX+MX1/Md9tLGraYHZOoC6WW7M4XOuWSqVQeujjyx/vqud3DMa6o5RS0VRsvwr1XUi+ mzJmS7/HwQY38WjwsZiFRotcRnXkW9+zSQq5l6cqyxNroUVUxfBzcci0WJXswJ1pzSKr5XSI 0TFVA89DCbpQzKffEMctduVgH1YPyK/l88wZGFiUpZ6Wwl9q9+KWOXEOhLNsHh0Ta3WSGwv9 gV1Qj0U1MO2ltefR6nmwsT1feLj2HMszyHkPw0nr5XkNE9Mn1Ka+qMisXn0K+WgTrjHTi0el OsbcAbqb3EhVZQ1YZIjTWB8aL62vD1SYVUKXLXqefX5MY1+Pl0o0vR6mgc70eOwxufniGMl8 DEc6cKOzgj8y6sgjjnKPxX3xnwwmd5XqiftAmryeHp2328vdZqJ4OeEZdugeLSts74iXNP1A WQ8mGxVe0Fmuavd4TD5FA2nqrL4O0GWJ1VjuTSXUs8N5pxAw+fN6tTybZuwc0vpcd+Yw6zHG hSAEBAQTvGsjMyJT/5okYrvNnBaER49FSsZ/j7PqRs+5E3XPIfeqUySgmLcHUy++33oKB2Nl lfuzow41bmIiSfjd6cSpGCU4lEJWPV7GiVu18mTePe3RSnhYxXnrgmR5NkDd1MXGR1Nr82a1 vXAlceY+EbCkAceGq5YlJ6NqBNZmB2HKlzLcOGmDNFsEIW1PkJTCdO+F4MFqG+0JHmwQIU8I oSkzI5B9HengWxcH8fg+UiNwFKityuPLvWtOgZDkVSPgXusqP82XZmq7ZL1cn7ukrlovaKWO MAiiJkbF5FgUtxAx2XeeHhddJIyuUB+isjU3XZBlmVfM8E5seVaoIxUKXZ7PhvWdM7FbLcXF nJyXRG0hVXEhfGpVWrK8EscmhfkcLVqGMbLueG4m2KgTsdvOl1Fu3r4S+XI3n69sxNyC9QJv JYVE/e0J8WFxuQ3glx4ca7IzD+0OBdus1oYvRSIWm+3SlBZMYpfrhYFpDzOd7szoSkU9367t 3/rbj11UoZbZuP+kGE/gSKzbcFStXd8yEe0utv6sQ1JzauWHkEptveoU5r9DIWcH3+hf0jVc /ZYdUrJHTbdc4AdQ4ZHTGrahjseCwmW/WRo9cATXDgjZCc3gChouovNme+my71bsvDElM+Dn 84VvxWbx5WLed/9xvkI0eFY3UuVoE8dC2ad6ha59+M/dy4zD0dAPyJn00mcXGC+fP8nd5ux3 OYU8foP/NTc5LZhXfLZjY2rR/UW5vMFNubtZVu+j2afH71/+kq+a/f71r2e8167iU5nlR3B2 H4EJp/Ze8sXNdZGS+K0a6sw1yvChtA4ZVKaY0VGGahlq2y31gX6j7fQRVBYKM4ppE/EEUtA1 xuwAXPSXlYYbVY59a/FoN056x0jofEKZq3FhTXUVVR7wv8vv9sc/Zq933x7+MWPJO9m9jFQH wyptLo+HRmGti1XCRIenGx8GUVMT01Q/FLz3vMz0jcUmDhOyheMthC4/lpbwGMZ0J8cAiOfV fk+uwiAqwN8rErfozDuKru37/Iv1gQUkrnE/aZexECw/pibRN3P82/eQiEQQz3ksIv8Ddi8C 9FBBpAozpqIiNbX/DRIP1TevbtQJ62i+V52V3DxECM8zxK3I7PLZeR+vFJOHcuGlxOV5GSSc pYQrUwVNlxZr3w9XN91Z/oeD0iroUIvIgiT37mxuHnrUFX5EMygoLGKe90ScXZJCNQBnOhDF odFnaOMZds8A+SIh7VAe3XaFeC9XrDH5X8+jJnYnRy+hFpG4eu88CQ4e6nwZfE3K1plleka5 A/deRdQsO7ttO0/bxgsYPcdbjdtNNm430bidv3FWvXcX1OitoXBWKpx9TqonUEEhOnHybzC1 srZ56r9kikzHwlkoalC3K7tXgblMDjYbbhhJW11IjQQXpDK92ZvZaQaC6Xw3ghHP4+rsodgq zkBwh4jUNJZBFJQiuRQoc6slKc2hp+6grOp25S1+9Wbxq18o/piJA7PHsgJtd2lCChv89Kwj 1a/antOOQtaGM6dQtKtjtmtPeVqpqU906lNn9nL9rppoT3xiY9MDBH+ak6j7q8tK8yqZVlvO q8VuYQsmjVp7MgVI9vf9Pk10jOOfLh3UmxSPxyCAqr34IAt8SVmMMOwCSjbHFvZrKsWS9e59 0toKhVwg7JHFa7v3QCZBbg81CYJTv/Nx6joKD3deBLuAaFN7iRG3xXrFtnL6WQYpfSb5VAjw XwePvzGVr83bR473yG3kGiQ7JiO2OQpe2QpM3TiSkJgKaTkhD8mS+JPjIv0aBwDYIueWBK7z qMtIYoECsKW7UAOnT2XI68wdWgDqJSTzur9gb2er3fo/9hCQ4NxW1VVSU4rVhU8fqIvtfL6w P3PjzAkZbTaCti+aUqIOaS54ZQ1gor319uPRmqvPNw/RYr005KjxzB5VGr/upykKqw5DjpaV UOxBmBy6JomcOeUANhZx48Jp4eGN8qM911QiUWOXRlcZaMfc/gqAJqga4GYVhhLtH8gQygra ElM8zFIqp1SZSK0wYCvUKVu6tGnMbRGQtE18rACAH+sq8SpeQKyLIbYaG7KBvcz+enz9LPmf 34ksmz3fvT7++TBexjH2NPjSg7WK9aB3DaNsUtZssVn6DtlVMZhnKyJe3EgQPDeNKQhl2bAJ k7W+t5tz/+Pl9euXmZz+fE2pE7kFI3Es8D3XgnYEfNHZenNcqE24erdE/BVANuMSIIif87Mj uwPfH8BZJiSU4mRVqLQBsP5wkTolN1KcoVKF6ceiEWEjpxsLOeb2lzlxW4Yn3sq1Zrh9Uv+q gGrsAeYLFFJYRzqANZGA22Q+x1jN0JraksJaKX0XrLeby7OFym3I5sIBxZp4xgzgau5UEGG/ f5Si39awIIeqL5fhxnqRVABXm40HvDw7bwf4vPTfwhsZfB4GSOXtdrlYWa9C0BbJh4KzxjT9 1krzauTakVtombbMg/LyQ2Rej1eo2F5eLNYWKjeU9gBSuNSNcZj7myOH+nK+dL4xzABV7vYt uNkrN0ih0pqEWQUJtljO7X5BLFMKkdp12kDuEmFTeL7ZOgVwm61PW2ihDc/y1G7cyT70lZi+ seWet/Lq3dfnp5/2IDUNquOomMMuJiScQn8f91u6QwS+WvCT2YklUfIf9ZVa4sD96e7p6V93 93/Mfps9Pfz77v6nz6mp7lfLwBo7Zkukj6hdq8/bIXEPeQvT9yKBLUpqjuIiQWvS3EEWLuIy Xaw3BBuTvJkoau9mgDI8hDSbpZAJo4NmSN/k0HbWcKSn4SiZHHEn4cyxkhQfM1NPBYSD8wcX 5iyTYGZYOUJacJ5PyB5S0vCAmyCijGpxqCjYHjj65J641IJLdeHXqab2WcZwIL4LKcZbtagt pCuuPSDL04iE3E4KDKpRUYhuAyQg9WhfhmxJ+Zg2VHCeHmKinRk+hxAEFROa2gii7kYY8TMK MDiQ5IgSApejlkJ2NIshdQY5l5X7NG45jwOW8fy/jF1N09soEv4r73H3sDWW/CUf5oAlbBHr KwLb8ntRZZLUJlWTmakkUzvz75cGJHUj5Mwhb6ynWwgQggaap7moKdbQWRv4NBzNizIJe/dj hl/nq0G15LGZYaerJDE/7bXbrqYYfsCghteZHIZXmKgkxd7sDisoE9SAzteg7KFszvlLtD5s Xv51+vz1413/+/d87+kkWm4OeH7xkb4mpvcI65qJAzA5pD6htcQ0rHgJUl/0RWqchMAdDcqc A1k/DhemVeAcI8tYozAXgSeAdY3dhortT/o49xPOXosaapjcAUGJibrX8ACibQwQcxBz6neh U4DBeYiDTg7EQeBY8ATmR4Waka45dwIGKQv0mIr7R0Bh7CasBMZHYrrkb6/aeH71ePyhVU4l 9tm1FGflHHGx7ALhpIhCW1+rrK2PolrUMCF9l6RwaP/G4Xv1GWEmHTiqdGQFeHiSCqcknQAo HEPm1hE5mJ56nl3jg/IT1mePipU41qTheTdHo/ExPYBgCFiKiGrk+lq1+gc+Oq6uKC834vbj vHfIh1QVJR7s5FV/ICU49aNZaJuSW+x1r+3QaA6utnOQcLE4LMU1OGB1eVj99dcSjvvjIWWh u++QvraR8ezJE1AHe1+Yoq8UaBhnH5oB6fcAENltdMyPTFCIV2Q5w0FPLKRBA0KL6w6kDXoy gBL0iHDClnmsla+WPY8k+GpKsLhuVOqJUqqNkJam5EDjEK/biaAVgqUiU/u9bgpUw6Cx8fsh uRnwH9TCqNamNz1zD7laELVwNll5ZFKyrG79bEySp1WT1614pe7pCH56q2CzogcIT/A71X2y bpPcv23ATRmXd+uIqoL9RtU+0Eo7kdu14RUpqsdbmvOFStUdWz0e6DNHiCfHnJnn9c1s/JMe xUJ06LMYjUJisJ+nIw7fv37+5c/vHz+8yP99/v7+0wv7+v7T5+8f33//82vwuIkjF+3LW5Lw Xdd1wcZGtVa7sOfXLK0eIvn1TXP9B+rROky162nF634X9bsQ66ch1Kpw7O8y8w+AW+eWfq17 ttmi+jrd7tFK44QmB1TfdUu2gdSjyYnzHXrKzIQaTCfoFU7CD7493FUoji1ePdGo6NTYIn1d Cj1Ui7P+xELzapwkni7riySKIur+2kB/T5aBbOmrMvUsYJxsG3LJxArwRmoyTBQx/oAwHQlc cXqJfVULnwOTZRysEhJCHPz7DpFtCUu0BSGqCpRna3bh5nHcoFahL2Co7NlVW5y84Jje0cnA bHwmR0DVYfossmtrXixmegf/Ge+yl62ob8RuQsWAGsLPmtEepLpSecb67qyr5XmtuL0q7BVm N68UeoMT1kfngOo6oLoJYbdT8MtI9bQRZcH/LLIq2OWjBDJOjUxtQgCBNaJEjqMVXnd2gO6A imkcsDehBxugL+9h/gUnLYNHRaywYvhsxYT1+V3PSnRLsNGqCUnApgv1gQMrVLJBpl5WHqIV amg6/W28m+8edobnLFj1mfNnHFIsYjRJ06Nf5mYI0/6Hw5YKjtLWEzRYQJ1aKo8rn0p1UO0Y sutljLv3W3cmOYBrt4Zk9rgXDCSU+un6Rih5nQ0Mp/L2Jkq6YI5y1HzyJsLr0EjLeLeilkv0 OGUqNJeYEf98JBe6UZR4fABIzxMJgD8g0ZEE9BX3LmcpGpCm6aCjBy18qSKJtx16paKhZXxT hse+YecCn5C7wSge2kW70PcN18teYCCEVWZY1p8a0OUR0yQey2EUcDZ1HllVowKWRbfpOZ4S W4BWmQHpapuBrKGJ1bZzta2vhjMkUkskNBblIpNkEwc7JBBtw8aWFemnhb6Ui3zVaXZ0puhl ojYHR1E+9BgdJ2+owRi49dGiDhCuohX2gRoQ2ihPnBVV+LOsmJK8RGkOwKQsk3UShz/XZH1Y zX0uOq9Xij0ST6fXpEu9V3UTGXbm0BONlGfci3M5aNcXgfOQ92dKXqHvq5dGbSCbBWrq6iww 3U3O9ECfoyw/dEOu7yd/BcnlwHmNjLe/LdiaeO+8LajNYq99q+Rt4UUDheNUlU927p4JYSMV J67zLHjeNYnWB7y6ANeqrnENOahvgv3HIDXLCOouJKEbHKRJFB9wZgA3i5mtc4UNpNwm0e5A +pUc3tbzTwD2NSfOnd1qQ3bskKLkPHQqC2sIsNmR+9chXq2jYHXT7lDIA/EFEjI64Gvi13RK DWHP3wRIMzhVUVF02UqVpUxnH5os00Ok84yGxEakviefvvMQBQmBjWiz8GlLZbop4rWjSrNO /KM3JPHhhZw1zaPkDDtxmIVCZM9CcPMKdzniGsyT4vlVYQPQXgdVsZq/xjoo3XAnA8yebS4q ahsN4JJ5BgrAO5jSYFzTM+7i1U61xzQt0t+3+k0FB5dRYb36wXDgDFG/YQAcY9/PU5ah+sj4 ibqGG2CphPJyQr2HHrWwCQ5zwPZaVTR64YT2BWxTmaWYkKOC4bw/UpOnyR+WLc6e7BTiRSOL XKVMJat15y06lxkFnLVEwYzdhCEGx+BbGPsoVABXJQb0xJXpySDBnCsRBeH7osgwZ/bQtEz2 nVcIkTbFVVLM9fkUrMych3ml0510tMJORMBky1W0iiIvT9YkcthkTWZwVleoI1viNbS3aUPo cNiGfVoKHCioaehFf5RQEx6oW2JBohAD6DPcAlY2jadl9oXp7EvDNQkAAwC5TdHn1zQoEiRr D1ERCBDD3jvVNimqLPKUygzDEfhRcTwOgABiuygPMxtK8Gs3+O4B5/gQM4B9ePfH9xk1csoU eiYgF3YnFhNgDT8ziXcSAWxVkUT4tO4ExhTU/4jJBpiJcNElSYT9lqjg0Ef7hM2laZZ63P5I 0nM8RGBBlS4IyqMISPSkfod3mwYcvs79tgvk2oyLQcm52MWrQEkq+LKS1VwA3/BxDpep3Cfr gH5bZcIebwsXUV6P0n8DwFpdbndrxKZm4CrexyuKWVJvT68t9Vdz7SjKG1lXcZIkFL6kcXTw EoW8vbJr67crk+cuidfRqp+1RBBeWFGKQG2+1V3w/Y7HbJDksp6rikpto857u1BRfiwrQx/e 5LN8SMHblvUz3Vuxw4PSnRiKbpht2QPv9+lRi7cKzkBpgwEILXF/OhMuTp/nmqQJMYHdZ8yR fzyzEnPITsooytR+l25X3TxtsoXpbr4X6y2lGgBHpzIY5gsq7zWjG7y0dd+JOWY6GvzpWGA/ AzyKW5aVyQIj8Z1QrZb3IsGU2SqfWKIwxmz4QDSbyp9ssOXbi6e8vTzdhAS5WV4LOTpbMVny 1tDhostCcqmRQN41elRpzTug2jGkADQVX9k+B+dNgyw/LuX8cHlKh2w1rAei/iYUH3wLwgWF UqnUqzwLhh4zGF2sLQ4R5ogYEK9djPC9IYGMRjy/t0HPOJ2L3YV8InDtUbA70H41uACAPn39 oLDslsfa7RYHqr4LPdJg70oH9EK2sOI1lXcQuLTJq49W9N3ra/9on0OfZn1UWG4AoLJcuuMG 789s1mDx4qBUGpHySIHlvaP1D/aO1rPDQOYBGd6VGTIBSx7evTMgf/TVHCqaOZZ7+aAtExDT +HCzBHDRL3Wz9k+jjtCz+pk0ntWS05rl0eFDTmcCb3EVCbx3OmTDq9BJuzcEcnqeYY760UpB WovU/+QZM7VBqU1LyoUKiDa7KceLxk7e5h4RPuV4B4XsGHqFYMlhbyV7PdFdo0J7or66hXlf nF6D93kHjLB/WIyGARLNPY6CqwogIacDHDAGFfvbF5jIYopE53ESe8wnvdZXORe+rQkd+QA/ MYe0imdKaWQ5DPO9uAvMdqyB7FaS69K7hhv6ujETL/3nWrCRqDv7+Muf//0v8OBO1OtT5t2t y93npAFOlE/6yEGxiXGF3v0OQCObw25LgPVhsx3WSz7/71e4fPkJfoHmDwuAvuon1mjAzCWm 44gGLWI3iM6t4SUu/lHhh1YyDeygZ5MlJy3eItZgDX1NVmyd3U938PSFc5bI1i+6KVWHqTKb YRX4uxQz2FnQC7BsdK/c4tCQdSuqOq1p5TbbzczuA2ym5A3uAC3QVmmJFzJCxd2KmOHxZrUi PYqGtjNoF/k6yfw2C+lf6zXe7SSS7ZJku3xPjOeiNnukTlq1X3sA3B2GFrLnJIHsWUkoe05i 75mWRUfZtbpU9T3ES2h1XLwM8mpMGAxzXj0k8Gt8wP2idk8SR6PSXGjJGIMiP4iKEy3GH1LF ONuaoCQ6xNh32kFyDmUetI/XzNdKEj6/Mb0SiI4SDvAr0oKevT/AT0ponhegIwba19AHCVPm KGrJQDdgy2F5IBfYyc4B3qRlQIFDdI56ZUvvcEhwdmDj/rlk3Quc0/j147dvL8evv7/78Mu7 3z7MWRdt7BoBvQfq1zBKGyWRBEPe3PHaS8Gqkmd42SjPcLh1uKJe4wNCF6EMah2lKHZqPcCu XE8DCmDhcOq6gnXdyQfqpnXeO0qem65XK1WHdlpOrKWLzZlMMTekuYSHOF4vH+5biQ87Fbgl wxWc6ME8oPJYhZoiCvE+uK9/CchO7MJzwhFltqvNeZEFalAnnFODluAygOaIjuKFxpaUGfHs gutebIK0eSBKGT76ZKBMp8lu5TEauQpaziTehYWb7DINMsKG1PpSZFnBaRc5SeFPPB77hKuX T+++frAUgPPYsMC4diu9hKYcHum4GpLeNk/vpidTPQX9l5hqnlg9fTpulKYgXM80Kz8z4sZm DwBMT5cEWepComZZBH9D79QI4aihyMIyIPpQgbKcxZmRxXQH2JaDwwE53JzbCHr8DBpHhser AS3hOEMIJUuq41MWOvv8AR/AF3I5ZHXo0gVRKW1RZeNDRVSLMYLMF4CetFR7S35KaWSJATXb bgGc9PEW1Y3n1Ar16uPaCubZCcc/szgsf1e8npXovtsdiDuahXVv8SboZuJSazAvi8MkG8O6 it/++PP7Ig2mF0rNXPank55+lCZS4hcqgSNWJKqzhWWju3h+8UKhWFnJVCu6i0fqPsY5+hUG 21DcYXc3nNwjROMU7xvJ8B6PJ5Vpy3UH3f0creLNc53Hz/tdQlXe1I9AYfnNgl45+S0cpRdq fymStr3zwh/HGkacsRQD0rOs2W6TBD/Nkx1CjnqjirocM+IVOEjeqmi1D62XII04wpTpo6C4 XCg1+Sg5e45WYQ3TiBYibI2KKmW7zUKAI6yUbKJwvKRRyba/ZyUtymRtFqnnN4NoHeLpQMl3 +/X2ELy7TMMLy5NC02pT+FnyFb8r3FOMgrrhFSyDyoBMqvrO7vjQ+CTSUzTMOj4KOkVw9I2g fhgu9ReHts9HqGdFIwOqcFRa6P+bJiTUFh9rlEiDdzqOlmCi4sSPdX0JycDMuRjuvZCUa0Nb 8TQP5oaDm7Yg+yso3fqa5hcR7ImN0hhRgqCsaQpu7vUlx7TcHvCJIwunD9YwH7zJrusYDXdk BP43R3M0VC/lffeFZEwbuz6pZaiCB6RnFdPvdLphEqyzEIrNlxFN62PLAvj5hA8WTHCLHVEI 3JdByVXoTqbEjBOjzASuZWlIJEXG76LKsPPGKFQlpp6ZkjNuvIsCU7vzWnTCGLs3jEJtirei DuWhZGfjex7KO1BS1O1xSQQ08SGZEtU5XN67yPRFQPKa8yq/ht5fdjyE3gYreVqHMq2uesJy btmJOO5NjUduV1Gogxw1YIy+BptA17BQewS4N9RlQQldPURvpLjoRqPHzMj/VBSw3KK+xl5b H5SUpzgTWCQacHMOic4KT96RIGeVnnefg7LLUV8EJXdGDvW4TEOHZC0flPMJ1J+t3CcbxHlD hftkv38iOzyT+YEIAhrh1V2iaIJClCagYDilKzh+d6kIHwTEqsdrrCct6x/qpY8kVeU5isL+ rVRVKdmYQxz/UHczUw6oAlNCgx1lsDBnZSNzcqwUiznHExosGc49LdSkKISun5AJhbXO1+p1 6cnFQo5N0+zvjlcz+HCrolvMD6tRW2JRlKxCvQVRS+V2RX3JibiUURRyACJK3nhOaqvinVgo b3nZ4/gdWKTNORO4eClfPNPzMrXtVqH4EljR/G7FOVfhB5nfd1EtPWj+zYTeSnnYY0dCX4Z5 DnxZFD+RrcMy4/5Wl00thVpoZMa778wK1i0n0bDqDd4E8+Xrclkm1BMhN+PYstx+HIvirEx7 JdNo9eTxrW1zywrZeHJmKRNAssaK/gcJnWugblwUv2GSnGmfVUXxpB54LJaFrw/V1pV4lrbS I1e62RKTyley399yGkw+ntSA+S2U5V8MfiD6RRlTPzzV9TTj1Sq0oj7X2i89TqooDsbvJWk0 crddYVdlN4ETksxmLKoH2WgTJnqwCseSRdugN4VdBUplcyEnI9zTSj0f34YHR6fRXNerJynr mU/Fi3nK5yYOc3YPYjg2LgoVWFug6asCFmpVNVvZYkr0LUwYeOyL9BxZG9CVE88zd+nUm9Ay zLBkdudtSZz/reChv1dw6/fgtIxWBx+82nW62aOb9JRs9+GwzKhq2lqx9gFnMetsgRhhaBld sX7aNEQp9VPDhB5DAdh6FfbFMXLYMbkcM7Kd4pxS8mG1VvxUv/jxXOCTQycK4LIXyWoT+6D+ S0NIWThVSZzusfOhxRvWkqUPh6aCLHRYtBBHQL0Hkm05C7kASDaJaWfKJi1jWF0OVqG7u01B K7Qir2dStHAD0ldyu00CeLEJgLy8RqtLFJCcysRYY3a359O7r+/ef//4db4fCgdFpkNmaFBN HauXalklCzZErRo1B4UQ1suCc3yi/h7UnuD+KCwr2+S6X4nukPSNeqCn6sbWKOk4FvVdwpB+ W/a3yTnHOd2pIPmsXd3BfOHIaaCG47Ze3LJHWrCMOu2kj1dYfQjGnK47ZmkCCrLHDbA5TEPo 4x9VSvuOAcEz4QHrcXyqqn6tS7KhhA8aepvO2qqXxN3fEilIQcmy0YG726XkxB/JBcD++vnd r/M9GFenSbxd4ReBYJ1k0+pJtOKZIazVtb/8bswNNt5pQDBrSCfRaWugLR4psELyMnwbjfeF H4Q39MiDJO0NBrxq+6t+kRIF1cHiVlv/ouROZxNS4R30luSwFZKWrNKtt25JLC0klzn4X4r2 7XJda8tOLUR9JFmVbDGN++ztV7//9h+QacQ0A8OBNe1E+cnoedx66QgpUQme/XUKp6zP5XX2 HiijIwLnrcMJ39APwKEyTasuHKXYaehXeeRtxoqF2BpWyw0TbxQ7w2v/B6o/UhOnbtcF6Rac AjAJQCKBUoX5nJywbeJZdWqMtGo/wZMs+qLxs+x0TBAHesC2aIb3ENJvyGZcfkudHwcaLjRm 2zcCOrzE5QBseQzDimWCTH2eStGUAlbesoLm1eDaLBRpb+h4g77H5egha8p6IqTBRkyoTQG4 M5XmGV5gt08CM7I+IboVPQiO/J6TF88AQgMEW8Lrjmdqlplmnqij/Z/BJNwAhukIhfLRYEah G4kh3K4POxzboWkKYRcrLTG68fV4eb9shIxDHO5zwQlP94X9hpy/ntAN9QYXLadb3eWd3bCX HbsPDW1SYZ3F+U3+HG9H+sC8wSvBcAWTImzQsOqc5hxWvuH9oKWM9EyrygCCmA8OgtWw0Ykg NDFMgd0kpUl5B+UAQn4I5BFSrdf+itsg5kVKCXrBsiJHs8hOE+TU7C9CDHmiY5ZzmPIwcLzy Ntc1XF5DXT1Icl5AsDo4CkJTkqXHLJzqDvRcH4Wag03KhhYHpR4nIcc/v6FhyrXIF52yxj/9 /u074uqfmzY2cRFt11v/iRrcrQNg54Nltses8xPWy02CgwM7CdD6UVAkKx8hgREsUnqVAkEE NhSqzHZVHAR1bg6JV0op9GzkMAd3+HSwww6Yigww0sc4wK5622C0EEcgWOEyNabt+Cq//f3t +8cvL7/oF+b0X/71Rb+5X/9++fjll48fPnz88PKT0/qPtlLef/r8x7/JOQJolLolLW2zglzb +OJcmbMtlLPJE1LPMy3j53il/Lb+5EG1t99vXlXKxrA/flJNxxZiRdiKL2Edz7unA6qBbmbC 8b909/ubtt20zk/2C3hnz+uHX0Qm6kL3tVe/L9BzbTpLQqCeXJNFaxApVks9vJYeKrShazet Te7q7590RqasoffttQ9FI1rbNwSuuYsbNZMKdBU/UNEtJWRAeUGimmUPa5CVzDER2amTbuv/ Z+zKmtvGlfVf0eNM3Tk3XMRFtyoPFEnJHJMSQ1C0nBeWxlZmVMe2UrZzTvLvbzdAUlgaSh6y qL8m0Ngaja27OrxhTV8CRkk3iZRkhY1oSXfweiEZcUjctWiXlIqTDAQs/RChssLXqWWtf7IV LUNbp4BDf/Qs/mUvsN5jFRaWujHoEIfaGUG8BV1eFqsVGrm6dHu8tG5N2ez3WnuNw9hc20ID 1a/n9/PD+WloKaNd4A9Ma9bU2zIPvT294rlhhZFlXTPzJl9dK7YC/LzyfGvT1shBpvzwdBLx xM0VGiYKFYxBP265/UKa6RNPmRVM8TEyIRc9QKWt971JtL8x5szh/fxqTsxtDYKfH/5NVAyU 1Q3iuB8tF6HRXg5/PR1nwivPDC8hbvIWgwPxF69YONYmVY2P2t7PIMVxBkoGlN7jCR+bgSbk ub39ry2foQuOlm0Dq667BMomNjFgbYSFxBcrk9nCd2qhmzRyTAKaS487J7SP9fod/4YHeDZq tTo+n19/zJ4PX7/CXMhTGDTn/8kNz1MYgvRcDzPHOYs2jkKXVqhirx6sA8sSXwib3lxJ/RrY 7eMgsMPlPazb9bisk73Ay3/8/hW6A1kD/LLfNbk5g0frEXH3MU0WgX+VAXf0rzAMV0LN8QF6 82fyDzbileqBCeIup++CC+mkTi1KXPbFVlG24sQhS33PNQ0J1Ja/VstXpKzS2vOZQ1/8HDh8 P46vNFQ037vh3BAvSRcRIZ8YKviAFk0LC47OjExoyPROMsPvXNxlGCd491//PQ2LjcvsceEU 1gC/xSrHdb4gGfPmspM+FYmV8wcZc+/oAXzhIdXwIC57OvznqErKSlg29+j4qFKkEXRW5ZUm igBQSktTKjyW+zkKj0dd1VU4fJeQjQO+VTpYDacNff9E5ossXvEVHkufVHnori/zxLlD3VGZ WJafvEj1PofbR9yPSnkvzxwy/Yq9UKNjOGSlR9QwMSQZrPYTNChpI7CFOfVKMsOn1+pJYaGr SWGhDMWRgS0Vg2kkY9V9t+j4kQevGkXO/JeYaB+8uNOx5uN6Hy8cumuPPGUdR150lcU69Y8M UKq5G9DTysgDiyd/Tuczlmm9LbNVwej5V/QlwymqhicdtUbSPFDzn7DsV94ZCOKwXrspzPck GxE4lzhm2rBtw/oElkC79a5RzgU0SFEDE5pFPnkpTGKYu3MiWaTHFD1VomBP5Mp1PNcGBDYg tAELC+DTeSw81evsBWqhAmxHMheeuUsfPMgcZM4AhJ4FiBwbQNUHS6OQqsHbuM2Vw9GR7jo0 sEoqN7gRnZbKZ6n4cJ/o7b4mcs9Y6BHcMAuTwhbBLcbeIYSK3NgJVjQQe6s1hQR+FDACACO7 ykz6GiayhOoFAJAL7xEuAzdmFZFgGXiOfow2QGiLrRI6Uu7IdFPchK5/rWfh7g3disWySnJC JqDX+Z4SqQCJuKa5kh+ub8w0/0znRB/mYUhlB9gTUMm7wBcq1d+BSvMSQwCohHBAJfRQWcVk bjGZW0zmRlVFWS3IdBdUBVULKrc2hQmLGBsIeC4lCQJzGxC6VGND3oHnX9PsnGNOycEBIjt+ D5lScwiETmj5JHQJZc2BMKZER2gRXZEcGMLQpxMNQ6qrciAgZwAOLWjjYOJJa98hn7ONHJu0 DSOqz27aVKwcCi3++4DXaRz5IdGlEJh7RA/k6+iF6tyx0vZnjRKwm9alrmtKOKWujcOOCaiq kGrvrMrdyCekzqvUnTvEcADAcy1AeKd4pbxkztJ5VF1BqNEosKW/IKSDCSMI93vDZ4+CU43B AZ+0UpjrUIOZPz/xSMsJgIgyIqAiYo8c5cUm8ZzF1ZZHlj19oUQwtDdVGhAdsK1qJbaORJ9T rYJ0qg+hw/W03tGzGIBhHCYE0LoepWq6Fv3TmvS72Id1EzHpI7CwAp4NIDokpwdUMwgEp/u0 bagtJomxjOKgJYwWAYUbwtABCDrfDWEcCSSnIP46k1Xpx6tnixN3WhdWi7C9dVz5dinXZ/J7 0IGgr3VGcpbz6OGwxurQzXnd3xVM8aRHMa6SohEXu+gVN/EJ+pQQLwKvfmJPnWCU5SXgS5Zy eaC7j1xXJcH4UPwaqeXSMfon442SlklFhQrZx2Ff3+L+Q1VLzcIbvD1+P7zNipe399dvz/zc Aw8Tn6nbitPNnB86ZbxXdtmrGYHN9i653+7M7ea7w/vDP4/nv62+Adh21RKXgZL00w6DPN9l cvjZrBOvmjVyWVR4AcGkRqB1VSpfWcRauqzGYA698h6RpWDNa2zLtF8VbZ16hMD5rtmaohXL yHF0UpUwaWDdJSvoNSpL6DtOjm8aFSrGmtRIIDJBmQJ5aO6E0Z53vZX+RRyplJuaKN9NDTz9 ht/0SrfqXWSWotMpNRFusbi+Stx0aiWHjl4iqGPQYlpaMIK0xuWxGWC69V1XTwAQP1pGeqFw 4lEIox41qQsLdbc2qHEUmawLg4jhiD6bnSmvwcjw5cqeRlaFTzs93nmpkY7vyLIpHmqdFv/6 6/B2fLwMt/Tw+iiNMrzmn5qNCmmI6xrjzv5PkgEOKhmGb862jBVLfrNUnICcX04PbzN2ejo9 nF9my8PDv78+HV6O0siXn+NjEgwdj0q9Cj3e4xmj8h6CcWd5PEKslKWJaukMLomXTZGtjQ/w +t3VFEcGlY5u2q58NsLKpQh8BWe7FIEYv4A3+f6lE1aZjOQFarnYILwma23F3cE9nJ9nb1+P D6cvp4cZRkS+tBT39/ysJGE0DKeK2kgLQnAFl2XmwCg0BihKK3oGVBhtG8GCSa9hcbD17en9 9OXbywOebFsj0uCV6uF+02UwIg3WPj594srhBm/w0KcniGfJwgk8q8NUZIE1EYYd+yUe20Nh 9MJeJ6xIqROisk7xUPnSkkhg6hUSzOTPZPMZWmGbWeoYeW7Bxihp5zb5Z7zdktDXxvHbrqjR f1vS0N8jS5O39NsrBGHNGzihT58m7NIlLC0d+00nnrx5bCujLRuj/ylfsWIehfvrKbMqsBzp Jst98DO5GCybrqD3LLVYhwi3BSwOfT/Y41PLJLO8JK9Z6DqWExLxvNL27H94e2nPHxk8l948 mRgWLn1SJDNcHQJ3petF/vV6LCs/sPQPUVNXHy1wlupK57dfvkA04eHgE+sYlXmuFrSKfdeu Dpp8jeuFLfnKCl1sTvbfs6T/no+Pp8Ps4fxKOEkTX6VJhQ8wDONRoMIrTt92NoasWBctPgyx cnDH41YwtSHwA6NSlPJDiK7Icn6ZSB6qgtjNSw/j7eD7y4R0s3HhM7+GlcaVY2LBsyr2OWjk YoNRDZPNOqcO/AQrxl5sZFsUiMvdCk+UCSp6zWdrAuhgQQfzLvVJtzSpnnZR90Kv8morB5i7 IJg31nRB5O9JAlC1DUvU4RkIUREgoSYOUpQw9i0ao32eczNQYcN3CCKofMMujmURQU8hVZGK ZmCjQVPxXm7M7U2qiQCESvbv36RidZM30t20smjk670NJ/TIpZI3+fS1Qm/SwEIPSfqfHZ0O 227urRmwz/Q3yeZ+SyJVmuPzZBPjdYCNKHsXT6WH40oy+Ub9XSg7piIf1e8W8GCMmUIVZ4X7 G7dqfe66baul1uRZk8iuZrGMbZMn1We5HYtmihCuZ1Ssd8kmUUhtCxIWahWU222Njm7lrl4I u7On/YYILcWDUk0KTGyBHP96ODybj3p4nCo+etIykR/maIDij/GHzLRm4k2HRKqCUAmBjuK0 nRPq4dDWZSyfM0yp9ct884miAyHX0xBAXSQuBeTttmIUgM9x6oJM7M8cLyj/SUIlOplYphkF 3kKSsqczCUFXGwmFVElDilc1C7wFQH6zuYsdUvBtF8gHWwrgz61AT35TJ6nnRBYk8vUGliCX bAmWz/V4XgOwWUBO8vmDjpGFBU1U7JdWhGw+/CtwyC4nIFpADgV2KLRDdKkQCq15uYGlMj4t LFIgkFoQ31J9uIVO9gk+VPVAhAO022A0QgpqQ9cn6VvFh5YEdHHgk52oSx3fI4WGGSGpKGBf NOJpYkGOv8+pr+ue+k6xIAaSdV9kxEk1OOhJ0EFaeT43fjjXc4aav8uXRkGY5wVa62LvVw68 REYAtd1oUCcvh6fz37O243diDf0uvqi7BlAjoYEsrqvrxRlBtOp+6KbWBGJ1FSvq+aJgvMmA Vc+3LdeeLw/DqVxdwYqtbo5ijbmKf1yF3ONF4nGeE9Xx4fH09+n98PSTakl2jnLuKVOFTa43 8d6D1dBe/2Igw5Rt+aBPSpbYvjLNZlj4hY5ZP4JKpjVAIikRc+gnNYB2qxa2YSBZx8CIJ7Es 2/RVseRz//IK1POTMcmXic6Rkh87EZXhrmp7xyWAdK8YeyO5WigzySV9WCt2Jr2rI0e+ciLT PSKddR3X7Nakb7YdKLteHX8jyK0+gp61LRgaOxPY1rAudk16slo4DiGtoBtG8wjXadvNA49A MgzyRUiWgpHTrO/7lpS6C1yqqVZNIT9Yn4T7DHZiRNRKnt5sCpbYaq0jaFhQ11IBPkXf3LOc KHeyC0OqU6GsDiFrmoeeT/DnqRvGRC8Bk5dovqJduD7Rqcoq9wJKnGpfuq7LVibStKUX7/da 3+EdrV/usrUcreCCKOtIVjHRno02LpZe6vWrMt+n25rSHjpu2QQXi5E/UDf9dlAU9u/X1HVe YcF01SeopFYcIELBDoi8phZLJ1z8a0snsY5/OHx9/0ZtWIkEq/w+H1Wv8sGHwzRBWz4tOln9 XGhkkVZLkv/ztkmMaZMT+yz1jZlEIGidOOa0KsDl7rMtPdfySVmVvn8FamwfJh0Lof70vaD+ Jt8Xu6pf51WxKSzgtiEMhmq/vNYYH/758dfr6fFKm6R717ALkGadyONYuYYz7FMKNzKWR7bT x0FMXuQb8ZiQJLZJAsCyTNLbZSFH1ZFQYjBwelf7TjAnoarO9Y24ftnGc029AckcnSxJItc3 0h3IZCFGzLSmRoQoA4e4fxN57+1iA+GLPTPqPYqddJGra1hB67csU00VoT+JLURKsY7MBUlO dNUqyDWea19RutqJEIVftd9g+dZutekzq1xXtx3qVgmLvUFXKGaxBaDSbrZ1LW/l8R3WtbJF xzPNhmPwS0POy+m56xQ1Srenk1Xep2mhbz+LK3380OCjsS/8M/dQ23T4lBqEIFQFswX8kWTS MpgYcu55qLRd9xq66k3f5TtLXvzZlqXwXdEVZunGzPFL7eG7uAMhNNzxcVZV6Qe8DzC6k5Av QFUiwKY65Q9T4uAy4jItahIs7z6lCf3AcWi1n+B3i0VIuVoWhzTTnvsPlY4noc5e3YwcaJrb CUG1rOqrJtZ3hDK2lDdieW5Vsi/4/3QAr+zdkkSPksPytPJSJJc6NUepbnNlEHHZk4XqzVsk 0+ZJEIW0p9IhI1CXkRPSb8vGRFZhHNLnpIJDHIIaHc685YeM8ffZqhpOQ2a/sXbGL/koDmAu qcbEY+apG69Or0cMIjj7DSPJzVx/Mf/dottXRZNn+uJuIOrhmMYDPrxuPbo/HE3Ah/PzM17X ENKfpxi4hhkwd40ZcNmmBq3t9AOmIf7KJX6mdQogZz45eIBC7jup9HyUF8kGerNSKxd6o3gw vtCJ0O3SPHt4eTg9PR1ef1w8/7x/e4F//wDOl7cz/ufkPfwx+/J6fnk/vjy+/a4f+OIhKcaG I+KMD7ZU2yayH+nBTm4GH1hi8+fb4+kMq4eH8yPP/OvrGZYRmD93OvF8+q70kLEtkp0yrAdy lkRz39gyA/IinptbMzmGUAqMaYnTPYO9YrU/Nzd4Uhb48pbDhVr6nmEn3VWx8r7jQpUfogxT R+1FrKr3Y001GZvqSa8Q6DmhiIPFWbvT4/FsZQajzzVyA2JgdEgghgbxljmuvAMg9V1zsSDI xGCqAzcwuLt673uXWIqiGNgNDkovIUofuRG1xReIdpdSO75cScNSrNhosSQDazMy5BfkKSh3 eng+vh6G8WRbIW+7KDRTqtpF57iTn+HV0+HtHykFqUCnZxgy/zmi1p6hfy4jg12dhXPHd43O KAD+lE0ohtPbwxGvWp7Rgdvx6SvoTTLFKvCixVSvTKiL2Te8AAoa9+380D+IkgvVousN7VKD RESnW7XsXFLGYBjHnvxszgDlLqCBLqCuFV3E8iM9BeTTsu1LDlq+rFrP2VsEQiy0lIRjvhXz 5AGpYa5vERSj2bmW/PbaQZ6KBcqetorNrVi1L+FD+VGtiUatBU3ncxY7thpI9p4rPxkz29m1 FGaVOo5rqSCOeVcwizhDjpYvc3sNrVLQTba+vAMT0bFIqu86ylgTC4d5l1tbb++gPQ+vj7Pf 3g7vx6en0/vx98uMrhperF068UKaGAZiaGwP42njwvluEEOYAL5b8n/g7qT+ZwYG3+sRzMwT bhxaJMmavbYpP47g1MuyMQOg/4v9SsFgHpgb2wWc6PkqsWp9V1tofy6h+PLTvAtRr6rgxlXs hrGqvDg2K9WhKtUzq59XKlX9jlFDsRP7ZrU5ThyarJ6+o93lzN0v9O+HLpe5hrgCElVr5grp 73X+xOxI4nNNPFZ4ynkd/5qBktI+zphvSFUt4zDRExS1ELlyx2nB3P2FnshqmBn06kfa3iiI Zxx4CaK+cdPsM5VShvModimR51oum31r9hvoswHRZ/1Aa5WsWGJ96Wd9Izk1yOggpyKpNSms 1sn54Y4mQ56SusQPI73mMg90mbYjxU9J9HMbQfTktk0HbWNtVezrsd6dRCk8siF0PSHGajSt YVoGeW5gqfvPLAHD5/RwePlwe349Hl5gZT31sg8p14GwjLNKBi3sOfqJ57YJ1FesI9H1tYZf ppVvHD2V66z1fT3RgRroVDWo7aTXHE0xJbs48DyK1huL94HezUsi4YuNW7Ds18flQm8o6Jox rQ48h33UDtilLMBiffoxE0vfD3VZqvnUpSazUHt4vu3oekGCJOM4T0c3yKP5PvsCiwE+eal5 lZtlrZeK07RqLhhoDL3hOFH/WhC1votGtK+3OovXuspN2mUVG8MNxkMYBtrUX8BCywm0VheG Sr/St5/juAFlrrcUP/KdViLt+fz0hn4locqOT+evs5fjf5WuoGym8/jskJGx07F+PXz9Bx+T GSdGyVryOQ4/0PNfOFdJwvO7QmIFUwnoifmyvbFO+qRZGgR+C3ld79hHN5Qhdle06U3ebKXX UJnsHA5+9Oq1CCDcVmxw6/1RPlQApNwmWQ/mYDbtSFEHCsDYtpMLeXxrMCyJZ9At6VUffiPc j4P2D1VxxB5pKc5xFHG4B+x9zddXi5jayuWyZKu9mmLjyssRTkkyzQ37hdrvKur6PDJstrsu T6RD9YEgdsY+BiR5fAr+0SeS6vFmr3DD/EMrbEy6duLQQrnjMFCwHZVm76t1orIx5Zim0WIL cI6kU1zncKbqbq1Gi71Q+9UyJR33IMu6Uu9ZDjSwOFQ5geYbxF1Wql8mrFUJULy1p6efFk2z Y/2nvNrpEn/aUy4QYNywVgkWNuyi7FoeW0u89bigN1klRaFZSYNzHCN8xMgsfSaHMYbfy+22 RZuBeNsCaLrC7emybJQN0AFIt/U95JEYQIGBipdloXSkAWvyDqNM5iXe4O6X9y01joGP3TM6 ZwTInBGw5bzaNnmx3vT5BhaUVB8Zc9zKccyxuvJV3jR51suvOoF+k6e7ZaLUJIPmQ2+9z0rO VYJvBslXMFj70pCTvoEPBjWoStMWJS9dKx6ai92z18PzcfbXty9fQLf9M4YvMF55YPXz/qjI XFee/htqfbXt0XnzdrMxmv1+mTfqBCdTee+S+ZMm1eojAX0KTUA7CeR9h7XU426AoH7l1Q9Q dthxFQonyBLkK2WI9BvFCR225DrRRGRuxt+TWkWM5pQ6BKTMYyeQXW1h5SQNdGOME7eRD9J5 11Dduk6kvsL45ZtiV/0/Y1e2HDeuZH9FcZ9mIqYjimStM9EPKJBVhIubCbIWvzDU7rKv4sqS Q1Lfac3XDxIgWVgSlB/arTonASb2PdOsFj0JXqk/twnG7THQcMqhxUOO+kMraJvDUGRDMop3 F0ZHjBvtO/eHatBcjJFwhDxNQpC2cEftzwI4mCPNKOYIchA625F7Pssjs4lHTg0fRymjBknQ +9bxJkEoTbCRACSY2VTF7y7SR6YBCxYGpsZR/VtH+QAROtKuqku68/RFIHbuPbOwrWil+r1Y aDlJKXpXZtalw0W/TC+AKDbH5x6aSqnk7Rp2LMu4LM2memzWy9AskaYWI2TRmHVDP/6WnVpk aSTaZM4K/E4ERJqjVgIgw3NO253ZZtXsQA+PGUrV87luWt00kHRJtbVcYhpjSAK+ccvcM1TC QjA8Wx2JwuT1m71VZQdOZbn+oW0tZtk8TTw2XCFv27I7BBv08gJ0phcxZhnvTpPzpSi5mshg lheGZgcNFrvRAbB68OV9RHmLQxc0rCmMEn33MBmLNAulp+FGcZKSGndGq4WPq/XaYw/aklp9 JJXl0TL6JSHcxJkmVK0XC/caA31+en1+FBOGh9efj/fDgTlyDXFPNDd5t/syeyL+UvaKOIWX yPBFbBIu17HUccNYk1yMEjuw9vMr5OCmsKrFVK++TMuC51u4NmHUp3KPujYp20K3cwY/u5Jz x7iTyXTgnzIjDHOzxo0Ii9h2+gVQRXMTSE9xUplQTU45i5kJfoJXmO86whMxJyio/QUBq7w3 YZEAsKxlRpGLeXkNlKOkF4T7e3tWGHfQDG1ACM+cLq2RHAF9e2JcrRpKOm+b9QSQs3T1ZnjZ LMZ+pRP9Mjx7NwMdwewGT/qx0U7IjWVFgzs+lVr5zNdAFKNTHw080CZDSlG9chf12IT7OgC5 Y5VjlUXgmLhnDJ0ENx84r+J8S06JLaHxva9g98t51c5nweBNElHJRI9nF4N3UvaTcZkJ9nVD VeG41TCQak3ghbL1YbEUdppP3lT6fVcFcd0doaqL0pFlGywXhvXHMfVWkxBVLCdFeJ4jyext 7YNzwfcJcqzzM0ORrWt2U8LBsovtbJEH94uz3VytWk/iYL3e2LnHjVdwPWYe9CqQLeYLK/li ZZdWVj6L7pedKwyTi1yr8yPteh3YnxJYiGDRzK7u5IQaqAbmSxNFhj1RAW4bddBlxCHBrjyC OcESHcdAipJZoG8VSixnho832RLOFzHfcOu9wq3wfB6uAwcznqgrbLGIZgi2sG6NSaI57yyd YlJnxM7QvTSSamIZubiCKvQcCT3HQlugqMDEQpgFJDQto72JgZPvfYlhdnoVGn/CZc+4sAU7 ztE10BYteBCtZhhoh+fBJlq72BLF7JugGqNu/BrM4LPdhoaOALb4rIE+jYnt+3WARXci99rt 8Qo4MdmRlk7EuvNL8vtybvNq8uIEE1MkCWA6wL7mNsFC3TjZVfwe4ALuECo1hVcL3nTIIaeD xIB1DQ+tbPr4WM72OTGOUEzeODsxKXPXdkzNRl/HmyH6jTsfCzYoSNF4eSJN006wUTjNyjHG JyHv6PizST7icdh+GYYU3AcjYeoMd4BY44hY/QUr/a7LCNo9kmwE6/MMR61oD2W9D0I73qzM rD4sOy/ny3liTZhzknCxjI9wFGvyYjruTK6KPFxYI09Fz6k1ia5Z1YgFtwXmSRQ60GaJQAtL DgxY0CPb2mlydl/UhIusQ3vY6kFs1Jf7ISW3uvLjOQwtLS75zhliuT2bhyNFG+iQoVE+2CaB 3XNKmJ/DiwtTwshnD4wVn4oqCMPMDbSEO//25AOIlO0Iuskhu3URCDxWW/1/j7rzjJHhVUIO SW2VHuOmz1WZn5Tbo5wy9Gmtmc6VmB4lVuAqlhlNd3bKeIlvhKrFNKzlsSTLqbHy5Cy3KlIW u/sSKdM9lbNYrJT0JVwLgdyoBTr2QcNlBrDyef8ov+KcnoA8mcMzcONjQsW6PSNQt9MWcBKt jKu/I6QbWJJgC8OSiW2T7MAKE4Oj9fpiY0z8skCxqo3ZIblwS1Y97zBBkXn7sqjBkveI3zAn TUnOO8MnPWBZQi2n9BLF9lwk80XoZkaRlplh9Er9dr6etsY7W4BEVE3Z2mV0uFgZ34q5vbGP DeBJTAb0paOsIZda7R8ZKKMktmJsTqxIiaNNwVmxb+zwGbWMyEswKcpj2TXVYRtbjNDVrXgD 2umT3RHU8wrAus23WVKROHSo/WY+c8BTmsABrZ3lcvs/L1tuJT9nYOi13DUWDJvZtV28uRjT GVJMhRhM9iYk1tNGRYDqLCY6oupnpf6aWAMdnaukIeD304pGtJSMxihoHKTrOHJEpNNZEnOc AWtrJgG7l5ZKdUkpsXKQE+bkACc5bwsrp7jT7kWXn8RggsiCGyhZ0e8lVtt3LCnJBlAnSSHW 9doEZ4TcBin3/jukfvBczGM+lRfzAzrqRNawY2m1sbLiIkkWmIoWltuYmCw3/Z7byOio87UT oaUVy4kx00IJgF+SujQTMSBOlF8usRgJ7Lav/EWIvms0BwDmJdCBTc0GnCqq3eboJZTlp/HC kxmZ8dwTHwtbwzifBtpbTnImBb6MU8K7lJqa/G7ZrpqyW0WKQgz8NOmK5KSZVdTe6QwPdSB3 nNeNKnrl0wKuSDBuKe5sERualY1PLye1J+OC2oB0dEt2dnpHwmNiRJbz8+vbB47cZSzL1Xk2 gxz26HlOKZMFYOkw4EqFPbivxiNIbhHYaA33gUT97BorUyXbNFBmXMw+YoS1bAHoX5r2Gy2L 5dyGwSyt7HQbQoxXQbA8fyizWjr558hEy3BSZif+ScPJgijRfCzHNLv5MXJc1AdvVvx6poHk VvxQF5vAVT0+08aEc/yYexSFi0ZZ0kubxd2iCW9hr8BBebYOAqy6joQoDp8iSoZyO2y9hqu6 Yn3gL5wTqmN6IpguoAVYyfdm3kdllkuh2OMqWKos1hucSENGqftwGfqH3hsMfbx/fXXXILLn pJaRPnkspY9zMuWxJdXcfBwVYlD77zuZtU0p5vbJ3Z/Xn3DxGF43itUfu/vjr7e7bXaAjrnj 8d2P+/fhTeb94+vz3R/Xu6fr9c/rn/8jlL8aMaXXx5/yAvgPsKT98PTt2dS+l3PqgYInh4xB Zti0G5PXA/KhdpWbtXSMmDRkR6yefCB3YkJjjP46yXgc2sYYBk78TRqc4nFczzZ+zrGr2HOf 2rziaemJlWRieU1wriwSa06tswdS556Awzt/kUXUk0Oi3nbtdhkuxov/UFnZj/vvD0/fcQu+ eUwdIxZylaDKzpwpnKjHaQGMhSkTc56EoO0F5jh4O2k5X4V2ucnTPAxztyM1jrCakm2WoAFJ fYiMN14aZy/bNYqmke5VUmNOqZjxp4lTsRQLpgHVTaqkt2GPxF2JYdS28NlTfVnna5ROTLtK GrNr4OyZlTjZFubaT+OOomevUYZV+maaTuDySbz3p3kgxbIBV3EdhLZp16Ho5VUwj4onHG9b FIddFrEUhW2wKR7nMo6rfii3LOu4bca5Z3PadK0vafLaGM6UfOVpH4oLFoOVHbRNgIxhdMLg RLdh7IlrZEGOuScHqiyM9IfRGlU2bLle4JX2MyUtXts/tySDJQxK8opW67PdDSsureZ4jJzs 3MHrRoksE4sx7xKrF2RJLhaBXV7h5S34uiawa5sltvnzQeSSb0u8I/PUf3lB+5My3O6yZ9HD OQNg3x2dPKWl7NHgVF6wIsHrKwSjnnBHseSvyGWqnz5zmXV43F88/dOJ8XRb2paKhkANjnPe Bs7A39erBm9uu4zwtD9yRKNs26LBVVRvdrTB1VwFo0NckrOlpYiAQmssInHbuO3jyO2Ovmal Y4c8S/aiLZ/s5GT2lDpLLGAYZ+hlRZeRzUkfjCbIYmvXSK6/YNBJMrsCym3zWCzgMnKx0sW4 +N9xb3c9AwwnpWZ3llmKN3BJPzmybU0ae9xi5YnUIpssGKycWYLyWGVnjR2XtrY9BSRfZDLP hlkuuYzgjMIf0WLms71FGrvBwn4fMgWkZziQsNZpCdlniRPFWc5oc1ubKr14lNiT3sigIa/Q CUcxthC880lw38yuKHaZUJM6blveyUOgEGGHGW3R5p26K8qF3NjqquvLw89/Xl/uH7VdGnt3 Zlc2ezHD6lqPLynZmvrVqVegOpPQ4zRKTpWPk9EDHfk3LsDt9Aa3kyarTh4vFtFy6gOi+w7D lT8Kya/xa8kyu8sDZk9QVvq9MuNhLgHk5eCpzRj1585fS2Aj1p/k1ue1TarU4GbnZEq6gvq3 X1S1mtBKzI0pDJQTIjlcWR9W0B+0gYbUe8/dfKWsGk/834I7pCquiUj6PQV/WcRUPhMpOWsm VO6K8sD8Gypwvpt3+US7V0dFE7y1n22x8XaPe9tTtHJ5gNXSk74OPsktIxOAnSUTYcF8rVtH z3Pj3Zv4OdEfAivWUDCDFMNmm3v8rwkpmh32pHHfgitDmsqWJjgndR0KQ2jpndLQUUHDPvna ZbZyn147+weDiP2VX0MzGAYn1fLvfWux8NjI2RHqKhsWq/Uyldn87kqDp25bwT6erNlhZQ4S py2PzY80bJd3PHaiQh2nqY8ovSg3I6LblWGhKpcXxIR4rpsmkXC7Na7gyrrBU0tq2PQysyXJ uZhdG/srA+Zz/nn98fzyzt8evv5Lm2S6ob21cxAEJ7Vj/XKi/rjshw/JHNf9I43MJ7l9VHTR +oywtRjwMBjLJzh0Ms9q4Vfvbqo/hRIIliFSULpRxMe+gV/OsavIkq0o2Sg3M2aoHvf7cJVS Hv+16rtVtJnPnYizarEIceebNx7fgBv5pTc5NEuOYIuWaQu2W3oWZzSdlpdSnY4JDcI5n+lW CSWxjcWEI7RA5f6d87mxSavUbqKFbgpExZ5kGUxetmV54I5qDSXgy3OyZBeLv/18CfZt/PQW juNzpxFCXWteHr5/N5qE0qhm+73pdk+DxwdFVjJ6Vix5YS/Zl9ODWJqI7nxr7Dga/O3Wg+9D tMK90hpCUzV3kBkOdeUGgcybh59vYFbo9e5NZRDE8NcT2PMorm/fHh7fwJ7H89O3h+93/wH5 +Hb/8v369p9Omx1zTCzwOEs8z8/NVPkscMP+K/hxtl7IkiC4dGLhCE+33adsTPxbsC3R34Td MNHFS/N/E6T66kTgJMe+1pE47pON0nmT6n7gbKbfmcBCsoo0KRrys34P0cS7mBJczZyXgdpx uV1ZcGnvGZEmS8/7beSJR3K/Gol2VzjPznO0DAWx+Khwi4R71BHMryhT0jrO8VJiVenJbcl0 FK8VihwKF1NNk5DnZ9Ma8rpClRB4g2vHDc+bJqEFScSAcEsB/IJtKUIvo4+w20tjIH252ZNw Kx2cb+rlISlw/MmKT76Qea40MfTq7SrZUUm0S+q6rCHKRC4AfREnq4Xuu0libB1ujAdcCjUN AvZY6GBn/Z2JklrM3ZAr03lCL4h8wnSg1AeOHIzb3hPqhsobye86MEyyNCilTSnK0gQF0JQp RSWH993/eHn7OvvHLfNBBJ/mCubu4UmMFd/ujZNKCCGmEDvb39yIw5NQBFY3rowPD3jXsgRe C+FrcKlifcRXS3B5CzRF5p1DuJgHkWeCoousPJb2byJLz+bOTSQKo2mRnJyXG890Z5Cp+YJG H3yK8SwIZ+tfkAmnIzoLEdz/+CBR0V0YhNP5J2TWvvmwIbP8BZn1tEw+DxrPLtogsv0chfir 40GCi9XIZobvswwyuzwKPEuWsajOQl18maCJzMLpHE7yaPZBBtdHIbKhoVP/YVn9Qf2HDNt8 nKebD+t/9EFNAZHNdIap+j9dJevNavZBnkILmU/XftkYp5OkavZ0ztTnuVXCMourx/u3b88v P6y8twLTvOR2n9dnVLhefpSXi2A6F0BkMa29EFnNp3Mb3G+uGjKdmfl83XygMIhE0/UDRBa4 xY1RhOfL8AONt5/n64+qULWgH9QhaFDTdTXm4Xw2d4r++ek3WLuZBT8+tVGm7z9qktqt5gZ/ xiOmrrc7vmP4G+oZtIVAfyHO+K5a8udMmkrA7LgoAVaSRs2Zb188ySDSbgeaW73AFAc7SSgP Lp1AAlGoglca+vQdbDwkxZ4V2voQMLlt+X5LPX18AG81t8ZYwDFYri2gCL8UtGvOPapnrj3F GBhq5Alpz/1RKrYRbhyoSxfv5rVnAVWiDuCb7D0Jd6tYjdufAJkYXEW5MpoE0c1DACBWCLTU LXPJb4Gho/FFl0aITNOdZ+wExMo8b7vmUiWByVhy1v3dAQOjN4iu8I4R85RVNzLi3qvFyxv4 +rC7WSVl7lP22BaeXJsGQnvGvr/b35//+vL8+vzt7S59/3l9+e149/2v6+sb8nBuMNVk/O7a hmXcQW9KyI+cr09eQ0FgzWoQf0dA2Kko60uXlg3YjjFlOK3bbVeRfcJNAqbWybGhqXYbQEVK D8pg1g3ccVNGmTTrGfNzYjWhUijvqRmc+A/OkjWTXBq5L8C1mfmZfU2KRioqH8nfSH5iZZNt QciMRRQ3iA9pMGKrREWiuQVCDyEXJQlX9+rGKgEsrGGzElv9ApvCm+rqKGq+dpzTkL0yJTks 5ZogCkyrGBmjuAmflm9ZZfngU9gRu3kt8LTk9tGvQP0HY6do0RbYfSqROTwPIbyx+qYptsUo ij+JjYasEO9ewUir3chtu5MGD7rD9vdwNl9PiIk5oS45s0RzxqnbQ/TkQf3feMTbU9tSrx09 aF486cHh0p6Nq3PhcDYLkXzgB9Qy3xAlOHD06LwOFwuz0+oJEot/TmCEIS73OEsgYsMTssMG M/1mo0sbN5YQWr+Yi9C6uR+XNiyvOHQ4rVoYTqoWBeEkvdCfpbv0GVUtg5JYiqW0j1udI2+4 dYDmhuQ2QYCpM3DY92BFwgLj0NPmdEOODofpclRVUR+lBy6vMgoMvNZBq6MUqGgYLaf5ZTTJ sxDTbCQjN7kURg/q1TwmfLZGPxk35n7fAF8K6RM6mCF1oC1YeT67LWovup20it2PMFqpSxYu Ixt+ODtQROfP25LUcYjp96nGc/AAZyKt+VRlyKKtHAgJR2rgyPkY/aq1weT+QDkWKrf8GY0w pNeBC9YtF7pDNR1HSgbw5QzHVziekW1F0bwsZNlg1UkxOcLUTbxA+hy+DN0+knOxYiwqNy+Y fln29kkxFzVmKuPAAXYjvGOHKAtRRMHSuCxhNAuEKGT161ainftZ6AjmHl7lKs7lsMRxmc8t US/tyecK4+UFNk8i42azDtyBQgSJW6T9SnhHkIFdUdLqkMMd88Ma6w5gdHbAndug9e5zquvE i8mby56qcoMJF/PrUt0eHuckFSnQ2Ui9DtYrbpwvZOtgE7YGYsye1O+O1peqESVL88rHNQfm 5U5J5XxUV2O9Ckwl+CKQ3rO0rRIJTUx04Xz2C0zcUFYsEroqFSsU7BQpY0WytGfCI9ixvGoz Lq/uVGXB/df1bo8moLLje1LHZrlcLLClLxBLY7PlLGKsnNUpEyvW17f+4Zi55US+fr0+Xl+e f1zfrK0mEjPRT4SeXbCBxbcPBxbfPh1YfCevZz17az0791z4YDzKZmHsMbxJCYzuTvaQp/vH 5+/SN0zvzOfr85PIJDdHVuHGlx2r5Qzf3xTUZoNfOhbUynMSISgxOfRRgeeiMWi49iZwSN0f D7/9+fBy/QoP/L1JbVaR+f3e/ejP+68ikqev11/KL7FY8KZh4U3Dau5+OZYaj+6W+PvT2z+v rw/WBxcbz4ELiTdrz9GapHw1dbP2pkBQ3gg3gTfUZuGeBgyp+v7+8vz69fnn9a53mOw2yJnH xHXfMJZu6RfXt/99fvmXrAXv/3d9+a879uPn9U9ZhtRTcCIfXY/e2cP3f75hmqmdaA4HhuFm FuBHAaZQiAs1gvSd3wH39+pvR638/vvT9U31YFPapTldrOdusohoCP++3l2fri/f3+9kNNBR MmpmSbJaeQ5LFOerQcDhiVWcrxdMVuuFe3hQX1+fH2EH8BdaX8g9h2lABb5Lc4oM3Ho03Ja7 ++1O+eB8fH66GocEsJcqBrQyZvT/KXuS5rZxZv+KK6eZqjcTa7V9yIEiIYkjbiZBSfaF5Tia RDWx5WfL9U3er3/dAEhiaTD5DilH3U3saDQavYiXCmXURR+vIs89puaVfgjE+XZfpVKn18l3 92VgOMrg74EDXqQOuPKkFAFBo+JBsqaN2cM9HzGa10Op+xX9HiE0hbd1HG6gaI9cUS1YM+YT 5ve+xogFA54JizBtdhjJiG4dH1FnXPVyePjn/QXXigg8//ZyODx+6/XHIlZdrQd5lICmusv4 GjqWcT3ni4vVJU8LW+Qwi15sHRW89GEXWeVDRSzkyWYAy/aG2tPBF9Q7lkU1UMOG3fn7nAx8 aLptW7hik9deLN8XpRfZxuXu+SW6pVUhRo5Cg+GgLIKo4SnsbdpUQKeHIgN0Gq1EBKMyjafU WEk9dtPGIu3FUMy+V408b6xtNs7LG5r1yexbEZ+MZvRzsCRY5XAfpXtS5Uk+35PZ05K4DF0F vIAu+PVYix4hYPEqL/G9pNYjEklMar4OCWARlMCxyJuUrDio9DicEmY53mpAaUGaxtyIYy8J dId9AbmPk7zzZg2ev7yejl+M8yCLynzAdWcHd0CvM5jgN80qSq/GHnaKr6RblkU5ZlzH1wva fytk0WjquVNEq5J2Heojag47WkW70O89t+App0KL76/nXcQfLSxWx9FZ2exSTR2EkHWkBWAU F+oEtosIZNj3dF3CBTxvUdSrMNrFdx/qQKPCFtIE+jV+Wf8V86omKjYx/nRQioxjmA2NqwRp jHmzlptYT1S6LmQEDANiNDOtYqczsKQCEcXWwYjXQbf3GFGP6BKCi1g9KVLWBxELkLvZxWGg ug0ilG8SBcZY+wGVA8ekEsO4DEK0P489frPEF79Ap9x80Aye6JpJK1hfvzpN5DrncCg1eNxq j42t9BsFhWUQLUw6WJbkO6JexljhTptY6+Z2QEi2MIHyY2vbQAudBWMAMNYgiE1upfgpz6t1 rOf+UwDY185iFR+EqX48K/sUawgWKeqWyDna56NZw9BlhTr5ZDRIp6XpPjW7JKvNgw0vpbNO v6RVEbfkMSXc7ZtVWu/dKSsrj8JKuuVgfMdQJhEkyYot7Mo4dCTEdZvEsHo5Pn8/Gb5p7aZN NmzL0VJ6NtEM3PFnI7zQfmiUiyTqKLvK0WVpkVNprKR1iJEmRoKcIIlBGkmUXnAHxMOdUxup p9hqgdcjGC7JAnWLfWnLZFWhgTWfmQFbKCRcJnlR3DU73f+ivG1KlgZFa3VUHp5O58PL6+mR MvmqOJPxu5sSbRDcG+HL09tX6sNCHGfL0pOGBsTj0Gx+P0vCVoTqmX4C4Q1OuvMbo9RBm3BB F9FsRLJLTLdjFKauiyxqi6Ww2jjiw0GeoXMk8LdC+BlJkrFHt9meXL3xnDjTmomhC9/sq4iW TMWdlbcfBfvYDSj33+gS51793vjGpzG4uvHYm6LazK+cvPLY7wJqeuVtxvU1LV+DLDiaeCyx 07CYjC9pGZHjg3J4eT1yV3Hw9PL9+PfRGaXrydzVBa6PX1o7SVRth6enp9MzOb9yjZgBVS10 u2is4NmKgomgFSC247W+3LgT3uV/P108yLn3Tfjscu7TEc0mXq3ebOLVEM+mHg9TQM3H09J2 mTY+nfpmHVA+ldRs5tXoz648lzVE+fvtX7KzucdeGNblxPPsAOty5rncwrKcXplm9CqP7+F/ 3w/Pjz86jfL/oYoriqqPRZK0ryShOA9XqCJ8OJ9eP0bHt/Pr8fM7atDNSb6xvBiksfe3h7fD HwmUcfhykZxOLxe/QeG/X/zdVf6mVW4WuJxOZq46579RGHvXD2J9Dgot1jcH+7KazijJRds7 q7syt3ir4qASYzPQnoqvJmNCiRXD+J8xW8DT4eHt/fXwdHg+X7w/H89Et6de9abAegYlzraY ZGx+ObvEtv66CjyI/oJ+TzwW960QLtTbHsa5DbNkaqnuiAMr6RIz/EzvHWyub66od0OtuDRY YQjLlGF8bnKqkMJz1v2SQlgENSnrgv9cG4zuYBSV3EOvhzecc8X43+x6KsxOySp6QWWcDiG7 TRmmuqDl5B2twYiLAEN0eL6CJrAuZ3zi6e0ydQ/A5fH1SYjfTpgGFhnzAj+bfLmkbvRt+nmQ 36R42Qq5qEEoF9p7eRRGC91SJ0rj2Mh/CwA5IZQIhwFr4fK05FClbqPbI/QGr/J8BZeZtnVO z9kyvviN/XuGeT1+/n7oRyJunQd/v6hse2f4qNkGem6VFtIUqDw3fU1NVCe9AytAyZ+YC9SQ /3g7H560eYjCIFyzZof5DpRfuO4Hu+fjxhNwCHATOoYWYKaNbjktADWm/UDhA8rULlqKuMEQ QJjaOXFRFQvrUjrI67VPvVqgvxaRYZyKv/0qo6pJF2IUNMsLhr7DgFkaV+sODMShx5WuJcFr DTojU2bEWvHNPuBck/91FDEkOloblrafbYu130Qhf3nGFOF+/Y74CpPgYjwUatr3Vu34+7bO uXZL3NMNQrCppkII7Cv6Jren2tnuy2U1NlqhAOIqj3r9KNHc2DFLq0neQpp8rMcw7sAYIKEC ZsmaMKnNtBAdjbis25VI9/c0qDYyFVzXGx1NbqcFL62RbSHGWPZPaS1WrFJxVq1wqul3t5a4 rLOmCjKgE+bg9J6X1L6xz+LEHk7fxkblh+5BgWH72inSoFWW83iprfDIBsQSIOZF+zDo6Prz ScEUm8O7dRpXVQyXbaIv1sIVP/E5AOOuyOMfk2v1BCLQmSLDhSv70VUuEb6Bk1heMo0F3S5T 3mxHNkAzABRfhTyxWonJgKVOWdMu1TxfViZTXgqGrNsgGmEzlQOUmjhlJ/P4Tfd5X1YW21SA bgP0Y68Qa2Ae+aoMaCGkpRp4+1YU+QJjIaBlFKU4FzQiEKTxdNFBByrQiMi2ynGI/ijz9GO0 jcSh6pypcZXfzOeXJivOk5hpM3IPRPoGqKOlQY+/s6QLIhXl1cdlwD9mnK4ScMbnaQVfGJCt TYK/W5kBY1mgp9Sn6eSKwsd5uAZRAzrw4f389/WHbsdz54wUIC+HQGS5a3tVvB3ev5wu/qZ6 JM5PfYQEYKNyqOuwbUoAQcwztoYAYhcxM0vMdQ8tK2IDTwvnJ8XEJMI6vtf1CnjEQi9AgUTl ulEv/rH4unDqEavvDo6WVH+xi5yBViAYTkovvLSKZsIE1SqiA4JwXVWBJ8vL2ioKfss0RfqJ xJz2CZBvISzs5jmSi32StBAVaebSge/gjGOu6rbHo1fVFnjaklICS7KqhjtGaUhU6mtrnjs4 KV61cgAhoCEKuTPe6uDoUcGvK5vk3gh3ImHJfW6DRHJ7t7dlvYhp0Uk1AFXvTZZnlI+1TlJg kGJHSuzx6KH203qWwTavS2g9URk01Jr5FoJeOhhBOZLDpXHKlsAYjw5qjhzIWsYRB+xc/13d 1kG1piD2hHdws/wObDSmL+ReH7kOPBUZUTAxincAO1qWLpgnFHxHsyyDVcpA/lDHL6ZUnnSM 35bL0ziDJWsIvamze9eFAFHCSrafWiUCaO6UoIA+DlASlUqY8GGNmsWdjAJJX7MsypRTA+SU l/O1dpcSWNiDC/OZr4NDodoBIi/g2nSqe3co47MR1SsCad7XHzZbc707oyAhkp/Rhh8Dw8r2 uVOghHnvv2NrNgUARTjj+FVk9r5owQQfbFEuGwQJaxuURqVBbbVCABYYRH2NKvBmNL4ynkYt tC8siFPMpe+pySKcjK/mV9TJinQVRuyruNOgtbxi+D6T9x5dLF9i4Mm84c186hRWRnQsRNmC oolxJgYo1js6FrXqaSN44SAFXhF8fQG0EgSs/izQDz3J88LpkG8FGm7fcMfa5eWGFoMya5Hg b/1KJH5P7N/mshSwqUlT7XTNoqRoRg5Ee2IvRFPErTW4M6wbBcaKjyxgcGmxaduaGmEzjCxc JIltMCRJngZx9unDP4fX58P3P0+vXz9YX7X7Cl2kWGIPkryaaVOQSe1FG/MuIq+9LdGGlRlL kMgs14rhCKDI6E0E0+EMd4RzYgMoqqnV3sjtJq0JR1J1UxmIkodzojVX/JSVaj2EZnXWGcY8 qRfX/pCvs9KwlRW/m5UeWVPB8ASCC1SW6dOkcGj92pgxGRXGXJQAgZHA4ptNuZg51NbMhKxY m7f72DwU8LfXrEQgdyzYNMUOU3Rqp6ZA1UUY6PZYAmidDAImjgULZky8gDjBI3soFS1YYvVm WL1KF97P+o3RTm1YmCwlFPc9lBk4SFKrzNBISSxch3niqqsksuJl7kJxBRmbSUBzEJIzQ1Oi ykAfAbjBUztUFpc4ZbE9LwPDbTQKzBPVvUIOMOWAGqwbc6zET4qEEgckwhUGzK4kVat0sFUN SdWpKZrpRPOXNjBXfszVzIO5nl16MWMvxl+arwXXc28985EX422Bng7Hwky9GG+r53Mv5saD uZn4vrnxjujNxNefm6mvnusrqz9xlV9fz26aa88Ho7G3fkBZQx1UYRzT5Y9o8JgGT2iwp+0z GjynwVc0+MbTbk9TRp62jKzGbPL4uikJWG3CMIoZ3Jb0tEotOGQJ18Nn9fCMs1rPJddhyhyE H7KsuzJOEqq0VcBoeMn0xJ4tOA4xB1REILI65p6+kU3idbmJq7WJqPlSW5H40KT/6E45ofrc CLHu4tvD4z/H56+92hN4OIYPLm+XSbCqNDtR8dXL6/H5/M/Fw/OXiy9Ph7evbkJr8Q6xaZRe qK1dqXGllk9EdkrYFoSRaUuxwFTN6tuIYTos/dlc5cCmg+uFp6eX4/fDH+fj0+Hi8dvh8Z83 0cBHCX912yjfuvBt1KilgzYli+qQVHmwDN+2xQsLfFCULAy4nj9a4dO64vL5S7uOwn1HfmmE XoLjOi6ACaSYC8+MS8mCSJQGSEp1lYGgHKkMepU+2PIlTy9qzTCV29C7sfyqkrIrKoJTjHhE ncuYNX2H4cFkh4pcvEaZzy06ZqC6ZV7CYpNynht8X5GmwSoW+vTytu+kBuxXV1BtPl3+ezn6 PDfHQl4m2jUss3lcRIfP71+/yrVvNQsZtfCRHGi6fAGir69qLOG+QGmzMXaZalfK0gQ6767C FjNUPEeLmbryOTRKqi390qWQccnrgPKrUo/FMrpdnMXcbaKaMBj1ghITtW6KluZbVi6TfOcW ZKB9JYlVh6PSbqqukA44NFZrKySjfNPCFXCBBoTvL5JlrB+ev+p5K0DArtHXh8NU6y8266CM XGT/8gDMDJ3WUp2wsP0DfkrcbIOkZp8uqYLR3fGXC7aJu4K7QcI+NGv0nOC4iRzG3aEEY0cV wmhMtqsn/IX+mrRudyUYHylyco0ZeLtTFSyKyL3ZCbDv2imSkHSvx9I2EW1UO15x8dub8uN4 +5+Lp/fz4d8D/Odwfvzzzz9/dxkJ3KzTmrO9x7OpRQuDh0FGWRVx5tVFq806UJGk2O1UdRVs NMx4MUArMmb5eWBRwoZtL6AkhSgAR3KgkoDneKxXCWO0i2LfFrScCQoM/pcsHfOQ7iQFRiLk F4KhSn7tZXXwDzjQIq+Ib4UiXET8Gmpk7HEgUhNIj5JECqVtDGfoAE0IMgmIrnGQuCajZVjT x1lV4KN5A/jBwxjxwMJApmROOH+NBLk9OvcnHRMYj8xCegrb8MysC+dooK8yXxvbiwik9Ki2 QzaUm0KzvPFq5vr1CnJcFt7RPqXi9FkHVXdilTEmq8ZcNWFe3EmxqqKONpKQEuYqyXjUAnb9 s7K8kONmHEOwCdu0jD/BrsqgWP8SzbKQ8TiHqmlSsR8owlZYX7Y70Y9sdjFfg5i7quzKjEpA yM7LyCJB+wqxFJFSLG6nENgu+lO6AIaqNFm0ZkxRSpM68yEOuU73ot9K+Ft86ER6Q/cGfziu 2Ar6FLoDrRUl2OrO0q465bXmT3ZBitBdIEuH81krg7a7Lm9BOlgOkciDdIBAzZaaEY8Tr/i8 qTKQFulEXurpC04W8aqBxgHGY6eCBxlsfbxzqQ88J15HDktkkFCK0W7v2lYl4qm8ES5Nxnre QBULJpeDZgZAQjWgeU9SI4dhTerC4b0dHUbH9jNNfW0tgImt06D0vFprlL5K5Yny/iyu0/zw drbOlGQTcfpSgSWJcxAETk+YFjlolW7oSdt59owQDnw/XblAo0U/Xpx5WxHzYYhMCiLzaSde 0FQiQn0ZxNHcX5QYBOT7Gd66k8J3qgu6DRDynHbrQxELo+Xl6zAeTW6mIqw+XsXoPdgGc0By dITNObNj+PeHEwboH/SlrzBUIvPe6+RtbBUtjIsY/CalMnEGwiYy0rphgAglcYkrQa0xQxaU yZ3SBuk16HB/SlwReoJHdUpHhxByeY5pwNzzWsJ9MlCrIuHoOVwDcynzbO8Wku29BeT1IlGP C85naLWX1BUtlLf+0b75ap20bV8dfdI6JkKFZcBBkynFSnITdPVI7ZxIONBc7q8v+wuXjWPR pxGNq6WGb0xjBeefODhRme4S3SMYHV6lo5D1DdN4jNF6A1StifodVUmsQn2Jt1p6t4eF3/ga LfBSjLQOV7zYtttWSyqNh1mTnD6lTeEgNqAkDgKrw9irw+P76/H8w1WKbtidcTbxEt0LIgEn 64STBq03CRKtxFZZJGxnrRq6h/UoZZVw8hKsguIhzqNdC9EthLrylAmHH9Psl2VKoEUaSCc4 Ad+TiUertEGHMDRnE5kpP80xFb1TJsxbnNV7suMK1+tEaGZskxMeVl5SVLPnBdHXliLYhrbD iEMjri0lu4Vp5ErPMhpoX5EncXgXLZDBCyNTX1i1/ss0CMmQIC0BHND5XU40USKExRT6VRS8 kWK/oWKniOso5vgQ8Wl0OZ4STVK0IBhwzekmyVGR/vOWqjFQ9J8+fHz7fHz+eD49nX6c/jg+ H88ffB8GILNvAyW3Syd69TX9WVDAykkNe3Ibpenc2smzSe8CPRePAZYiMjMcGWOPZMG8+mbJ Ru2l8mvEcmR+jbbt869RY/8GuH7PofTMnTb204duVvY42HiJ1M0ehNho5haRMNRcF3c2dJ+X Nqi4tSFSCsW7rJa5RUZ5bjWX4euPl/Pp4vH0erg4vV58O3x/ObxqYWdkSOglRu/5YQGDZGXE jDHAYxfO9Gy/GtAlhftUGBdrI3S+hXE/sgyAeqBLWmYrp2SAuYQFWnU7pALqEqdBFhhRUkz4 2LAAkihkGbQoYHza8nLX580kXy1H4+u0TpwWZ3XiAgvx1wHj0Xdbs5o5HRF/iDms+RqOeQdu 5WtRxHhXllcelEcc/Ao4j4mXMUrez98OcNt8fDgfvlyw50dcthhD+T/H87eL4O3t9HgUqOjh /OAs3zBM3YoIWMVu421b5UIEnng6fdGdydoCF253Q+4u15BXDozpHpsKlpQ7YnqISva8i0Gw fnj75mteGrifringnqpkKynbaBdwu3drKMPJmBgDAZYSkWHGp6GH1rsggJ4nVj5Za+rEVrfr TqMpAZu52zEO14HIqOe2v0wj2EEkWLeK6sHjmbuEATwZu9TVOhiRwKaqKjYhhguQUL5ED40a 0M1GY5eOKo1qwcxI2KA276oc3bjgXUERiwlpxKxhzoN2+uUBc3z5ZkYyazk/caKwSlxS5u5M Ikor2kJm9SJ2d1pQhm5BcPDuljGxflqEE7TIxntaGAYpS5I48CL6D51l31JAL6GTwXavaAf3 ivPRmPjK/gYtTuj+IW5GNg7gnja5lHNPCfNfKiFi7iwu6WNqsw7uCYGiwpCS1O6TcN/kVYwR ZbGyQA2tBw4bjo39BUqavtfUBu+Jfj53nLlLC+6p5FpWcN9Ut2hP2010M9kFd14ao3+dpRUG jDnqccG6+V3iE5pT2r2ZBE4divc5MWbJ/eCuAPSaCNT38Pzl9HSRvT99Pry2waSoBgZZFTdh QQmI4vEt0GOZWoiGPJY6bOWTadc7hxHiY0IRRKZ7hosTTHQID8xdH0K4FaQpQ/0JqlmElsqn B9xsNdVHC8GHoHAdFzSmKfOaG89THVY8aiy11zkEwqCEQkmMD+f4rGyiURNpfSCvOUuigrSK CSjqt0qWwEVeqPjx4t9TKbum+F5co42a+jEVXTPPHNGS1AxbKJpbS3UBpePatuGNoQ9orZ8a Dz+LOAtKpbJediYlx8+vD68/Ll5P7+fjsy7kyVudfttbxLxkqEbRhrB9Gqx4mcH9EdN6plb8 CZ0kYZkHi9GlZY5UB4UhiPBRAQ6VRcxdPCaBi3MjHlKL8oK19zCYMZzAXaU/CYCICPJ8zA22 HBqJD4GCjy6jeGnCYl435lcT606GwueAXlsRJDCPi7tr4lOJ8fEnQRKUu8DjMCkpFuQKApxm XA3c0hXAQ01uRX6K1hWC2f4woA4LBjbb+Xr3tAhFVb8Ln5Lw/T2C7d/iCqc/IEhoke/g5KON hhRJHHikH4UPSlqH1KP5uk7p0GOKBu1eKNszhV6EfxFN9776tEPSrO5jI/5Xh1gAYkxikntd r6YhhGc2RZ974NP/7+NadhgEgeA39dJwtQUTUhpSrF79DT9fZ0zoLJJeB10SHwvMzO71l6I/ azDOxBJgCc4pm82BouDtXf8GTPhn6HYXG0I4zqsBKb6HrS/lVgR/vLvwOAlOSVdTPuqdjHZ4 Qtb+QHeOPuuz+RBS8mBXIGYe28nto5WAyZaRVe9PFYn5EY8sMfrGRSKnMq9NR5pjvSpN343i eTz9kZK+xyfn6OGMiRPI7BpufqJJBNVlcX5k7Fivmh7wHqXE693mmghu4wveAeGPDl64PQIA --------------020709090402000802070905 Content-Type: text/plain; charset=UTF-8; name="xlcreate.txt" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="xlcreate.txt" UGFyc2luZyBjb25maWcgZnJvbSB0ZXN0LmNmZwpsaWJ4bDogZGVidWc6IGxpYnhsX2NyZWF0 ZS5jOjEyMzA6ZG9fZG9tYWluX2NyZWF0ZTogYW8gMHhkNDA4YjA6IGNyZWF0ZTogaG93PShu aWwpIGNhbGxiYWNrPShuaWwpIHBvbGxlcj0weGQ0MDkxMApsaWJ4bDogZGVidWc6IGxpYnhs X2NyZWF0ZS5jOjY3NTppbml0aWF0ZV9kb21haW5fY3JlYXRlOiBydW5uaW5nIGJvb3Rsb2Fk ZXIKbGlieGw6IGRlYnVnOiBsaWJ4bF9ib290bG9hZGVyLmM6MzIxOmxpYnhsX19ib290bG9h ZGVyX3J1bjogbm90IGEgUFYgZG9tYWluLCBza2lwcGluZyBib290bG9hZGVyCmxpYnhsOiBk ZWJ1ZzogbGlieGxfZXZlbnQuYzo2MDg6bGlieGxfX2V2X3hzd2F0Y2hfZGVyZWdpc3Rlcjog d2F0Y2ggdz0weGQzNjA5ODogZGVyZWdpc3RlciB1bnJlZ2lzdGVyZWQKbGlieGw6IGRlYnVn OiBsaWJ4bF9udW1hLmM6NDc1OmxpYnhsX19nZXRfbnVtYV9jYW5kaWRhdGU6IE5ldyBiZXN0 IE5VTUEgcGxhY2VtZW50IGNhbmRpZGF0ZSBmb3VuZDogbnJfbm9kZXM9MSwgbnJfY3B1cz04 LCBucl92Y3B1cz0xMywgZnJlZV9tZW1rYj0xOTY5OQpsaWJ4bDogZGV0YWlsOiBsaWJ4bF9k b20uYzoxOTU6bnVtYV9wbGFjZV9kb21haW46IE5VTUEgcGxhY2VtZW50IGNhbmRpZGF0ZSB3 aXRoIDEgbm9kZXMsIDggY3B1cyBhbmQgMTk2OTkgS0IgZnJlZSBzZWxlY3RlZAp4YzogZGV0 YWlsOiBlbGZfcGFyc2VfYmluYXJ5OiBwaGRyOiBwYWRkcj0weDEwMDAwMCBtZW1zej0weDll ZjY0CnhjOiBkZXRhaWw6IGVsZl9wYXJzZV9iaW5hcnk6IG1lbW9yeTogMHgxMDAwMDAgLT4g MHgxOWVmNjQKeGM6IGluZm86IFZJUlRVQUwgTUVNT1JZIEFSUkFOR0VNRU5UOgogIExvYWRl cjogICAgICAgIDAwMDAwMDAwMDAxMDAwMDAtPjAwMDAwMDAwMDAxOWVmNjQKICBNb2R1bGVz OiAgICAgICAwMDAwMDAwMDAwMDAwMDAwLT4wMDAwMDAwMDAwMDAwMDAwCiAgVE9UQUw6ICAg ICAgICAgMDAwMDAwMDAwMDAwMDAwMC0+MDAwMDAwMDA3ZjgwMDAwMAogIEVOVFJZIEFERFJF U1M6IDAwMDAwMDAwMDAxMDA2MDgKeGM6IGluZm86IFBIWVNJQ0FMIE1FTU9SWSBBTExPQ0FU SU9OOgogIDRLQiBQQUdFUzogMHgwMDAwMDAwMDAwMDAwMjAwCiAgMk1CIFBBR0VTOiAweDAw MDAwMDAwMDAwMDAzZmIKICAxR0IgUEFHRVM6IDB4MDAwMDAwMDAwMDAwMDAwMAp4YzogZGV0 YWlsOiBlbGZfbG9hZF9iaW5hcnk6IHBoZHIgMCBhdCAweDdmNjM4ZGZlMjAwMCAtPiAweDdm NjM4ZTA3N2RlZApsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6MTIwNjpsaWJ4bF9fc3Bhd25f bG9jYWxfZG06IFNwYXduaW5nIGRldmljZS1tb2RlbCAvdXNyL2Jpbi9xZW11LXN5c3RlbS14 ODZfNjQgd2l0aCBhcmd1bWVudHM6CmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4Omxp YnhsX19zcGF3bl9sb2NhbF9kbTogICAvdXNyL2Jpbi9xZW11LXN5c3RlbS14ODZfNjQKbGli eGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAgIC14 ZW4tZG9taWQKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xv Y2FsX2RtOiAgIDEzCmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19zcGF3 bl9sb2NhbF9kbTogICAtY2hhcmRldgpsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6MTIwODps aWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgc29ja2V0LGlkPWxpYnhsLWNtZCxwYXRoPS92YXIv cnVuL3hlbi9xbXAtbGlieGwtMTMsc2VydmVyLG5vd2FpdApsaWJ4bDogZGVidWc6IGxpYnhs X2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgLW1vbgpsaWJ4bDogZGVidWc6 IGxpYnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgY2hhcmRldj1saWJ4 bC1jbWQsbW9kZT1jb250cm9sCmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhs X19zcGF3bl9sb2NhbF9kbTogICAtbmFtZQpsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6MTIw ODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgdGVzdApsaWJ4bDogZGVidWc6IGxpYnhsX2Rt LmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgLXZuYwpsaWJ4bDogZGVidWc6IGxp YnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgMTI3LjAuMC4xOjAsdG89 OTkKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2Rt OiAgIC1nbG9iYWwKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXdu X2xvY2FsX2RtOiAgIGlzYS1mZGMuZHJpdmVBPQpsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6 MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgLXZnYQpsaWJ4bDogZGVidWc6IGxpYnhs X2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgY2lycnVzCmxpYnhsOiBkZWJ1 ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19zcGF3bl9sb2NhbF9kbTogICAtZ2xvYmFsCmxp YnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19zcGF3bl9sb2NhbF9kbTogICB2 Z2EudnJhbV9zaXplX21iPTgKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxf X3NwYXduX2xvY2FsX2RtOiAgIC1ib290CmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4 OmxpYnhsX19zcGF3bl9sb2NhbF9kbTogICBvcmRlcj1jZGEKbGlieGw6IGRlYnVnOiBsaWJ4 bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAgIC1uZXQKbGlieGw6IGRlYnVn OiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAgIG5vbmUKbGlieGw6 IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAgIC1NCmxp YnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19zcGF3bl9sb2NhbF9kbTogICB4 ZW5mdgpsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxf ZG06ICAgLW0KbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xv Y2FsX2RtOiAgIDIwNDAKbGlieGw6IGRlYnVnOiBsaWJ4bF9ldmVudC5jOjU1OTpsaWJ4bF9f ZXZfeHN3YXRjaF9yZWdpc3Rlcjogd2F0Y2ggdz0weGQzNjJkMCB3cGF0aD0vbG9jYWwvZG9t YWluLzAvZGV2aWNlLW1vZGVsLzEzL3N0YXRlIHRva2VuPTMvMDogcmVnaXN0ZXIgc2xvdG51 bT0zCmxpYnhsOiBkZWJ1ZzogbGlieGxfY3JlYXRlLmM6MTI0Mzpkb19kb21haW5fY3JlYXRl OiBhbyAweGQ0MDhiMDogaW5wcm9ncmVzczogcG9sbGVyPTB4ZDQwOTEwLCBmbGFncz1pCmxp YnhsOiBkZWJ1ZzogbGlieGxfZXZlbnQuYzo1MDM6d2F0Y2hmZF9jYWxsYmFjazogd2F0Y2gg dz0weGQzNjJkMCB3cGF0aD0vbG9jYWwvZG9tYWluLzAvZGV2aWNlLW1vZGVsLzEzL3N0YXRl IHRva2VuPTMvMDogZXZlbnQgZXBhdGg9L2xvY2FsL2RvbWFpbi8wL2RldmljZS1tb2RlbC8x My9zdGF0ZQpsaWJ4bDogZGVidWc6IGxpYnhsX2V2ZW50LmM6NTAzOndhdGNoZmRfY2FsbGJh Y2s6IHdhdGNoIHc9MHhkMzYyZDAgd3BhdGg9L2xvY2FsL2RvbWFpbi8wL2RldmljZS1tb2Rl bC8xMy9zdGF0ZSB0b2tlbj0zLzA6IGV2ZW50IGVwYXRoPS9sb2NhbC9kb21haW4vMC9kZXZp Y2UtbW9kZWwvMTMvc3RhdGUKbGlieGw6IGRlYnVnOiBsaWJ4bF9ldmVudC5jOjU5NjpsaWJ4 bF9fZXZfeHN3YXRjaF9kZXJlZ2lzdGVyOiB3YXRjaCB3PTB4ZDM2MmQwIHdwYXRoPS9sb2Nh bC9kb21haW4vMC9kZXZpY2UtbW9kZWwvMTMvc3RhdGUgdG9rZW49My8wOiBkZXJlZ2lzdGVy IHNsb3RudW09MwpsaWJ4bDogZGVidWc6IGxpYnhsX2V2ZW50LmM6NjA4OmxpYnhsX19ldl94 c3dhdGNoX2RlcmVnaXN0ZXI6IHdhdGNoIHc9MHhkMzYyZDA6IGRlcmVnaXN0ZXIgdW5yZWdp c3RlcmVkCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6NzA3OmxpYnhsX19xbXBfaW5pdGlh bGl6ZTogY29ubmVjdGVkIHRvIC92YXIvcnVuL3hlbi9xbXAtbGlieGwtMTMKbGlieGw6IGRl YnVnOiBsaWJ4bF9xbXAuYzoyOTk6cW1wX2hhbmRsZV9yZXNwb25zZTogbWVzc2FnZSB0eXBl OiBxbXAKbGlieGw6IGRlYnVnOiBsaWJ4bF9xbXAuYzo1NTU6cW1wX3NlbmRfcHJlcGFyZTog bmV4dCBxbXAgY29tbWFuZDogJ3sKICAgICJleGVjdXRlIjogInFtcF9jYXBhYmlsaXRpZXMi LAogICAgImlkIjogMQp9CicKbGlieGw6IGRlYnVnOiBsaWJ4bF9xbXAuYzoyOTk6cW1wX2hh bmRsZV9yZXNwb25zZTogbWVzc2FnZSB0eXBlOiByZXR1cm4KbGlieGw6IGRlYnVnOiBsaWJ4 bF9xbXAuYzo1NTU6cW1wX3NlbmRfcHJlcGFyZTogbmV4dCBxbXAgY29tbWFuZDogJ3sKICAg ICJleGVjdXRlIjogInF1ZXJ5LWNoYXJkZXYiLAogICAgImlkIjogMgp9CicKbGlieGw6IGRl YnVnOiBsaWJ4bF9xbXAuYzoyOTk6cW1wX2hhbmRsZV9yZXNwb25zZTogbWVzc2FnZSB0eXBl OiByZXR1cm4KbGlieGw6IGRlYnVnOiBsaWJ4bF9xbXAuYzo1NTU6cW1wX3NlbmRfcHJlcGFy ZTogbmV4dCBxbXAgY29tbWFuZDogJ3sKICAgICJleGVjdXRlIjogInF1ZXJ5LXZuYyIsCiAg ICAiaWQiOiAzCn0KJwpsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjI5OTpxbXBfaGFuZGxl X3Jlc3BvbnNlOiBtZXNzYWdlIHR5cGU6IHJldHVybgpsaWJ4bDogZGVidWc6IGxpYnhsX3Ft cC5jOjcwNzpsaWJ4bF9fcW1wX2luaXRpYWxpemU6IGNvbm5lY3RlZCB0byAvdmFyL3J1bi94 ZW4vcW1wLWxpYnhsLTEzCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5k bGVfcmVzcG9uc2U6IG1lc3NhZ2UgdHlwZTogcW1wCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1w LmM6NTU1OnFtcF9zZW5kX3ByZXBhcmU6IG5leHQgcW1wIGNvbW1hbmQ6ICd7CiAgICAiZXhl Y3V0ZSI6ICJxbXBfY2FwYWJpbGl0aWVzIiwKICAgICJpZCI6IDEKfQonCmxpYnhsOiBkZWJ1 ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1lc3NhZ2UgdHlwZTog cmV0dXJuCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6NTU1OnFtcF9zZW5kX3ByZXBhcmU6 IG5leHQgcW1wIGNvbW1hbmQ6ICd7CiAgICAiZXhlY3V0ZSI6ICJkZXZpY2VfYWRkIiwKICAg ICJpZCI6IDIsCiAgICAiYXJndW1lbnRzIjogewogICAgICAgICJkcml2ZXIiOiAieGVuLXBj aS1wYXNzdGhyb3VnaCIsCiAgICAgICAgImlkIjogInBjaS1wdC0wMV8wMC4xIiwKICAgICAg ICAiaG9zdGFkZHIiOiAiMDAwMDowMTowMC4xIgogICAgfQp9CicKbGlieGw6IGRlYnVnOiBs aWJ4bF9xbXAuYzoyOTk6cW1wX2hhbmRsZV9yZXNwb25zZTogbWVzc2FnZSB0eXBlOiByZXR1 cm4KbGlieGw6IGRlYnVnOiBsaWJ4bF9xbXAuYzo1NTU6cW1wX3NlbmRfcHJlcGFyZTogbmV4 dCBxbXAgY29tbWFuZDogJ3sKICAgICJleGVjdXRlIjogInF1ZXJ5LXBjaSIsCiAgICAiaWQi OiAzCn0KJwpsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjI5OTpxbXBfaGFuZGxlX3Jlc3Bv bnNlOiBtZXNzYWdlIHR5cGU6IHJldHVybgpsaWJ4bDogZGVidWc6IGxpYnhsX3BjaS5jOjgx OmxpYnhsX19jcmVhdGVfcGNpX2JhY2tlbmQ6IENyZWF0aW5nIHBjaSBiYWNrZW5kCmxpYnhs OiBkZWJ1ZzogbGlieGxfZXZlbnQuYzoxNzM3OmxpYnhsX19hb19wcm9ncmVzc19yZXBvcnQ6 IGFvIDB4ZDQwOGIwOiBwcm9ncmVzcyByZXBvcnQ6IGlnbm9yZWQKbGlieGw6IGRlYnVnOiBs aWJ4bF9ldmVudC5jOjE1Njk6bGlieGxfX2FvX2NvbXBsZXRlOiBhbyAweGQ0MDhiMDogY29t cGxldGUsIHJjPTAKbGlieGw6IGRlYnVnOiBsaWJ4bF9ldmVudC5jOjE1NDE6bGlieGxfX2Fv X19kZXN0cm95OiBhbyAweGQ0MDhiMDogZGVzdHJveQpEYWVtb24gcnVubmluZyB3aXRoIFBJ RCAxODU3NAp4YzogZGVidWc6IGh5cGVyY2FsbCBidWZmZXI6IHRvdGFsIGFsbG9jYXRpb25z OjEwNjIgdG90YWwgcmVsZWFzZXM6MTA2Mgp4YzogZGVidWc6IGh5cGVyY2FsbCBidWZmZXI6 IGN1cnJlbnQgYWxsb2NhdGlvbnM6MCBtYXhpbXVtIGFsbG9jYXRpb25zOjQKeGM6IGRlYnVn OiBoeXBlcmNhbGwgYnVmZmVyOiBjYWNoZSBjdXJyZW50IHNpemU6NAp4YzogZGVidWc6IGh5 cGVyY2FsbCBidWZmZXI6IGNhY2hlIGhpdHM6MTA1NCBtaXNzZXM6NCB0b29iaWc6NAo= --------------020709090402000802070905 Content-Type: text/plain; charset=UTF-8; name="xlcreatediff.txt" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="xlcreatediff.txt" K2xpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6NzA3OmxpYnhsX19xbXBfaW5pdGlhbGl6ZTog Y29ubmVjdGVkIHRvIC92YXIvcnVuL3hlbi9xbXAtbGlieGwtMTQKK2xpYnhsOiBkZWJ1Zzog bGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1lc3NhZ2UgdHlwZTogcW1w CitsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjU1NTpxbXBfc2VuZF9wcmVwYXJlOiBuZXh0 IHFtcCBjb21tYW5kOiAneworICAgICJleGVjdXRlIjogInFtcF9jYXBhYmlsaXRpZXMiLAor ICAgICJpZCI6IDEKK30KKycKK2xpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9o YW5kbGVfcmVzcG9uc2U6IG1lc3NhZ2UgdHlwZTogcmV0dXJuCitsaWJ4bDogZGVidWc6IGxp YnhsX3FtcC5jOjU1NTpxbXBfc2VuZF9wcmVwYXJlOiBuZXh0IHFtcCBjb21tYW5kOiAnewor ICAgICJleGVjdXRlIjogImRldmljZV9hZGQiLAorICAgICJpZCI6IDIsCisgICAgImFyZ3Vt ZW50cyI6IHsKKyAgICAgICAgImRyaXZlciI6ICJ4ZW4tcGNpLXBhc3N0aHJvdWdoIiwKKyAg ICAgICAgImlkIjogInBjaS1wdC0wMV8wMC4wIiwKKyAgICAgICAgImhvc3RhZGRyIjogIjAw MDA6MDE6MDAuMCIKKyAgICB9Cit9CisnCitsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjI5 OTpxbXBfaGFuZGxlX3Jlc3BvbnNlOiBtZXNzYWdlIHR5cGU6IHJldHVybgorbGlieGw6IGRl YnVnOiBsaWJ4bF9xbXAuYzo1NTU6cW1wX3NlbmRfcHJlcGFyZTogbmV4dCBxbXAgY29tbWFu ZDogJ3sKKyAgICAiZXhlY3V0ZSI6ICJxdWVyeS1wY2kiLAorICAgICJpZCI6IDMKK30KKycK K2xpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1l c3NhZ2UgdHlwZTogcmV0dXJuCg== --------------020709090402000802070905 Content-Type: text/plain; charset=UTF-8; name="xlcreatevga.txt" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="xlcreatevga.txt" UGFyc2luZyBjb25maWcgZnJvbSB0ZXN0LmNmZwpsaWJ4bDogZGVidWc6IGxpYnhsX2NyZWF0 ZS5jOjEyMzA6ZG9fZG9tYWluX2NyZWF0ZTogYW8gMHgxOWFiOGIwOiBjcmVhdGU6IGhvdz0o bmlsKSBjYWxsYmFjaz0obmlsKSBwb2xsZXI9MHgxOWFiOTEwCmxpYnhsOiBkZWJ1ZzogbGli eGxfY3JlYXRlLmM6Njc1OmluaXRpYXRlX2RvbWFpbl9jcmVhdGU6IHJ1bm5pbmcgYm9vdGxv YWRlcgpsaWJ4bDogZGVidWc6IGxpYnhsX2Jvb3Rsb2FkZXIuYzozMjE6bGlieGxfX2Jvb3Rs b2FkZXJfcnVuOiBub3QgYSBQViBkb21haW4sIHNraXBwaW5nIGJvb3Rsb2FkZXIKbGlieGw6 IGRlYnVnOiBsaWJ4bF9ldmVudC5jOjYwODpsaWJ4bF9fZXZfeHN3YXRjaF9kZXJlZ2lzdGVy OiB3YXRjaCB3PTB4MTlhMTA5ODogZGVyZWdpc3RlciB1bnJlZ2lzdGVyZWQKbGlieGw6IGRl YnVnOiBsaWJ4bF9udW1hLmM6NDc1OmxpYnhsX19nZXRfbnVtYV9jYW5kaWRhdGU6IE5ldyBi ZXN0IE5VTUEgcGxhY2VtZW50IGNhbmRpZGF0ZSBmb3VuZDogbnJfbm9kZXM9MSwgbnJfY3B1 cz04LCBucl92Y3B1cz0xMywgZnJlZV9tZW1rYj0xOTY5OQpsaWJ4bDogZGV0YWlsOiBsaWJ4 bF9kb20uYzoxOTU6bnVtYV9wbGFjZV9kb21haW46IE5VTUEgcGxhY2VtZW50IGNhbmRpZGF0 ZSB3aXRoIDEgbm9kZXMsIDggY3B1cyBhbmQgMTk2OTkgS0IgZnJlZSBzZWxlY3RlZAp4Yzog ZGV0YWlsOiBlbGZfcGFyc2VfYmluYXJ5OiBwaGRyOiBwYWRkcj0weDEwMDAwMCBtZW1zej0w eDllZjY0CnhjOiBkZXRhaWw6IGVsZl9wYXJzZV9iaW5hcnk6IG1lbW9yeTogMHgxMDAwMDAg LT4gMHgxOWVmNjQKeGM6IGluZm86IFZJUlRVQUwgTUVNT1JZIEFSUkFOR0VNRU5UOgogIExv YWRlcjogICAgICAgIDAwMDAwMDAwMDAxMDAwMDAtPjAwMDAwMDAwMDAxOWVmNjQKICBNb2R1 bGVzOiAgICAgICAwMDAwMDAwMDAwMDAwMDAwLT4wMDAwMDAwMDAwMDAwMDAwCiAgVE9UQUw6 ICAgICAgICAgMDAwMDAwMDAwMDAwMDAwMC0+MDAwMDAwMDA3ZjgwMDAwMAogIEVOVFJZIEFE RFJFU1M6IDAwMDAwMDAwMDAxMDA2MDgKeGM6IGluZm86IFBIWVNJQ0FMIE1FTU9SWSBBTExP Q0FUSU9OOgogIDRLQiBQQUdFUzogMHgwMDAwMDAwMDAwMDAwMjAwCiAgMk1CIFBBR0VTOiAw eDAwMDAwMDAwMDAwMDAzZmIKICAxR0IgUEFHRVM6IDB4MDAwMDAwMDAwMDAwMDAwMAp4Yzog ZGV0YWlsOiBlbGZfbG9hZF9iaW5hcnk6IHBoZHIgMCBhdCAweDdmMjM2MWY0MzAwMCAtPiAw eDdmMjM2MWZkOGRlZApsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6MTIwNjpsaWJ4bF9fc3Bh d25fbG9jYWxfZG06IFNwYXduaW5nIGRldmljZS1tb2RlbCAvdXNyL2Jpbi9xZW11LXN5c3Rl bS14ODZfNjQgd2l0aCBhcmd1bWVudHM6CmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4 OmxpYnhsX19zcGF3bl9sb2NhbF9kbTogICAvdXNyL2Jpbi9xZW11LXN5c3RlbS14ODZfNjQK bGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAg IC14ZW4tZG9taWQKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXdu X2xvY2FsX2RtOiAgIDE0CmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19z cGF3bl9sb2NhbF9kbTogICAtY2hhcmRldgpsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6MTIw ODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgc29ja2V0LGlkPWxpYnhsLWNtZCxwYXRoPS92 YXIvcnVuL3hlbi9xbXAtbGlieGwtMTQsc2VydmVyLG5vd2FpdApsaWJ4bDogZGVidWc6IGxp YnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgLW1vbgpsaWJ4bDogZGVi dWc6IGxpYnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgY2hhcmRldj1s aWJ4bC1jbWQsbW9kZT1jb250cm9sCmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4Omxp YnhsX19zcGF3bl9sb2NhbF9kbTogICAtbmFtZQpsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6 MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgdGVzdApsaWJ4bDogZGVidWc6IGxpYnhs X2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgLXZuYwpsaWJ4bDogZGVidWc6 IGxpYnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgMTI3LjAuMC4xOjAs dG89OTkKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2Fs X2RtOiAgIC1nbG9iYWwKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3Nw YXduX2xvY2FsX2RtOiAgIGlzYS1mZGMuZHJpdmVBPQpsaWJ4bDogZGVidWc6IGxpYnhsX2Rt LmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgLXZnYQpsaWJ4bDogZGVidWc6IGxp YnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9jYWxfZG06ICAgY2lycnVzCmxpYnhsOiBk ZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19zcGF3bl9sb2NhbF9kbTogICAtZ2xvYmFs CmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19zcGF3bl9sb2NhbF9kbTog ICB2Z2EudnJhbV9zaXplX21iPTgKbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGli eGxfX3NwYXduX2xvY2FsX2RtOiAgIC1ib290CmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzox MjA4OmxpYnhsX19zcGF3bl9sb2NhbF9kbTogICBvcmRlcj1jZGEKbGlieGw6IGRlYnVnOiBs aWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAgIC1uZXQKbGlieGw6IGRl YnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAgIG5vbmUKbGli eGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXduX2xvY2FsX2RtOiAgIC1N CmxpYnhsOiBkZWJ1ZzogbGlieGxfZG0uYzoxMjA4OmxpYnhsX19zcGF3bl9sb2NhbF9kbTog ICB4ZW5mdgpsaWJ4bDogZGVidWc6IGxpYnhsX2RtLmM6MTIwODpsaWJ4bF9fc3Bhd25fbG9j YWxfZG06ICAgLW0KbGlieGw6IGRlYnVnOiBsaWJ4bF9kbS5jOjEyMDg6bGlieGxfX3NwYXdu X2xvY2FsX2RtOiAgIDIwNDAKbGlieGw6IGRlYnVnOiBsaWJ4bF9ldmVudC5jOjU1OTpsaWJ4 bF9fZXZfeHN3YXRjaF9yZWdpc3Rlcjogd2F0Y2ggdz0weDE5YTEyZDAgd3BhdGg9L2xvY2Fs L2RvbWFpbi8wL2RldmljZS1tb2RlbC8xNC9zdGF0ZSB0b2tlbj0zLzA6IHJlZ2lzdGVyIHNs b3RudW09MwpsaWJ4bDogZGVidWc6IGxpYnhsX2NyZWF0ZS5jOjEyNDM6ZG9fZG9tYWluX2Ny ZWF0ZTogYW8gMHgxOWFiOGIwOiBpbnByb2dyZXNzOiBwb2xsZXI9MHgxOWFiOTEwLCBmbGFn cz1pCmxpYnhsOiBkZWJ1ZzogbGlieGxfZXZlbnQuYzo1MDM6d2F0Y2hmZF9jYWxsYmFjazog d2F0Y2ggdz0weDE5YTEyZDAgd3BhdGg9L2xvY2FsL2RvbWFpbi8wL2RldmljZS1tb2RlbC8x NC9zdGF0ZSB0b2tlbj0zLzA6IGV2ZW50IGVwYXRoPS9sb2NhbC9kb21haW4vMC9kZXZpY2Ut bW9kZWwvMTQvc3RhdGUKbGlieGw6IGRlYnVnOiBsaWJ4bF9ldmVudC5jOjUwMzp3YXRjaGZk X2NhbGxiYWNrOiB3YXRjaCB3PTB4MTlhMTJkMCB3cGF0aD0vbG9jYWwvZG9tYWluLzAvZGV2 aWNlLW1vZGVsLzE0L3N0YXRlIHRva2VuPTMvMDogZXZlbnQgZXBhdGg9L2xvY2FsL2RvbWFp bi8wL2RldmljZS1tb2RlbC8xNC9zdGF0ZQpsaWJ4bDogZGVidWc6IGxpYnhsX2V2ZW50LmM6 NTk2OmxpYnhsX19ldl94c3dhdGNoX2RlcmVnaXN0ZXI6IHdhdGNoIHc9MHgxOWExMmQwIHdw YXRoPS9sb2NhbC9kb21haW4vMC9kZXZpY2UtbW9kZWwvMTQvc3RhdGUgdG9rZW49My8wOiBk ZXJlZ2lzdGVyIHNsb3RudW09MwpsaWJ4bDogZGVidWc6IGxpYnhsX2V2ZW50LmM6NjA4Omxp YnhsX19ldl94c3dhdGNoX2RlcmVnaXN0ZXI6IHdhdGNoIHc9MHgxOWExMmQwOiBkZXJlZ2lz dGVyIHVucmVnaXN0ZXJlZApsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjcwNzpsaWJ4bF9f cW1wX2luaXRpYWxpemU6IGNvbm5lY3RlZCB0byAvdmFyL3J1bi94ZW4vcW1wLWxpYnhsLTE0 CmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1l c3NhZ2UgdHlwZTogcW1wCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6NTU1OnFtcF9zZW5k X3ByZXBhcmU6IG5leHQgcW1wIGNvbW1hbmQ6ICd7CiAgICAiZXhlY3V0ZSI6ICJxbXBfY2Fw YWJpbGl0aWVzIiwKICAgICJpZCI6IDEKfQonCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6 Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1lc3NhZ2UgdHlwZTogcmV0dXJuCmxpYnhsOiBk ZWJ1ZzogbGlieGxfcW1wLmM6NTU1OnFtcF9zZW5kX3ByZXBhcmU6IG5leHQgcW1wIGNvbW1h bmQ6ICd7CiAgICAiZXhlY3V0ZSI6ICJxdWVyeS1jaGFyZGV2IiwKICAgICJpZCI6IDIKfQon CmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1l c3NhZ2UgdHlwZTogcmV0dXJuCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6NTU1OnFtcF9z ZW5kX3ByZXBhcmU6IG5leHQgcW1wIGNvbW1hbmQ6ICd7CiAgICAiZXhlY3V0ZSI6ICJxdWVy eS12bmMiLAogICAgImlkIjogMwp9CicKbGlieGw6IGRlYnVnOiBsaWJ4bF9xbXAuYzoyOTk6 cW1wX2hhbmRsZV9yZXNwb25zZTogbWVzc2FnZSB0eXBlOiByZXR1cm4KbGlieGw6IGRlYnVn OiBsaWJ4bF9xbXAuYzo3MDc6bGlieGxfX3FtcF9pbml0aWFsaXplOiBjb25uZWN0ZWQgdG8g L3Zhci9ydW4veGVuL3FtcC1saWJ4bC0xNApsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjI5 OTpxbXBfaGFuZGxlX3Jlc3BvbnNlOiBtZXNzYWdlIHR5cGU6IHFtcApsaWJ4bDogZGVidWc6 IGxpYnhsX3FtcC5jOjU1NTpxbXBfc2VuZF9wcmVwYXJlOiBuZXh0IHFtcCBjb21tYW5kOiAn ewogICAgImV4ZWN1dGUiOiAicW1wX2NhcGFiaWxpdGllcyIsCiAgICAiaWQiOiAxCn0KJwps aWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjI5OTpxbXBfaGFuZGxlX3Jlc3BvbnNlOiBtZXNz YWdlIHR5cGU6IHJldHVybgpsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjU1NTpxbXBfc2Vu ZF9wcmVwYXJlOiBuZXh0IHFtcCBjb21tYW5kOiAnewogICAgImV4ZWN1dGUiOiAiZGV2aWNl X2FkZCIsCiAgICAiaWQiOiAyLAogICAgImFyZ3VtZW50cyI6IHsKICAgICAgICAiZHJpdmVy IjogInhlbi1wY2ktcGFzc3Rocm91Z2giLAogICAgICAgICJpZCI6ICJwY2ktcHQtMDFfMDAu MSIsCiAgICAgICAgImhvc3RhZGRyIjogIjAwMDA6MDE6MDAuMSIKICAgIH0KfQonCmxpYnhs OiBkZWJ1ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1lc3NhZ2Ug dHlwZTogcmV0dXJuCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6NTU1OnFtcF9zZW5kX3By ZXBhcmU6IG5leHQgcW1wIGNvbW1hbmQ6ICd7CiAgICAiZXhlY3V0ZSI6ICJxdWVyeS1wY2ki LAogICAgImlkIjogMwp9CicKbGlieGw6IGRlYnVnOiBsaWJ4bF9xbXAuYzoyOTk6cW1wX2hh bmRsZV9yZXNwb25zZTogbWVzc2FnZSB0eXBlOiByZXR1cm4KbGlieGw6IGRlYnVnOiBsaWJ4 bF9xbXAuYzo3MDc6bGlieGxfX3FtcF9pbml0aWFsaXplOiBjb25uZWN0ZWQgdG8gL3Zhci9y dW4veGVuL3FtcC1saWJ4bC0xNApsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjI5OTpxbXBf aGFuZGxlX3Jlc3BvbnNlOiBtZXNzYWdlIHR5cGU6IHFtcApsaWJ4bDogZGVidWc6IGxpYnhs X3FtcC5jOjU1NTpxbXBfc2VuZF9wcmVwYXJlOiBuZXh0IHFtcCBjb21tYW5kOiAnewogICAg ImV4ZWN1dGUiOiAicW1wX2NhcGFiaWxpdGllcyIsCiAgICAiaWQiOiAxCn0KJwpsaWJ4bDog ZGVidWc6IGxpYnhsX3FtcC5jOjI5OTpxbXBfaGFuZGxlX3Jlc3BvbnNlOiBtZXNzYWdlIHR5 cGU6IHJldHVybgpsaWJ4bDogZGVidWc6IGxpYnhsX3FtcC5jOjU1NTpxbXBfc2VuZF9wcmVw YXJlOiBuZXh0IHFtcCBjb21tYW5kOiAnewogICAgImV4ZWN1dGUiOiAiZGV2aWNlX2FkZCIs CiAgICAiaWQiOiAyLAogICAgImFyZ3VtZW50cyI6IHsKICAgICAgICAiZHJpdmVyIjogInhl bi1wY2ktcGFzc3Rocm91Z2giLAogICAgICAgICJpZCI6ICJwY2ktcHQtMDFfMDAuMCIsCiAg ICAgICAgImhvc3RhZGRyIjogIjAwMDA6MDE6MDAuMCIKICAgIH0KfQonCmxpYnhsOiBkZWJ1 ZzogbGlieGxfcW1wLmM6Mjk5OnFtcF9oYW5kbGVfcmVzcG9uc2U6IG1lc3NhZ2UgdHlwZTog cmV0dXJuCmxpYnhsOiBkZWJ1ZzogbGlieGxfcW1wLmM6NTU1OnFtcF9zZW5kX3ByZXBhcmU6 IG5leHQgcW1wIGNvbW1hbmQ6ICd7CiAgICAiZXhlY3V0ZSI6ICJxdWVyeS1wY2kiLAogICAg ImlkIjogMwp9CicKbGlieGw6IGRlYnVnOiBsaWJ4bF9xbXAuYzoyOTk6cW1wX2hhbmRsZV9y ZXNwb25zZTogbWVzc2FnZSB0eXBlOiByZXR1cm4KbGlieGw6IGRlYnVnOiBsaWJ4bF9wY2ku Yzo4MTpsaWJ4bF9fY3JlYXRlX3BjaV9iYWNrZW5kOiBDcmVhdGluZyBwY2kgYmFja2VuZAps aWJ4bDogZGVidWc6IGxpYnhsX2V2ZW50LmM6MTczNzpsaWJ4bF9fYW9fcHJvZ3Jlc3NfcmVw b3J0OiBhbyAweDE5YWI4YjA6IHByb2dyZXNzIHJlcG9ydDogaWdub3JlZApsaWJ4bDogZGVi dWc6IGxpYnhsX2V2ZW50LmM6MTU2OTpsaWJ4bF9fYW9fY29tcGxldGU6IGFvIDB4MTlhYjhi MDogY29tcGxldGUsIHJjPTAKbGlieGw6IGRlYnVnOiBsaWJ4bF9ldmVudC5jOjE1NDE6bGli eGxfX2FvX19kZXN0cm95OiBhbyAweDE5YWI4YjA6IGRlc3Ryb3kKRGFlbW9uIHJ1bm5pbmcg d2l0aCBQSUQgMTg2NTEKeGM6IGRlYnVnOiBoeXBlcmNhbGwgYnVmZmVyOiB0b3RhbCBhbGxv Y2F0aW9uczoxMDY4IHRvdGFsIHJlbGVhc2VzOjEwNjgKeGM6IGRlYnVnOiBoeXBlcmNhbGwg YnVmZmVyOiBjdXJyZW50IGFsbG9jYXRpb25zOjAgbWF4aW11bSBhbGxvY2F0aW9uczo0Cnhj OiBkZWJ1ZzogaHlwZXJjYWxsIGJ1ZmZlcjogY2FjaGUgY3VycmVudCBzaXplOjQKeGM6IGRl YnVnOiBoeXBlcmNhbGwgYnVmZmVyOiBjYWNoZSBoaXRzOjEwNjAgbWlzc2VzOjQgdG9vYmln OjQK --------------020709090402000802070905 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --------------020709090402000802070905-- From xen-users-bounces@lists.xen.org Sun Dec 08 17:58:04 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 08 Dec 2013 17:58:04 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpibm-000250-8u; Sun, 08 Dec 2013 17:57:34 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpibj-00024v-SL for xen-users@lists.xen.org; Sun, 08 Dec 2013 17:57:32 +0000 Received: from [85.158.139.211:15615] by server-1.bemta-5.messagelabs.com id 12/11-21065-B03B4A25; Sun, 08 Dec 2013 17:57:31 +0000 X-Env-Sender: cdelorme@gmail.com X-Msg-Ref: server-12.tower-206.messagelabs.com!1386525448!3068551!1 X-Originating-IP: [209.85.220.178] X-SpamReason: No, hits=0.4 required=7.0 tests=HTML_30_40,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 7001 invoked from network); 8 Dec 2013 17:57:29 -0000 Received: from mail-vc0-f178.google.com (HELO mail-vc0-f178.google.com) (209.85.220.178) by server-12.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 8 Dec 2013 17:57:29 -0000 Received: by mail-vc0-f178.google.com with SMTP id lh4so2680468vcb.37 for ; Sun, 08 Dec 2013 09:57:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=nRUHSRESryspkIegfQYPCpRZ+CJMbOG6RR9og/w/Y24=; b=aydYqSTQ9AlR91LmGEYCSJe5NLd6fF0vxt6Ms2CF9hdwAkMpeb/VRjsdvbd3T7Hm/7 m6bzxNBAp2bq3UGLRSry1b4zsVsoW78QUR3xgdRBm0V8w/yyKWBxnYIYdw2hheeftjGH 8ADgPPpSy5FF/1TRDOb5tTuU+v4RNhedrrNWVdMeSxnmf/hy9fzLzZ3rLzA8NeXyObbZ 9p33L2xm6PPDG6QhGMGVOdfTVURKFfNShstxIioHl7AkJrQUOcdRingLO7+GCejyJ/4L mTqJQv7FdVNtTUBfXqzRmk7mccajPsm3RKlqFzesOe9aJm0Qghams7XTWA5UpJaBEfLf Rm2w== MIME-Version: 1.0 X-Received: by 10.53.13.44 with SMTP id ev12mr7498569vdd.17.1386525447879; Sun, 08 Dec 2013 09:57:27 -0800 (PST) Received: by 10.58.155.106 with HTTP; Sun, 8 Dec 2013 09:57:27 -0800 (PST) In-Reply-To: <52A4AB45.8080507@unitedklasens.de> References: <52A46D13.4050806@unitedklasens.de> <52A4AB45.8080507@unitedklasens.de> Date: Sun, 8 Dec 2013 12:57:27 -0500 Message-ID: From: Casey DeLorme To: Volker Klasen Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] VGA Passthrough with Xen 4.3 and Qemu 1.7 on Debian Jessie X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============8088182383590347391==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============8088182383590347391== Content-Type: multipart/alternative; boundary=001a1135f180cb02a104ed099c1d --001a1135f180cb02a104ed099c1d Content-Type: text/plain; charset=UTF-8 On Sun, Dec 8, 2013 at 12:24 PM, Volker Klasen wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hi Casey, > > > Can you supply more information about the system. There are many > > possibilities, so it'll be hard to narrow it down with only what > > you have provided. > > I'll do: > > > - What does the domu.cfg look like (complete copy) > > I just did a new test without any disks so we can discard the guest OS > as the cause. With my graphics card (0000:01:00.0) passed through the > BIOS is not displayed; without (0000:01:00.1 is the HDMI device of the > graphics card) it is and says that it cannot find anything to boot. > Here's the complete config for those tests: > > You should have a disk > name = 'test' > builder = 'hvm' > device_model_version = 'qemu-xen' > device_model_override = '/usr/bin/qemu-system-x86_64' > memory = 2048 > # working > #pci = ['0000:01:00.1'] > # not working > pci = ['0000:01:00.1','0000:01:00.0'] > > The default qemu in 4.3 should be upstream, but a lot of people have had better luck with traditional for higher memory (myself included). Is there a reason you are overriding the qemu device model? AFAIK this is not a needed step, it should be able to get that by default. > And here's the output from xl pci-assignable-list: > > 0000:00:1d.0 > 0000:01:00.0 > 0000:01:00.1 > 0000:04:04.0 > > So your kernel/grub is binding them to pciback. That works for me. > > - Can you supply your kernel config > > see attachments (current Jessie kernel), pciback is a module and binds > the devices at initramfs time via /etc/modprobe.d/: > > options xen-pciback > hide=(0000:00:1d.0)(0000:01:00.0)(0000:01:00.1)(0000:04:04.0) > install ehci_hcd /sbin/modprobe xen-pciback; /sbin/modprobe > - --first-time --ignore-install ehci_hcd > install radeon /sbin/modprobe xen-pciback; /sbin/modprobe --first-time > - --ignore-install radeon > install snd_hda_intel /sbin/modprobe xen-pciback; /sbin/modprobe > - --first-time --ignore-install snd_hda_intel > install snd_virtuoso /sbin/modprobe xen-pciback; /sbin/modprobe > - --first-time --ignore-install snd_virtuoso > > > - Any notable hardware (eg. motherboard?) > > MSI Z77A-GD65, i7 3770 (non-k), Sapphire Radeon HD 7870 GHz Edition > > The hardware worked 18 month with VGA passthrough, so I would exclude > it as cause, as well. > > I wouldn't entirely rule it out, were you using 4.1 on Jessie, or a previous debian? The way hardware is addressed by the kernel may have changed, so knowing the model might help. > > - run `xl -vvv create` and attach the output > > I attached the output from both test runs (with and w/o vga > passthrough) and the cleaned diff (there were different memory > addresses and domain ids) > > > I have been using Xen 4.3 and 4.4 on Wheezy for some time now, but > > I have not yet tried with Jessie. Off the top of my head, three > > possibilities stand out. Could be a syntax error in your domu.cfg > > (review the latest man pages: > > http://xenbits.xen.org/docs/4.3-testing/man/xl.cfg.5.html). I > > still build pciback into my kernels as I have never had good luck > > with late device binding even with though the xl toolstack should > > do so; is pciback compiled into the kernel and your devices hidden > > by grub, or are you relying on late binding? There have been > > problems with larger amounts of memory. Have you tried dropping to > > 1~2 GB of ram in your config (yes I am aware that it is a very > > small amount for Windows to run well on, maybe try it just to > > confirm possible causes)? > > I dropped the allocated RAM to 2GB, but no difference. > > > Send us more info. > > Hopefully, the info I now provided is more helpful. > > Cheers, > Volker > > I don't see anything that stands out. Your devices are bound to pciback, though the kernel config shows the backend drivers are as modules. The xl output doesn't appear to explain the problem either. Have you tried traditional without the override? > > > On Sun, Dec 8, 2013 at 7:58 AM, Volker Klasen > > wrote: > > > > Hello, > > > > the short version: I can't get VGA passthrough working with Xen > > 4.3 and Qemu 1.7. The VM won't even display a bios screen. > > > > The long version: after successfully running Windows 7 64bit with > > a passthrough'd Radeon HD 7870 about 1.5 years with Xen 4.1 > > (xm/qemu-dm), I decided it was time to upgrade to Jessie's current > > Xen packages (4.3). > > > > Unexpectedly, I came across several issues related to switching > > from xm to xl and from qemu-dm to qemu, as well as non-functional > > VGA passthrough. I found 2 setups that at least would start the > > VM: > > > > 1) Using qemu-dm from Wheezy packages xen-utils-4.1 In this setup I > > can pass through all 4 PCI devices (USB controller, VGA card, HDMI > > audio and audio card), however, none is working. For the audio card > > error 10 is reported, for the graphics card error 43. > > > > 2) Using qemu In this setup PCI passthrough works as long as I do > > not passthrough my VGA card (the other three are working without > > problems). As soon as I passthrough the graphics card, the VM won't > > even startup at all (vnc is running but no bios is displayed, only > > black screen); the logs are empty, as well (the only line is > > "Waiting for domain ..." in /var/log/xen/xl-domain.log). > > > > I tried setting and unsetting the pci_* options in the domain > > config file but I had no luck. Here's my current config (left some > > unrelated things out) set up for 2) with VGA passthrough > > (01:00.0): > > > > # qemu device_model_version="qemu-xen" device_model_override = > > '/usr/bin/qemu-system-x86_64' # qemu-dm > > #device_model_version="qemu-xen-traditional" #device_model_override > > = '/usr/lib/xen-4.1/bin/qemu-dm' > > > > builder = 'hvm' viridian = 1 vga = 'stdvga' pci_msitranslate = 0 > > > > #pci = ['0000:00:1d.0','0000:01:00.1','0000:04:04.0'] pci = > > ['0000:00:1d.0','0000:01:00.0','0000:01:00.1','0000:04:04.0'] > > > > > > Has anyone an idea what I could try? > > > > Thanks, Volker > >> > >> _______________________________________________ Xen-users mailing > >> list Xen-users@lists.xen.org http://lists.xen.org/xen-users > >> > > > > > > > > _______________________________________________ Xen-users mailing > > list Xen-users@lists.xen.org http://lists.xen.org/xen-users > > > > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.15 (GNU/Linux) > Comment: Using GnuPG with Icedove - http://www.enigmail.net/ > > iEYEARECAAYFAlKkq0UACgkQgKD4KXUzSri9xwCgkDbPIZ3j5Ks1gxOllEmNM2p8 > 5JAAoIekcrJvY/O5j2OmgWI0jNtqPX2T > =1A0F > -----END PGP SIGNATURE----- > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > --001a1135f180cb02a104ed099c1d Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
On S= un, Dec 8, 2013 at 12:24 PM, Volker Klasen <reklov@unitedklasens.de<= /a>> wrote:
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Casey,

> Can you supply more information about the system. =C2=A0There are many=
> possibilities, so it'll be hard to narrow it down with only what > you have provided.

I'll do:

> - What does the domu.cfg look like (complete copy)

I just did a new test without any disks so we can discard the guest O= S
as the cause. With my graphics card (0000:01:00.0) passed through the
BIOS is not displayed; without (0000:01:00.1 is the HDMI device of the
graphics card) it is and says that it cannot find anything to boot.
Here's the complete config for those tests:


You should have a disk
=C2= =A0
name =3D 'test'
builder =3D 'hvm'
device_model_version =3D 'qemu-xen'
device_model_override =3D '/usr/bin/qemu-system-x86_64'
memory =3D 2048
# working
#pci =3D ['0000:01:00.1']
# not working
pci =3D ['0000:01:00.1','0000:01:00.0']

The default qemu in 4.3 should be upstream, but a lot= of people have had better luck with traditional for higher memory (myself = included).

Is there a reason you are overridin= g the qemu device model? =C2=A0AFAIK this is not a needed step, it should b= e able to get that by default.

=C2=A0
And here's the output from xl pci-assignable-list:

0000:00:1d.0
0000:01:00.0
0000:01:00.1
0000:04:04.0

So your kernel/grub is bindin= g them to pciback. =C2=A0That works for me.
=C2=A0
> - Can you supply your kernel config

see attachments (current Jessie kernel), pciback is a module and bind= s
the devices at initramfs time via /etc/modprobe.d/:

options xen-pciback
hide=3D(0000:00:1d.0)(0000:01:00.0)(0000:01:00.1)(0000:04:04.0)
install ehci_hcd /sbin/modprobe xen-pciback; /sbin/modprobe
- --first-time --ignore-install ehci_hcd
install radeon /sbin/modprobe xen-pciback; /sbin/modprobe --first-time
- --ignore-install radeon
install snd_hda_intel /sbin/modprobe xen-pciback; /sbin/modprobe
- --first-time --ignore-install snd_hda_intel
install snd_virtuoso /sbin/modprobe xen-pciback; /sbin/modprobe
- --first-time --ignore-install snd_virtuoso

> - Any notable hardware (eg. motherboard?)

MSI Z77A-GD65, i7 3770 (non-k), Sapphire Radeon HD 7870 GHz Edition
The hardware worked 18 month with VGA passthrough, so I would exclude
it as cause, as well.

I wouldn't entirely rule = it out, were you using 4.1 on Jessie, or a previous debian? =C2=A0The way h= ardware is addressed by the kernel may have changed, so knowing the model m= ight help.
=C2=A0
> - run `xl -vvv create` and attach the output

I attached the output from both test runs (with and w/o vga
passthrough) and the cleaned diff (there were different memory
addresses and domain ids)

> I have been using Xen 4.3 and 4.4 on Wheezy for some time now, but
> I have not yet tried with Jessie. =C2=A0Off the top of my head, three<= br> > possibilities stand out. =C2=A0Could be a syntax error in your domu.cf= g
> (review the latest man pages:
> http://xenbits.xen.org/docs/4.3-testing/man/xl.cfg.5.html= ). =C2=A0I
> still build pciback into my kernels as I have never had good luck
> with late device binding even with though the xl toolstack should
> do so; is pciback compiled into the kernel and your devices hidden
> by grub, or are you relying on late binding? =C2=A0There have been
> problems with larger amounts of memory. =C2=A0Have you tried dropping = to
> 1~2 GB of ram in your config (yes I am aware that it is a very
> small amount for Windows to run well on, maybe try it just to
> confirm possible causes)?

I dropped the allocated RAM to 2GB, but no difference.

> Send us more info.

Hopefully, the info I now provided is more helpful.

Cheers,
Volker


I don't se= e anything that stands out. =C2=A0Your devices are bound to pciback, though= the kernel config shows the backend drivers are as modules. =C2=A0The xl o= utput doesn't appear to explain the problem either. =C2=A0Have you trie= d traditional without the override?



> On Sun, Dec 8, 2013 at 7:58 AM, Volker Klasen
> <reklov@unitedklasens.de= >wrote:
>
> Hello,
>
> the short version: I can't get VGA passthrough working with Xen > 4.3 and Qemu 1.7. The VM won't even display a bios screen.
>
> The long version: after successfully running Windows 7 64bit with
> a passthrough'd Radeon HD 7870 about 1.5 years with Xen 4.1
> (xm/qemu-dm), I decided it was time to upgrade to Jessie's current=
> Xen packages (4.3).
>
> Unexpectedly, I came across several issues related to switching
> from xm to xl and from qemu-dm to qemu, as well as non-functional
> VGA passthrough. I found 2 setups that at least would start the
> VM:
>
> 1) Using qemu-dm from Wheezy packages xen-utils-4.1 In this setup I > can pass through all 4 PCI devices (USB controller, VGA card, HDMI
> audio and audio card), however, none is working. For the audio card > error 10 is reported, for the graphics card error 43.
>
> 2) Using qemu In this setup PCI passthrough works as long as I do
> not passthrough my VGA card (the other three are working without
> problems). As soon as I passthrough the graphics card, the VM won'= t
> even startup at all (vnc is running but no bios is displayed, only
> black screen); the logs are empty, as well (the only line is
> "Waiting for domain ..." in /var/log/xen/xl-domain.log).
>
> I tried setting and unsetting the pci_* options in the domain
> config file but I had no luck. Here's my current config (left some=
> unrelated things out) set up for 2) with VGA passthrough
> (01:00.0):
>
> # qemu device_model_version=3D"qemu-xen" device_model_overri= de =3D
> '/usr/bin/qemu-system-x86_64' # qemu-dm
> #device_model_version=3D"qemu-xen-traditional" #device_model= _override
> =3D '/usr/lib/xen-4.1/bin/qemu-dm'
>
> builder =3D 'hvm' viridian =3D 1 vga =3D 'stdvga' pci_= msitranslate =3D 0
>
> #pci =3D ['0000:00:1d.0','0000:01:00.1','0000:04:0= 4.0'] pci =3D
> ['0000:00:1d.0','0000:01:00.0','0000:01:00.1',= '0000:04:04.0']
>
>
> Has anyone an idea what I could try?
>
> Thanks, Volker
>>
>> ____________________________________= ___________ Xen-users mailing
>> list Xen-users@lists.xe= n.org http= ://lists.xen.org/xen-users
>>
>
>
>
> _______________________________________________ Xen-users mailing
> list Xen-users@lists.xen.or= g http://l= ists.xen.org/xen-users
>

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.15 (GNU/Linux)
Comment: Using GnuPG with Icedove - http://www.enigmail.net/

iEYEARECAAYFAlKkq0UACgkQgKD4KXUzSri9xwCgkDbPIZ3j5Ks1gxOllEmNM2p8
5JAAoIekcrJvY/O5j2OmgWI0jNtqPX2T
=3D1A0F
-----END PGP SIGNATURE-----

_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.x= en.org/xen-users

--001a1135f180cb02a104ed099c1d-- --===============8088182383590347391== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============8088182383590347391==-- From xen-users-bounces@lists.xen.org Sun Dec 08 17:58:04 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 08 Dec 2013 17:58:04 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpibm-000250-8u; Sun, 08 Dec 2013 17:57:34 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpibj-00024v-SL for xen-users@lists.xen.org; Sun, 08 Dec 2013 17:57:32 +0000 Received: from [85.158.139.211:15615] by server-1.bemta-5.messagelabs.com id 12/11-21065-B03B4A25; Sun, 08 Dec 2013 17:57:31 +0000 X-Env-Sender: cdelorme@gmail.com X-Msg-Ref: server-12.tower-206.messagelabs.com!1386525448!3068551!1 X-Originating-IP: [209.85.220.178] X-SpamReason: No, hits=0.4 required=7.0 tests=HTML_30_40,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 7001 invoked from network); 8 Dec 2013 17:57:29 -0000 Received: from mail-vc0-f178.google.com (HELO mail-vc0-f178.google.com) (209.85.220.178) by server-12.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 8 Dec 2013 17:57:29 -0000 Received: by mail-vc0-f178.google.com with SMTP id lh4so2680468vcb.37 for ; Sun, 08 Dec 2013 09:57:27 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=nRUHSRESryspkIegfQYPCpRZ+CJMbOG6RR9og/w/Y24=; b=aydYqSTQ9AlR91LmGEYCSJe5NLd6fF0vxt6Ms2CF9hdwAkMpeb/VRjsdvbd3T7Hm/7 m6bzxNBAp2bq3UGLRSry1b4zsVsoW78QUR3xgdRBm0V8w/yyKWBxnYIYdw2hheeftjGH 8ADgPPpSy5FF/1TRDOb5tTuU+v4RNhedrrNWVdMeSxnmf/hy9fzLzZ3rLzA8NeXyObbZ 9p33L2xm6PPDG6QhGMGVOdfTVURKFfNShstxIioHl7AkJrQUOcdRingLO7+GCejyJ/4L mTqJQv7FdVNtTUBfXqzRmk7mccajPsm3RKlqFzesOe9aJm0Qghams7XTWA5UpJaBEfLf Rm2w== MIME-Version: 1.0 X-Received: by 10.53.13.44 with SMTP id ev12mr7498569vdd.17.1386525447879; Sun, 08 Dec 2013 09:57:27 -0800 (PST) Received: by 10.58.155.106 with HTTP; Sun, 8 Dec 2013 09:57:27 -0800 (PST) In-Reply-To: <52A4AB45.8080507@unitedklasens.de> References: <52A46D13.4050806@unitedklasens.de> <52A4AB45.8080507@unitedklasens.de> Date: Sun, 8 Dec 2013 12:57:27 -0500 Message-ID: From: Casey DeLorme To: Volker Klasen Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] VGA Passthrough with Xen 4.3 and Qemu 1.7 on Debian Jessie X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============8088182383590347391==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============8088182383590347391== Content-Type: multipart/alternative; boundary=001a1135f180cb02a104ed099c1d --001a1135f180cb02a104ed099c1d Content-Type: text/plain; charset=UTF-8 On Sun, Dec 8, 2013 at 12:24 PM, Volker Klasen wrote: > -----BEGIN PGP SIGNED MESSAGE----- > Hash: SHA1 > > Hi Casey, > > > Can you supply more information about the system. There are many > > possibilities, so it'll be hard to narrow it down with only what > > you have provided. > > I'll do: > > > - What does the domu.cfg look like (complete copy) > > I just did a new test without any disks so we can discard the guest OS > as the cause. With my graphics card (0000:01:00.0) passed through the > BIOS is not displayed; without (0000:01:00.1 is the HDMI device of the > graphics card) it is and says that it cannot find anything to boot. > Here's the complete config for those tests: > > You should have a disk > name = 'test' > builder = 'hvm' > device_model_version = 'qemu-xen' > device_model_override = '/usr/bin/qemu-system-x86_64' > memory = 2048 > # working > #pci = ['0000:01:00.1'] > # not working > pci = ['0000:01:00.1','0000:01:00.0'] > > The default qemu in 4.3 should be upstream, but a lot of people have had better luck with traditional for higher memory (myself included). Is there a reason you are overriding the qemu device model? AFAIK this is not a needed step, it should be able to get that by default. > And here's the output from xl pci-assignable-list: > > 0000:00:1d.0 > 0000:01:00.0 > 0000:01:00.1 > 0000:04:04.0 > > So your kernel/grub is binding them to pciback. That works for me. > > - Can you supply your kernel config > > see attachments (current Jessie kernel), pciback is a module and binds > the devices at initramfs time via /etc/modprobe.d/: > > options xen-pciback > hide=(0000:00:1d.0)(0000:01:00.0)(0000:01:00.1)(0000:04:04.0) > install ehci_hcd /sbin/modprobe xen-pciback; /sbin/modprobe > - --first-time --ignore-install ehci_hcd > install radeon /sbin/modprobe xen-pciback; /sbin/modprobe --first-time > - --ignore-install radeon > install snd_hda_intel /sbin/modprobe xen-pciback; /sbin/modprobe > - --first-time --ignore-install snd_hda_intel > install snd_virtuoso /sbin/modprobe xen-pciback; /sbin/modprobe > - --first-time --ignore-install snd_virtuoso > > > - Any notable hardware (eg. motherboard?) > > MSI Z77A-GD65, i7 3770 (non-k), Sapphire Radeon HD 7870 GHz Edition > > The hardware worked 18 month with VGA passthrough, so I would exclude > it as cause, as well. > > I wouldn't entirely rule it out, were you using 4.1 on Jessie, or a previous debian? The way hardware is addressed by the kernel may have changed, so knowing the model might help. > > - run `xl -vvv create` and attach the output > > I attached the output from both test runs (with and w/o vga > passthrough) and the cleaned diff (there were different memory > addresses and domain ids) > > > I have been using Xen 4.3 and 4.4 on Wheezy for some time now, but > > I have not yet tried with Jessie. Off the top of my head, three > > possibilities stand out. Could be a syntax error in your domu.cfg > > (review the latest man pages: > > http://xenbits.xen.org/docs/4.3-testing/man/xl.cfg.5.html). I > > still build pciback into my kernels as I have never had good luck > > with late device binding even with though the xl toolstack should > > do so; is pciback compiled into the kernel and your devices hidden > > by grub, or are you relying on late binding? There have been > > problems with larger amounts of memory. Have you tried dropping to > > 1~2 GB of ram in your config (yes I am aware that it is a very > > small amount for Windows to run well on, maybe try it just to > > confirm possible causes)? > > I dropped the allocated RAM to 2GB, but no difference. > > > Send us more info. > > Hopefully, the info I now provided is more helpful. > > Cheers, > Volker > > I don't see anything that stands out. Your devices are bound to pciback, though the kernel config shows the backend drivers are as modules. The xl output doesn't appear to explain the problem either. Have you tried traditional without the override? > > > On Sun, Dec 8, 2013 at 7:58 AM, Volker Klasen > > wrote: > > > > Hello, > > > > the short version: I can't get VGA passthrough working with Xen > > 4.3 and Qemu 1.7. The VM won't even display a bios screen. > > > > The long version: after successfully running Windows 7 64bit with > > a passthrough'd Radeon HD 7870 about 1.5 years with Xen 4.1 > > (xm/qemu-dm), I decided it was time to upgrade to Jessie's current > > Xen packages (4.3). > > > > Unexpectedly, I came across several issues related to switching > > from xm to xl and from qemu-dm to qemu, as well as non-functional > > VGA passthrough. I found 2 setups that at least would start the > > VM: > > > > 1) Using qemu-dm from Wheezy packages xen-utils-4.1 In this setup I > > can pass through all 4 PCI devices (USB controller, VGA card, HDMI > > audio and audio card), however, none is working. For the audio card > > error 10 is reported, for the graphics card error 43. > > > > 2) Using qemu In this setup PCI passthrough works as long as I do > > not passthrough my VGA card (the other three are working without > > problems). As soon as I passthrough the graphics card, the VM won't > > even startup at all (vnc is running but no bios is displayed, only > > black screen); the logs are empty, as well (the only line is > > "Waiting for domain ..." in /var/log/xen/xl-domain.log). > > > > I tried setting and unsetting the pci_* options in the domain > > config file but I had no luck. Here's my current config (left some > > unrelated things out) set up for 2) with VGA passthrough > > (01:00.0): > > > > # qemu device_model_version="qemu-xen" device_model_override = > > '/usr/bin/qemu-system-x86_64' # qemu-dm > > #device_model_version="qemu-xen-traditional" #device_model_override > > = '/usr/lib/xen-4.1/bin/qemu-dm' > > > > builder = 'hvm' viridian = 1 vga = 'stdvga' pci_msitranslate = 0 > > > > #pci = ['0000:00:1d.0','0000:01:00.1','0000:04:04.0'] pci = > > ['0000:00:1d.0','0000:01:00.0','0000:01:00.1','0000:04:04.0'] > > > > > > Has anyone an idea what I could try? > > > > Thanks, Volker > >> > >> _______________________________________________ Xen-users mailing > >> list Xen-users@lists.xen.org http://lists.xen.org/xen-users > >> > > > > > > > > _______________________________________________ Xen-users mailing > > list Xen-users@lists.xen.org http://lists.xen.org/xen-users > > > > -----BEGIN PGP SIGNATURE----- > Version: GnuPG v1.4.15 (GNU/Linux) > Comment: Using GnuPG with Icedove - http://www.enigmail.net/ > > iEYEARECAAYFAlKkq0UACgkQgKD4KXUzSri9xwCgkDbPIZ3j5Ks1gxOllEmNM2p8 > 5JAAoIekcrJvY/O5j2OmgWI0jNtqPX2T > =1A0F > -----END PGP SIGNATURE----- > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > --001a1135f180cb02a104ed099c1d Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable
On S= un, Dec 8, 2013 at 12:24 PM, Volker Klasen <reklov@unitedklasens.de<= /a>> wrote:
-----BEGIN PGP SIGNED MESSAGE-----
Hash: SHA1

Hi Casey,

> Can you supply more information about the system. =C2=A0There are many=
> possibilities, so it'll be hard to narrow it down with only what > you have provided.

I'll do:

> - What does the domu.cfg look like (complete copy)

I just did a new test without any disks so we can discard the guest O= S
as the cause. With my graphics card (0000:01:00.0) passed through the
BIOS is not displayed; without (0000:01:00.1 is the HDMI device of the
graphics card) it is and says that it cannot find anything to boot.
Here's the complete config for those tests:


You should have a disk
=C2= =A0
name =3D 'test'
builder =3D 'hvm'
device_model_version =3D 'qemu-xen'
device_model_override =3D '/usr/bin/qemu-system-x86_64'
memory =3D 2048
# working
#pci =3D ['0000:01:00.1']
# not working
pci =3D ['0000:01:00.1','0000:01:00.0']

The default qemu in 4.3 should be upstream, but a lot= of people have had better luck with traditional for higher memory (myself = included).

Is there a reason you are overridin= g the qemu device model? =C2=A0AFAIK this is not a needed step, it should b= e able to get that by default.

=C2=A0
And here's the output from xl pci-assignable-list:

0000:00:1d.0
0000:01:00.0
0000:01:00.1
0000:04:04.0

So your kernel/grub is bindin= g them to pciback. =C2=A0That works for me.
=C2=A0
> - Can you supply your kernel config

see attachments (current Jessie kernel), pciback is a module and bind= s
the devices at initramfs time via /etc/modprobe.d/:

options xen-pciback
hide=3D(0000:00:1d.0)(0000:01:00.0)(0000:01:00.1)(0000:04:04.0)
install ehci_hcd /sbin/modprobe xen-pciback; /sbin/modprobe
- --first-time --ignore-install ehci_hcd
install radeon /sbin/modprobe xen-pciback; /sbin/modprobe --first-time
- --ignore-install radeon
install snd_hda_intel /sbin/modprobe xen-pciback; /sbin/modprobe
- --first-time --ignore-install snd_hda_intel
install snd_virtuoso /sbin/modprobe xen-pciback; /sbin/modprobe
- --first-time --ignore-install snd_virtuoso

> - Any notable hardware (eg. motherboard?)

MSI Z77A-GD65, i7 3770 (non-k), Sapphire Radeon HD 7870 GHz Edition
The hardware worked 18 month with VGA passthrough, so I would exclude
it as cause, as well.

I wouldn't entirely rule = it out, were you using 4.1 on Jessie, or a previous debian? =C2=A0The way h= ardware is addressed by the kernel may have changed, so knowing the model m= ight help.
=C2=A0
> - run `xl -vvv create` and attach the output

I attached the output from both test runs (with and w/o vga
passthrough) and the cleaned diff (there were different memory
addresses and domain ids)

> I have been using Xen 4.3 and 4.4 on Wheezy for some time now, but
> I have not yet tried with Jessie. =C2=A0Off the top of my head, three<= br> > possibilities stand out. =C2=A0Could be a syntax error in your domu.cf= g
> (review the latest man pages:
> http://xenbits.xen.org/docs/4.3-testing/man/xl.cfg.5.html= ). =C2=A0I
> still build pciback into my kernels as I have never had good luck
> with late device binding even with though the xl toolstack should
> do so; is pciback compiled into the kernel and your devices hidden
> by grub, or are you relying on late binding? =C2=A0There have been
> problems with larger amounts of memory. =C2=A0Have you tried dropping = to
> 1~2 GB of ram in your config (yes I am aware that it is a very
> small amount for Windows to run well on, maybe try it just to
> confirm possible causes)?

I dropped the allocated RAM to 2GB, but no difference.

> Send us more info.

Hopefully, the info I now provided is more helpful.

Cheers,
Volker


I don't se= e anything that stands out. =C2=A0Your devices are bound to pciback, though= the kernel config shows the backend drivers are as modules. =C2=A0The xl o= utput doesn't appear to explain the problem either. =C2=A0Have you trie= d traditional without the override?



> On Sun, Dec 8, 2013 at 7:58 AM, Volker Klasen
> <reklov@unitedklasens.de= >wrote:
>
> Hello,
>
> the short version: I can't get VGA passthrough working with Xen > 4.3 and Qemu 1.7. The VM won't even display a bios screen.
>
> The long version: after successfully running Windows 7 64bit with
> a passthrough'd Radeon HD 7870 about 1.5 years with Xen 4.1
> (xm/qemu-dm), I decided it was time to upgrade to Jessie's current=
> Xen packages (4.3).
>
> Unexpectedly, I came across several issues related to switching
> from xm to xl and from qemu-dm to qemu, as well as non-functional
> VGA passthrough. I found 2 setups that at least would start the
> VM:
>
> 1) Using qemu-dm from Wheezy packages xen-utils-4.1 In this setup I > can pass through all 4 PCI devices (USB controller, VGA card, HDMI
> audio and audio card), however, none is working. For the audio card > error 10 is reported, for the graphics card error 43.
>
> 2) Using qemu In this setup PCI passthrough works as long as I do
> not passthrough my VGA card (the other three are working without
> problems). As soon as I passthrough the graphics card, the VM won'= t
> even startup at all (vnc is running but no bios is displayed, only
> black screen); the logs are empty, as well (the only line is
> "Waiting for domain ..." in /var/log/xen/xl-domain.log).
>
> I tried setting and unsetting the pci_* options in the domain
> config file but I had no luck. Here's my current config (left some=
> unrelated things out) set up for 2) with VGA passthrough
> (01:00.0):
>
> # qemu device_model_version=3D"qemu-xen" device_model_overri= de =3D
> '/usr/bin/qemu-system-x86_64' # qemu-dm
> #device_model_version=3D"qemu-xen-traditional" #device_model= _override
> =3D '/usr/lib/xen-4.1/bin/qemu-dm'
>
> builder =3D 'hvm' viridian =3D 1 vga =3D 'stdvga' pci_= msitranslate =3D 0
>
> #pci =3D ['0000:00:1d.0','0000:01:00.1','0000:04:0= 4.0'] pci =3D
> ['0000:00:1d.0','0000:01:00.0','0000:01:00.1',= '0000:04:04.0']
>
>
> Has anyone an idea what I could try?
>
> Thanks, Volker
>>
>> ____________________________________= ___________ Xen-users mailing
>> list Xen-users@lists.xe= n.org http= ://lists.xen.org/xen-users
>>
>
>
>
> _______________________________________________ Xen-users mailing
> list Xen-users@lists.xen.or= g http://l= ists.xen.org/xen-users
>

-----BEGIN PGP SIGNATURE-----
Version: GnuPG v1.4.15 (GNU/Linux)
Comment: Using GnuPG with Icedove - http://www.enigmail.net/

iEYEARECAAYFAlKkq0UACgkQgKD4KXUzSri9xwCgkDbPIZ3j5Ks1gxOllEmNM2p8
5JAAoIekcrJvY/O5j2OmgWI0jNtqPX2T
=3D1A0F
-----END PGP SIGNATURE-----

_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.x= en.org/xen-users

--001a1135f180cb02a104ed099c1d-- --===============8088182383590347391== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============8088182383590347391==-- From xen-users-bounces@lists.xen.org Sun Dec 08 18:32:55 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 08 Dec 2013 18:32:55 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpj96-0003ek-Um; Sun, 08 Dec 2013 18:32:00 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpj94-0003ef-R1 for xen-users@lists.xen.org; Sun, 08 Dec 2013 18:31:59 +0000 Received: from [193.109.254.147:2345] by server-10.bemta-14.messagelabs.com id E2/1C-20752-E1BB4A25; Sun, 08 Dec 2013 18:31:58 +0000 X-Env-Sender: reklov@unitedklasens.de X-Msg-Ref: server-10.tower-27.messagelabs.com!1386527517!3749242!1 X-Originating-IP: [37.17.224.201] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 27086 invoked from network); 8 Dec 2013 18:31:57 -0000 Received: from mail.webgo24-server13.de (HELO mail.webgo24-server13.de) (37.17.224.201) by server-10.tower-27.messagelabs.com with SMTP; 8 Dec 2013 18:31:57 -0000 Received: from [192.168.42.13] (HSI-KBW-46-223-75-55.hsi.kabel-badenwuerttemberg.de [46.223.75.55]) by mail.webgo24-server13.de (Postfix) with ESMTPSA id 0E15B3041B79 for ; Sun, 8 Dec 2013 19:31:56 +0100 (CET) Message-ID: <52A4BB1B.4050604@unitedklasens.de> Date: Sun, 08 Dec 2013 19:31:55 +0100 From: Volker Klasen User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20131005 Icedove/17.0.9 MIME-Version: 1.0 To: "xen-users@lists.xen.org" References: <52A46D13.4050806@unitedklasens.de> <52A4AB45.8080507@unitedklasens.de> In-Reply-To: X-Enigmail-Version: 1.6 Subject: Re: [Xen-users] VGA Passthrough with Xen 4.3 and Qemu 1.7 on Debian Jessie X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hey, >> You should have a disk no need, as the bios is not started and thus no disk is being accessed (or tried to). > The default qemu in 4.3 should be upstream, but a lot of people > have had better luck with traditional for higher memory (myself > included). >> Is there a reason you are overriding the qemu device model? >> AFAIK this is not a needed step, it should be able to get that by >> default. If I don't use any device_model overrides, I'll get this error: libxl: error: libxl_dm.c:1142:libxl__spawn_local_dm: device model /usr/lib/xen-4.3/bin/qemu-dm is not executable: No such file or directory Qemu isn't shipped anymore with Debian or Xen itself since 4.2 [1] > The hardware worked 18 month with VGA passthrough, so I would > exclude it as cause, as well. > > I wouldn't entirely rule it out, were you using 4.1 on Jessie, or > a >> previous debian? The way hardware is addressed by the kernel may >> have changed, so knowing the model might help. I did no kernel upgrade when updating Xen, just Xen (and some unrelated stuff), just checked my dpkg.log >> I don't see anything that stands out. Your devices are bound to >> pciback, though the kernel config shows the backend drivers are >> as modules. The xl output doesn't appear to explain the problem >> either. Have you tried traditional without the override? I tried traditional with qemu-dm from xen-utils 4.1 (cf. above) and I can get Windows to boot but all devices I passed through are not working (errors 10 and 43, cf. my original post) Cheers, Volker [1] http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=688311 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.15 (GNU/Linux) Comment: Using GnuPG with Icedove - http://www.enigmail.net/ iEYEARECAAYFAlKkuxsACgkQgKD4KXUzSriBqgCghvAIc2Wr3j/IdRh0aAnAvtCM 47MAoLT1EKDELNYK0pMCOGso4YVpZtWN =FU0t -----END PGP SIGNATURE----- _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sun Dec 08 18:32:55 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 08 Dec 2013 18:32:55 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpj96-0003ek-Um; Sun, 08 Dec 2013 18:32:00 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vpj94-0003ef-R1 for xen-users@lists.xen.org; Sun, 08 Dec 2013 18:31:59 +0000 Received: from [193.109.254.147:2345] by server-10.bemta-14.messagelabs.com id E2/1C-20752-E1BB4A25; Sun, 08 Dec 2013 18:31:58 +0000 X-Env-Sender: reklov@unitedklasens.de X-Msg-Ref: server-10.tower-27.messagelabs.com!1386527517!3749242!1 X-Originating-IP: [37.17.224.201] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 27086 invoked from network); 8 Dec 2013 18:31:57 -0000 Received: from mail.webgo24-server13.de (HELO mail.webgo24-server13.de) (37.17.224.201) by server-10.tower-27.messagelabs.com with SMTP; 8 Dec 2013 18:31:57 -0000 Received: from [192.168.42.13] (HSI-KBW-46-223-75-55.hsi.kabel-badenwuerttemberg.de [46.223.75.55]) by mail.webgo24-server13.de (Postfix) with ESMTPSA id 0E15B3041B79 for ; Sun, 8 Dec 2013 19:31:56 +0100 (CET) Message-ID: <52A4BB1B.4050604@unitedklasens.de> Date: Sun, 08 Dec 2013 19:31:55 +0100 From: Volker Klasen User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20131005 Icedove/17.0.9 MIME-Version: 1.0 To: "xen-users@lists.xen.org" References: <52A46D13.4050806@unitedklasens.de> <52A4AB45.8080507@unitedklasens.de> In-Reply-To: X-Enigmail-Version: 1.6 Subject: Re: [Xen-users] VGA Passthrough with Xen 4.3 and Qemu 1.7 on Debian Jessie X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hey, >> You should have a disk no need, as the bios is not started and thus no disk is being accessed (or tried to). > The default qemu in 4.3 should be upstream, but a lot of people > have had better luck with traditional for higher memory (myself > included). >> Is there a reason you are overriding the qemu device model? >> AFAIK this is not a needed step, it should be able to get that by >> default. If I don't use any device_model overrides, I'll get this error: libxl: error: libxl_dm.c:1142:libxl__spawn_local_dm: device model /usr/lib/xen-4.3/bin/qemu-dm is not executable: No such file or directory Qemu isn't shipped anymore with Debian or Xen itself since 4.2 [1] > The hardware worked 18 month with VGA passthrough, so I would > exclude it as cause, as well. > > I wouldn't entirely rule it out, were you using 4.1 on Jessie, or > a >> previous debian? The way hardware is addressed by the kernel may >> have changed, so knowing the model might help. I did no kernel upgrade when updating Xen, just Xen (and some unrelated stuff), just checked my dpkg.log >> I don't see anything that stands out. Your devices are bound to >> pciback, though the kernel config shows the backend drivers are >> as modules. The xl output doesn't appear to explain the problem >> either. Have you tried traditional without the override? I tried traditional with qemu-dm from xen-utils 4.1 (cf. above) and I can get Windows to boot but all devices I passed through are not working (errors 10 and 43, cf. my original post) Cheers, Volker [1] http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=688311 -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.15 (GNU/Linux) Comment: Using GnuPG with Icedove - http://www.enigmail.net/ iEYEARECAAYFAlKkuxsACgkQgKD4KXUzSriBqgCghvAIc2Wr3j/IdRh0aAnAvtCM 47MAoLT1EKDELNYK0pMCOGso4YVpZtWN =FU0t -----END PGP SIGNATURE----- _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sun Dec 08 18:55:41 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 08 Dec 2013 18:55:41 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VpjVa-0004WY-5h; Sun, 08 Dec 2013 18:55:14 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VpjVV-0004WT-U0 for xen-users@lists.xen.org; Sun, 08 Dec 2013 18:55:13 +0000 Received: from [193.109.254.147:5832] by server-14.bemta-14.messagelabs.com id 20/D3-12628-C80C4A25; Sun, 08 Dec 2013 18:55:08 +0000 X-Env-Sender: cdelorme@gmail.com X-Msg-Ref: server-16.tower-27.messagelabs.com!1386528906!2247895!1 X-Originating-IP: [209.85.128.169] X-SpamReason: No, hits=0.4 required=7.0 tests=HTML_30_40,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 18072 invoked from network); 8 Dec 2013 18:55:07 -0000 Received: from mail-ve0-f169.google.com (HELO mail-ve0-f169.google.com) (209.85.128.169) by server-16.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 8 Dec 2013 18:55:07 -0000 Received: by mail-ve0-f169.google.com with SMTP id c14so2875015vea.14 for ; Sun, 08 Dec 2013 10:55:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=ykgHD8yzuWZmH/Frg1DzU+NF33WnYzmwXQpe+b+l6ZM=; b=Jcrig6ye9NyAmImRbKAC2u4Kb3deYh5B4qfojAlFHquA8rN7PFSmMqql5glHw3h8PK vUviG+NEjLv0eftIGjlHRC73dAXn8VmnmfxMVXD3LpHIEJ4QUTV6WaCcb67PVXUNubQ4 uKrUaG93ZpCUxVSvLQJiaLfLzLi99b0UtTaDXcqxe9apOgwT2Bw6FGXORe/tdOV4prRn UeX97Vkb64nar9AnDkc9K0YcATqsUEEhbBUXT0dfpTJo/ENPKtyhXtBmcskdEDV3MXC/ YbDAZQ14Fh4KpPiR4AvhNdjtiGzCyN7T6t5SgdiAMH9xeORt2D3pcHBD/rI7Ejb+3SHT Aaqw== MIME-Version: 1.0 X-Received: by 10.58.143.17 with SMTP id sa17mr9515258veb.14.1386528906459; Sun, 08 Dec 2013 10:55:06 -0800 (PST) Received: by 10.58.155.106 with HTTP; Sun, 8 Dec 2013 10:55:06 -0800 (PST) In-Reply-To: <52A4BB1B.4050604@unitedklasens.de> References: <52A46D13.4050806@unitedklasens.de> <52A4AB45.8080507@unitedklasens.de> <52A4BB1B.4050604@unitedklasens.de> Date: Sun, 8 Dec 2013 13:55:06 -0500 Message-ID: From: Casey DeLorme To: Volker Klasen Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] VGA Passthrough with Xen 4.3 and Qemu 1.7 on Debian Jessie X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6249319097686946172==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6249319097686946172== Content-Type: multipart/alternative; boundary=047d7b6d95eef0be6504ed0a6a72 --047d7b6d95eef0be6504ed0a6a72 Content-Type: text/plain; charset=UTF-8 > > > >> You should have a disk > > no need, as the bios is not started and thus no disk is being accessed > (or tried to). > > My mistake, you are right. I tested but forgot to remove that sentence from my reply. > > > The default qemu in 4.3 should be upstream, but a lot of people > > have had better luck with traditional for higher memory (myself > > included). > > >> Is there a reason you are overriding the qemu device model? > >> AFAIK this is not a needed step, it should be able to get that by > >> default. > > If I don't use any device_model overrides, I'll get this error: > > libxl: error: libxl_dm.c:1142:libxl__spawn_local_dm: device model > /usr/lib/xen-4.3/bin/qemu-dm is not executable: No such file or directory > > Qemu isn't shipped anymore with Debian or Xen itself since 4.2 [1] > > That may be the problem then. I built xen from source, which builds qemu. I would recommend building from source instead. Jessie is in testing, so it's not uncommon for packages to be incomplete or misconfigured. > The hardware worked 18 month with VGA passthrough, so I would > > exclude it as cause, as well. > > > > I wouldn't entirely rule it out, were you using 4.1 on Jessie, or > > a > >> previous debian? The way hardware is addressed by the kernel may > >> have changed, so knowing the model might help. > > I did no kernel upgrade when updating Xen, just Xen (and some > unrelated stuff), just checked my dpkg.log > > Yes, the default kernel has them set as modules. I build a kernel for xen, with all related flags set to on. Supposedly you can do this easily to the existing kernel with `mkinitramfs`, but I have never tried that method. The fact that your devices are bound to pciback would suggest that things are working fine though. > >> I don't see anything that stands out. Your devices are bound to > >> pciback, though the kernel config shows the backend drivers are > >> as modules. The xl output doesn't appear to explain the problem > >> either. Have you tried traditional without the override? > > I tried traditional with qemu-dm from xen-utils 4.1 (cf. above) and I > can get Windows to boot but all devices I passed through are not > working (errors 10 and 43, cf. my original post) > > Yeah, 4.1 to 4.3 is a major jump. The code that lets xen interface with the custom qemu has changed, I'm more surprised that it loaded than that it didn't load pci devices. I would remove the xen packages and try building it from source. At least until Jessie gets closer to a stable release. --047d7b6d95eef0be6504ed0a6a72 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

>> You should have a disk

no need, as the bios is not started and thus no disk is being accesse= d
(or tried to).

My mistake, you are right. = =C2=A0I tested but forgot to remove that sentence from my reply.
= =C2=A0

> The default qemu in 4.3 should be upstream, but a lot of people
> have had better luck with traditional for higher memory (myself
> included).

>> Is there a reason you are overriding the qemu device model?
>> AFAIK this is not a needed step, it should be able to get that by<= br> >> default.

If I don't use any device_model overrides, I'll get this erro= r:

libxl: error: libxl_dm.c:1142:libxl__spawn_local_dm: device model
/usr/lib/xen-4.3/bin/qemu-dm is not executable: No such file or directory
Qemu isn't shipped anymore with Debian or Xen itself since 4.2 [1]

That may be the problem then.= =C2=A0I built xen from source, which builds qemu. =C2=A0I would recommend = building from source instead. =C2=A0Jessie is in testing, so it's not u= ncommon for packages to be incomplete or misconfigured.

> The hardware worked 18 month with VGA passthrough, so I would
> exclude it as cause, as well.
>
> I wouldn't entirely rule it out, were you using 4.1 on Jessie, or<= br> > a
>> previous debian? =C2=A0The way hardware is addressed by the kernel= may
>> have changed, so knowing the model might help.

I did no kernel upgrade when updating Xen, just Xen (and some
unrelated stuff), just checked my dpkg.log

Yes, the default kernel has t= hem set as modules. =C2=A0I build a kernel for xen, with all related flags = set to on. =C2=A0Supposedly you can do this easily to the existing kernel w= ith `mkinitramfs`, but I have never tried that method.

The fact that your devices are bound to pciback would s= uggest that things are working fine though.
=C2=A0
>> I don't see anything that stands out. =C2=A0Your devices are b= ound to
>> pciback, though the kernel config shows the backend drivers are >> as modules. =C2=A0The xl output doesn't appear to explain the = problem
>> either. =C2=A0Have you tried traditional without the override?

I tried traditional with qemu-dm from xen-utils 4.1 (cf. above) and I=
can get Windows to boot but all devices I passed through are not
working (errors 10 and 43, cf. my original post)

Yeah, 4.1 to 4.3 is a major jump. =C2=A0The code that= lets xen interface with the custom qemu has changed, I'm more surprise= d that it loaded than that it didn't load pci devices.

I would remove the xen packages and try building it from source. =C2= =A0At least until Jessie gets closer to a stable release.
=
--047d7b6d95eef0be6504ed0a6a72-- --===============6249319097686946172== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6249319097686946172==-- From xen-users-bounces@lists.xen.org Sun Dec 08 18:55:41 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 08 Dec 2013 18:55:41 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VpjVa-0004WY-5h; Sun, 08 Dec 2013 18:55:14 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VpjVV-0004WT-U0 for xen-users@lists.xen.org; Sun, 08 Dec 2013 18:55:13 +0000 Received: from [193.109.254.147:5832] by server-14.bemta-14.messagelabs.com id 20/D3-12628-C80C4A25; Sun, 08 Dec 2013 18:55:08 +0000 X-Env-Sender: cdelorme@gmail.com X-Msg-Ref: server-16.tower-27.messagelabs.com!1386528906!2247895!1 X-Originating-IP: [209.85.128.169] X-SpamReason: No, hits=0.4 required=7.0 tests=HTML_30_40,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 18072 invoked from network); 8 Dec 2013 18:55:07 -0000 Received: from mail-ve0-f169.google.com (HELO mail-ve0-f169.google.com) (209.85.128.169) by server-16.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 8 Dec 2013 18:55:07 -0000 Received: by mail-ve0-f169.google.com with SMTP id c14so2875015vea.14 for ; Sun, 08 Dec 2013 10:55:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=ykgHD8yzuWZmH/Frg1DzU+NF33WnYzmwXQpe+b+l6ZM=; b=Jcrig6ye9NyAmImRbKAC2u4Kb3deYh5B4qfojAlFHquA8rN7PFSmMqql5glHw3h8PK vUviG+NEjLv0eftIGjlHRC73dAXn8VmnmfxMVXD3LpHIEJ4QUTV6WaCcb67PVXUNubQ4 uKrUaG93ZpCUxVSvLQJiaLfLzLi99b0UtTaDXcqxe9apOgwT2Bw6FGXORe/tdOV4prRn UeX97Vkb64nar9AnDkc9K0YcATqsUEEhbBUXT0dfpTJo/ENPKtyhXtBmcskdEDV3MXC/ YbDAZQ14Fh4KpPiR4AvhNdjtiGzCyN7T6t5SgdiAMH9xeORt2D3pcHBD/rI7Ejb+3SHT Aaqw== MIME-Version: 1.0 X-Received: by 10.58.143.17 with SMTP id sa17mr9515258veb.14.1386528906459; Sun, 08 Dec 2013 10:55:06 -0800 (PST) Received: by 10.58.155.106 with HTTP; Sun, 8 Dec 2013 10:55:06 -0800 (PST) In-Reply-To: <52A4BB1B.4050604@unitedklasens.de> References: <52A46D13.4050806@unitedklasens.de> <52A4AB45.8080507@unitedklasens.de> <52A4BB1B.4050604@unitedklasens.de> Date: Sun, 8 Dec 2013 13:55:06 -0500 Message-ID: From: Casey DeLorme To: Volker Klasen Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] VGA Passthrough with Xen 4.3 and Qemu 1.7 on Debian Jessie X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6249319097686946172==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6249319097686946172== Content-Type: multipart/alternative; boundary=047d7b6d95eef0be6504ed0a6a72 --047d7b6d95eef0be6504ed0a6a72 Content-Type: text/plain; charset=UTF-8 > > > >> You should have a disk > > no need, as the bios is not started and thus no disk is being accessed > (or tried to). > > My mistake, you are right. I tested but forgot to remove that sentence from my reply. > > > The default qemu in 4.3 should be upstream, but a lot of people > > have had better luck with traditional for higher memory (myself > > included). > > >> Is there a reason you are overriding the qemu device model? > >> AFAIK this is not a needed step, it should be able to get that by > >> default. > > If I don't use any device_model overrides, I'll get this error: > > libxl: error: libxl_dm.c:1142:libxl__spawn_local_dm: device model > /usr/lib/xen-4.3/bin/qemu-dm is not executable: No such file or directory > > Qemu isn't shipped anymore with Debian or Xen itself since 4.2 [1] > > That may be the problem then. I built xen from source, which builds qemu. I would recommend building from source instead. Jessie is in testing, so it's not uncommon for packages to be incomplete or misconfigured. > The hardware worked 18 month with VGA passthrough, so I would > > exclude it as cause, as well. > > > > I wouldn't entirely rule it out, were you using 4.1 on Jessie, or > > a > >> previous debian? The way hardware is addressed by the kernel may > >> have changed, so knowing the model might help. > > I did no kernel upgrade when updating Xen, just Xen (and some > unrelated stuff), just checked my dpkg.log > > Yes, the default kernel has them set as modules. I build a kernel for xen, with all related flags set to on. Supposedly you can do this easily to the existing kernel with `mkinitramfs`, but I have never tried that method. The fact that your devices are bound to pciback would suggest that things are working fine though. > >> I don't see anything that stands out. Your devices are bound to > >> pciback, though the kernel config shows the backend drivers are > >> as modules. The xl output doesn't appear to explain the problem > >> either. Have you tried traditional without the override? > > I tried traditional with qemu-dm from xen-utils 4.1 (cf. above) and I > can get Windows to boot but all devices I passed through are not > working (errors 10 and 43, cf. my original post) > > Yeah, 4.1 to 4.3 is a major jump. The code that lets xen interface with the custom qemu has changed, I'm more surprised that it loaded than that it didn't load pci devices. I would remove the xen packages and try building it from source. At least until Jessie gets closer to a stable release. --047d7b6d95eef0be6504ed0a6a72 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable

>> You should have a disk

no need, as the bios is not started and thus no disk is being accesse= d
(or tried to).

My mistake, you are right. = =C2=A0I tested but forgot to remove that sentence from my reply.
= =C2=A0

> The default qemu in 4.3 should be upstream, but a lot of people
> have had better luck with traditional for higher memory (myself
> included).

>> Is there a reason you are overriding the qemu device model?
>> AFAIK this is not a needed step, it should be able to get that by<= br> >> default.

If I don't use any device_model overrides, I'll get this erro= r:

libxl: error: libxl_dm.c:1142:libxl__spawn_local_dm: device model
/usr/lib/xen-4.3/bin/qemu-dm is not executable: No such file or directory
Qemu isn't shipped anymore with Debian or Xen itself since 4.2 [1]

That may be the problem then.= =C2=A0I built xen from source, which builds qemu. =C2=A0I would recommend = building from source instead. =C2=A0Jessie is in testing, so it's not u= ncommon for packages to be incomplete or misconfigured.

> The hardware worked 18 month with VGA passthrough, so I would
> exclude it as cause, as well.
>
> I wouldn't entirely rule it out, were you using 4.1 on Jessie, or<= br> > a
>> previous debian? =C2=A0The way hardware is addressed by the kernel= may
>> have changed, so knowing the model might help.

I did no kernel upgrade when updating Xen, just Xen (and some
unrelated stuff), just checked my dpkg.log

Yes, the default kernel has t= hem set as modules. =C2=A0I build a kernel for xen, with all related flags = set to on. =C2=A0Supposedly you can do this easily to the existing kernel w= ith `mkinitramfs`, but I have never tried that method.

The fact that your devices are bound to pciback would s= uggest that things are working fine though.
=C2=A0
>> I don't see anything that stands out. =C2=A0Your devices are b= ound to
>> pciback, though the kernel config shows the backend drivers are >> as modules. =C2=A0The xl output doesn't appear to explain the = problem
>> either. =C2=A0Have you tried traditional without the override?

I tried traditional with qemu-dm from xen-utils 4.1 (cf. above) and I=
can get Windows to boot but all devices I passed through are not
working (errors 10 and 43, cf. my original post)

Yeah, 4.1 to 4.3 is a major jump. =C2=A0The code that= lets xen interface with the custom qemu has changed, I'm more surprise= d that it loaded than that it didn't load pci devices.

I would remove the xen packages and try building it from source. =C2= =A0At least until Jessie gets closer to a stable release.
=
--047d7b6d95eef0be6504ed0a6a72-- --===============6249319097686946172== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6249319097686946172==-- From xen-users-bounces@lists.xen.org Mon Dec 09 16:47:11 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 09 Dec 2013 16:47:11 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vq3y0-0005Pe-EH; Mon, 09 Dec 2013 16:45:56 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vq3xy-0005PY-St for xen-users@lists.xen.org; Mon, 09 Dec 2013 16:45:55 +0000 Received: from [85.158.137.68:5203] by server-9.bemta-3.messagelabs.com id 9F/BD-13104-2C3F5A25; Mon, 09 Dec 2013 16:45:54 +0000 X-Env-Sender: jdurand@hrsg.ca X-Msg-Ref: server-5.tower-31.messagelabs.com!1386607552!2755472!1 X-Originating-IP: [206.191.52.229] X-SpamReason: No, hits=0.0 required=7.0 tests=HTML_MESSAGE X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 14815 invoked from network); 9 Dec 2013 16:45:53 -0000 Received: from mail.hrsg.ca (HELO mail.hrsg.ca) (206.191.52.229) by server-5.tower-31.messagelabs.com with SMTP; 9 Dec 2013 16:45:53 -0000 Received: from EXCHANGE0.INTRANET.local ([192.168.128.7]) by mail.hrsg.ca with Microsoft SMTPSVC(6.0.3790.4675); Mon, 9 Dec 2013 11:45:52 -0500 Received: from EXCHANGE0.INTRANET.local ([fe80::d8de:d7b:5777:ae03]) by exchange0.INTRANET.local ([fe80::d8de:d7b:5777:ae03%18]) with mapi id 14.01.0438.000; Mon, 9 Dec 2013 11:45:52 -0500 From: Jim Durand To: "xen-users@lists.xen.org" Thread-Topic: Best PV drivers for Windows on Xen 4.2.3 Thread-Index: Ac70/h4Sn7FtJpdDSkidC7VhEIVaEw== Date: Mon, 9 Dec 2013 16:45:50 +0000 Message-ID: <4AA28137EB92344F92DEC7BB41FE62C06266E627@exchange0.INTRANET.local> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.128.43] MIME-Version: 1.0 X-OriginalArrivalTime: 09 Dec 2013 16:45:52.0616 (UTC) FILETIME=[1F68DE80:01CEF4FE] Subject: [Xen-users] Best PV drivers for Windows on Xen 4.2.3 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============1116781830175059793==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============1116781830175059793== Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_4AA28137EB92344F92DEC7BB41FE62C06266E627exchange0INTRAN_" --_000_4AA28137EB92344F92DEC7BB41FE62C06266E627exchange0INTRAN_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Tried to install Citrix PV drivers on Windows Server 2012 and Xen 4.2.3, ma= chine kept crashing (reboot loop), I thought I was able to do this. Also is= it even worth it when GPLPV works fine, just want to run some performance = tests to compare. Thanks! --_000_4AA28137EB92344F92DEC7BB41FE62C06266E627exchange0INTRAN_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Tried to install Citrix PV drivers on Windows Server= 2012 and Xen 4.2.3, machine kept crashing (reboot loop), I thought I was a= ble to do this. Also is it even worth it when GPLPV works fine, just want t= o run some performance tests to compare.

 

 

Thanks!

--_000_4AA28137EB92344F92DEC7BB41FE62C06266E627exchange0INTRAN_-- --===============1116781830175059793== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============1116781830175059793==-- From xen-users-bounces@lists.xen.org Mon Dec 09 16:47:11 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 09 Dec 2013 16:47:11 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vq3y0-0005Pe-EH; Mon, 09 Dec 2013 16:45:56 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vq3xy-0005PY-St for xen-users@lists.xen.org; Mon, 09 Dec 2013 16:45:55 +0000 Received: from [85.158.137.68:5203] by server-9.bemta-3.messagelabs.com id 9F/BD-13104-2C3F5A25; Mon, 09 Dec 2013 16:45:54 +0000 X-Env-Sender: jdurand@hrsg.ca X-Msg-Ref: server-5.tower-31.messagelabs.com!1386607552!2755472!1 X-Originating-IP: [206.191.52.229] X-SpamReason: No, hits=0.0 required=7.0 tests=HTML_MESSAGE X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 14815 invoked from network); 9 Dec 2013 16:45:53 -0000 Received: from mail.hrsg.ca (HELO mail.hrsg.ca) (206.191.52.229) by server-5.tower-31.messagelabs.com with SMTP; 9 Dec 2013 16:45:53 -0000 Received: from EXCHANGE0.INTRANET.local ([192.168.128.7]) by mail.hrsg.ca with Microsoft SMTPSVC(6.0.3790.4675); Mon, 9 Dec 2013 11:45:52 -0500 Received: from EXCHANGE0.INTRANET.local ([fe80::d8de:d7b:5777:ae03]) by exchange0.INTRANET.local ([fe80::d8de:d7b:5777:ae03%18]) with mapi id 14.01.0438.000; Mon, 9 Dec 2013 11:45:52 -0500 From: Jim Durand To: "xen-users@lists.xen.org" Thread-Topic: Best PV drivers for Windows on Xen 4.2.3 Thread-Index: Ac70/h4Sn7FtJpdDSkidC7VhEIVaEw== Date: Mon, 9 Dec 2013 16:45:50 +0000 Message-ID: <4AA28137EB92344F92DEC7BB41FE62C06266E627@exchange0.INTRANET.local> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.128.43] MIME-Version: 1.0 X-OriginalArrivalTime: 09 Dec 2013 16:45:52.0616 (UTC) FILETIME=[1F68DE80:01CEF4FE] Subject: [Xen-users] Best PV drivers for Windows on Xen 4.2.3 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============1116781830175059793==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============1116781830175059793== Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_4AA28137EB92344F92DEC7BB41FE62C06266E627exchange0INTRAN_" --_000_4AA28137EB92344F92DEC7BB41FE62C06266E627exchange0INTRAN_ Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable Tried to install Citrix PV drivers on Windows Server 2012 and Xen 4.2.3, ma= chine kept crashing (reboot loop), I thought I was able to do this. Also is= it even worth it when GPLPV works fine, just want to run some performance = tests to compare. Thanks! --_000_4AA28137EB92344F92DEC7BB41FE62C06266E627exchange0INTRAN_ Content-Type: text/html; charset="us-ascii" Content-Transfer-Encoding: quoted-printable

Tried to install Citrix PV drivers on Windows Server= 2012 and Xen 4.2.3, machine kept crashing (reboot loop), I thought I was a= ble to do this. Also is it even worth it when GPLPV works fine, just want t= o run some performance tests to compare.

 

 

Thanks!

--_000_4AA28137EB92344F92DEC7BB41FE62C06266E627exchange0INTRAN_-- --===============1116781830175059793== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============1116781830175059793==-- From xen-users-bounces@lists.xen.org Mon Dec 09 19:52:21 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 09 Dec 2013 19:52:21 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vq6rC-0008Hp-2t; Mon, 09 Dec 2013 19:51:06 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vq6rA-0008Hk-9S for xen-users@lists.xen.org; Mon, 09 Dec 2013 19:51:04 +0000 Received: from [85.158.143.35:43743] by server-1.bemta-4.messagelabs.com id 81/E6-02132-72F16A25; Mon, 09 Dec 2013 19:51:03 +0000 X-Env-Sender: forrie@gmail.com X-Msg-Ref: server-13.tower-21.messagelabs.com!1386618661!3217052!1 X-Originating-IP: [209.85.216.50] X-SpamReason: No, hits=1.1 required=7.0 tests=BODY_RANDOM_LONG, HTML_40_50,HTML_MESSAGE,ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 18415 invoked from network); 9 Dec 2013 19:51:02 -0000 Received: from mail-qa0-f50.google.com (HELO mail-qa0-f50.google.com) (209.85.216.50) by server-13.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 9 Dec 2013 19:51:02 -0000 Received: by mail-qa0-f50.google.com with SMTP id i13so2960523qae.2 for ; Mon, 09 Dec 2013 11:51:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject :content-type; bh=f4cM3azmAUNJFMYGOaiJ1aTj8qmPZf1VBKauxAyPFJw=; b=yU8YPAG31QlY61/tE8Yq8/HOzgIG3rNxP8Y5CNMJydsGaZpl3mS+lOrTIiaqCQAope gpQgAwdWg0aQ7L5qdQCbpSwSxFYf9inHc62G+C22jDETGtxGkO80xkYA8lsGxQ/+oIjV 26CtIZ3pZ1/YgvzjbVmzF3fmwR1me5ZWmjnd1gHs4JTFJQOWY82U57Ltdvw3xnkamC+p 4qzgBxPUInOaWGIuYFUb/LPJN/iU3tq1D671msFZpF5ZE0CyPF8FkAtGfE8F+VRctk2B TQ3rAvY5LoQPivQQ+kJYK+vT2ztBAp4gCVx5wE9KxFX0pDv1TWXZsRAAo1TQTYby5iga vvBA== X-Received: by 10.49.116.5 with SMTP id js5mr36648399qeb.36.1386618661646; Mon, 09 Dec 2013 11:51:01 -0800 (PST) Received: from gump.de-prod.harvard.edu (story1-vpn-gw.dce.harvard.edu. [140.247.198.51]) by mx.google.com with ESMTPSA id f10sm32969819qej.1.2013.12.09.11.51.00 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 09 Dec 2013 11:51:01 -0800 (PST) Message-ID: <52A61F24.2030501@gmail.com> Date: Mon, 09 Dec 2013 14:51:00 -0500 From: Forrest Aldrich User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.1.1 MIME-Version: 1.0 To: xen-users@lists.xen.org Subject: [Xen-users] Newbie: Xenserver Hardware/setup configuration recommendations X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============3196152508267505367==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a multi-part message in MIME format. --===============3196152508267505367== Content-Type: multipart/alternative; boundary="------------040806040202090703080602" This is a multi-part message in MIME format. --------------040806040202090703080602 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit I'm a newbie to Xen, and have been given the go-ahead to spec out a medium-ish sized system to run VMs on for development/testing. We are primarily an HP server shop. I'm looking for detailed information about hardware configuration recommendations - memory, disk, NIC ports, processors, etc. Could someone point me to some good info? Thanks. --------------040806040202090703080602 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit I'm a newbie to Xen, and have been given the go-ahead to spec out a medium-ish sized system to run VMs on for development/testing.  

We are primarily an HP server shop. I'm looking for detailed information about hardware configuration recommendations - memory, disk, NIC ports, processors, etc.   

Could someone point me to some good info?


Thanks.

--------------040806040202090703080602-- --===============3196152508267505367== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============3196152508267505367==-- From xen-users-bounces@lists.xen.org Mon Dec 09 19:52:21 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 09 Dec 2013 19:52:21 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vq6rC-0008Hp-2t; Mon, 09 Dec 2013 19:51:06 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vq6rA-0008Hk-9S for xen-users@lists.xen.org; Mon, 09 Dec 2013 19:51:04 +0000 Received: from [85.158.143.35:43743] by server-1.bemta-4.messagelabs.com id 81/E6-02132-72F16A25; Mon, 09 Dec 2013 19:51:03 +0000 X-Env-Sender: forrie@gmail.com X-Msg-Ref: server-13.tower-21.messagelabs.com!1386618661!3217052!1 X-Originating-IP: [209.85.216.50] X-SpamReason: No, hits=1.1 required=7.0 tests=BODY_RANDOM_LONG, HTML_40_50,HTML_MESSAGE,ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 18415 invoked from network); 9 Dec 2013 19:51:02 -0000 Received: from mail-qa0-f50.google.com (HELO mail-qa0-f50.google.com) (209.85.216.50) by server-13.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 9 Dec 2013 19:51:02 -0000 Received: by mail-qa0-f50.google.com with SMTP id i13so2960523qae.2 for ; Mon, 09 Dec 2013 11:51:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject :content-type; bh=f4cM3azmAUNJFMYGOaiJ1aTj8qmPZf1VBKauxAyPFJw=; b=yU8YPAG31QlY61/tE8Yq8/HOzgIG3rNxP8Y5CNMJydsGaZpl3mS+lOrTIiaqCQAope gpQgAwdWg0aQ7L5qdQCbpSwSxFYf9inHc62G+C22jDETGtxGkO80xkYA8lsGxQ/+oIjV 26CtIZ3pZ1/YgvzjbVmzF3fmwR1me5ZWmjnd1gHs4JTFJQOWY82U57Ltdvw3xnkamC+p 4qzgBxPUInOaWGIuYFUb/LPJN/iU3tq1D671msFZpF5ZE0CyPF8FkAtGfE8F+VRctk2B TQ3rAvY5LoQPivQQ+kJYK+vT2ztBAp4gCVx5wE9KxFX0pDv1TWXZsRAAo1TQTYby5iga vvBA== X-Received: by 10.49.116.5 with SMTP id js5mr36648399qeb.36.1386618661646; Mon, 09 Dec 2013 11:51:01 -0800 (PST) Received: from gump.de-prod.harvard.edu (story1-vpn-gw.dce.harvard.edu. [140.247.198.51]) by mx.google.com with ESMTPSA id f10sm32969819qej.1.2013.12.09.11.51.00 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 09 Dec 2013 11:51:01 -0800 (PST) Message-ID: <52A61F24.2030501@gmail.com> Date: Mon, 09 Dec 2013 14:51:00 -0500 From: Forrest Aldrich User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.1.1 MIME-Version: 1.0 To: xen-users@lists.xen.org Subject: [Xen-users] Newbie: Xenserver Hardware/setup configuration recommendations X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============3196152508267505367==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a multi-part message in MIME format. --===============3196152508267505367== Content-Type: multipart/alternative; boundary="------------040806040202090703080602" This is a multi-part message in MIME format. --------------040806040202090703080602 Content-Type: text/plain; charset=ISO-8859-1; format=flowed Content-Transfer-Encoding: 7bit I'm a newbie to Xen, and have been given the go-ahead to spec out a medium-ish sized system to run VMs on for development/testing. We are primarily an HP server shop. I'm looking for detailed information about hardware configuration recommendations - memory, disk, NIC ports, processors, etc. Could someone point me to some good info? Thanks. --------------040806040202090703080602 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: 7bit I'm a newbie to Xen, and have been given the go-ahead to spec out a medium-ish sized system to run VMs on for development/testing.  

We are primarily an HP server shop. I'm looking for detailed information about hardware configuration recommendations - memory, disk, NIC ports, processors, etc.   

Could someone point me to some good info?


Thanks.

--------------040806040202090703080602-- --===============3196152508267505367== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============3196152508267505367==-- From xen-users-bounces@lists.xen.org Mon Dec 09 20:04:00 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 09 Dec 2013 20:04:00 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vq73P-0000X4-2u; Mon, 09 Dec 2013 20:03:43 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vq73N-0000Ws-Io for xen-users@lists.xen.org; Mon, 09 Dec 2013 20:03:41 +0000 Received: from [85.158.139.211:47747] by server-13.bemta-5.messagelabs.com id 6B/D0-11357-C1226A25; Mon, 09 Dec 2013 20:03:40 +0000 X-Env-Sender: reklov@unitedklasens.de X-Msg-Ref: server-12.tower-206.messagelabs.com!1386619419!3322971!1 X-Originating-IP: [37.17.224.201] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 31880 invoked from network); 9 Dec 2013 20:03:39 -0000 Received: from mail.webgo24-server13.de (HELO mail.webgo24-server13.de) (37.17.224.201) by server-12.tower-206.messagelabs.com with SMTP; 9 Dec 2013 20:03:39 -0000 Received: from [192.168.42.13] (HSI-KBW-46-223-75-55.hsi.kabel-badenwuerttemberg.de [46.223.75.55]) by mail.webgo24-server13.de (Postfix) with ESMTPSA id 7A0A330407D0 for ; Mon, 9 Dec 2013 21:03:39 +0100 (CET) Message-ID: <52A62218.1080003@unitedklasens.de> Date: Mon, 09 Dec 2013 21:03:36 +0100 From: Volker Klasen User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20131005 Icedove/17.0.9 MIME-Version: 1.0 To: xen-users@lists.xen.org References: <52A46D13.4050806@unitedklasens.de> In-Reply-To: <52A46D13.4050806@unitedklasens.de> X-Enigmail-Version: 1.6 Content-Type: multipart/mixed; boundary="------------070004000502040802050603" Subject: Re: [Xen-users] VGA Passthrough with Xen 4.3 and Qemu 1.7 on Debian Jessie X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a multi-part message in MIME format. --------------070004000502040802050603 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hey there, as Casey suggested (thank you!) I built qemu-dm from the xen sources and now VGA passthrough is working again. It seems that there is still something missing in qemu upstream. Here's the small test example which now works fine (without device_model_override as I installed qemu-dm in the right place): name = 'test' builder = 'hvm' memory = 2048 pci = ['0000:01:00.1','0000:01:00.0'] I used the debian sources from Jessie and pbuilder to build xen. I had to modify some files in debian/ such that qemu-dm is built again; find the patchable diff attached. I had to insert "sleep 1d" as building the debian packages after compilation failed and pbuilder cleaned up before I could get a hand on qemu-dm. At the bottom are some lines to save, install and uninstall qemu-dm after building. Cheers, Volker ### save built files cd mkdir /tmp/qemu-dm cp debian/build/build-utils_amd64/tools/blktap/lib/libblktap.so.3.0.0 /tmp/qemu-dm/ cp debian/build/build-utils_amd64/tools/qemu-xen-traditional-dir-remote/i386-dm/qemu-dm /tmp/qemu-dm/ cp -r debian/build/build-utils_amd64/tools/qemu-xen-traditional-dir-remote/keymaps /tmp/qemu-dm/ cd /tmp/ tar czf ~/qemu-dm.tgz qemu-dm rm -r qemu-dm ### install libblktap, qemu-dm and keymaps cd /tmp tar xf ~/qemu-dm.tgz cp qemu-dm/libblktap.so.3.0.0 /usr/lib/ cp qemu-dm/qemu-dm /usr/lib/xen-4.3/bin/ mkdir -p /usr/share/xen/qemu/ cp -r qemu-dm/keymaps /usr/share/xen/qemu/ ldconfig rm -r qemu-dm ### remove libblktap, qemu-dm and keymaps rm -r /usr/lib/libblktap.so.3.* /usr/lib/xen-4.3/bin/qemu-dm /usr/share/xen/qemu/keymaps rmdir /usr/share/xen/qemu /usr/share/xen -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.15 (GNU/Linux) Comment: Using GnuPG with Icedove - http://www.enigmail.net/ iEYEARECAAYFAlKmIhgACgkQgKD4KXUzSrjRVACgwu6nh0rk8mfvpn8r0ZQa3OHi PJcAnAvoCZag7j75fPORJRXyYfGWPxZa =86/K -----END PGP SIGNATURE----- --------------070004000502040802050603 Content-Type: text/x-patch; name="build-qemu-dm.diff" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="build-qemu-dm.diff" diff -ur tmp/debian/changelog xen-4.3.0/debian/changelog --- tmp/debian/changelog 2013-10-18 00:17:13.000000000 +0200 +++ xen-4.3.0/debian/changelog 2013-12-08 21:00:20.351864217 +0100 @@ -1,3 +1,9 @@ +xen (4.3.0-3.1) UNRELEASED; urgency=low + + * Reenabled building of qemu-dm + + -- Volker Klasen Sun, 08 Dec 2013 20:59:43 +0100 + xen (4.3.0-3) unstable; urgency=low * Revive hypervisor on i386. diff -ur tmp/debian/control xen-4.3.0/debian/control --- tmp/debian/control 2013-10-18 00:18:21.000000000 +0200 +++ xen-4.3.0/debian/control 2013-12-08 21:45:27.679351497 +0100 @@ -4,7 +4,7 @@ Maintainer: Debian Xen Team Uploaders: Guido Trotter , Bastian Blank Standards-Version: 3.9.4 -Build-Depends: debhelper (>> 7), dpkg-dev (>= 1.16.0~), lsb-release, python-dev, bcc, gcc-multilib, e2fslibs-dev, iasl, ipxe-qemu, seabios, libaio-dev, libglib2.0-dev, libgnutls-dev, liblzma-dev, libncurses5-dev, libpci-dev, libyajl-dev, libssl-dev, pkg-config, uuid-dev, zlib1g-dev, ocaml-nox, dh-ocaml, ocaml-findlib +Build-Depends: git, libpixman-1-dev, debhelper (>> 7), dpkg-dev (>= 1.16.0~), lsb-release, python-dev, bcc, gcc-multilib, e2fslibs-dev, iasl, ipxe-qemu, seabios, libaio-dev, libglib2.0-dev, libgnutls-dev, liblzma-dev, libncurses5-dev, libpci-dev, libyajl-dev, libssl-dev, pkg-config, uuid-dev, zlib1g-dev, ocaml-nox, dh-ocaml, ocaml-findlib XS-Python-Version: current Package: libxen-4.3 diff -ur tmp/debian/control.md5sum xen-4.3.0/debian/control.md5sum --- tmp/debian/control.md5sum 2013-10-18 00:18:21.000000000 +0200 +++ xen-4.3.0/debian/control.md5sum 2013-12-08 21:45:27.687351525 +0100 @@ -1,8 +1,8 @@ -22a892a035f25617633bbf1244a2110c debian/changelog +3b58984e01ba094c4a73b8d52425b0ac debian/changelog c379f09bde66561f34d361dd9f89e345 debian/bin/gencontrol.py a4fad0ec66d977759a362165bf8aa31d debian/templates/control.hypervisor.in e9166b8a1e6e9ac9e2fba6050a59fbdb debian/templates/control.main.in -d9d85cc5f2ddd8c23cc860bb4b1b3fe5 debian/templates/control.source.in +3c1b594d48ffc8552ddafa8b64c23803 debian/templates/control.source.in fe9f3e8a9c9b716f7b4c5b7d7aec3128 debian/templates/control.system.latest.in 7f13b99c446eb6cf64d21a2de26b9460 debian/templates/control.utils.in a15fa64ce6deead28d33c1581b14dba7 debian/templates/xen-hypervisor.postinst.in diff -ur tmp/debian/patches/tools-disable.diff xen-4.3.0/debian/patches/tools-disable.diff --- tmp/debian/patches/tools-disable.diff 2013-07-28 13:24:02.000000000 +0200 +++ xen-4.3.0/debian/patches/tools-disable.diff 2013-12-08 22:19:40.867179983 +0100 @@ -1,55 +0,0 @@ ---- a/tools/Makefile -+++ b/tools/Makefile -@@ -1,10 +1,6 @@ - XEN_ROOT = $(CURDIR)/.. - include $(XEN_ROOT)/tools/Rules.mk - --ifneq ($(CONFIG_SYSTEM_LIBAIO),y) --SUBDIRS-libaio := libaio --endif -- - SUBDIRS-y := - SUBDIRS-y += include - SUBDIRS-y += libxc -@@ -19,14 +15,7 @@ - SUBDIRS-y += console - SUBDIRS-y += xenmon - SUBDIRS-y += xenstat --SUBDIRS-$(CONFIG_Linux) += $(SUBDIRS-libaio) - SUBDIRS-$(CONFIG_Linux) += memshr --ifeq ($(CONFIG_X86),y) --SUBDIRS-$(CONFIG_Linux) += blktap --endif --SUBDIRS-$(CONFIG_Linux) += blktap2 --SUBDIRS-$(CONFIG_NetBSD) += $(SUBDIRS-libaio) --SUBDIRS-$(CONFIG_NetBSD) += blktap2 - SUBDIRS-$(CONFIG_NetBSD) += xenbackendd - SUBDIRS-y += libfsimage - SUBDIRS-$(LIBXENAPI_BINDINGS) += libxen -@@ -34,9 +23,12 @@ - - # do not recurse in to a dir we are about to delete - ifneq "$(MAKECMDGOALS)" "distclean" -+CONFIG_QEMU = $(CURDIR)/../qemu -+ifneq ($(wildcard $(CONFIG_QEMU)),) - SUBDIRS-$(CONFIG_IOEMU) += qemu-xen-traditional-dir - SUBDIRS-$(CONFIG_IOEMU) += qemu-xen-dir - endif -+endif - - SUBDIRS-y += xenpmd - SUBDIRS-y += libxl ---- a/tools/Rules.mk -+++ b/tools/Rules.mk -@@ -41,11 +41,7 @@ - LDLIBS_libxenvchan = $(SHLIB_libxenctrl) $(SHLIB_libxenstore) -L$(XEN_LIBVCHAN) -lxenvchan - SHLIB_libxenvchan = -Wl,-rpath-link=$(XEN_LIBVCHAN) - --ifeq ($(CONFIG_Linux),y) --LIBXL_BLKTAP ?= y --else - LIBXL_BLKTAP ?= n --endif - - ifeq ($(LIBXL_BLKTAP),y) - CFLAGS_libblktapctl = -I$(XEN_BLKTAP2)/control -I$(XEN_BLKTAP2)/include $(CFLAGS_xeninclude) diff -ur tmp/debian/rules.defs xen-4.3.0/debian/rules.defs --- tmp/debian/rules.defs 2013-10-05 17:04:53.000000000 +0200 +++ xen-4.3.0/debian/rules.defs 2013-12-08 21:09:09.734142489 +0100 @@ -1,4 +1,4 @@ -KERNELVERSION := 3.10-3 +KERNELVERSION := 3.11-2 BUILD_DIR = debian/build STAMPS_DIR = debian/stamps TEMPLATES_DIR = debian/templates diff -ur tmp/debian/rules.real xen-4.3.0/debian/rules.real --- tmp/debian/rules.real 2013-09-07 13:30:51.000000000 +0200 +++ xen-4.3.0/debian/rules.real 2013-12-09 20:03:35.336119779 +0100 @@ -118,6 +118,7 @@ touch $@ install-base: + sleep 1d dh_installchangelogs -XChangelog dh_installdirs dh_installdocs diff -ur tmp/debian/templates/control.source.in xen-4.3.0/debian/templates/control.source.in --- tmp/debian/templates/control.source.in 2013-08-11 22:30:59.000000000 +0200 +++ xen-4.3.0/debian/templates/control.source.in 2013-12-08 21:45:15.039307221 +0100 @@ -3,6 +3,8 @@ Maintainer: Debian Xen Team Uploaders: Guido Trotter , Bastian Blank Build-Depends: + git, + libpixman-1-dev, debhelper (>> 7), dpkg-dev (>= 1.16.0~), lsb-release, --------------070004000502040802050603 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --------------070004000502040802050603-- From xen-users-bounces@lists.xen.org Mon Dec 09 20:04:00 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 09 Dec 2013 20:04:00 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vq73P-0000X4-2u; Mon, 09 Dec 2013 20:03:43 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vq73N-0000Ws-Io for xen-users@lists.xen.org; Mon, 09 Dec 2013 20:03:41 +0000 Received: from [85.158.139.211:47747] by server-13.bemta-5.messagelabs.com id 6B/D0-11357-C1226A25; Mon, 09 Dec 2013 20:03:40 +0000 X-Env-Sender: reklov@unitedklasens.de X-Msg-Ref: server-12.tower-206.messagelabs.com!1386619419!3322971!1 X-Originating-IP: [37.17.224.201] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 31880 invoked from network); 9 Dec 2013 20:03:39 -0000 Received: from mail.webgo24-server13.de (HELO mail.webgo24-server13.de) (37.17.224.201) by server-12.tower-206.messagelabs.com with SMTP; 9 Dec 2013 20:03:39 -0000 Received: from [192.168.42.13] (HSI-KBW-46-223-75-55.hsi.kabel-badenwuerttemberg.de [46.223.75.55]) by mail.webgo24-server13.de (Postfix) with ESMTPSA id 7A0A330407D0 for ; Mon, 9 Dec 2013 21:03:39 +0100 (CET) Message-ID: <52A62218.1080003@unitedklasens.de> Date: Mon, 09 Dec 2013 21:03:36 +0100 From: Volker Klasen User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20131005 Icedove/17.0.9 MIME-Version: 1.0 To: xen-users@lists.xen.org References: <52A46D13.4050806@unitedklasens.de> In-Reply-To: <52A46D13.4050806@unitedklasens.de> X-Enigmail-Version: 1.6 Content-Type: multipart/mixed; boundary="------------070004000502040802050603" Subject: Re: [Xen-users] VGA Passthrough with Xen 4.3 and Qemu 1.7 on Debian Jessie X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a multi-part message in MIME format. --------------070004000502040802050603 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Hey there, as Casey suggested (thank you!) I built qemu-dm from the xen sources and now VGA passthrough is working again. It seems that there is still something missing in qemu upstream. Here's the small test example which now works fine (without device_model_override as I installed qemu-dm in the right place): name = 'test' builder = 'hvm' memory = 2048 pci = ['0000:01:00.1','0000:01:00.0'] I used the debian sources from Jessie and pbuilder to build xen. I had to modify some files in debian/ such that qemu-dm is built again; find the patchable diff attached. I had to insert "sleep 1d" as building the debian packages after compilation failed and pbuilder cleaned up before I could get a hand on qemu-dm. At the bottom are some lines to save, install and uninstall qemu-dm after building. Cheers, Volker ### save built files cd mkdir /tmp/qemu-dm cp debian/build/build-utils_amd64/tools/blktap/lib/libblktap.so.3.0.0 /tmp/qemu-dm/ cp debian/build/build-utils_amd64/tools/qemu-xen-traditional-dir-remote/i386-dm/qemu-dm /tmp/qemu-dm/ cp -r debian/build/build-utils_amd64/tools/qemu-xen-traditional-dir-remote/keymaps /tmp/qemu-dm/ cd /tmp/ tar czf ~/qemu-dm.tgz qemu-dm rm -r qemu-dm ### install libblktap, qemu-dm and keymaps cd /tmp tar xf ~/qemu-dm.tgz cp qemu-dm/libblktap.so.3.0.0 /usr/lib/ cp qemu-dm/qemu-dm /usr/lib/xen-4.3/bin/ mkdir -p /usr/share/xen/qemu/ cp -r qemu-dm/keymaps /usr/share/xen/qemu/ ldconfig rm -r qemu-dm ### remove libblktap, qemu-dm and keymaps rm -r /usr/lib/libblktap.so.3.* /usr/lib/xen-4.3/bin/qemu-dm /usr/share/xen/qemu/keymaps rmdir /usr/share/xen/qemu /usr/share/xen -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.15 (GNU/Linux) Comment: Using GnuPG with Icedove - http://www.enigmail.net/ iEYEARECAAYFAlKmIhgACgkQgKD4KXUzSrjRVACgwu6nh0rk8mfvpn8r0ZQa3OHi PJcAnAvoCZag7j75fPORJRXyYfGWPxZa =86/K -----END PGP SIGNATURE----- --------------070004000502040802050603 Content-Type: text/x-patch; name="build-qemu-dm.diff" Content-Transfer-Encoding: 7bit Content-Disposition: attachment; filename="build-qemu-dm.diff" diff -ur tmp/debian/changelog xen-4.3.0/debian/changelog --- tmp/debian/changelog 2013-10-18 00:17:13.000000000 +0200 +++ xen-4.3.0/debian/changelog 2013-12-08 21:00:20.351864217 +0100 @@ -1,3 +1,9 @@ +xen (4.3.0-3.1) UNRELEASED; urgency=low + + * Reenabled building of qemu-dm + + -- Volker Klasen Sun, 08 Dec 2013 20:59:43 +0100 + xen (4.3.0-3) unstable; urgency=low * Revive hypervisor on i386. diff -ur tmp/debian/control xen-4.3.0/debian/control --- tmp/debian/control 2013-10-18 00:18:21.000000000 +0200 +++ xen-4.3.0/debian/control 2013-12-08 21:45:27.679351497 +0100 @@ -4,7 +4,7 @@ Maintainer: Debian Xen Team Uploaders: Guido Trotter , Bastian Blank Standards-Version: 3.9.4 -Build-Depends: debhelper (>> 7), dpkg-dev (>= 1.16.0~), lsb-release, python-dev, bcc, gcc-multilib, e2fslibs-dev, iasl, ipxe-qemu, seabios, libaio-dev, libglib2.0-dev, libgnutls-dev, liblzma-dev, libncurses5-dev, libpci-dev, libyajl-dev, libssl-dev, pkg-config, uuid-dev, zlib1g-dev, ocaml-nox, dh-ocaml, ocaml-findlib +Build-Depends: git, libpixman-1-dev, debhelper (>> 7), dpkg-dev (>= 1.16.0~), lsb-release, python-dev, bcc, gcc-multilib, e2fslibs-dev, iasl, ipxe-qemu, seabios, libaio-dev, libglib2.0-dev, libgnutls-dev, liblzma-dev, libncurses5-dev, libpci-dev, libyajl-dev, libssl-dev, pkg-config, uuid-dev, zlib1g-dev, ocaml-nox, dh-ocaml, ocaml-findlib XS-Python-Version: current Package: libxen-4.3 diff -ur tmp/debian/control.md5sum xen-4.3.0/debian/control.md5sum --- tmp/debian/control.md5sum 2013-10-18 00:18:21.000000000 +0200 +++ xen-4.3.0/debian/control.md5sum 2013-12-08 21:45:27.687351525 +0100 @@ -1,8 +1,8 @@ -22a892a035f25617633bbf1244a2110c debian/changelog +3b58984e01ba094c4a73b8d52425b0ac debian/changelog c379f09bde66561f34d361dd9f89e345 debian/bin/gencontrol.py a4fad0ec66d977759a362165bf8aa31d debian/templates/control.hypervisor.in e9166b8a1e6e9ac9e2fba6050a59fbdb debian/templates/control.main.in -d9d85cc5f2ddd8c23cc860bb4b1b3fe5 debian/templates/control.source.in +3c1b594d48ffc8552ddafa8b64c23803 debian/templates/control.source.in fe9f3e8a9c9b716f7b4c5b7d7aec3128 debian/templates/control.system.latest.in 7f13b99c446eb6cf64d21a2de26b9460 debian/templates/control.utils.in a15fa64ce6deead28d33c1581b14dba7 debian/templates/xen-hypervisor.postinst.in diff -ur tmp/debian/patches/tools-disable.diff xen-4.3.0/debian/patches/tools-disable.diff --- tmp/debian/patches/tools-disable.diff 2013-07-28 13:24:02.000000000 +0200 +++ xen-4.3.0/debian/patches/tools-disable.diff 2013-12-08 22:19:40.867179983 +0100 @@ -1,55 +0,0 @@ ---- a/tools/Makefile -+++ b/tools/Makefile -@@ -1,10 +1,6 @@ - XEN_ROOT = $(CURDIR)/.. - include $(XEN_ROOT)/tools/Rules.mk - --ifneq ($(CONFIG_SYSTEM_LIBAIO),y) --SUBDIRS-libaio := libaio --endif -- - SUBDIRS-y := - SUBDIRS-y += include - SUBDIRS-y += libxc -@@ -19,14 +15,7 @@ - SUBDIRS-y += console - SUBDIRS-y += xenmon - SUBDIRS-y += xenstat --SUBDIRS-$(CONFIG_Linux) += $(SUBDIRS-libaio) - SUBDIRS-$(CONFIG_Linux) += memshr --ifeq ($(CONFIG_X86),y) --SUBDIRS-$(CONFIG_Linux) += blktap --endif --SUBDIRS-$(CONFIG_Linux) += blktap2 --SUBDIRS-$(CONFIG_NetBSD) += $(SUBDIRS-libaio) --SUBDIRS-$(CONFIG_NetBSD) += blktap2 - SUBDIRS-$(CONFIG_NetBSD) += xenbackendd - SUBDIRS-y += libfsimage - SUBDIRS-$(LIBXENAPI_BINDINGS) += libxen -@@ -34,9 +23,12 @@ - - # do not recurse in to a dir we are about to delete - ifneq "$(MAKECMDGOALS)" "distclean" -+CONFIG_QEMU = $(CURDIR)/../qemu -+ifneq ($(wildcard $(CONFIG_QEMU)),) - SUBDIRS-$(CONFIG_IOEMU) += qemu-xen-traditional-dir - SUBDIRS-$(CONFIG_IOEMU) += qemu-xen-dir - endif -+endif - - SUBDIRS-y += xenpmd - SUBDIRS-y += libxl ---- a/tools/Rules.mk -+++ b/tools/Rules.mk -@@ -41,11 +41,7 @@ - LDLIBS_libxenvchan = $(SHLIB_libxenctrl) $(SHLIB_libxenstore) -L$(XEN_LIBVCHAN) -lxenvchan - SHLIB_libxenvchan = -Wl,-rpath-link=$(XEN_LIBVCHAN) - --ifeq ($(CONFIG_Linux),y) --LIBXL_BLKTAP ?= y --else - LIBXL_BLKTAP ?= n --endif - - ifeq ($(LIBXL_BLKTAP),y) - CFLAGS_libblktapctl = -I$(XEN_BLKTAP2)/control -I$(XEN_BLKTAP2)/include $(CFLAGS_xeninclude) diff -ur tmp/debian/rules.defs xen-4.3.0/debian/rules.defs --- tmp/debian/rules.defs 2013-10-05 17:04:53.000000000 +0200 +++ xen-4.3.0/debian/rules.defs 2013-12-08 21:09:09.734142489 +0100 @@ -1,4 +1,4 @@ -KERNELVERSION := 3.10-3 +KERNELVERSION := 3.11-2 BUILD_DIR = debian/build STAMPS_DIR = debian/stamps TEMPLATES_DIR = debian/templates diff -ur tmp/debian/rules.real xen-4.3.0/debian/rules.real --- tmp/debian/rules.real 2013-09-07 13:30:51.000000000 +0200 +++ xen-4.3.0/debian/rules.real 2013-12-09 20:03:35.336119779 +0100 @@ -118,6 +118,7 @@ touch $@ install-base: + sleep 1d dh_installchangelogs -XChangelog dh_installdirs dh_installdocs diff -ur tmp/debian/templates/control.source.in xen-4.3.0/debian/templates/control.source.in --- tmp/debian/templates/control.source.in 2013-08-11 22:30:59.000000000 +0200 +++ xen-4.3.0/debian/templates/control.source.in 2013-12-08 21:45:15.039307221 +0100 @@ -3,6 +3,8 @@ Maintainer: Debian Xen Team Uploaders: Guido Trotter , Bastian Blank Build-Depends: + git, + libpixman-1-dev, debhelper (>> 7), dpkg-dev (>= 1.16.0~), lsb-release, --------------070004000502040802050603 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --------------070004000502040802050603-- From xen-users-bounces@lists.xen.org Tue Dec 10 01:03:27 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 01:03:27 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqBim-0007Wy-7O; Tue, 10 Dec 2013 01:02:44 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqBik-0007FU-UC for xen-users@lists.xen.org; Tue, 10 Dec 2013 01:02:43 +0000 Received: from [85.158.139.211:34585] by server-10.bemta-5.messagelabs.com id 0A/EB-01405-23866A25; Tue, 10 Dec 2013 01:02:42 +0000 X-Env-Sender: mark@bradakis.com X-Msg-Ref: server-6.tower-206.messagelabs.com!1386637360!3346728!1 X-Originating-IP: [50.198.190.18] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 25034 invoked from network); 10 Dec 2013 01:02:41 -0000 Received: from 50-198-190-18-static.hfc.comcastbusiness.net (HELO bradakis.com) (50.198.190.18) by server-6.tower-206.messagelabs.com with SMTP; 10 Dec 2013 01:02:41 -0000 Received: from bradakis.com (unknown [50.198.190.18]) by bradakis.com (Postfix) with ESMTP id CEE8EA0356 for ; Mon, 9 Dec 2013 18:02:09 -0700 (MST) Message-ID: <52A667FA.8050305@bradakis.com> Date: Mon, 09 Dec 2013 18:01:46 -0700 From: Mark J Bradakis User-Agent: Mozilla/5.0 (X11; Linux i686; rv:24.0) Gecko/20100101 Firefox/24.0 SeaMonkey/2.21 MIME-Version: 1.0 To: "xen-users@lists.xen.org" Subject: [Xen-users] rc.local? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Fairly new to xen. Working on getting Ubuntu Precise set up on a guest. I was under the impression that using a command line such as xen-create-image --boot blah blah would configure and start the VM, then run /etc/rc.local but that does not seem to be the case. How does one get a script to run when the new guest is first started, before logging in and doing it by hand? What am I missing? mjb. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 10 01:03:27 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 01:03:27 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqBim-0007Wy-7O; Tue, 10 Dec 2013 01:02:44 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqBik-0007FU-UC for xen-users@lists.xen.org; Tue, 10 Dec 2013 01:02:43 +0000 Received: from [85.158.139.211:34585] by server-10.bemta-5.messagelabs.com id 0A/EB-01405-23866A25; Tue, 10 Dec 2013 01:02:42 +0000 X-Env-Sender: mark@bradakis.com X-Msg-Ref: server-6.tower-206.messagelabs.com!1386637360!3346728!1 X-Originating-IP: [50.198.190.18] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 25034 invoked from network); 10 Dec 2013 01:02:41 -0000 Received: from 50-198-190-18-static.hfc.comcastbusiness.net (HELO bradakis.com) (50.198.190.18) by server-6.tower-206.messagelabs.com with SMTP; 10 Dec 2013 01:02:41 -0000 Received: from bradakis.com (unknown [50.198.190.18]) by bradakis.com (Postfix) with ESMTP id CEE8EA0356 for ; Mon, 9 Dec 2013 18:02:09 -0700 (MST) Message-ID: <52A667FA.8050305@bradakis.com> Date: Mon, 09 Dec 2013 18:01:46 -0700 From: Mark J Bradakis User-Agent: Mozilla/5.0 (X11; Linux i686; rv:24.0) Gecko/20100101 Firefox/24.0 SeaMonkey/2.21 MIME-Version: 1.0 To: "xen-users@lists.xen.org" Subject: [Xen-users] rc.local? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Fairly new to xen. Working on getting Ubuntu Precise set up on a guest. I was under the impression that using a command line such as xen-create-image --boot blah blah would configure and start the VM, then run /etc/rc.local but that does not seem to be the case. How does one get a script to run when the new guest is first started, before logging in and doing it by hand? What am I missing? mjb. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 10 01:09:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 01:09:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqBpV-0000Te-DQ; Tue, 10 Dec 2013 01:09:41 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqBpT-0000TZ-LL for xen-users@lists.xen.org; Tue, 10 Dec 2013 01:09:39 +0000 Received: from [85.158.143.35:59278] by server-3.bemta-4.messagelabs.com id CA/CF-32360-3D966A25; Tue, 10 Dec 2013 01:09:39 +0000 X-Env-Sender: mitch@bitblock.net X-Msg-Ref: server-14.tower-21.messagelabs.com!1386637776!4516948!1 X-Originating-IP: [66.199.170.5] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23030 invoked from network); 10 Dec 2013 01:09:38 -0000 Received: from vserver.bitblock.com (HELO slim1.bitblock.com) (66.199.170.5) by server-14.tower-21.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 10 Dec 2013 01:09:38 -0000 Received: from ES3.hs.planbcorp.net ([10.2.1.6]) (AUTH: LOGIN es3-relay@bitblock.net, TLS: TLSv1/SSLv3, 128bits, AES128-SHA) by slim1.bitblock.com with esmtp; Tue, 10 Dec 2013 01:09:35 +0000 Received: from ES3.hs.planbcorp.net ([fe80::58cf:69f9:51e:44a1]) by ES3.hs.planbcorp.net ([fe80::58cf:69f9:51e:44a1%12]) with mapi id 14.02.0347.000; Mon, 9 Dec 2013 17:09:35 -0800 From: "mitch@bitblock.net" To: 'Mark J Bradakis' , "xen-users@lists.xen.org" Thread-Topic: [Xen-users] rc.local? Thread-Index: AQHO9UQq4mRwchXYqk2Oc+87axDorJpMnf4w Date: Tue, 10 Dec 2013 01:09:34 +0000 Message-ID: References: <52A667FA.8050305@bradakis.com> In-Reply-To: <52A667FA.8050305@bradakis.com> Accept-Language: en-CA, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.1.0.12] MIME-Version: 1.0 Subject: Re: [Xen-users] rc.local? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi there mark - that would really depend on your distro - that's not a function of Xen at all as far as I know - the guest boots and what the guest does is the guest's business. Some distro's might use rc.local - others might use run-level changes, or other script sets - but what you have to do within a xen guest has always been the same as when running the guest os natively from my experience. Hope that helps. m -----Original Message----- From: xen-users-bounces@lists.xen.org [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Mark J Bradakis Sent: December 9, 2013 5:02 PM To: xen-users@lists.xen.org Subject: [Xen-users] rc.local? Fairly new to xen. Working on getting Ubuntu Precise set up on a guest. I was under the impression that using a command line such as xen-create-image --boot blah blah would configure and start the VM, then run /etc/rc.local but that does not seem to be the case. How does one get a script to run when the new guest is first started, before logging in and doing it by hand? What am I missing? mjb. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 10 01:09:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 01:09:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqBpV-0000Te-DQ; Tue, 10 Dec 2013 01:09:41 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqBpT-0000TZ-LL for xen-users@lists.xen.org; Tue, 10 Dec 2013 01:09:39 +0000 Received: from [85.158.143.35:59278] by server-3.bemta-4.messagelabs.com id CA/CF-32360-3D966A25; Tue, 10 Dec 2013 01:09:39 +0000 X-Env-Sender: mitch@bitblock.net X-Msg-Ref: server-14.tower-21.messagelabs.com!1386637776!4516948!1 X-Originating-IP: [66.199.170.5] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23030 invoked from network); 10 Dec 2013 01:09:38 -0000 Received: from vserver.bitblock.com (HELO slim1.bitblock.com) (66.199.170.5) by server-14.tower-21.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 10 Dec 2013 01:09:38 -0000 Received: from ES3.hs.planbcorp.net ([10.2.1.6]) (AUTH: LOGIN es3-relay@bitblock.net, TLS: TLSv1/SSLv3, 128bits, AES128-SHA) by slim1.bitblock.com with esmtp; Tue, 10 Dec 2013 01:09:35 +0000 Received: from ES3.hs.planbcorp.net ([fe80::58cf:69f9:51e:44a1]) by ES3.hs.planbcorp.net ([fe80::58cf:69f9:51e:44a1%12]) with mapi id 14.02.0347.000; Mon, 9 Dec 2013 17:09:35 -0800 From: "mitch@bitblock.net" To: 'Mark J Bradakis' , "xen-users@lists.xen.org" Thread-Topic: [Xen-users] rc.local? Thread-Index: AQHO9UQq4mRwchXYqk2Oc+87axDorJpMnf4w Date: Tue, 10 Dec 2013 01:09:34 +0000 Message-ID: References: <52A667FA.8050305@bradakis.com> In-Reply-To: <52A667FA.8050305@bradakis.com> Accept-Language: en-CA, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.1.0.12] MIME-Version: 1.0 Subject: Re: [Xen-users] rc.local? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi there mark - that would really depend on your distro - that's not a function of Xen at all as far as I know - the guest boots and what the guest does is the guest's business. Some distro's might use rc.local - others might use run-level changes, or other script sets - but what you have to do within a xen guest has always been the same as when running the guest os natively from my experience. Hope that helps. m -----Original Message----- From: xen-users-bounces@lists.xen.org [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Mark J Bradakis Sent: December 9, 2013 5:02 PM To: xen-users@lists.xen.org Subject: [Xen-users] rc.local? Fairly new to xen. Working on getting Ubuntu Precise set up on a guest. I was under the impression that using a command line such as xen-create-image --boot blah blah would configure and start the VM, then run /etc/rc.local but that does not seem to be the case. How does one get a script to run when the new guest is first started, before logging in and doing it by hand? What am I missing? mjb. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 10 01:52:12 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 01:52:12 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqCUF-0003BB-8G; Tue, 10 Dec 2013 01:51:47 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqCUD-0003B3-VV for xen-users@lists.xensource.com; Tue, 10 Dec 2013 01:51:46 +0000 Received: from [85.158.143.35:24165] by server-3.bemta-4.messagelabs.com id CF/42-32360-1B376A25; Tue, 10 Dec 2013 01:51:45 +0000 X-Env-Sender: theubaz@gmail.com X-Msg-Ref: server-7.tower-21.messagelabs.com!1386640303!4523966!1 X-Originating-IP: [209.85.212.46] X-SpamReason: No, hits=1.5 required=7.0 tests=HTML_00_10,HTML_MESSAGE, RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 4313 invoked from network); 10 Dec 2013 01:51:44 -0000 Received: from mail-vb0-f46.google.com (HELO mail-vb0-f46.google.com) (209.85.212.46) by server-7.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 10 Dec 2013 01:51:44 -0000 Received: by mail-vb0-f46.google.com with SMTP id w20so99180vbb.33 for ; Mon, 09 Dec 2013 17:51:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=Ot7sl5jTZsPpwdRIl5ARLjLn9MHMjJ9ldbBg7OBMdkE=; b=pu+L0OKtWsi+bNUQ47miNIl23DCTdilTjlrq6QM1hbT0QmIgJ3r2rzNOtqTIvFesVk AnSU81QTnHjqaHCF6emGsk4eA0qia1XuSeoFZZ6ItkvNCjJ5tM9syj0wZhNtfz0OVSFH WQRYHiWIdEyxTcpTss1Mzglv1dTdpQuSS0fNeHD4BbVJVMNrkun3jI9GZ5K9gTrPPTpb iLM9fCs5+257cTxZkkDPC+Zg7mRDhO+5HhuQKpnUsTjRAvIW/uoVhCVFVKiFsQIYnOZj VUGAE9lFiEhdKoQWM3NlOnIu5y3opblVHh1gCKHOzXzAnC7pMQIZ5IHsirR6MiLMRcYn aeLQ== MIME-Version: 1.0 X-Received: by 10.58.19.195 with SMTP id h3mr590610vee.48.1386640303351; Mon, 09 Dec 2013 17:51:43 -0800 (PST) Received: by 10.220.10.8 with HTTP; Mon, 9 Dec 2013 17:51:43 -0800 (PST) Date: Mon, 9 Dec 2013 17:51:43 -0800 X-Google-Sender-Auth: e5VGmMKGSZSWVMTWinKCZkyIty8 Message-ID: From: John Sherwood To: xen-users Subject: [Xen-users] Pass through physical TPM X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============0057705726933130304==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============0057705726933130304== Content-Type: multipart/alternative; boundary=047d7b86c81eb66d3204ed245aac --047d7b86c81eb66d3204ed245aac Content-Type: text/plain; charset=ISO-8859-1 I'm aware of the Xen vTPM capabilities, but is it possible to directly pass through the hardware TPM of a host to a domU? My usecase is taking a machine running Windows with a Bitlocker encrypted drive and starting it as an HVM without needing to monkey around in the guest OS at all. --047d7b86c81eb66d3204ed245aac Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
I'm aware of the Xen vTPM capabilities, but is it poss= ible to directly pass through the hardware TPM of a host to a domU?

= My usecase is taking a machine running Windows with a Bitlocker encrypted d= rive and starting it as an HVM without needing to monkey around in the gues= t OS at all.
--047d7b86c81eb66d3204ed245aac-- --===============0057705726933130304== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============0057705726933130304==-- From xen-users-bounces@lists.xen.org Tue Dec 10 01:52:12 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 01:52:12 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqCUF-0003BB-8G; Tue, 10 Dec 2013 01:51:47 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqCUD-0003B3-VV for xen-users@lists.xensource.com; Tue, 10 Dec 2013 01:51:46 +0000 Received: from [85.158.143.35:24165] by server-3.bemta-4.messagelabs.com id CF/42-32360-1B376A25; Tue, 10 Dec 2013 01:51:45 +0000 X-Env-Sender: theubaz@gmail.com X-Msg-Ref: server-7.tower-21.messagelabs.com!1386640303!4523966!1 X-Originating-IP: [209.85.212.46] X-SpamReason: No, hits=1.5 required=7.0 tests=HTML_00_10,HTML_MESSAGE, RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 4313 invoked from network); 10 Dec 2013 01:51:44 -0000 Received: from mail-vb0-f46.google.com (HELO mail-vb0-f46.google.com) (209.85.212.46) by server-7.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 10 Dec 2013 01:51:44 -0000 Received: by mail-vb0-f46.google.com with SMTP id w20so99180vbb.33 for ; Mon, 09 Dec 2013 17:51:43 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=Ot7sl5jTZsPpwdRIl5ARLjLn9MHMjJ9ldbBg7OBMdkE=; b=pu+L0OKtWsi+bNUQ47miNIl23DCTdilTjlrq6QM1hbT0QmIgJ3r2rzNOtqTIvFesVk AnSU81QTnHjqaHCF6emGsk4eA0qia1XuSeoFZZ6ItkvNCjJ5tM9syj0wZhNtfz0OVSFH WQRYHiWIdEyxTcpTss1Mzglv1dTdpQuSS0fNeHD4BbVJVMNrkun3jI9GZ5K9gTrPPTpb iLM9fCs5+257cTxZkkDPC+Zg7mRDhO+5HhuQKpnUsTjRAvIW/uoVhCVFVKiFsQIYnOZj VUGAE9lFiEhdKoQWM3NlOnIu5y3opblVHh1gCKHOzXzAnC7pMQIZ5IHsirR6MiLMRcYn aeLQ== MIME-Version: 1.0 X-Received: by 10.58.19.195 with SMTP id h3mr590610vee.48.1386640303351; Mon, 09 Dec 2013 17:51:43 -0800 (PST) Received: by 10.220.10.8 with HTTP; Mon, 9 Dec 2013 17:51:43 -0800 (PST) Date: Mon, 9 Dec 2013 17:51:43 -0800 X-Google-Sender-Auth: e5VGmMKGSZSWVMTWinKCZkyIty8 Message-ID: From: John Sherwood To: xen-users Subject: [Xen-users] Pass through physical TPM X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============0057705726933130304==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============0057705726933130304== Content-Type: multipart/alternative; boundary=047d7b86c81eb66d3204ed245aac --047d7b86c81eb66d3204ed245aac Content-Type: text/plain; charset=ISO-8859-1 I'm aware of the Xen vTPM capabilities, but is it possible to directly pass through the hardware TPM of a host to a domU? My usecase is taking a machine running Windows with a Bitlocker encrypted drive and starting it as an HVM without needing to monkey around in the guest OS at all. --047d7b86c81eb66d3204ed245aac Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
I'm aware of the Xen vTPM capabilities, but is it poss= ible to directly pass through the hardware TPM of a host to a domU?

= My usecase is taking a machine running Windows with a Bitlocker encrypted d= rive and starting it as an HVM without needing to monkey around in the gues= t OS at all.
--047d7b86c81eb66d3204ed245aac-- --===============0057705726933130304== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============0057705726933130304==-- From xen-users-bounces@lists.xen.org Tue Dec 10 06:00:59 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 06:00:59 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqGMX-0005wi-BJ; Tue, 10 Dec 2013 06:00:05 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqGMT-0005s7-KV for xen-users@lists.xen.org; Tue, 10 Dec 2013 06:00:03 +0000 Received: from [85.158.143.35:45664] by server-2.bemta-4.messagelabs.com id 9C/11-11386-0EDA6A25; Tue, 10 Dec 2013 06:00:00 +0000 X-Env-Sender: cloud2han9@163.com X-Msg-Ref: server-3.tower-21.messagelabs.com!1386655198!4506852!1 X-Originating-IP: [220.181.13.79] X-SpamReason: No, hits=0.7 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjEzLjc5ID0+IDUyMTk=\n,sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjEzLjc5ID0+IDUyMTk=\n, BLANK_LINES_80_90, HTML_50_60, HTML_MESSAGE,MIME_BASE64_TEXT X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 28308 invoked from network); 10 Dec 2013 05:59:59 -0000 Received: from m13-79.163.com (HELO m13-79.163.com) (220.181.13.79) by server-3.tower-21.messagelabs.com with SMTP; 10 Dec 2013 05:59:59 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=163.com; s=s110527; h=Date:From:Subject:Content-Type:MIME-Version: Message-ID; bh=5CCiDP4aTR/0JLP6mVA1chlayeCWzvmDilJpyYuI2Zc=; b=j 6x9FcWHlCNMZyR4eYpqRkZQzjETAZf1cewkEJ1M9aurPfpbA08DGY78fWpTVpcfa HTzfGLZtSLPKOaZWiKITpI0gA5hbemwETeuxWd6HpyRnja2Zzb3hydVwJOkc5mx9 Cdm2Go2mupk5opZsXmuH/I9ZHWVZ8HzeNJLO1FDGhA= Received: from cloud2han9$163.com ( [222.196.190.204] ) by ajax-webmail-wmsvr79 (Coremail) ; Tue, 10 Dec 2013 13:58:49 +0800 (CST) X-Originating-IP: [222.196.190.204] Date: Tue, 10 Dec 2013 13:58:49 +0800 (CST) From: =?GBK?B?1cXUxs/2?= To: xen-users X-Priority: 3 X-Mailer: Coremail Webmail Server Version SP_ntes V3.5 build 20131115(24167.5769.5770) Copyright (c) 2002-2013 www.mailtech.cn 163com X-CM-CTRLDATA: xrVwTmZvb3Rlcl9odG09NTcwOjgx MIME-Version: 1.0 Message-ID: <3c610e6a.623.142db162054.Coremail.cloud2han9@163.com> X-CM-TRANSID: T8GowECJS0LdraZS+1wIAA--.3740W X-CM-SenderInfo: pfor3vwskd0mi6rwjhhfrp/1tbivxLvVFD+Qftd6QAAs2 X-Coremail-Antispam: 1U5529EdanIXcx71UUUUU7vcSsGvfC2KfnxnUU== Subject: [Xen-users] hypercall implementation X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============7360955284671180402==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============7360955284671180402== Content-Type: multipart/alternative; boundary="----=_Part_3677_921303385.1386655129683" ------=_Part_3677_921303385.1386655129683 Content-Type: text/plain; charset=GBK Content-Transfer-Encoding: base64 SSBhbSBsZWFybmluZyB4ZW4ncyBtZW1vcnkgbWFuYWdlbWVudCByZWNlbnRseS4gSSBmaW5kIG1v c3QgZG9jcyBpcyBob3cgdG8gdXNlIHRoZSBoeXBlcmNhbGwgcmVsYXRlZCBtZW1vcnkgbWFuYWdl bWVudC4gQ2FuIHNvbWVzb21lIHRlbGwgbWUgd2hlcmUgaXMgdGhlIGltcGxlbWVudGF0aW9uIG9m IHRoZSB0aGVtIGluIHRoZSB4ZW4gc291cmNlLiBPciBzb21lIGRvY3MgZXhwbGFpbmluZyBpdCB3 aWxsIGJlIGlkZWFsLgoKCgoKCgoKCgoKCsTqydmyu77lva26/sDPo6y3xbjoy8S6o8jO5dDSo6Gj zrS94sewwre24MnZysKjrNP70+vH4MzsytSxyLjfoaMKCgo= ------=_Part_3677_921303385.1386655129683 Content-Type: text/html; charset=GBK Content-Transfer-Encoding: base64 PGRpdiBzdHlsZT0iY29sb3I6IzAwMDsgZm9udC1zaXplOiAxNHB4O2ZvbnQtZmFtaWx5OiBhcmlh bDsiPjxkaXY+SSBhbSBsZWFybmluZyB4ZW4ncyBtZW1vcnkgbWFuYWdlbWVudCByZWNlbnRseS4g SSBmaW5kIG1vc3QgZG9jcyBpcyBob3cgdG8gdXNlIHRoZSBoeXBlcmNhbGwgcmVsYXRlZCBtZW1v cnkgbWFuYWdlbWVudC4gQ2FuIHNvbWVzb21lIHRlbGwgbWUgd2hlcmUgaXMgdGhlIGltcGxlbWVu dGF0aW9uIG9mIHRoZSB0aGVtIGluIHRoZSB4ZW4gc291cmNlLiBPciBzb21lIGRvY3MgZXhwbGFp bmluZyBpdCB3aWxsIGJlIGlkZWFsLjxicj48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2Pjxicj48 L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2Pjxicj48L2Rpdj48L2Rpdj48 ZGl2PjwvZGl2PjxkaXYgaWQ9InNwbkVkaXRvclNpZ24iIG5hbWU9IjEwMCI+PGRpdj48ZGl2PsTq ydmyu77lva26/sDPo6y3xbjoy8S6o8jO5dDSo6GjzrS94sewwre24MnZysKjrNP70+vH4MzsytSx yLjfoaM8YnI+PC9kaXY+PC9kaXY+PC9kaXY+PGRpdj48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2 PjwvZGl2PjwhLS0gank1Q29udGVudFN1ZmZpeCAtLT48YnI+PGJyPjxzcGFuIHRpdGxlPSJuZXRl YXNlZm9vdGVyIj48c3BhbiBpZD0ibmV0ZWFzZV9tYWlsX2Zvb3RlciI+PC9zcGFuPjwvc3Bhbj4= ------=_Part_3677_921303385.1386655129683-- --===============7360955284671180402== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============7360955284671180402==-- From xen-users-bounces@lists.xen.org Tue Dec 10 06:00:59 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 06:00:59 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqGMX-0005wi-BJ; Tue, 10 Dec 2013 06:00:05 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqGMT-0005s7-KV for xen-users@lists.xen.org; Tue, 10 Dec 2013 06:00:03 +0000 Received: from [85.158.143.35:45664] by server-2.bemta-4.messagelabs.com id 9C/11-11386-0EDA6A25; Tue, 10 Dec 2013 06:00:00 +0000 X-Env-Sender: cloud2han9@163.com X-Msg-Ref: server-3.tower-21.messagelabs.com!1386655198!4506852!1 X-Originating-IP: [220.181.13.79] X-SpamReason: No, hits=0.7 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjEzLjc5ID0+IDUyMTk=\n,sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjEzLjc5ID0+IDUyMTk=\n, BLANK_LINES_80_90, HTML_50_60, HTML_MESSAGE,MIME_BASE64_TEXT X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 28308 invoked from network); 10 Dec 2013 05:59:59 -0000 Received: from m13-79.163.com (HELO m13-79.163.com) (220.181.13.79) by server-3.tower-21.messagelabs.com with SMTP; 10 Dec 2013 05:59:59 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=163.com; s=s110527; h=Date:From:Subject:Content-Type:MIME-Version: Message-ID; bh=5CCiDP4aTR/0JLP6mVA1chlayeCWzvmDilJpyYuI2Zc=; b=j 6x9FcWHlCNMZyR4eYpqRkZQzjETAZf1cewkEJ1M9aurPfpbA08DGY78fWpTVpcfa HTzfGLZtSLPKOaZWiKITpI0gA5hbemwETeuxWd6HpyRnja2Zzb3hydVwJOkc5mx9 Cdm2Go2mupk5opZsXmuH/I9ZHWVZ8HzeNJLO1FDGhA= Received: from cloud2han9$163.com ( [222.196.190.204] ) by ajax-webmail-wmsvr79 (Coremail) ; Tue, 10 Dec 2013 13:58:49 +0800 (CST) X-Originating-IP: [222.196.190.204] Date: Tue, 10 Dec 2013 13:58:49 +0800 (CST) From: =?GBK?B?1cXUxs/2?= To: xen-users X-Priority: 3 X-Mailer: Coremail Webmail Server Version SP_ntes V3.5 build 20131115(24167.5769.5770) Copyright (c) 2002-2013 www.mailtech.cn 163com X-CM-CTRLDATA: xrVwTmZvb3Rlcl9odG09NTcwOjgx MIME-Version: 1.0 Message-ID: <3c610e6a.623.142db162054.Coremail.cloud2han9@163.com> X-CM-TRANSID: T8GowECJS0LdraZS+1wIAA--.3740W X-CM-SenderInfo: pfor3vwskd0mi6rwjhhfrp/1tbivxLvVFD+Qftd6QAAs2 X-Coremail-Antispam: 1U5529EdanIXcx71UUUUU7vcSsGvfC2KfnxnUU== Subject: [Xen-users] hypercall implementation X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============7360955284671180402==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============7360955284671180402== Content-Type: multipart/alternative; boundary="----=_Part_3677_921303385.1386655129683" ------=_Part_3677_921303385.1386655129683 Content-Type: text/plain; charset=GBK Content-Transfer-Encoding: base64 SSBhbSBsZWFybmluZyB4ZW4ncyBtZW1vcnkgbWFuYWdlbWVudCByZWNlbnRseS4gSSBmaW5kIG1v c3QgZG9jcyBpcyBob3cgdG8gdXNlIHRoZSBoeXBlcmNhbGwgcmVsYXRlZCBtZW1vcnkgbWFuYWdl bWVudC4gQ2FuIHNvbWVzb21lIHRlbGwgbWUgd2hlcmUgaXMgdGhlIGltcGxlbWVudGF0aW9uIG9m IHRoZSB0aGVtIGluIHRoZSB4ZW4gc291cmNlLiBPciBzb21lIGRvY3MgZXhwbGFpbmluZyBpdCB3 aWxsIGJlIGlkZWFsLgoKCgoKCgoKCgoKCsTqydmyu77lva26/sDPo6y3xbjoy8S6o8jO5dDSo6Gj zrS94sewwre24MnZysKjrNP70+vH4MzsytSxyLjfoaMKCgo= ------=_Part_3677_921303385.1386655129683 Content-Type: text/html; charset=GBK Content-Transfer-Encoding: base64 PGRpdiBzdHlsZT0iY29sb3I6IzAwMDsgZm9udC1zaXplOiAxNHB4O2ZvbnQtZmFtaWx5OiBhcmlh bDsiPjxkaXY+SSBhbSBsZWFybmluZyB4ZW4ncyBtZW1vcnkgbWFuYWdlbWVudCByZWNlbnRseS4g SSBmaW5kIG1vc3QgZG9jcyBpcyBob3cgdG8gdXNlIHRoZSBoeXBlcmNhbGwgcmVsYXRlZCBtZW1v cnkgbWFuYWdlbWVudC4gQ2FuIHNvbWVzb21lIHRlbGwgbWUgd2hlcmUgaXMgdGhlIGltcGxlbWVu dGF0aW9uIG9mIHRoZSB0aGVtIGluIHRoZSB4ZW4gc291cmNlLiBPciBzb21lIGRvY3MgZXhwbGFp bmluZyBpdCB3aWxsIGJlIGlkZWFsLjxicj48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2Pjxicj48 L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2Pjxicj48L2Rpdj48L2Rpdj48 ZGl2PjwvZGl2PjxkaXYgaWQ9InNwbkVkaXRvclNpZ24iIG5hbWU9IjEwMCI+PGRpdj48ZGl2PsTq ydmyu77lva26/sDPo6y3xbjoy8S6o8jO5dDSo6GjzrS94sewwre24MnZysKjrNP70+vH4MzsytSx yLjfoaM8YnI+PC9kaXY+PC9kaXY+PC9kaXY+PGRpdj48L2Rpdj48ZGl2Pjxicj48L2Rpdj48ZGl2 PjwvZGl2PjwhLS0gank1Q29udGVudFN1ZmZpeCAtLT48YnI+PGJyPjxzcGFuIHRpdGxlPSJuZXRl YXNlZm9vdGVyIj48c3BhbiBpZD0ibmV0ZWFzZV9tYWlsX2Zvb3RlciI+PC9zcGFuPjwvc3Bhbj4= ------=_Part_3677_921303385.1386655129683-- --===============7360955284671180402== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============7360955284671180402==-- From xen-users-bounces@lists.xen.org Tue Dec 10 10:00:05 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 10:00:05 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqK5n-0002Du-4U; Tue, 10 Dec 2013 09:59:03 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqK5m-0002Dj-3n for xen-users@lists.xen.org; Tue, 10 Dec 2013 09:59:02 +0000 Received: from [85.158.137.68:40143] by server-14.bemta-3.messagelabs.com id 0F/A4-06105-5E5E6A25; Tue, 10 Dec 2013 09:59:01 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-7.tower-31.messagelabs.com!1386669539!2927813!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11231 invoked from network); 10 Dec 2013 09:59:00 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-7.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 10 Dec 2013 09:59:00 -0000 X-IronPort-AV: E=Sophos;i="4.93,864,1378857600"; d="scan'208";a="80368534" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 10 Dec 2013 09:58:58 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL02.citrite.net (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Tue, 10 Dec 2013 04:58:57 -0500 Message-ID: <1386669537.11925.25.camel@kazak.uk.xensource.com> From: Ian Campbell To: Forrest Aldrich Date: Tue, 10 Dec 2013 09:58:57 +0000 In-Reply-To: <52A61F24.2030501@gmail.com> References: <52A61F24.2030501@gmail.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA1 Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] Newbie: Xenserver Hardware/setup configuration recommendations X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Mon, 2013-12-09 at 14:51 -0500, Forrest Aldrich wrote: > I'm a newbie to Xen, and have been given the go-ahead to spec out a > medium-ish sized system to run VMs on for development/testing. > > We are primarily an HP server shop. I'm looking for detailed > information about hardware configuration recommendations - memory, > disk, NIC ports, processors, etc. > > Could someone point me to some good info? This list is mostly to do with the upstream Xen.org version of Xen, and the supported hardware will depend on the underlying distro and kernel which you choose. XenServer is in effect its own distro so for XenServer specific advice you will probably find more folks on the www.xenserver.org lists or the XenServer forums at http://forums.citrix.com/category.jspa?categoryID=101 or your Citrix Support channel folks. I'm fairly certain that XenServer also publish a Hardware Compatibility List, I'd be amazed if there weren't a bunch of HP systems on it. If you want to deploy upstream Xen on a regular distro then IMHO the best advice is to pick a Linux (or BSD) distro which you are familiar with and check if there is any Xen advice for that distro in wiki.xen.org (e.g. http://wiki.xen.org/wiki/Category:Host_Install) or on the distros own wiki. Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 10 10:00:05 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 10:00:05 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqK5n-0002Du-4U; Tue, 10 Dec 2013 09:59:03 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqK5m-0002Dj-3n for xen-users@lists.xen.org; Tue, 10 Dec 2013 09:59:02 +0000 Received: from [85.158.137.68:40143] by server-14.bemta-3.messagelabs.com id 0F/A4-06105-5E5E6A25; Tue, 10 Dec 2013 09:59:01 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-7.tower-31.messagelabs.com!1386669539!2927813!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11231 invoked from network); 10 Dec 2013 09:59:00 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-7.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 10 Dec 2013 09:59:00 -0000 X-IronPort-AV: E=Sophos;i="4.93,864,1378857600"; d="scan'208";a="80368534" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 10 Dec 2013 09:58:58 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL02.citrite.net (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Tue, 10 Dec 2013 04:58:57 -0500 Message-ID: <1386669537.11925.25.camel@kazak.uk.xensource.com> From: Ian Campbell To: Forrest Aldrich Date: Tue, 10 Dec 2013 09:58:57 +0000 In-Reply-To: <52A61F24.2030501@gmail.com> References: <52A61F24.2030501@gmail.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA1 Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] Newbie: Xenserver Hardware/setup configuration recommendations X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Mon, 2013-12-09 at 14:51 -0500, Forrest Aldrich wrote: > I'm a newbie to Xen, and have been given the go-ahead to spec out a > medium-ish sized system to run VMs on for development/testing. > > We are primarily an HP server shop. I'm looking for detailed > information about hardware configuration recommendations - memory, > disk, NIC ports, processors, etc. > > Could someone point me to some good info? This list is mostly to do with the upstream Xen.org version of Xen, and the supported hardware will depend on the underlying distro and kernel which you choose. XenServer is in effect its own distro so for XenServer specific advice you will probably find more folks on the www.xenserver.org lists or the XenServer forums at http://forums.citrix.com/category.jspa?categoryID=101 or your Citrix Support channel folks. I'm fairly certain that XenServer also publish a Hardware Compatibility List, I'd be amazed if there weren't a bunch of HP systems on it. If you want to deploy upstream Xen on a regular distro then IMHO the best advice is to pick a Linux (or BSD) distro which you are familiar with and check if there is any Xen advice for that distro in wiki.xen.org (e.g. http://wiki.xen.org/wiki/Category:Host_Install) or on the distros own wiki. Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 10 10:28:02 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 10:28:02 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqKXO-0003tY-QV; Tue, 10 Dec 2013 10:27:34 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqKXN-0003tT-2k for xen-users@lists.xen.org; Tue, 10 Dec 2013 10:27:33 +0000 Received: from [85.158.137.68:53540] by server-7.bemta-3.messagelabs.com id 85/1C-27599-49CE6A25; Tue, 10 Dec 2013 10:27:32 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-15.tower-31.messagelabs.com!1386671250!2895180!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 6688 invoked from network); 10 Dec 2013 10:27:31 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-15.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 10 Dec 2013 10:27:31 -0000 X-IronPort-AV: E=Sophos;i="4.93,864,1378857600"; d="scan'208";a="80375175" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 10 Dec 2013 10:27:17 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL01.citrite.net (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Tue, 10 Dec 2013 05:27:16 -0500 Message-ID: <1386671235.11925.47.camel@kazak.uk.xensource.com> From: Ian Campbell To: =?UTF-8?Q?=E5=BC=A0=E4=BA=91=E9=9C=84?= Date: Tue, 10 Dec 2013 10:27:15 +0000 In-Reply-To: <3c610e6a.623.142db162054.Coremail.cloud2han9@163.com> References: <3c610e6a.623.142db162054.Coremail.cloud2han9@163.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA2 Cc: xen-users Subject: Re: [Xen-users] hypercall implementation X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org T24gVHVlLCAyMDEzLTEyLTEwIGF0IDEzOjU4ICswODAwLCDlvKDkupHpnIQgd3JvdGU6Cj4gSSBh bSBsZWFybmluZyB4ZW4ncyBtZW1vcnkgbWFuYWdlbWVudCByZWNlbnRseS4gSSBmaW5kIG1vc3Qg ZG9jcyBpcwo+IGhvdyB0byB1c2UgdGhlIGh5cGVyY2FsbCByZWxhdGVkIG1lbW9yeSBtYW5hZ2Vt ZW50LiBDYW4gc29tZXNvbWUgdGVsbAo+IG1lIHdoZXJlIGlzIHRoZSBpbXBsZW1lbnRhdGlvbiBv ZiB0aGUgdGhlbSBpbiB0aGUgeGVuIHNvdXJjZS4KCkhhdmUgeW91IHRyaWVkIHVzaW5nIGUuZy4g Z3JlcD8KCklhbi4KCgoKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX18KWGVuLXVzZXJzIG1haWxpbmcgbGlzdApYZW4tdXNlcnNAbGlzdHMueGVuLm9yZwpodHRw Oi8vbGlzdHMueGVuLm9yZy94ZW4tdXNlcnM= From xen-users-bounces@lists.xen.org Tue Dec 10 10:28:02 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 10:28:02 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqKXO-0003tY-QV; Tue, 10 Dec 2013 10:27:34 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqKXN-0003tT-2k for xen-users@lists.xen.org; Tue, 10 Dec 2013 10:27:33 +0000 Received: from [85.158.137.68:53540] by server-7.bemta-3.messagelabs.com id 85/1C-27599-49CE6A25; Tue, 10 Dec 2013 10:27:32 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-15.tower-31.messagelabs.com!1386671250!2895180!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 6688 invoked from network); 10 Dec 2013 10:27:31 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-15.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 10 Dec 2013 10:27:31 -0000 X-IronPort-AV: E=Sophos;i="4.93,864,1378857600"; d="scan'208";a="80375175" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 10 Dec 2013 10:27:17 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL01.citrite.net (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Tue, 10 Dec 2013 05:27:16 -0500 Message-ID: <1386671235.11925.47.camel@kazak.uk.xensource.com> From: Ian Campbell To: =?UTF-8?Q?=E5=BC=A0=E4=BA=91=E9=9C=84?= Date: Tue, 10 Dec 2013 10:27:15 +0000 In-Reply-To: <3c610e6a.623.142db162054.Coremail.cloud2han9@163.com> References: <3c610e6a.623.142db162054.Coremail.cloud2han9@163.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA2 Cc: xen-users Subject: Re: [Xen-users] hypercall implementation X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org T24gVHVlLCAyMDEzLTEyLTEwIGF0IDEzOjU4ICswODAwLCDlvKDkupHpnIQgd3JvdGU6Cj4gSSBh bSBsZWFybmluZyB4ZW4ncyBtZW1vcnkgbWFuYWdlbWVudCByZWNlbnRseS4gSSBmaW5kIG1vc3Qg ZG9jcyBpcwo+IGhvdyB0byB1c2UgdGhlIGh5cGVyY2FsbCByZWxhdGVkIG1lbW9yeSBtYW5hZ2Vt ZW50LiBDYW4gc29tZXNvbWUgdGVsbAo+IG1lIHdoZXJlIGlzIHRoZSBpbXBsZW1lbnRhdGlvbiBv ZiB0aGUgdGhlbSBpbiB0aGUgeGVuIHNvdXJjZS4KCkhhdmUgeW91IHRyaWVkIHVzaW5nIGUuZy4g Z3JlcD8KCklhbi4KCgoKX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX18KWGVuLXVzZXJzIG1haWxpbmcgbGlzdApYZW4tdXNlcnNAbGlzdHMueGVuLm9yZwpodHRw Oi8vbGlzdHMueGVuLm9yZy94ZW4tdXNlcnM= From xen-users-bounces@lists.xen.org Tue Dec 10 10:41:55 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 10:41:55 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqKl2-0005c3-MT; Tue, 10 Dec 2013 10:41:40 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqKl0-0005bj-WE for xen-users@lists.xensource.com; Tue, 10 Dec 2013 10:41:39 +0000 Received: from [193.109.254.147:41338] by server-15.bemta-14.messagelabs.com id 5E/E7-22186-0EFE6A25; Tue, 10 Dec 2013 10:41:36 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-7.tower-27.messagelabs.com!1386672095!4140531!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 14834 invoked from network); 10 Dec 2013 10:41:36 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-7.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 10 Dec 2013 10:41:36 -0000 X-IronPort-AV: E=Sophos;i="4.93,864,1378857600"; d="scan'208";a="80378445" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 10 Dec 2013 10:41:34 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL02.citrite.net (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Tue, 10 Dec 2013 05:41:34 -0500 Message-ID: <1386672093.11925.52.camel@kazak.uk.xensource.com> From: Ian Campbell To: John Sherwood Date: Tue, 10 Dec 2013 10:41:33 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA1 Cc: xen-users Subject: Re: [Xen-users] Pass through physical TPM X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Mon, 2013-12-09 at 17:51 -0800, John Sherwood wrote: > I'm aware of the Xen vTPM capabilities, but is it possible to directly > pass through the hardware TPM of a host to a domU? I suppose ultimately a TPM is just hardware and therefore you can map it through using either PCI passthrough (if it is a PCI device, I don't know about TPM) or "manually" map the individual i/o ports, mmio regions and interrupts using ioports, iomem and irqs directives in your guest config (see the xl.cfg man page for details). PCI passthrough certainly works with HVM guests. I'm not 100% sure about the others, I can see the hypervisor side code to make ioports work, but the other two are too subtle for me to grok right now ;-) I suggest trying it and seeing... What I can't advise on is all the TPM specific stuff like the attestation and measurement which happens during boot and how that is impacted by the need to start a VM. Maybe that's not an issue -- I really have no idea how that all works or whether Bitlocker even needs it to have happened. Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 10 10:41:55 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 10:41:55 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqKl2-0005c3-MT; Tue, 10 Dec 2013 10:41:40 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqKl0-0005bj-WE for xen-users@lists.xensource.com; Tue, 10 Dec 2013 10:41:39 +0000 Received: from [193.109.254.147:41338] by server-15.bemta-14.messagelabs.com id 5E/E7-22186-0EFE6A25; Tue, 10 Dec 2013 10:41:36 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-7.tower-27.messagelabs.com!1386672095!4140531!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 14834 invoked from network); 10 Dec 2013 10:41:36 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-7.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 10 Dec 2013 10:41:36 -0000 X-IronPort-AV: E=Sophos;i="4.93,864,1378857600"; d="scan'208";a="80378445" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 10 Dec 2013 10:41:34 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL02.citrite.net (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Tue, 10 Dec 2013 05:41:34 -0500 Message-ID: <1386672093.11925.52.camel@kazak.uk.xensource.com> From: Ian Campbell To: John Sherwood Date: Tue, 10 Dec 2013 10:41:33 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA1 Cc: xen-users Subject: Re: [Xen-users] Pass through physical TPM X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Mon, 2013-12-09 at 17:51 -0800, John Sherwood wrote: > I'm aware of the Xen vTPM capabilities, but is it possible to directly > pass through the hardware TPM of a host to a domU? I suppose ultimately a TPM is just hardware and therefore you can map it through using either PCI passthrough (if it is a PCI device, I don't know about TPM) or "manually" map the individual i/o ports, mmio regions and interrupts using ioports, iomem and irqs directives in your guest config (see the xl.cfg man page for details). PCI passthrough certainly works with HVM guests. I'm not 100% sure about the others, I can see the hypervisor side code to make ioports work, but the other two are too subtle for me to grok right now ;-) I suggest trying it and seeing... What I can't advise on is all the TPM specific stuff like the attestation and measurement which happens during boot and how that is impacted by the need to start a VM. Maybe that's not an issue -- I really have no idea how that all works or whether Bitlocker even needs it to have happened. Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 10 10:55:58 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 10:55:58 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqKyd-000745-TK; Tue, 10 Dec 2013 10:55:43 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqKyc-00073n-HJ for xen-users@lists.xen.org; Tue, 10 Dec 2013 10:55:43 +0000 Received: from [85.158.139.211:11861] by server-5.bemta-5.messagelabs.com id D5/6B-14928-D23F6A25; Tue, 10 Dec 2013 10:55:41 +0000 X-Env-Sender: cloud2han9@163.com X-Msg-Ref: server-12.tower-206.messagelabs.com!1386672938!3471772!1 X-Originating-IP: [220.181.13.79] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjEzLjc5ID0+IDUyMTk=\n,sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjEzLjc5ID0+IDUyMTk=\n,HTML_MESSAGE X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 8973 invoked from network); 10 Dec 2013 10:55:39 -0000 Received: from m13-79.163.com (HELO m13-79.163.com) (220.181.13.79) by server-12.tower-206.messagelabs.com with SMTP; 10 Dec 2013 10:55:39 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=163.com; s=s110527; h=Date:From:Subject:Content-Type:MIME-Version: Message-ID; bh=NBMSWIV91xe2OFOzTnV78uMf05aYmmz22TLR8qez+rU=; b=O nveeoBL+3h8LKzQmj82CdFvCFPLyym43dm2caMGXHZD6tKS43WMfTosILCD4bMlh nx9BDfWEBPQYRDEVGrCRh6EJKY0nFJVv/E9dtkaai2whe15lAWpdOBOSsuY+bZgQ 1TXbH+pgG1ql+/S7a3B6AXjoQBkpL1ytmHeth+DcP8= Received: from cloud2han9$163.com ( [222.196.190.204] ) by ajax-webmail-wmsvr79 (Coremail) ; Tue, 10 Dec 2013 18:55:28 +0800 (CST) X-Originating-IP: [222.196.190.204] Date: Tue, 10 Dec 2013 18:55:28 +0800 (CST) From: =?UTF-8?B?5byg5LqR6ZyE?= To: "Ian Campbell" X-Priority: 3 X-Mailer: Coremail Webmail Server Version SP_ntes V3.5 build 20131115(24167.5769.5770) Copyright (c) 2002-2013 www.mailtech.cn 163com In-Reply-To: <1386671235.11925.47.camel@kazak.uk.xensource.com> References: <3c610e6a.623.142db162054.Coremail.cloud2han9@163.com> <1386671235.11925.47.camel@kazak.uk.xensource.com> X-CM-CTRLDATA: OlFdF2Zvb3Rlcl9odG09NDAxOTo4MQ== MIME-Version: 1.0 Message-ID: <15baa64e.7a9.142dc25b689.Coremail.cloud2han9@163.com> X-CM-TRANSID: T8GowED5u0Ih86ZSmwAJAA--.3638W X-CM-SenderInfo: pfor3vwskd0mi6rwjhhfrp/1tbiJRXvVE9pBXjqRgABs9 X-Coremail-Antispam: 1U5529EdanIXcx71UUUUU7vcSsGvfC2KfnxnUU== Cc: xen-users Subject: Re: [Xen-users] hypercall implementation X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============7071782614679248898==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============7071782614679248898== Content-Type: multipart/alternative; boundary="----=_Part_4594_1407201024.1386672928393" ------=_Part_4594_1407201024.1386672928393 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 VGhhbmt5b3UgZm9yIHlvdXIgcmVwbHkhCkkgdXNlIHZpbSArIGN0YWdzLiBJIGhhdmUgdGFnZ2Vk LCBidXQgZ2V0IHRoaXM6CgpzdGF0aWMgaW5saW5lIGludApIWVBFUlZJU09SX21tdV91cGRhdGUo CiAgICAgICAgbW11X3VwZGF0ZV90ICpyZXEsIGludCBjb3VudCwgaW50ICpzdWNjZXNzX2NvdW50 LCBkb21pZF90IGRvbWlkKQp7CiAgICAgICAgcmV0dXJuIF9oeXBlcmNhbGw0KGludCwgbW11X3Vw ZGF0ZSwgcmVxLCBjb3VudCwgc3VjY2Vzc19jb3VudCwgZG9taWQpOwp9CgphbmQgdGhpczoKCiNk ZWZpbmUgX2h5cGVyY2FsbDQodHlwZSwgbmFtZSwgYTEsIGEyLCBhMywgYTQpICAgICAgICAgICAg ICAgICBcCih7ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICBcCiAgICAgICAgbG9uZyBfX3JlcywgX19pZ24xLCBfX2lnbjIsIF9faWdu MzsgICAgICAgICAgICAgICAgICAgICBcCiAgICAgICAgYXNtIHZvbGF0aWxlICggICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBcCiAgICAgICAgICAgICAgICAibW92cSAl NywlJXIxMDsgIiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBcCiAgICAgICAgICAgICAg ICAiY2FsbCBoeXBlcmNhbGxfcGFnZSArICgiU1RSKF9fSFlQRVJWSVNPUl8jI25hbWUpIiAqIDMy KSJcCiAgICAgICAgICAgICAgICA6ICI9YSIgKF9fcmVzKSwgIj1EIiAoX19pZ24xKSwgIj1TIiAo X19pZ24yKSwgICBcCiAgICAgICAgICAgICAgICAiPWQiIChfX2lnbjMpICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICBcCiAgICAgICAgICAgICAgICA6ICIxIiAoKGxvbmcpKGExKSks ICIyIiAoKGxvbmcpKGEyKSksICAgICAgICAgICBcCiAgICAgICAgICAgICAgICAiMyIgKChsb25n KShhMykpLCAiZyIgKChsb25nKShhNCkpICAgICAgICAgICAgICBcCiAgICAgICAgICAgICAgICA6 ICJtZW1vcnkiLCAicjEwIiApOyAgICAgICAgICAgICAgICAgICAgICAgICAgICBcCiAgICAgICAg KHR5cGUpX19yZXM7ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBc Cn0pCgpCdXQgd2hhdCdzIHRoZSBjb250ZW50IChzcmMgY29kZSkgb2YgaHlwZXJjYWxsX3BhZ2U/ IEhvdyBpcyB0aGUgaHlwZXJjYWxsIGltcGxlbWVudGVkPw== ------=_Part_4594_1407201024.1386672928393 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: base64 PGRpdiBzdHlsZT0ibGluZS1oZWlnaHQ6MS43O2NvbG9yOiMwMDAwMDA7Zm9udC1zaXplOjE0cHg7 Zm9udC1mYW1pbHk6YXJpYWwiPlRoYW5reW91Jm5ic3A7Zm9yJm5ic3A7eW91ciZuYnNwO3JlcGx5 ITxicj5JJm5ic3A7dXNlJm5ic3A7dmltJm5ic3A7KyZuYnNwO2N0YWdzLiZuYnNwO0kmbmJzcDto YXZlJm5ic3A7dGFnZ2VkLCZuYnNwO2J1dCZuYnNwO2dldCZuYnNwO3RoaXM6PGJyPjxicj5zdGF0 aWMmbmJzcDtpbmxpbmUmbmJzcDtpbnQ8YnI+SFlQRVJWSVNPUl9tbXVfdXBkYXRlKDxicj4mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDttbXVfdXBkYXRlX3Qm bmJzcDsqcmVxLCZuYnNwO2ludCZuYnNwO2NvdW50LCZuYnNwO2ludCZuYnNwOypzdWNjZXNzX2Nv dW50LCZuYnNwO2RvbWlkX3QmbmJzcDtkb21pZCk8YnI+ezxicj4mbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDtyZXR1cm4mbmJzcDtfaHlwZXJjYWxsNChpbnQs Jm5ic3A7bW11X3VwZGF0ZSwmbmJzcDtyZXEsJm5ic3A7Y291bnQsJm5ic3A7c3VjY2Vzc19jb3Vu dCwmbmJzcDtkb21pZCk7PGJyPn08YnI+PGJyPmFuZCZuYnNwO3RoaXM6PGJyPjxicj4jZGVmaW5l Jm5ic3A7X2h5cGVyY2FsbDQodHlwZSwmbmJzcDtuYW1lLCZuYnNwO2ExLCZuYnNwO2EyLCZuYnNw O2EzLCZuYnNwO2E0KSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw O1w8YnI+KHsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDtcPGJyPiZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwO2xvbmcmbmJzcDtfX3JlcywmbmJzcDtf X2lnbjEsJm5ic3A7X19pZ24yLCZuYnNwO19faWduMzsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDtcPGJyPiZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwO2FzbSZuYnNwO3ZvbGF0aWxl Jm5ic3A7KCZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwO1w8YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Im1vdnEmbmJzcDslNywlJXIxMDsmbmJzcDsiJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7XDxicj4mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsiY2FsbCZuYnNw O2h5cGVyY2FsbF9wYWdlJm5ic3A7KyZuYnNwOygiU1RSKF9fSFlQRVJWSVNPUl8jI25hbWUpIiZu YnNwOyombmJzcDszMikiXDxicj4mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDs6Jm5ic3A7Ij1hIiZuYnNwOyhfX3JlcyksJm5ic3A7Ij1EIiZuYnNwOyhfX2lnbjEpLCZuYnNw OyI9UyImbmJzcDsoX19pZ24yKSwmbmJzcDsmbmJzcDsmbmJzcDtcPGJyPiZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyI9ZCImbmJzcDsoX19pZ24zKSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwO1w8YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7OiZuYnNwOyIxIiZuYnNwOygobG9uZykoYTEpKSwmbmJzcDsiMiImbmJzcDso KGxvbmcpKGEyKSksJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7XDxicj4mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsiMyImbmJzcDsoKGxvbmcpKGEzKSksJm5ic3A7ImciJm5ic3A7KChsb25nKShhNCkp Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7XDxicj4mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDs6Jm5ic3A7Im1lbW9yeSIsJm5ic3A7InIxMCImbmJzcDspOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwO1w8YnI+Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7KHR5cGUpX19yZXM7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7XDxicj59KTxicj48YnI+QnV0Jm5ic3A7 d2hhdCdzJm5ic3A7dGhlJm5ic3A7Y29udGVudCZuYnNwOyhzcmMmbmJzcDtjb2RlKSZuYnNwO29m Jm5ic3A7aHlwZXJjYWxsX3BhZ2U/Jm5ic3A7SG93Jm5ic3A7aXMmbmJzcDt0aGUmbmJzcDtoeXBl cmNhbGwmbmJzcDtpbXBsZW1lbnRlZD88L2Rpdj48YnI+PGJyPjxzcGFuIHRpdGxlPSJuZXRlYXNl Zm9vdGVyIj48c3BhbiBpZD0ibmV0ZWFzZV9tYWlsX2Zvb3RlciI+PC9zcGFuPjwvc3Bhbj4= ------=_Part_4594_1407201024.1386672928393-- --===============7071782614679248898== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============7071782614679248898==-- From xen-users-bounces@lists.xen.org Tue Dec 10 10:55:58 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 10:55:58 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqKyd-000745-TK; Tue, 10 Dec 2013 10:55:43 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqKyc-00073n-HJ for xen-users@lists.xen.org; Tue, 10 Dec 2013 10:55:43 +0000 Received: from [85.158.139.211:11861] by server-5.bemta-5.messagelabs.com id D5/6B-14928-D23F6A25; Tue, 10 Dec 2013 10:55:41 +0000 X-Env-Sender: cloud2han9@163.com X-Msg-Ref: server-12.tower-206.messagelabs.com!1386672938!3471772!1 X-Originating-IP: [220.181.13.79] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjEzLjc5ID0+IDUyMTk=\n,sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjEzLjc5ID0+IDUyMTk=\n,HTML_MESSAGE X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 8973 invoked from network); 10 Dec 2013 10:55:39 -0000 Received: from m13-79.163.com (HELO m13-79.163.com) (220.181.13.79) by server-12.tower-206.messagelabs.com with SMTP; 10 Dec 2013 10:55:39 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=163.com; s=s110527; h=Date:From:Subject:Content-Type:MIME-Version: Message-ID; bh=NBMSWIV91xe2OFOzTnV78uMf05aYmmz22TLR8qez+rU=; b=O nveeoBL+3h8LKzQmj82CdFvCFPLyym43dm2caMGXHZD6tKS43WMfTosILCD4bMlh nx9BDfWEBPQYRDEVGrCRh6EJKY0nFJVv/E9dtkaai2whe15lAWpdOBOSsuY+bZgQ 1TXbH+pgG1ql+/S7a3B6AXjoQBkpL1ytmHeth+DcP8= Received: from cloud2han9$163.com ( [222.196.190.204] ) by ajax-webmail-wmsvr79 (Coremail) ; Tue, 10 Dec 2013 18:55:28 +0800 (CST) X-Originating-IP: [222.196.190.204] Date: Tue, 10 Dec 2013 18:55:28 +0800 (CST) From: =?UTF-8?B?5byg5LqR6ZyE?= To: "Ian Campbell" X-Priority: 3 X-Mailer: Coremail Webmail Server Version SP_ntes V3.5 build 20131115(24167.5769.5770) Copyright (c) 2002-2013 www.mailtech.cn 163com In-Reply-To: <1386671235.11925.47.camel@kazak.uk.xensource.com> References: <3c610e6a.623.142db162054.Coremail.cloud2han9@163.com> <1386671235.11925.47.camel@kazak.uk.xensource.com> X-CM-CTRLDATA: OlFdF2Zvb3Rlcl9odG09NDAxOTo4MQ== MIME-Version: 1.0 Message-ID: <15baa64e.7a9.142dc25b689.Coremail.cloud2han9@163.com> X-CM-TRANSID: T8GowED5u0Ih86ZSmwAJAA--.3638W X-CM-SenderInfo: pfor3vwskd0mi6rwjhhfrp/1tbiJRXvVE9pBXjqRgABs9 X-Coremail-Antispam: 1U5529EdanIXcx71UUUUU7vcSsGvfC2KfnxnUU== Cc: xen-users Subject: Re: [Xen-users] hypercall implementation X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============7071782614679248898==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============7071782614679248898== Content-Type: multipart/alternative; boundary="----=_Part_4594_1407201024.1386672928393" ------=_Part_4594_1407201024.1386672928393 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 VGhhbmt5b3UgZm9yIHlvdXIgcmVwbHkhCkkgdXNlIHZpbSArIGN0YWdzLiBJIGhhdmUgdGFnZ2Vk LCBidXQgZ2V0IHRoaXM6CgpzdGF0aWMgaW5saW5lIGludApIWVBFUlZJU09SX21tdV91cGRhdGUo CiAgICAgICAgbW11X3VwZGF0ZV90ICpyZXEsIGludCBjb3VudCwgaW50ICpzdWNjZXNzX2NvdW50 LCBkb21pZF90IGRvbWlkKQp7CiAgICAgICAgcmV0dXJuIF9oeXBlcmNhbGw0KGludCwgbW11X3Vw ZGF0ZSwgcmVxLCBjb3VudCwgc3VjY2Vzc19jb3VudCwgZG9taWQpOwp9CgphbmQgdGhpczoKCiNk ZWZpbmUgX2h5cGVyY2FsbDQodHlwZSwgbmFtZSwgYTEsIGEyLCBhMywgYTQpICAgICAgICAgICAg ICAgICBcCih7ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAg ICAgICAgICAgICAgICBcCiAgICAgICAgbG9uZyBfX3JlcywgX19pZ24xLCBfX2lnbjIsIF9faWdu MzsgICAgICAgICAgICAgICAgICAgICBcCiAgICAgICAgYXNtIHZvbGF0aWxlICggICAgICAgICAg ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBcCiAgICAgICAgICAgICAgICAibW92cSAl NywlJXIxMDsgIiAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBcCiAgICAgICAgICAgICAg ICAiY2FsbCBoeXBlcmNhbGxfcGFnZSArICgiU1RSKF9fSFlQRVJWSVNPUl8jI25hbWUpIiAqIDMy KSJcCiAgICAgICAgICAgICAgICA6ICI9YSIgKF9fcmVzKSwgIj1EIiAoX19pZ24xKSwgIj1TIiAo X19pZ24yKSwgICBcCiAgICAgICAgICAgICAgICAiPWQiIChfX2lnbjMpICAgICAgICAgICAgICAg ICAgICAgICAgICAgICAgICAgICBcCiAgICAgICAgICAgICAgICA6ICIxIiAoKGxvbmcpKGExKSks ICIyIiAoKGxvbmcpKGEyKSksICAgICAgICAgICBcCiAgICAgICAgICAgICAgICAiMyIgKChsb25n KShhMykpLCAiZyIgKChsb25nKShhNCkpICAgICAgICAgICAgICBcCiAgICAgICAgICAgICAgICA6 ICJtZW1vcnkiLCAicjEwIiApOyAgICAgICAgICAgICAgICAgICAgICAgICAgICBcCiAgICAgICAg KHR5cGUpX19yZXM7ICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBc Cn0pCgpCdXQgd2hhdCdzIHRoZSBjb250ZW50IChzcmMgY29kZSkgb2YgaHlwZXJjYWxsX3BhZ2U/ IEhvdyBpcyB0aGUgaHlwZXJjYWxsIGltcGxlbWVudGVkPw== ------=_Part_4594_1407201024.1386672928393 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: base64 PGRpdiBzdHlsZT0ibGluZS1oZWlnaHQ6MS43O2NvbG9yOiMwMDAwMDA7Zm9udC1zaXplOjE0cHg7 Zm9udC1mYW1pbHk6YXJpYWwiPlRoYW5reW91Jm5ic3A7Zm9yJm5ic3A7eW91ciZuYnNwO3JlcGx5 ITxicj5JJm5ic3A7dXNlJm5ic3A7dmltJm5ic3A7KyZuYnNwO2N0YWdzLiZuYnNwO0kmbmJzcDto YXZlJm5ic3A7dGFnZ2VkLCZuYnNwO2J1dCZuYnNwO2dldCZuYnNwO3RoaXM6PGJyPjxicj5zdGF0 aWMmbmJzcDtpbmxpbmUmbmJzcDtpbnQ8YnI+SFlQRVJWSVNPUl9tbXVfdXBkYXRlKDxicj4mbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDttbXVfdXBkYXRlX3Qm bmJzcDsqcmVxLCZuYnNwO2ludCZuYnNwO2NvdW50LCZuYnNwO2ludCZuYnNwOypzdWNjZXNzX2Nv dW50LCZuYnNwO2RvbWlkX3QmbmJzcDtkb21pZCk8YnI+ezxicj4mbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDtyZXR1cm4mbmJzcDtfaHlwZXJjYWxsNChpbnQs Jm5ic3A7bW11X3VwZGF0ZSwmbmJzcDtyZXEsJm5ic3A7Y291bnQsJm5ic3A7c3VjY2Vzc19jb3Vu dCwmbmJzcDtkb21pZCk7PGJyPn08YnI+PGJyPmFuZCZuYnNwO3RoaXM6PGJyPjxicj4jZGVmaW5l Jm5ic3A7X2h5cGVyY2FsbDQodHlwZSwmbmJzcDtuYW1lLCZuYnNwO2ExLCZuYnNwO2EyLCZuYnNw O2EzLCZuYnNwO2E0KSZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw O1w8YnI+KHsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDtcPGJyPiZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwO2xvbmcmbmJzcDtfX3JlcywmbmJzcDtf X2lnbjEsJm5ic3A7X19pZ24yLCZuYnNwO19faWduMzsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDtcPGJyPiZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwO2FzbSZuYnNwO3ZvbGF0aWxl Jm5ic3A7KCZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwO1w8YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Im1vdnEmbmJzcDslNywlJXIxMDsmbmJzcDsiJm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7XDxicj4mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsiY2FsbCZuYnNw O2h5cGVyY2FsbF9wYWdlJm5ic3A7KyZuYnNwOygiU1RSKF9fSFlQRVJWSVNPUl8jI25hbWUpIiZu YnNwOyombmJzcDszMikiXDxicj4mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDs6Jm5ic3A7Ij1hIiZuYnNwOyhfX3JlcyksJm5ic3A7Ij1EIiZuYnNwOyhfX2lnbjEpLCZuYnNw OyI9UyImbmJzcDsoX19pZ24yKSwmbmJzcDsmbmJzcDsmbmJzcDtcPGJyPiZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyI9ZCImbmJzcDsoX19pZ24zKSZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwO1w8YnI+Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7OiZuYnNwOyIxIiZuYnNwOygobG9uZykoYTEpKSwmbmJzcDsiMiImbmJzcDso KGxvbmcpKGEyKSksJm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7XDxicj4mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsiMyImbmJzcDsoKGxvbmcpKGEzKSksJm5ic3A7ImciJm5ic3A7KChsb25nKShhNCkp Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7XDxicj4mbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsm bmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJzcDsmbmJz cDsmbmJzcDsmbmJzcDs6Jm5ic3A7Im1lbW9yeSIsJm5ic3A7InIxMCImbmJzcDspOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNw OyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZu YnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwOyZuYnNwO1w8YnI+Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7KHR5cGUpX19yZXM7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7 Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5i c3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7Jm5ic3A7XDxicj59KTxicj48YnI+QnV0Jm5ic3A7 d2hhdCdzJm5ic3A7dGhlJm5ic3A7Y29udGVudCZuYnNwOyhzcmMmbmJzcDtjb2RlKSZuYnNwO29m Jm5ic3A7aHlwZXJjYWxsX3BhZ2U/Jm5ic3A7SG93Jm5ic3A7aXMmbmJzcDt0aGUmbmJzcDtoeXBl cmNhbGwmbmJzcDtpbXBsZW1lbnRlZD88L2Rpdj48YnI+PGJyPjxzcGFuIHRpdGxlPSJuZXRlYXNl Zm9vdGVyIj48c3BhbiBpZD0ibmV0ZWFzZV9tYWlsX2Zvb3RlciI+PC9zcGFuPjwvc3Bhbj4= ------=_Part_4594_1407201024.1386672928393-- --===============7071782614679248898== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============7071782614679248898==-- From xen-users-bounces@lists.xen.org Tue Dec 10 11:02:57 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 11:02:57 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqL5F-0007dC-0t; Tue, 10 Dec 2013 11:02:33 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqL5D-0007d4-Gg for xen-users@lists.xen.org; Tue, 10 Dec 2013 11:02:31 +0000 Received: from [193.109.254.147:48266] by server-15.bemta-14.messagelabs.com id 7A/D0-22186-6C4F6A25; Tue, 10 Dec 2013 11:02:30 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-15.tower-27.messagelabs.com!1386673348!4149271!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 12269 invoked from network); 10 Dec 2013 11:02:30 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-15.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 10 Dec 2013 11:02:30 -0000 X-IronPort-AV: E=Sophos;i="4.93,865,1378857600"; d="scan'208";a="80383874" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 10 Dec 2013 11:02:01 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL01.citrite.net (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Tue, 10 Dec 2013 06:02:00 -0500 Message-ID: <1386673319.11925.56.camel@kazak.uk.xensource.com> From: Ian Campbell To: =?UTF-8?Q?=E5=BC=A0=E4=BA=91=E9=9C=84?= Date: Tue, 10 Dec 2013 11:01:59 +0000 In-Reply-To: <15baa64e.7a9.142dc25b689.Coremail.cloud2han9@163.com> References: <3c610e6a.623.142db162054.Coremail.cloud2han9@163.com> <1386671235.11925.47.camel@kazak.uk.xensource.com> <15baa64e.7a9.142dc25b689.Coremail.cloud2han9@163.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA1 Cc: xen-users Subject: Re: [Xen-users] hypercall implementation X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org T24gVHVlLCAyMDEzLTEyLTEwIGF0IDE4OjU1ICswODAwLCDlvKDkupHpnIQgd3JvdGU6Cj4gQnV0 IHdoYXQncyB0aGUgY29udGVudCAoc3JjIGNvZGUpIG9mIGh5cGVyY2FsbF9wYWdlPwo+ICBIb3cg aXMgdGhlIGh5cGVyY2FsbCBpbXBsZW1lbnRlZD8KCllvdSBuZWVkIHRvIGJlIGxvb2tpbmcgb24g dGhlIGh5cGVydmlzb3Igc2lkZSBmb3IgdGhhdC4gSXQgaXMgYSBwYWdlIG9mCmNvZGUgd2hpY2gg aXMgbWFwcGVkIGludG8gdGhlIGd1ZXN0IGtlcm5lbCBhbmQgY29udGFpbnMgdGhlIG5lY2Vzc2Fy eQppbnN0cnVjdGlvbnMgKGludCAweDgyLCBzeXNjYWxsLCB2bWNhbGwsIGV0YykgZGVwZW5kaW5n IG9uIHRoZSBndWVzdAp0eXBlIGV0Yy4gRm9yIGEgUFYgZ3Vlc3QgaXQgaXMgcG9wdWxhdGVkIGJ5 IHRoZSBYZW4gdG9vbHMgYXNraW5nIHRoZQpoeXBlcnZpc29yIHRvIGRvIHNvIGR1cmluZyBndWVz dCBidWlsZCBhbmQgZm9yIGEgUFZIVk0gZ3Vlc3QgaXQgaXMKcG9wdWxhdGVkIGJ5IHRoZSBndWVz dCB3cml0aW5nIHRvIGEgc3BlY2lhbCBNU1IsIHNlZSBlbmxpZ2h0ZW4uYyBpbiB0aGUKTGludXgg a2VybmVsLCBzcGVjaWZpY2FsbHkgaW5pdF9odm1fcHZfaW5mbygpLgoKSWFuLgoKCgpfX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpYZW4tdXNlcnMgbWFpbGlu ZyBsaXN0Clhlbi11c2Vyc0BsaXN0cy54ZW4ub3JnCmh0dHA6Ly9saXN0cy54ZW4ub3JnL3hlbi11 c2Vycw== From xen-users-bounces@lists.xen.org Tue Dec 10 11:02:57 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 11:02:57 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqL5F-0007dC-0t; Tue, 10 Dec 2013 11:02:33 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqL5D-0007d4-Gg for xen-users@lists.xen.org; Tue, 10 Dec 2013 11:02:31 +0000 Received: from [193.109.254.147:48266] by server-15.bemta-14.messagelabs.com id 7A/D0-22186-6C4F6A25; Tue, 10 Dec 2013 11:02:30 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-15.tower-27.messagelabs.com!1386673348!4149271!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 12269 invoked from network); 10 Dec 2013 11:02:30 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-15.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 10 Dec 2013 11:02:30 -0000 X-IronPort-AV: E=Sophos;i="4.93,865,1378857600"; d="scan'208";a="80383874" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 10 Dec 2013 11:02:01 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL01.citrite.net (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Tue, 10 Dec 2013 06:02:00 -0500 Message-ID: <1386673319.11925.56.camel@kazak.uk.xensource.com> From: Ian Campbell To: =?UTF-8?Q?=E5=BC=A0=E4=BA=91=E9=9C=84?= Date: Tue, 10 Dec 2013 11:01:59 +0000 In-Reply-To: <15baa64e.7a9.142dc25b689.Coremail.cloud2han9@163.com> References: <3c610e6a.623.142db162054.Coremail.cloud2han9@163.com> <1386671235.11925.47.camel@kazak.uk.xensource.com> <15baa64e.7a9.142dc25b689.Coremail.cloud2han9@163.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA1 Cc: xen-users Subject: Re: [Xen-users] hypercall implementation X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org T24gVHVlLCAyMDEzLTEyLTEwIGF0IDE4OjU1ICswODAwLCDlvKDkupHpnIQgd3JvdGU6Cj4gQnV0 IHdoYXQncyB0aGUgY29udGVudCAoc3JjIGNvZGUpIG9mIGh5cGVyY2FsbF9wYWdlPwo+ICBIb3cg aXMgdGhlIGh5cGVyY2FsbCBpbXBsZW1lbnRlZD8KCllvdSBuZWVkIHRvIGJlIGxvb2tpbmcgb24g dGhlIGh5cGVydmlzb3Igc2lkZSBmb3IgdGhhdC4gSXQgaXMgYSBwYWdlIG9mCmNvZGUgd2hpY2gg aXMgbWFwcGVkIGludG8gdGhlIGd1ZXN0IGtlcm5lbCBhbmQgY29udGFpbnMgdGhlIG5lY2Vzc2Fy eQppbnN0cnVjdGlvbnMgKGludCAweDgyLCBzeXNjYWxsLCB2bWNhbGwsIGV0YykgZGVwZW5kaW5n IG9uIHRoZSBndWVzdAp0eXBlIGV0Yy4gRm9yIGEgUFYgZ3Vlc3QgaXQgaXMgcG9wdWxhdGVkIGJ5 IHRoZSBYZW4gdG9vbHMgYXNraW5nIHRoZQpoeXBlcnZpc29yIHRvIGRvIHNvIGR1cmluZyBndWVz dCBidWlsZCBhbmQgZm9yIGEgUFZIVk0gZ3Vlc3QgaXQgaXMKcG9wdWxhdGVkIGJ5IHRoZSBndWVz dCB3cml0aW5nIHRvIGEgc3BlY2lhbCBNU1IsIHNlZSBlbmxpZ2h0ZW4uYyBpbiB0aGUKTGludXgg a2VybmVsLCBzcGVjaWZpY2FsbHkgaW5pdF9odm1fcHZfaW5mbygpLgoKSWFuLgoKCgpfX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpYZW4tdXNlcnMgbWFpbGlu ZyBsaXN0Clhlbi11c2Vyc0BsaXN0cy54ZW4ub3JnCmh0dHA6Ly9saXN0cy54ZW4ub3JnL3hlbi11 c2Vycw== From xen-users-bounces@lists.xen.org Tue Dec 10 12:48:00 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 12:48:00 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMiF-0005JE-L6; Tue, 10 Dec 2013 12:46:55 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMiC-0005J9-VB for xen-users@lists.xen.org; Tue, 10 Dec 2013 12:46:54 +0000 Received: from [85.158.139.211:52703] by server-8.bemta-5.messagelabs.com id CD/F6-29838-C3D07A25; Tue, 10 Dec 2013 12:46:52 +0000 X-Env-Sender: cloud2han9@163.com X-Msg-Ref: server-16.tower-206.messagelabs.com!1386679608!2280031!1 X-Originating-IP: [220.181.13.79] X-SpamReason: No, hits=0.9 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjEzLjc5ID0+IDUyMTk=\n,sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjEzLjc5ID0+IDUyMTk=\n,HTML_20_30,HTML_MESSAGE X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 6256 invoked from network); 10 Dec 2013 12:46:50 -0000 Received: from m13-79.163.com (HELO m13-79.163.com) (220.181.13.79) by server-16.tower-206.messagelabs.com with SMTP; 10 Dec 2013 12:46:50 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=163.com; s=s110527; h=Date:From:Subject:Content-Type:MIME-Version: Message-ID; bh=D4hMzwiy3n4be5cJXL7Jkuf5iDl7O82bpwbQSTkiCYk=; b=L BH7D49rBK21glLC6/ReeefUXa+SvaE9QUWVnLHBmkl5iAn7SO0DHNVZscnlHRtF3 wmZcb+9dgkrZkW32JwtbfcjJZu2pVO5emUnsvMJIeVnYO97bYta5q1UbpIgXsqr1 sf1e7anYFeu9D1KGIbMkRBXOYLPIYWS3+j+8Z6o6sY= Received: from cloud2han9$163.com ( [222.196.190.204] ) by ajax-webmail-wmsvr79 (Coremail) ; Tue, 10 Dec 2013 20:46:28 +0800 (CST) X-Originating-IP: [222.196.190.204] Date: Tue, 10 Dec 2013 20:46:28 +0800 (CST) From: =?UTF-8?B?5byg5LqR6ZyE?= To: "Ian Campbell" X-Priority: 3 X-Mailer: Coremail Webmail Server Version SP_ntes V3.5 build 20131115(24167.5769.5770) Copyright (c) 2002-2013 www.mailtech.cn 163com In-Reply-To: <1386673319.11925.56.camel@kazak.uk.xensource.com> References: <3c610e6a.623.142db162054.Coremail.cloud2han9@163.com> <1386671235.11925.47.camel@kazak.uk.xensource.com> <15baa64e.7a9.142dc25b689.Coremail.cloud2han9@163.com> <1386673319.11925.56.camel@kazak.uk.xensource.com> X-CM-CTRLDATA: swo90GZvb3Rlcl9odG09MjA2Mzo4MQ== MIME-Version: 1.0 Message-ID: <2e8a6480.82b.142dc8b54c2.Coremail.cloud2han9@163.com> X-CM-TRANSID: T8GowEBpLEMlDadSexgJAA--.10496W X-CM-SenderInfo: pfor3vwskd0mi6rwjhhfrp/xtbBDQXvVFIwONaQ3wAAsw X-Coremail-Antispam: 1U5529EdanIXcx71UUUUU7vcSsGvfC2KfnxnUU== Cc: xen-users Subject: Re: [Xen-users] hypercall implementation X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============8429133706030628598==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============8429133706030628598== Content-Type: multipart/alternative; boundary="----=_Part_4878_823759293.1386679588034" ------=_Part_4878_823759293.1386679588034 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 SSB0YWxrZWQgYWJvdXQgUFYuCgpJIGtub3cgdGhlIGh5cGVyY2FsbCdzIGltcGxlbWVudGF0aW9u IG1lY2hhbmlzbSwgYnV0IGh5cGVyY2FsbCdzIGNhbGwgdHJlZS4KCkZyb20gdGhlIGJvb2ssIFRo ZSBEZWZpbml0aXZlIEd1aWRlIHRvIFhlbiBIeXBlcnZpc29yLCBJIGtub3duIHRoYXQgdGhlICJn ZW5lcmljIGJ1aWxkZXIiIHdpbGwgYXV0b21hdGljYWxseSBtYXAgdGhlIGh5cGVyY2FsbCBwYWdl IGF0IG9uZSBwYWdlIGluZGljYXRlZCBieSB0aGUga2V5ICJIWVBFUkNBTExfUEFHRSIgaW4gdGhl IGd1ZXN0IGtlcm5lbCBlbGYncyAgc2VjdGlvbiAiX194ZW5fZ3Vlc3QgIiBpbnRvIHRoZSBndWVz dCBvcycgYWRkcmVzcyBzcGFjZS4gSSBoYXZlIHNlYXJjaGVkIHRoZSBYZW4gc291cmNlIGNvZGUu IEkgY2FuJ3QgZmluZCB0aGUgaHlwZXJjYWxsIHBhZ2UncyBzb3VyY2UgY29kZS4gV2hlcmUgaXMg aXQ/CgoKSW4gYWRkaXRpb24sICBUaGUgYm9vayBtZW50aW9uZWQgYWJvdmUgZGVzY3JpYmVzIHhl bicgaW50ZXJuYWxzIHdlbGwgbWFpbmx5IGluIEVuZ2xpc2guIEluIG9yZGVyIHRvIGtub3cgWGVu IGV4YWN0bHksIEkgdGhpbmsgSSBtdXN0IHJlYWQgWGVuJ3Mgc291cmNlIGNvZGUuIElzIHRoZXJl IHNvbWUgcmVzb3VyY2UoYm9vaywgYmxvZywgcGFwZXIsIGV0YykgZGVzY3JpcGluZyBYZW4gaHlw ZXJ2aXNvciBtYWlubHkgaW4gQyBsYW5ndWFnZS4gSSBuZWVkIGEgc3RhcnQgcG9pbnQgaW4gWGVu J3Mgc291cmNlIGNvZGUgdG8gZXhwbG9yZSBYZW4gaHlwZXJ2aXNvciBvciBhIHBhdGggdGhyb3Vn aCBpdC4gRG8geW91IGhhdmUgc29tZSBzdWdnZXN0aW9uID8gVGhhbmdrcy4KCkNsb3VkIFpoYW5n LgoKCgoKCuW5tOWwkeS4jeaDp+axn+a5luiAge+8jOaUvuatjOWbm+a1t+S7u+mAjemBpeOAguac quino+WJjei3r+WkmuWwkeS6i++8jOassuS4jumdkuWkqeivleavlOmrmOOAggoKCgrlnKgyMDEz 5bm0MTLmnIgxMCAxOeaXtjAx5YiG77yMIklhbiBDYW1wYmVsbCI8SWFuLkNhbXBiZWxsQGNpdHJp eC5jb20+5YaZ6YGT77yaCgpPbiBUdWUsIDIwMTMtMTItMTAgYXQgMTg6NTUgKzA4MDAsIOW8oOS6 kemchCB3cm90ZToKPiBCdXQgd2hhdCdzIHRoZSBjb250ZW50IChzcmMgY29kZSkgb2YgaHlwZXJj YWxsX3BhZ2U/Cj4gIEhvdyBpcyB0aGUgaHlwZXJjYWxsIGltcGxlbWVudGVkPwoKWW91IG5lZWQg dG8gYmUgbG9va2luZyBvbiB0aGUgaHlwZXJ2aXNvciBzaWRlIGZvciB0aGF0LiBJdCBpcyBhIHBh Z2Ugb2YKY29kZSB3aGljaCBpcyBtYXBwZWQgaW50byB0aGUgZ3Vlc3Qga2VybmVsIGFuZCBjb250 YWlucyB0aGUgbmVjZXNzYXJ5Cmluc3RydWN0aW9ucyAoaW50IDB4ODIsIHN5c2NhbGwsIHZtY2Fs bCwgZXRjKSBkZXBlbmRpbmcgb24gdGhlIGd1ZXN0CnR5cGUgZXRjLiBGb3IgYSBQViBndWVzdCBp dCBpcyBwb3B1bGF0ZWQgYnkgdGhlIFhlbiB0b29scyBhc2tpbmcgdGhlCmh5cGVydmlzb3IgdG8g ZG8gc28gZHVyaW5nIGd1ZXN0IGJ1aWxkIGFuZCBmb3IgYSBQVkhWTSBndWVzdCBpdCBpcwpwb3B1 bGF0ZWQgYnkgdGhlIGd1ZXN0IHdyaXRpbmcgdG8gYSBzcGVjaWFsIE1TUiwgc2VlIGVubGlnaHRl bi5jIGluIHRoZQpMaW51eCBrZXJuZWwsIHNwZWNpZmljYWxseSBpbml0X2h2bV9wdl9pbmZvKCku CgpJYW4uCgoK ------=_Part_4878_823759293.1386679588034 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: base64 PGRpdj48L2Rpdj48ZGl2IHN0eWxlPSJjb2xvcjojMDAwOyBmb250LXNpemU6IDE0cHg7Zm9udC1m YW1pbHk6IGFyaWFsOyI+PGRpdj5JIHRhbGtlZCBhYm91dCBQVi4gPGJyPjxicj5JIGtub3cgdGhl IGh5cGVyY2FsbCdzIGltcGxlbWVudGF0aW9uIG1lY2hhbmlzbSwgYnV0IGh5cGVyY2FsbCdzIGNh bGwgdHJlZS48YnI+PGJyPkZyb20gdGhlIGJvb2ssIFRoZSBEZWZpbml0aXZlIEd1aWRlIHRvIFhl biBIeXBlcnZpc29yLCBJIGtub3duIHRoYXQgdGhlICJnZW5lcmljIGJ1aWxkZXIiIHdpbGwgYXV0 b21hdGljYWxseSBtYXAgdGhlIGh5cGVyY2FsbCBwYWdlIGF0IG9uZSBwYWdlIGluZGljYXRlZCBi eSB0aGUga2V5ICJIWVBFUkNBTExfUEFHRSIgaW4gdGhlIGd1ZXN0IGtlcm5lbCBlbGYncyZuYnNw OyBzZWN0aW9uICJfX3hlbl9ndWVzdCAiIGludG8gdGhlIGd1ZXN0IG9zJyBhZGRyZXNzIHNwYWNl LiBJIGhhdmUgc2VhcmNoZWQgdGhlIFhlbiBzb3VyY2UgY29kZS4gSSBjYW4ndCBmaW5kIHRoZSBo eXBlcmNhbGwgcGFnZSdzIHNvdXJjZSBjb2RlLiBXaGVyZSBpcyBpdD88YnI+PGJyPjwvZGl2Pklu IGFkZGl0aW9uLCZuYnNwOyBUaGUgYm9vayBtZW50aW9uZWQgYWJvdmUgZGVzY3JpYmVzIHhlbicg aW50ZXJuYWxzIHdlbGwgbWFpbmx5IGluIEVuZ2xpc2guIEluIG9yZGVyIHRvIGtub3cgWGVuIGV4 YWN0bHksIEkgdGhpbmsgSSBtdXN0IHJlYWQgWGVuJ3Mgc291cmNlIGNvZGUuIElzIHRoZXJlIHNv bWUgcmVzb3VyY2UoYm9vaywgYmxvZywgcGFwZXIsIGV0YykgZGVzY3JpcGluZyBYZW4gaHlwZXJ2 aXNvciBtYWlubHkgaW4gQyBsYW5ndWFnZS4gSSBuZWVkIGEgc3RhcnQgcG9pbnQgaW4gWGVuJ3Mg c291cmNlIGNvZGUgdG8gZXhwbG9yZSBYZW4gaHlwZXJ2aXNvciBvciBhIHBhdGggdGhyb3VnaCBp dC4gRG8geW91IGhhdmUgc29tZSBzdWdnZXN0aW9uID8gVGhhbmdrcy48YnI+PGJyPkNsb3VkIFpo YW5nLjxicj48ZGl2Pjxicj48L2Rpdj48ZGl2Pjxicj48L2Rpdj48L2Rpdj48ZGl2PjwvZGl2Pjxk aXYgaWQ9InNwbkVkaXRvclNpZ24iIG5hbWU9IjEwMCI+PGRpdj48ZGl2PuW5tOWwkeS4jeaDp+ax n+a5luiAge+8jOaUvuatjOWbm+a1t+S7u+mAjemBpeOAguacquino+WJjei3r+WkmuWwkeS6i++8 jOassuS4jumdkuWkqeivleavlOmrmOOAgjxicj48L2Rpdj48L2Rpdj48L2Rpdj48ZGl2PjwvZGl2 PjxkaXY+PGJyPjwvZGl2PjxkaXY+PC9kaXY+PCEtLSBqeTVDb250ZW50U3VmZml4IC0tPjxkaXY+ 5ZyoMjAxM+W5tDEy5pyIMTAgMTnml7YwMeWIhu+8jCJJYW4gQ2FtcGJlbGwiJmx0O0lhbi5DYW1w YmVsbEBjaXRyaXguY29tJmd0O+WGmemBk++8mjwvZGl2PjxibG9ja3F1b3RlIGlkPSJpc1JlcGx5 Q29udGVudCIgc3R5bGU9InBhZGRpbmctbGVmdDoxZXg7IG1hcmdpbjogMHB4IDBweCAwcHggMC44 ZXg7IEJPUkRFUi1MRUZUOiAjY2NjIDFweCBzb2xpZCI+PGJyPiBPbiBUdWUsIDIwMTMtMTItMTAg YXQgMTg6NTUgKzA4MDAsIOW8oOS6kemchCB3cm90ZTo8YnI+Jmd0OyBCdXQgd2hhdCdzIHRoZSBj b250ZW50IChzcmMgY29kZSkgb2YgaHlwZXJjYWxsX3BhZ2U/PGJyPiZndDsgJm5ic3A7SG93IGlz IHRoZSBoeXBlcmNhbGwgaW1wbGVtZW50ZWQ/PGJyPjxicj5Zb3UgbmVlZCB0byBiZSBsb29raW5n IG9uIHRoZSBoeXBlcnZpc29yIHNpZGUgZm9yIHRoYXQuIEl0IGlzIGEgcGFnZSBvZjxicj5jb2Rl IHdoaWNoIGlzIG1hcHBlZCBpbnRvIHRoZSBndWVzdCBrZXJuZWwgYW5kIGNvbnRhaW5zIHRoZSBu ZWNlc3Nhcnk8YnI+aW5zdHJ1Y3Rpb25zIChpbnQgMHg4Miwgc3lzY2FsbCwgdm1jYWxsLCBldGMp IGRlcGVuZGluZyBvbiB0aGUgZ3Vlc3Q8YnI+dHlwZSBldGMuIEZvciBhIFBWIGd1ZXN0IGl0IGlz IHBvcHVsYXRlZCBieSB0aGUgWGVuIHRvb2xzIGFza2luZyB0aGU8YnI+aHlwZXJ2aXNvciB0byBk byBzbyBkdXJpbmcgZ3Vlc3QgYnVpbGQgYW5kIGZvciBhIFBWSFZNIGd1ZXN0IGl0IGlzPGJyPnBv cHVsYXRlZCBieSB0aGUgZ3Vlc3Qgd3JpdGluZyB0byBhIHNwZWNpYWwgTVNSLCBzZWUgZW5saWdo dGVuLmMgaW4gdGhlPGJyPkxpbnV4IGtlcm5lbCwgc3BlY2lmaWNhbGx5IGluaXRfaHZtX3B2X2lu Zm8oKS48YnI+PGJyPklhbi48YnI+PGJyPjxicj48L2Jsb2NrcXVvdGU+PGJyPjxicj48c3BhbiB0 aXRsZT0ibmV0ZWFzZWZvb3RlciI+PHNwYW4gaWQ9Im5ldGVhc2VfbWFpbF9mb290ZXIiPjwvc3Bh bj48L3NwYW4+ ------=_Part_4878_823759293.1386679588034-- --===============8429133706030628598== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============8429133706030628598==-- From xen-users-bounces@lists.xen.org Tue Dec 10 12:48:00 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 12:48:00 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMiF-0005JE-L6; Tue, 10 Dec 2013 12:46:55 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMiC-0005J9-VB for xen-users@lists.xen.org; Tue, 10 Dec 2013 12:46:54 +0000 Received: from [85.158.139.211:52703] by server-8.bemta-5.messagelabs.com id CD/F6-29838-C3D07A25; Tue, 10 Dec 2013 12:46:52 +0000 X-Env-Sender: cloud2han9@163.com X-Msg-Ref: server-16.tower-206.messagelabs.com!1386679608!2280031!1 X-Originating-IP: [220.181.13.79] X-SpamReason: No, hits=0.9 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjEzLjc5ID0+IDUyMTk=\n,sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjEzLjc5ID0+IDUyMTk=\n,HTML_20_30,HTML_MESSAGE X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 6256 invoked from network); 10 Dec 2013 12:46:50 -0000 Received: from m13-79.163.com (HELO m13-79.163.com) (220.181.13.79) by server-16.tower-206.messagelabs.com with SMTP; 10 Dec 2013 12:46:50 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=163.com; s=s110527; h=Date:From:Subject:Content-Type:MIME-Version: Message-ID; bh=D4hMzwiy3n4be5cJXL7Jkuf5iDl7O82bpwbQSTkiCYk=; b=L BH7D49rBK21glLC6/ReeefUXa+SvaE9QUWVnLHBmkl5iAn7SO0DHNVZscnlHRtF3 wmZcb+9dgkrZkW32JwtbfcjJZu2pVO5emUnsvMJIeVnYO97bYta5q1UbpIgXsqr1 sf1e7anYFeu9D1KGIbMkRBXOYLPIYWS3+j+8Z6o6sY= Received: from cloud2han9$163.com ( [222.196.190.204] ) by ajax-webmail-wmsvr79 (Coremail) ; Tue, 10 Dec 2013 20:46:28 +0800 (CST) X-Originating-IP: [222.196.190.204] Date: Tue, 10 Dec 2013 20:46:28 +0800 (CST) From: =?UTF-8?B?5byg5LqR6ZyE?= To: "Ian Campbell" X-Priority: 3 X-Mailer: Coremail Webmail Server Version SP_ntes V3.5 build 20131115(24167.5769.5770) Copyright (c) 2002-2013 www.mailtech.cn 163com In-Reply-To: <1386673319.11925.56.camel@kazak.uk.xensource.com> References: <3c610e6a.623.142db162054.Coremail.cloud2han9@163.com> <1386671235.11925.47.camel@kazak.uk.xensource.com> <15baa64e.7a9.142dc25b689.Coremail.cloud2han9@163.com> <1386673319.11925.56.camel@kazak.uk.xensource.com> X-CM-CTRLDATA: swo90GZvb3Rlcl9odG09MjA2Mzo4MQ== MIME-Version: 1.0 Message-ID: <2e8a6480.82b.142dc8b54c2.Coremail.cloud2han9@163.com> X-CM-TRANSID: T8GowEBpLEMlDadSexgJAA--.10496W X-CM-SenderInfo: pfor3vwskd0mi6rwjhhfrp/xtbBDQXvVFIwONaQ3wAAsw X-Coremail-Antispam: 1U5529EdanIXcx71UUUUU7vcSsGvfC2KfnxnUU== Cc: xen-users Subject: Re: [Xen-users] hypercall implementation X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============8429133706030628598==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============8429133706030628598== Content-Type: multipart/alternative; boundary="----=_Part_4878_823759293.1386679588034" ------=_Part_4878_823759293.1386679588034 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: base64 SSB0YWxrZWQgYWJvdXQgUFYuCgpJIGtub3cgdGhlIGh5cGVyY2FsbCdzIGltcGxlbWVudGF0aW9u IG1lY2hhbmlzbSwgYnV0IGh5cGVyY2FsbCdzIGNhbGwgdHJlZS4KCkZyb20gdGhlIGJvb2ssIFRo ZSBEZWZpbml0aXZlIEd1aWRlIHRvIFhlbiBIeXBlcnZpc29yLCBJIGtub3duIHRoYXQgdGhlICJn ZW5lcmljIGJ1aWxkZXIiIHdpbGwgYXV0b21hdGljYWxseSBtYXAgdGhlIGh5cGVyY2FsbCBwYWdl IGF0IG9uZSBwYWdlIGluZGljYXRlZCBieSB0aGUga2V5ICJIWVBFUkNBTExfUEFHRSIgaW4gdGhl IGd1ZXN0IGtlcm5lbCBlbGYncyAgc2VjdGlvbiAiX194ZW5fZ3Vlc3QgIiBpbnRvIHRoZSBndWVz dCBvcycgYWRkcmVzcyBzcGFjZS4gSSBoYXZlIHNlYXJjaGVkIHRoZSBYZW4gc291cmNlIGNvZGUu IEkgY2FuJ3QgZmluZCB0aGUgaHlwZXJjYWxsIHBhZ2UncyBzb3VyY2UgY29kZS4gV2hlcmUgaXMg aXQ/CgoKSW4gYWRkaXRpb24sICBUaGUgYm9vayBtZW50aW9uZWQgYWJvdmUgZGVzY3JpYmVzIHhl bicgaW50ZXJuYWxzIHdlbGwgbWFpbmx5IGluIEVuZ2xpc2guIEluIG9yZGVyIHRvIGtub3cgWGVu IGV4YWN0bHksIEkgdGhpbmsgSSBtdXN0IHJlYWQgWGVuJ3Mgc291cmNlIGNvZGUuIElzIHRoZXJl IHNvbWUgcmVzb3VyY2UoYm9vaywgYmxvZywgcGFwZXIsIGV0YykgZGVzY3JpcGluZyBYZW4gaHlw ZXJ2aXNvciBtYWlubHkgaW4gQyBsYW5ndWFnZS4gSSBuZWVkIGEgc3RhcnQgcG9pbnQgaW4gWGVu J3Mgc291cmNlIGNvZGUgdG8gZXhwbG9yZSBYZW4gaHlwZXJ2aXNvciBvciBhIHBhdGggdGhyb3Vn aCBpdC4gRG8geW91IGhhdmUgc29tZSBzdWdnZXN0aW9uID8gVGhhbmdrcy4KCkNsb3VkIFpoYW5n LgoKCgoKCuW5tOWwkeS4jeaDp+axn+a5luiAge+8jOaUvuatjOWbm+a1t+S7u+mAjemBpeOAguac quino+WJjei3r+WkmuWwkeS6i++8jOassuS4jumdkuWkqeivleavlOmrmOOAggoKCgrlnKgyMDEz 5bm0MTLmnIgxMCAxOeaXtjAx5YiG77yMIklhbiBDYW1wYmVsbCI8SWFuLkNhbXBiZWxsQGNpdHJp eC5jb20+5YaZ6YGT77yaCgpPbiBUdWUsIDIwMTMtMTItMTAgYXQgMTg6NTUgKzA4MDAsIOW8oOS6 kemchCB3cm90ZToKPiBCdXQgd2hhdCdzIHRoZSBjb250ZW50IChzcmMgY29kZSkgb2YgaHlwZXJj YWxsX3BhZ2U/Cj4gIEhvdyBpcyB0aGUgaHlwZXJjYWxsIGltcGxlbWVudGVkPwoKWW91IG5lZWQg dG8gYmUgbG9va2luZyBvbiB0aGUgaHlwZXJ2aXNvciBzaWRlIGZvciB0aGF0LiBJdCBpcyBhIHBh Z2Ugb2YKY29kZSB3aGljaCBpcyBtYXBwZWQgaW50byB0aGUgZ3Vlc3Qga2VybmVsIGFuZCBjb250 YWlucyB0aGUgbmVjZXNzYXJ5Cmluc3RydWN0aW9ucyAoaW50IDB4ODIsIHN5c2NhbGwsIHZtY2Fs bCwgZXRjKSBkZXBlbmRpbmcgb24gdGhlIGd1ZXN0CnR5cGUgZXRjLiBGb3IgYSBQViBndWVzdCBp dCBpcyBwb3B1bGF0ZWQgYnkgdGhlIFhlbiB0b29scyBhc2tpbmcgdGhlCmh5cGVydmlzb3IgdG8g ZG8gc28gZHVyaW5nIGd1ZXN0IGJ1aWxkIGFuZCBmb3IgYSBQVkhWTSBndWVzdCBpdCBpcwpwb3B1 bGF0ZWQgYnkgdGhlIGd1ZXN0IHdyaXRpbmcgdG8gYSBzcGVjaWFsIE1TUiwgc2VlIGVubGlnaHRl bi5jIGluIHRoZQpMaW51eCBrZXJuZWwsIHNwZWNpZmljYWxseSBpbml0X2h2bV9wdl9pbmZvKCku CgpJYW4uCgoK ------=_Part_4878_823759293.1386679588034 Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: base64 PGRpdj48L2Rpdj48ZGl2IHN0eWxlPSJjb2xvcjojMDAwOyBmb250LXNpemU6IDE0cHg7Zm9udC1m YW1pbHk6IGFyaWFsOyI+PGRpdj5JIHRhbGtlZCBhYm91dCBQVi4gPGJyPjxicj5JIGtub3cgdGhl IGh5cGVyY2FsbCdzIGltcGxlbWVudGF0aW9uIG1lY2hhbmlzbSwgYnV0IGh5cGVyY2FsbCdzIGNh bGwgdHJlZS48YnI+PGJyPkZyb20gdGhlIGJvb2ssIFRoZSBEZWZpbml0aXZlIEd1aWRlIHRvIFhl biBIeXBlcnZpc29yLCBJIGtub3duIHRoYXQgdGhlICJnZW5lcmljIGJ1aWxkZXIiIHdpbGwgYXV0 b21hdGljYWxseSBtYXAgdGhlIGh5cGVyY2FsbCBwYWdlIGF0IG9uZSBwYWdlIGluZGljYXRlZCBi eSB0aGUga2V5ICJIWVBFUkNBTExfUEFHRSIgaW4gdGhlIGd1ZXN0IGtlcm5lbCBlbGYncyZuYnNw OyBzZWN0aW9uICJfX3hlbl9ndWVzdCAiIGludG8gdGhlIGd1ZXN0IG9zJyBhZGRyZXNzIHNwYWNl LiBJIGhhdmUgc2VhcmNoZWQgdGhlIFhlbiBzb3VyY2UgY29kZS4gSSBjYW4ndCBmaW5kIHRoZSBo eXBlcmNhbGwgcGFnZSdzIHNvdXJjZSBjb2RlLiBXaGVyZSBpcyBpdD88YnI+PGJyPjwvZGl2Pklu IGFkZGl0aW9uLCZuYnNwOyBUaGUgYm9vayBtZW50aW9uZWQgYWJvdmUgZGVzY3JpYmVzIHhlbicg aW50ZXJuYWxzIHdlbGwgbWFpbmx5IGluIEVuZ2xpc2guIEluIG9yZGVyIHRvIGtub3cgWGVuIGV4 YWN0bHksIEkgdGhpbmsgSSBtdXN0IHJlYWQgWGVuJ3Mgc291cmNlIGNvZGUuIElzIHRoZXJlIHNv bWUgcmVzb3VyY2UoYm9vaywgYmxvZywgcGFwZXIsIGV0YykgZGVzY3JpcGluZyBYZW4gaHlwZXJ2 aXNvciBtYWlubHkgaW4gQyBsYW5ndWFnZS4gSSBuZWVkIGEgc3RhcnQgcG9pbnQgaW4gWGVuJ3Mg c291cmNlIGNvZGUgdG8gZXhwbG9yZSBYZW4gaHlwZXJ2aXNvciBvciBhIHBhdGggdGhyb3VnaCBp dC4gRG8geW91IGhhdmUgc29tZSBzdWdnZXN0aW9uID8gVGhhbmdrcy48YnI+PGJyPkNsb3VkIFpo YW5nLjxicj48ZGl2Pjxicj48L2Rpdj48ZGl2Pjxicj48L2Rpdj48L2Rpdj48ZGl2PjwvZGl2Pjxk aXYgaWQ9InNwbkVkaXRvclNpZ24iIG5hbWU9IjEwMCI+PGRpdj48ZGl2PuW5tOWwkeS4jeaDp+ax n+a5luiAge+8jOaUvuatjOWbm+a1t+S7u+mAjemBpeOAguacquino+WJjei3r+WkmuWwkeS6i++8 jOassuS4jumdkuWkqeivleavlOmrmOOAgjxicj48L2Rpdj48L2Rpdj48L2Rpdj48ZGl2PjwvZGl2 PjxkaXY+PGJyPjwvZGl2PjxkaXY+PC9kaXY+PCEtLSBqeTVDb250ZW50U3VmZml4IC0tPjxkaXY+ 5ZyoMjAxM+W5tDEy5pyIMTAgMTnml7YwMeWIhu+8jCJJYW4gQ2FtcGJlbGwiJmx0O0lhbi5DYW1w YmVsbEBjaXRyaXguY29tJmd0O+WGmemBk++8mjwvZGl2PjxibG9ja3F1b3RlIGlkPSJpc1JlcGx5 Q29udGVudCIgc3R5bGU9InBhZGRpbmctbGVmdDoxZXg7IG1hcmdpbjogMHB4IDBweCAwcHggMC44 ZXg7IEJPUkRFUi1MRUZUOiAjY2NjIDFweCBzb2xpZCI+PGJyPiBPbiBUdWUsIDIwMTMtMTItMTAg YXQgMTg6NTUgKzA4MDAsIOW8oOS6kemchCB3cm90ZTo8YnI+Jmd0OyBCdXQgd2hhdCdzIHRoZSBj b250ZW50IChzcmMgY29kZSkgb2YgaHlwZXJjYWxsX3BhZ2U/PGJyPiZndDsgJm5ic3A7SG93IGlz IHRoZSBoeXBlcmNhbGwgaW1wbGVtZW50ZWQ/PGJyPjxicj5Zb3UgbmVlZCB0byBiZSBsb29raW5n IG9uIHRoZSBoeXBlcnZpc29yIHNpZGUgZm9yIHRoYXQuIEl0IGlzIGEgcGFnZSBvZjxicj5jb2Rl IHdoaWNoIGlzIG1hcHBlZCBpbnRvIHRoZSBndWVzdCBrZXJuZWwgYW5kIGNvbnRhaW5zIHRoZSBu ZWNlc3Nhcnk8YnI+aW5zdHJ1Y3Rpb25zIChpbnQgMHg4Miwgc3lzY2FsbCwgdm1jYWxsLCBldGMp IGRlcGVuZGluZyBvbiB0aGUgZ3Vlc3Q8YnI+dHlwZSBldGMuIEZvciBhIFBWIGd1ZXN0IGl0IGlz IHBvcHVsYXRlZCBieSB0aGUgWGVuIHRvb2xzIGFza2luZyB0aGU8YnI+aHlwZXJ2aXNvciB0byBk byBzbyBkdXJpbmcgZ3Vlc3QgYnVpbGQgYW5kIGZvciBhIFBWSFZNIGd1ZXN0IGl0IGlzPGJyPnBv cHVsYXRlZCBieSB0aGUgZ3Vlc3Qgd3JpdGluZyB0byBhIHNwZWNpYWwgTVNSLCBzZWUgZW5saWdo dGVuLmMgaW4gdGhlPGJyPkxpbnV4IGtlcm5lbCwgc3BlY2lmaWNhbGx5IGluaXRfaHZtX3B2X2lu Zm8oKS48YnI+PGJyPklhbi48YnI+PGJyPjxicj48L2Jsb2NrcXVvdGU+PGJyPjxicj48c3BhbiB0 aXRsZT0ibmV0ZWFzZWZvb3RlciI+PHNwYW4gaWQ9Im5ldGVhc2VfbWFpbF9mb290ZXIiPjwvc3Bh bj48L3NwYW4+ ------=_Part_4878_823759293.1386679588034-- --===============8429133706030628598== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============8429133706030628598==-- From xen-users-bounces@lists.xen.org Tue Dec 10 12:59:33 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 12:59:33 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMte-0006Zq-KW; Tue, 10 Dec 2013 12:58:42 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMtb-0006Uq-MF; Tue, 10 Dec 2013 12:58:40 +0000 Received: from [85.158.139.211:18165] by server-13.bemta-5.messagelabs.com id A8/22-11357-EFF07A25; Tue, 10 Dec 2013 12:58:38 +0000 X-Env-Sender: iwj@xenbits.xen.org X-Msg-Ref: server-15.tower-206.messagelabs.com!1386680316!3508789!1 X-Originating-IP: [50.57.168.107] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 2357 invoked from network); 10 Dec 2013 12:58:37 -0000 Received: from mail.xen.org (HELO mail.xen.org) (50.57.168.107) by server-15.tower-206.messagelabs.com with AES256-SHA encrypted SMTP; 10 Dec 2013 12:58:37 -0000 Received: from xenbits.xen.org ([50.57.170.242]) by mail.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMtS-000071-1c; Tue, 10 Dec 2013 12:58:30 +0000 Received: from iwj by xenbits.xen.org with local (Exim 4.72) (envelope-from ) id 1VqMtR-0007D8-OW; Tue, 10 Dec 2013 12:58:29 +0000 Date: Tue, 10 Dec 2013 12:58:29 +0000 Message-Id: Content-Type: multipart/mixed; boundary="=separator"; charset="utf-8" Content-Transfer-Encoding: binary MIME-Version: 1.0 X-Mailer: MIME-tools 5.428 (Entity 5.428) To: xen-announce@lists.xen.org, xen-devel@lists.xen.org, xen-users@lists.xen.org, oss-security@lists.openwall.com From: Xen.org security team Cc: "Xen.org security team" Subject: [Xen-users] Xen Security Advisory 77 - Disaggregated domain management security status X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --=separator Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Xen Security Advisory XSA-77 version 3 Disaggregated domain management security status UPDATES IN VERSION 3 ==================== Public release. The included documentation patch now updates the xsm-flash.txt documentation rather than the Xen public headers. The advisory has been updated to reflect this. Made the warning about the documentation patch stand out more clearly. ISSUE DESCRIPTION ================= Xen supports disaggregation of various support and management functions into their own domains; this is often done for security and robustness reasons. In Xen 4.3 additional functionality was introduced to allow further disaggregation: the Xen Security Modules mechanism was enhanced to make it possible to delegate various domain control hypercalls to particular other domains, rather than only permitting use by dom0. However the several affected hypercall implementations were originally written to be used only by the totally-privileged dom0, and have not been reviewed for security when exposed to supposedly-only-semi-privileged disaggregated management domains. But such management domains are (in such a design) to be seen as potentially hostile, e.g. due to privilege escalation following exploitation of a bug in the management domain. As a result, the potential security benefits of toolstack disaggregation are not always fully realised. This constitutes a breach of the enhanced security promises implied by the Xen APIs in Xen in 4.3 and later. The affected hypercalls are: __HYPERVISOR_domctl: The majority of the XEN_DOMCTL_* subops are affected. Exceptions are listed below. __HYPERVISOR_sysctl: All XEN_SYSCTL_* subops are affected. __HYPERVISOR_memory_op: A small number of XENMEM_* subops are affected. See below. __HYPERVISOR_tmem_op: All TMEMC_* sub-subops of the TMEM_CONTROL subop are affected. The majority of the domctls are subject to this issue. Prior to 4.3, only the following domctls were disaggregatable, and they are NOT affected by these problems: XEN_DOMCTL_ioport_mapping XEN_DOMCTL_bind_pt_irq XEN_DOMCTL_memory_mapping XEN_DOMCTL_unbind_pt_irq The implementations of these were written with semi-trusted callers in mind. Only the following memory op subops are affected: XENMEM_set_pod_target XENMEM_get_pod_target XENMEM_claim_pages The remainder of the memory ops were written with untrusted or semi-trusted callers in mind. IMPACT ====== Domains deliberately given partial management control may be able to deny service to the entire host or even escalate their privileges. As a result, in a system designed to enhance security by radically disaggregating the management, the security may be reduced. But, the security will be no worse than a non-disaggregated design. VULNERABLE SYSTEMS ================== This issue is only relevant to systems which intend to increase security through the use of advanced disaggregated management techniques. This does not include systems using libxl, libvirt, xm/xend, XCP/XenServer, OpenStack or CloudStack (unless substantially modified or supplemented, as compared to versions supplied by the respective upstreams). This issue is not relevant to stub device models, driver domains, or stub xenstored. Those disaggregation techniques do not rely on granting the semi-privileged support domains access to the affected interfaces, and are believed to provide the intended security benefits. This issue is only relevant to Xen 4.3 and xen-unstable, and not to any earlier version. PROCESS FOR VULNERABILITIES IN AFFECTED INTERFACES ================================================== Until the interfaces have been properly reviewed for security against hostile callers, the Xen.org security team intends (subject of course to the permission of anyone disclosing to us) to handle these and future vulnerabilities in these interfaces in public, as if they were normal non-security-related bugs. This applies only to bugs which do no more than reduce the security of a radically disaggregated system to the security of a non-disaggregated one. Here a "radically disaggregated system" is one which uses the XSM mechanism to delegate the affected interfaces to other-than-fully-trusted domains. This policy does not apply to bugs which affect stub device models, driver domains, or stub xenstored - even if those bugs do no worse than reduce the security of such a system to one whose device models, backend drivers, or xenstore, run in dom0. The list of interfaces which are subject to the above process exception are listed in the Xen Source tree in docs/misc/xsm-flask under the heading "Security Status of dom0 disaggregation". This document is also available at http://xenbits.xen.org/docs/unstable/misc/xsm-flask.txt. We intend that currently-known problems will be publicly disclosed on the xen-devel mailing list, as normal bug reports, at the expiry of the XSA-77 embargo. In the meantime the list below may be helpful. MITIGATION ========== The issues discussed in this advisory are themselves bugs in features used for a security risk mitigation. There is no further mitigation available, beyond general measures to try to avoid parts of the system management becoming controlled by attackers. Those are the kind of measures which we expect any users of radical disaggregation to have already deployed. Switching from disaggregated to a non-disaggregated operation does NOT mitigate these vulnerabilities. Rather, it simply recategorises the vulnerability to hostile management code, regarding it "as designed"; thus it merely reclassifies these issues as "not a bug". Users and vendors of disaggregated systems should not change their configuration. The robustness benefits of disaggregation are unaffected, and (depending on system design) security benefits are likely to remain despite the vulnerabilities. RESOLUTION ========== We hope that the control interface attack surface can be reviewed and improved so that disaggregation can deliver its security benefits more fully. Patches resulting from this process will be developed in public and applied to the Xen trees as if they were ordinary bugfixes. In the meantime the attached patch will be applied to the unstable branch in order to track which interfaces are subject to this exception. This patch is purely documentary and DOES NOT resolve any issue. $ sha256sum xsa77*.patch bd9daffa8abfb05fb4a474e903dcd777352a705c1cf6e89343ea6545d545e4cb xsa77-unstable.patch $ CREDITS ======= The issues which prompted this advisory were discovered by Jan Beulich and Don Slutz. LIST OF KNOWN VULNERABILITIES ============================= **NOTE** that this is unlikely to be a complete list of problems. **NOTE** that after publication of this advisory, after the embargo ends, the advisory will no longer be updated to extend this list of vulnerabilities. See `Process for domctl vulnerabilities', above. Multiple domctls can be made, by the caller, to perform excessively long-running operations. This can result in host-wide denial of service and watchdog-induced crashes. XEN_DOMCTL_gethvmcontext_partial allows access to guest state, in particular certain pieces that are per-vCPU. If one or more of a guest's vCPU-s are offline, the space internally allocated to store each individual vCPU's state would not get fully used and, due to another bug, information from the portion that didn't get initialized may be returned back to the caller. In the course of processing the request to set register state for another PV guest's vCPU, the hypervisor updated the in memory copy of the debug register values twice - first by simply copying over the values, and in a second step through code properly verifying them. Between the two operations there are, however, other error exit paths, making it possible that unvalidated state could remain in place and be loaded when the vCPU is next scheduled to run. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) iQEcBAEBAgAGBQJSpw/NAAoJEIP+FMlX6CvZBskH/j4YsHS48A82IEez4Zn7m+m6 n2d3UjT7fAAgxvqD3YJ7gsZI0Xi4PKw4ThHmmV6ZIdE18jju9ByrcsLLA/z77sO4 eUEastK49XKQ1Him7v+XB2/zfZ2ty/grnWS9dk5r18hVQLv+KIuQoyB+/QHt3bD4 i06R6iyhE57yJiD72bTNflITioyuZybMG/MM+7Pby8OVblagNgUS3YK9Z5J246/e fWDTUsgI6c63zWRjqwBZB0vI+omr/GfNUX0e77LMnv/f/X6jwVBdNML2RDI9HDRO lWdfQQeYHQN/mK6OD5s13+qIonv3iq8wJjeRxvQpQKAnjynFu61VDnp/ghN6xnE= =lQLn -----END PGP SIGNATURE----- --=separator Content-Type: application/octet-stream; name="xsa77-unstable.patch" Content-Disposition: attachment; filename="xsa77-unstable.patch" Content-Transfer-Encoding: base64 eGVuOiBsaXN0IGludGVyZmFjZXMgc3ViamVjdCB0byB0aGUgc2VjdXJpdHkg cHJvY2VzcyBleGNlcHRpb24gaW4gWFNBLTc3CgpMaXN0IGFsbCB0aGUgc3Vi IG9wcyBvZjoKICBfX0hZUEVSVklTT1JfZG9tY3RsCiAgX19IWVBFUlZJU09S X3N5c2N0bAogIF9fSFlQRVJWSVNPUl9tZW1vcnlfb3AKICBfX0hZUEVSVklT T1JfdG1lbV9vcAp3aGljaCBhcmUgc3ViamVjdCB0byB0aGUgcG9saWN5IGdp dmVuIGluCmh0dHA6Ly94ZW5iaXRzLnhlbi5vcmcveHNhL2Fkdmlzb3J5LTc3 Lmh0bWwKCkl0IGlzIGV4cGVjdGVkIHRoYXQgdGhlc2UgbGlzdHMgd2lsbCBi ZSB3aGl0dGxlZCBhd2F5IGFzIGVhY2ggaW50ZXJmYWNlIGlzCmF1ZGl0ZWQg Zm9yIHNhZmV0eS4KCk5ldyBpbnRlcmZhY2VzIHNob3VsZCBiZSBleHBlY3Rl ZCB0byBiZSBzYWZlIHdoZW4gaW50cm9kdWNlZCAoSU9XIHRoZSBsaXN0CnNo b3VsZCBuZXZlciBiZSBleHBhbmRlZCkuCgpUaGlzIGlzIFhTQS03Ny4KClNp Z25lZC1vZmYtYnk6IElhbiBDYW1wYmVsbCA8aWFuLmNhbXBiZWxsQGNpdHJp eC5jb20+CgpkaWZmIC0tZ2l0IGEvZG9jcy9taXNjL3hzbS1mbGFzay50eHQg Yi9kb2NzL21pc2MveHNtLWZsYXNrLnR4dAppbmRleCBmZjgxYjAxLi5kZGQ1 ODMxIDEwMDY0NAotLS0gYS9kb2NzL21pc2MveHNtLWZsYXNrLnR4dAorKysg Yi9kb2NzL21pc2MveHNtLWZsYXNrLnR4dApAQCAtMTcsNiArMTcsMTg5IEBA IFNvbWUgZXhhbXBsZXMgb2Ygd2hhdCBGTEFTSyBjYW4gZG86CiBTb21lIG9m IHRoZXNlIGV4YW1wbGVzIHJlcXVpcmUgZG9tMCBkaXNhZ2dyZWdhdGlvbiB0 byBiZSB1c2VmdWwsIHNpbmNlIHRoZQogZG9tYWluIGJ1aWxkIHByb2Nlc3Mg cmVxdWlyZXMgdGhlIGFiaWxpdHkgdG8gd3JpdGUgdG8gdGhlIG5ldyBkb21h aW4ncyBtZW1vcnkuCiAKK1NlY3VyaXR5IFN0YXR1cyBvZiBkb20wIGRpc2Fn Z3JlZ2F0aW9uCistLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLQorCitYZW4gc3VwcG9ydHMgZGlzYWdncmVnYXRpb24gb2YgdmFyaW91 cyBzdXBwb3J0IGFuZCBtYW5hZ2VtZW50CitmdW5jdGlvbnMgaW50byB0aGVp ciBvd24gZG9tYWlucywgdmlhIHRoZSBYU00gbWVjaGFuaXNtcyBkZXNjcmli ZWQgaW4KK3RoaXMgZG9jdW1lbnQuCisKK0hvd2V2ZXIgdGhlIGltcGxlbWVu dGF0aW9ucyBvZiB0aGVzZSBzdXBwb3J0IGFuZCBtYW5hZ2VtZW50IGludGVy ZmFjZXMKK3dlcmUgb3JpZ2luYWxseSB3cml0dGVuIHRvIGJlIHVzZWQgb25s eSBieSB0aGUgdG90YWxseS1wcml2aWxlZ2VkCitkb20wLCBhbmQgaGF2ZSBu b3QgYmVlbiByZXZpZXdlZCBmb3Igc2VjdXJpdHkgd2hlbiBleHBvc2VkIHRv CitzdXBwb3NlZGx5LW9ubHktc2VtaS1wcml2aWxlZ2VkIGRpc2FnZ3JlZ2F0 ZWQgbWFuYWdlbWVudCBkb21haW5zLiAgQnV0CitzdWNoIG1hbmFnZW1lbnQg ZG9tYWlucyBhcmUgKGluIHN1Y2ggYSBkZXNpZ24pIHRvIGJlIHNlZW4gYXMK K3BvdGVudGlhbGx5IGhvc3RpbGUsIGUuZy4gZHVlIHRvIHByaXZpbGVnZSBl c2NhbGF0aW9uIGZvbGxvd2luZworZXhwbG9pdGF0aW9uIG9mIGEgYnVnIGlu IHRoZSBtYW5hZ2VtZW50IGRvbWFpbi4KKworVW50aWwgdGhlIGludGVyZmFj ZXMgaGF2ZSBiZWVuIHByb3Blcmx5IHJldmlld2VkIGZvciBzZWN1cml0eSBh Z2FpbnN0Citob3N0aWxlIGNhbGxlcnMsIHRoZSBYZW4ub3JnIHNlY3VyaXR5 IHRlYW0gaW50ZW5kcyAoc3ViamVjdCBvZiBjb3Vyc2UKK3RvIHRoZSBwZXJt aXNzaW9uIG9mIGFueW9uZSBkaXNjbG9zaW5nIHRvIHVzKSB0byBoYW5kbGUg dGhlc2UgYW5kCitmdXR1cmUgdnVsbmVyYWJpbGl0aWVzIGluIHRoZXNlIGlu dGVyZmFjZXMgaW4gcHVibGljLCBhcyBpZiB0aGV5IHdlcmUKK25vcm1hbCBu b24tc2VjdXJpdHktcmVsYXRlZCBidWdzLgorCitUaGlzIGFwcGxpZXMgb25s eSB0byBidWdzIHdoaWNoIGRvIG5vIG1vcmUgdGhhbiByZWR1Y2UgdGhlIHNl Y3VyaXR5IG9mCithIHJhZGljYWxseSBkaXNhZ2dyZWdhdGVkIHN5c3RlbSB0 byB0aGUgc2VjdXJpdHkgb2YgYQorbm9uLWRpc2FnZ3JlZ2F0ZWQgb25lLiAg SGVyZSBhICJyYWRpY2FsbHkgZGlzYWdncmVnYXRlZCBzeXN0ZW0iIGlzIG9u ZQord2hpY2ggdXNlcyB0aGUgWFNNIG1lY2hhbmlzbSB0byBkZWxlZ2F0ZSB0 aGUgYWZmZWN0ZWQgaW50ZXJmYWNlcyB0bworb3RoZXItdGhhbi1mdWxseS10 cnVzdGVkIGRvbWFpbnMuCisKK1RoaXMgcG9saWN5IGRvZXMgbm90IGFwcGx5 IHRvIGJ1Z3Mgd2hpY2ggYWZmZWN0IHN0dWIgZGV2aWNlIG1vZGVscywKK2Ry aXZlciBkb21haW5zLCBvciBzdHViIHhlbnN0b3JlZCAtIGV2ZW4gaWYgdGhv c2UgYnVncyBkbyBubyB3b3JzZQordGhhbiByZWR1Y2UgdGhlIHNlY3VyaXR5 IG9mIHN1Y2ggYSBzeXN0ZW0gdG8gb25lIHdob3NlIGRldmljZSBtb2RlbHMs CitiYWNrZW5kIGRyaXZlcnMsIG9yIHhlbnN0b3JlLCBydW4gaW4gZG9tMC4K KworRm9yIG1vcmUgaW5mb3JtYXRpb24gc2VlIGh0dHA6Ly94ZW5iaXRzLnhl bi5vcmcveHNhL2Fkdmlzb3J5LTc3Lmh0bWwuCisKK1RoZSBmb2xsb3dpbmcg aW50ZXJmYWNlcyBhcmUgY292ZXJlZCBieSB0aGlzIHN0YXRlbWVudC4gIElu dGVyZmFjZXMKK25vdCBsaXN0ZWQgaGVyZSBhcmUgY29uc2lkZXJlZCBzYWZl IGZvciBkaXNhZ2dyZWdhdGlvbiwgc2VjdXJpdHkKK2lzc3VlcyBmb3VuZCBp biBpbnRlcmZhY2VzIG5vdCBsaXN0ZWQgaGVyZSB3aWxsIGJlIGhhbmRsZWQg YWNjb3JkaW5nCit0byB0aGUgbm9ybWFsIHNlY3VyaXR5IHByb2JsZW0gcmVz cG9uc2UgcG9saWN5CitodHRwOi8vd3d3LnhlbnByb2plY3Qub3JnL3NlY3Vy aXR5LXBvbGljeS5odG1sLgorCitfX0hZUEVSVklTT1JfZG9tY3RsICh4ZW4v aW5jbHVkZS9wdWJsaWMvZG9tY3RsLmgpCisKKyBUaGUgZm9sbG93aW5nIHN1 Ym9wcyBhcmUgY292ZXJlZCBieSB0aGlzIHN0YXRlbWVudC4gc3Vib3BzIG5v dCBsaXN0ZWQKKyBoZXJlIGFyZSBjb25zaWRlcmVkIHNhZmUgZm9yIGRpc2Fn Z3JlZ2F0aW9uLgorCisgKiBYRU5fRE9NQ1RMX2NyZWF0ZWRvbWFpbgorICog WEVOX0RPTUNUTF9kZXN0cm95ZG9tYWluCisgKiBYRU5fRE9NQ1RMX3BhdXNl ZG9tYWluCisgKiBYRU5fRE9NQ1RMX3VucGF1c2Vkb21haW4KKyAqIFhFTl9E T01DVExfZ2V0ZG9tYWluaW5mbworICogWEVOX0RPTUNUTF9nZXRtZW1saXN0 CisgKiBYRU5fRE9NQ1RMX2dldHBhZ2VmcmFtZWluZm8KKyAqIFhFTl9ET01D VExfZ2V0cGFnZWZyYW1laW5mbzIKKyAqIFhFTl9ET01DVExfc2V0dmNwdWFm ZmluaXR5CisgKiBYRU5fRE9NQ1RMX3NoYWRvd19vcAorICogWEVOX0RPTUNU TF9tYXhfbWVtCisgKiBYRU5fRE9NQ1RMX3NldHZjcHVjb250ZXh0CisgKiBY RU5fRE9NQ1RMX2dldHZjcHVjb250ZXh0CisgKiBYRU5fRE9NQ1RMX2dldHZj cHVpbmZvCisgKiBYRU5fRE9NQ1RMX21heF92Y3B1cworICogWEVOX0RPTUNU TF9zY2hlZHVsZXJfb3AKKyAqIFhFTl9ET01DVExfc2V0ZG9tYWluaGFuZGxl CisgKiBYRU5fRE9NQ1RMX3NldGRlYnVnZ2luZworICogWEVOX0RPTUNUTF9p cnFfcGVybWlzc2lvbgorICogWEVOX0RPTUNUTF9pb21lbV9wZXJtaXNzaW9u CisgKiBYRU5fRE9NQ1RMX2lvcG9ydF9wZXJtaXNzaW9uCisgKiBYRU5fRE9N Q1RMX2h5cGVyY2FsbF9pbml0CisgKiBYRU5fRE9NQ1RMX2FyY2hfc2V0dXAK KyAqIFhFTl9ET01DVExfc2V0dGltZW9mZnNldAorICogWEVOX0RPTUNUTF9n ZXR2Y3B1YWZmaW5pdHkKKyAqIFhFTl9ET01DVExfcmVhbF9tb2RlX2FyZWEK KyAqIFhFTl9ET01DVExfcmVzdW1lZG9tYWluCisgKiBYRU5fRE9NQ1RMX3Nl bmR0cmlnZ2VyCisgKiBYRU5fRE9NQ1RMX3N1YnNjcmliZQorICogWEVOX0RP TUNUTF9nZXRodm1jb250ZXh0CisgKiBYRU5fRE9NQ1RMX3NldGh2bWNvbnRl eHQKKyAqIFhFTl9ET01DVExfc2V0X2FkZHJlc3Nfc2l6ZQorICogWEVOX0RP TUNUTF9nZXRfYWRkcmVzc19zaXplCisgKiBYRU5fRE9NQ1RMX2Fzc2lnbl9k ZXZpY2UKKyAqIFhFTl9ET01DVExfcGluX21lbV9jYWNoZWF0dHIKKyAqIFhF Tl9ET01DVExfc2V0X2V4dF92Y3B1Y29udGV4dAorICogWEVOX0RPTUNUTF9n ZXRfZXh0X3ZjcHVjb250ZXh0CisgKiBYRU5fRE9NQ1RMX3NldF9vcHRfZmVh dHVyZQorICogWEVOX0RPTUNUTF90ZXN0X2Fzc2lnbl9kZXZpY2UKKyAqIFhF Tl9ET01DVExfc2V0X3RhcmdldAorICogWEVOX0RPTUNUTF9kZWFzc2lnbl9k ZXZpY2UKKyAqIFhFTl9ET01DVExfc2V0X2NwdWlkCisgKiBYRU5fRE9NQ1RM X2dldF9kZXZpY2VfZ3JvdXAKKyAqIFhFTl9ET01DVExfc2V0X21hY2hpbmVf YWRkcmVzc19zaXplCisgKiBYRU5fRE9NQ1RMX2dldF9tYWNoaW5lX2FkZHJl c3Nfc2l6ZQorICogWEVOX0RPTUNUTF9zdXBwcmVzc19zcHVyaW91c19wYWdl X2ZhdWx0cworICogWEVOX0RPTUNUTF9kZWJ1Z19vcAorICogWEVOX0RPTUNU TF9nZXRodm1jb250ZXh0X3BhcnRpYWwKKyAqIFhFTl9ET01DVExfbWVtX2V2 ZW50X29wCisgKiBYRU5fRE9NQ1RMX21lbV9zaGFyaW5nX29wCisgKiBYRU5f RE9NQ1RMX2Rpc2FibGVfbWlncmF0ZQorICogWEVOX0RPTUNUTF9nZXR0c2Np bmZvCisgKiBYRU5fRE9NQ1RMX3NldHRzY2luZm8KKyAqIFhFTl9ET01DVExf Z2V0cGFnZWZyYW1laW5mbzMKKyAqIFhFTl9ET01DVExfc2V0dmNwdWV4dHN0 YXRlCisgKiBYRU5fRE9NQ1RMX2dldHZjcHVleHRzdGF0ZQorICogWEVOX0RP TUNUTF9zZXRfYWNjZXNzX3JlcXVpcmVkCisgKiBYRU5fRE9NQ1RMX2F1ZGl0 X3AybQorICogWEVOX0RPTUNUTF9zZXRfdmlycV9oYW5kbGVyCisgKiBYRU5f RE9NQ1RMX3NldF9icm9rZW5fcGFnZV9wMm0KKyAqIFhFTl9ET01DVExfc2V0 bm9kZWFmZmluaXR5CisgKiBYRU5fRE9NQ1RMX2dldG5vZGVhZmZpbml0eQor ICogWEVOX0RPTUNUTF9zZXRfbWF4X2V2dGNobgorICogWEVOX0RPTUNUTF9n ZGJzeF9ndWVzdG1lbWlvCisgKiBYRU5fRE9NQ1RMX2dkYnN4X3BhdXNldmNw dQorICogWEVOX0RPTUNUTF9nZGJzeF91bnBhdXNldmNwdQorICogWEVOX0RP TUNUTF9nZGJzeF9kb21zdGF0dXMKKworX19IWVBFUlZJU09SX3N5c2N0bCAo eGVuL2luY2x1ZGUvcHVibGljL3N5c2N0bC5oKQorCisgVGhlIGZvbGxvd2lu ZyBzdWJvcHMgYXJlIGNvdmVyZWQgYnkgdGhpcyBzdGF0ZW1lbnQuIHN1Ym9w cyBub3QgbGlzdGVkCisgaGVyZSBhcmUgY29uc2lkZXJlZCBzYWZlIGZvciBk aXNhZ2dyZWdhdGlvbi4KKworICogWEVOX1NZU0NUTF9yZWFkY29uc29sZQor ICogWEVOX1NZU0NUTF90YnVmX29wCisgKiBYRU5fU1lTQ1RMX3BoeXNpbmZv CisgKiBYRU5fU1lTQ1RMX3NjaGVkX2lkCisgKiBYRU5fU1lTQ1RMX3BlcmZj X29wCisgKiBYRU5fU1lTQ1RMX2dldGRvbWFpbmluZm9saXN0CisgKiBYRU5f U1lTQ1RMX2RlYnVnX2tleXMKKyAqIFhFTl9TWVNDVExfZ2V0Y3B1aW5mbwor ICogWEVOX1NZU0NUTF9hdmFpbGhlYXAKKyAqIFhFTl9TWVNDVExfZ2V0X3Bt c3RhdAorICogWEVOX1NZU0NUTF9jcHVfaG90cGx1ZworICogWEVOX1NZU0NU TF9wbV9vcAorICogWEVOX1NZU0NUTF9wYWdlX29mZmxpbmVfb3AKKyAqIFhF Tl9TWVNDVExfbG9ja3Byb2Zfb3AKKyAqIFhFTl9TWVNDVExfdG9wb2xvZ3lp bmZvCisgKiBYRU5fU1lTQ1RMX251bWFpbmZvCisgKiBYRU5fU1lTQ1RMX2Nw dXBvb2xfb3AKKyAqIFhFTl9TWVNDVExfc2NoZWR1bGVyX29wCisgKiBYRU5f U1lTQ1RMX2NvdmVyYWdlX29wCisKK19fSFlQRVJWSVNPUl9tZW1vcnlfb3Ag KHhlbi9pbmNsdWRlL3B1YmxpYy9tZW1vcnkuaCkKKworIFRoZSBmb2xsb3dp bmcgc3Vib3BzIGFyZSBjb3ZlcmVkIGJ5IHRoaXMgc3RhdGVtZW50LiBzdWJv cHMgbm90IGxpc3RlZAorIGhlcmUgYXJlIGNvbnNpZGVyZWQgc2FmZSBmb3Ig ZGlzYWdncmVnYXRpb24uCisKKyAqIFhFTk1FTV9zZXRfcG9kX3RhcmdldAor ICogWEVOTUVNX2dldF9wb2RfdGFyZ2V0CisgKiBYRU5NRU1fY2xhaW1fcGFn ZXMKKworX19IWVBFUlZJU09SX3RtZW1fb3AgKHhlbi9pbmNsdWRlL3B1Ymxp Yy90bWVtLmgpCisKKyBUaGUgZm9sbG93aW5nIHRtZW0gY29udHJvbCBvcHMs IHRoYXQgaXMgdGhlIHN1Yi1zdWJvcHMgb2YKKyBUTUVNX0NPTlRST0wsIGFy ZSBjb3ZlcmVkIGJ5IHRoaXMgc3RhdGVtZW50LiAKKworIE5vdGUgdGhhdCBU TUVNIGlzIGFsc28gc3ViamVjdCB0byBhIHNpbWlsYXIgcG9saWN5IGFyaXNp bmcgZnJvbQorIFhTQS0xNSBodHRwOi8vbGlzdHMueGVuLm9yZy9hcmNoaXZl cy9odG1sL3hlbi1hbm5vdW5jZS8yMDEyLTA5L21zZzAwMDA2Lmh0bWwuCisg RHVlIHRvIHRoaXMgZXhpc3RpbmcgcG9saWN5IGFsbCBUTUVNIE9wcyBhcmUg YWxyZWFkeSBzdWJqZWN0IHRvCisgcmVkdWNlZCBzZWN1cml0eSBzdXBwb3J0 LgorCisgKiBUTUVNQ19USEFXCisgKiBUTUVNQ19GUkVFWkUKKyAqIFRNRU1D X0ZMVVNICisgKiBUTUVNQ19ERVNUUk9ZCisgKiBUTUVNQ19MSVNUCisgKiBU TUVNQ19TRVRfV0VJR0hUCisgKiBUTUVNQ19TRVRfQ0FQCisgKiBUTUVNQ19T RVRfQ09NUFJFU1MKKyAqIFRNRU1DX1FVRVJZX0ZSRUVBQkxFX01CCisgKiBU TUVNQ19TQVZFX0JFR0lOCisgKiBUTUVNQ19TQVZFX0dFVF9WRVJTSU9OCisg KiBUTUVNQ19TQVZFX0dFVF9NQVhQT09MUworICogVE1FTUNfU0FWRV9HRVRf Q0xJRU5UX1dFSUdIVAorICogVE1FTUNfU0FWRV9HRVRfQ0xJRU5UX0NBUAor ICogVE1FTUNfU0FWRV9HRVRfQ0xJRU5UX0ZMQUdTCisgKiBUTUVNQ19TQVZF X0dFVF9QT09MX0ZMQUdTCisgKiBUTUVNQ19TQVZFX0dFVF9QT09MX05QQUdF UworICogVE1FTUNfU0FWRV9HRVRfUE9PTF9VVUlECisgKiBUTUVNQ19TQVZF X0dFVF9ORVhUX1BBR0UKKyAqIFRNRU1DX1NBVkVfR0VUX05FWFRfSU5WCisg KiBUTUVNQ19TQVZFX0VORAorICogVE1FTUNfUkVTVE9SRV9CRUdJTgorICog VE1FTUNfUkVTVE9SRV9QVVRfUEFHRQorICogVE1FTUNfUkVTVE9SRV9GTFVT SF9QQUdFCisKKwogCiBTZXR0aW5nIHVwIEZMQVNLCiAtLS0tLS0tLS0tLS0t LS0tCg== --=separator Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --=separator-- From xen-users-bounces@lists.xen.org Tue Dec 10 12:59:33 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 12:59:33 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMth-0006de-4X; Tue, 10 Dec 2013 12:58:45 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMtd-0006XI-AE; Tue, 10 Dec 2013 12:58:41 +0000 Received: from [85.158.143.35:29138] by server-1.bemta-4.messagelabs.com id AE/32-02132-00017A25; Tue, 10 Dec 2013 12:58:40 +0000 X-Env-Sender: iwj@xenbits.xen.org X-Msg-Ref: server-7.tower-21.messagelabs.com!1386680318!4616381!1 X-Originating-IP: [50.57.168.107] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 6930 invoked from network); 10 Dec 2013 12:58:39 -0000 Received: from mail.xen.org (HELO mail.xen.org) (50.57.168.107) by server-7.tower-21.messagelabs.com with AES256-SHA encrypted SMTP; 10 Dec 2013 12:58:39 -0000 Received: from xenbits.xen.org ([50.57.170.242]) by mail.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMtV-00007D-QA; Tue, 10 Dec 2013 12:58:33 +0000 Received: from iwj by xenbits.xen.org with local (Exim 4.72) (envelope-from ) id 1VqMtV-0007EA-Nj; Tue, 10 Dec 2013 12:58:33 +0000 Date: Tue, 10 Dec 2013 12:58:33 +0000 Message-Id: Content-Type: multipart/mixed; boundary="=separator"; charset="utf-8" Content-Transfer-Encoding: binary MIME-Version: 1.0 X-Mailer: MIME-tools 5.428 (Entity 5.428) To: xen-announce@lists.xen.org, xen-devel@lists.xen.org, xen-users@lists.xen.org, oss-security@lists.openwall.com From: Xen.org security team Cc: "Xen.org security team" Subject: [Xen-users] Xen Security Advisory 80 (CVE-2013-6400) - IOMMU TLB flushing may be inadvertently suppressed X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --=separator Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Xen Security Advisory CVE-2013-6400 / XSA-80 version 3 IOMMU TLB flushing may be inadvertently suppressed UPDATES IN VERSION 3 ==================== Public release. Corrected explanatory text to refer to the correct patch filename. ISSUE DESCRIPTION ================= An internal flag is used to temporarily suppress IOMMU TLB flushes, in order to consolidate multiple single page flushes into one wider flush. This flag is not cleared again, on certain error paths. This can result in TLB flushes not happening when they are needed. Retaining stale TLB entries could allow guests access to memory that ought to have been revoked, or grant greater access than intended. IMPACT ====== Malicious guest administrators might be able to cause host-wide denial of service, or escalate their privilege to that of the host. VULNERABLE SYSTEMS ================== Only VMs which have been assigned PCI devices can exploit the bug. Only systems using Intel VT-d are vulnerable, since the bug is in the VT-d specific code in Xen. Xen 4.2.x and later are vulnerable. Xen 4.1.x and earlier are not vulnerable. MITIGATION ========== This issue can be avoided by not assigning PCI devices to untrusted guests on systems supporting Intel VT-d. CREDITS ======= This issue was discovered by Jan Beulich. RESOLUTION ========== Applying the attached patch resolves this issue. xsa80.patch Xen 4.2.x, Xen 4.3.x, xen-unstable $ sha256sum xsa80*.patch d15e627c59dd48e1cacb2fbcd5e2148975daa426df1f693b991d69201c048e77 xsa80.patch $ -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) iQEcBAEBAgAGBQJSpw/SAAoJEIP+FMlX6CvZu48IAIsJz4NRVXqCYl9hjtFhgfhL /V2J9T9Xp0/iNTmfP6FMu2wIZohAcosMOaZ5NXouIb50bta2mpeQhA0K0RZLEin5 2QH9rcfYYchAeQjPt72QVPH3iMTWdPXXV3HDuqXI+G+II64bonHvArtAwYxeJpWM ZwegEnxsEk2YsYk+TYGMzQws2sXygx06JxEJsE9/Q6BOJG9jnwvtRsleVDuMuBMR 6U1DdaxZohk5k1xqS5Y6udyXpJQgob7fMdwAoLWxxlb7vB3kOgzMoorVrzRZ0LcZ LmqBYxdCQRV+Tn19eE9xo1LjBr9qBS13nGDQbyIADoF85N/SmZoMycRsqunUQ2U= =rB23 -----END PGP SIGNATURE----- --=separator Content-Type: application/octet-stream; name="xsa80.patch" Content-Disposition: attachment; filename="xsa80.patch" Content-Transfer-Encoding: base64 SU9NTVU6IGNsZWFyICJkb24ndCBmbHVzaCIgb3ZlcnJpZGUgb24gZXJyb3Ig cGF0aHMKCkJvdGggeGVubWVtX2FkZF90b19waHlzbWFwKCkgYW5kIGlvbW11 X3BvcHVsYXRlX3BhZ2VfdGFibGUoKSBlYWNoIGhhdmUKYW4gZXJyb3IgcGF0 aCB0aGF0IGZhaWxzIHRvIGNsZWFyIHRoYXQgZmxhZywgdGh1cyBzdXBwcmVz c2luZyBmdXJ0aGVyCmZsdXNoZXMgb24gdGhlIHJlc3BlY3RpdmUgcENQVS4K CkluIGlvbW11X3BvcHVsYXRlX3BhZ2VfdGFibGUoKSBhbHNvIHNsaWdodGx5 IHJlLWFycmFuZ2UgY29kZSB0byBhdm9pZAp0aGUgZmFsc2UgaW1wcmVzc2lv biBvZiB0aGUgZmxhZyBpbiBxdWVzdGlvbiBiZWluZyBndWFyZGVkIGJ5IGEK ZG9tYWluJ3MgcGFnZV9hbGxvY19sb2NrLgoKVGhpcyBpcyBDVkUtMjAxMy02 NDAwIC8gWFNBLTgwLgoKU2lnbmVkLW9mZi1ieTogSmFuIEJldWxpY2ggPGpi ZXVsaWNoQHN1c2UuY29tPgpBY2tlZC1ieTogSWFuIENhbXBiZWxsIDxpYW4u Y2FtcGJlbGxAY2l0cml4LmNvbT4KCi0tLSBhL3hlbi9hcmNoL3g4Ni9tbS5j CisrKyBiL3hlbi9hcmNoL3g4Ni9tbS5jCkBAIC00NjQ4LDcgKzQ2NDgsNyBA QCBzdGF0aWMgaW50IHhlbm1lbV9hZGRfdG9fcGh5c21hcChzdHJ1Y3QgCiAg ICAgICAgIHsKICAgICAgICAgICAgIHJjID0geGVubWVtX2FkZF90b19waHlz bWFwX29uY2UoZCwgeGF0cCk7CiAgICAgICAgICAgICBpZiAoIHJjIDwgMCAp Ci0gICAgICAgICAgICAgICAgcmV0dXJuIHJjOworICAgICAgICAgICAgICAg IGJyZWFrOwogCiAgICAgICAgICAgICB4YXRwLT5pZHgrKzsKICAgICAgICAg ICAgIHhhdHAtPmdwZm4rKzsKLS0tIGEveGVuL2RyaXZlcnMvcGFzc3Rocm91 Z2gvaW9tbXUuYworKysgYi94ZW4vZHJpdmVycy9wYXNzdGhyb3VnaC9pb21t dS5jCkBAIC0zMDYsMTEgKzMwNiwxMSBAQCBzdGF0aWMgaW50IGlvbW11X3Bv cHVsYXRlX3BhZ2VfdGFibGUoc3RyCiB7CiAgICAgc3RydWN0IGh2bV9pb21t dSAqaGQgPSBkb21haW5faHZtX2lvbW11KGQpOwogICAgIHN0cnVjdCBwYWdl X2luZm8gKnBhZ2U7Ci0gICAgaW50IHJjOworICAgIGludCByYyA9IDA7CiAK KyAgICB0aGlzX2NwdShpb21tdV9kb250X2ZsdXNoX2lvdGxiKSA9IDE7CiAg ICAgc3Bpbl9sb2NrKCZkLT5wYWdlX2FsbG9jX2xvY2spOwogCi0gICAgdGhp c19jcHUoaW9tbXVfZG9udF9mbHVzaF9pb3RsYikgPSAxOwogICAgIHBhZ2Vf bGlzdF9mb3JfZWFjaCAoIHBhZ2UsICZkLT5wYWdlX2xpc3QgKQogICAgIHsK ICAgICAgICAgaWYgKCBpc19odm1fZG9tYWluKGQpIHx8CkBAIC0zMjAsMTgg KzMyMCwyMCBAQCBzdGF0aWMgaW50IGlvbW11X3BvcHVsYXRlX3BhZ2VfdGFi bGUoc3RyCiAgICAgICAgICAgICByYyA9IGhkLT5wbGF0Zm9ybV9vcHMtPm1h cF9wYWdlKAogICAgICAgICAgICAgICAgIGQsIG1mbl90b19nbWZuKGQsIHBh Z2VfdG9fbWZuKHBhZ2UpKSwgcGFnZV90b19tZm4ocGFnZSksCiAgICAgICAg ICAgICAgICAgSU9NTVVGX3JlYWRhYmxlfElPTU1VRl93cml0YWJsZSk7Ci0g ICAgICAgICAgICBpZiAocmMpCi0gICAgICAgICAgICB7Ci0gICAgICAgICAg ICAgICAgc3Bpbl91bmxvY2soJmQtPnBhZ2VfYWxsb2NfbG9jayk7Ci0gICAg ICAgICAgICAgICAgaGQtPnBsYXRmb3JtX29wcy0+dGVhcmRvd24oZCk7Ci0g ICAgICAgICAgICAgICAgcmV0dXJuIHJjOwotICAgICAgICAgICAgfQorICAg ICAgICAgICAgaWYgKCByYyApCisgICAgICAgICAgICAgICAgYnJlYWs7CiAg ICAgICAgIH0KICAgICB9Ci0gICAgdGhpc19jcHUoaW9tbXVfZG9udF9mbHVz aF9pb3RsYikgPSAwOwotICAgIGlvbW11X2lvdGxiX2ZsdXNoX2FsbChkKTsK KwogICAgIHNwaW5fdW5sb2NrKCZkLT5wYWdlX2FsbG9jX2xvY2spOwotICAg IHJldHVybiAwOworICAgIHRoaXNfY3B1KGlvbW11X2RvbnRfZmx1c2hfaW90 bGIpID0gMDsKKworICAgIGlmICggIXJjICkKKyAgICAgICAgaW9tbXVfaW90 bGJfZmx1c2hfYWxsKGQpOworICAgIGVsc2UKKyAgICAgICAgaGQtPnBsYXRm b3JtX29wcy0+dGVhcmRvd24oZCk7CisKKyAgICByZXR1cm4gcmM7CiB9CiAK IAo= --=separator Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --=separator-- From xen-users-bounces@lists.xen.org Tue Dec 10 12:59:33 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 12:59:33 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMte-0006Zq-KW; Tue, 10 Dec 2013 12:58:42 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMtb-0006Uq-MF; Tue, 10 Dec 2013 12:58:40 +0000 Received: from [85.158.139.211:18165] by server-13.bemta-5.messagelabs.com id A8/22-11357-EFF07A25; Tue, 10 Dec 2013 12:58:38 +0000 X-Env-Sender: iwj@xenbits.xen.org X-Msg-Ref: server-15.tower-206.messagelabs.com!1386680316!3508789!1 X-Originating-IP: [50.57.168.107] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 2357 invoked from network); 10 Dec 2013 12:58:37 -0000 Received: from mail.xen.org (HELO mail.xen.org) (50.57.168.107) by server-15.tower-206.messagelabs.com with AES256-SHA encrypted SMTP; 10 Dec 2013 12:58:37 -0000 Received: from xenbits.xen.org ([50.57.170.242]) by mail.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMtS-000071-1c; Tue, 10 Dec 2013 12:58:30 +0000 Received: from iwj by xenbits.xen.org with local (Exim 4.72) (envelope-from ) id 1VqMtR-0007D8-OW; Tue, 10 Dec 2013 12:58:29 +0000 Date: Tue, 10 Dec 2013 12:58:29 +0000 Message-Id: Content-Type: multipart/mixed; boundary="=separator"; charset="utf-8" Content-Transfer-Encoding: binary MIME-Version: 1.0 X-Mailer: MIME-tools 5.428 (Entity 5.428) To: xen-announce@lists.xen.org, xen-devel@lists.xen.org, xen-users@lists.xen.org, oss-security@lists.openwall.com From: Xen.org security team Cc: "Xen.org security team" Subject: [Xen-users] Xen Security Advisory 77 - Disaggregated domain management security status X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --=separator Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Xen Security Advisory XSA-77 version 3 Disaggregated domain management security status UPDATES IN VERSION 3 ==================== Public release. The included documentation patch now updates the xsm-flash.txt documentation rather than the Xen public headers. The advisory has been updated to reflect this. Made the warning about the documentation patch stand out more clearly. ISSUE DESCRIPTION ================= Xen supports disaggregation of various support and management functions into their own domains; this is often done for security and robustness reasons. In Xen 4.3 additional functionality was introduced to allow further disaggregation: the Xen Security Modules mechanism was enhanced to make it possible to delegate various domain control hypercalls to particular other domains, rather than only permitting use by dom0. However the several affected hypercall implementations were originally written to be used only by the totally-privileged dom0, and have not been reviewed for security when exposed to supposedly-only-semi-privileged disaggregated management domains. But such management domains are (in such a design) to be seen as potentially hostile, e.g. due to privilege escalation following exploitation of a bug in the management domain. As a result, the potential security benefits of toolstack disaggregation are not always fully realised. This constitutes a breach of the enhanced security promises implied by the Xen APIs in Xen in 4.3 and later. The affected hypercalls are: __HYPERVISOR_domctl: The majority of the XEN_DOMCTL_* subops are affected. Exceptions are listed below. __HYPERVISOR_sysctl: All XEN_SYSCTL_* subops are affected. __HYPERVISOR_memory_op: A small number of XENMEM_* subops are affected. See below. __HYPERVISOR_tmem_op: All TMEMC_* sub-subops of the TMEM_CONTROL subop are affected. The majority of the domctls are subject to this issue. Prior to 4.3, only the following domctls were disaggregatable, and they are NOT affected by these problems: XEN_DOMCTL_ioport_mapping XEN_DOMCTL_bind_pt_irq XEN_DOMCTL_memory_mapping XEN_DOMCTL_unbind_pt_irq The implementations of these were written with semi-trusted callers in mind. Only the following memory op subops are affected: XENMEM_set_pod_target XENMEM_get_pod_target XENMEM_claim_pages The remainder of the memory ops were written with untrusted or semi-trusted callers in mind. IMPACT ====== Domains deliberately given partial management control may be able to deny service to the entire host or even escalate their privileges. As a result, in a system designed to enhance security by radically disaggregating the management, the security may be reduced. But, the security will be no worse than a non-disaggregated design. VULNERABLE SYSTEMS ================== This issue is only relevant to systems which intend to increase security through the use of advanced disaggregated management techniques. This does not include systems using libxl, libvirt, xm/xend, XCP/XenServer, OpenStack or CloudStack (unless substantially modified or supplemented, as compared to versions supplied by the respective upstreams). This issue is not relevant to stub device models, driver domains, or stub xenstored. Those disaggregation techniques do not rely on granting the semi-privileged support domains access to the affected interfaces, and are believed to provide the intended security benefits. This issue is only relevant to Xen 4.3 and xen-unstable, and not to any earlier version. PROCESS FOR VULNERABILITIES IN AFFECTED INTERFACES ================================================== Until the interfaces have been properly reviewed for security against hostile callers, the Xen.org security team intends (subject of course to the permission of anyone disclosing to us) to handle these and future vulnerabilities in these interfaces in public, as if they were normal non-security-related bugs. This applies only to bugs which do no more than reduce the security of a radically disaggregated system to the security of a non-disaggregated one. Here a "radically disaggregated system" is one which uses the XSM mechanism to delegate the affected interfaces to other-than-fully-trusted domains. This policy does not apply to bugs which affect stub device models, driver domains, or stub xenstored - even if those bugs do no worse than reduce the security of such a system to one whose device models, backend drivers, or xenstore, run in dom0. The list of interfaces which are subject to the above process exception are listed in the Xen Source tree in docs/misc/xsm-flask under the heading "Security Status of dom0 disaggregation". This document is also available at http://xenbits.xen.org/docs/unstable/misc/xsm-flask.txt. We intend that currently-known problems will be publicly disclosed on the xen-devel mailing list, as normal bug reports, at the expiry of the XSA-77 embargo. In the meantime the list below may be helpful. MITIGATION ========== The issues discussed in this advisory are themselves bugs in features used for a security risk mitigation. There is no further mitigation available, beyond general measures to try to avoid parts of the system management becoming controlled by attackers. Those are the kind of measures which we expect any users of radical disaggregation to have already deployed. Switching from disaggregated to a non-disaggregated operation does NOT mitigate these vulnerabilities. Rather, it simply recategorises the vulnerability to hostile management code, regarding it "as designed"; thus it merely reclassifies these issues as "not a bug". Users and vendors of disaggregated systems should not change their configuration. The robustness benefits of disaggregation are unaffected, and (depending on system design) security benefits are likely to remain despite the vulnerabilities. RESOLUTION ========== We hope that the control interface attack surface can be reviewed and improved so that disaggregation can deliver its security benefits more fully. Patches resulting from this process will be developed in public and applied to the Xen trees as if they were ordinary bugfixes. In the meantime the attached patch will be applied to the unstable branch in order to track which interfaces are subject to this exception. This patch is purely documentary and DOES NOT resolve any issue. $ sha256sum xsa77*.patch bd9daffa8abfb05fb4a474e903dcd777352a705c1cf6e89343ea6545d545e4cb xsa77-unstable.patch $ CREDITS ======= The issues which prompted this advisory were discovered by Jan Beulich and Don Slutz. LIST OF KNOWN VULNERABILITIES ============================= **NOTE** that this is unlikely to be a complete list of problems. **NOTE** that after publication of this advisory, after the embargo ends, the advisory will no longer be updated to extend this list of vulnerabilities. See `Process for domctl vulnerabilities', above. Multiple domctls can be made, by the caller, to perform excessively long-running operations. This can result in host-wide denial of service and watchdog-induced crashes. XEN_DOMCTL_gethvmcontext_partial allows access to guest state, in particular certain pieces that are per-vCPU. If one or more of a guest's vCPU-s are offline, the space internally allocated to store each individual vCPU's state would not get fully used and, due to another bug, information from the portion that didn't get initialized may be returned back to the caller. In the course of processing the request to set register state for another PV guest's vCPU, the hypervisor updated the in memory copy of the debug register values twice - first by simply copying over the values, and in a second step through code properly verifying them. Between the two operations there are, however, other error exit paths, making it possible that unvalidated state could remain in place and be loaded when the vCPU is next scheduled to run. -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) iQEcBAEBAgAGBQJSpw/NAAoJEIP+FMlX6CvZBskH/j4YsHS48A82IEez4Zn7m+m6 n2d3UjT7fAAgxvqD3YJ7gsZI0Xi4PKw4ThHmmV6ZIdE18jju9ByrcsLLA/z77sO4 eUEastK49XKQ1Him7v+XB2/zfZ2ty/grnWS9dk5r18hVQLv+KIuQoyB+/QHt3bD4 i06R6iyhE57yJiD72bTNflITioyuZybMG/MM+7Pby8OVblagNgUS3YK9Z5J246/e fWDTUsgI6c63zWRjqwBZB0vI+omr/GfNUX0e77LMnv/f/X6jwVBdNML2RDI9HDRO lWdfQQeYHQN/mK6OD5s13+qIonv3iq8wJjeRxvQpQKAnjynFu61VDnp/ghN6xnE= =lQLn -----END PGP SIGNATURE----- --=separator Content-Type: application/octet-stream; name="xsa77-unstable.patch" Content-Disposition: attachment; filename="xsa77-unstable.patch" Content-Transfer-Encoding: base64 eGVuOiBsaXN0IGludGVyZmFjZXMgc3ViamVjdCB0byB0aGUgc2VjdXJpdHkg cHJvY2VzcyBleGNlcHRpb24gaW4gWFNBLTc3CgpMaXN0IGFsbCB0aGUgc3Vi IG9wcyBvZjoKICBfX0hZUEVSVklTT1JfZG9tY3RsCiAgX19IWVBFUlZJU09S X3N5c2N0bAogIF9fSFlQRVJWSVNPUl9tZW1vcnlfb3AKICBfX0hZUEVSVklT T1JfdG1lbV9vcAp3aGljaCBhcmUgc3ViamVjdCB0byB0aGUgcG9saWN5IGdp dmVuIGluCmh0dHA6Ly94ZW5iaXRzLnhlbi5vcmcveHNhL2Fkdmlzb3J5LTc3 Lmh0bWwKCkl0IGlzIGV4cGVjdGVkIHRoYXQgdGhlc2UgbGlzdHMgd2lsbCBi ZSB3aGl0dGxlZCBhd2F5IGFzIGVhY2ggaW50ZXJmYWNlIGlzCmF1ZGl0ZWQg Zm9yIHNhZmV0eS4KCk5ldyBpbnRlcmZhY2VzIHNob3VsZCBiZSBleHBlY3Rl ZCB0byBiZSBzYWZlIHdoZW4gaW50cm9kdWNlZCAoSU9XIHRoZSBsaXN0CnNo b3VsZCBuZXZlciBiZSBleHBhbmRlZCkuCgpUaGlzIGlzIFhTQS03Ny4KClNp Z25lZC1vZmYtYnk6IElhbiBDYW1wYmVsbCA8aWFuLmNhbXBiZWxsQGNpdHJp eC5jb20+CgpkaWZmIC0tZ2l0IGEvZG9jcy9taXNjL3hzbS1mbGFzay50eHQg Yi9kb2NzL21pc2MveHNtLWZsYXNrLnR4dAppbmRleCBmZjgxYjAxLi5kZGQ1 ODMxIDEwMDY0NAotLS0gYS9kb2NzL21pc2MveHNtLWZsYXNrLnR4dAorKysg Yi9kb2NzL21pc2MveHNtLWZsYXNrLnR4dApAQCAtMTcsNiArMTcsMTg5IEBA IFNvbWUgZXhhbXBsZXMgb2Ygd2hhdCBGTEFTSyBjYW4gZG86CiBTb21lIG9m IHRoZXNlIGV4YW1wbGVzIHJlcXVpcmUgZG9tMCBkaXNhZ2dyZWdhdGlvbiB0 byBiZSB1c2VmdWwsIHNpbmNlIHRoZQogZG9tYWluIGJ1aWxkIHByb2Nlc3Mg cmVxdWlyZXMgdGhlIGFiaWxpdHkgdG8gd3JpdGUgdG8gdGhlIG5ldyBkb21h aW4ncyBtZW1vcnkuCiAKK1NlY3VyaXR5IFN0YXR1cyBvZiBkb20wIGRpc2Fn Z3JlZ2F0aW9uCistLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0tLS0t LS0tLQorCitYZW4gc3VwcG9ydHMgZGlzYWdncmVnYXRpb24gb2YgdmFyaW91 cyBzdXBwb3J0IGFuZCBtYW5hZ2VtZW50CitmdW5jdGlvbnMgaW50byB0aGVp ciBvd24gZG9tYWlucywgdmlhIHRoZSBYU00gbWVjaGFuaXNtcyBkZXNjcmli ZWQgaW4KK3RoaXMgZG9jdW1lbnQuCisKK0hvd2V2ZXIgdGhlIGltcGxlbWVu dGF0aW9ucyBvZiB0aGVzZSBzdXBwb3J0IGFuZCBtYW5hZ2VtZW50IGludGVy ZmFjZXMKK3dlcmUgb3JpZ2luYWxseSB3cml0dGVuIHRvIGJlIHVzZWQgb25s eSBieSB0aGUgdG90YWxseS1wcml2aWxlZ2VkCitkb20wLCBhbmQgaGF2ZSBu b3QgYmVlbiByZXZpZXdlZCBmb3Igc2VjdXJpdHkgd2hlbiBleHBvc2VkIHRv CitzdXBwb3NlZGx5LW9ubHktc2VtaS1wcml2aWxlZ2VkIGRpc2FnZ3JlZ2F0 ZWQgbWFuYWdlbWVudCBkb21haW5zLiAgQnV0CitzdWNoIG1hbmFnZW1lbnQg ZG9tYWlucyBhcmUgKGluIHN1Y2ggYSBkZXNpZ24pIHRvIGJlIHNlZW4gYXMK K3BvdGVudGlhbGx5IGhvc3RpbGUsIGUuZy4gZHVlIHRvIHByaXZpbGVnZSBl c2NhbGF0aW9uIGZvbGxvd2luZworZXhwbG9pdGF0aW9uIG9mIGEgYnVnIGlu IHRoZSBtYW5hZ2VtZW50IGRvbWFpbi4KKworVW50aWwgdGhlIGludGVyZmFj ZXMgaGF2ZSBiZWVuIHByb3Blcmx5IHJldmlld2VkIGZvciBzZWN1cml0eSBh Z2FpbnN0Citob3N0aWxlIGNhbGxlcnMsIHRoZSBYZW4ub3JnIHNlY3VyaXR5 IHRlYW0gaW50ZW5kcyAoc3ViamVjdCBvZiBjb3Vyc2UKK3RvIHRoZSBwZXJt aXNzaW9uIG9mIGFueW9uZSBkaXNjbG9zaW5nIHRvIHVzKSB0byBoYW5kbGUg dGhlc2UgYW5kCitmdXR1cmUgdnVsbmVyYWJpbGl0aWVzIGluIHRoZXNlIGlu dGVyZmFjZXMgaW4gcHVibGljLCBhcyBpZiB0aGV5IHdlcmUKK25vcm1hbCBu b24tc2VjdXJpdHktcmVsYXRlZCBidWdzLgorCitUaGlzIGFwcGxpZXMgb25s eSB0byBidWdzIHdoaWNoIGRvIG5vIG1vcmUgdGhhbiByZWR1Y2UgdGhlIHNl Y3VyaXR5IG9mCithIHJhZGljYWxseSBkaXNhZ2dyZWdhdGVkIHN5c3RlbSB0 byB0aGUgc2VjdXJpdHkgb2YgYQorbm9uLWRpc2FnZ3JlZ2F0ZWQgb25lLiAg SGVyZSBhICJyYWRpY2FsbHkgZGlzYWdncmVnYXRlZCBzeXN0ZW0iIGlzIG9u ZQord2hpY2ggdXNlcyB0aGUgWFNNIG1lY2hhbmlzbSB0byBkZWxlZ2F0ZSB0 aGUgYWZmZWN0ZWQgaW50ZXJmYWNlcyB0bworb3RoZXItdGhhbi1mdWxseS10 cnVzdGVkIGRvbWFpbnMuCisKK1RoaXMgcG9saWN5IGRvZXMgbm90IGFwcGx5 IHRvIGJ1Z3Mgd2hpY2ggYWZmZWN0IHN0dWIgZGV2aWNlIG1vZGVscywKK2Ry aXZlciBkb21haW5zLCBvciBzdHViIHhlbnN0b3JlZCAtIGV2ZW4gaWYgdGhv c2UgYnVncyBkbyBubyB3b3JzZQordGhhbiByZWR1Y2UgdGhlIHNlY3VyaXR5 IG9mIHN1Y2ggYSBzeXN0ZW0gdG8gb25lIHdob3NlIGRldmljZSBtb2RlbHMs CitiYWNrZW5kIGRyaXZlcnMsIG9yIHhlbnN0b3JlLCBydW4gaW4gZG9tMC4K KworRm9yIG1vcmUgaW5mb3JtYXRpb24gc2VlIGh0dHA6Ly94ZW5iaXRzLnhl bi5vcmcveHNhL2Fkdmlzb3J5LTc3Lmh0bWwuCisKK1RoZSBmb2xsb3dpbmcg aW50ZXJmYWNlcyBhcmUgY292ZXJlZCBieSB0aGlzIHN0YXRlbWVudC4gIElu dGVyZmFjZXMKK25vdCBsaXN0ZWQgaGVyZSBhcmUgY29uc2lkZXJlZCBzYWZl IGZvciBkaXNhZ2dyZWdhdGlvbiwgc2VjdXJpdHkKK2lzc3VlcyBmb3VuZCBp biBpbnRlcmZhY2VzIG5vdCBsaXN0ZWQgaGVyZSB3aWxsIGJlIGhhbmRsZWQg YWNjb3JkaW5nCit0byB0aGUgbm9ybWFsIHNlY3VyaXR5IHByb2JsZW0gcmVz cG9uc2UgcG9saWN5CitodHRwOi8vd3d3LnhlbnByb2plY3Qub3JnL3NlY3Vy aXR5LXBvbGljeS5odG1sLgorCitfX0hZUEVSVklTT1JfZG9tY3RsICh4ZW4v aW5jbHVkZS9wdWJsaWMvZG9tY3RsLmgpCisKKyBUaGUgZm9sbG93aW5nIHN1 Ym9wcyBhcmUgY292ZXJlZCBieSB0aGlzIHN0YXRlbWVudC4gc3Vib3BzIG5v dCBsaXN0ZWQKKyBoZXJlIGFyZSBjb25zaWRlcmVkIHNhZmUgZm9yIGRpc2Fn Z3JlZ2F0aW9uLgorCisgKiBYRU5fRE9NQ1RMX2NyZWF0ZWRvbWFpbgorICog WEVOX0RPTUNUTF9kZXN0cm95ZG9tYWluCisgKiBYRU5fRE9NQ1RMX3BhdXNl ZG9tYWluCisgKiBYRU5fRE9NQ1RMX3VucGF1c2Vkb21haW4KKyAqIFhFTl9E T01DVExfZ2V0ZG9tYWluaW5mbworICogWEVOX0RPTUNUTF9nZXRtZW1saXN0 CisgKiBYRU5fRE9NQ1RMX2dldHBhZ2VmcmFtZWluZm8KKyAqIFhFTl9ET01D VExfZ2V0cGFnZWZyYW1laW5mbzIKKyAqIFhFTl9ET01DVExfc2V0dmNwdWFm ZmluaXR5CisgKiBYRU5fRE9NQ1RMX3NoYWRvd19vcAorICogWEVOX0RPTUNU TF9tYXhfbWVtCisgKiBYRU5fRE9NQ1RMX3NldHZjcHVjb250ZXh0CisgKiBY RU5fRE9NQ1RMX2dldHZjcHVjb250ZXh0CisgKiBYRU5fRE9NQ1RMX2dldHZj cHVpbmZvCisgKiBYRU5fRE9NQ1RMX21heF92Y3B1cworICogWEVOX0RPTUNU TF9zY2hlZHVsZXJfb3AKKyAqIFhFTl9ET01DVExfc2V0ZG9tYWluaGFuZGxl CisgKiBYRU5fRE9NQ1RMX3NldGRlYnVnZ2luZworICogWEVOX0RPTUNUTF9p cnFfcGVybWlzc2lvbgorICogWEVOX0RPTUNUTF9pb21lbV9wZXJtaXNzaW9u CisgKiBYRU5fRE9NQ1RMX2lvcG9ydF9wZXJtaXNzaW9uCisgKiBYRU5fRE9N Q1RMX2h5cGVyY2FsbF9pbml0CisgKiBYRU5fRE9NQ1RMX2FyY2hfc2V0dXAK KyAqIFhFTl9ET01DVExfc2V0dGltZW9mZnNldAorICogWEVOX0RPTUNUTF9n ZXR2Y3B1YWZmaW5pdHkKKyAqIFhFTl9ET01DVExfcmVhbF9tb2RlX2FyZWEK KyAqIFhFTl9ET01DVExfcmVzdW1lZG9tYWluCisgKiBYRU5fRE9NQ1RMX3Nl bmR0cmlnZ2VyCisgKiBYRU5fRE9NQ1RMX3N1YnNjcmliZQorICogWEVOX0RP TUNUTF9nZXRodm1jb250ZXh0CisgKiBYRU5fRE9NQ1RMX3NldGh2bWNvbnRl eHQKKyAqIFhFTl9ET01DVExfc2V0X2FkZHJlc3Nfc2l6ZQorICogWEVOX0RP TUNUTF9nZXRfYWRkcmVzc19zaXplCisgKiBYRU5fRE9NQ1RMX2Fzc2lnbl9k ZXZpY2UKKyAqIFhFTl9ET01DVExfcGluX21lbV9jYWNoZWF0dHIKKyAqIFhF Tl9ET01DVExfc2V0X2V4dF92Y3B1Y29udGV4dAorICogWEVOX0RPTUNUTF9n ZXRfZXh0X3ZjcHVjb250ZXh0CisgKiBYRU5fRE9NQ1RMX3NldF9vcHRfZmVh dHVyZQorICogWEVOX0RPTUNUTF90ZXN0X2Fzc2lnbl9kZXZpY2UKKyAqIFhF Tl9ET01DVExfc2V0X3RhcmdldAorICogWEVOX0RPTUNUTF9kZWFzc2lnbl9k ZXZpY2UKKyAqIFhFTl9ET01DVExfc2V0X2NwdWlkCisgKiBYRU5fRE9NQ1RM X2dldF9kZXZpY2VfZ3JvdXAKKyAqIFhFTl9ET01DVExfc2V0X21hY2hpbmVf YWRkcmVzc19zaXplCisgKiBYRU5fRE9NQ1RMX2dldF9tYWNoaW5lX2FkZHJl c3Nfc2l6ZQorICogWEVOX0RPTUNUTF9zdXBwcmVzc19zcHVyaW91c19wYWdl X2ZhdWx0cworICogWEVOX0RPTUNUTF9kZWJ1Z19vcAorICogWEVOX0RPTUNU TF9nZXRodm1jb250ZXh0X3BhcnRpYWwKKyAqIFhFTl9ET01DVExfbWVtX2V2 ZW50X29wCisgKiBYRU5fRE9NQ1RMX21lbV9zaGFyaW5nX29wCisgKiBYRU5f RE9NQ1RMX2Rpc2FibGVfbWlncmF0ZQorICogWEVOX0RPTUNUTF9nZXR0c2Np bmZvCisgKiBYRU5fRE9NQ1RMX3NldHRzY2luZm8KKyAqIFhFTl9ET01DVExf Z2V0cGFnZWZyYW1laW5mbzMKKyAqIFhFTl9ET01DVExfc2V0dmNwdWV4dHN0 YXRlCisgKiBYRU5fRE9NQ1RMX2dldHZjcHVleHRzdGF0ZQorICogWEVOX0RP TUNUTF9zZXRfYWNjZXNzX3JlcXVpcmVkCisgKiBYRU5fRE9NQ1RMX2F1ZGl0 X3AybQorICogWEVOX0RPTUNUTF9zZXRfdmlycV9oYW5kbGVyCisgKiBYRU5f RE9NQ1RMX3NldF9icm9rZW5fcGFnZV9wMm0KKyAqIFhFTl9ET01DVExfc2V0 bm9kZWFmZmluaXR5CisgKiBYRU5fRE9NQ1RMX2dldG5vZGVhZmZpbml0eQor ICogWEVOX0RPTUNUTF9zZXRfbWF4X2V2dGNobgorICogWEVOX0RPTUNUTF9n ZGJzeF9ndWVzdG1lbWlvCisgKiBYRU5fRE9NQ1RMX2dkYnN4X3BhdXNldmNw dQorICogWEVOX0RPTUNUTF9nZGJzeF91bnBhdXNldmNwdQorICogWEVOX0RP TUNUTF9nZGJzeF9kb21zdGF0dXMKKworX19IWVBFUlZJU09SX3N5c2N0bCAo eGVuL2luY2x1ZGUvcHVibGljL3N5c2N0bC5oKQorCisgVGhlIGZvbGxvd2lu ZyBzdWJvcHMgYXJlIGNvdmVyZWQgYnkgdGhpcyBzdGF0ZW1lbnQuIHN1Ym9w cyBub3QgbGlzdGVkCisgaGVyZSBhcmUgY29uc2lkZXJlZCBzYWZlIGZvciBk aXNhZ2dyZWdhdGlvbi4KKworICogWEVOX1NZU0NUTF9yZWFkY29uc29sZQor ICogWEVOX1NZU0NUTF90YnVmX29wCisgKiBYRU5fU1lTQ1RMX3BoeXNpbmZv CisgKiBYRU5fU1lTQ1RMX3NjaGVkX2lkCisgKiBYRU5fU1lTQ1RMX3BlcmZj X29wCisgKiBYRU5fU1lTQ1RMX2dldGRvbWFpbmluZm9saXN0CisgKiBYRU5f U1lTQ1RMX2RlYnVnX2tleXMKKyAqIFhFTl9TWVNDVExfZ2V0Y3B1aW5mbwor ICogWEVOX1NZU0NUTF9hdmFpbGhlYXAKKyAqIFhFTl9TWVNDVExfZ2V0X3Bt c3RhdAorICogWEVOX1NZU0NUTF9jcHVfaG90cGx1ZworICogWEVOX1NZU0NU TF9wbV9vcAorICogWEVOX1NZU0NUTF9wYWdlX29mZmxpbmVfb3AKKyAqIFhF Tl9TWVNDVExfbG9ja3Byb2Zfb3AKKyAqIFhFTl9TWVNDVExfdG9wb2xvZ3lp bmZvCisgKiBYRU5fU1lTQ1RMX251bWFpbmZvCisgKiBYRU5fU1lTQ1RMX2Nw dXBvb2xfb3AKKyAqIFhFTl9TWVNDVExfc2NoZWR1bGVyX29wCisgKiBYRU5f U1lTQ1RMX2NvdmVyYWdlX29wCisKK19fSFlQRVJWSVNPUl9tZW1vcnlfb3Ag KHhlbi9pbmNsdWRlL3B1YmxpYy9tZW1vcnkuaCkKKworIFRoZSBmb2xsb3dp bmcgc3Vib3BzIGFyZSBjb3ZlcmVkIGJ5IHRoaXMgc3RhdGVtZW50LiBzdWJv cHMgbm90IGxpc3RlZAorIGhlcmUgYXJlIGNvbnNpZGVyZWQgc2FmZSBmb3Ig ZGlzYWdncmVnYXRpb24uCisKKyAqIFhFTk1FTV9zZXRfcG9kX3RhcmdldAor ICogWEVOTUVNX2dldF9wb2RfdGFyZ2V0CisgKiBYRU5NRU1fY2xhaW1fcGFn ZXMKKworX19IWVBFUlZJU09SX3RtZW1fb3AgKHhlbi9pbmNsdWRlL3B1Ymxp Yy90bWVtLmgpCisKKyBUaGUgZm9sbG93aW5nIHRtZW0gY29udHJvbCBvcHMs IHRoYXQgaXMgdGhlIHN1Yi1zdWJvcHMgb2YKKyBUTUVNX0NPTlRST0wsIGFy ZSBjb3ZlcmVkIGJ5IHRoaXMgc3RhdGVtZW50LiAKKworIE5vdGUgdGhhdCBU TUVNIGlzIGFsc28gc3ViamVjdCB0byBhIHNpbWlsYXIgcG9saWN5IGFyaXNp bmcgZnJvbQorIFhTQS0xNSBodHRwOi8vbGlzdHMueGVuLm9yZy9hcmNoaXZl cy9odG1sL3hlbi1hbm5vdW5jZS8yMDEyLTA5L21zZzAwMDA2Lmh0bWwuCisg RHVlIHRvIHRoaXMgZXhpc3RpbmcgcG9saWN5IGFsbCBUTUVNIE9wcyBhcmUg YWxyZWFkeSBzdWJqZWN0IHRvCisgcmVkdWNlZCBzZWN1cml0eSBzdXBwb3J0 LgorCisgKiBUTUVNQ19USEFXCisgKiBUTUVNQ19GUkVFWkUKKyAqIFRNRU1D X0ZMVVNICisgKiBUTUVNQ19ERVNUUk9ZCisgKiBUTUVNQ19MSVNUCisgKiBU TUVNQ19TRVRfV0VJR0hUCisgKiBUTUVNQ19TRVRfQ0FQCisgKiBUTUVNQ19T RVRfQ09NUFJFU1MKKyAqIFRNRU1DX1FVRVJZX0ZSRUVBQkxFX01CCisgKiBU TUVNQ19TQVZFX0JFR0lOCisgKiBUTUVNQ19TQVZFX0dFVF9WRVJTSU9OCisg KiBUTUVNQ19TQVZFX0dFVF9NQVhQT09MUworICogVE1FTUNfU0FWRV9HRVRf Q0xJRU5UX1dFSUdIVAorICogVE1FTUNfU0FWRV9HRVRfQ0xJRU5UX0NBUAor ICogVE1FTUNfU0FWRV9HRVRfQ0xJRU5UX0ZMQUdTCisgKiBUTUVNQ19TQVZF X0dFVF9QT09MX0ZMQUdTCisgKiBUTUVNQ19TQVZFX0dFVF9QT09MX05QQUdF UworICogVE1FTUNfU0FWRV9HRVRfUE9PTF9VVUlECisgKiBUTUVNQ19TQVZF X0dFVF9ORVhUX1BBR0UKKyAqIFRNRU1DX1NBVkVfR0VUX05FWFRfSU5WCisg KiBUTUVNQ19TQVZFX0VORAorICogVE1FTUNfUkVTVE9SRV9CRUdJTgorICog VE1FTUNfUkVTVE9SRV9QVVRfUEFHRQorICogVE1FTUNfUkVTVE9SRV9GTFVT SF9QQUdFCisKKwogCiBTZXR0aW5nIHVwIEZMQVNLCiAtLS0tLS0tLS0tLS0t LS0tCg== --=separator Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --=separator-- From xen-users-bounces@lists.xen.org Tue Dec 10 12:59:33 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 12:59:33 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMth-0006de-4X; Tue, 10 Dec 2013 12:58:45 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMtd-0006XI-AE; Tue, 10 Dec 2013 12:58:41 +0000 Received: from [85.158.143.35:29138] by server-1.bemta-4.messagelabs.com id AE/32-02132-00017A25; Tue, 10 Dec 2013 12:58:40 +0000 X-Env-Sender: iwj@xenbits.xen.org X-Msg-Ref: server-7.tower-21.messagelabs.com!1386680318!4616381!1 X-Originating-IP: [50.57.168.107] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 6930 invoked from network); 10 Dec 2013 12:58:39 -0000 Received: from mail.xen.org (HELO mail.xen.org) (50.57.168.107) by server-7.tower-21.messagelabs.com with AES256-SHA encrypted SMTP; 10 Dec 2013 12:58:39 -0000 Received: from xenbits.xen.org ([50.57.170.242]) by mail.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMtV-00007D-QA; Tue, 10 Dec 2013 12:58:33 +0000 Received: from iwj by xenbits.xen.org with local (Exim 4.72) (envelope-from ) id 1VqMtV-0007EA-Nj; Tue, 10 Dec 2013 12:58:33 +0000 Date: Tue, 10 Dec 2013 12:58:33 +0000 Message-Id: Content-Type: multipart/mixed; boundary="=separator"; charset="utf-8" Content-Transfer-Encoding: binary MIME-Version: 1.0 X-Mailer: MIME-tools 5.428 (Entity 5.428) To: xen-announce@lists.xen.org, xen-devel@lists.xen.org, xen-users@lists.xen.org, oss-security@lists.openwall.com From: Xen.org security team Cc: "Xen.org security team" Subject: [Xen-users] Xen Security Advisory 80 (CVE-2013-6400) - IOMMU TLB flushing may be inadvertently suppressed X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --=separator Content-Type: text/plain; charset="utf-8" Content-Disposition: inline Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNED MESSAGE----- Hash: SHA1 Xen Security Advisory CVE-2013-6400 / XSA-80 version 3 IOMMU TLB flushing may be inadvertently suppressed UPDATES IN VERSION 3 ==================== Public release. Corrected explanatory text to refer to the correct patch filename. ISSUE DESCRIPTION ================= An internal flag is used to temporarily suppress IOMMU TLB flushes, in order to consolidate multiple single page flushes into one wider flush. This flag is not cleared again, on certain error paths. This can result in TLB flushes not happening when they are needed. Retaining stale TLB entries could allow guests access to memory that ought to have been revoked, or grant greater access than intended. IMPACT ====== Malicious guest administrators might be able to cause host-wide denial of service, or escalate their privilege to that of the host. VULNERABLE SYSTEMS ================== Only VMs which have been assigned PCI devices can exploit the bug. Only systems using Intel VT-d are vulnerable, since the bug is in the VT-d specific code in Xen. Xen 4.2.x and later are vulnerable. Xen 4.1.x and earlier are not vulnerable. MITIGATION ========== This issue can be avoided by not assigning PCI devices to untrusted guests on systems supporting Intel VT-d. CREDITS ======= This issue was discovered by Jan Beulich. RESOLUTION ========== Applying the attached patch resolves this issue. xsa80.patch Xen 4.2.x, Xen 4.3.x, xen-unstable $ sha256sum xsa80*.patch d15e627c59dd48e1cacb2fbcd5e2148975daa426df1f693b991d69201c048e77 xsa80.patch $ -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.12 (GNU/Linux) iQEcBAEBAgAGBQJSpw/SAAoJEIP+FMlX6CvZu48IAIsJz4NRVXqCYl9hjtFhgfhL /V2J9T9Xp0/iNTmfP6FMu2wIZohAcosMOaZ5NXouIb50bta2mpeQhA0K0RZLEin5 2QH9rcfYYchAeQjPt72QVPH3iMTWdPXXV3HDuqXI+G+II64bonHvArtAwYxeJpWM ZwegEnxsEk2YsYk+TYGMzQws2sXygx06JxEJsE9/Q6BOJG9jnwvtRsleVDuMuBMR 6U1DdaxZohk5k1xqS5Y6udyXpJQgob7fMdwAoLWxxlb7vB3kOgzMoorVrzRZ0LcZ LmqBYxdCQRV+Tn19eE9xo1LjBr9qBS13nGDQbyIADoF85N/SmZoMycRsqunUQ2U= =rB23 -----END PGP SIGNATURE----- --=separator Content-Type: application/octet-stream; name="xsa80.patch" Content-Disposition: attachment; filename="xsa80.patch" Content-Transfer-Encoding: base64 SU9NTVU6IGNsZWFyICJkb24ndCBmbHVzaCIgb3ZlcnJpZGUgb24gZXJyb3Ig cGF0aHMKCkJvdGggeGVubWVtX2FkZF90b19waHlzbWFwKCkgYW5kIGlvbW11 X3BvcHVsYXRlX3BhZ2VfdGFibGUoKSBlYWNoIGhhdmUKYW4gZXJyb3IgcGF0 aCB0aGF0IGZhaWxzIHRvIGNsZWFyIHRoYXQgZmxhZywgdGh1cyBzdXBwcmVz c2luZyBmdXJ0aGVyCmZsdXNoZXMgb24gdGhlIHJlc3BlY3RpdmUgcENQVS4K CkluIGlvbW11X3BvcHVsYXRlX3BhZ2VfdGFibGUoKSBhbHNvIHNsaWdodGx5 IHJlLWFycmFuZ2UgY29kZSB0byBhdm9pZAp0aGUgZmFsc2UgaW1wcmVzc2lv biBvZiB0aGUgZmxhZyBpbiBxdWVzdGlvbiBiZWluZyBndWFyZGVkIGJ5IGEK ZG9tYWluJ3MgcGFnZV9hbGxvY19sb2NrLgoKVGhpcyBpcyBDVkUtMjAxMy02 NDAwIC8gWFNBLTgwLgoKU2lnbmVkLW9mZi1ieTogSmFuIEJldWxpY2ggPGpi ZXVsaWNoQHN1c2UuY29tPgpBY2tlZC1ieTogSWFuIENhbXBiZWxsIDxpYW4u Y2FtcGJlbGxAY2l0cml4LmNvbT4KCi0tLSBhL3hlbi9hcmNoL3g4Ni9tbS5j CisrKyBiL3hlbi9hcmNoL3g4Ni9tbS5jCkBAIC00NjQ4LDcgKzQ2NDgsNyBA QCBzdGF0aWMgaW50IHhlbm1lbV9hZGRfdG9fcGh5c21hcChzdHJ1Y3QgCiAg ICAgICAgIHsKICAgICAgICAgICAgIHJjID0geGVubWVtX2FkZF90b19waHlz bWFwX29uY2UoZCwgeGF0cCk7CiAgICAgICAgICAgICBpZiAoIHJjIDwgMCAp Ci0gICAgICAgICAgICAgICAgcmV0dXJuIHJjOworICAgICAgICAgICAgICAg IGJyZWFrOwogCiAgICAgICAgICAgICB4YXRwLT5pZHgrKzsKICAgICAgICAg ICAgIHhhdHAtPmdwZm4rKzsKLS0tIGEveGVuL2RyaXZlcnMvcGFzc3Rocm91 Z2gvaW9tbXUuYworKysgYi94ZW4vZHJpdmVycy9wYXNzdGhyb3VnaC9pb21t dS5jCkBAIC0zMDYsMTEgKzMwNiwxMSBAQCBzdGF0aWMgaW50IGlvbW11X3Bv cHVsYXRlX3BhZ2VfdGFibGUoc3RyCiB7CiAgICAgc3RydWN0IGh2bV9pb21t dSAqaGQgPSBkb21haW5faHZtX2lvbW11KGQpOwogICAgIHN0cnVjdCBwYWdl X2luZm8gKnBhZ2U7Ci0gICAgaW50IHJjOworICAgIGludCByYyA9IDA7CiAK KyAgICB0aGlzX2NwdShpb21tdV9kb250X2ZsdXNoX2lvdGxiKSA9IDE7CiAg ICAgc3Bpbl9sb2NrKCZkLT5wYWdlX2FsbG9jX2xvY2spOwogCi0gICAgdGhp c19jcHUoaW9tbXVfZG9udF9mbHVzaF9pb3RsYikgPSAxOwogICAgIHBhZ2Vf bGlzdF9mb3JfZWFjaCAoIHBhZ2UsICZkLT5wYWdlX2xpc3QgKQogICAgIHsK ICAgICAgICAgaWYgKCBpc19odm1fZG9tYWluKGQpIHx8CkBAIC0zMjAsMTgg KzMyMCwyMCBAQCBzdGF0aWMgaW50IGlvbW11X3BvcHVsYXRlX3BhZ2VfdGFi bGUoc3RyCiAgICAgICAgICAgICByYyA9IGhkLT5wbGF0Zm9ybV9vcHMtPm1h cF9wYWdlKAogICAgICAgICAgICAgICAgIGQsIG1mbl90b19nbWZuKGQsIHBh Z2VfdG9fbWZuKHBhZ2UpKSwgcGFnZV90b19tZm4ocGFnZSksCiAgICAgICAg ICAgICAgICAgSU9NTVVGX3JlYWRhYmxlfElPTU1VRl93cml0YWJsZSk7Ci0g ICAgICAgICAgICBpZiAocmMpCi0gICAgICAgICAgICB7Ci0gICAgICAgICAg ICAgICAgc3Bpbl91bmxvY2soJmQtPnBhZ2VfYWxsb2NfbG9jayk7Ci0gICAg ICAgICAgICAgICAgaGQtPnBsYXRmb3JtX29wcy0+dGVhcmRvd24oZCk7Ci0g ICAgICAgICAgICAgICAgcmV0dXJuIHJjOwotICAgICAgICAgICAgfQorICAg ICAgICAgICAgaWYgKCByYyApCisgICAgICAgICAgICAgICAgYnJlYWs7CiAg ICAgICAgIH0KICAgICB9Ci0gICAgdGhpc19jcHUoaW9tbXVfZG9udF9mbHVz aF9pb3RsYikgPSAwOwotICAgIGlvbW11X2lvdGxiX2ZsdXNoX2FsbChkKTsK KwogICAgIHNwaW5fdW5sb2NrKCZkLT5wYWdlX2FsbG9jX2xvY2spOwotICAg IHJldHVybiAwOworICAgIHRoaXNfY3B1KGlvbW11X2RvbnRfZmx1c2hfaW90 bGIpID0gMDsKKworICAgIGlmICggIXJjICkKKyAgICAgICAgaW9tbXVfaW90 bGJfZmx1c2hfYWxsKGQpOworICAgIGVsc2UKKyAgICAgICAgaGQtPnBsYXRm b3JtX29wcy0+dGVhcmRvd24oZCk7CisKKyAgICByZXR1cm4gcmM7CiB9CiAK IAo= --=separator Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --=separator-- From xen-users-bounces@lists.xen.org Tue Dec 10 13:02:07 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 13:02:07 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMvy-0007Xy-0r; Tue, 10 Dec 2013 13:01:06 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMvw-0007Xb-HY for xen-users@lists.xen.org; Tue, 10 Dec 2013 13:01:04 +0000 Received: from [85.158.139.211:18069] by server-9.bemta-5.messagelabs.com id BD/BC-15098-F8017A25; Tue, 10 Dec 2013 13:01:03 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-13.tower-206.messagelabs.com!1386680461!3512680!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 19613 invoked from network); 10 Dec 2013 13:01:03 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-13.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 10 Dec 2013 13:01:03 -0000 X-IronPort-AV: E=Sophos;i="4.93,865,1378857600"; d="scan'208";a="82765378" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 10 Dec 2013 13:01:01 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL03.citrite.net (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Tue, 10 Dec 2013 08:01:00 -0500 Message-ID: <1386680459.11925.68.camel@kazak.uk.xensource.com> From: Ian Campbell To: =?UTF-8?Q?=E5=BC=A0=E4=BA=91=E9=9C=84?= Date: Tue, 10 Dec 2013 13:00:59 +0000 In-Reply-To: <2e8a6480.82b.142dc8b54c2.Coremail.cloud2han9@163.com> References: <3c610e6a.623.142db162054.Coremail.cloud2han9@163.com> <1386671235.11925.47.camel@kazak.uk.xensource.com> <15baa64e.7a9.142dc25b689.Coremail.cloud2han9@163.com> <1386673319.11925.56.camel@kazak.uk.xensource.com> <2e8a6480.82b.142dc8b54c2.Coremail.cloud2han9@163.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA1 Cc: xen-users Subject: Re: [Xen-users] hypercall implementation X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org T24gVHVlLCAyMDEzLTEyLTEwIGF0IDIwOjQ2ICswODAwLCDlvKDkupHpnIQgd3JvdGU6Cj4gCj4g SSB0YWxrZWQgYWJvdXQgUFYuIAo+IAo+IEkga25vdyB0aGUgaHlwZXJjYWxsJ3MgaW1wbGVtZW50 YXRpb24gbWVjaGFuaXNtLCBidXQgaHlwZXJjYWxsJ3MgY2FsbAo+IHRyZWUuCj4gCj4gRnJvbSB0 aGUgYm9vaywgVGhlIERlZmluaXRpdmUgR3VpZGUgdG8gWGVuIEh5cGVydmlzb3IsIEkga25vd24g dGhhdAo+IHRoZSAiZ2VuZXJpYyBidWlsZGVyIiB3aWxsIGF1dG9tYXRpY2FsbHkgbWFwIHRoZSBo eXBlcmNhbGwgcGFnZSBhdCBvbmUKPiBwYWdlIGluZGljYXRlZCBieSB0aGUga2V5ICJIWVBFUkNB TExfUEFHRSIgaW4gdGhlIGd1ZXN0IGtlcm5lbCBlbGYncwo+IHNlY3Rpb24gIl9feGVuX2d1ZXN0 ICIgaW50byB0aGUgZ3Vlc3Qgb3MnIGFkZHJlc3Mgc3BhY2UuIEkgaGF2ZQo+IHNlYXJjaGVkIHRo ZSBYZW4gc291cmNlIGNvZGUuIEkgY2FuJ3QgZmluZCB0aGUgaHlwZXJjYWxsIHBhZ2UncyBzb3Vy Y2UKPiBjb2RlLiBXaGVyZSBpcyBpdD8KCklmIHlvdSBoYWQgZ3JlcHBlZCBmb3IgImh5cGVyY2Fs bF9wYWdlIiBpbiB0aGUgaHlwZXJ2aXNvciBzb3VyY2UgY29kZQp0aGVuIHlvdSB3b3VsZCBoYXZl IGZvdW5kIGh5cGVyY2FsbF9wYWdlX2luaXRpYWxpc2VfKi4KCj4gSW4gYWRkaXRpb24sICBUaGUg Ym9vayBtZW50aW9uZWQgYWJvdmUgZGVzY3JpYmVzIHhlbicgaW50ZXJuYWxzIHdlbGwKPiBtYWlu bHkgaW4gRW5nbGlzaC4gSW4gb3JkZXIgdG8ga25vdyBYZW4gZXhhY3RseSwgSSB0aGluayBJIG11 c3QgcmVhZAo+IFhlbidzIHNvdXJjZSBjb2RlLiBJcyB0aGVyZSBzb21lIHJlc291cmNlKGJvb2ss IGJsb2csIHBhcGVyLCBldGMpCj4gZGVzY3JpcGluZyBYZW4gaHlwZXJ2aXNvciBtYWlubHkgaW4g QyBsYW5ndWFnZS4KClRoZSBjb2RlIGl0c2VsZiBpcyBpbiBDLiBJJ20gbm90IGF3YXJlIG9mIGFu eSBib29rcyBldGMgIm1haW5seSBpbiBDCmxhbmd1YWdlIi4KCj4gIEkgbmVlZCBhIHN0YXJ0IHBv aW50IGluIFhlbidzIHNvdXJjZSBjb2RlIHRvIGV4cGxvcmUgWGVuIGh5cGVydmlzb3IKPiBvciBh IHBhdGggdGhyb3VnaCBpdC4gRG8geW91IGhhdmUgc29tZSBzdWdnZXN0aW9uID8gVGhhbmdrcy4K CmdyZXAsIGxlc3MsIHZpbSBvciBlbWFjcyBkZXBlbmRpbmcgb24geW91ciBwcmVmZXJlbmNlLgoK SWFuLgoKCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpY ZW4tdXNlcnMgbWFpbGluZyBsaXN0Clhlbi11c2Vyc0BsaXN0cy54ZW4ub3JnCmh0dHA6Ly9saXN0 cy54ZW4ub3JnL3hlbi11c2Vycw== From xen-users-bounces@lists.xen.org Tue Dec 10 13:02:07 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 13:02:07 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMvy-0007Xy-0r; Tue, 10 Dec 2013 13:01:06 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqMvw-0007Xb-HY for xen-users@lists.xen.org; Tue, 10 Dec 2013 13:01:04 +0000 Received: from [85.158.139.211:18069] by server-9.bemta-5.messagelabs.com id BD/BC-15098-F8017A25; Tue, 10 Dec 2013 13:01:03 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-13.tower-206.messagelabs.com!1386680461!3512680!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 19613 invoked from network); 10 Dec 2013 13:01:03 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-13.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 10 Dec 2013 13:01:03 -0000 X-IronPort-AV: E=Sophos;i="4.93,865,1378857600"; d="scan'208";a="82765378" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 10 Dec 2013 13:01:01 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL03.citrite.net (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Tue, 10 Dec 2013 08:01:00 -0500 Message-ID: <1386680459.11925.68.camel@kazak.uk.xensource.com> From: Ian Campbell To: =?UTF-8?Q?=E5=BC=A0=E4=BA=91=E9=9C=84?= Date: Tue, 10 Dec 2013 13:00:59 +0000 In-Reply-To: <2e8a6480.82b.142dc8b54c2.Coremail.cloud2han9@163.com> References: <3c610e6a.623.142db162054.Coremail.cloud2han9@163.com> <1386671235.11925.47.camel@kazak.uk.xensource.com> <15baa64e.7a9.142dc25b689.Coremail.cloud2han9@163.com> <1386673319.11925.56.camel@kazak.uk.xensource.com> <2e8a6480.82b.142dc8b54c2.Coremail.cloud2han9@163.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA1 Cc: xen-users Subject: Re: [Xen-users] hypercall implementation X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org T24gVHVlLCAyMDEzLTEyLTEwIGF0IDIwOjQ2ICswODAwLCDlvKDkupHpnIQgd3JvdGU6Cj4gCj4g SSB0YWxrZWQgYWJvdXQgUFYuIAo+IAo+IEkga25vdyB0aGUgaHlwZXJjYWxsJ3MgaW1wbGVtZW50 YXRpb24gbWVjaGFuaXNtLCBidXQgaHlwZXJjYWxsJ3MgY2FsbAo+IHRyZWUuCj4gCj4gRnJvbSB0 aGUgYm9vaywgVGhlIERlZmluaXRpdmUgR3VpZGUgdG8gWGVuIEh5cGVydmlzb3IsIEkga25vd24g dGhhdAo+IHRoZSAiZ2VuZXJpYyBidWlsZGVyIiB3aWxsIGF1dG9tYXRpY2FsbHkgbWFwIHRoZSBo eXBlcmNhbGwgcGFnZSBhdCBvbmUKPiBwYWdlIGluZGljYXRlZCBieSB0aGUga2V5ICJIWVBFUkNB TExfUEFHRSIgaW4gdGhlIGd1ZXN0IGtlcm5lbCBlbGYncwo+IHNlY3Rpb24gIl9feGVuX2d1ZXN0 ICIgaW50byB0aGUgZ3Vlc3Qgb3MnIGFkZHJlc3Mgc3BhY2UuIEkgaGF2ZQo+IHNlYXJjaGVkIHRo ZSBYZW4gc291cmNlIGNvZGUuIEkgY2FuJ3QgZmluZCB0aGUgaHlwZXJjYWxsIHBhZ2UncyBzb3Vy Y2UKPiBjb2RlLiBXaGVyZSBpcyBpdD8KCklmIHlvdSBoYWQgZ3JlcHBlZCBmb3IgImh5cGVyY2Fs bF9wYWdlIiBpbiB0aGUgaHlwZXJ2aXNvciBzb3VyY2UgY29kZQp0aGVuIHlvdSB3b3VsZCBoYXZl IGZvdW5kIGh5cGVyY2FsbF9wYWdlX2luaXRpYWxpc2VfKi4KCj4gSW4gYWRkaXRpb24sICBUaGUg Ym9vayBtZW50aW9uZWQgYWJvdmUgZGVzY3JpYmVzIHhlbicgaW50ZXJuYWxzIHdlbGwKPiBtYWlu bHkgaW4gRW5nbGlzaC4gSW4gb3JkZXIgdG8ga25vdyBYZW4gZXhhY3RseSwgSSB0aGluayBJIG11 c3QgcmVhZAo+IFhlbidzIHNvdXJjZSBjb2RlLiBJcyB0aGVyZSBzb21lIHJlc291cmNlKGJvb2ss IGJsb2csIHBhcGVyLCBldGMpCj4gZGVzY3JpcGluZyBYZW4gaHlwZXJ2aXNvciBtYWlubHkgaW4g QyBsYW5ndWFnZS4KClRoZSBjb2RlIGl0c2VsZiBpcyBpbiBDLiBJJ20gbm90IGF3YXJlIG9mIGFu eSBib29rcyBldGMgIm1haW5seSBpbiBDCmxhbmd1YWdlIi4KCj4gIEkgbmVlZCBhIHN0YXJ0IHBv aW50IGluIFhlbidzIHNvdXJjZSBjb2RlIHRvIGV4cGxvcmUgWGVuIGh5cGVydmlzb3IKPiBvciBh IHBhdGggdGhyb3VnaCBpdC4gRG8geW91IGhhdmUgc29tZSBzdWdnZXN0aW9uID8gVGhhbmdrcy4K CmdyZXAsIGxlc3MsIHZpbSBvciBlbWFjcyBkZXBlbmRpbmcgb24geW91ciBwcmVmZXJlbmNlLgoK SWFuLgoKCgpfX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpY ZW4tdXNlcnMgbWFpbGluZyBsaXN0Clhlbi11c2Vyc0BsaXN0cy54ZW4ub3JnCmh0dHA6Ly9saXN0 cy54ZW4ub3JnL3hlbi11c2Vycw== From xen-users-bounces@lists.xen.org Tue Dec 10 16:23:06 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 16:23:06 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqQ4P-0002zw-H3; Tue, 10 Dec 2013 16:22:01 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqQ4O-0002zr-7y for xen-users@lists.xen.org; Tue, 10 Dec 2013 16:22:00 +0000 Received: from [85.158.139.211:21232] by server-6.bemta-5.messagelabs.com id 1A/FB-16310-7AF37A25; Tue, 10 Dec 2013 16:21:59 +0000 X-Env-Sender: alk@ondore.com X-Msg-Ref: server-11.tower-206.messagelabs.com!1386692517!3391885!1 X-Originating-IP: [184.172.38.139] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 2634 invoked from network); 10 Dec 2013 16:21:58 -0000 Received: from host1a.ondore-systems.com (HELO host1a.ondore-systems.com) (184.172.38.139) by server-11.tower-206.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 10 Dec 2013 16:21:58 -0000 Received: from [189.253.59.37] (port=43619 helo=mail.ondore.i) by host1a.ondore-systems.com with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (Exim 4.82) (envelope-from ) id 1VqQ4L-0007Iq-71 for xen-users@lists.xen.org; Tue, 10 Dec 2013 10:21:57 -0600 Received: from [10.13.34.96] (alk-desktop.sys.ondore.i [10.13.34.96]) by mail.ondore.i (Postfix) with ESMTPSA id 8E8A4A20D for ; Tue, 10 Dec 2013 10:21:55 -0600 (CST) Message-ID: <52A73FA3.6080108@ondore.com> Date: Tue, 10 Dec 2013 10:21:55 -0600 From: Alexandre Kouznetsov User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130330 Thunderbird/17.0.5 MIME-Version: 1.0 To: xen-users@lists.xen.org References: <52A667FA.8050305@bradakis.com> In-Reply-To: <52A667FA.8050305@bradakis.com> X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - host1a.ondore-systems.com X-AntiAbuse: Original Domain - lists.xen.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - ondore.com X-Get-Message-Sender-Via: host1a.ondore-systems.com: authenticated_id: sys.intranet@ondore.com Subject: Re: [Xen-users] rc.local? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="iso-8859-1"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hello. El 09/12/13 19:01, Mark J Bradakis escribi=F3: > xen-create-image --boot blah blah > > would configure and start the VM, then run /etc/rc.local but that does > not seem to be the case. > > How does one get a script to run when the new guest is first started, > before logging in and > doing it by hand? What am I missing? If you deploy a Debian or Ubuntu DomU with help of xen-create-image, it = will run it's own /etc/rc.local on startup, not because = xen-create-image made it to do so, but because the distribution is = organized that way. By default, this script does nothing. There are several ways to make your new DomU to run custom scripts on = startup. 1. You may use /etc/xen-tools/skel/etc/rc.local to deploy a custom = version of the script. You even may trick it, so it run something at = first boot and modify itself in order to do noting on subsequent boots. 2. You may deploy a custom script with everything you need but run it by = hand, to have more control (I do that myself). 3. You may use /etc/xen-tools/role.d/something to make xen-create-image = to run custom commands while creating the image, even before it boots. 4. You may install some puppet or chief agent by default on each DomU = you deploy, and manage them from a central location. Greetings. -- = Alexandre Kouznetsov _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 10 16:23:06 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 16:23:06 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqQ4P-0002zw-H3; Tue, 10 Dec 2013 16:22:01 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqQ4O-0002zr-7y for xen-users@lists.xen.org; Tue, 10 Dec 2013 16:22:00 +0000 Received: from [85.158.139.211:21232] by server-6.bemta-5.messagelabs.com id 1A/FB-16310-7AF37A25; Tue, 10 Dec 2013 16:21:59 +0000 X-Env-Sender: alk@ondore.com X-Msg-Ref: server-11.tower-206.messagelabs.com!1386692517!3391885!1 X-Originating-IP: [184.172.38.139] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 2634 invoked from network); 10 Dec 2013 16:21:58 -0000 Received: from host1a.ondore-systems.com (HELO host1a.ondore-systems.com) (184.172.38.139) by server-11.tower-206.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 10 Dec 2013 16:21:58 -0000 Received: from [189.253.59.37] (port=43619 helo=mail.ondore.i) by host1a.ondore-systems.com with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (Exim 4.82) (envelope-from ) id 1VqQ4L-0007Iq-71 for xen-users@lists.xen.org; Tue, 10 Dec 2013 10:21:57 -0600 Received: from [10.13.34.96] (alk-desktop.sys.ondore.i [10.13.34.96]) by mail.ondore.i (Postfix) with ESMTPSA id 8E8A4A20D for ; Tue, 10 Dec 2013 10:21:55 -0600 (CST) Message-ID: <52A73FA3.6080108@ondore.com> Date: Tue, 10 Dec 2013 10:21:55 -0600 From: Alexandre Kouznetsov User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130330 Thunderbird/17.0.5 MIME-Version: 1.0 To: xen-users@lists.xen.org References: <52A667FA.8050305@bradakis.com> In-Reply-To: <52A667FA.8050305@bradakis.com> X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - host1a.ondore-systems.com X-AntiAbuse: Original Domain - lists.xen.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - ondore.com X-Get-Message-Sender-Via: host1a.ondore-systems.com: authenticated_id: sys.intranet@ondore.com Subject: Re: [Xen-users] rc.local? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="iso-8859-1"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hello. El 09/12/13 19:01, Mark J Bradakis escribi=F3: > xen-create-image --boot blah blah > > would configure and start the VM, then run /etc/rc.local but that does > not seem to be the case. > > How does one get a script to run when the new guest is first started, > before logging in and > doing it by hand? What am I missing? If you deploy a Debian or Ubuntu DomU with help of xen-create-image, it = will run it's own /etc/rc.local on startup, not because = xen-create-image made it to do so, but because the distribution is = organized that way. By default, this script does nothing. There are several ways to make your new DomU to run custom scripts on = startup. 1. You may use /etc/xen-tools/skel/etc/rc.local to deploy a custom = version of the script. You even may trick it, so it run something at = first boot and modify itself in order to do noting on subsequent boots. 2. You may deploy a custom script with everything you need but run it by = hand, to have more control (I do that myself). 3. You may use /etc/xen-tools/role.d/something to make xen-create-image = to run custom commands while creating the image, even before it boots. 4. You may install some puppet or chief agent by default on each DomU = you deploy, and manage them from a central location. Greetings. -- = Alexandre Kouznetsov _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 10 16:30:09 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 16:30:09 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqQC3-0003Yi-BP; Tue, 10 Dec 2013 16:29:55 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqQC1-0003Yb-Mq for xen-users@lists.xen.org; Tue, 10 Dec 2013 16:29:53 +0000 Received: from [85.158.139.211:27001] by server-11.bemta-5.messagelabs.com id 32/C0-23268-18147A25; Tue, 10 Dec 2013 16:29:53 +0000 X-Env-Sender: alk@ondore.com X-Msg-Ref: server-16.tower-206.messagelabs.com!1386692991!2350709!1 X-Originating-IP: [184.172.38.139] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 22258 invoked from network); 10 Dec 2013 16:29:52 -0000 Received: from host1a.ondore-systems.com (HELO host1a.ondore-systems.com) (184.172.38.139) by server-16.tower-206.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 10 Dec 2013 16:29:52 -0000 Received: from [189.253.59.37] (port=44692 helo=mail.ondore.i) by host1a.ondore-systems.com with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (Exim 4.82) (envelope-from ) id 1VqQBy-0007fz-JA for xen-users@lists.xen.org; Tue, 10 Dec 2013 10:29:50 -0600 Received: from [10.13.34.96] (alk-desktop.sys.ondore.i [10.13.34.96]) by mail.ondore.i (Postfix) with ESMTPSA id E537DA20D for ; Tue, 10 Dec 2013 10:29:48 -0600 (CST) Message-ID: <52A7417D.2030207@ondore.com> Date: Tue, 10 Dec 2013 10:29:49 -0600 From: Alexandre Kouznetsov User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130330 Thunderbird/17.0.5 MIME-Version: 1.0 To: xen-users@lists.xen.org References: <52A61F24.2030501@gmail.com> In-Reply-To: <52A61F24.2030501@gmail.com> X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - host1a.ondore-systems.com X-AntiAbuse: Original Domain - lists.xen.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - ondore.com X-Get-Message-Sender-Via: host1a.ondore-systems.com: authenticated_id: sys.intranet@ondore.com Subject: Re: [Xen-users] Newbie: Xenserver Hardware/setup configuration recommendations X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="iso-8859-1"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hello. El 09/12/13 13:51, Forrest Aldrich escribi=F3: > I'm a newbie to Xen, and have been given the go-ahead to spec out a > medium-ish sized system to run VMs on for development/testing. > > We are primarily an HP server shop. I'm looking for detailed information > about hardware configuration recommendations - memory, disk, NIC ports, > processors, etc. > > Could someone point me to some good info? Hard to say, beside trivial recommendations. Many CPU cores are better = than few, bigger RAM is better than smaller. Leave room for upgrade = (second CPU, double the RAM, add disks) if you are trying not to spend = too much. Depend a lot on the intended use. If the goal is just to test = Xen, grab anything. Make sure the CPU support virtualization and your storage system has a = hardware RAID. Good idea to have 2 or more NIC ports, one for = administration (and, maybe, storage) another one for the VM's. The usage = will tell you the rest. I don't think you could find any relevant general recommendation, beside = reference of what people actually use for specific purposes. Greetings. -- = Alexandre Kouznetsov _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 10 16:30:09 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 10 Dec 2013 16:30:09 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqQC3-0003Yi-BP; Tue, 10 Dec 2013 16:29:55 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqQC1-0003Yb-Mq for xen-users@lists.xen.org; Tue, 10 Dec 2013 16:29:53 +0000 Received: from [85.158.139.211:27001] by server-11.bemta-5.messagelabs.com id 32/C0-23268-18147A25; Tue, 10 Dec 2013 16:29:53 +0000 X-Env-Sender: alk@ondore.com X-Msg-Ref: server-16.tower-206.messagelabs.com!1386692991!2350709!1 X-Originating-IP: [184.172.38.139] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 22258 invoked from network); 10 Dec 2013 16:29:52 -0000 Received: from host1a.ondore-systems.com (HELO host1a.ondore-systems.com) (184.172.38.139) by server-16.tower-206.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 10 Dec 2013 16:29:52 -0000 Received: from [189.253.59.37] (port=44692 helo=mail.ondore.i) by host1a.ondore-systems.com with esmtpsa (TLSv1:DHE-RSA-AES256-SHA:256) (Exim 4.82) (envelope-from ) id 1VqQBy-0007fz-JA for xen-users@lists.xen.org; Tue, 10 Dec 2013 10:29:50 -0600 Received: from [10.13.34.96] (alk-desktop.sys.ondore.i [10.13.34.96]) by mail.ondore.i (Postfix) with ESMTPSA id E537DA20D for ; Tue, 10 Dec 2013 10:29:48 -0600 (CST) Message-ID: <52A7417D.2030207@ondore.com> Date: Tue, 10 Dec 2013 10:29:49 -0600 From: Alexandre Kouznetsov User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:17.0) Gecko/20130330 Thunderbird/17.0.5 MIME-Version: 1.0 To: xen-users@lists.xen.org References: <52A61F24.2030501@gmail.com> In-Reply-To: <52A61F24.2030501@gmail.com> X-AntiAbuse: This header was added to track abuse, please include it with any abuse report X-AntiAbuse: Primary Hostname - host1a.ondore-systems.com X-AntiAbuse: Original Domain - lists.xen.org X-AntiAbuse: Originator/Caller UID/GID - [47 12] / [47 12] X-AntiAbuse: Sender Address Domain - ondore.com X-Get-Message-Sender-Via: host1a.ondore-systems.com: authenticated_id: sys.intranet@ondore.com Subject: Re: [Xen-users] Newbie: Xenserver Hardware/setup configuration recommendations X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset="iso-8859-1"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hello. El 09/12/13 13:51, Forrest Aldrich escribi=F3: > I'm a newbie to Xen, and have been given the go-ahead to spec out a > medium-ish sized system to run VMs on for development/testing. > > We are primarily an HP server shop. I'm looking for detailed information > about hardware configuration recommendations - memory, disk, NIC ports, > processors, etc. > > Could someone point me to some good info? Hard to say, beside trivial recommendations. Many CPU cores are better = than few, bigger RAM is better than smaller. Leave room for upgrade = (second CPU, double the RAM, add disks) if you are trying not to spend = too much. Depend a lot on the intended use. If the goal is just to test = Xen, grab anything. Make sure the CPU support virtualization and your storage system has a = hardware RAID. Good idea to have 2 or more NIC ports, one for = administration (and, maybe, storage) another one for the VM's. The usage = will tell you the rest. I don't think you could find any relevant general recommendation, beside = reference of what people actually use for specific purposes. Greetings. -- = Alexandre Kouznetsov _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Wed Dec 11 00:56:49 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 11 Dec 2013 00:56:49 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqY5Z-00016Z-Aq; Wed, 11 Dec 2013 00:55:45 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqY5Y-00016S-4k for xen-users@lists.xen.org; Wed, 11 Dec 2013 00:55:44 +0000 Received: from [85.158.143.35:59570] by server-1.bemta-4.messagelabs.com id 54/88-02132-F08B7A25; Wed, 11 Dec 2013 00:55:43 +0000 X-Env-Sender: mariusweiler@web.de X-Msg-Ref: server-13.tower-21.messagelabs.com!1386723342!3564068!1 X-Originating-IP: [212.227.17.11] X-SpamReason: No, hits=0.7 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjExID0+IDE4NTg2\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjExID0+IDE4NTg2\n,HTML_60_70,HTML_MESSAGE, MIME_HTML_ONLY X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 14604 invoked from network); 11 Dec 2013 00:55:42 -0000 Received: from mout.web.de (HELO mout.web.de) (212.227.17.11) by server-13.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 11 Dec 2013 00:55:42 -0000 Received: from 3capp-webde-bs02.server.lan ([172.19.170.2]) by mriweb.server.lan (mriweb003) with ESMTP (Nemesis) id 0LtZlL-1VOx7y0KyC-010rgE for ; Wed, 11 Dec 2013 01:55:42 +0100 Received: from [93.114.40.100] by 3capp-webde-bs02.server.lan with HTTP; Wed Dec 11 01:55:42 CET 2013 MIME-Version: 1.0 Message-ID: From: "Marius Weiler" To: xen-users@lists.xen.org Date: Wed, 11 Dec 2013 01:55:42 +0100 (CET) Importance: normal Sensitivity: Normal X-Priority: 3 X-Provags-ID: V03:K0:xxj1C+/tMYcEnnu+p0AGOQFs+BpdelOtls0WsQb0RAU fnbIAA2jWPplwXYuRvpIVoDM84u1Wx04CkJ2q3MDc3NBbJJIai JboANPN9l6FrD7VwOQIGoBw2AE319nF4hQOyF6JmXyQeNlVl/C OsV3Yk/u4gTrxqTEenrc3dY1RTMZ8Cbd1WKcG+DsYwXljy61BJ EtW8eWosOd/8cSeCESV5ImC6mq95G2rEvxUVQaMnlwTrCcDrHo MotRneojg5QZlqd3+6Wfzl91OlpDHHAl7DZmam0yRM8SzSZBfZ Sc5qeWbSfYv6J26g3+c1T0CP1EF Subject: [Xen-users] DomU speed very slow X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6830718979947787098==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6830718979947787098== Content-Type: text/html; charset=UTF-8
Hello,
 
I set up with Virtualizor a XEN server with 5 VPS. The node port speed is 1Gbit and I also get around 40MB/S download speed when I use wget on the node.
 
But all the VPS only have a maximum download speed of 8 MB/s. Any ideas why?
 
host                   : xxxxxxxxxx
release                : 3.10.20-11.el6.centos.alt.x86_64
version                : #1 SMP Sat Nov 23 23:08:56 UTC 2013
machine                : x86_64
nr_cpus                : 4
nr_nodes               : 1
cores_per_socket       : 4
threads_per_core       : 1
cpu_mhz                : 2666
hw_caps                : bfebfbff:20100800:00000000:00000940:0408e3bd:00000000:00000001:00000000
virt_caps              : hvm
total_memory           : 8157
free_memory            : 2156
free_cpus              : 0
xen_major              : 4
xen_minor              : 2
xen_extra              : .3-25.el6
xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler          : credit
xen_pagesize           : 4096
platform_params        : virt_start=0xffff800000000000
xen_changeset          : unavailable
xen_commandline        : dom0_mem=1024M,max:1024M loglvl=all guest_loglvl=all
cc_compiler            : gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-3)
cc_compile_by          : mockbuild
cc_compile_domain      : centos.org
cc_compile_date        : Sat Nov 23 13:55:46 UTC 2013
xend_config_format     : 4
 
 
Thanks a lot
 
-- 
Marius Weiler
MariusWeiler@web.de
--===============6830718979947787098== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6830718979947787098==-- From xen-users-bounces@lists.xen.org Wed Dec 11 00:56:49 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 11 Dec 2013 00:56:49 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqY5Z-00016Z-Aq; Wed, 11 Dec 2013 00:55:45 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqY5Y-00016S-4k for xen-users@lists.xen.org; Wed, 11 Dec 2013 00:55:44 +0000 Received: from [85.158.143.35:59570] by server-1.bemta-4.messagelabs.com id 54/88-02132-F08B7A25; Wed, 11 Dec 2013 00:55:43 +0000 X-Env-Sender: mariusweiler@web.de X-Msg-Ref: server-13.tower-21.messagelabs.com!1386723342!3564068!1 X-Originating-IP: [212.227.17.11] X-SpamReason: No, hits=0.7 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjExID0+IDE4NTg2\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjExID0+IDE4NTg2\n,HTML_60_70,HTML_MESSAGE, MIME_HTML_ONLY X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 14604 invoked from network); 11 Dec 2013 00:55:42 -0000 Received: from mout.web.de (HELO mout.web.de) (212.227.17.11) by server-13.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 11 Dec 2013 00:55:42 -0000 Received: from 3capp-webde-bs02.server.lan ([172.19.170.2]) by mriweb.server.lan (mriweb003) with ESMTP (Nemesis) id 0LtZlL-1VOx7y0KyC-010rgE for ; Wed, 11 Dec 2013 01:55:42 +0100 Received: from [93.114.40.100] by 3capp-webde-bs02.server.lan with HTTP; Wed Dec 11 01:55:42 CET 2013 MIME-Version: 1.0 Message-ID: From: "Marius Weiler" To: xen-users@lists.xen.org Date: Wed, 11 Dec 2013 01:55:42 +0100 (CET) Importance: normal Sensitivity: Normal X-Priority: 3 X-Provags-ID: V03:K0:xxj1C+/tMYcEnnu+p0AGOQFs+BpdelOtls0WsQb0RAU fnbIAA2jWPplwXYuRvpIVoDM84u1Wx04CkJ2q3MDc3NBbJJIai JboANPN9l6FrD7VwOQIGoBw2AE319nF4hQOyF6JmXyQeNlVl/C OsV3Yk/u4gTrxqTEenrc3dY1RTMZ8Cbd1WKcG+DsYwXljy61BJ EtW8eWosOd/8cSeCESV5ImC6mq95G2rEvxUVQaMnlwTrCcDrHo MotRneojg5QZlqd3+6Wfzl91OlpDHHAl7DZmam0yRM8SzSZBfZ Sc5qeWbSfYv6J26g3+c1T0CP1EF Subject: [Xen-users] DomU speed very slow X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6830718979947787098==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6830718979947787098== Content-Type: text/html; charset=UTF-8
Hello,
 
I set up with Virtualizor a XEN server with 5 VPS. The node port speed is 1Gbit and I also get around 40MB/S download speed when I use wget on the node.
 
But all the VPS only have a maximum download speed of 8 MB/s. Any ideas why?
 
host                   : xxxxxxxxxx
release                : 3.10.20-11.el6.centos.alt.x86_64
version                : #1 SMP Sat Nov 23 23:08:56 UTC 2013
machine                : x86_64
nr_cpus                : 4
nr_nodes               : 1
cores_per_socket       : 4
threads_per_core       : 1
cpu_mhz                : 2666
hw_caps                : bfebfbff:20100800:00000000:00000940:0408e3bd:00000000:00000001:00000000
virt_caps              : hvm
total_memory           : 8157
free_memory            : 2156
free_cpus              : 0
xen_major              : 4
xen_minor              : 2
xen_extra              : .3-25.el6
xen_caps               : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 hvm-3.0-x86_32p hvm-3.0-x86_64
xen_scheduler          : credit
xen_pagesize           : 4096
platform_params        : virt_start=0xffff800000000000
xen_changeset          : unavailable
xen_commandline        : dom0_mem=1024M,max:1024M loglvl=all guest_loglvl=all
cc_compiler            : gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-3)
cc_compile_by          : mockbuild
cc_compile_domain      : centos.org
cc_compile_date        : Sat Nov 23 13:55:46 UTC 2013
xend_config_format     : 4
 
 
Thanks a lot
 
-- 
Marius Weiler
MariusWeiler@web.de
--===============6830718979947787098== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6830718979947787098==-- From xen-users-bounces@lists.xen.org Wed Dec 11 09:42:49 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 11 Dec 2013 09:42:49 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqgIa-0004EJ-ED; Wed, 11 Dec 2013 09:41:44 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqgIY-0004EC-Gh for xen-users@lists.xen.org; Wed, 11 Dec 2013 09:41:42 +0000 Received: from [85.158.139.211:34593] by server-12.bemta-5.messagelabs.com id 34/AC-30017-55338A25; Wed, 11 Dec 2013 09:41:41 +0000 X-Env-Sender: gordan@bobich.net X-Msg-Ref: server-4.tower-206.messagelabs.com!1386754900!3729498!1 X-Originating-IP: [217.34.137.81] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 19696 invoked from network); 11 Dec 2013 09:41:41 -0000 Received: from host217-34-137-81.in-addr.btopenworld.com (HELO external.sentinel2) (217.34.137.81) by server-4.tower-206.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 11 Dec 2013 09:41:41 -0000 Received: from mail.shatteredsilicon.net (localhost [127.0.0.1]) by external.sentinel2 (Postfix) with ESMTP id CF8DF220294; Wed, 11 Dec 2013 09:41:39 +0000 (GMT) MIME-Version: 1.0 Date: Wed, 11 Dec 2013 09:41:39 +0000 From: Gordan Bobic To: Marius Weiler In-Reply-To: References: Message-ID: X-Sender: gordan@bobich.net User-Agent: Roundcube Webmail/0.4.2 Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] DomU speed very slow X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Only guessing since you didn't provide much relevant information, but most likely because you are using a HVM guest without paravirtualized drivers. On Wed, 11 Dec 2013 01:55:42 +0100 (CET), "Marius Weiler" wrote: > Hello, > > I set up with Virtualizor a XEN server with 5 VPS. The node port > speed > is 1Gbit and I also get around 40MB/S download speed when I use wget > on the node. > > But all the VPS only have a maximum download speed of 8 MB/s. Any > ideas why? > > host : xxxxxxxxxx > release : 3.10.20-11.el6.centos.alt.x86_64 > version : #1 SMP Sat Nov 23 23:08:56 UTC 2013 > machine : x86_64 > nr_cpus : 4 > nr_nodes : 1 > cores_per_socket : 4 > threads_per_core : 1 > cpu_mhz : 2666 > hw_caps : > > bfebfbff:20100800:00000000:00000940:0408e3bd:00000000:00000001:00000000 > virt_caps : hvm > total_memory : 8157 > free_memory : 2156 > free_cpus : 0 > xen_major : 4 > xen_minor : 2 > xen_extra : .3-25.el6 > xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 > hvm-3.0-x86_32p hvm-3.0-x86_64 > xen_scheduler : credit > xen_pagesize : 4096 > platform_params : virt_start=0xffff800000000000 > xen_changeset : unavailable > xen_commandline : dom0_mem=1024M,max:1024M loglvl=all > guest_loglvl=all > cc_compiler : gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-3) > cc_compile_by : mockbuild > cc_compile_domain : centos.org > cc_compile_date : Sat Nov 23 13:55:46 UTC 2013 > xend_config_format : 4 > > Thanks a lot _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Wed Dec 11 09:42:49 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 11 Dec 2013 09:42:49 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqgIa-0004EJ-ED; Wed, 11 Dec 2013 09:41:44 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqgIY-0004EC-Gh for xen-users@lists.xen.org; Wed, 11 Dec 2013 09:41:42 +0000 Received: from [85.158.139.211:34593] by server-12.bemta-5.messagelabs.com id 34/AC-30017-55338A25; Wed, 11 Dec 2013 09:41:41 +0000 X-Env-Sender: gordan@bobich.net X-Msg-Ref: server-4.tower-206.messagelabs.com!1386754900!3729498!1 X-Originating-IP: [217.34.137.81] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 19696 invoked from network); 11 Dec 2013 09:41:41 -0000 Received: from host217-34-137-81.in-addr.btopenworld.com (HELO external.sentinel2) (217.34.137.81) by server-4.tower-206.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 11 Dec 2013 09:41:41 -0000 Received: from mail.shatteredsilicon.net (localhost [127.0.0.1]) by external.sentinel2 (Postfix) with ESMTP id CF8DF220294; Wed, 11 Dec 2013 09:41:39 +0000 (GMT) MIME-Version: 1.0 Date: Wed, 11 Dec 2013 09:41:39 +0000 From: Gordan Bobic To: Marius Weiler In-Reply-To: References: Message-ID: X-Sender: gordan@bobich.net User-Agent: Roundcube Webmail/0.4.2 Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] DomU speed very slow X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Only guessing since you didn't provide much relevant information, but most likely because you are using a HVM guest without paravirtualized drivers. On Wed, 11 Dec 2013 01:55:42 +0100 (CET), "Marius Weiler" wrote: > Hello, > > I set up with Virtualizor a XEN server with 5 VPS. The node port > speed > is 1Gbit and I also get around 40MB/S download speed when I use wget > on the node. > > But all the VPS only have a maximum download speed of 8 MB/s. Any > ideas why? > > host : xxxxxxxxxx > release : 3.10.20-11.el6.centos.alt.x86_64 > version : #1 SMP Sat Nov 23 23:08:56 UTC 2013 > machine : x86_64 > nr_cpus : 4 > nr_nodes : 1 > cores_per_socket : 4 > threads_per_core : 1 > cpu_mhz : 2666 > hw_caps : > > bfebfbff:20100800:00000000:00000940:0408e3bd:00000000:00000001:00000000 > virt_caps : hvm > total_memory : 8157 > free_memory : 2156 > free_cpus : 0 > xen_major : 4 > xen_minor : 2 > xen_extra : .3-25.el6 > xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p hvm-3.0-x86_32 > hvm-3.0-x86_32p hvm-3.0-x86_64 > xen_scheduler : credit > xen_pagesize : 4096 > platform_params : virt_start=0xffff800000000000 > xen_changeset : unavailable > xen_commandline : dom0_mem=1024M,max:1024M loglvl=all > guest_loglvl=all > cc_compiler : gcc (GCC) 4.4.7 20120313 (Red Hat 4.4.7-3) > cc_compile_by : mockbuild > cc_compile_domain : centos.org > cc_compile_date : Sat Nov 23 13:55:46 UTC 2013 > xend_config_format : 4 > > Thanks a lot _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Wed Dec 11 10:14:41 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 11 Dec 2013 10:14:41 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqgnZ-00079m-1k; Wed, 11 Dec 2013 10:13:45 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqgnX-00079a-Oy for xen-users@lists.xen.org; Wed, 11 Dec 2013 10:13:43 +0000 Received: from [85.158.137.68:63975] by server-17.bemta-3.messagelabs.com id 59/6E-15965-6DA38A25; Wed, 11 Dec 2013 10:13:42 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-11.tower-31.messagelabs.com!1386756819!3188633!1 X-Originating-IP: [203.16.207.99] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 8502 invoked from network); 11 Dec 2013 10:13:42 -0000 Received: from mail.bendigoit.com.au (HELO smtp2.bendigoit.com.au) (203.16.207.99) by server-11.tower-31.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 11 Dec 2013 10:13:42 -0000 Received: from bitcom1.int.sbss.com.au ([192.168.200.237]) by smtp2.bendigoit.com.au with esmtp (Exim 4.80) (envelope-from ) id 1VqgnR-0005o7-AA for xen-users@lists.xen.org; Wed, 11 Dec 2013 21:13:37 +1100 Received: from BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d]) by BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d%12]) with mapi id 14.01.0438.000; Wed, 11 Dec 2013 21:13:36 +1100 From: James Harper To: "xen-users@lists.xen.org" Thread-Topic: GPLPV license change Thread-Index: Ac72WGTMIWT75KcUR1mBxrs52dPT+w== Date: Wed, 11 Dec 2013 10:13:34 +0000 Message-ID: <6035A0D088A63A46850C3988ED045A4B66C0308C@BITCOM1.int.sbss.com.au> Accept-Language: en-AU, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.16.3.239] x-tm-as-product-ver: SMEX-10.2.0.3176-7.000.1014-20352.006 x-tm-as-result: No--40.833300-0.000000-31 x-tm-as-user-approved-sender: Yes x-tm-as-user-blocked-sender: No MIME-Version: 1.0 X-Really-From-Bendigo-IT: magichashvalue Subject: [Xen-users] GPLPV license change X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org At some point in the near future I will be changing the license for the GPLPV drivers to be either dual GPL and BSD style license (if possible and useful), or just a BSD style license. There are some issues around WHQL that are incompatible with the GPL, so this is an unfortunate but necessary change, and I think a BSD style license offers the best compromise. A name change will be in order too, obviously :) Please email me off-list if you think this warrants further discussion. Thanks James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Wed Dec 11 10:14:41 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 11 Dec 2013 10:14:41 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqgnZ-00079m-1k; Wed, 11 Dec 2013 10:13:45 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqgnX-00079a-Oy for xen-users@lists.xen.org; Wed, 11 Dec 2013 10:13:43 +0000 Received: from [85.158.137.68:63975] by server-17.bemta-3.messagelabs.com id 59/6E-15965-6DA38A25; Wed, 11 Dec 2013 10:13:42 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-11.tower-31.messagelabs.com!1386756819!3188633!1 X-Originating-IP: [203.16.207.99] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 8502 invoked from network); 11 Dec 2013 10:13:42 -0000 Received: from mail.bendigoit.com.au (HELO smtp2.bendigoit.com.au) (203.16.207.99) by server-11.tower-31.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 11 Dec 2013 10:13:42 -0000 Received: from bitcom1.int.sbss.com.au ([192.168.200.237]) by smtp2.bendigoit.com.au with esmtp (Exim 4.80) (envelope-from ) id 1VqgnR-0005o7-AA for xen-users@lists.xen.org; Wed, 11 Dec 2013 21:13:37 +1100 Received: from BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d]) by BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d%12]) with mapi id 14.01.0438.000; Wed, 11 Dec 2013 21:13:36 +1100 From: James Harper To: "xen-users@lists.xen.org" Thread-Topic: GPLPV license change Thread-Index: Ac72WGTMIWT75KcUR1mBxrs52dPT+w== Date: Wed, 11 Dec 2013 10:13:34 +0000 Message-ID: <6035A0D088A63A46850C3988ED045A4B66C0308C@BITCOM1.int.sbss.com.au> Accept-Language: en-AU, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.16.3.239] x-tm-as-product-ver: SMEX-10.2.0.3176-7.000.1014-20352.006 x-tm-as-result: No--40.833300-0.000000-31 x-tm-as-user-approved-sender: Yes x-tm-as-user-blocked-sender: No MIME-Version: 1.0 X-Really-From-Bendigo-IT: magichashvalue Subject: [Xen-users] GPLPV license change X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org At some point in the near future I will be changing the license for the GPLPV drivers to be either dual GPL and BSD style license (if possible and useful), or just a BSD style license. There are some issues around WHQL that are incompatible with the GPL, so this is an unfortunate but necessary change, and I think a BSD style license offers the best compromise. A name change will be in order too, obviously :) Please email me off-list if you think this warrants further discussion. Thanks James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Wed Dec 11 14:49:29 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 11 Dec 2013 14:49:29 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vql5P-0003Hf-Cb; Wed, 11 Dec 2013 14:48:27 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vql5O-0003FV-5i for xen-users@lists.xen.org; Wed, 11 Dec 2013 14:48:26 +0000 Received: from [85.158.139.211:51389] by server-16.bemta-5.messagelabs.com id 76/3A-11843-93B78A25; Wed, 11 Dec 2013 14:48:25 +0000 X-Env-Sender: russell.pavlicek.xen@gmail.com X-Msg-Ref: server-3.tower-206.messagelabs.com!1386773302!3620116!1 X-Originating-IP: [209.85.192.174] X-SpamReason: No, hits=0.3 required=7.0 tests=RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30120 invoked from network); 11 Dec 2013 14:48:24 -0000 Received: from mail-pd0-f174.google.com (HELO mail-pd0-f174.google.com) (209.85.192.174) by server-3.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 11 Dec 2013 14:48:24 -0000 Received: by mail-pd0-f174.google.com with SMTP id y13so9540823pdi.5 for ; Wed, 11 Dec 2013 06:48:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=ztj2FMjEQjmzsGe9nlc9vkQaBBVt+zuh8gJJFO0USV4=; b=O4XD0l4HzFtRDjUNP5DI5Efvbyg1XBdgeIFGPHErm9CqiDcCa76D2EruNzsYiMKj0N IYPEZlN/3F1WzIRq6JVZyUUs7suhs0eiRCXOMHqKda4AbQggDvRpNi0VEx7SrehALvqY 22NStyY4skSFkaAeJ0ocVWLjJT9EYQxDjvuLMOQ0n5QXQcm8uiDOmBh0PWu483zBQF7O C2zkeyeIySyvIme/7jsVIUnNGABidh9RIWWUddVcJAKjvB44seSULBoCLwRC9zHKJ8uL ZR+hVXLHTRRKMfuWtQZ4sZn4vYyPzj/Jmud6rc1YM5PK1dk6oTidvR9BWU3exfN3bsN8 xpPw== MIME-Version: 1.0 X-Received: by 10.68.164.165 with SMTP id yr5mr2132999pbb.146.1386773302404; Wed, 11 Dec 2013 06:48:22 -0800 (PST) Received: by 10.68.78.137 with HTTP; Wed, 11 Dec 2013 06:48:22 -0800 (PST) Date: Wed, 11 Dec 2013 09:48:22 -0500 X-Google-Sender-Auth: nTnNS0lAH_VbBWX0QNhgcoUII10 Message-ID: From: Russ Pavlicek To: "xen-users@lists.xen.org" Subject: [Xen-users] XenProject.org Q&A: Running xen to create PV hosts under KVM with virtio X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="windows-1252" Content-Transfer-Encoding: quoted-printable Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org The following question was posed by Simon Easter on the XenProject.org Q&A area. Please reply to me so I can post your answers to the site or, if you feel so inclined, answer yourself on the website: I have a need to run very low weight PV debian guests under a kvm hypervised guest .(i.e. split a vm using pv - the reasons are varied but essentially each host has to have it's own networking/routing layer) I can boot these only when the underlying block device in kvm guest is switched to ide from virtio.(on test system) My question is: is there any way I can get xen to boot with virtio as I don't have the control to switch the block device supplied to IDE (it's not permitted) Can the xen system be recompiled or can I compile a module that works and doesn't result in error message of udevd timout: killing =91/sbin/modprobe -v virtio=85=85=85 Any suggestions I was going to look at jails but am unsure the networking is self contained in each jail so xen pv was the next choice. Simon _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Wed Dec 11 14:49:29 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 11 Dec 2013 14:49:29 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vql5P-0003Hf-Cb; Wed, 11 Dec 2013 14:48:27 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vql5O-0003FV-5i for xen-users@lists.xen.org; Wed, 11 Dec 2013 14:48:26 +0000 Received: from [85.158.139.211:51389] by server-16.bemta-5.messagelabs.com id 76/3A-11843-93B78A25; Wed, 11 Dec 2013 14:48:25 +0000 X-Env-Sender: russell.pavlicek.xen@gmail.com X-Msg-Ref: server-3.tower-206.messagelabs.com!1386773302!3620116!1 X-Originating-IP: [209.85.192.174] X-SpamReason: No, hits=0.3 required=7.0 tests=RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30120 invoked from network); 11 Dec 2013 14:48:24 -0000 Received: from mail-pd0-f174.google.com (HELO mail-pd0-f174.google.com) (209.85.192.174) by server-3.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 11 Dec 2013 14:48:24 -0000 Received: by mail-pd0-f174.google.com with SMTP id y13so9540823pdi.5 for ; Wed, 11 Dec 2013 06:48:22 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type :content-transfer-encoding; bh=ztj2FMjEQjmzsGe9nlc9vkQaBBVt+zuh8gJJFO0USV4=; b=O4XD0l4HzFtRDjUNP5DI5Efvbyg1XBdgeIFGPHErm9CqiDcCa76D2EruNzsYiMKj0N IYPEZlN/3F1WzIRq6JVZyUUs7suhs0eiRCXOMHqKda4AbQggDvRpNi0VEx7SrehALvqY 22NStyY4skSFkaAeJ0ocVWLjJT9EYQxDjvuLMOQ0n5QXQcm8uiDOmBh0PWu483zBQF7O C2zkeyeIySyvIme/7jsVIUnNGABidh9RIWWUddVcJAKjvB44seSULBoCLwRC9zHKJ8uL ZR+hVXLHTRRKMfuWtQZ4sZn4vYyPzj/Jmud6rc1YM5PK1dk6oTidvR9BWU3exfN3bsN8 xpPw== MIME-Version: 1.0 X-Received: by 10.68.164.165 with SMTP id yr5mr2132999pbb.146.1386773302404; Wed, 11 Dec 2013 06:48:22 -0800 (PST) Received: by 10.68.78.137 with HTTP; Wed, 11 Dec 2013 06:48:22 -0800 (PST) Date: Wed, 11 Dec 2013 09:48:22 -0500 X-Google-Sender-Auth: nTnNS0lAH_VbBWX0QNhgcoUII10 Message-ID: From: Russ Pavlicek To: "xen-users@lists.xen.org" Subject: [Xen-users] XenProject.org Q&A: Running xen to create PV hosts under KVM with virtio X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="windows-1252" Content-Transfer-Encoding: quoted-printable Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org The following question was posed by Simon Easter on the XenProject.org Q&A area. Please reply to me so I can post your answers to the site or, if you feel so inclined, answer yourself on the website: I have a need to run very low weight PV debian guests under a kvm hypervised guest .(i.e. split a vm using pv - the reasons are varied but essentially each host has to have it's own networking/routing layer) I can boot these only when the underlying block device in kvm guest is switched to ide from virtio.(on test system) My question is: is there any way I can get xen to boot with virtio as I don't have the control to switch the block device supplied to IDE (it's not permitted) Can the xen system be recompiled or can I compile a module that works and doesn't result in error message of udevd timout: killing =91/sbin/modprobe -v virtio=85=85=85 Any suggestions I was going to look at jails but am unsure the networking is self contained in each jail so xen pv was the next choice. Simon _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Wed Dec 11 16:36:03 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 11 Dec 2013 16:36:03 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqmkO-0004kM-Bp; Wed, 11 Dec 2013 16:34:52 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqmkN-0004kF-4O for xen-users@lists.xen.org; Wed, 11 Dec 2013 16:34:51 +0000 Received: from [85.158.137.68:13464] by server-10.bemta-3.messagelabs.com id 5E/34-23989-A2498A25; Wed, 11 Dec 2013 16:34:50 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-2.tower-31.messagelabs.com!1386779688!3282886!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 27883 invoked from network); 11 Dec 2013 16:34:49 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-2.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 11 Dec 2013 16:34:49 -0000 X-IronPort-AV: E=Sophos;i="4.93,872,1378857600"; d="scan'208";a="83290467" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 11 Dec 2013 16:34:47 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL02.citrite.net (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Wed, 11 Dec 2013 11:34:46 -0500 Message-ID: <1386779686.12610.20.camel@kazak.uk.xensource.com> From: Ian Campbell To: Russ Pavlicek Date: Wed, 11 Dec 2013 16:34:46 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA1 Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] XenProject.org Q&A: Running xen to create PV hosts under KVM with virtio X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org SWYgSSB1bmRlcnN0YW5kIGhpbSBjb3JyZWN0bHkgaGUgd2FudHMgdG8gdXNlIHZpcnRpbyBhcyB0 aGUgImhvc3QiIChmcm9tClhlbidzIFBvVikgZGlzayBkZXZpY2UgZHJpdmVyIChpLmUuIHRoZSBL Vk0gZ3Vlc3QncyBJL08gcGF0aCkuIEFzCmRpc3RpbmN0IGZyb20gd2FudGluZyB0byB1c2Ugdmly dGlvIGFzIHRoZSBJL08gcGF0aCBmb3IgdGhlIFhlbiBQVgpndWVzdHMuCgpNeSBleHBlcmllbmNl IHdpdGggdGhlIEFSTSBGb3VuZGF0aW9uIG1vZGVsICh3aGljaCBhbHNvIGV4cG9zZXMgYSB2aXJ0 aW8KImhvc3QiIGRpc2spIGlzIHRoYXQgdGhlIHZpcnRpbyBkcml2ZXJzIGRvIG5vdCB3b3JrIHVu ZGVyIFhlbiBiZWNhdXNlCnRoZXkgZG8gbm90IGNvcnJlY3RseSB1c2UgdGhlIGtlcm5lbCdzIERN QSBBUElzICh0aGlzIGlzIG5lZWRlZCBiZWNhdXNlCnVuZGVyIFhlbiBwaHlzaWNhbCBhZGRycyB0 byBub3QgbWFwIDE6MSB0byBETUEgYWRkcmVzc2VzKS4gQnkgImRvIG5vdApjb3JyZWN0bHkgdXNl IiBJIGFjdHVhbGx5IG1lYW4gImRvIG5vdCB1c2UgYXQgYWxsIi4KCklNSE8gdGhpcyBpcyBhIGJ1 ZyBpbiB2aXJ0aW8gYW5kIGl0IHdvdWxkIGJlIGxvdmVseSB0byBzZWUgaXQgZml4ZWQsIGJ1dApB RkFJSyBub29uZSBpcyB3b3JraW5nIG9uIHRoYXQgc2luY2UgaXQgaXMgYSBiaXQgb2YgYSBuaWNo ZSB1c2UgY2FzZS4gSWYKaGUgd2FudHMgdG8gaGF2ZSBhIHN0YWIgYXQgaXQgaGUnbGwgcHJvYmFi bHkgd2FudCB0byBqb2luIHRoZSB4ZW4tZGV2ZWwKYW5kIHFlbXUtZGV2ZWwgbGlzdHMuCgpPbiBB Uk0gd2UgaGF2ZSB0aGUgb3B0aW9uIHRvIG1ha2UgRE1BIGFkZHI9cGh5c2ljYWwgYWRkciB3aGlj aCBjYW4gYmUKdXNlZCB0byB3b3JrIGFyb3VuZCB0aGlzIGlzc3VlLiBJIGRvbid0IHRoaW5rIHRo ZXJlIGlzIGFueSBzaW1pbGFyCm9wdGlvbiBmb3IgeDg2IFBWIGRvbTAuCgpJYW4uCgpPbiBXZWQs IDIwMTMtMTItMTEgYXQgMDk6NDggLTA1MDAsIFJ1c3MgUGF2bGljZWsgd3JvdGU6Cj4gIFRoZSBm b2xsb3dpbmcgcXVlc3Rpb24gd2FzIHBvc2VkIGJ5IFNpbW9uIEVhc3RlciBvbiB0aGUKPiBYZW5Q cm9qZWN0Lm9yZyBRJkEgYXJlYS4gIFBsZWFzZSByZXBseSB0byBtZSBzbyBJIGNhbiBwb3N0IHlv dXIKPiBhbnN3ZXJzIHRvIHRoZSBzaXRlIG9yLCBpZiB5b3UgZmVlbCBzbyBpbmNsaW5lZCwgYW5z d2VyIHlvdXJzZWxmIG9uCj4gdGhlIHdlYnNpdGU6Cj4gCj4gSSBoYXZlIGEgbmVlZCB0byBydW4g dmVyeSBsb3cgd2VpZ2h0IFBWIGRlYmlhbiBndWVzdHMgdW5kZXIgYSBrdm0KPiBoeXBlcnZpc2Vk IGd1ZXN0IC4oaS5lLiBzcGxpdCBhIHZtIHVzaW5nIHB2IC0gdGhlIHJlYXNvbnMgYXJlIHZhcmll ZAo+IGJ1dCBlc3NlbnRpYWxseSBlYWNoIGhvc3QgaGFzIHRvIGhhdmUgaXQncyBvd24gbmV0d29y a2luZy9yb3V0aW5nCj4gbGF5ZXIpCj4gSSBjYW4gYm9vdCB0aGVzZSBvbmx5IHdoZW4gdGhlIHVu ZGVybHlpbmcgYmxvY2sgZGV2aWNlIGluIGt2bSBndWVzdCBpcwo+IHN3aXRjaGVkIHRvIGlkZSBm cm9tIHZpcnRpby4ob24gdGVzdCBzeXN0ZW0pCj4gCj4gTXkgcXVlc3Rpb24gaXM6IGlzIHRoZXJl IGFueSB3YXkgSSBjYW4gZ2V0IHhlbiB0byBib290IHdpdGggdmlydGlvIGFzCj4gSSBkb24ndCBo YXZlIHRoZSBjb250cm9sIHRvIHN3aXRjaCB0aGUgYmxvY2sgZGV2aWNlIHN1cHBsaWVkIHRvIElE RQo+IChpdCdzIG5vdCBwZXJtaXR0ZWQpCj4gQ2FuIHRoZSB4ZW4gc3lzdGVtIGJlIHJlY29tcGls ZWQgb3IgY2FuIEkgY29tcGlsZSBhIG1vZHVsZSB0aGF0IHdvcmtzCj4gYW5kIGRvZXNuJ3QgcmVz dWx0IGluIGVycm9yIG1lc3NhZ2Ugb2YKPiAKPiB1ZGV2ZCB0aW1vdXQ6IGtpbGxpbmcg4oCYL3Ni aW4vbW9kcHJvYmUgLXYgdmlydGlv4oCm4oCm4oCmCj4gCj4gQW55IHN1Z2dlc3Rpb25zIEkgd2Fz IGdvaW5nIHRvIGxvb2sgYXQgamFpbHMgYnV0IGFtIHVuc3VyZSB0aGUKPiBuZXR3b3JraW5nIGlz IHNlbGYgY29udGFpbmVkIGluIGVhY2ggamFpbCBzbyB4ZW4gcHYgd2FzIHRoZSBuZXh0Cj4gY2hv aWNlLgo+IAo+IFNpbW9uCj4gCj4gX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX18KPiBYZW4tdXNlcnMgbWFpbGluZyBsaXN0Cj4gWGVuLXVzZXJzQGxpc3RzLnhl bi5vcmcKPiBodHRwOi8vbGlzdHMueGVuLm9yZy94ZW4tdXNlcnMKCgoKX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KWGVuLXVzZXJzIG1haWxpbmcgbGlzdApY ZW4tdXNlcnNAbGlzdHMueGVuLm9yZwpodHRwOi8vbGlzdHMueGVuLm9yZy94ZW4tdXNlcnM= From xen-users-bounces@lists.xen.org Wed Dec 11 16:36:03 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 11 Dec 2013 16:36:03 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqmkO-0004kM-Bp; Wed, 11 Dec 2013 16:34:52 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqmkN-0004kF-4O for xen-users@lists.xen.org; Wed, 11 Dec 2013 16:34:51 +0000 Received: from [85.158.137.68:13464] by server-10.bemta-3.messagelabs.com id 5E/34-23989-A2498A25; Wed, 11 Dec 2013 16:34:50 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-2.tower-31.messagelabs.com!1386779688!3282886!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 27883 invoked from network); 11 Dec 2013 16:34:49 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-2.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 11 Dec 2013 16:34:49 -0000 X-IronPort-AV: E=Sophos;i="4.93,872,1378857600"; d="scan'208";a="83290467" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 11 Dec 2013 16:34:47 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL02.citrite.net (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Wed, 11 Dec 2013 11:34:46 -0500 Message-ID: <1386779686.12610.20.camel@kazak.uk.xensource.com> From: Ian Campbell To: Russ Pavlicek Date: Wed, 11 Dec 2013 16:34:46 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA1 Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] XenProject.org Q&A: Running xen to create PV hosts under KVM with virtio X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org SWYgSSB1bmRlcnN0YW5kIGhpbSBjb3JyZWN0bHkgaGUgd2FudHMgdG8gdXNlIHZpcnRpbyBhcyB0 aGUgImhvc3QiIChmcm9tClhlbidzIFBvVikgZGlzayBkZXZpY2UgZHJpdmVyIChpLmUuIHRoZSBL Vk0gZ3Vlc3QncyBJL08gcGF0aCkuIEFzCmRpc3RpbmN0IGZyb20gd2FudGluZyB0byB1c2Ugdmly dGlvIGFzIHRoZSBJL08gcGF0aCBmb3IgdGhlIFhlbiBQVgpndWVzdHMuCgpNeSBleHBlcmllbmNl IHdpdGggdGhlIEFSTSBGb3VuZGF0aW9uIG1vZGVsICh3aGljaCBhbHNvIGV4cG9zZXMgYSB2aXJ0 aW8KImhvc3QiIGRpc2spIGlzIHRoYXQgdGhlIHZpcnRpbyBkcml2ZXJzIGRvIG5vdCB3b3JrIHVu ZGVyIFhlbiBiZWNhdXNlCnRoZXkgZG8gbm90IGNvcnJlY3RseSB1c2UgdGhlIGtlcm5lbCdzIERN QSBBUElzICh0aGlzIGlzIG5lZWRlZCBiZWNhdXNlCnVuZGVyIFhlbiBwaHlzaWNhbCBhZGRycyB0 byBub3QgbWFwIDE6MSB0byBETUEgYWRkcmVzc2VzKS4gQnkgImRvIG5vdApjb3JyZWN0bHkgdXNl IiBJIGFjdHVhbGx5IG1lYW4gImRvIG5vdCB1c2UgYXQgYWxsIi4KCklNSE8gdGhpcyBpcyBhIGJ1 ZyBpbiB2aXJ0aW8gYW5kIGl0IHdvdWxkIGJlIGxvdmVseSB0byBzZWUgaXQgZml4ZWQsIGJ1dApB RkFJSyBub29uZSBpcyB3b3JraW5nIG9uIHRoYXQgc2luY2UgaXQgaXMgYSBiaXQgb2YgYSBuaWNo ZSB1c2UgY2FzZS4gSWYKaGUgd2FudHMgdG8gaGF2ZSBhIHN0YWIgYXQgaXQgaGUnbGwgcHJvYmFi bHkgd2FudCB0byBqb2luIHRoZSB4ZW4tZGV2ZWwKYW5kIHFlbXUtZGV2ZWwgbGlzdHMuCgpPbiBB Uk0gd2UgaGF2ZSB0aGUgb3B0aW9uIHRvIG1ha2UgRE1BIGFkZHI9cGh5c2ljYWwgYWRkciB3aGlj aCBjYW4gYmUKdXNlZCB0byB3b3JrIGFyb3VuZCB0aGlzIGlzc3VlLiBJIGRvbid0IHRoaW5rIHRo ZXJlIGlzIGFueSBzaW1pbGFyCm9wdGlvbiBmb3IgeDg2IFBWIGRvbTAuCgpJYW4uCgpPbiBXZWQs IDIwMTMtMTItMTEgYXQgMDk6NDggLTA1MDAsIFJ1c3MgUGF2bGljZWsgd3JvdGU6Cj4gIFRoZSBm b2xsb3dpbmcgcXVlc3Rpb24gd2FzIHBvc2VkIGJ5IFNpbW9uIEVhc3RlciBvbiB0aGUKPiBYZW5Q cm9qZWN0Lm9yZyBRJkEgYXJlYS4gIFBsZWFzZSByZXBseSB0byBtZSBzbyBJIGNhbiBwb3N0IHlv dXIKPiBhbnN3ZXJzIHRvIHRoZSBzaXRlIG9yLCBpZiB5b3UgZmVlbCBzbyBpbmNsaW5lZCwgYW5z d2VyIHlvdXJzZWxmIG9uCj4gdGhlIHdlYnNpdGU6Cj4gCj4gSSBoYXZlIGEgbmVlZCB0byBydW4g dmVyeSBsb3cgd2VpZ2h0IFBWIGRlYmlhbiBndWVzdHMgdW5kZXIgYSBrdm0KPiBoeXBlcnZpc2Vk IGd1ZXN0IC4oaS5lLiBzcGxpdCBhIHZtIHVzaW5nIHB2IC0gdGhlIHJlYXNvbnMgYXJlIHZhcmll ZAo+IGJ1dCBlc3NlbnRpYWxseSBlYWNoIGhvc3QgaGFzIHRvIGhhdmUgaXQncyBvd24gbmV0d29y a2luZy9yb3V0aW5nCj4gbGF5ZXIpCj4gSSBjYW4gYm9vdCB0aGVzZSBvbmx5IHdoZW4gdGhlIHVu ZGVybHlpbmcgYmxvY2sgZGV2aWNlIGluIGt2bSBndWVzdCBpcwo+IHN3aXRjaGVkIHRvIGlkZSBm cm9tIHZpcnRpby4ob24gdGVzdCBzeXN0ZW0pCj4gCj4gTXkgcXVlc3Rpb24gaXM6IGlzIHRoZXJl IGFueSB3YXkgSSBjYW4gZ2V0IHhlbiB0byBib290IHdpdGggdmlydGlvIGFzCj4gSSBkb24ndCBo YXZlIHRoZSBjb250cm9sIHRvIHN3aXRjaCB0aGUgYmxvY2sgZGV2aWNlIHN1cHBsaWVkIHRvIElE RQo+IChpdCdzIG5vdCBwZXJtaXR0ZWQpCj4gQ2FuIHRoZSB4ZW4gc3lzdGVtIGJlIHJlY29tcGls ZWQgb3IgY2FuIEkgY29tcGlsZSBhIG1vZHVsZSB0aGF0IHdvcmtzCj4gYW5kIGRvZXNuJ3QgcmVz dWx0IGluIGVycm9yIG1lc3NhZ2Ugb2YKPiAKPiB1ZGV2ZCB0aW1vdXQ6IGtpbGxpbmcg4oCYL3Ni aW4vbW9kcHJvYmUgLXYgdmlydGlv4oCm4oCm4oCmCj4gCj4gQW55IHN1Z2dlc3Rpb25zIEkgd2Fz IGdvaW5nIHRvIGxvb2sgYXQgamFpbHMgYnV0IGFtIHVuc3VyZSB0aGUKPiBuZXR3b3JraW5nIGlz IHNlbGYgY29udGFpbmVkIGluIGVhY2ggamFpbCBzbyB4ZW4gcHYgd2FzIHRoZSBuZXh0Cj4gY2hv aWNlLgo+IAo+IFNpbW9uCj4gCj4gX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fX19fX19fX18KPiBYZW4tdXNlcnMgbWFpbGluZyBsaXN0Cj4gWGVuLXVzZXJzQGxpc3RzLnhl bi5vcmcKPiBodHRwOi8vbGlzdHMueGVuLm9yZy94ZW4tdXNlcnMKCgoKX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KWGVuLXVzZXJzIG1haWxpbmcgbGlzdApY ZW4tdXNlcnNAbGlzdHMueGVuLm9yZwpodHRwOi8vbGlzdHMueGVuLm9yZy94ZW4tdXNlcnM= From xen-users-bounces@lists.xen.org Thu Dec 12 04:48:22 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 12 Dec 2013 04:48:22 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqyB1-0001xv-Cf; Thu, 12 Dec 2013 04:47:07 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqyAz-0001xq-GN for xen-users@lists.xen.org; Thu, 12 Dec 2013 04:47:05 +0000 Received: from [193.109.254.147:45794] by server-8.bemta-14.messagelabs.com id 4A/84-30921-8CF39A25; Thu, 12 Dec 2013 04:47:04 +0000 X-Env-Sender: bradleyfamily.jami@gmail.com X-Msg-Ref: server-16.tower-27.messagelabs.com!1386823622!3140063!1 X-Originating-IP: [209.85.223.177] X-SpamReason: No, hits=0.4 required=7.0 tests=HTML_30_40,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 18532 invoked from network); 12 Dec 2013 04:47:03 -0000 Received: from mail-ie0-f177.google.com (HELO mail-ie0-f177.google.com) (209.85.223.177) by server-16.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 12 Dec 2013 04:47:03 -0000 Received: by mail-ie0-f177.google.com with SMTP id tp5so12670062ieb.36 for ; Wed, 11 Dec 2013 20:47:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=hy3plbDUaF09mHC9WsTnWEGO5aTNzQgfiRKPsM1gLNA=; b=p/evIoSJnNquheVs/4mjApKNVjAt+amPyzj/iHS5bcgVuVZ4ZZxQlMH5J6LcJrWlbL IJsxN5N94Fqt+V6OC/SZxPZ9C6NM3a7eU+t9Axy587aY315rwb2NJ29ZZMfkFhdrMel5 PtvtKLNFRy0m8k09laVFMf8WI2kN8NgnZ44CI4AQbSGAqztt24Oj2js/PO45lzjVtgmi bIViuVlpqnXdTuyAnUrQBnelar3s/DxkcGA83OYnUV/NX15V/zCWsfzRcXXwvZfvztQS /k4FZOiYEmpzjTIKEjA6aAeydE5mRmBbdLqfVSIkeptyFo6l1bAv3Z2T2Ij3zPrPXvlb JXdg== MIME-Version: 1.0 X-Received: by 10.50.118.41 with SMTP id kj9mr6945951igb.9.1386823622085; Wed, 11 Dec 2013 20:47:02 -0800 (PST) Received: by 10.64.240.232 with HTTP; Wed, 11 Dec 2013 20:47:02 -0800 (PST) Date: Wed, 11 Dec 2013 21:47:02 -0700 Message-ID: From: Jami Bradley To: xen-users@lists.xen.org Subject: Re: [Xen-users] I/O virtualisation disabled - ACPI issue? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============8368299409412713350==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============8368299409412713350== Content-Type: multipart/alternative; boundary=089e011769a35c54d504ed4f09ad --089e011769a35c54d504ed4f09ad Content-Type: text/plain; charset=ISO-8859-1 On Wed, Dec 4, 2013 at 5:00 AM, Jami Bradley wrote: > From: Jami Bradley > To: xen-users@lists.xen.org > Cc: > Date: Tue, 3 Dec 2013 18:03:36 -0700 > Subject: [Xen-users] I/O virtualisation disabled - ACPI issue? > I just started using Xen and am trying to come up to speed. I am trying > to configure a desktop PC to boot Xen, then passthrough VGA, Keyboard, and > Mouse to a VM for development. I have a Win7 DomU working beautifully > without the passthrough, so I have the basics working. > > Here is my configuration (please let me know if I missed something > important): > ASUS P9X79 Pro motherboard, current BIOS, with VT-D enabled. > Intel I7-4930K processor > > I installed CentOS 6.5 minimal for Dom0, plus a couple packages to get > things working (e.g., Perl). I have xend turned off and I am trying to do > everything using the XL toolkit. > > I have installed Xen 4.2.3 stable and have built and installed the current > head from GIT (post 4.3.1) with identical results. > > After some debugging, I believe it is failing to parse the ACPI table > (acpi_drhd_units is empty in intel_vtd_setup) and disabling IOMMU. > > Any tips on how to proceed? > > Thanks! > > I just wanted to follow up on my research on my issue. What I found is that the ASUS P9X79 Pro motherboard does *not* support VT-d. It supports "Virtualization" by Vanderpool (aka. VT-x). Looking at the BIOS releases they have had, version 0906 added support for VT-d. Apparently at some point they dropped/disabled it. But, here is the last response I received from ASUS, I will cross my fingers!!! I have checked with the relative department, and they mentioned a new bios > will be released to solve the VT-D option not exist in the bios with the > Ivy bridge-E cpu installed, may be in one month. > Please pay attention to our website for updating. > Sorry for the inconvenience. > > Best Regards, > Carter > ASUS Product Support Team --089e011769a35c54d504ed4f09ad Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
On W= ed, Dec 4, 2013 at 5:00 AM,=A0Jami Bradley <bradleyfamily.jami@gmail.com>=A0wrote:
From:=A0Jami Bradley <br= adleyfamily.jami@gmail.com>
To:=A0xen-users@lists.xen.org
Cc:=A0
Date:=A0Tue, 3 Dec 201= 3 18:03:36 -0700
Subject:=A0[Xen-users] I/O virtualisation disabled - ACPI issue?
I just started using Xen and am trying to come up to speed. =A0I = am trying to configure a desktop PC to boot Xen, then passthrough VGA, Keyb= oard, and Mouse to a VM for development. =A0I have a Win7 DomU working beau= tifully without the passthrough, so I have the basics working.

Here is my configuration (please let me know if I missed som= ething important):
ASUS P9X79 Pro motherboard, current BIOS, with= VT-D enabled.
Intel I7-4930K processor

I installed CentOS 6.5 minimal for Dom0, plus a couple packages to get thin= gs working (e.g., Perl). =A0I have xend turned off and I am trying to do ev= erything using the XL toolkit.

I have installed Xe= n 4.2.3 stable and have built and installed the current head from GIT (post= 4.3.1) with identical results.

After some debugging, I believe it is failing to parse = the ACPI table (acpi_drhd_units is empty in intel_vtd_setup) and disabling = IOMMU.

Any tips on how to proceed?

Thanks!

I just wante= d to follow up on my research on my issue. =A0What I found is that the ASUS= P9X79 Pro motherboard does *not* support VT-d. =A0It supports "Virtua= lization" by Vanderpool (aka. VT-x). =A0Looking at the BIOS releases t= hey have had, version 0906 added support for VT-d. Apparently at some point= they dropped/disabled it.

But, here is the last response I received from ASUS, I = will cross my fingers!!!

I have checked with the relative department, and they mentioned a new=20 bios will be released to solve the VT-D option not exist in the bios=20 with the Ivy bridge-E cpu installed, may be in one month.
Please pay att= ention to our website for updating.
Sorry for the inconvenience.

= Best Regards,
Carter
ASUS Product Support Team

=A0
--089e011769a35c54d504ed4f09ad-- --===============8368299409412713350== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============8368299409412713350==-- From xen-users-bounces@lists.xen.org Thu Dec 12 04:48:22 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 12 Dec 2013 04:48:22 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqyB1-0001xv-Cf; Thu, 12 Dec 2013 04:47:07 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VqyAz-0001xq-GN for xen-users@lists.xen.org; Thu, 12 Dec 2013 04:47:05 +0000 Received: from [193.109.254.147:45794] by server-8.bemta-14.messagelabs.com id 4A/84-30921-8CF39A25; Thu, 12 Dec 2013 04:47:04 +0000 X-Env-Sender: bradleyfamily.jami@gmail.com X-Msg-Ref: server-16.tower-27.messagelabs.com!1386823622!3140063!1 X-Originating-IP: [209.85.223.177] X-SpamReason: No, hits=0.4 required=7.0 tests=HTML_30_40,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 18532 invoked from network); 12 Dec 2013 04:47:03 -0000 Received: from mail-ie0-f177.google.com (HELO mail-ie0-f177.google.com) (209.85.223.177) by server-16.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 12 Dec 2013 04:47:03 -0000 Received: by mail-ie0-f177.google.com with SMTP id tp5so12670062ieb.36 for ; Wed, 11 Dec 2013 20:47:02 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=hy3plbDUaF09mHC9WsTnWEGO5aTNzQgfiRKPsM1gLNA=; b=p/evIoSJnNquheVs/4mjApKNVjAt+amPyzj/iHS5bcgVuVZ4ZZxQlMH5J6LcJrWlbL IJsxN5N94Fqt+V6OC/SZxPZ9C6NM3a7eU+t9Axy587aY315rwb2NJ29ZZMfkFhdrMel5 PtvtKLNFRy0m8k09laVFMf8WI2kN8NgnZ44CI4AQbSGAqztt24Oj2js/PO45lzjVtgmi bIViuVlpqnXdTuyAnUrQBnelar3s/DxkcGA83OYnUV/NX15V/zCWsfzRcXXwvZfvztQS /k4FZOiYEmpzjTIKEjA6aAeydE5mRmBbdLqfVSIkeptyFo6l1bAv3Z2T2Ij3zPrPXvlb JXdg== MIME-Version: 1.0 X-Received: by 10.50.118.41 with SMTP id kj9mr6945951igb.9.1386823622085; Wed, 11 Dec 2013 20:47:02 -0800 (PST) Received: by 10.64.240.232 with HTTP; Wed, 11 Dec 2013 20:47:02 -0800 (PST) Date: Wed, 11 Dec 2013 21:47:02 -0700 Message-ID: From: Jami Bradley To: xen-users@lists.xen.org Subject: Re: [Xen-users] I/O virtualisation disabled - ACPI issue? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============8368299409412713350==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============8368299409412713350== Content-Type: multipart/alternative; boundary=089e011769a35c54d504ed4f09ad --089e011769a35c54d504ed4f09ad Content-Type: text/plain; charset=ISO-8859-1 On Wed, Dec 4, 2013 at 5:00 AM, Jami Bradley wrote: > From: Jami Bradley > To: xen-users@lists.xen.org > Cc: > Date: Tue, 3 Dec 2013 18:03:36 -0700 > Subject: [Xen-users] I/O virtualisation disabled - ACPI issue? > I just started using Xen and am trying to come up to speed. I am trying > to configure a desktop PC to boot Xen, then passthrough VGA, Keyboard, and > Mouse to a VM for development. I have a Win7 DomU working beautifully > without the passthrough, so I have the basics working. > > Here is my configuration (please let me know if I missed something > important): > ASUS P9X79 Pro motherboard, current BIOS, with VT-D enabled. > Intel I7-4930K processor > > I installed CentOS 6.5 minimal for Dom0, plus a couple packages to get > things working (e.g., Perl). I have xend turned off and I am trying to do > everything using the XL toolkit. > > I have installed Xen 4.2.3 stable and have built and installed the current > head from GIT (post 4.3.1) with identical results. > > After some debugging, I believe it is failing to parse the ACPI table > (acpi_drhd_units is empty in intel_vtd_setup) and disabling IOMMU. > > Any tips on how to proceed? > > Thanks! > > I just wanted to follow up on my research on my issue. What I found is that the ASUS P9X79 Pro motherboard does *not* support VT-d. It supports "Virtualization" by Vanderpool (aka. VT-x). Looking at the BIOS releases they have had, version 0906 added support for VT-d. Apparently at some point they dropped/disabled it. But, here is the last response I received from ASUS, I will cross my fingers!!! I have checked with the relative department, and they mentioned a new bios > will be released to solve the VT-D option not exist in the bios with the > Ivy bridge-E cpu installed, may be in one month. > Please pay attention to our website for updating. > Sorry for the inconvenience. > > Best Regards, > Carter > ASUS Product Support Team --089e011769a35c54d504ed4f09ad Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
On W= ed, Dec 4, 2013 at 5:00 AM,=A0Jami Bradley <bradleyfamily.jami@gmail.com>=A0wrote:
From:=A0Jami Bradley <br= adleyfamily.jami@gmail.com>
To:=A0xen-users@lists.xen.org
Cc:=A0
Date:=A0Tue, 3 Dec 201= 3 18:03:36 -0700
Subject:=A0[Xen-users] I/O virtualisation disabled - ACPI issue?
I just started using Xen and am trying to come up to speed. =A0I = am trying to configure a desktop PC to boot Xen, then passthrough VGA, Keyb= oard, and Mouse to a VM for development. =A0I have a Win7 DomU working beau= tifully without the passthrough, so I have the basics working.

Here is my configuration (please let me know if I missed som= ething important):
ASUS P9X79 Pro motherboard, current BIOS, with= VT-D enabled.
Intel I7-4930K processor

I installed CentOS 6.5 minimal for Dom0, plus a couple packages to get thin= gs working (e.g., Perl). =A0I have xend turned off and I am trying to do ev= erything using the XL toolkit.

I have installed Xe= n 4.2.3 stable and have built and installed the current head from GIT (post= 4.3.1) with identical results.

After some debugging, I believe it is failing to parse = the ACPI table (acpi_drhd_units is empty in intel_vtd_setup) and disabling = IOMMU.

Any tips on how to proceed?

Thanks!

I just wante= d to follow up on my research on my issue. =A0What I found is that the ASUS= P9X79 Pro motherboard does *not* support VT-d. =A0It supports "Virtua= lization" by Vanderpool (aka. VT-x). =A0Looking at the BIOS releases t= hey have had, version 0906 added support for VT-d. Apparently at some point= they dropped/disabled it.

But, here is the last response I received from ASUS, I = will cross my fingers!!!

I have checked with the relative department, and they mentioned a new=20 bios will be released to solve the VT-D option not exist in the bios=20 with the Ivy bridge-E cpu installed, may be in one month.
Please pay att= ention to our website for updating.
Sorry for the inconvenience.

= Best Regards,
Carter
ASUS Product Support Team

=A0
--089e011769a35c54d504ed4f09ad-- --===============8368299409412713350== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============8368299409412713350==-- From xen-users-bounces@lists.xen.org Fri Dec 13 11:10:53 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 13 Dec 2013 11:10:53 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrQcj-0007Z9-ES; Fri, 13 Dec 2013 11:09:37 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrGs5-0006bC-K0 for xen-users@lists.xen.org; Fri, 13 Dec 2013 00:44:49 +0000 Received: from [85.158.137.68:19149] by server-3.bemta-3.messagelabs.com id DD/65-10658-0885AA25; Fri, 13 Dec 2013 00:44:48 +0000 X-Env-Sender: philgagnon1@gmail.com X-Msg-Ref: server-12.tower-31.messagelabs.com!1386895486!3541156!1 X-Originating-IP: [209.85.212.51] X-SpamReason: No, hits=0.3 required=7.0 tests=ML_RADAR_SPEW_LINKS_14, RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 26532 invoked from network); 13 Dec 2013 00:44:48 -0000 Received: from mail-vb0-f51.google.com (HELO mail-vb0-f51.google.com) (209.85.212.51) by server-12.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 13 Dec 2013 00:44:48 -0000 Received: by mail-vb0-f51.google.com with SMTP id 11so858076vbe.10 for ; Thu, 12 Dec 2013 16:44:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=3wprgU/ZUwinDmziZWvUprgVPeeku7KGEXm0ztg5WCI=; b=YvEU0YnG7PCRCNc9BdxuovJmQuyQ3fyURAkwbXHXjulcV95YQ2r+aycs/n51y/XEBb RE7nL9cA5e0B3dFgENesFCeCg6fYz48uKS7EhZ9lc/7+oWJ5+8OhiQ/m/pWCgfxT6p8c cDcqX+U5b34g4IIhcRhpGX+3+As3mhJedHknwlsbZQe+o2vSF2eRWlJSOyulH+DrG/Ro 5NXnlKcFitLfsUh+UEMNTU3smgE/U7M3HmHQWPW0Vc8S6aEaHHgzZYdsFzhHukAwf0l3 NkFDjYwL+iLQK9PxdIc87lKf6/QOddYFoJcJmjWXuw3SCeFyKH8c+OMB60Fw2MJVHmm2 xPMA== MIME-Version: 1.0 X-Received: by 10.52.163.165 with SMTP id yj5mr859246vdb.42.1386895486689; Thu, 12 Dec 2013 16:44:46 -0800 (PST) Received: by 10.58.187.11 with HTTP; Thu, 12 Dec 2013 16:44:46 -0800 (PST) Date: Thu, 12 Dec 2013 19:44:46 -0500 Message-ID: From: Philippe Gagnon To: xen-users@lists.xen.org X-Mailman-Approved-At: Fri, 13 Dec 2013 11:09:35 +0000 Subject: [Xen-users] Xen 4.3.1 ignoring dom0_mem command line parameter? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hello, I'm setting up a server running Xen 4.3.1 on Gentoo but I am running into a weird issue. My machine has 64GB of RAM total. I'm trying to set dom0's memory but no matter what I do it seems that the memory available to dom0 decreases when a VM is started. After a while, the system locks up; it responds to ping requests and shows the login prompt (on which you can enter a username, but the password input never appears) and that's it. When we managed to get a dmesg, it showed that the system ran out of memory. I have the following options on the kernel line for xen: (XEN) Command line: placeholder dom0_mem=12288M,max:12288M dom0_max_vcpus=4 And I have the following options on the kernel line for dom0: placeholder root=ZFS=tank/dom0 ro apparmor=1 security=apparmor After starting a few test VMs (about 40), xm and xl report different values with regards to the memory available to the dom0: prometheus ~ # xm list Name ID Mem VCPUs State Time(s) Domain-0 0 12288 4 r----- 1277.6 prometheus ~ # xl list Name ID Mem VCPUs State Time(s) Domain-0 0 12040 4 r----- 1279.1 /etc/xen/xl.conf is at its default value, but setting it to off has no effect either: #autoballoon="auto" and I have set the following options in /etc/xen/xend-config.sxp: (dom0-min-mem 12582912) (enable-dom0-ballooning no) The values in /proc/meminfo do not change: prometheus xen # cat /proc/meminfo MemTotal: 12233120 kB MemFree: 2055792 kB Buffers: 2892 kB Cached: 250984 kB I have been banging my head on my desk for a few days about this. Any help would be appreciated. Thank you so much, Philippe _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 13 11:10:53 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 13 Dec 2013 11:10:53 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrQcj-0007Z9-ES; Fri, 13 Dec 2013 11:09:37 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrGs5-0006bC-K0 for xen-users@lists.xen.org; Fri, 13 Dec 2013 00:44:49 +0000 Received: from [85.158.137.68:19149] by server-3.bemta-3.messagelabs.com id DD/65-10658-0885AA25; Fri, 13 Dec 2013 00:44:48 +0000 X-Env-Sender: philgagnon1@gmail.com X-Msg-Ref: server-12.tower-31.messagelabs.com!1386895486!3541156!1 X-Originating-IP: [209.85.212.51] X-SpamReason: No, hits=0.3 required=7.0 tests=ML_RADAR_SPEW_LINKS_14, RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 26532 invoked from network); 13 Dec 2013 00:44:48 -0000 Received: from mail-vb0-f51.google.com (HELO mail-vb0-f51.google.com) (209.85.212.51) by server-12.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 13 Dec 2013 00:44:48 -0000 Received: by mail-vb0-f51.google.com with SMTP id 11so858076vbe.10 for ; Thu, 12 Dec 2013 16:44:46 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=3wprgU/ZUwinDmziZWvUprgVPeeku7KGEXm0ztg5WCI=; b=YvEU0YnG7PCRCNc9BdxuovJmQuyQ3fyURAkwbXHXjulcV95YQ2r+aycs/n51y/XEBb RE7nL9cA5e0B3dFgENesFCeCg6fYz48uKS7EhZ9lc/7+oWJ5+8OhiQ/m/pWCgfxT6p8c cDcqX+U5b34g4IIhcRhpGX+3+As3mhJedHknwlsbZQe+o2vSF2eRWlJSOyulH+DrG/Ro 5NXnlKcFitLfsUh+UEMNTU3smgE/U7M3HmHQWPW0Vc8S6aEaHHgzZYdsFzhHukAwf0l3 NkFDjYwL+iLQK9PxdIc87lKf6/QOddYFoJcJmjWXuw3SCeFyKH8c+OMB60Fw2MJVHmm2 xPMA== MIME-Version: 1.0 X-Received: by 10.52.163.165 with SMTP id yj5mr859246vdb.42.1386895486689; Thu, 12 Dec 2013 16:44:46 -0800 (PST) Received: by 10.58.187.11 with HTTP; Thu, 12 Dec 2013 16:44:46 -0800 (PST) Date: Thu, 12 Dec 2013 19:44:46 -0500 Message-ID: From: Philippe Gagnon To: xen-users@lists.xen.org X-Mailman-Approved-At: Fri, 13 Dec 2013 11:09:35 +0000 Subject: [Xen-users] Xen 4.3.1 ignoring dom0_mem command line parameter? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hello, I'm setting up a server running Xen 4.3.1 on Gentoo but I am running into a weird issue. My machine has 64GB of RAM total. I'm trying to set dom0's memory but no matter what I do it seems that the memory available to dom0 decreases when a VM is started. After a while, the system locks up; it responds to ping requests and shows the login prompt (on which you can enter a username, but the password input never appears) and that's it. When we managed to get a dmesg, it showed that the system ran out of memory. I have the following options on the kernel line for xen: (XEN) Command line: placeholder dom0_mem=12288M,max:12288M dom0_max_vcpus=4 And I have the following options on the kernel line for dom0: placeholder root=ZFS=tank/dom0 ro apparmor=1 security=apparmor After starting a few test VMs (about 40), xm and xl report different values with regards to the memory available to the dom0: prometheus ~ # xm list Name ID Mem VCPUs State Time(s) Domain-0 0 12288 4 r----- 1277.6 prometheus ~ # xl list Name ID Mem VCPUs State Time(s) Domain-0 0 12040 4 r----- 1279.1 /etc/xen/xl.conf is at its default value, but setting it to off has no effect either: #autoballoon="auto" and I have set the following options in /etc/xen/xend-config.sxp: (dom0-min-mem 12582912) (enable-dom0-ballooning no) The values in /proc/meminfo do not change: prometheus xen # cat /proc/meminfo MemTotal: 12233120 kB MemFree: 2055792 kB Buffers: 2892 kB Cached: 250984 kB I have been banging my head on my desk for a few days about this. Any help would be appreciated. Thank you so much, Philippe _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 13 11:20:32 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 13 Dec 2013 11:20:32 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrQmw-0008Ns-5u; Fri, 13 Dec 2013 11:20:10 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrQmv-0008Nn-68 for xen-users@lists.xen.org; Fri, 13 Dec 2013 11:20:09 +0000 Received: from [85.158.139.211:24075] by server-17.bemta-5.messagelabs.com id 6F/52-19152-86DEAA25; Fri, 13 Dec 2013 11:20:08 +0000 X-Env-Sender: roger.pau@citrix.com X-Msg-Ref: server-3.tower-206.messagelabs.com!1386933605!4076296!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23730 invoked from network); 13 Dec 2013 11:20:07 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-3.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 13 Dec 2013 11:20:07 -0000 X-IronPort-AV: E=Sophos;i="4.95,478,1384300800"; d="scan'208";a="81942656" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 13 Dec 2013 11:20:05 +0000 Received: from [IPv6:::1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Fri, 13 Dec 2013 06:20:05 -0500 Message-ID: <52AAED64.5030709@citrix.com> Date: Fri, 13 Dec 2013 12:20:04 +0100 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Philippe Gagnon , References: In-Reply-To: X-Enigmail-Version: 1.6 X-DLP: MIA2 Subject: Re: [Xen-users] Xen 4.3.1 ignoring dom0_mem command line parameter? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On 13/12/13 01:44, Philippe Gagnon wrote: > Hello, > > I'm setting up a server running Xen 4.3.1 on Gentoo but I am running > into a weird issue. My machine has 64GB of RAM total. I'm trying to > set dom0's memory but no matter what I do it seems that the memory > available to dom0 decreases when a VM is started. After a while, the > system locks up; it responds to ping requests and shows the login > prompt (on which you can enter a username, but the password input > never appears) and that's it. When we managed to get a dmesg, it > showed that the system ran out of memory. > > I have the following options on the kernel line for xen: > > (XEN) Command line: placeholder dom0_mem=12288M,max:12288M dom0_max_vcpus=4 > > And I have the following options on the kernel line for dom0: > > placeholder root=ZFS=tank/dom0 ro apparmor=1 security=apparmor > > After starting a few test VMs (about 40), xm and xl report different > values with regards to the memory available to the dom0: > > prometheus ~ # xm list > Name ID Mem VCPUs State Time(s) > Domain-0 0 12288 4 r----- 1277.6 > > prometheus ~ # xl list > Name ID Mem VCPUs State Time(s) > Domain-0 0 12040 4 r----- 1279.1 Hello, It seems that you are running both xl and xend at the same time, which is not recommended and is known to cause trouble. How do you launch your VMs? > /etc/xen/xl.conf is at its default value, but setting it to off has no > effect either: > #autoballoon="auto" Try setting it to "off", don't start xend and create your VMs using xl only. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 13 11:20:32 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 13 Dec 2013 11:20:32 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrQmw-0008Ns-5u; Fri, 13 Dec 2013 11:20:10 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrQmv-0008Nn-68 for xen-users@lists.xen.org; Fri, 13 Dec 2013 11:20:09 +0000 Received: from [85.158.139.211:24075] by server-17.bemta-5.messagelabs.com id 6F/52-19152-86DEAA25; Fri, 13 Dec 2013 11:20:08 +0000 X-Env-Sender: roger.pau@citrix.com X-Msg-Ref: server-3.tower-206.messagelabs.com!1386933605!4076296!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23730 invoked from network); 13 Dec 2013 11:20:07 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-3.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 13 Dec 2013 11:20:07 -0000 X-IronPort-AV: E=Sophos;i="4.95,478,1384300800"; d="scan'208";a="81942656" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 13 Dec 2013 11:20:05 +0000 Received: from [IPv6:::1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Fri, 13 Dec 2013 06:20:05 -0500 Message-ID: <52AAED64.5030709@citrix.com> Date: Fri, 13 Dec 2013 12:20:04 +0100 From: =?ISO-8859-1?Q?Roger_Pau_Monn=E9?= User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.7; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Philippe Gagnon , References: In-Reply-To: X-Enigmail-Version: 1.6 X-DLP: MIA2 Subject: Re: [Xen-users] Xen 4.3.1 ignoring dom0_mem command line parameter? X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On 13/12/13 01:44, Philippe Gagnon wrote: > Hello, > > I'm setting up a server running Xen 4.3.1 on Gentoo but I am running > into a weird issue. My machine has 64GB of RAM total. I'm trying to > set dom0's memory but no matter what I do it seems that the memory > available to dom0 decreases when a VM is started. After a while, the > system locks up; it responds to ping requests and shows the login > prompt (on which you can enter a username, but the password input > never appears) and that's it. When we managed to get a dmesg, it > showed that the system ran out of memory. > > I have the following options on the kernel line for xen: > > (XEN) Command line: placeholder dom0_mem=12288M,max:12288M dom0_max_vcpus=4 > > And I have the following options on the kernel line for dom0: > > placeholder root=ZFS=tank/dom0 ro apparmor=1 security=apparmor > > After starting a few test VMs (about 40), xm and xl report different > values with regards to the memory available to the dom0: > > prometheus ~ # xm list > Name ID Mem VCPUs State Time(s) > Domain-0 0 12288 4 r----- 1277.6 > > prometheus ~ # xl list > Name ID Mem VCPUs State Time(s) > Domain-0 0 12040 4 r----- 1279.1 Hello, It seems that you are running both xl and xend at the same time, which is not recommended and is known to cause trouble. How do you launch your VMs? > /etc/xen/xl.conf is at its default value, but setting it to off has no > effect either: > #autoballoon="auto" Try setting it to "off", don't start xend and create your VMs using xl only. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 13 12:56:35 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 13 Dec 2013 12:56:35 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrSHP-0007Na-Lk; Fri, 13 Dec 2013 12:55:43 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrSHO-0007NC-6p for xen-users@lists.xen.org; Fri, 13 Dec 2013 12:55:42 +0000 Received: from [193.109.254.147:55942] by server-11.bemta-14.messagelabs.com id 15/57-20576-CC30BA25; Fri, 13 Dec 2013 12:55:40 +0000 X-Env-Sender: blackstn10@gmail.com X-Msg-Ref: server-9.tower-27.messagelabs.com!1386939337!5006062!1 X-Originating-IP: [209.85.160.44] X-SpamReason: No, hits=0.8 required=7.0 tests=HTML_60_70,HTML_MESSAGE, MIME_BASE64_TEXT,MIME_BOUND_NEXTPART,ML_RADAR_SPEW_LINKS_14, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 20659 invoked from network); 13 Dec 2013 12:55:39 -0000 Received: from mail-pb0-f44.google.com (HELO mail-pb0-f44.google.com) (209.85.160.44) by server-9.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 13 Dec 2013 12:55:39 -0000 Received: by mail-pb0-f44.google.com with SMTP id rq2so2543547pbb.17 for ; Fri, 13 Dec 2013 04:55:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:cc:subject:mime-version:message-id:content-type; bh=4E0b+jmOjXiNNynSxg5BHiUVM3NdE7w6ERfwyf0ExTk=; b=nUVLG4wY4qphl6oIDjjRUGoiZ5pOGkY5SY8NIPgGSu/u/F7mLo0xSxFhqnAe7tZyRH uFSYFQGfsplqYmib2hyobXN1VkMJFp6cvo9NKRujqpvqX6TKbb+COdGQcZkCTeHgM1DZ RET4KqD1yLXSyE9wOIx5oinQCB9a0h7mhEj4xgSiVXYfwW37dQjmUaM6tq4h5zE42o2k 5rcNcTtP+p9cxMfkMCh9NRNIhxzXzfSaeYqBdf5XWguMdNjeXlyfcT5z4MwKRILhRzSA EnoVacPOAJjW+n2nx4sN2Zlfes8oIf98f+Fn/z3DPwHfiA7mo+89Z5QZOjtcSuXH2snY junQ== X-Received: by 10.68.203.34 with SMTP id kn2mr3105633pbc.82.1386939337057; Fri, 13 Dec 2013 04:55:37 -0800 (PST) Received: from yunshan-ray ([106.3.243.118]) by mx.google.com with ESMTPSA id gg10sm4706486pbc.46.2013.12.13.04.55.04 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 13 Dec 2013 04:55:36 -0800 (PST) Date: Fri, 13 Dec 2013 20:55:06 +0800 From: =?GB2312?B?yq/A2g==?= To: xen-users X-Priority: 3 X-Has-Attach: no X-Mailer: Foxmail 7, 1, 3, 48[cn] Mime-Version: 1.0 Message-ID: <2013121320544848851769@gmail.com> Cc: xen-api Subject: [Xen-users] How to disallow snapshot vdi when taking a snapshot to vm X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============1945523542668274283==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a multi-part message in MIME format. --===============1945523542668274283== Content-Type: multipart/alternative; boundary="----=_001_NextPart183514471464_=----" This is a multi-part message in MIME format. ------=_001_NextPart183514471464_=---- Content-Type: text/plain; charset="GB2312" Content-Transfer-Encoding: base64 SGVsbG8gZXhwZXJ0cywNCkl0IHNvdW5kcyB0byBiZSBhIHdlaXJkIHF1ZXN0aW9uIQ0KSSBkbyBh IHNuYXBzaG90IHRvIHZtIHdpdGggdHdvIHZkaXMsIGJ1dCBJIGRvbid0IHdhbnQgdG8gZG8gc25h cHNob3QgdG8gb25lIG9mIHRoZSB2ZGlzIGJlY2F1c2UgSSBqdXN0IHdhbnQgdGhlIHZkaSB0byBi YWNrdXAgbXkgZGF0YWJhc2UuDQpIb3cgY2FuIEkgZG8/ICBEbyB3ZSBoYXZlIHNvbWUgdHJpY2t5 IHdheXMgdG8gc3VwcG9ydCBpdC4NClRoYW5rcyBpbiBhZHZhbmNlIQ0KVGhhbmtz ------=_001_NextPart183514471464_=---- Content-Type: text/html; charset="GB2312" Content-Transfer-Encoding: quoted-printable
Hello experts,
It sounds to be a weird question!
I do a snapshot to vm with two vdis, but I don't want to do snapshot = to one=20 of the vdis because I just want the vdi to backup my database.
How can I do?  Do we have some tricky ways to support it.
Thanks in advance!
Thanks
------=_001_NextPart183514471464_=------ --===============1945523542668274283== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============1945523542668274283==-- From xen-users-bounces@lists.xen.org Fri Dec 13 12:56:35 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 13 Dec 2013 12:56:35 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrSHP-0007Na-Lk; Fri, 13 Dec 2013 12:55:43 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrSHO-0007NC-6p for xen-users@lists.xen.org; Fri, 13 Dec 2013 12:55:42 +0000 Received: from [193.109.254.147:55942] by server-11.bemta-14.messagelabs.com id 15/57-20576-CC30BA25; Fri, 13 Dec 2013 12:55:40 +0000 X-Env-Sender: blackstn10@gmail.com X-Msg-Ref: server-9.tower-27.messagelabs.com!1386939337!5006062!1 X-Originating-IP: [209.85.160.44] X-SpamReason: No, hits=0.8 required=7.0 tests=HTML_60_70,HTML_MESSAGE, MIME_BASE64_TEXT,MIME_BOUND_NEXTPART,ML_RADAR_SPEW_LINKS_14, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 20659 invoked from network); 13 Dec 2013 12:55:39 -0000 Received: from mail-pb0-f44.google.com (HELO mail-pb0-f44.google.com) (209.85.160.44) by server-9.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 13 Dec 2013 12:55:39 -0000 Received: by mail-pb0-f44.google.com with SMTP id rq2so2543547pbb.17 for ; Fri, 13 Dec 2013 04:55:37 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:cc:subject:mime-version:message-id:content-type; bh=4E0b+jmOjXiNNynSxg5BHiUVM3NdE7w6ERfwyf0ExTk=; b=nUVLG4wY4qphl6oIDjjRUGoiZ5pOGkY5SY8NIPgGSu/u/F7mLo0xSxFhqnAe7tZyRH uFSYFQGfsplqYmib2hyobXN1VkMJFp6cvo9NKRujqpvqX6TKbb+COdGQcZkCTeHgM1DZ RET4KqD1yLXSyE9wOIx5oinQCB9a0h7mhEj4xgSiVXYfwW37dQjmUaM6tq4h5zE42o2k 5rcNcTtP+p9cxMfkMCh9NRNIhxzXzfSaeYqBdf5XWguMdNjeXlyfcT5z4MwKRILhRzSA EnoVacPOAJjW+n2nx4sN2Zlfes8oIf98f+Fn/z3DPwHfiA7mo+89Z5QZOjtcSuXH2snY junQ== X-Received: by 10.68.203.34 with SMTP id kn2mr3105633pbc.82.1386939337057; Fri, 13 Dec 2013 04:55:37 -0800 (PST) Received: from yunshan-ray ([106.3.243.118]) by mx.google.com with ESMTPSA id gg10sm4706486pbc.46.2013.12.13.04.55.04 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Fri, 13 Dec 2013 04:55:36 -0800 (PST) Date: Fri, 13 Dec 2013 20:55:06 +0800 From: =?GB2312?B?yq/A2g==?= To: xen-users X-Priority: 3 X-Has-Attach: no X-Mailer: Foxmail 7, 1, 3, 48[cn] Mime-Version: 1.0 Message-ID: <2013121320544848851769@gmail.com> Cc: xen-api Subject: [Xen-users] How to disallow snapshot vdi when taking a snapshot to vm X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============1945523542668274283==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a multi-part message in MIME format. --===============1945523542668274283== Content-Type: multipart/alternative; boundary="----=_001_NextPart183514471464_=----" This is a multi-part message in MIME format. ------=_001_NextPart183514471464_=---- Content-Type: text/plain; charset="GB2312" Content-Transfer-Encoding: base64 SGVsbG8gZXhwZXJ0cywNCkl0IHNvdW5kcyB0byBiZSBhIHdlaXJkIHF1ZXN0aW9uIQ0KSSBkbyBh IHNuYXBzaG90IHRvIHZtIHdpdGggdHdvIHZkaXMsIGJ1dCBJIGRvbid0IHdhbnQgdG8gZG8gc25h cHNob3QgdG8gb25lIG9mIHRoZSB2ZGlzIGJlY2F1c2UgSSBqdXN0IHdhbnQgdGhlIHZkaSB0byBi YWNrdXAgbXkgZGF0YWJhc2UuDQpIb3cgY2FuIEkgZG8/ICBEbyB3ZSBoYXZlIHNvbWUgdHJpY2t5 IHdheXMgdG8gc3VwcG9ydCBpdC4NClRoYW5rcyBpbiBhZHZhbmNlIQ0KVGhhbmtz ------=_001_NextPart183514471464_=---- Content-Type: text/html; charset="GB2312" Content-Transfer-Encoding: quoted-printable
Hello experts,
It sounds to be a weird question!
I do a snapshot to vm with two vdis, but I don't want to do snapshot = to one=20 of the vdis because I just want the vdi to backup my database.
How can I do?  Do we have some tricky ways to support it.
Thanks in advance!
Thanks
------=_001_NextPart183514471464_=------ --===============1945523542668274283== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============1945523542668274283==-- From xen-users-bounces@lists.xen.org Fri Dec 13 16:13:24 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 13 Dec 2013 16:13:24 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrVLp-0000w1-DE; Fri, 13 Dec 2013 16:12:29 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrVLo-0000vl-GP for xen-users@lists.xen.org; Fri, 13 Dec 2013 16:12:28 +0000 Received: from [85.158.137.68:5812] by server-17.bemta-3.messagelabs.com id D0/57-15965-BE13BA25; Fri, 13 Dec 2013 16:12:27 +0000 X-Env-Sender: lists@aewne.net X-Msg-Ref: server-6.tower-31.messagelabs.com!1386951145!3792755!1 X-Originating-IP: [109.247.116.8] X-SpamReason: No, hits=0.0 required=7.0 tests=SUBJECT_EXCESS_QP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 12858 invoked from network); 13 Dec 2013 16:12:25 -0000 Received: from asav21.altibox.net (HELO asav21.altibox.net) (109.247.116.8) by server-6.tower-31.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 13 Dec 2013 16:12:25 -0000 Received: from localhost (localhost [127.0.0.1]) by asav21.altibox.net (Postfix) with ESMTP id 292E780268 for ; Fri, 13 Dec 2013 17:12:25 +0100 (CET) Received: from asav21.altibox.net ([127.0.0.1]) by localhost (asav21.lysetele.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id tv-RwhNMakhC for ; Fri, 13 Dec 2013 17:12:24 +0100 (CET) Received: from mail.aewne.net (180.79-160-8.customer.lyse.net [79.160.8.180]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by asav21.altibox.net (Postfix) with ESMTPS id 0B93E800E3 for ; Fri, 13 Dec 2013 17:12:23 +0100 (CET) Received: from localhost (180.79-160-8.customer.lyse.net [79.160.8.180]) by mail.aewne.net (Postfix) with ESMTPSA id 6DCA46041A for ; Fri, 13 Dec 2013 17:10:28 +0100 (CET) MIME-Version: 1.0 Date: Fri, 13 Dec 2013 17:10:28 +0100 From: Alex Aune To: xen-users@lists.xen.org In-Reply-To: References: Message-ID: X-Sender: lists@aewne.net User-Agent: Roundcube Webmail/0.9.2 Subject: Re: [Xen-users] =?utf-8?q?I/O_virtualisation_disabled_-_ACPI_issue=3F?= X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org T24gMTIuMTIuMjAxMyAwNTo0NywgSmFtaSBCcmFkbGV5IHdyb3RlOgo+IE9uIFdlZCwgRGVjIDQs IDIwMTMgYXQgNTowMCBBTSzCoEphbWkgQnJhZGxleQo+IDxicmFkbGV5ZmFtaWx5LmphbWlAZ21h aWwuY29tPsKgd3JvdGU6Cj4gCj4+IEZyb206wqBKYW1pIEJyYWRsZXkgPGJyYWRsZXlmYW1pbHku amFtaUBnbWFpbC5jb20+Cj4+IFRvOsKgeGVuLXVzZXJzQGxpc3RzLnhlbi5vcmcKPj4gQ2M6wqAK Pj4gRGF0ZTrCoFR1ZSwgMyBEZWMgMjAxMyAxODowMzozNiAtMDcwMAo+PiBTdWJqZWN0OsKgW1hl bi11c2Vyc10gSS9PIHZpcnR1YWxpc2F0aW9uIGRpc2FibGVkIC0gQUNQSSBpc3N1ZT8KPj4gCj4+ IEkganVzdCBzdGFydGVkIHVzaW5nIFhlbiBhbmQgYW0gdHJ5aW5nIHRvIGNvbWUgdXAgdG8gc3Bl ZWQuIMKgSSBhbQo+PiB0cnlpbmcgdG8gY29uZmlndXJlIGEgZGVza3RvcCBQQyB0byBib290IFhl biwgdGhlbiBwYXNzdGhyb3VnaCBWR0EsCj4+IEtleWJvYXJkLCBhbmQgTW91c2UgdG8gYSBWTSBm b3IgZGV2ZWxvcG1lbnQuIMKgSSBoYXZlIGEgV2luNyBEb21VCj4+IHdvcmtpbmcgYmVhdXRpZnVs bHkgd2l0aG91dCB0aGUgcGFzc3Rocm91Z2gsIHNvIEkgaGF2ZSB0aGUgYmFzaWNzCj4+IHdvcmtp bmcuCj4+IAo+PiBIZXJlIGlzIG15IGNvbmZpZ3VyYXRpb24gKHBsZWFzZSBsZXQgbWUga25vdyBp ZiBJIG1pc3NlZCBzb21ldGhpbmcKPj4gaW1wb3J0YW50KToKPj4gQVNVUyBQOVg3OSBQcm8gbW90 aGVyYm9hcmQsIGN1cnJlbnQgQklPUywgd2l0aCBWVC1EIGVuYWJsZWQuCj4+IEludGVsIEk3LTQ5 MzBLIHByb2Nlc3Nvcgo+PiAKPj4gSSBpbnN0YWxsZWQgQ2VudE9TIDYuNSBtaW5pbWFsIGZvciBE b20wLCBwbHVzIGEgY291cGxlIHBhY2thZ2VzIHRvCj4+IGdldCB0aGluZ3Mgd29ya2luZyAoZS5n LiwgUGVybCkuIMKgSSBoYXZlIHhlbmQgdHVybmVkIG9mZiBhbmQgSSBhbQo+PiB0cnlpbmcgdG8g ZG8gZXZlcnl0aGluZyB1c2luZyB0aGUgWEwgdG9vbGtpdC4KPj4gCj4+IEkgaGF2ZSBpbnN0YWxs ZWQgWGVuIDQuMi4zIHN0YWJsZSBhbmQgaGF2ZSBidWlsdCBhbmQgaW5zdGFsbGVkIHRoZQo+PiBj dXJyZW50IGhlYWQgZnJvbSBHSVQgKHBvc3QgNC4zLjEpIHdpdGggaWRlbnRpY2FsIHJlc3VsdHMu Cj4+IAo+PiBBZnRlciBzb21lIGRlYnVnZ2luZywgSSBiZWxpZXZlIGl0IGlzIGZhaWxpbmcgdG8g cGFyc2UgdGhlIEFDUEkKPj4gdGFibGUgKGFjcGlfZHJoZF91bml0cyBpcyBlbXB0eSBpbiBpbnRl bF92dGRfc2V0dXApIGFuZCBkaXNhYmxpbmcKPj4gSU9NTVUuCj4+IAo+PiBBbnkgdGlwcyBvbiBo b3cgdG8gcHJvY2VlZD8KPj4gCj4+IFRoYW5rcyEKPiAKPiBJIGp1c3Qgd2FudGVkIHRvIGZvbGxv dyB1cCBvbiBteSByZXNlYXJjaCBvbiBteSBpc3N1ZS4gwqBXaGF0IEkgZm91bmQKPiBpcyB0aGF0 IHRoZSBBU1VTIFA5WDc5IFBybyBtb3RoZXJib2FyZCBkb2VzICpub3QqIHN1cHBvcnQgVlQtZC4g wqBJdAo+IHN1cHBvcnRzICJWaXJ0dWFsaXphdGlvbiIgYnkgVmFuZGVycG9vbCAoYWthLiBWVC14 KS4gwqBMb29raW5nIGF0IHRoZQo+IEJJT1MgcmVsZWFzZXMgdGhleSBoYXZlIGhhZCwgdmVyc2lv biAwOTA2IGFkZGVkIHN1cHBvcnQgZm9yIFZULWQuCj4gQXBwYXJlbnRseSBhdCBzb21lIHBvaW50 IHRoZXkgZHJvcHBlZC9kaXNhYmxlZCBpdC4KPiAKPiBCdXQsIGhlcmUgaXMgdGhlIGxhc3QgcmVz cG9uc2UgSSByZWNlaXZlZCBmcm9tIEFTVVMsIEkgd2lsbCBjcm9zcyBteQo+IGZpbmdlcnMhISEK PiAKPj4gSSBoYXZlIGNoZWNrZWQgd2l0aCB0aGUgcmVsYXRpdmUgZGVwYXJ0bWVudCwgYW5kIHRo ZXkgbWVudGlvbmVkIGEKPj4gbmV3IGJpb3Mgd2lsbCBiZSByZWxlYXNlZCB0byBzb2x2ZSB0aGUg VlQtRCBvcHRpb24gbm90IGV4aXN0IGluIHRoZQo+PiBiaW9zIHdpdGggdGhlIEl2eSBicmlkZ2Ut RSBjcHUgaW5zdGFsbGVkLCBtYXkgYmUgaW4gb25lIG1vbnRoLgo+PiBQbGVhc2UgcGF5IGF0dGVu dGlvbiB0byBvdXIgd2Vic2l0ZSBmb3IgdXBkYXRpbmcuCj4+IFNvcnJ5IGZvciB0aGUgaW5jb252 ZW5pZW5jZS4KPj4gCj4+IEJlc3QgUmVnYXJkcywKPj4gQ2FydGVyCj4+IEFTVVMgUHJvZHVjdCBT dXBwb3J0IFRlYW0KCkkgaGFkIGEgc2ltaWxhciBleHByaWVuY2Ugd2l0aCB0aGUgQXN1cyBSYW1w YWdlIElWIEV4dHJlbWUgbW90aGVyYm9hcmQgCndpdGggYW4gSXZ5IEJyaWRnZS1FIENQVSwgYnV0 IEFzdXMgU3VwcG9ydCBjb3VsZG4ndCBjb25maXJtIHdoZXRoZXIgb3IgCm5vdCBWVC1kIHdhcyBi ZWluZyB3b3JrZWQgb24gb3Igbm90IGJ5IHRoZSBCSU9TIGVuZ2luZWVycy4KCkhlcmUncyB3aGF0 IHRoZXkgaGFkIHRvIHNheToKPiB3ZSBoYXZlIGhhZCB0YWxrcyB3aXRoIFImRCByZWdhcmRpbmcg dGhlIG1hdHRlciBtdWx0aXBsZSB0aW1lcyBidXQgaSAKPiBjYW50IHNheSBmb3Igc3VyZSBpZiBh bnl0aGluZyB3aWxsIGNvbWUgb3V0IG9mIHRoZW0uIEkgY2FudCBnZXQgYSBjbGVhciAKPiBhbnN3 ZXIgZnJvbSB0aGVtLgoKTHVja2lseSBJIHdhcyBhYmxlIHRvIGdldCBteSBoYW5kcyBvbiBhIGJl dGEgdmVyc2lvbiB0aHJvdWdoIHRoZSBST0cgCmZvcnVtcy4gQSB1c2VyIHRoZXJlIGhhZCBhY3F1 aXJlZCB0aGUgc2FtZSBtb3RoZXJib2FyZC9DUFUgdGhyb3VnaCBhIApzeXN0ZW0gbWFudWZhY3R1 cmVyIHdobyBpbiB0dXJuIGhhZCBmb3J3YXJkZWQgaGlzIHJlcXVlc3QgZm9yIFZULWQgdG8gCkFz dXMgZm9yIGhpbS4gSW4gcmVzcG9uc2UgQXN1cyBoYWQgcHJvdmlkZWQgdGhlIGJldGEgdmVyc2lv biBJIGVuZGVkIHVwIApnZXR0aW5nIG15IGhhbmRzIG9uLgoKSW4gdGhlaXIgY3VycmVudCBzdGF0 ZSBJIHdvdWxkbid0IHJlY29tbWVuZCBBc3VzIGJvYXJkcyB3aXRoIEl2eSAKQnJpZGdlLUUgQ1BV J3MuLi4KCkFsZXgKCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fClhlbi11c2VycyBtYWlsaW5nIGxpc3QKWGVuLXVzZXJzQGxpc3RzLnhlbi5vcmcKaHR0cDov L2xpc3RzLnhlbi5vcmcveGVuLXVzZXJz From xen-users-bounces@lists.xen.org Fri Dec 13 16:13:24 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 13 Dec 2013 16:13:24 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrVLp-0000w1-DE; Fri, 13 Dec 2013 16:12:29 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrVLo-0000vl-GP for xen-users@lists.xen.org; Fri, 13 Dec 2013 16:12:28 +0000 Received: from [85.158.137.68:5812] by server-17.bemta-3.messagelabs.com id D0/57-15965-BE13BA25; Fri, 13 Dec 2013 16:12:27 +0000 X-Env-Sender: lists@aewne.net X-Msg-Ref: server-6.tower-31.messagelabs.com!1386951145!3792755!1 X-Originating-IP: [109.247.116.8] X-SpamReason: No, hits=0.0 required=7.0 tests=SUBJECT_EXCESS_QP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 12858 invoked from network); 13 Dec 2013 16:12:25 -0000 Received: from asav21.altibox.net (HELO asav21.altibox.net) (109.247.116.8) by server-6.tower-31.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 13 Dec 2013 16:12:25 -0000 Received: from localhost (localhost [127.0.0.1]) by asav21.altibox.net (Postfix) with ESMTP id 292E780268 for ; Fri, 13 Dec 2013 17:12:25 +0100 (CET) Received: from asav21.altibox.net ([127.0.0.1]) by localhost (asav21.lysetele.net [127.0.0.1]) (amavisd-new, port 10024) with LMTP id tv-RwhNMakhC for ; Fri, 13 Dec 2013 17:12:24 +0100 (CET) Received: from mail.aewne.net (180.79-160-8.customer.lyse.net [79.160.8.180]) (using TLSv1 with cipher ADH-AES256-SHA (256/256 bits)) (No client certificate requested) by asav21.altibox.net (Postfix) with ESMTPS id 0B93E800E3 for ; Fri, 13 Dec 2013 17:12:23 +0100 (CET) Received: from localhost (180.79-160-8.customer.lyse.net [79.160.8.180]) by mail.aewne.net (Postfix) with ESMTPSA id 6DCA46041A for ; Fri, 13 Dec 2013 17:10:28 +0100 (CET) MIME-Version: 1.0 Date: Fri, 13 Dec 2013 17:10:28 +0100 From: Alex Aune To: xen-users@lists.xen.org In-Reply-To: References: Message-ID: X-Sender: lists@aewne.net User-Agent: Roundcube Webmail/0.9.2 Subject: Re: [Xen-users] =?utf-8?q?I/O_virtualisation_disabled_-_ACPI_issue=3F?= X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org T24gMTIuMTIuMjAxMyAwNTo0NywgSmFtaSBCcmFkbGV5IHdyb3RlOgo+IE9uIFdlZCwgRGVjIDQs IDIwMTMgYXQgNTowMCBBTSzCoEphbWkgQnJhZGxleQo+IDxicmFkbGV5ZmFtaWx5LmphbWlAZ21h aWwuY29tPsKgd3JvdGU6Cj4gCj4+IEZyb206wqBKYW1pIEJyYWRsZXkgPGJyYWRsZXlmYW1pbHku amFtaUBnbWFpbC5jb20+Cj4+IFRvOsKgeGVuLXVzZXJzQGxpc3RzLnhlbi5vcmcKPj4gQ2M6wqAK Pj4gRGF0ZTrCoFR1ZSwgMyBEZWMgMjAxMyAxODowMzozNiAtMDcwMAo+PiBTdWJqZWN0OsKgW1hl bi11c2Vyc10gSS9PIHZpcnR1YWxpc2F0aW9uIGRpc2FibGVkIC0gQUNQSSBpc3N1ZT8KPj4gCj4+ IEkganVzdCBzdGFydGVkIHVzaW5nIFhlbiBhbmQgYW0gdHJ5aW5nIHRvIGNvbWUgdXAgdG8gc3Bl ZWQuIMKgSSBhbQo+PiB0cnlpbmcgdG8gY29uZmlndXJlIGEgZGVza3RvcCBQQyB0byBib290IFhl biwgdGhlbiBwYXNzdGhyb3VnaCBWR0EsCj4+IEtleWJvYXJkLCBhbmQgTW91c2UgdG8gYSBWTSBm b3IgZGV2ZWxvcG1lbnQuIMKgSSBoYXZlIGEgV2luNyBEb21VCj4+IHdvcmtpbmcgYmVhdXRpZnVs bHkgd2l0aG91dCB0aGUgcGFzc3Rocm91Z2gsIHNvIEkgaGF2ZSB0aGUgYmFzaWNzCj4+IHdvcmtp bmcuCj4+IAo+PiBIZXJlIGlzIG15IGNvbmZpZ3VyYXRpb24gKHBsZWFzZSBsZXQgbWUga25vdyBp ZiBJIG1pc3NlZCBzb21ldGhpbmcKPj4gaW1wb3J0YW50KToKPj4gQVNVUyBQOVg3OSBQcm8gbW90 aGVyYm9hcmQsIGN1cnJlbnQgQklPUywgd2l0aCBWVC1EIGVuYWJsZWQuCj4+IEludGVsIEk3LTQ5 MzBLIHByb2Nlc3Nvcgo+PiAKPj4gSSBpbnN0YWxsZWQgQ2VudE9TIDYuNSBtaW5pbWFsIGZvciBE b20wLCBwbHVzIGEgY291cGxlIHBhY2thZ2VzIHRvCj4+IGdldCB0aGluZ3Mgd29ya2luZyAoZS5n LiwgUGVybCkuIMKgSSBoYXZlIHhlbmQgdHVybmVkIG9mZiBhbmQgSSBhbQo+PiB0cnlpbmcgdG8g ZG8gZXZlcnl0aGluZyB1c2luZyB0aGUgWEwgdG9vbGtpdC4KPj4gCj4+IEkgaGF2ZSBpbnN0YWxs ZWQgWGVuIDQuMi4zIHN0YWJsZSBhbmQgaGF2ZSBidWlsdCBhbmQgaW5zdGFsbGVkIHRoZQo+PiBj dXJyZW50IGhlYWQgZnJvbSBHSVQgKHBvc3QgNC4zLjEpIHdpdGggaWRlbnRpY2FsIHJlc3VsdHMu Cj4+IAo+PiBBZnRlciBzb21lIGRlYnVnZ2luZywgSSBiZWxpZXZlIGl0IGlzIGZhaWxpbmcgdG8g cGFyc2UgdGhlIEFDUEkKPj4gdGFibGUgKGFjcGlfZHJoZF91bml0cyBpcyBlbXB0eSBpbiBpbnRl bF92dGRfc2V0dXApIGFuZCBkaXNhYmxpbmcKPj4gSU9NTVUuCj4+IAo+PiBBbnkgdGlwcyBvbiBo b3cgdG8gcHJvY2VlZD8KPj4gCj4+IFRoYW5rcyEKPiAKPiBJIGp1c3Qgd2FudGVkIHRvIGZvbGxv dyB1cCBvbiBteSByZXNlYXJjaCBvbiBteSBpc3N1ZS4gwqBXaGF0IEkgZm91bmQKPiBpcyB0aGF0 IHRoZSBBU1VTIFA5WDc5IFBybyBtb3RoZXJib2FyZCBkb2VzICpub3QqIHN1cHBvcnQgVlQtZC4g wqBJdAo+IHN1cHBvcnRzICJWaXJ0dWFsaXphdGlvbiIgYnkgVmFuZGVycG9vbCAoYWthLiBWVC14 KS4gwqBMb29raW5nIGF0IHRoZQo+IEJJT1MgcmVsZWFzZXMgdGhleSBoYXZlIGhhZCwgdmVyc2lv biAwOTA2IGFkZGVkIHN1cHBvcnQgZm9yIFZULWQuCj4gQXBwYXJlbnRseSBhdCBzb21lIHBvaW50 IHRoZXkgZHJvcHBlZC9kaXNhYmxlZCBpdC4KPiAKPiBCdXQsIGhlcmUgaXMgdGhlIGxhc3QgcmVz cG9uc2UgSSByZWNlaXZlZCBmcm9tIEFTVVMsIEkgd2lsbCBjcm9zcyBteQo+IGZpbmdlcnMhISEK PiAKPj4gSSBoYXZlIGNoZWNrZWQgd2l0aCB0aGUgcmVsYXRpdmUgZGVwYXJ0bWVudCwgYW5kIHRo ZXkgbWVudGlvbmVkIGEKPj4gbmV3IGJpb3Mgd2lsbCBiZSByZWxlYXNlZCB0byBzb2x2ZSB0aGUg VlQtRCBvcHRpb24gbm90IGV4aXN0IGluIHRoZQo+PiBiaW9zIHdpdGggdGhlIEl2eSBicmlkZ2Ut RSBjcHUgaW5zdGFsbGVkLCBtYXkgYmUgaW4gb25lIG1vbnRoLgo+PiBQbGVhc2UgcGF5IGF0dGVu dGlvbiB0byBvdXIgd2Vic2l0ZSBmb3IgdXBkYXRpbmcuCj4+IFNvcnJ5IGZvciB0aGUgaW5jb252 ZW5pZW5jZS4KPj4gCj4+IEJlc3QgUmVnYXJkcywKPj4gQ2FydGVyCj4+IEFTVVMgUHJvZHVjdCBT dXBwb3J0IFRlYW0KCkkgaGFkIGEgc2ltaWxhciBleHByaWVuY2Ugd2l0aCB0aGUgQXN1cyBSYW1w YWdlIElWIEV4dHJlbWUgbW90aGVyYm9hcmQgCndpdGggYW4gSXZ5IEJyaWRnZS1FIENQVSwgYnV0 IEFzdXMgU3VwcG9ydCBjb3VsZG4ndCBjb25maXJtIHdoZXRoZXIgb3IgCm5vdCBWVC1kIHdhcyBi ZWluZyB3b3JrZWQgb24gb3Igbm90IGJ5IHRoZSBCSU9TIGVuZ2luZWVycy4KCkhlcmUncyB3aGF0 IHRoZXkgaGFkIHRvIHNheToKPiB3ZSBoYXZlIGhhZCB0YWxrcyB3aXRoIFImRCByZWdhcmRpbmcg dGhlIG1hdHRlciBtdWx0aXBsZSB0aW1lcyBidXQgaSAKPiBjYW50IHNheSBmb3Igc3VyZSBpZiBh bnl0aGluZyB3aWxsIGNvbWUgb3V0IG9mIHRoZW0uIEkgY2FudCBnZXQgYSBjbGVhciAKPiBhbnN3 ZXIgZnJvbSB0aGVtLgoKTHVja2lseSBJIHdhcyBhYmxlIHRvIGdldCBteSBoYW5kcyBvbiBhIGJl dGEgdmVyc2lvbiB0aHJvdWdoIHRoZSBST0cgCmZvcnVtcy4gQSB1c2VyIHRoZXJlIGhhZCBhY3F1 aXJlZCB0aGUgc2FtZSBtb3RoZXJib2FyZC9DUFUgdGhyb3VnaCBhIApzeXN0ZW0gbWFudWZhY3R1 cmVyIHdobyBpbiB0dXJuIGhhZCBmb3J3YXJkZWQgaGlzIHJlcXVlc3QgZm9yIFZULWQgdG8gCkFz dXMgZm9yIGhpbS4gSW4gcmVzcG9uc2UgQXN1cyBoYWQgcHJvdmlkZWQgdGhlIGJldGEgdmVyc2lv biBJIGVuZGVkIHVwIApnZXR0aW5nIG15IGhhbmRzIG9uLgoKSW4gdGhlaXIgY3VycmVudCBzdGF0 ZSBJIHdvdWxkbid0IHJlY29tbWVuZCBBc3VzIGJvYXJkcyB3aXRoIEl2eSAKQnJpZGdlLUUgQ1BV J3MuLi4KCkFsZXgKCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19f X19fClhlbi11c2VycyBtYWlsaW5nIGxpc3QKWGVuLXVzZXJzQGxpc3RzLnhlbi5vcmcKaHR0cDov L2xpc3RzLnhlbi5vcmcveGVuLXVzZXJz From xen-users-bounces@lists.xen.org Fri Dec 13 22:42:18 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 13 Dec 2013 22:42:18 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrbPo-0000TP-Pc; Fri, 13 Dec 2013 22:41:00 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrbPn-0000TK-34 for xen-users@lists.xen.org; Fri, 13 Dec 2013 22:40:59 +0000 Received: from [85.158.137.68:63094] by server-2.bemta-3.messagelabs.com id 04/8D-17329-AFC8BA25; Fri, 13 Dec 2013 22:40:58 +0000 X-Env-Sender: etzion@barnoy.co.il X-Msg-Ref: server-2.tower-31.messagelabs.com!1386974454!3841805!1 X-Originating-IP: [209.85.192.178] X-SpamReason: No, hits=1.2 required=7.0 tests=HTML_10_20,HTML_MESSAGE, RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11197 invoked from network); 13 Dec 2013 22:40:55 -0000 Received: from mail-pd0-f178.google.com (HELO mail-pd0-f178.google.com) (209.85.192.178) by server-2.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 13 Dec 2013 22:40:55 -0000 Received: by mail-pd0-f178.google.com with SMTP id y10so3043575pdj.23 for ; Fri, 13 Dec 2013 14:40:53 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to :content-type; bh=jAmVMyBtVqrCAvApr+2diCCMKti7TNkuOL6C07SeJG8=; b=gFkYiIgeaNdogLWXkluXKb2XIo7WUjSv4cUTnn1U2zNa1haf/uOon3etwNtOanS8Ic CL86FnLbPsyHKVePqIO2djzCHXu1CJXqsky1p1gCjQsg0MNHXfVMCNsR8kZLHuOoTQ73 243qQdab1cSjI3i1/pgG6abo0TOlzw/LpeOAyuYxFNA30FBD5kVfnwgq3pG46zDqZvXT rUsroc0DgRdcfbMwM47kWxRhtKjavgYCnjt0kUv5Y+SBHKc2vZwIeWAPF8mtj9KhDCHL yYKqRaHuxN9YZCsPhmtZVgMTqu9hai3LfjIubrltnnT/b6JF9J/mpokB0A6paEevkcBp JM/A== X-Gm-Message-State: ALoCoQkXZNU0XPvh2xTLDbmgIWiaiQ918aJ9R8HIl4u0axlGEsdbdi5p3lxIma2prT7WLSpdfV9b MIME-Version: 1.0 X-Received: by 10.68.172.196 with SMTP id be4mr6236498pbc.12.1386974453443; Fri, 13 Dec 2013 14:40:53 -0800 (PST) Received: by 10.66.147.166 with HTTP; Fri, 13 Dec 2013 14:40:53 -0800 (PST) X-Originating-IP: [85.64.43.73] Date: Sat, 14 Dec 2013 00:40:53 +0200 Message-ID: From: Etzion Bar-Noy To: xen-users@lists.xen.org Subject: [Xen-users] Nested virtualization instabilities X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============0181144092381069083==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============0181144092381069083== Content-Type: multipart/alternative; boundary=047d7b6786149c491404ed722730 --047d7b6786149c491404ed722730 Content-Type: text/plain; charset=ISO-8859-1 Hi. I am using the unstable build-from-source of Xen community. It reports as 4.4, and was pulled from Git two days ago. The problem I will describe below appears on version 4.3.1, compiled from source as well. In both cases - I used spec file to create my own RPMs, because it's the right method of doing it. Problem: When VM running under HVM which is a hypervisor (XenServer 6.2 or VMware ESXi5.5) attempts to start a (HVM) virtual machine, the following happens, 100% reproducible on this server. XenServer: domain crush. XenServer restarts itself. It doesn't happen for PV on XenServer VM VMware: An "unknown failure", which leads me to think that the nested virtualization properties are not forwarded correctly to DomU This is the configuration used for XS: name = "XenServer" uuid = "a0b8c668-afaf-887a-1f4b-856dac4c8401" maxmem = 4096 memory = 4096 vcpus = 2 builder = "hvm" boot = "c" pae = 1 acpi = 1 apic = 1 hap = 0 viridian = 0 rtc_timeoffset = 0 localtime = 0 on_poweroff = "destroy" on_reboot = "restart" on_crash = "restart" sdl = 0 vnc = 1 vncunused = 1 keymap = "en-us" disk = [ "tap2:aio:/dev/share/VMS/xenserver01.lun,hda,w", ",hdc:cdrom,r" ] vif = [ "mac=00:16:3e:14:0d:72,bridge=lan,script=vif-bridge,model=e1000" ] parallel = "none" serial = "pty" nestedhvm = 1 nx=1 # A note - this problem appears with and without the 'nx' flag. A snippet from strace to qemu process: poll([{fd=30, events=POLLIN|POLLERR|POLLHUP}, {fd=18, events=POLLIN|POLLERR|POLLHUP}, {fd=29, events=POLLIN|POLLERR|POLLHUP}, {fd=21, events=POLLIN|POLLERR|POLLHUP}, {fd=15, events=POLLIN|POLLERR|POLLHUP}, {fd=5, events= POLLIN|POLLERR|POLLHUP}, {fd=7, events=POLLIN}, {fd=11, events=POLLIN}, {fd=28, events=POLLIN}, {fd=6, events=POLLIN}], 10, 307) = ? ERESTART_RESTARTBLOCK (To be restarted) --- SIGHUP (Hangup) @ 0 (0) --- write(6, "\1\0\0\0\0\0\0\0", 8) = 8 rt_sigreturn(0x2) = -1 EINTR (Interrupted system call) gettimeofday({1386761621, 705266}, NULL) = 0 clock_gettime(CLOCK_MONOTONIC, {1840, 693236049}) = 0 clock_gettime(CLOCK_MONOTONIC, {1840, 693333096}) = 0 gettimeofday({1386761621, 705546}, NULL) = 0 write(2, "qemu: terminating on signal 1", 29) = 29 write(2, " from pid 6933\n", 15) = 15 >From the xl log for this domain: Waiting for domain XenServer (domid 5) to die [pid 6933] Domain 5 has shut down, reason code 3 0x3 Action for shutdown reason code 3 is restart Domain 5 needs to be cleaned up: destroying the domain Done. Rebooting now Waiting for domain XenServer (domid 6) to die [pid 6933] >From 'xl dmesg' (XEN) error code 7 (XEN) domain_crash_sync called from vmcs.c:1293 (XEN) Domain 8 (vcpu#0) crashed on cpu#4: (XEN) ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 4 (XEN) RIP: 0000:[<0000000000000000>] (XEN) RFLAGS: 0000000000000002 CONTEXT: hvm guest (XEN) rax: 0000000000000000 rbx: ffff830824f98000 rcx: ffff830824f9ff80 (XEN) rdx: ffff82d0801d0cf9 rsi: 0000000000000000 rdi: ffff82d0801de7fc (XEN) rbp: ffff82d080105ab1 rsp: 0000000000000000 r8: 0000000000000004 (XEN) r9: ffff82d080105b20 r10: ffff830824f9ff70 r11: 0000000000000000 (XEN) r12: ffff830824f9ff50 r13: ffff830654f9e000 r14: ffff830824f9ff30 (XEN) r15: ffff82d080187e43 cr0: 0000000000000039 cr4: 0000000000002050 (XEN) cr3: 00000000feffa000 cr2: 0000000000000000 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: 0000 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (d9) HVM Loader (d9) Detected Xen v4.4-unstable (d9) Xenbus rings @0xfeffc000, event channel 4 (d9) System requested SeaBIOS (d9) CPU speed is 3400 MHz (d9) Relocating guest memory for lowmem MMIO space disabled (XEN) irq.c:270: Dom9 PCI link 0 changed 0 -> 5 (d9) PCI-ISA link 0 routed to IRQ5 (XEN) irq.c:270: Dom9 PCI link 1 changed 0 -> 10 (d9) PCI-ISA link 1 routed to IRQ10 (XEN) irq.c:270: Dom9 PCI link 2 changed 0 -> 11 (d9) PCI-ISA link 2 routed to IRQ11 (XEN) irq.c:270: Dom9 PCI link 3 changed 0 -> 5 (d9) PCI-ISA link 3 routed to IRQ5 (d9) pci dev 01:3 INTA->IRQ10 (d9) pci dev 02:0 INTA->IRQ11 (d9) pci dev 04:0 INTA->IRQ5 (d9) RAM in high memory; setting high_mem resource base to 10f800000 (d9) pci dev 03:0 bar 10 size 002000000: 0f0000008 (d9) pci dev 02:0 bar 14 size 001000000: 0f2000008 (d9) pci dev 04:0 bar 30 size 000040000: 0f3000000 (d9) pci dev 04:0 bar 10 size 000020000: 0f3040000 (d9) pci dev 03:0 bar 30 size 000010000: 0f3060000 (d9) pci dev 03:0 bar 14 size 000001000: 0f3070000 (d9) pci dev 02:0 bar 10 size 000000100: 00000c001 (d9) pci dev 04:0 bar 14 size 000000040: 00000c101 (d9) pci dev 01:1 bar 20 size 000000010: 00000c141 (d9) Multiprocessor initialisation: (d9) - CPU0 ... 46-bit phys ... fixed MTRRs ... var MTRRs [2/8] ... done. (d9) - CPU1 ... 46-bit phys ... fixed MTRRs ... var MTRRs [2/8] ... done. (d9) Testing HVM environment: (d9) - REP INSB across page boundaries ... passed (d9) - GS base MSRs and SWAPGS ... passed (d9) Passed 2 of 2 tests (d9) Writing SMBIOS tables ... (d9) Loading SeaBIOS ... (d9) Creating MP tables ... (d9) Loading ACPI ... (d9) vm86 TSS at fc00a080 (d9) BIOS map: (d9) 10000-100d3: Scratch space (d9) e0000-fffff: Main BIOS (d9) E820 table: (d9) [00]: 00000000:00000000 - 00000000:000a0000: RAM (d9) HOLE: 00000000:000a0000 - 00000000:000e0000 (d9) [01]: 00000000:000e0000 - 00000000:00100000: RESERVED (d9) [02]: 00000000:00100000 - 00000000:f0000000: RAM (d9) HOLE: 00000000:f0000000 - 00000000:fc000000 (d9) [03]: 00000000:fc000000 - 00000001:00000000: RESERVED (d9) [04]: 00000001:00000000 - 00000001:0f800000: RAM (d9) Invoking SeaBIOS ... (d9) SeaBIOS (version rel-1.7.3.1-0-g7d9cbe6-20131211_100730-compilevm) (d9) (d9) Found Xen hypervisor signature at 40000000 (d9) xen: copy e820... (d9) Relocating init from 0x000e2e88 to 0xeffe1d80 (size 57784) (d9) CPU Mhz=3400 (d9) Found 7 PCI devices (max PCI bus is 00) (d9) Allocated Xen hypercall page at effff000 (d9) Detected Xen v4.4-unstable (d9) xen: copy BIOS tables... (d9) Copying SMBIOS entry point from 0x00010010 to 0x000f1020 (d9) Copying MPTABLE from 0xfc001170/fc001180 to 0x000f0f20 (d9) Copying PIR from 0x00010030 to 0x000f0ea0 (d9) Copying ACPI RSDP from 0x000100b0 to 0x000f0e70 (d9) Using pmtimer, ioport 0xb008, freq 3579 kHz (d9) Scan for VGA option rom (d9) WARNING! Found unaligned PCI rom (vd=1013:00b8) (d9) Running option rom at c000:0003 (XEN) stdvga.c:147:d9 entering stdvga and caching modes (d9) Turning on vga text mode console (d9) SeaBIOS (version rel-1.7.3.1-0-g7d9cbe6-20131211_100730-compilevm) (d9) Machine UUID a0b8c668-afaf-887a-1f4b-856dac4c8401 (d9) Found 0 lpt ports (d9) Found 1 serial ports (d9) ATA controller 1 at 1f0/3f4/c140 (irq 14 dev 9) (d9) ATA controller 2 at 170/374/c148 (irq 15 dev 9) (d9) ata0-0: QEMU HARDDISK ATA-7 Hard-Disk (14336 MiBytes) (d9) Searching bootorder for: /pci@i0cf8/*@1,1/drive@0/disk@0 (d9) DVD/CD [ata1-0: QEMU DVD-ROM ATAPI-4 DVD/CD] (d9) Searching bootorder for: /pci@i0cf8/*@1,1/drive@1/disk@0 (d9) PS2 keyboard initialized (d9) All threads complete. (d9) Scan for option roms (d9) Running option rom at c900:0003 (d9) pmm call arg1=1 (d9) pmm call arg1=0 (d9) pmm call arg1=1 (d9) pmm call arg1=0 (d9) Searching bootorder for: /pci@i0cf8/*@4 (d9) (d9) Press F12 for boot menu. (d9) (d9) Searching bootorder for: HALT (d9) drive 0x000f0e20: PCHS=16383/16/63 translation=lba LCHS=1024/255/63 s=29360128 (d9) Space available for UMB: ca000-ee800, f0000-f0dc0 (d9) Returned 61440 bytes of ZoneHigh (d9) e820 map has 7 items: (d9) 0: 0000000000000000 - 000000000009fc00 = 1 RAM (d9) 1: 000000000009fc00 - 00000000000a0000 = 2 RESERVED (d9) 2: 00000000000f0000 - 0000000000100000 = 2 RESERVED (d9) 3: 0000000000100000 - 00000000effff000 = 1 RAM (d9) 4: 00000000effff000 - 00000000f0000000 = 2 RESERVED (d9) 5: 00000000fc000000 - 0000000100000000 = 2 RESERVED (d9) 6: 0000000100000000 - 000000010f800000 = 1 RAM (d9) enter handle_19: (d9) NULL (d9) Booting from Hard Disk... (d9) Booting from 0000:7c00 [root@monster ~]# xl dmesg (XEN) error code 7 (XEN) domain_crash_sync called from vmcs.c:1293 (XEN) Domain 8 (vcpu#0) crashed on cpu#4: (XEN) ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 4 (XEN) RIP: 0000:[<0000000000000000>] (XEN) RFLAGS: 0000000000000002 CONTEXT: hvm guest (XEN) rax: 0000000000000000 rbx: ffff830824f98000 rcx: ffff830824f9ff80 (XEN) rdx: ffff82d0801d0cf9 rsi: 0000000000000000 rdi: ffff82d0801de7fc (XEN) rbp: ffff82d080105ab1 rsp: 0000000000000000 r8: 0000000000000004 (XEN) r9: ffff82d080105b20 r10: ffff830824f9ff70 r11: 0000000000000000 (XEN) r12: ffff830824f9ff50 r13: ffff830654f9e000 r14: ffff830824f9ff30 (XEN) r15: ffff82d080187e43 cr0: 0000000000000039 cr4: 0000000000002050 (XEN) cr3: 00000000feffa000 cr2: 0000000000000000 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: 0000 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (d9) HVM Loader (d9) Detected Xen v4.4-unstable (d9) Xenbus rings @0xfeffc000, event channel 4 (d9) System requested SeaBIOS (d9) CPU speed is 3400 MHz (d9) Relocating guest memory for lowmem MMIO space disabled (XEN) irq.c:270: Dom9 PCI link 0 changed 0 -> 5 (d9) PCI-ISA link 0 routed to IRQ5 (XEN) irq.c:270: Dom9 PCI link 1 changed 0 -> 10 (d9) PCI-ISA link 1 routed to IRQ10 (XEN) irq.c:270: Dom9 PCI link 2 changed 0 -> 11 (d9) PCI-ISA link 2 routed to IRQ11 (XEN) irq.c:270: Dom9 PCI link 3 changed 0 -> 5 (d9) PCI-ISA link 3 routed to IRQ5 (d9) pci dev 01:3 INTA->IRQ10 (d9) pci dev 02:0 INTA->IRQ11 (d9) pci dev 04:0 INTA->IRQ5 (d9) RAM in high memory; setting high_mem resource base to 10f800000 (d9) pci dev 03:0 bar 10 size 002000000: 0f0000008 (d9) pci dev 02:0 bar 14 size 001000000: 0f2000008 (d9) pci dev 04:0 bar 30 size 000040000: 0f3000000 (d9) pci dev 04:0 bar 10 size 000020000: 0f3040000 (d9) pci dev 03:0 bar 30 size 000010000: 0f3060000 (d9) pci dev 03:0 bar 14 size 000001000: 0f3070000 (d9) pci dev 02:0 bar 10 size 000000100: 00000c001 (d9) pci dev 04:0 bar 14 size 000000040: 00000c101 (d9) pci dev 01:1 bar 20 size 000000010: 00000c141 (d9) Multiprocessor initialisation: (d9) - CPU0 ... 46-bit phys ... fixed MTRRs ... var MTRRs [2/8] ... done. (d9) - CPU1 ... 46-bit phys ... fixed MTRRs ... var MTRRs [2/8] ... done. (d9) Testing HVM environment: (d9) - REP INSB across page boundaries ... passed (d9) - GS base MSRs and SWAPGS ... passed (d9) Passed 2 of 2 tests (d9) Writing SMBIOS tables ... (d9) Loading SeaBIOS ... (d9) Creating MP tables ... (d9) Loading ACPI ... (d9) vm86 TSS at fc00a080 (d9) BIOS map: (d9) 10000-100d3: Scratch space (d9) e0000-fffff: Main BIOS (d9) E820 table: (d9) [00]: 00000000:00000000 - 00000000:000a0000: RAM (d9) HOLE: 00000000:000a0000 - 00000000:000e0000 (d9) [01]: 00000000:000e0000 - 00000000:00100000: RESERVED (d9) [02]: 00000000:00100000 - 00000000:f0000000: RAM (d9) HOLE: 00000000:f0000000 - 00000000:fc000000 (d9) [03]: 00000000:fc000000 - 00000001:00000000: RESERVED (d9) [04]: 00000001:00000000 - 00000001:0f800000: RAM (d9) Invoking SeaBIOS ... (d9) SeaBIOS (version rel-1.7.3.1-0-g7d9cbe6-20131211_100730-compilevm) (d9) (d9) Found Xen hypervisor signature at 40000000 (d9) xen: copy e820... (d9) Relocating init from 0x000e2e88 to 0xeffe1d80 (size 57784) (d9) CPU Mhz=3400 (d9) Found 7 PCI devices (max PCI bus is 00) (d9) Allocated Xen hypercall page at effff000 (d9) Detected Xen v4.4-unstable (d9) xen: copy BIOS tables... (d9) Copying SMBIOS entry point from 0x00010010 to 0x000f1020 (d9) Copying MPTABLE from 0xfc001170/fc001180 to 0x000f0f20 (d9) Copying PIR from 0x00010030 to 0x000f0ea0 (d9) Copying ACPI RSDP from 0x000100b0 to 0x000f0e70 (d9) Using pmtimer, ioport 0xb008, freq 3579 kHz (d9) Scan for VGA option rom (d9) WARNING! Found unaligned PCI rom (vd=1013:00b8) (d9) Running option rom at c000:0003 (XEN) stdvga.c:147:d9 entering stdvga and caching modes (d9) Turning on vga text mode console (d9) SeaBIOS (version rel-1.7.3.1-0-g7d9cbe6-20131211_100730-compilevm) (d9) Machine UUID a0b8c668-afaf-887a-1f4b-856dac4c8401 (d9) Found 0 lpt ports (d9) Found 1 serial ports (d9) ATA controller 1 at 1f0/3f4/c140 (irq 14 dev 9) (d9) ATA controller 2 at 170/374/c148 (irq 15 dev 9) (d9) ata0-0: QEMU HARDDISK ATA-7 Hard-Disk (14336 MiBytes) (d9) Searching bootorder for: /pci@i0cf8/*@1,1/drive@0/disk@0 (d9) DVD/CD [ata1-0: QEMU DVD-ROM ATAPI-4 DVD/CD] (d9) Searching bootorder for: /pci@i0cf8/*@1,1/drive@1/disk@0 (d9) PS2 keyboard initialized (d9) All threads complete. (d9) Scan for option roms (d9) Running option rom at c900:0003 (d9) pmm call arg1=1 (d9) pmm call arg1=0 (d9) pmm call arg1=1 (d9) pmm call arg1=0 (d9) Searching bootorder for: /pci@i0cf8/*@4 (d9) (d9) Press F12 for boot menu. (d9) (d9) Searching bootorder for: HALT (d9) drive 0x000f0e20: PCHS=16383/16/63 translation=lba LCHS=1024/255/63 s=29360128 (d9) Space available for UMB: ca000-ee800, f0000-f0dc0 (d9) Returned 61440 bytes of ZoneHigh (d9) e820 map has 7 items: (d9) 0: 0000000000000000 - 000000000009fc00 = 1 RAM (d9) 1: 000000000009fc00 - 00000000000a0000 = 2 RESERVED (d9) 2: 00000000000f0000 - 0000000000100000 = 2 RESERVED (d9) 3: 0000000000100000 - 00000000effff000 = 1 RAM (d9) 4: 00000000effff000 - 00000000f0000000 = 2 RESERVED (d9) 5: 00000000fc000000 - 0000000100000000 = 2 RESERVED (d9) 6: 0000000100000000 - 000000010f800000 = 1 RAM (d9) enter handle_19: (d9) NULL (d9) Booting from Hard Disk... (d9) Booting from 0000:7c00 System description: 1. Centos 6.4 x86_64, latest updates 2. Xen4centos packages - current kernel is 3.10.23-11.el6.centos.alt.x86_64 3. System with 32GB RAM 4. Virtual disks are ZFS volumes (aka - block devices). Same problem appeared when on local ext3 disks 5. Using OpenVSwitch version 2.0, compiled to RPM, again. Any tip or advice would be great. Any request for further info would be also great! Thanks! Etzion --047d7b6786149c491404ed722730 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi.
I am using the unstable build-from-= source of Xen community. It reports as 4.4, and was pulled from Git two day= s ago. The problem I will describe below appears on version 4.3.1, compiled= from source as well. In both cases - I used spec file to create my own RPM= s, because it's the right method of doing it.

Problem: When VM running under HVM which is a hypervisor (XenServ= er 6.2 or VMware ESXi5.5) attempts to start a (HVM) virtual machine, the fo= llowing happens, 100% reproducible on this server.
XenServer: doma= in crush. XenServer restarts itself. It doesn't happen for PV on XenSer= ver VM
VMware: An "unknown failure", which leads me to think that = the nested virtualization properties are not forwarded correctly to DomU
This is the configuration used for XS:
name =3D "XenServ= er"
uuid =3D "a0b8c668-afaf-887a-1f4b-856dac4c8401"
maxmem =3D 409= 6
memory =3D 4096
vcpus =3D 2
builder =3D "hvm"
boot = =3D "c"
pae =3D 1
acpi =3D 1
apic =3D 1
hap =3D 0
= viridian =3D 0
rtc_timeoffset =3D 0
localtime =3D 0
on_poweroff =3D "destroy&qu= ot;
on_reboot =3D "restart"
on_crash =3D "restart"= ;
sdl =3D 0
vnc =3D 1
vncunused =3D 1
keymap =3D "en-us&qu= ot;
disk =3D [ "tap2:aio:/dev/share/VMS/xenserver01.lun,hda,w"= , ",hdc:cdrom,r" ]
vif =3D [ "mac=3D00:16:3e:14:0d:72,bridge=3Dlan,script=3Dvif-bridge,mo= del=3De1000" ]
parallel =3D "none"
serial =3D "pt= y"
nestedhvm =3D 1
nx=3D1

# A note - this pro= blem appears with and without the 'nx' flag.
A snippet from strace to qemu process:

poll([{fd=3D30, events= =3DPOLLIN|POLLERR|POLLHUP}, {fd=3D18, events=3DPOLLIN|POLLERR|POLLHUP}, {fd= =3D29, events=3DPOLLIN|POLLERR|POLLHUP}, {fd=3D21,
events=3DPOLLIN|POLL= ERR|POLLHUP}, {fd=3D15, events=3DPOLLIN|POLLERR|POLLHUP}, {fd=3D5, events= =3D
POLLIN|POLLERR|POLLHUP}, {fd=3D7, events=3DPOLLIN}, {fd=3D11, events=3DPOLL= IN}, {fd=3D28, events=3DPOLLIN}, {fd=3D6, events=3DPOLLIN}], 10, 307) =3D ?= ERESTART_RESTARTBLOCK (To be restarted)
--- SIGHUP (Hangup) @ 0 (0) ---=
write(6, "\1\0\0\0\0\0\0\0", 8)=A0=A0=A0=A0=A0=A0=A0=A0 =3D 8=
rt_sigreturn(0x2)=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0 =3D -1 EINTR (Interrupted system call)
gettimeofday({138676162= 1, 705266}, NULL) =3D 0
clock_gettime(CLOCK_MONOTONIC, {1840, 693236049}= ) =3D 0
clock_gettime(CLOCK_MONOTONIC, {1840, 693333096}) =3D 0
gettimeofday({1386761621, 705546}, NULL) =3D 0
write(2, "qemu: term= inating on signal 1", 29) =3D 29
write(2, " from pid 6933\n&qu= ot;, 15)=A0=A0=A0=A0=A0=A0=A0 =3D 15

From the xl log for this = domain:
Waiting for domain XenServer (domid 5) to die [pid 6933]
Domain 5 has shut down, reason code 3 0x3
Action for shutdown reason cod= e 3 is restart
Domain 5 needs to be cleaned up: destroying the domainDone. Rebooting now
Waiting for domain XenServer (domid 6) to die [pid = 6933]

From 'xl dmesg'
(XEN) <vm_launch_fail> error cod= e 7
(XEN) domain_crash_sync called from vmcs.c:1293
(XEN) Domain 8 (v= cpu#0) crashed on cpu#4:
(XEN) ----[ Xen-4.4-unstable=A0 x86_64=A0 debug= =3Dy=A0 Not tainted ]----
(XEN) CPU:=A0=A0=A0 4
(XEN) RIP:=A0=A0=A0 0000:[<0000000000000000>= ]
(XEN) RFLAGS: 0000000000000002=A0=A0 CONTEXT: hvm guest
(XEN) rax: = 0000000000000000=A0=A0 rbx: ffff830824f98000=A0=A0 rcx: ffff830824f9ff80(XEN) rdx: ffff82d0801d0cf9=A0=A0 rsi: 0000000000000000=A0=A0 rdi: ffff82d= 0801de7fc
(XEN) rbp: ffff82d080105ab1=A0=A0 rsp: 0000000000000000=A0=A0 r8:=A0 000000= 0000000004
(XEN) r9:=A0 ffff82d080105b20=A0=A0 r10: ffff830824f9ff70=A0= =A0 r11: 0000000000000000
(XEN) r12: ffff830824f9ff50=A0=A0 r13: ffff830= 654f9e000=A0=A0 r14: ffff830824f9ff30
(XEN) r15: ffff82d080187e43=A0=A0 cr0: 0000000000000039=A0=A0 cr4: 00000000= 00002050
(XEN) cr3: 00000000feffa000=A0=A0 cr2: 0000000000000000
(XEN= ) ds: 0000=A0=A0 es: 0000=A0=A0 fs: 0000=A0=A0 gs: 0000=A0=A0 ss: 0000=A0= =A0 cs: 0000
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, er= ror -22
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN)= event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) even= t_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_cha= nnel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN)= event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) even= t_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_cha= nnel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN)= event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) even= t_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(d9) HVM Loader=
(d9) Detected Xen v4.4-unstable
(d9) Xenbus rings @0xfeffc000, event cha= nnel 4
(d9) System requested SeaBIOS
(d9) CPU speed is 3400 MHz
(d= 9) Relocating guest memory for lowmem MMIO space disabled
(XEN) irq.c:27= 0: Dom9 PCI link 0 changed 0 -> 5
(d9) PCI-ISA link 0 routed to IRQ5
(XEN) irq.c:270: Dom9 PCI link 1 chan= ged 0 -> 10
(d9) PCI-ISA link 1 routed to IRQ10
(XEN) irq.c:270: D= om9 PCI link 2 changed 0 -> 11
(d9) PCI-ISA link 2 routed to IRQ11 (XEN) irq.c:270: Dom9 PCI link 3 changed 0 -> 5
(d9) PCI-ISA link 3 r= outed to IRQ5
(d9) pci dev 01:3 INTA->IRQ10
(d9) pci dev 02:0 INTA= ->IRQ11
(d9) pci dev 04:0 INTA->IRQ5
(d9) RAM in high memory; s= etting high_mem resource base to 10f800000
(d9) pci dev 03:0 bar 10 size 002000000: 0f0000008
(d9) pci dev 02:0 bar= 14 size 001000000: 0f2000008
(d9) pci dev 04:0 bar 30 size 000040000: 0= f3000000
(d9) pci dev 04:0 bar 10 size 000020000: 0f3040000
(d9) pci = dev 03:0 bar 30 size 000010000: 0f3060000
(d9) pci dev 03:0 bar 14 size 000001000: 0f3070000
(d9) pci dev 02:0 bar= 10 size 000000100: 00000c001
(d9) pci dev 04:0 bar 14 size 000000040: 0= 0000c101
(d9) pci dev 01:1 bar 20 size 000000010: 00000c141
(d9) Mult= iprocessor initialisation:
(d9)=A0 - CPU0 ... 46-bit phys ... fixed MTRRs ... var MTRRs [2/8] ... done= .
(d9)=A0 - CPU1 ... 46-bit phys ... fixed MTRRs ... var MTRRs [2/8] ...= done.
(d9) Testing HVM environment:
(d9)=A0 - REP INSB across page b= oundaries ... passed
(d9)=A0 - GS base MSRs and SWAPGS ... passed
(d9) Passed 2 of 2 tests(d9) Writing SMBIOS tables ...
(d9) Loading SeaBIOS ...
(d9) Creatin= g MP tables ...
(d9) Loading ACPI ...
(d9) vm86 TSS at fc00a080
(d9) BIOS map:
(d9)=A0 10000-100d3: Scratch space
(d9)=A0 e0000-fffff= : Main BIOS
(d9) E820 table:
(d9)=A0 [00]: 00000000:00000000 - 000000= 00:000a0000: RAM
(d9)=A0 HOLE: 00000000:000a0000 - 00000000:000e0000
= (d9)=A0 [01]: 00000000:000e0000 - 00000000:00100000: RESERVED
(d9)=A0 [02]: 00000000:00100000 - 00000000:f0000000: RAM
(d9)=A0 HOLE: 0= 0000000:f0000000 - 00000000:fc000000
(d9)=A0 [03]: 00000000:fc000000 - 0= 0000001:00000000: RESERVED
(d9)=A0 [04]: 00000001:00000000 - 00000001:0f= 800000: RAM
(d9) Invoking SeaBIOS ...
(d9) SeaBIOS (version rel-1.7.3.1-0-g7d9cbe6-2= 0131211_100730-compilevm)
(d9)
(d9) Found Xen hypervisor signature a= t 40000000
(d9) xen: copy e820...
(d9) Relocating init from 0x000e2e8= 8 to 0xeffe1d80 (size 57784)
(d9) CPU Mhz=3D3400
(d9) Found 7 PCI devices (max PCI bus is 00)
(d9)= Allocated Xen hypercall page at effff000
(d9) Detected Xen v4.4-unstabl= e
(d9) xen: copy BIOS tables...
(d9) Copying SMBIOS entry point from = 0x00010010 to 0x000f1020
(d9) Copying MPTABLE from 0xfc001170/fc001180 to 0x000f0f20
(d9) Copying= PIR from 0x00010030 to 0x000f0ea0
(d9) Copying ACPI RSDP from 0x000100b= 0 to 0x000f0e70
(d9) Using pmtimer, ioport 0xb008, freq 3579 kHz
(d9) Scan for VGA option rom
(d9) WARNING! Found unaligned PCI rom (vd= =3D1013:00b8)
(d9) Running option rom at c000:0003
(XEN) stdvga.c:147= :d9 entering stdvga and caching modes
(d9) Turning on vga text mode cons= ole
(d9) SeaBIOS (version rel-1.7.3.1-0-g7d9cbe6-20131211_100730-compilevm)
= (d9) Machine UUID a0b8c668-afaf-887a-1f4b-856dac4c8401
(d9) Found 0 lpt = ports
(d9) Found 1 serial ports
(d9) ATA controller 1 at 1f0/3f4/c140= (irq 14 dev 9)
(d9) ATA controller 2 at 170/374/c148 (irq 15 dev 9)
(d9) ata0-0: QEMU H= ARDDISK ATA-7 Hard-Disk (14336 MiBytes)
(d9) Searching bootorder for: /p= ci@i0cf8/*@1,1/drive@0/disk@0
(d9) DVD/CD [ata1-0: QEMU DVD-ROM ATAPI-4 = DVD/CD]
(d9) Searching bootorder for: /pci@i0cf8/*@1,1/drive@1/disk@0
(d9) PS2 k= eyboard initialized
(d9) All threads complete.
(d9) Scan for option r= oms
(d9) Running option rom at c900:0003
(d9) pmm call arg1=3D1
(d9) pmm call arg1=3D0
(d9) pmm call arg1=3D1
(d9) pmm call arg1=3D0<= br>(d9) Searching bootorder for: /pci@i0cf8/*@4
(d9)
(d9) Press F12 = for boot menu.
(d9)
(d9) Searching bootorder for: HALT
(d9) drive= 0x000f0e20: PCHS=3D16383/16/63 translation=3Dlba LCHS=3D1024/255/63 s=3D29= 360128
(d9) Space available for UMB: ca000-ee800, f0000-f0dc0
(d9) Returned 614= 40 bytes of ZoneHigh
(d9) e820 map has 7 items:
(d9)=A0=A0 0: 0000000= 000000000 - 000000000009fc00 =3D 1 RAM
(d9)=A0=A0 1: 000000000009fc00 - = 00000000000a0000 =3D 2 RESERVED
(d9)=A0=A0 2: 00000000000f0000 - 0000000000100000 =3D 2 RESERVED
(d9)=A0= =A0 3: 0000000000100000 - 00000000effff000 =3D 1 RAM
(d9)=A0=A0 4: 00000= 000effff000 - 00000000f0000000 =3D 2 RESERVED
(d9)=A0=A0 5: 00000000fc00= 0000 - 0000000100000000 =3D 2 RESERVED
(d9)=A0=A0 6: 0000000100000000 - 000000010f800000 =3D 1 RAM
(d9) enter h= andle_19:
(d9)=A0=A0 NULL
(d9) Booting from Hard Disk...
(d9) Boot= ing from 0000:7c00
[root@monster ~]# xl dmesg
(XEN) <vm_launch_fa= il> error code 7
(XEN) domain_crash_sync called from vmcs.c:1293
(XEN) Domain 8 (vcpu#0) = crashed on cpu#4:
(XEN) ----[ Xen-4.4-unstable=A0 x86_64=A0 debug=3Dy=A0= Not tainted ]----
(XEN) CPU:=A0=A0=A0 4
(XEN) RIP:=A0=A0=A0 0000:[&l= t;0000000000000000>]
(XEN) RFLAGS: 0000000000000002=A0=A0 CONTEXT: hvm guest
(XEN) rax: 00000= 00000000000=A0=A0 rbx: ffff830824f98000=A0=A0 rcx: ffff830824f9ff80
(XEN= ) rdx: ffff82d0801d0cf9=A0=A0 rsi: 0000000000000000=A0=A0 rdi: ffff82d0801d= e7fc
(XEN) rbp: ffff82d080105ab1=A0=A0 rsp: 0000000000000000=A0=A0 r8:= =A0 0000000000000004
(XEN) r9:=A0 ffff82d080105b20=A0=A0 r10: ffff830824f9ff70=A0=A0 r11: 000000= 0000000000
(XEN) r12: ffff830824f9ff50=A0=A0 r13: ffff830654f9e000=A0=A0= r14: ffff830824f9ff30
(XEN) r15: ffff82d080187e43=A0=A0 cr0: 0000000000= 000039=A0=A0 cr4: 0000000000002050
(XEN) cr3: 00000000feffa000=A0=A0 cr2: 0000000000000000
(XEN) ds: 0000= =A0=A0 es: 0000=A0=A0 fs: 0000=A0=A0 gs: 0000=A0=A0 ss: 0000=A0=A0 cs: 0000=
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(= XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN)= event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) even= t_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_cha= nnel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN)= event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) even= t_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_cha= nnel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN)= event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(d9) HVM L= oader
(d9) Detected Xen v4.4-unstable
(d9) Xenbus rings @0xfeffc000, = event channel 4
(d9) System requested SeaBIOS
(d9) CPU speed is 3400 MHz
(d9) Relocat= ing guest memory for lowmem MMIO space disabled
(XEN) irq.c:270: Dom9 PC= I link 0 changed 0 -> 5
(d9) PCI-ISA link 0 routed to IRQ5
(XEN) i= rq.c:270: Dom9 PCI link 1 changed 0 -> 10
(d9) PCI-ISA link 1 routed to IRQ10
(XEN) irq.c:270: Dom9 PCI link 2 cha= nged 0 -> 11
(d9) PCI-ISA link 2 routed to IRQ11
(XEN) irq.c:270: = Dom9 PCI link 3 changed 0 -> 5
(d9) PCI-ISA link 3 routed to IRQ5
(d9) pci dev 01:3 INTA->IRQ10
(d9) pci dev 02:0 INTA->IRQ11
(d9= ) pci dev 04:0 INTA->IRQ5
(d9) RAM in high memory; setting high_mem r= esource base to 10f800000
(d9) pci dev 03:0 bar 10 size 002000000: 0f000= 0008
(d9) pci dev 02:0 bar 14 size 001000000: 0f2000008
(d9) pci dev 04:0 bar= 30 size 000040000: 0f3000000
(d9) pci dev 04:0 bar 10 size 000020000: 0= f3040000
(d9) pci dev 03:0 bar 30 size 000010000: 0f3060000
(d9) pci = dev 03:0 bar 14 size 000001000: 0f3070000
(d9) pci dev 02:0 bar 10 size 000000100: 00000c001
(d9) pci dev 04:0 bar= 14 size 000000040: 00000c101
(d9) pci dev 01:1 bar 20 size 000000010: 0= 0000c141
(d9) Multiprocessor initialisation:
(d9)=A0 - CPU0 ... 46-bi= t phys ... fixed MTRRs ... var MTRRs [2/8] ... done.
(d9)=A0 - CPU1 ... 46-bit phys ... fixed MTRRs ... var MTRRs [2/8] ... done= .
(d9) Testing HVM environment:
(d9)=A0 - REP INSB across page bounda= ries ... passed
(d9)=A0 - GS base MSRs and SWAPGS ... passed
(d9) Pas= sed 2 of 2 tests
(d9) Writing SMBIOS tables ...
(d9) Loading SeaBIOS ...
(d9) Creating= MP tables ...
(d9) Loading ACPI ...
(d9) vm86 TSS at fc00a080
(d9= ) BIOS map:
(d9)=A0 10000-100d3: Scratch space
(d9)=A0 e0000-fffff: M= ain BIOS
(d9) E820 table:
(d9)=A0 [00]: 00000000:00000000 - 00000000:000a0000: RA= M
(d9)=A0 HOLE: 00000000:000a0000 - 00000000:000e0000
(d9)=A0 [01]: 0= 0000000:000e0000 - 00000000:00100000: RESERVED
(d9)=A0 [02]: 00000000:00= 100000 - 00000000:f0000000: RAM
(d9)=A0 HOLE: 00000000:f0000000 - 00000000:fc000000
(d9)=A0 [03]: 000000= 00:fc000000 - 00000001:00000000: RESERVED
(d9)=A0 [04]: 00000001:0000000= 0 - 00000001:0f800000: RAM
(d9) Invoking SeaBIOS ...
(d9) SeaBIOS (ve= rsion rel-1.7.3.1-0-g7d9cbe6-20131211_100730-compilevm)
(d9)
(d9) Found Xen hypervisor signature at 40000000
(d9) xen: copy = e820...
(d9) Relocating init from 0x000e2e88 to 0xeffe1d80 (size 57784)<= br>(d9) CPU Mhz=3D3400
(d9) Found 7 PCI devices (max PCI bus is 00)
(d9) Allocated Xen hypercall page at effff000
(d9) Detected Xen v4.4-uns= table
(d9) xen: copy BIOS tables...
(d9) Copying SMBIOS entry point f= rom 0x00010010 to 0x000f1020
(d9) Copying MPTABLE from 0xfc001170/fc0011= 80 to 0x000f0f20
(d9) Copying PIR from 0x00010030 to 0x000f0ea0
(d9) Copying ACPI RSDP fr= om 0x000100b0 to 0x000f0e70
(d9) Using pmtimer, ioport 0xb008, freq 3579= kHz
(d9) Scan for VGA option rom
(d9) WARNING! Found unaligned PCI r= om (vd=3D1013:00b8)
(d9) Running option rom at c000:0003
(XEN) stdvga.c:147:d9 entering stdv= ga and caching modes
(d9) Turning on vga text mode console
(d9) SeaBI= OS (version rel-1.7.3.1-0-g7d9cbe6-20131211_100730-compilevm)
(d9) Machi= ne UUID a0b8c668-afaf-887a-1f4b-856dac4c8401
(d9) Found 0 lpt ports
(d9) Found 1 serial ports
(d9) ATA controller = 1 at 1f0/3f4/c140 (irq 14 dev 9)
(d9) ATA controller 2 at 170/374/c148 (= irq 15 dev 9)
(d9) ata0-0: QEMU HARDDISK ATA-7 Hard-Disk (14336 MiBytes)=
(d9) Searching bootorder for: /pci@i0cf8/*@1,1/drive@0/disk@0
(d9) DVD/C= D [ata1-0: QEMU DVD-ROM ATAPI-4 DVD/CD]
(d9) Searching bootorder for: /p= ci@i0cf8/*@1,1/drive@1/disk@0
(d9) PS2 keyboard initialized
(d9) All = threads complete.
(d9) Scan for option roms
(d9) Running option rom at c900:0003
(d9) p= mm call arg1=3D1
(d9) pmm call arg1=3D0
(d9) pmm call arg1=3D1
(d9= ) pmm call arg1=3D0
(d9) Searching bootorder for: /pci@i0cf8/*@4
(d9)=
(d9) Press F12 for boot menu.
(d9)
(d9) Searching bootorder for: HAL= T
(d9) drive 0x000f0e20: PCHS=3D16383/16/63 translation=3Dlba LCHS=3D102= 4/255/63 s=3D29360128
(d9) Space available for UMB: ca000-ee800, f0000-f= 0dc0
(d9) Returned 61440 bytes of ZoneHigh
(d9) e820 map has 7 items:
(d9)= =A0=A0 0: 0000000000000000 - 000000000009fc00 =3D 1 RAM
(d9)=A0=A0 1: 00= 0000000009fc00 - 00000000000a0000 =3D 2 RESERVED
(d9)=A0=A0 2: 000000000= 00f0000 - 0000000000100000 =3D 2 RESERVED
(d9)=A0=A0 3: 0000000000100000 - 00000000effff000 =3D 1 RAM
(d9)=A0=A0 4= : 00000000effff000 - 00000000f0000000 =3D 2 RESERVED
(d9)=A0=A0 5: 00000= 000fc000000 - 0000000100000000 =3D 2 RESERVED
(d9)=A0=A0 6: 000000010000= 0000 - 000000010f800000 =3D 1 RAM
(d9) enter handle_19:
(d9)=A0=A0 NULL
(d9) Booting from Hard Disk...<= br>(d9) Booting from 0000:7c00

System description:
1.= Centos 6.4 x86_64, latest updates
2. Xen4centos packages - curren= t kernel is 3.10.23-11.el6.centos.alt.x86_64
3. System with 32GB RAM
4. Virtual disks are ZFS volumes (ak= a - block devices). Same problem appeared when on local ext3 disks
5. Using OpenVSwitch version 2.0, compiled to RPM, again.

Any tip or advice would be great. Any request for further info would be als= o great!

Thanks!
Etzion



--047d7b6786149c491404ed722730-- --===============0181144092381069083== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============0181144092381069083==-- From xen-users-bounces@lists.xen.org Fri Dec 13 22:42:18 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 13 Dec 2013 22:42:18 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrbPo-0000TP-Pc; Fri, 13 Dec 2013 22:41:00 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VrbPn-0000TK-34 for xen-users@lists.xen.org; Fri, 13 Dec 2013 22:40:59 +0000 Received: from [85.158.137.68:63094] by server-2.bemta-3.messagelabs.com id 04/8D-17329-AFC8BA25; Fri, 13 Dec 2013 22:40:58 +0000 X-Env-Sender: etzion@barnoy.co.il X-Msg-Ref: server-2.tower-31.messagelabs.com!1386974454!3841805!1 X-Originating-IP: [209.85.192.178] X-SpamReason: No, hits=1.2 required=7.0 tests=HTML_10_20,HTML_MESSAGE, RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11197 invoked from network); 13 Dec 2013 22:40:55 -0000 Received: from mail-pd0-f178.google.com (HELO mail-pd0-f178.google.com) (209.85.192.178) by server-2.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 13 Dec 2013 22:40:55 -0000 Received: by mail-pd0-f178.google.com with SMTP id y10so3043575pdj.23 for ; Fri, 13 Dec 2013 14:40:53 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to :content-type; bh=jAmVMyBtVqrCAvApr+2diCCMKti7TNkuOL6C07SeJG8=; b=gFkYiIgeaNdogLWXkluXKb2XIo7WUjSv4cUTnn1U2zNa1haf/uOon3etwNtOanS8Ic CL86FnLbPsyHKVePqIO2djzCHXu1CJXqsky1p1gCjQsg0MNHXfVMCNsR8kZLHuOoTQ73 243qQdab1cSjI3i1/pgG6abo0TOlzw/LpeOAyuYxFNA30FBD5kVfnwgq3pG46zDqZvXT rUsroc0DgRdcfbMwM47kWxRhtKjavgYCnjt0kUv5Y+SBHKc2vZwIeWAPF8mtj9KhDCHL yYKqRaHuxN9YZCsPhmtZVgMTqu9hai3LfjIubrltnnT/b6JF9J/mpokB0A6paEevkcBp JM/A== X-Gm-Message-State: ALoCoQkXZNU0XPvh2xTLDbmgIWiaiQ918aJ9R8HIl4u0axlGEsdbdi5p3lxIma2prT7WLSpdfV9b MIME-Version: 1.0 X-Received: by 10.68.172.196 with SMTP id be4mr6236498pbc.12.1386974453443; Fri, 13 Dec 2013 14:40:53 -0800 (PST) Received: by 10.66.147.166 with HTTP; Fri, 13 Dec 2013 14:40:53 -0800 (PST) X-Originating-IP: [85.64.43.73] Date: Sat, 14 Dec 2013 00:40:53 +0200 Message-ID: From: Etzion Bar-Noy To: xen-users@lists.xen.org Subject: [Xen-users] Nested virtualization instabilities X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============0181144092381069083==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============0181144092381069083== Content-Type: multipart/alternative; boundary=047d7b6786149c491404ed722730 --047d7b6786149c491404ed722730 Content-Type: text/plain; charset=ISO-8859-1 Hi. I am using the unstable build-from-source of Xen community. It reports as 4.4, and was pulled from Git two days ago. The problem I will describe below appears on version 4.3.1, compiled from source as well. In both cases - I used spec file to create my own RPMs, because it's the right method of doing it. Problem: When VM running under HVM which is a hypervisor (XenServer 6.2 or VMware ESXi5.5) attempts to start a (HVM) virtual machine, the following happens, 100% reproducible on this server. XenServer: domain crush. XenServer restarts itself. It doesn't happen for PV on XenServer VM VMware: An "unknown failure", which leads me to think that the nested virtualization properties are not forwarded correctly to DomU This is the configuration used for XS: name = "XenServer" uuid = "a0b8c668-afaf-887a-1f4b-856dac4c8401" maxmem = 4096 memory = 4096 vcpus = 2 builder = "hvm" boot = "c" pae = 1 acpi = 1 apic = 1 hap = 0 viridian = 0 rtc_timeoffset = 0 localtime = 0 on_poweroff = "destroy" on_reboot = "restart" on_crash = "restart" sdl = 0 vnc = 1 vncunused = 1 keymap = "en-us" disk = [ "tap2:aio:/dev/share/VMS/xenserver01.lun,hda,w", ",hdc:cdrom,r" ] vif = [ "mac=00:16:3e:14:0d:72,bridge=lan,script=vif-bridge,model=e1000" ] parallel = "none" serial = "pty" nestedhvm = 1 nx=1 # A note - this problem appears with and without the 'nx' flag. A snippet from strace to qemu process: poll([{fd=30, events=POLLIN|POLLERR|POLLHUP}, {fd=18, events=POLLIN|POLLERR|POLLHUP}, {fd=29, events=POLLIN|POLLERR|POLLHUP}, {fd=21, events=POLLIN|POLLERR|POLLHUP}, {fd=15, events=POLLIN|POLLERR|POLLHUP}, {fd=5, events= POLLIN|POLLERR|POLLHUP}, {fd=7, events=POLLIN}, {fd=11, events=POLLIN}, {fd=28, events=POLLIN}, {fd=6, events=POLLIN}], 10, 307) = ? ERESTART_RESTARTBLOCK (To be restarted) --- SIGHUP (Hangup) @ 0 (0) --- write(6, "\1\0\0\0\0\0\0\0", 8) = 8 rt_sigreturn(0x2) = -1 EINTR (Interrupted system call) gettimeofday({1386761621, 705266}, NULL) = 0 clock_gettime(CLOCK_MONOTONIC, {1840, 693236049}) = 0 clock_gettime(CLOCK_MONOTONIC, {1840, 693333096}) = 0 gettimeofday({1386761621, 705546}, NULL) = 0 write(2, "qemu: terminating on signal 1", 29) = 29 write(2, " from pid 6933\n", 15) = 15 >From the xl log for this domain: Waiting for domain XenServer (domid 5) to die [pid 6933] Domain 5 has shut down, reason code 3 0x3 Action for shutdown reason code 3 is restart Domain 5 needs to be cleaned up: destroying the domain Done. Rebooting now Waiting for domain XenServer (domid 6) to die [pid 6933] >From 'xl dmesg' (XEN) error code 7 (XEN) domain_crash_sync called from vmcs.c:1293 (XEN) Domain 8 (vcpu#0) crashed on cpu#4: (XEN) ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 4 (XEN) RIP: 0000:[<0000000000000000>] (XEN) RFLAGS: 0000000000000002 CONTEXT: hvm guest (XEN) rax: 0000000000000000 rbx: ffff830824f98000 rcx: ffff830824f9ff80 (XEN) rdx: ffff82d0801d0cf9 rsi: 0000000000000000 rdi: ffff82d0801de7fc (XEN) rbp: ffff82d080105ab1 rsp: 0000000000000000 r8: 0000000000000004 (XEN) r9: ffff82d080105b20 r10: ffff830824f9ff70 r11: 0000000000000000 (XEN) r12: ffff830824f9ff50 r13: ffff830654f9e000 r14: ffff830824f9ff30 (XEN) r15: ffff82d080187e43 cr0: 0000000000000039 cr4: 0000000000002050 (XEN) cr3: 00000000feffa000 cr2: 0000000000000000 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: 0000 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (d9) HVM Loader (d9) Detected Xen v4.4-unstable (d9) Xenbus rings @0xfeffc000, event channel 4 (d9) System requested SeaBIOS (d9) CPU speed is 3400 MHz (d9) Relocating guest memory for lowmem MMIO space disabled (XEN) irq.c:270: Dom9 PCI link 0 changed 0 -> 5 (d9) PCI-ISA link 0 routed to IRQ5 (XEN) irq.c:270: Dom9 PCI link 1 changed 0 -> 10 (d9) PCI-ISA link 1 routed to IRQ10 (XEN) irq.c:270: Dom9 PCI link 2 changed 0 -> 11 (d9) PCI-ISA link 2 routed to IRQ11 (XEN) irq.c:270: Dom9 PCI link 3 changed 0 -> 5 (d9) PCI-ISA link 3 routed to IRQ5 (d9) pci dev 01:3 INTA->IRQ10 (d9) pci dev 02:0 INTA->IRQ11 (d9) pci dev 04:0 INTA->IRQ5 (d9) RAM in high memory; setting high_mem resource base to 10f800000 (d9) pci dev 03:0 bar 10 size 002000000: 0f0000008 (d9) pci dev 02:0 bar 14 size 001000000: 0f2000008 (d9) pci dev 04:0 bar 30 size 000040000: 0f3000000 (d9) pci dev 04:0 bar 10 size 000020000: 0f3040000 (d9) pci dev 03:0 bar 30 size 000010000: 0f3060000 (d9) pci dev 03:0 bar 14 size 000001000: 0f3070000 (d9) pci dev 02:0 bar 10 size 000000100: 00000c001 (d9) pci dev 04:0 bar 14 size 000000040: 00000c101 (d9) pci dev 01:1 bar 20 size 000000010: 00000c141 (d9) Multiprocessor initialisation: (d9) - CPU0 ... 46-bit phys ... fixed MTRRs ... var MTRRs [2/8] ... done. (d9) - CPU1 ... 46-bit phys ... fixed MTRRs ... var MTRRs [2/8] ... done. (d9) Testing HVM environment: (d9) - REP INSB across page boundaries ... passed (d9) - GS base MSRs and SWAPGS ... passed (d9) Passed 2 of 2 tests (d9) Writing SMBIOS tables ... (d9) Loading SeaBIOS ... (d9) Creating MP tables ... (d9) Loading ACPI ... (d9) vm86 TSS at fc00a080 (d9) BIOS map: (d9) 10000-100d3: Scratch space (d9) e0000-fffff: Main BIOS (d9) E820 table: (d9) [00]: 00000000:00000000 - 00000000:000a0000: RAM (d9) HOLE: 00000000:000a0000 - 00000000:000e0000 (d9) [01]: 00000000:000e0000 - 00000000:00100000: RESERVED (d9) [02]: 00000000:00100000 - 00000000:f0000000: RAM (d9) HOLE: 00000000:f0000000 - 00000000:fc000000 (d9) [03]: 00000000:fc000000 - 00000001:00000000: RESERVED (d9) [04]: 00000001:00000000 - 00000001:0f800000: RAM (d9) Invoking SeaBIOS ... (d9) SeaBIOS (version rel-1.7.3.1-0-g7d9cbe6-20131211_100730-compilevm) (d9) (d9) Found Xen hypervisor signature at 40000000 (d9) xen: copy e820... (d9) Relocating init from 0x000e2e88 to 0xeffe1d80 (size 57784) (d9) CPU Mhz=3400 (d9) Found 7 PCI devices (max PCI bus is 00) (d9) Allocated Xen hypercall page at effff000 (d9) Detected Xen v4.4-unstable (d9) xen: copy BIOS tables... (d9) Copying SMBIOS entry point from 0x00010010 to 0x000f1020 (d9) Copying MPTABLE from 0xfc001170/fc001180 to 0x000f0f20 (d9) Copying PIR from 0x00010030 to 0x000f0ea0 (d9) Copying ACPI RSDP from 0x000100b0 to 0x000f0e70 (d9) Using pmtimer, ioport 0xb008, freq 3579 kHz (d9) Scan for VGA option rom (d9) WARNING! Found unaligned PCI rom (vd=1013:00b8) (d9) Running option rom at c000:0003 (XEN) stdvga.c:147:d9 entering stdvga and caching modes (d9) Turning on vga text mode console (d9) SeaBIOS (version rel-1.7.3.1-0-g7d9cbe6-20131211_100730-compilevm) (d9) Machine UUID a0b8c668-afaf-887a-1f4b-856dac4c8401 (d9) Found 0 lpt ports (d9) Found 1 serial ports (d9) ATA controller 1 at 1f0/3f4/c140 (irq 14 dev 9) (d9) ATA controller 2 at 170/374/c148 (irq 15 dev 9) (d9) ata0-0: QEMU HARDDISK ATA-7 Hard-Disk (14336 MiBytes) (d9) Searching bootorder for: /pci@i0cf8/*@1,1/drive@0/disk@0 (d9) DVD/CD [ata1-0: QEMU DVD-ROM ATAPI-4 DVD/CD] (d9) Searching bootorder for: /pci@i0cf8/*@1,1/drive@1/disk@0 (d9) PS2 keyboard initialized (d9) All threads complete. (d9) Scan for option roms (d9) Running option rom at c900:0003 (d9) pmm call arg1=1 (d9) pmm call arg1=0 (d9) pmm call arg1=1 (d9) pmm call arg1=0 (d9) Searching bootorder for: /pci@i0cf8/*@4 (d9) (d9) Press F12 for boot menu. (d9) (d9) Searching bootorder for: HALT (d9) drive 0x000f0e20: PCHS=16383/16/63 translation=lba LCHS=1024/255/63 s=29360128 (d9) Space available for UMB: ca000-ee800, f0000-f0dc0 (d9) Returned 61440 bytes of ZoneHigh (d9) e820 map has 7 items: (d9) 0: 0000000000000000 - 000000000009fc00 = 1 RAM (d9) 1: 000000000009fc00 - 00000000000a0000 = 2 RESERVED (d9) 2: 00000000000f0000 - 0000000000100000 = 2 RESERVED (d9) 3: 0000000000100000 - 00000000effff000 = 1 RAM (d9) 4: 00000000effff000 - 00000000f0000000 = 2 RESERVED (d9) 5: 00000000fc000000 - 0000000100000000 = 2 RESERVED (d9) 6: 0000000100000000 - 000000010f800000 = 1 RAM (d9) enter handle_19: (d9) NULL (d9) Booting from Hard Disk... (d9) Booting from 0000:7c00 [root@monster ~]# xl dmesg (XEN) error code 7 (XEN) domain_crash_sync called from vmcs.c:1293 (XEN) Domain 8 (vcpu#0) crashed on cpu#4: (XEN) ----[ Xen-4.4-unstable x86_64 debug=y Not tainted ]---- (XEN) CPU: 4 (XEN) RIP: 0000:[<0000000000000000>] (XEN) RFLAGS: 0000000000000002 CONTEXT: hvm guest (XEN) rax: 0000000000000000 rbx: ffff830824f98000 rcx: ffff830824f9ff80 (XEN) rdx: ffff82d0801d0cf9 rsi: 0000000000000000 rdi: ffff82d0801de7fc (XEN) rbp: ffff82d080105ab1 rsp: 0000000000000000 r8: 0000000000000004 (XEN) r9: ffff82d080105b20 r10: ffff830824f9ff70 r11: 0000000000000000 (XEN) r12: ffff830824f9ff50 r13: ffff830654f9e000 r14: ffff830824f9ff30 (XEN) r15: ffff82d080187e43 cr0: 0000000000000039 cr4: 0000000000002050 (XEN) cr3: 00000000feffa000 cr2: 0000000000000000 (XEN) ds: 0000 es: 0000 fs: 0000 gs: 0000 ss: 0000 cs: 0000 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22 (d9) HVM Loader (d9) Detected Xen v4.4-unstable (d9) Xenbus rings @0xfeffc000, event channel 4 (d9) System requested SeaBIOS (d9) CPU speed is 3400 MHz (d9) Relocating guest memory for lowmem MMIO space disabled (XEN) irq.c:270: Dom9 PCI link 0 changed 0 -> 5 (d9) PCI-ISA link 0 routed to IRQ5 (XEN) irq.c:270: Dom9 PCI link 1 changed 0 -> 10 (d9) PCI-ISA link 1 routed to IRQ10 (XEN) irq.c:270: Dom9 PCI link 2 changed 0 -> 11 (d9) PCI-ISA link 2 routed to IRQ11 (XEN) irq.c:270: Dom9 PCI link 3 changed 0 -> 5 (d9) PCI-ISA link 3 routed to IRQ5 (d9) pci dev 01:3 INTA->IRQ10 (d9) pci dev 02:0 INTA->IRQ11 (d9) pci dev 04:0 INTA->IRQ5 (d9) RAM in high memory; setting high_mem resource base to 10f800000 (d9) pci dev 03:0 bar 10 size 002000000: 0f0000008 (d9) pci dev 02:0 bar 14 size 001000000: 0f2000008 (d9) pci dev 04:0 bar 30 size 000040000: 0f3000000 (d9) pci dev 04:0 bar 10 size 000020000: 0f3040000 (d9) pci dev 03:0 bar 30 size 000010000: 0f3060000 (d9) pci dev 03:0 bar 14 size 000001000: 0f3070000 (d9) pci dev 02:0 bar 10 size 000000100: 00000c001 (d9) pci dev 04:0 bar 14 size 000000040: 00000c101 (d9) pci dev 01:1 bar 20 size 000000010: 00000c141 (d9) Multiprocessor initialisation: (d9) - CPU0 ... 46-bit phys ... fixed MTRRs ... var MTRRs [2/8] ... done. (d9) - CPU1 ... 46-bit phys ... fixed MTRRs ... var MTRRs [2/8] ... done. (d9) Testing HVM environment: (d9) - REP INSB across page boundaries ... passed (d9) - GS base MSRs and SWAPGS ... passed (d9) Passed 2 of 2 tests (d9) Writing SMBIOS tables ... (d9) Loading SeaBIOS ... (d9) Creating MP tables ... (d9) Loading ACPI ... (d9) vm86 TSS at fc00a080 (d9) BIOS map: (d9) 10000-100d3: Scratch space (d9) e0000-fffff: Main BIOS (d9) E820 table: (d9) [00]: 00000000:00000000 - 00000000:000a0000: RAM (d9) HOLE: 00000000:000a0000 - 00000000:000e0000 (d9) [01]: 00000000:000e0000 - 00000000:00100000: RESERVED (d9) [02]: 00000000:00100000 - 00000000:f0000000: RAM (d9) HOLE: 00000000:f0000000 - 00000000:fc000000 (d9) [03]: 00000000:fc000000 - 00000001:00000000: RESERVED (d9) [04]: 00000001:00000000 - 00000001:0f800000: RAM (d9) Invoking SeaBIOS ... (d9) SeaBIOS (version rel-1.7.3.1-0-g7d9cbe6-20131211_100730-compilevm) (d9) (d9) Found Xen hypervisor signature at 40000000 (d9) xen: copy e820... (d9) Relocating init from 0x000e2e88 to 0xeffe1d80 (size 57784) (d9) CPU Mhz=3400 (d9) Found 7 PCI devices (max PCI bus is 00) (d9) Allocated Xen hypercall page at effff000 (d9) Detected Xen v4.4-unstable (d9) xen: copy BIOS tables... (d9) Copying SMBIOS entry point from 0x00010010 to 0x000f1020 (d9) Copying MPTABLE from 0xfc001170/fc001180 to 0x000f0f20 (d9) Copying PIR from 0x00010030 to 0x000f0ea0 (d9) Copying ACPI RSDP from 0x000100b0 to 0x000f0e70 (d9) Using pmtimer, ioport 0xb008, freq 3579 kHz (d9) Scan for VGA option rom (d9) WARNING! Found unaligned PCI rom (vd=1013:00b8) (d9) Running option rom at c000:0003 (XEN) stdvga.c:147:d9 entering stdvga and caching modes (d9) Turning on vga text mode console (d9) SeaBIOS (version rel-1.7.3.1-0-g7d9cbe6-20131211_100730-compilevm) (d9) Machine UUID a0b8c668-afaf-887a-1f4b-856dac4c8401 (d9) Found 0 lpt ports (d9) Found 1 serial ports (d9) ATA controller 1 at 1f0/3f4/c140 (irq 14 dev 9) (d9) ATA controller 2 at 170/374/c148 (irq 15 dev 9) (d9) ata0-0: QEMU HARDDISK ATA-7 Hard-Disk (14336 MiBytes) (d9) Searching bootorder for: /pci@i0cf8/*@1,1/drive@0/disk@0 (d9) DVD/CD [ata1-0: QEMU DVD-ROM ATAPI-4 DVD/CD] (d9) Searching bootorder for: /pci@i0cf8/*@1,1/drive@1/disk@0 (d9) PS2 keyboard initialized (d9) All threads complete. (d9) Scan for option roms (d9) Running option rom at c900:0003 (d9) pmm call arg1=1 (d9) pmm call arg1=0 (d9) pmm call arg1=1 (d9) pmm call arg1=0 (d9) Searching bootorder for: /pci@i0cf8/*@4 (d9) (d9) Press F12 for boot menu. (d9) (d9) Searching bootorder for: HALT (d9) drive 0x000f0e20: PCHS=16383/16/63 translation=lba LCHS=1024/255/63 s=29360128 (d9) Space available for UMB: ca000-ee800, f0000-f0dc0 (d9) Returned 61440 bytes of ZoneHigh (d9) e820 map has 7 items: (d9) 0: 0000000000000000 - 000000000009fc00 = 1 RAM (d9) 1: 000000000009fc00 - 00000000000a0000 = 2 RESERVED (d9) 2: 00000000000f0000 - 0000000000100000 = 2 RESERVED (d9) 3: 0000000000100000 - 00000000effff000 = 1 RAM (d9) 4: 00000000effff000 - 00000000f0000000 = 2 RESERVED (d9) 5: 00000000fc000000 - 0000000100000000 = 2 RESERVED (d9) 6: 0000000100000000 - 000000010f800000 = 1 RAM (d9) enter handle_19: (d9) NULL (d9) Booting from Hard Disk... (d9) Booting from 0000:7c00 System description: 1. Centos 6.4 x86_64, latest updates 2. Xen4centos packages - current kernel is 3.10.23-11.el6.centos.alt.x86_64 3. System with 32GB RAM 4. Virtual disks are ZFS volumes (aka - block devices). Same problem appeared when on local ext3 disks 5. Using OpenVSwitch version 2.0, compiled to RPM, again. Any tip or advice would be great. Any request for further info would be also great! Thanks! Etzion --047d7b6786149c491404ed722730 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi.
I am using the unstable build-from-= source of Xen community. It reports as 4.4, and was pulled from Git two day= s ago. The problem I will describe below appears on version 4.3.1, compiled= from source as well. In both cases - I used spec file to create my own RPM= s, because it's the right method of doing it.

Problem: When VM running under HVM which is a hypervisor (XenServ= er 6.2 or VMware ESXi5.5) attempts to start a (HVM) virtual machine, the fo= llowing happens, 100% reproducible on this server.
XenServer: doma= in crush. XenServer restarts itself. It doesn't happen for PV on XenSer= ver VM
VMware: An "unknown failure", which leads me to think that = the nested virtualization properties are not forwarded correctly to DomU
This is the configuration used for XS:
name =3D "XenServ= er"
uuid =3D "a0b8c668-afaf-887a-1f4b-856dac4c8401"
maxmem =3D 409= 6
memory =3D 4096
vcpus =3D 2
builder =3D "hvm"
boot = =3D "c"
pae =3D 1
acpi =3D 1
apic =3D 1
hap =3D 0
= viridian =3D 0
rtc_timeoffset =3D 0
localtime =3D 0
on_poweroff =3D "destroy&qu= ot;
on_reboot =3D "restart"
on_crash =3D "restart"= ;
sdl =3D 0
vnc =3D 1
vncunused =3D 1
keymap =3D "en-us&qu= ot;
disk =3D [ "tap2:aio:/dev/share/VMS/xenserver01.lun,hda,w"= , ",hdc:cdrom,r" ]
vif =3D [ "mac=3D00:16:3e:14:0d:72,bridge=3Dlan,script=3Dvif-bridge,mo= del=3De1000" ]
parallel =3D "none"
serial =3D "pt= y"
nestedhvm =3D 1
nx=3D1

# A note - this pro= blem appears with and without the 'nx' flag.
A snippet from strace to qemu process:

poll([{fd=3D30, events= =3DPOLLIN|POLLERR|POLLHUP}, {fd=3D18, events=3DPOLLIN|POLLERR|POLLHUP}, {fd= =3D29, events=3DPOLLIN|POLLERR|POLLHUP}, {fd=3D21,
events=3DPOLLIN|POLL= ERR|POLLHUP}, {fd=3D15, events=3DPOLLIN|POLLERR|POLLHUP}, {fd=3D5, events= =3D
POLLIN|POLLERR|POLLHUP}, {fd=3D7, events=3DPOLLIN}, {fd=3D11, events=3DPOLL= IN}, {fd=3D28, events=3DPOLLIN}, {fd=3D6, events=3DPOLLIN}], 10, 307) =3D ?= ERESTART_RESTARTBLOCK (To be restarted)
--- SIGHUP (Hangup) @ 0 (0) ---=
write(6, "\1\0\0\0\0\0\0\0", 8)=A0=A0=A0=A0=A0=A0=A0=A0 =3D 8=
rt_sigreturn(0x2)=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0=A0= =A0=A0=A0 =3D -1 EINTR (Interrupted system call)
gettimeofday({138676162= 1, 705266}, NULL) =3D 0
clock_gettime(CLOCK_MONOTONIC, {1840, 693236049}= ) =3D 0
clock_gettime(CLOCK_MONOTONIC, {1840, 693333096}) =3D 0
gettimeofday({1386761621, 705546}, NULL) =3D 0
write(2, "qemu: term= inating on signal 1", 29) =3D 29
write(2, " from pid 6933\n&qu= ot;, 15)=A0=A0=A0=A0=A0=A0=A0 =3D 15

From the xl log for this = domain:
Waiting for domain XenServer (domid 5) to die [pid 6933]
Domain 5 has shut down, reason code 3 0x3
Action for shutdown reason cod= e 3 is restart
Domain 5 needs to be cleaned up: destroying the domainDone. Rebooting now
Waiting for domain XenServer (domid 6) to die [pid = 6933]

From 'xl dmesg'
(XEN) <vm_launch_fail> error cod= e 7
(XEN) domain_crash_sync called from vmcs.c:1293
(XEN) Domain 8 (v= cpu#0) crashed on cpu#4:
(XEN) ----[ Xen-4.4-unstable=A0 x86_64=A0 debug= =3Dy=A0 Not tainted ]----
(XEN) CPU:=A0=A0=A0 4
(XEN) RIP:=A0=A0=A0 0000:[<0000000000000000>= ]
(XEN) RFLAGS: 0000000000000002=A0=A0 CONTEXT: hvm guest
(XEN) rax: = 0000000000000000=A0=A0 rbx: ffff830824f98000=A0=A0 rcx: ffff830824f9ff80(XEN) rdx: ffff82d0801d0cf9=A0=A0 rsi: 0000000000000000=A0=A0 rdi: ffff82d= 0801de7fc
(XEN) rbp: ffff82d080105ab1=A0=A0 rsp: 0000000000000000=A0=A0 r8:=A0 000000= 0000000004
(XEN) r9:=A0 ffff82d080105b20=A0=A0 r10: ffff830824f9ff70=A0= =A0 r11: 0000000000000000
(XEN) r12: ffff830824f9ff50=A0=A0 r13: ffff830= 654f9e000=A0=A0 r14: ffff830824f9ff30
(XEN) r15: ffff82d080187e43=A0=A0 cr0: 0000000000000039=A0=A0 cr4: 00000000= 00002050
(XEN) cr3: 00000000feffa000=A0=A0 cr2: 0000000000000000
(XEN= ) ds: 0000=A0=A0 es: 0000=A0=A0 fs: 0000=A0=A0 gs: 0000=A0=A0 ss: 0000=A0= =A0 cs: 0000
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, er= ror -22
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN)= event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) even= t_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_cha= nnel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN)= event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) even= t_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_cha= nnel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN)= event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) even= t_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(d9) HVM Loader=
(d9) Detected Xen v4.4-unstable
(d9) Xenbus rings @0xfeffc000, event cha= nnel 4
(d9) System requested SeaBIOS
(d9) CPU speed is 3400 MHz
(d= 9) Relocating guest memory for lowmem MMIO space disabled
(XEN) irq.c:27= 0: Dom9 PCI link 0 changed 0 -> 5
(d9) PCI-ISA link 0 routed to IRQ5
(XEN) irq.c:270: Dom9 PCI link 1 chan= ged 0 -> 10
(d9) PCI-ISA link 1 routed to IRQ10
(XEN) irq.c:270: D= om9 PCI link 2 changed 0 -> 11
(d9) PCI-ISA link 2 routed to IRQ11 (XEN) irq.c:270: Dom9 PCI link 3 changed 0 -> 5
(d9) PCI-ISA link 3 r= outed to IRQ5
(d9) pci dev 01:3 INTA->IRQ10
(d9) pci dev 02:0 INTA= ->IRQ11
(d9) pci dev 04:0 INTA->IRQ5
(d9) RAM in high memory; s= etting high_mem resource base to 10f800000
(d9) pci dev 03:0 bar 10 size 002000000: 0f0000008
(d9) pci dev 02:0 bar= 14 size 001000000: 0f2000008
(d9) pci dev 04:0 bar 30 size 000040000: 0= f3000000
(d9) pci dev 04:0 bar 10 size 000020000: 0f3040000
(d9) pci = dev 03:0 bar 30 size 000010000: 0f3060000
(d9) pci dev 03:0 bar 14 size 000001000: 0f3070000
(d9) pci dev 02:0 bar= 10 size 000000100: 00000c001
(d9) pci dev 04:0 bar 14 size 000000040: 0= 0000c101
(d9) pci dev 01:1 bar 20 size 000000010: 00000c141
(d9) Mult= iprocessor initialisation:
(d9)=A0 - CPU0 ... 46-bit phys ... fixed MTRRs ... var MTRRs [2/8] ... done= .
(d9)=A0 - CPU1 ... 46-bit phys ... fixed MTRRs ... var MTRRs [2/8] ...= done.
(d9) Testing HVM environment:
(d9)=A0 - REP INSB across page b= oundaries ... passed
(d9)=A0 - GS base MSRs and SWAPGS ... passed
(d9) Passed 2 of 2 tests(d9) Writing SMBIOS tables ...
(d9) Loading SeaBIOS ...
(d9) Creatin= g MP tables ...
(d9) Loading ACPI ...
(d9) vm86 TSS at fc00a080
(d9) BIOS map:
(d9)=A0 10000-100d3: Scratch space
(d9)=A0 e0000-fffff= : Main BIOS
(d9) E820 table:
(d9)=A0 [00]: 00000000:00000000 - 000000= 00:000a0000: RAM
(d9)=A0 HOLE: 00000000:000a0000 - 00000000:000e0000
= (d9)=A0 [01]: 00000000:000e0000 - 00000000:00100000: RESERVED
(d9)=A0 [02]: 00000000:00100000 - 00000000:f0000000: RAM
(d9)=A0 HOLE: 0= 0000000:f0000000 - 00000000:fc000000
(d9)=A0 [03]: 00000000:fc000000 - 0= 0000001:00000000: RESERVED
(d9)=A0 [04]: 00000001:00000000 - 00000001:0f= 800000: RAM
(d9) Invoking SeaBIOS ...
(d9) SeaBIOS (version rel-1.7.3.1-0-g7d9cbe6-2= 0131211_100730-compilevm)
(d9)
(d9) Found Xen hypervisor signature a= t 40000000
(d9) xen: copy e820...
(d9) Relocating init from 0x000e2e8= 8 to 0xeffe1d80 (size 57784)
(d9) CPU Mhz=3D3400
(d9) Found 7 PCI devices (max PCI bus is 00)
(d9)= Allocated Xen hypercall page at effff000
(d9) Detected Xen v4.4-unstabl= e
(d9) xen: copy BIOS tables...
(d9) Copying SMBIOS entry point from = 0x00010010 to 0x000f1020
(d9) Copying MPTABLE from 0xfc001170/fc001180 to 0x000f0f20
(d9) Copying= PIR from 0x00010030 to 0x000f0ea0
(d9) Copying ACPI RSDP from 0x000100b= 0 to 0x000f0e70
(d9) Using pmtimer, ioport 0xb008, freq 3579 kHz
(d9) Scan for VGA option rom
(d9) WARNING! Found unaligned PCI rom (vd= =3D1013:00b8)
(d9) Running option rom at c000:0003
(XEN) stdvga.c:147= :d9 entering stdvga and caching modes
(d9) Turning on vga text mode cons= ole
(d9) SeaBIOS (version rel-1.7.3.1-0-g7d9cbe6-20131211_100730-compilevm)
= (d9) Machine UUID a0b8c668-afaf-887a-1f4b-856dac4c8401
(d9) Found 0 lpt = ports
(d9) Found 1 serial ports
(d9) ATA controller 1 at 1f0/3f4/c140= (irq 14 dev 9)
(d9) ATA controller 2 at 170/374/c148 (irq 15 dev 9)
(d9) ata0-0: QEMU H= ARDDISK ATA-7 Hard-Disk (14336 MiBytes)
(d9) Searching bootorder for: /p= ci@i0cf8/*@1,1/drive@0/disk@0
(d9) DVD/CD [ata1-0: QEMU DVD-ROM ATAPI-4 = DVD/CD]
(d9) Searching bootorder for: /pci@i0cf8/*@1,1/drive@1/disk@0
(d9) PS2 k= eyboard initialized
(d9) All threads complete.
(d9) Scan for option r= oms
(d9) Running option rom at c900:0003
(d9) pmm call arg1=3D1
(d9) pmm call arg1=3D0
(d9) pmm call arg1=3D1
(d9) pmm call arg1=3D0<= br>(d9) Searching bootorder for: /pci@i0cf8/*@4
(d9)
(d9) Press F12 = for boot menu.
(d9)
(d9) Searching bootorder for: HALT
(d9) drive= 0x000f0e20: PCHS=3D16383/16/63 translation=3Dlba LCHS=3D1024/255/63 s=3D29= 360128
(d9) Space available for UMB: ca000-ee800, f0000-f0dc0
(d9) Returned 614= 40 bytes of ZoneHigh
(d9) e820 map has 7 items:
(d9)=A0=A0 0: 0000000= 000000000 - 000000000009fc00 =3D 1 RAM
(d9)=A0=A0 1: 000000000009fc00 - = 00000000000a0000 =3D 2 RESERVED
(d9)=A0=A0 2: 00000000000f0000 - 0000000000100000 =3D 2 RESERVED
(d9)=A0= =A0 3: 0000000000100000 - 00000000effff000 =3D 1 RAM
(d9)=A0=A0 4: 00000= 000effff000 - 00000000f0000000 =3D 2 RESERVED
(d9)=A0=A0 5: 00000000fc00= 0000 - 0000000100000000 =3D 2 RESERVED
(d9)=A0=A0 6: 0000000100000000 - 000000010f800000 =3D 1 RAM
(d9) enter h= andle_19:
(d9)=A0=A0 NULL
(d9) Booting from Hard Disk...
(d9) Boot= ing from 0000:7c00
[root@monster ~]# xl dmesg
(XEN) <vm_launch_fa= il> error code 7
(XEN) domain_crash_sync called from vmcs.c:1293
(XEN) Domain 8 (vcpu#0) = crashed on cpu#4:
(XEN) ----[ Xen-4.4-unstable=A0 x86_64=A0 debug=3Dy=A0= Not tainted ]----
(XEN) CPU:=A0=A0=A0 4
(XEN) RIP:=A0=A0=A0 0000:[&l= t;0000000000000000>]
(XEN) RFLAGS: 0000000000000002=A0=A0 CONTEXT: hvm guest
(XEN) rax: 00000= 00000000000=A0=A0 rbx: ffff830824f98000=A0=A0 rcx: ffff830824f9ff80
(XEN= ) rdx: ffff82d0801d0cf9=A0=A0 rsi: 0000000000000000=A0=A0 rdi: ffff82d0801d= e7fc
(XEN) rbp: ffff82d080105ab1=A0=A0 rsp: 0000000000000000=A0=A0 r8:= =A0 0000000000000004
(XEN) r9:=A0 ffff82d080105b20=A0=A0 r10: ffff830824f9ff70=A0=A0 r11: 000000= 0000000000
(XEN) r12: ffff830824f9ff50=A0=A0 r13: ffff830654f9e000=A0=A0= r14: ffff830824f9ff30
(XEN) r15: ffff82d080187e43=A0=A0 cr0: 0000000000= 000039=A0=A0 cr4: 0000000000002050
(XEN) cr3: 00000000feffa000=A0=A0 cr2: 0000000000000000
(XEN) ds: 0000= =A0=A0 es: 0000=A0=A0 fs: 0000=A0=A0 gs: 0000=A0=A0 ss: 0000=A0=A0 cs: 0000=
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(= XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN)= event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) even= t_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_cha= nnel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN)= event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) even= t_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_cha= nnel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN) event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(XEN)= event_channel.c:270:d0 EVTCHNOP failure: domain 9, error -22
(d9) HVM L= oader
(d9) Detected Xen v4.4-unstable
(d9) Xenbus rings @0xfeffc000, = event channel 4
(d9) System requested SeaBIOS
(d9) CPU speed is 3400 MHz
(d9) Relocat= ing guest memory for lowmem MMIO space disabled
(XEN) irq.c:270: Dom9 PC= I link 0 changed 0 -> 5
(d9) PCI-ISA link 0 routed to IRQ5
(XEN) i= rq.c:270: Dom9 PCI link 1 changed 0 -> 10
(d9) PCI-ISA link 1 routed to IRQ10
(XEN) irq.c:270: Dom9 PCI link 2 cha= nged 0 -> 11
(d9) PCI-ISA link 2 routed to IRQ11
(XEN) irq.c:270: = Dom9 PCI link 3 changed 0 -> 5
(d9) PCI-ISA link 3 routed to IRQ5
(d9) pci dev 01:3 INTA->IRQ10
(d9) pci dev 02:0 INTA->IRQ11
(d9= ) pci dev 04:0 INTA->IRQ5
(d9) RAM in high memory; setting high_mem r= esource base to 10f800000
(d9) pci dev 03:0 bar 10 size 002000000: 0f000= 0008
(d9) pci dev 02:0 bar 14 size 001000000: 0f2000008
(d9) pci dev 04:0 bar= 30 size 000040000: 0f3000000
(d9) pci dev 04:0 bar 10 size 000020000: 0= f3040000
(d9) pci dev 03:0 bar 30 size 000010000: 0f3060000
(d9) pci = dev 03:0 bar 14 size 000001000: 0f3070000
(d9) pci dev 02:0 bar 10 size 000000100: 00000c001
(d9) pci dev 04:0 bar= 14 size 000000040: 00000c101
(d9) pci dev 01:1 bar 20 size 000000010: 0= 0000c141
(d9) Multiprocessor initialisation:
(d9)=A0 - CPU0 ... 46-bi= t phys ... fixed MTRRs ... var MTRRs [2/8] ... done.
(d9)=A0 - CPU1 ... 46-bit phys ... fixed MTRRs ... var MTRRs [2/8] ... done= .
(d9) Testing HVM environment:
(d9)=A0 - REP INSB across page bounda= ries ... passed
(d9)=A0 - GS base MSRs and SWAPGS ... passed
(d9) Pas= sed 2 of 2 tests
(d9) Writing SMBIOS tables ...
(d9) Loading SeaBIOS ...
(d9) Creating= MP tables ...
(d9) Loading ACPI ...
(d9) vm86 TSS at fc00a080
(d9= ) BIOS map:
(d9)=A0 10000-100d3: Scratch space
(d9)=A0 e0000-fffff: M= ain BIOS
(d9) E820 table:
(d9)=A0 [00]: 00000000:00000000 - 00000000:000a0000: RA= M
(d9)=A0 HOLE: 00000000:000a0000 - 00000000:000e0000
(d9)=A0 [01]: 0= 0000000:000e0000 - 00000000:00100000: RESERVED
(d9)=A0 [02]: 00000000:00= 100000 - 00000000:f0000000: RAM
(d9)=A0 HOLE: 00000000:f0000000 - 00000000:fc000000
(d9)=A0 [03]: 000000= 00:fc000000 - 00000001:00000000: RESERVED
(d9)=A0 [04]: 00000001:0000000= 0 - 00000001:0f800000: RAM
(d9) Invoking SeaBIOS ...
(d9) SeaBIOS (ve= rsion rel-1.7.3.1-0-g7d9cbe6-20131211_100730-compilevm)
(d9)
(d9) Found Xen hypervisor signature at 40000000
(d9) xen: copy = e820...
(d9) Relocating init from 0x000e2e88 to 0xeffe1d80 (size 57784)<= br>(d9) CPU Mhz=3D3400
(d9) Found 7 PCI devices (max PCI bus is 00)
(d9) Allocated Xen hypercall page at effff000
(d9) Detected Xen v4.4-uns= table
(d9) xen: copy BIOS tables...
(d9) Copying SMBIOS entry point f= rom 0x00010010 to 0x000f1020
(d9) Copying MPTABLE from 0xfc001170/fc0011= 80 to 0x000f0f20
(d9) Copying PIR from 0x00010030 to 0x000f0ea0
(d9) Copying ACPI RSDP fr= om 0x000100b0 to 0x000f0e70
(d9) Using pmtimer, ioport 0xb008, freq 3579= kHz
(d9) Scan for VGA option rom
(d9) WARNING! Found unaligned PCI r= om (vd=3D1013:00b8)
(d9) Running option rom at c000:0003
(XEN) stdvga.c:147:d9 entering stdv= ga and caching modes
(d9) Turning on vga text mode console
(d9) SeaBI= OS (version rel-1.7.3.1-0-g7d9cbe6-20131211_100730-compilevm)
(d9) Machi= ne UUID a0b8c668-afaf-887a-1f4b-856dac4c8401
(d9) Found 0 lpt ports
(d9) Found 1 serial ports
(d9) ATA controller = 1 at 1f0/3f4/c140 (irq 14 dev 9)
(d9) ATA controller 2 at 170/374/c148 (= irq 15 dev 9)
(d9) ata0-0: QEMU HARDDISK ATA-7 Hard-Disk (14336 MiBytes)=
(d9) Searching bootorder for: /pci@i0cf8/*@1,1/drive@0/disk@0
(d9) DVD/C= D [ata1-0: QEMU DVD-ROM ATAPI-4 DVD/CD]
(d9) Searching bootorder for: /p= ci@i0cf8/*@1,1/drive@1/disk@0
(d9) PS2 keyboard initialized
(d9) All = threads complete.
(d9) Scan for option roms
(d9) Running option rom at c900:0003
(d9) p= mm call arg1=3D1
(d9) pmm call arg1=3D0
(d9) pmm call arg1=3D1
(d9= ) pmm call arg1=3D0
(d9) Searching bootorder for: /pci@i0cf8/*@4
(d9)=
(d9) Press F12 for boot menu.
(d9)
(d9) Searching bootorder for: HAL= T
(d9) drive 0x000f0e20: PCHS=3D16383/16/63 translation=3Dlba LCHS=3D102= 4/255/63 s=3D29360128
(d9) Space available for UMB: ca000-ee800, f0000-f= 0dc0
(d9) Returned 61440 bytes of ZoneHigh
(d9) e820 map has 7 items:
(d9)= =A0=A0 0: 0000000000000000 - 000000000009fc00 =3D 1 RAM
(d9)=A0=A0 1: 00= 0000000009fc00 - 00000000000a0000 =3D 2 RESERVED
(d9)=A0=A0 2: 000000000= 00f0000 - 0000000000100000 =3D 2 RESERVED
(d9)=A0=A0 3: 0000000000100000 - 00000000effff000 =3D 1 RAM
(d9)=A0=A0 4= : 00000000effff000 - 00000000f0000000 =3D 2 RESERVED
(d9)=A0=A0 5: 00000= 000fc000000 - 0000000100000000 =3D 2 RESERVED
(d9)=A0=A0 6: 000000010000= 0000 - 000000010f800000 =3D 1 RAM
(d9) enter handle_19:
(d9)=A0=A0 NULL
(d9) Booting from Hard Disk...<= br>(d9) Booting from 0000:7c00

System description:
1.= Centos 6.4 x86_64, latest updates
2. Xen4centos packages - curren= t kernel is 3.10.23-11.el6.centos.alt.x86_64
3. System with 32GB RAM
4. Virtual disks are ZFS volumes (ak= a - block devices). Same problem appeared when on local ext3 disks
5. Using OpenVSwitch version 2.0, compiled to RPM, again.

Any tip or advice would be great. Any request for further info would be als= o great!

Thanks!
Etzion



--047d7b6786149c491404ed722730-- --===============0181144092381069083== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============0181144092381069083==-- From xen-users-bounces@lists.xen.org Sat Dec 14 18:55:55 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sat, 14 Dec 2013 18:55:55 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VruMO-00069x-1e; Sat, 14 Dec 2013 18:54:44 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VruMN-00069q-6l for xen-users@lists.xen.org; Sat, 14 Dec 2013 18:54:43 +0000 Received: from [85.158.143.35:58666] by server-2.bemta-4.messagelabs.com id 24/7C-11386-279ACA25; Sat, 14 Dec 2013 18:54:42 +0000 X-Env-Sender: jep@obrien-pifer.com X-Msg-Ref: server-9.tower-21.messagelabs.com!1387047280!5790531!1 X-Originating-IP: [75.180.132.120] X-SpamReason: No, hits=0.5 required=7.0 tests=sa_preprocessor: QmFkIElQOiA3NS4xODAuMTMyLjEyMCA9PiAxMTIzMzM=\n,sa_preprocessor: QmFkIElQOiA3NS4xODAuMTMyLjEyMCA9PiAxMTIzMzM=\n,BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 1563 invoked from network); 14 Dec 2013 18:54:41 -0000 Received: from cdptpa-omtalb.mail.rr.com (HELO cdptpa-omtalb.mail.rr.com) (75.180.132.120) by server-9.tower-21.messagelabs.com with SMTP; 14 Dec 2013 18:54:41 -0000 X-Authority-Analysis: v=2.0 cv=H69ZMpki c=1 sm=0 a=khvKJusKvADddYwUSfUZmw==:17 a=7N2hENjDmNMA:10 a=CLvEeJB4iJAA:10 a=i7z8CvP5fyYA:10 a=s-1hg7RLGykA:10 a=8nJEP1OIZ-IA:10 a=oZXU78TAAAAA:8 a=KGjhK52YXX0A:10 a=3NK0dmEYCXoA:10 a=XEz_5OiUeMeqK4eIeoAA:9 a=wPNLvfGTeEIA:10 a=khvKJusKvADddYwUSfUZmw==:117 X-Cloudmark-Score: 0 X-Authenticated-User: X-Originating-IP: 96.10.171.230 Received: from [96.10.171.230] ([96.10.171.230:53458] helo=mailserver.obrien-pifer.com) by cdptpa-oedge04.mail.rr.com (envelope-from ) (ecelerity 2.2.3.46 r()) with ESMTP id D6/17-11872-E69ACA25; Sat, 14 Dec 2013 18:54:40 +0000 Received: from [10.99.1.24] ([10.99.1.24]) (authenticated bits=0) by mailserver.obrien-pifer.com (8.13.8/8.13.8) with ESMTP id rBEIsTd0008317 for ; Sat, 14 Dec 2013 13:54:29 -0500 Message-ID: <52ACA964.5080501@obrien-pifer.com> Date: Sat, 14 Dec 2013 13:54:28 -0500 From: James Pifer User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: "xen-users@lists.xen.org" Subject: [Xen-users] Can't boot converted SLES11SP2/OES11 domU X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org I have a physical SLES11SP2/OES11 system that I've converted to a domU. It's boots ok as an HVM, but when I try to boot as a PV it gets stuck. I have the kernel-xen packages installed and confident the menu.lst is correct. If I look at xm console for the VM I get the output below: Any ideas? Thanks James [ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Linux version 3.0.101-0.5-xen (geeko@buildhost) (gcc version 4.3.4 [gcc-4_3-branch revision 152973] (SUSE Linux) ) #1 SMP Thu Oct 31 05:21:34 UTC 2013 (36fae46) [ 0.000000] Command line: root=/dev/xvda2 resume=/dev/xvda1 splash=silent showopts vga=0x317 [ 0.000000] Xen-provided physical RAM map: [ 0.000000] Xen: 0000000000000000 - 0000000100800000 (usable) [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] last_pfn = 0x100800 max_arch_pfn = 0x80000000 [ 0.000000] last_pfn = 0x100000 max_arch_pfn = 0x80000000 [ 0.000000] init_memory_mapping: 0000000000000000-0000000100000000 [ 0.000000] init_memory_mapping: 0000000100000000-0000000100800000 [ 0.000000] nmi ring buffer: 262144 [ 0.000000] RAMDISK: 00880000 - 019ac000 [ 0.000000] ACPI in unprivileged domain disabled [ 0.000000] Zone PFN ranges: [ 0.000000] DMA 0x00000000 -> 0x00001000 [ 0.000000] DMA32 0x00001000 -> 0x00100000 [ 0.000000] Normal 0x00100000 -> 0x00100800 [ 0.000000] Movable zone start PFN for each node [ 0.000000] early_node_map[2] active PFN ranges [ 0.000000] 0: 0x00000000 -> 0x00100000 [ 0.000000] 0: 0x00100800 -> 0x00100800 [ 0.000000] Normal zone: 28 pages exceeds realsize 0 [ 0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] PERCPU: Embedded 18 pages/cpu @ffff8800fbc00000 s41088 r8192 d24448 u524288 [ 0.000000] Swapping MFNs for PFN 728 and fbc05 (MFN 2b36a00 and da036c) [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 1034240 [ 0.000000] Kernel command line: root=/dev/xvda2 resume=/dev/xvda1 splash=silent showopts vga=0x317 [ 0.000000] bootsplash: silent mode. [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) [ 0.000000] allocated 33619968 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] Software IO TLB disabled [ 0.000000] Memory: 4054728k/4202496k available (4121k kernel code, 8192k absent, 139576k reserved, 3171k data, 424k init) [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU dyntick-idle grace-period acceleration is enabled. [ 0.000000] NR_IRQS:38912 nr_irqs:2624 16 [ 0.000000] Xen reported: 2494.062 MHz processor. [ 0.000000] Console: colour dummy device 80x25 [ 0.000000] console [tty0] enabled [ 0.000000] console [xvc-1] enabled [ 0.080007] Calibrating delay using timer specific routine.. 5055.20 BogoMIPS (lpj=10110411) [ 0.080015] pid_max: default: 32768 minimum: 301 [ 0.080080] Security Framework initialized [ 0.080098] AppArmor: AppArmor initialized [ 0.080121] Mount-cache hash table entries: 256 [ 0.080232] Initializing cgroup subsys cpuacct [ 0.080239] Initializing cgroup subsys memory [ 0.080247] Initializing cgroup subsys devices [ 0.080250] Initializing cgroup subsys freezer [ 0.080253] Initializing cgroup subsys net_cls [ 0.080256] Initializing cgroup subsys blkio [ 0.080263] Initializing cgroup subsys perf_event [ 0.080317] ENERGY_PERF_BIAS: Set to 'normal', was 'performance' [ 0.080318] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8) [ 0.080368] SMP alternatives: switching to UP code [ 0.109517] Brought up 1 CPUs [ 0.109606] devtmpfs: initialized [ 0.109870] print_constraints: dummy: [ 0.130004] Time: 165:165:165 Date: 165/165/65 [ 0.130066] NET: Registered protocol family 16 [ 0.130211] SMP alternatives: switching to SMP code [ 0.158810] Brought up 4 CPUs [ 0.160017] PCI: Fatal: No config space access function found [ 0.160024] PCI: setting up Xen PCI frontend stub [ 0.160311] bio: create slab at 0 [ 0.160322] ACPI: Interpreter disabled. [ 0.160322] vgaarb: loaded [ 0.160322] suspend: event channel 15 [ 0.160322] xen_mem: Initialising balloon driver. [ 0.160322] Unable to read sysrq code in control/sysrq [ 0.160322] PCI: System does not support PCI [ 0.160322] PCI: System does not support PCI [ 0.160322] NetLabel: Initializing [ 0.160322] NetLabel: domain hash size = 128 [ 0.160322] NetLabel: protocols = UNLABELED CIPSOv4 [ 0.160322] NetLabel: unlabeled traffic allowed by default [ 0.160322] Switching to clocksource xen [ 0.160805] Switched to NOHz mode on CPU #0 [ 0.162490] AppArmor: AppArmor Filesystem Enabled [ 0.162490] pnp: PnP ACPI: disabled [ 0.162668] NET: Registered protocol family 2 [ 0.162767] IP route cache hash table entries: 131072 (order: 8, 1048576 bytes) [ 0.163243] Switched to NOHz mode on CPU #1 [ 0.163257] TCP established hash table entries: 262144 (order: 10, 4194304 bytes) [ 0.163832] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) [ 0.163889] Switched to NOHz mode on CPU #2 [ 0.163992] TCP: Hash tables configured (established 262144 bind 65536) [ 0.163996] TCP reno registered [ 0.164000] UDP hash table entries: 2048 (order: 5, 131072 bytes) [ 0.164024] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes) [ 0.164216] NET: Registered protocol family 1 [ 0.164269] Unpacking initramfs... [ 0.164288] Switched to NOHz mode on CPU #3 [ 0.176390] Freeing initrd memory: 17584k freed [ 0.181881] audit: initializing netlink socket (disabled) [ 0.181906] type=2000 audit(1387044947.180:1): initialized [ 0.207507] bounce pool size: 64 pages [ 0.207872] VFS: Disk quotas dquot_6.5.2 [ 0.207923] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.207990] msgmni has been set to 2056 [ 0.208179] alg: No test for stdrng (krng) [ 0.208221] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253) [ 0.208262] io scheduler noop registered [ 0.208265] io scheduler deadline registered [ 0.208290] io scheduler cfq registered (default) [ 0.208515] Non-volatile memory driver v1.3 [ 0.208581] Xen virtual console successfully installed as xvc0 [ 0.209826] bootsplash 3.2.0-2010/03/31: looking for picture... [ 0.209828] bootsplash: silentjpeg size 59221 bytes [ 0.225712] bootsplash: scaling image from 1024x768 to 800x600 [ 0.250385] bootsplash: scaling image from 1024x768 to 800x600 [ 0.267722] Console: switching to colour frame buffer device 96x33 [ 0.274853] bootsplash: scaling image from 1024x768 to 800x600 [ 0.299383] bootsplash: scaling image from 1024x768 to 800x600 [ 0.320686] console [tty0] enabled [ 0.321576] input: Xen Virtual Keyboard as /devices/virtual/input/input0 [ 0.321632] input: Xen Virtual Pointer as /devices/virtual/input/input1 [ 0.328722] Fixed MDIO Bus: probed [ 0.328779] i8042: PNP: No PS/2 controller found. Probing ports directly. [ 1.346241] i8042: No controller found [ 1.346405] mousedev: PS/2 mouse device common for all mice [ 1.346581] EFI Variables Facility v0.08 2004-May-17 [ 1.346816] TCP cubic registered [ 1.346854] Registering the dns_resolver key type [ 1.346967] registered taskstats version 1 [ 1.347011] Magic number: 1:252:3141 [ 1.347070] XENBUS: Device with no driver: device/vbd/51712 [ 1.347096] XENBUS: Device with no driver: device/vif/0 [ 1.347307] Freeing unused kernel memory: 424k freed [ 1.347513] Write protecting the kernel read-only data: 6888k [ 1.405949] SCSI subsystem initialized [ 1.406566] HP CISS Driver (v 4.6.28) [ 1.444007] netfront: Initialising virtual ethernet driver. [ 1.561718] xen-vbd: registered block device major 202 [ 1.561805] blkfront: xvda: flush diskcache: enabled [ 1.563164] xvda: xvda1 xvda2 [ 1.665025] rdac: device handler registered [ 1.672330] hp_sw: device handler registered [ 1.679412] emc: device handler registered [ 1.686872] alua: device handler registered [ 1.691116] udev: starting version 147 [ 2.004010] kjournald starting. Commit interval 15 seconds [ 2.016756] EXT3-fs (xvda2): using internal journal [ 2.016786] EXT3-fs (xvda2): mounted filesystem with ordered data mode _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sat Dec 14 18:55:55 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sat, 14 Dec 2013 18:55:55 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VruMO-00069x-1e; Sat, 14 Dec 2013 18:54:44 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VruMN-00069q-6l for xen-users@lists.xen.org; Sat, 14 Dec 2013 18:54:43 +0000 Received: from [85.158.143.35:58666] by server-2.bemta-4.messagelabs.com id 24/7C-11386-279ACA25; Sat, 14 Dec 2013 18:54:42 +0000 X-Env-Sender: jep@obrien-pifer.com X-Msg-Ref: server-9.tower-21.messagelabs.com!1387047280!5790531!1 X-Originating-IP: [75.180.132.120] X-SpamReason: No, hits=0.5 required=7.0 tests=sa_preprocessor: QmFkIElQOiA3NS4xODAuMTMyLjEyMCA9PiAxMTIzMzM=\n,sa_preprocessor: QmFkIElQOiA3NS4xODAuMTMyLjEyMCA9PiAxMTIzMzM=\n,BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 1563 invoked from network); 14 Dec 2013 18:54:41 -0000 Received: from cdptpa-omtalb.mail.rr.com (HELO cdptpa-omtalb.mail.rr.com) (75.180.132.120) by server-9.tower-21.messagelabs.com with SMTP; 14 Dec 2013 18:54:41 -0000 X-Authority-Analysis: v=2.0 cv=H69ZMpki c=1 sm=0 a=khvKJusKvADddYwUSfUZmw==:17 a=7N2hENjDmNMA:10 a=CLvEeJB4iJAA:10 a=i7z8CvP5fyYA:10 a=s-1hg7RLGykA:10 a=8nJEP1OIZ-IA:10 a=oZXU78TAAAAA:8 a=KGjhK52YXX0A:10 a=3NK0dmEYCXoA:10 a=XEz_5OiUeMeqK4eIeoAA:9 a=wPNLvfGTeEIA:10 a=khvKJusKvADddYwUSfUZmw==:117 X-Cloudmark-Score: 0 X-Authenticated-User: X-Originating-IP: 96.10.171.230 Received: from [96.10.171.230] ([96.10.171.230:53458] helo=mailserver.obrien-pifer.com) by cdptpa-oedge04.mail.rr.com (envelope-from ) (ecelerity 2.2.3.46 r()) with ESMTP id D6/17-11872-E69ACA25; Sat, 14 Dec 2013 18:54:40 +0000 Received: from [10.99.1.24] ([10.99.1.24]) (authenticated bits=0) by mailserver.obrien-pifer.com (8.13.8/8.13.8) with ESMTP id rBEIsTd0008317 for ; Sat, 14 Dec 2013 13:54:29 -0500 Message-ID: <52ACA964.5080501@obrien-pifer.com> Date: Sat, 14 Dec 2013 13:54:28 -0500 From: James Pifer User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: "xen-users@lists.xen.org" Subject: [Xen-users] Can't boot converted SLES11SP2/OES11 domU X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org I have a physical SLES11SP2/OES11 system that I've converted to a domU. It's boots ok as an HVM, but when I try to boot as a PV it gets stuck. I have the kernel-xen packages installed and confident the menu.lst is correct. If I look at xm console for the VM I get the output below: Any ideas? Thanks James [ 0.000000] Initializing cgroup subsys cpuset [ 0.000000] Initializing cgroup subsys cpu [ 0.000000] Linux version 3.0.101-0.5-xen (geeko@buildhost) (gcc version 4.3.4 [gcc-4_3-branch revision 152973] (SUSE Linux) ) #1 SMP Thu Oct 31 05:21:34 UTC 2013 (36fae46) [ 0.000000] Command line: root=/dev/xvda2 resume=/dev/xvda1 splash=silent showopts vga=0x317 [ 0.000000] Xen-provided physical RAM map: [ 0.000000] Xen: 0000000000000000 - 0000000100800000 (usable) [ 0.000000] NX (Execute Disable) protection: active [ 0.000000] last_pfn = 0x100800 max_arch_pfn = 0x80000000 [ 0.000000] last_pfn = 0x100000 max_arch_pfn = 0x80000000 [ 0.000000] init_memory_mapping: 0000000000000000-0000000100000000 [ 0.000000] init_memory_mapping: 0000000100000000-0000000100800000 [ 0.000000] nmi ring buffer: 262144 [ 0.000000] RAMDISK: 00880000 - 019ac000 [ 0.000000] ACPI in unprivileged domain disabled [ 0.000000] Zone PFN ranges: [ 0.000000] DMA 0x00000000 -> 0x00001000 [ 0.000000] DMA32 0x00001000 -> 0x00100000 [ 0.000000] Normal 0x00100000 -> 0x00100800 [ 0.000000] Movable zone start PFN for each node [ 0.000000] early_node_map[2] active PFN ranges [ 0.000000] 0: 0x00000000 -> 0x00100000 [ 0.000000] 0: 0x00100800 -> 0x00100800 [ 0.000000] Normal zone: 28 pages exceeds realsize 0 [ 0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 nr_cpu_ids:4 nr_node_ids:1 [ 0.000000] PERCPU: Embedded 18 pages/cpu @ffff8800fbc00000 s41088 r8192 d24448 u524288 [ 0.000000] Swapping MFNs for PFN 728 and fbc05 (MFN 2b36a00 and da036c) [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. Total pages: 1034240 [ 0.000000] Kernel command line: root=/dev/xvda2 resume=/dev/xvda1 splash=silent showopts vga=0x317 [ 0.000000] bootsplash: silent mode. [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) [ 0.000000] Dentry cache hash table entries: 524288 (order: 10, 4194304 bytes) [ 0.000000] Inode-cache hash table entries: 262144 (order: 9, 2097152 bytes) [ 0.000000] allocated 33619968 bytes of page_cgroup [ 0.000000] please try 'cgroup_disable=memory' option if you don't want memory cgroups [ 0.000000] Software IO TLB disabled [ 0.000000] Memory: 4054728k/4202496k available (4121k kernel code, 8192k absent, 139576k reserved, 3171k data, 424k init) [ 0.000000] Hierarchical RCU implementation. [ 0.000000] RCU dyntick-idle grace-period acceleration is enabled. [ 0.000000] NR_IRQS:38912 nr_irqs:2624 16 [ 0.000000] Xen reported: 2494.062 MHz processor. [ 0.000000] Console: colour dummy device 80x25 [ 0.000000] console [tty0] enabled [ 0.000000] console [xvc-1] enabled [ 0.080007] Calibrating delay using timer specific routine.. 5055.20 BogoMIPS (lpj=10110411) [ 0.080015] pid_max: default: 32768 minimum: 301 [ 0.080080] Security Framework initialized [ 0.080098] AppArmor: AppArmor initialized [ 0.080121] Mount-cache hash table entries: 256 [ 0.080232] Initializing cgroup subsys cpuacct [ 0.080239] Initializing cgroup subsys memory [ 0.080247] Initializing cgroup subsys devices [ 0.080250] Initializing cgroup subsys freezer [ 0.080253] Initializing cgroup subsys net_cls [ 0.080256] Initializing cgroup subsys blkio [ 0.080263] Initializing cgroup subsys perf_event [ 0.080317] ENERGY_PERF_BIAS: Set to 'normal', was 'performance' [ 0.080318] ENERGY_PERF_BIAS: View and update with x86_energy_perf_policy(8) [ 0.080368] SMP alternatives: switching to UP code [ 0.109517] Brought up 1 CPUs [ 0.109606] devtmpfs: initialized [ 0.109870] print_constraints: dummy: [ 0.130004] Time: 165:165:165 Date: 165/165/65 [ 0.130066] NET: Registered protocol family 16 [ 0.130211] SMP alternatives: switching to SMP code [ 0.158810] Brought up 4 CPUs [ 0.160017] PCI: Fatal: No config space access function found [ 0.160024] PCI: setting up Xen PCI frontend stub [ 0.160311] bio: create slab at 0 [ 0.160322] ACPI: Interpreter disabled. [ 0.160322] vgaarb: loaded [ 0.160322] suspend: event channel 15 [ 0.160322] xen_mem: Initialising balloon driver. [ 0.160322] Unable to read sysrq code in control/sysrq [ 0.160322] PCI: System does not support PCI [ 0.160322] PCI: System does not support PCI [ 0.160322] NetLabel: Initializing [ 0.160322] NetLabel: domain hash size = 128 [ 0.160322] NetLabel: protocols = UNLABELED CIPSOv4 [ 0.160322] NetLabel: unlabeled traffic allowed by default [ 0.160322] Switching to clocksource xen [ 0.160805] Switched to NOHz mode on CPU #0 [ 0.162490] AppArmor: AppArmor Filesystem Enabled [ 0.162490] pnp: PnP ACPI: disabled [ 0.162668] NET: Registered protocol family 2 [ 0.162767] IP route cache hash table entries: 131072 (order: 8, 1048576 bytes) [ 0.163243] Switched to NOHz mode on CPU #1 [ 0.163257] TCP established hash table entries: 262144 (order: 10, 4194304 bytes) [ 0.163832] TCP bind hash table entries: 65536 (order: 8, 1048576 bytes) [ 0.163889] Switched to NOHz mode on CPU #2 [ 0.163992] TCP: Hash tables configured (established 262144 bind 65536) [ 0.163996] TCP reno registered [ 0.164000] UDP hash table entries: 2048 (order: 5, 131072 bytes) [ 0.164024] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes) [ 0.164216] NET: Registered protocol family 1 [ 0.164269] Unpacking initramfs... [ 0.164288] Switched to NOHz mode on CPU #3 [ 0.176390] Freeing initrd memory: 17584k freed [ 0.181881] audit: initializing netlink socket (disabled) [ 0.181906] type=2000 audit(1387044947.180:1): initialized [ 0.207507] bounce pool size: 64 pages [ 0.207872] VFS: Disk quotas dquot_6.5.2 [ 0.207923] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) [ 0.207990] msgmni has been set to 2056 [ 0.208179] alg: No test for stdrng (krng) [ 0.208221] Block layer SCSI generic (bsg) driver version 0.4 loaded (major 253) [ 0.208262] io scheduler noop registered [ 0.208265] io scheduler deadline registered [ 0.208290] io scheduler cfq registered (default) [ 0.208515] Non-volatile memory driver v1.3 [ 0.208581] Xen virtual console successfully installed as xvc0 [ 0.209826] bootsplash 3.2.0-2010/03/31: looking for picture... [ 0.209828] bootsplash: silentjpeg size 59221 bytes [ 0.225712] bootsplash: scaling image from 1024x768 to 800x600 [ 0.250385] bootsplash: scaling image from 1024x768 to 800x600 [ 0.267722] Console: switching to colour frame buffer device 96x33 [ 0.274853] bootsplash: scaling image from 1024x768 to 800x600 [ 0.299383] bootsplash: scaling image from 1024x768 to 800x600 [ 0.320686] console [tty0] enabled [ 0.321576] input: Xen Virtual Keyboard as /devices/virtual/input/input0 [ 0.321632] input: Xen Virtual Pointer as /devices/virtual/input/input1 [ 0.328722] Fixed MDIO Bus: probed [ 0.328779] i8042: PNP: No PS/2 controller found. Probing ports directly. [ 1.346241] i8042: No controller found [ 1.346405] mousedev: PS/2 mouse device common for all mice [ 1.346581] EFI Variables Facility v0.08 2004-May-17 [ 1.346816] TCP cubic registered [ 1.346854] Registering the dns_resolver key type [ 1.346967] registered taskstats version 1 [ 1.347011] Magic number: 1:252:3141 [ 1.347070] XENBUS: Device with no driver: device/vbd/51712 [ 1.347096] XENBUS: Device with no driver: device/vif/0 [ 1.347307] Freeing unused kernel memory: 424k freed [ 1.347513] Write protecting the kernel read-only data: 6888k [ 1.405949] SCSI subsystem initialized [ 1.406566] HP CISS Driver (v 4.6.28) [ 1.444007] netfront: Initialising virtual ethernet driver. [ 1.561718] xen-vbd: registered block device major 202 [ 1.561805] blkfront: xvda: flush diskcache: enabled [ 1.563164] xvda: xvda1 xvda2 [ 1.665025] rdac: device handler registered [ 1.672330] hp_sw: device handler registered [ 1.679412] emc: device handler registered [ 1.686872] alua: device handler registered [ 1.691116] udev: starting version 147 [ 2.004010] kjournald starting. Commit interval 15 seconds [ 2.016756] EXT3-fs (xvda2): using internal journal [ 2.016786] EXT3-fs (xvda2): mounted filesystem with ordered data mode _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sun Dec 15 01:06:05 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 15 Dec 2013 01:06:05 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vs08g-0000WB-VP; Sun, 15 Dec 2013 01:04:58 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vs08e-0000W6-QD for xen-users@lists.xen.org; Sun, 15 Dec 2013 01:04:57 +0000 Received: from [85.158.137.68:53982] by server-6.bemta-3.messagelabs.com id 79/68-04868-8300DA25; Sun, 15 Dec 2013 01:04:56 +0000 X-Env-Sender: jep@obrien-pifer.com X-Msg-Ref: server-4.tower-31.messagelabs.com!1387069494!3955598!1 X-Originating-IP: [75.180.132.120] X-SpamReason: No, hits=0.5 required=7.0 tests=sa_preprocessor: QmFkIElQOiA3NS4xODAuMTMyLjEyMCA9PiAxMTIzMzM=\n,sa_preprocessor: QmFkIElQOiA3NS4xODAuMTMyLjEyMCA9PiAxMTIzMzM=\n,BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 14852 invoked from network); 15 Dec 2013 01:04:54 -0000 Received: from cdptpa-omtalb.mail.rr.com (HELO cdptpa-omtalb.mail.rr.com) (75.180.132.120) by server-4.tower-31.messagelabs.com with SMTP; 15 Dec 2013 01:04:54 -0000 X-Authority-Analysis: v=2.0 cv=b8cwE66x c=1 sm=0 a=khvKJusKvADddYwUSfUZmw==:17 a=7N2hENjDmNMA:10 a=8PiRiIwLzMgA:10 a=i7z8CvP5fyYA:10 a=s-1hg7RLGykA:10 a=8nJEP1OIZ-IA:10 a=oZXU78TAAAAA:8 a=KGjhK52YXX0A:10 a=frVud_nAroAA:10 a=mLnsDVdbAAAA:8 a=edIxhD-GsFLOtYf6188A:9 a=wPNLvfGTeEIA:10 a=khvKJusKvADddYwUSfUZmw==:117 X-Cloudmark-Score: 0 X-Authenticated-User: X-Originating-IP: 96.10.171.230 Received: from [96.10.171.230] ([96.10.171.230:11707] helo=mailserver.obrien-pifer.com) by cdptpa-oedge02.mail.rr.com (envelope-from ) (ecelerity 2.2.3.46 r()) with ESMTP id C8/6F-21976-3300DA25; Sun, 15 Dec 2013 01:04:53 +0000 Received: from [10.99.1.24] ([10.99.1.24]) (authenticated bits=0) by mailserver.obrien-pifer.com (8.13.8/8.13.8) with ESMTP id rBF14edU013668 for ; Sat, 14 Dec 2013 20:04:41 -0500 Message-ID: <52AD0027.3070704@obrien-pifer.com> Date: Sat, 14 Dec 2013 20:04:39 -0500 From: James Pifer User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: "xen-users@lists.xen.org" References: <52ACA964.5080501@obrien-pifer.com> In-Reply-To: <52ACA964.5080501@obrien-pifer.com> Subject: Re: [Xen-users] Can't boot converted SLES11SP2/OES11 domU X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On 12/14/2013 1:54 PM, James Pifer wrote: > I have a physical SLES11SP2/OES11 system that I've converted to a > domU. It's boots ok as an HVM, but when I try to boot as a PV it gets > stuck. I have the kernel-xen packages installed and confident the > menu.lst is correct. > > If I look at xm console for the VM I get the output below: > > Any ideas? > > Thanks > James > > [ 0.000000] Initializing cgroup subsys cpuset > [ 0.000000] Initializing cgroup subsys cpu > [ 0.000000] Linux version 3.0.101-0.5-xen (geeko@buildhost) (gcc > version 4.3.4 [gcc-4_3-branch revision 152973] (SUSE Linux) ) #1 SMP > Thu Oct 31 05:21:34 UTC 2013 (36fae46) > [ 0.000000] Command line: root=/dev/xvda2 resume=/dev/xvda1 > splash=silent showopts vga=0x317 > [ 0.000000] Xen-provided physical RAM map: > [ 0.000000] Xen: 0000000000000000 - 0000000100800000 (usable) > [ 0.000000] NX (Execute Disable) protection: active > [ 0.000000] last_pfn = 0x100800 max_arch_pfn = 0x80000000 > [ 0.000000] last_pfn = 0x100000 max_arch_pfn = 0x80000000 > [ 0.000000] init_memory_mapping: 0000000000000000-0000000100000000 > [ 0.000000] init_memory_mapping: 0000000100000000-0000000100800000 > [ 0.000000] nmi ring buffer: 262144 > [ 0.000000] RAMDISK: 00880000 - 019ac000 > [ 0.000000] ACPI in unprivileged domain disabled > [ 0.000000] Zone PFN ranges: > [ 0.000000] DMA 0x00000000 -> 0x00001000 > [ 0.000000] DMA32 0x00001000 -> 0x00100000 > [ 0.000000] Normal 0x00100000 -> 0x00100800 > [ 0.000000] Movable zone start PFN for each node > [ 0.000000] early_node_map[2] active PFN ranges > [ 0.000000] 0: 0x00000000 -> 0x00100000 > [ 0.000000] 0: 0x00100800 -> 0x00100800 > [ 0.000000] Normal zone: 28 pages exceeds realsize 0 > [ 0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 > nr_cpu_ids:4 nr_node_ids:1 > [ 0.000000] PERCPU: Embedded 18 pages/cpu @ffff8800fbc00000 s41088 > r8192 d24448 u524288 > [ 0.000000] Swapping MFNs for PFN 728 and fbc05 (MFN 2b36a00 and > da036c) > [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. > Total pages: 1034240 > [ 0.000000] Kernel command line: root=/dev/xvda2 resume=/dev/xvda1 > splash=silent showopts vga=0x317 > [ 0.000000] bootsplash: silent mode. > [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) > [ 0.000000] Dentry cache hash table entries: 524288 (order: 10, > 4194304 bytes) > [ 0.000000] Inode-cache hash table entries: 262144 (order: 9, > 2097152 bytes) > [ 0.000000] allocated 33619968 bytes of page_cgroup > [ 0.000000] please try 'cgroup_disable=memory' option if you don't > want memory cgroups > [ 0.000000] Software IO TLB disabled > [ 0.000000] Memory: 4054728k/4202496k available (4121k kernel code, > 8192k absent, 139576k reserved, 3171k data, 424k init) > [ 0.000000] Hierarchical RCU implementation. > [ 0.000000] RCU dyntick-idle grace-period acceleration is enabled. > [ 0.000000] NR_IRQS:38912 nr_irqs:2624 16 > [ 0.000000] Xen reported: 2494.062 MHz processor. > [ 0.000000] Console: colour dummy device 80x25 > [ 0.000000] console [tty0] enabled > [ 0.000000] console [xvc-1] enabled > [ 0.080007] Calibrating delay using timer specific routine.. > 5055.20 BogoMIPS (lpj=10110411) > [ 0.080015] pid_max: default: 32768 minimum: 301 > [ 0.080080] Security Framework initialized > [ 0.080098] AppArmor: AppArmor initialized > [ 0.080121] Mount-cache hash table entries: 256 > [ 0.080232] Initializing cgroup subsys cpuacct > [ 0.080239] Initializing cgroup subsys memory > [ 0.080247] Initializing cgroup subsys devices > [ 0.080250] Initializing cgroup subsys freezer > [ 0.080253] Initializing cgroup subsys net_cls > [ 0.080256] Initializing cgroup subsys blkio > [ 0.080263] Initializing cgroup subsys perf_event > [ 0.080317] ENERGY_PERF_BIAS: Set to 'normal', was 'performance' > [ 0.080318] ENERGY_PERF_BIAS: View and update with > x86_energy_perf_policy(8) > [ 0.080368] SMP alternatives: switching to UP code > [ 0.109517] Brought up 1 CPUs > [ 0.109606] devtmpfs: initialized > [ 0.109870] print_constraints: dummy: > [ 0.130004] Time: 165:165:165 Date: 165/165/65 > [ 0.130066] NET: Registered protocol family 16 > [ 0.130211] SMP alternatives: switching to SMP code > [ 0.158810] Brought up 4 CPUs > [ 0.160017] PCI: Fatal: No config space access function found > [ 0.160024] PCI: setting up Xen PCI frontend stub > [ 0.160311] bio: create slab at 0 > [ 0.160322] ACPI: Interpreter disabled. > [ 0.160322] vgaarb: loaded > [ 0.160322] suspend: event channel 15 > [ 0.160322] xen_mem: Initialising balloon driver. > [ 0.160322] Unable to read sysrq code in control/sysrq > [ 0.160322] PCI: System does not support PCI > [ 0.160322] PCI: System does not support PCI > [ 0.160322] NetLabel: Initializing > [ 0.160322] NetLabel: domain hash size = 128 > [ 0.160322] NetLabel: protocols = UNLABELED CIPSOv4 > [ 0.160322] NetLabel: unlabeled traffic allowed by default > [ 0.160322] Switching to clocksource xen > [ 0.160805] Switched to NOHz mode on CPU #0 > [ 0.162490] AppArmor: AppArmor Filesystem Enabled > [ 0.162490] pnp: PnP ACPI: disabled > [ 0.162668] NET: Registered protocol family 2 > [ 0.162767] IP route cache hash table entries: 131072 (order: 8, > 1048576 bytes) > [ 0.163243] Switched to NOHz mode on CPU #1 > [ 0.163257] TCP established hash table entries: 262144 (order: 10, > 4194304 bytes) > [ 0.163832] TCP bind hash table entries: 65536 (order: 8, 1048576 > bytes) > [ 0.163889] Switched to NOHz mode on CPU #2 > [ 0.163992] TCP: Hash tables configured (established 262144 bind > 65536) > [ 0.163996] TCP reno registered > [ 0.164000] UDP hash table entries: 2048 (order: 5, 131072 bytes) > [ 0.164024] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes) > [ 0.164216] NET: Registered protocol family 1 > [ 0.164269] Unpacking initramfs... > [ 0.164288] Switched to NOHz mode on CPU #3 > [ 0.176390] Freeing initrd memory: 17584k freed > [ 0.181881] audit: initializing netlink socket (disabled) > [ 0.181906] type=2000 audit(1387044947.180:1): initialized > [ 0.207507] bounce pool size: 64 pages > [ 0.207872] VFS: Disk quotas dquot_6.5.2 > [ 0.207923] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) > [ 0.207990] msgmni has been set to 2056 > [ 0.208179] alg: No test for stdrng (krng) > [ 0.208221] Block layer SCSI generic (bsg) driver version 0.4 > loaded (major 253) > [ 0.208262] io scheduler noop registered > [ 0.208265] io scheduler deadline registered > [ 0.208290] io scheduler cfq registered (default) > [ 0.208515] Non-volatile memory driver v1.3 > [ 0.208581] Xen virtual console successfully installed as xvc0 > [ 0.209826] bootsplash 3.2.0-2010/03/31: looking for picture... > [ 0.209828] bootsplash: silentjpeg size 59221 bytes > [ 0.225712] bootsplash: scaling image from 1024x768 to 800x600 > [ 0.250385] bootsplash: scaling image from 1024x768 to 800x600 > [ 0.267722] Console: switching to colour frame buffer device 96x33 > [ 0.274853] bootsplash: scaling image from 1024x768 to 800x600 > [ 0.299383] bootsplash: scaling image from 1024x768 to 800x600 > [ 0.320686] console [tty0] enabled > [ 0.321576] input: Xen Virtual Keyboard as > /devices/virtual/input/input0 > [ 0.321632] input: Xen Virtual Pointer as > /devices/virtual/input/input1 > [ 0.328722] Fixed MDIO Bus: probed > [ 0.328779] i8042: PNP: No PS/2 controller found. Probing ports > directly. > [ 1.346241] i8042: No controller found > [ 1.346405] mousedev: PS/2 mouse device common for all mice > [ 1.346581] EFI Variables Facility v0.08 2004-May-17 > [ 1.346816] TCP cubic registered > [ 1.346854] Registering the dns_resolver key type > [ 1.346967] registered taskstats version 1 > [ 1.347011] Magic number: 1:252:3141 > [ 1.347070] XENBUS: Device with no driver: device/vbd/51712 > [ 1.347096] XENBUS: Device with no driver: device/vif/0 > [ 1.347307] Freeing unused kernel memory: 424k freed > [ 1.347513] Write protecting the kernel read-only data: 6888k > [ 1.405949] SCSI subsystem initialized > [ 1.406566] HP CISS Driver (v 4.6.28) > [ 1.444007] netfront: Initialising virtual ethernet driver. > [ 1.561718] xen-vbd: registered block device major 202 > [ 1.561805] blkfront: xvda: flush diskcache: enabled > [ 1.563164] xvda: xvda1 xvda2 > [ 1.665025] rdac: device handler registered > [ 1.672330] hp_sw: device handler registered > [ 1.679412] emc: device handler registered > [ 1.686872] alua: device handler registered > [ 1.691116] udev: starting version 147 > [ 2.004010] kjournald starting. Commit interval 15 seconds > [ 2.016756] EXT3-fs (xvda2): using internal journal > [ 2.016786] EXT3-fs (xvda2): mounted filesystem with ordered data mode > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > Disregard. Was able to get this working. Had to force a mkinitrd by booting with virt-manager to /dev/xvda. James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sun Dec 15 01:06:05 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 15 Dec 2013 01:06:05 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vs08g-0000WB-VP; Sun, 15 Dec 2013 01:04:58 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vs08e-0000W6-QD for xen-users@lists.xen.org; Sun, 15 Dec 2013 01:04:57 +0000 Received: from [85.158.137.68:53982] by server-6.bemta-3.messagelabs.com id 79/68-04868-8300DA25; Sun, 15 Dec 2013 01:04:56 +0000 X-Env-Sender: jep@obrien-pifer.com X-Msg-Ref: server-4.tower-31.messagelabs.com!1387069494!3955598!1 X-Originating-IP: [75.180.132.120] X-SpamReason: No, hits=0.5 required=7.0 tests=sa_preprocessor: QmFkIElQOiA3NS4xODAuMTMyLjEyMCA9PiAxMTIzMzM=\n,sa_preprocessor: QmFkIElQOiA3NS4xODAuMTMyLjEyMCA9PiAxMTIzMzM=\n,BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 14852 invoked from network); 15 Dec 2013 01:04:54 -0000 Received: from cdptpa-omtalb.mail.rr.com (HELO cdptpa-omtalb.mail.rr.com) (75.180.132.120) by server-4.tower-31.messagelabs.com with SMTP; 15 Dec 2013 01:04:54 -0000 X-Authority-Analysis: v=2.0 cv=b8cwE66x c=1 sm=0 a=khvKJusKvADddYwUSfUZmw==:17 a=7N2hENjDmNMA:10 a=8PiRiIwLzMgA:10 a=i7z8CvP5fyYA:10 a=s-1hg7RLGykA:10 a=8nJEP1OIZ-IA:10 a=oZXU78TAAAAA:8 a=KGjhK52YXX0A:10 a=frVud_nAroAA:10 a=mLnsDVdbAAAA:8 a=edIxhD-GsFLOtYf6188A:9 a=wPNLvfGTeEIA:10 a=khvKJusKvADddYwUSfUZmw==:117 X-Cloudmark-Score: 0 X-Authenticated-User: X-Originating-IP: 96.10.171.230 Received: from [96.10.171.230] ([96.10.171.230:11707] helo=mailserver.obrien-pifer.com) by cdptpa-oedge02.mail.rr.com (envelope-from ) (ecelerity 2.2.3.46 r()) with ESMTP id C8/6F-21976-3300DA25; Sun, 15 Dec 2013 01:04:53 +0000 Received: from [10.99.1.24] ([10.99.1.24]) (authenticated bits=0) by mailserver.obrien-pifer.com (8.13.8/8.13.8) with ESMTP id rBF14edU013668 for ; Sat, 14 Dec 2013 20:04:41 -0500 Message-ID: <52AD0027.3070704@obrien-pifer.com> Date: Sat, 14 Dec 2013 20:04:39 -0500 From: James Pifer User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: "xen-users@lists.xen.org" References: <52ACA964.5080501@obrien-pifer.com> In-Reply-To: <52ACA964.5080501@obrien-pifer.com> Subject: Re: [Xen-users] Can't boot converted SLES11SP2/OES11 domU X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On 12/14/2013 1:54 PM, James Pifer wrote: > I have a physical SLES11SP2/OES11 system that I've converted to a > domU. It's boots ok as an HVM, but when I try to boot as a PV it gets > stuck. I have the kernel-xen packages installed and confident the > menu.lst is correct. > > If I look at xm console for the VM I get the output below: > > Any ideas? > > Thanks > James > > [ 0.000000] Initializing cgroup subsys cpuset > [ 0.000000] Initializing cgroup subsys cpu > [ 0.000000] Linux version 3.0.101-0.5-xen (geeko@buildhost) (gcc > version 4.3.4 [gcc-4_3-branch revision 152973] (SUSE Linux) ) #1 SMP > Thu Oct 31 05:21:34 UTC 2013 (36fae46) > [ 0.000000] Command line: root=/dev/xvda2 resume=/dev/xvda1 > splash=silent showopts vga=0x317 > [ 0.000000] Xen-provided physical RAM map: > [ 0.000000] Xen: 0000000000000000 - 0000000100800000 (usable) > [ 0.000000] NX (Execute Disable) protection: active > [ 0.000000] last_pfn = 0x100800 max_arch_pfn = 0x80000000 > [ 0.000000] last_pfn = 0x100000 max_arch_pfn = 0x80000000 > [ 0.000000] init_memory_mapping: 0000000000000000-0000000100000000 > [ 0.000000] init_memory_mapping: 0000000100000000-0000000100800000 > [ 0.000000] nmi ring buffer: 262144 > [ 0.000000] RAMDISK: 00880000 - 019ac000 > [ 0.000000] ACPI in unprivileged domain disabled > [ 0.000000] Zone PFN ranges: > [ 0.000000] DMA 0x00000000 -> 0x00001000 > [ 0.000000] DMA32 0x00001000 -> 0x00100000 > [ 0.000000] Normal 0x00100000 -> 0x00100800 > [ 0.000000] Movable zone start PFN for each node > [ 0.000000] early_node_map[2] active PFN ranges > [ 0.000000] 0: 0x00000000 -> 0x00100000 > [ 0.000000] 0: 0x00100800 -> 0x00100800 > [ 0.000000] Normal zone: 28 pages exceeds realsize 0 > [ 0.000000] setup_percpu: NR_CPUS:512 nr_cpumask_bits:512 > nr_cpu_ids:4 nr_node_ids:1 > [ 0.000000] PERCPU: Embedded 18 pages/cpu @ffff8800fbc00000 s41088 > r8192 d24448 u524288 > [ 0.000000] Swapping MFNs for PFN 728 and fbc05 (MFN 2b36a00 and > da036c) > [ 0.000000] Built 1 zonelists in Zone order, mobility grouping on. > Total pages: 1034240 > [ 0.000000] Kernel command line: root=/dev/xvda2 resume=/dev/xvda1 > splash=silent showopts vga=0x317 > [ 0.000000] bootsplash: silent mode. > [ 0.000000] PID hash table entries: 4096 (order: 3, 32768 bytes) > [ 0.000000] Dentry cache hash table entries: 524288 (order: 10, > 4194304 bytes) > [ 0.000000] Inode-cache hash table entries: 262144 (order: 9, > 2097152 bytes) > [ 0.000000] allocated 33619968 bytes of page_cgroup > [ 0.000000] please try 'cgroup_disable=memory' option if you don't > want memory cgroups > [ 0.000000] Software IO TLB disabled > [ 0.000000] Memory: 4054728k/4202496k available (4121k kernel code, > 8192k absent, 139576k reserved, 3171k data, 424k init) > [ 0.000000] Hierarchical RCU implementation. > [ 0.000000] RCU dyntick-idle grace-period acceleration is enabled. > [ 0.000000] NR_IRQS:38912 nr_irqs:2624 16 > [ 0.000000] Xen reported: 2494.062 MHz processor. > [ 0.000000] Console: colour dummy device 80x25 > [ 0.000000] console [tty0] enabled > [ 0.000000] console [xvc-1] enabled > [ 0.080007] Calibrating delay using timer specific routine.. > 5055.20 BogoMIPS (lpj=10110411) > [ 0.080015] pid_max: default: 32768 minimum: 301 > [ 0.080080] Security Framework initialized > [ 0.080098] AppArmor: AppArmor initialized > [ 0.080121] Mount-cache hash table entries: 256 > [ 0.080232] Initializing cgroup subsys cpuacct > [ 0.080239] Initializing cgroup subsys memory > [ 0.080247] Initializing cgroup subsys devices > [ 0.080250] Initializing cgroup subsys freezer > [ 0.080253] Initializing cgroup subsys net_cls > [ 0.080256] Initializing cgroup subsys blkio > [ 0.080263] Initializing cgroup subsys perf_event > [ 0.080317] ENERGY_PERF_BIAS: Set to 'normal', was 'performance' > [ 0.080318] ENERGY_PERF_BIAS: View and update with > x86_energy_perf_policy(8) > [ 0.080368] SMP alternatives: switching to UP code > [ 0.109517] Brought up 1 CPUs > [ 0.109606] devtmpfs: initialized > [ 0.109870] print_constraints: dummy: > [ 0.130004] Time: 165:165:165 Date: 165/165/65 > [ 0.130066] NET: Registered protocol family 16 > [ 0.130211] SMP alternatives: switching to SMP code > [ 0.158810] Brought up 4 CPUs > [ 0.160017] PCI: Fatal: No config space access function found > [ 0.160024] PCI: setting up Xen PCI frontend stub > [ 0.160311] bio: create slab at 0 > [ 0.160322] ACPI: Interpreter disabled. > [ 0.160322] vgaarb: loaded > [ 0.160322] suspend: event channel 15 > [ 0.160322] xen_mem: Initialising balloon driver. > [ 0.160322] Unable to read sysrq code in control/sysrq > [ 0.160322] PCI: System does not support PCI > [ 0.160322] PCI: System does not support PCI > [ 0.160322] NetLabel: Initializing > [ 0.160322] NetLabel: domain hash size = 128 > [ 0.160322] NetLabel: protocols = UNLABELED CIPSOv4 > [ 0.160322] NetLabel: unlabeled traffic allowed by default > [ 0.160322] Switching to clocksource xen > [ 0.160805] Switched to NOHz mode on CPU #0 > [ 0.162490] AppArmor: AppArmor Filesystem Enabled > [ 0.162490] pnp: PnP ACPI: disabled > [ 0.162668] NET: Registered protocol family 2 > [ 0.162767] IP route cache hash table entries: 131072 (order: 8, > 1048576 bytes) > [ 0.163243] Switched to NOHz mode on CPU #1 > [ 0.163257] TCP established hash table entries: 262144 (order: 10, > 4194304 bytes) > [ 0.163832] TCP bind hash table entries: 65536 (order: 8, 1048576 > bytes) > [ 0.163889] Switched to NOHz mode on CPU #2 > [ 0.163992] TCP: Hash tables configured (established 262144 bind > 65536) > [ 0.163996] TCP reno registered > [ 0.164000] UDP hash table entries: 2048 (order: 5, 131072 bytes) > [ 0.164024] UDP-Lite hash table entries: 2048 (order: 5, 131072 bytes) > [ 0.164216] NET: Registered protocol family 1 > [ 0.164269] Unpacking initramfs... > [ 0.164288] Switched to NOHz mode on CPU #3 > [ 0.176390] Freeing initrd memory: 17584k freed > [ 0.181881] audit: initializing netlink socket (disabled) > [ 0.181906] type=2000 audit(1387044947.180:1): initialized > [ 0.207507] bounce pool size: 64 pages > [ 0.207872] VFS: Disk quotas dquot_6.5.2 > [ 0.207923] Dquot-cache hash table entries: 512 (order 0, 4096 bytes) > [ 0.207990] msgmni has been set to 2056 > [ 0.208179] alg: No test for stdrng (krng) > [ 0.208221] Block layer SCSI generic (bsg) driver version 0.4 > loaded (major 253) > [ 0.208262] io scheduler noop registered > [ 0.208265] io scheduler deadline registered > [ 0.208290] io scheduler cfq registered (default) > [ 0.208515] Non-volatile memory driver v1.3 > [ 0.208581] Xen virtual console successfully installed as xvc0 > [ 0.209826] bootsplash 3.2.0-2010/03/31: looking for picture... > [ 0.209828] bootsplash: silentjpeg size 59221 bytes > [ 0.225712] bootsplash: scaling image from 1024x768 to 800x600 > [ 0.250385] bootsplash: scaling image from 1024x768 to 800x600 > [ 0.267722] Console: switching to colour frame buffer device 96x33 > [ 0.274853] bootsplash: scaling image from 1024x768 to 800x600 > [ 0.299383] bootsplash: scaling image from 1024x768 to 800x600 > [ 0.320686] console [tty0] enabled > [ 0.321576] input: Xen Virtual Keyboard as > /devices/virtual/input/input0 > [ 0.321632] input: Xen Virtual Pointer as > /devices/virtual/input/input1 > [ 0.328722] Fixed MDIO Bus: probed > [ 0.328779] i8042: PNP: No PS/2 controller found. Probing ports > directly. > [ 1.346241] i8042: No controller found > [ 1.346405] mousedev: PS/2 mouse device common for all mice > [ 1.346581] EFI Variables Facility v0.08 2004-May-17 > [ 1.346816] TCP cubic registered > [ 1.346854] Registering the dns_resolver key type > [ 1.346967] registered taskstats version 1 > [ 1.347011] Magic number: 1:252:3141 > [ 1.347070] XENBUS: Device with no driver: device/vbd/51712 > [ 1.347096] XENBUS: Device with no driver: device/vif/0 > [ 1.347307] Freeing unused kernel memory: 424k freed > [ 1.347513] Write protecting the kernel read-only data: 6888k > [ 1.405949] SCSI subsystem initialized > [ 1.406566] HP CISS Driver (v 4.6.28) > [ 1.444007] netfront: Initialising virtual ethernet driver. > [ 1.561718] xen-vbd: registered block device major 202 > [ 1.561805] blkfront: xvda: flush diskcache: enabled > [ 1.563164] xvda: xvda1 xvda2 > [ 1.665025] rdac: device handler registered > [ 1.672330] hp_sw: device handler registered > [ 1.679412] emc: device handler registered > [ 1.686872] alua: device handler registered > [ 1.691116] udev: starting version 147 > [ 2.004010] kjournald starting. Commit interval 15 seconds > [ 2.016756] EXT3-fs (xvda2): using internal journal > [ 2.016786] EXT3-fs (xvda2): mounted filesystem with ordered data mode > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > Disregard. Was able to get this working. Had to force a mkinitrd by booting with virt-manager to /dev/xvda. James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sun Dec 15 12:59:17 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 15 Dec 2013 12:59:17 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsBGe-0003Aa-OO; Sun, 15 Dec 2013 12:57:56 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vrj2Z-0005dp-AS for xen-users@lists.xen.org; Sat, 14 Dec 2013 06:49:31 +0000 Received: from [85.158.137.68:31159] by server-13.bemta-3.messagelabs.com id 50/8A-28603-A7FFBA25; Sat, 14 Dec 2013 06:49:30 +0000 X-Env-Sender: zir_blazer@hotmail.com X-Msg-Ref: server-4.tower-31.messagelabs.com!1387003767!3863463!1 X-Originating-IP: [65.54.190.99] X-SpamReason: No, hits=1.5 required=7.0 tests=BODY_RANDOM_LONG, FORGED_HOTMAIL_RCVD,HTML_10_20,HTML_MESSAGE,ML_RADAR_SPEW_LINKS_12, ML_RADAR_SPEW_LINKS_14,ML_RADAR_SPEW_LINKS_2,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 32732 invoked from network); 14 Dec 2013 06:49:27 -0000 Received: from bay0-omc2-s24.bay0.hotmail.com (HELO bay0-omc2-s24.bay0.hotmail.com) (65.54.190.99) by server-4.tower-31.messagelabs.com with SMTP; 14 Dec 2013 06:49:27 -0000 Received: from BAY170-W67 ([65.54.190.123]) by bay0-omc2-s24.bay0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Fri, 13 Dec 2013 22:49:26 -0800 X-TMN: [JDhLCRyosa/haCeuiS6BddgrrBo79xSkN0PqoHhaMbQ=] X-Originating-Email: [zir_blazer@hotmail.com] Message-ID: From: Zir Blazer To: "xen-users@lists.xen.org" Date: Sat, 14 Dec 2013 03:49:26 -0300 Importance: Normal MIME-Version: 1.0 X-OriginalArrivalTime: 14 Dec 2013 06:49:26.0408 (UTC) FILETIME=[A13BA080:01CEF898] X-Mailman-Approved-At: Sun, 15 Dec 2013 12:57:55 +0000 Subject: [Xen-users] Xen black screens while booting in Arch Linux with UEFI GRUB X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============8226792391363804905==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============8226792391363804905== Content-Type: multipart/alternative; boundary="_c7e92d98-f6da-4e1b-802c-7df44e6237e7_" --_c7e92d98-f6da-4e1b-802c-7df44e6237e7_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable I posted this on Arch Linux Forums but didn't received any help=2C and due = to the fact that I don't know if its an OS-related or Xen-related issue=2C = I prefer to ask in both places to see if I can get an answer.https://bbs.ar= chlinux.org/viewtopic.php?id=3D174184 Basically=2C the issue I have goes like this: After installing Arch Linux i= n UEFI mode=2C I install Xen on top of it following Arch Linux wiki instruc= tions for Xen. GRUB allows me to choose to load Xen Arch=2C it starts to bo= ot but suddently black screens right after saying how many CPUs it has dete= cted. If on xen.conf I limit the amount of RAM for Dom0 then generate a gru= b.cfg file with the changes=2C it black screens after the Scrubbing RAM ste= p=2C which is an extra step right after the CPU detection. Some days ago I managed to get Xen working relatively well on my current ma= chine (I didn't manage to do VGA passthrough - that will come at a later st= age. But could install WXP on a LVM partition and the GPLPV Drivers)=2C how= ever=2C at that time I partitioned using MBR and my Boot Loader was Syslinu= x. As most examples on Internet for the Xen Boot Loader configuration are f= or GRUB=2C not Syslinux=2C I decided to reinstall from scratch and do a pro= per installation in UEFI mode and GPT partitioned. After several fresh and = fully documented installations=2C I didn't manage to get Xen working since = then. Due to the fact that I'm still new on Linux (Less than two weeks using Arch= Linux) and still didn't learned how to properly use debugging tools=2C log= s and such=2C I can't really put a log of actual issue unless someone expla= ins me how to do so. So for a first Post=2C until further instructions abou= t what I can do to provide more info=2C the most data that I can give you i= s just a step-by-step of what I do after a fresh install of Arch Linux and = Xen that causes the issue=2C to see if anyone can notice if I missed someth= ing which isn't on the wikis and not easy to google without the proper keyw= ords. HARDWAREProcessor: Xeon E3-1245 V3 (Haswell)Motherboard: Supermicro X10SAT = (Chipset C226)RAM: 32 GB (4 * 8 GB) AMD Performance Edition RP1866 Unbuffer= ed/Non-ECCHD: Seagate Desktop HDD.15 4 TBVideo Card: Both integrated Intel = HD Graphics 4600 and a Radeon 5770 intended for GPU passthrough on Xen=2C w= ill add a second 5770 laterPower Supply: Seasonic S12II-520Monitors: Samsun= g SyncMaster 2370H (DVI) and 932N+ (VGA)=2C both currently plugged on the I= ntel HD Graphics 4600 Any option that the BIOS allows me to choose between Legacy-only or UEFI-on= ly=2C is configured as UEFI-only. This applies to PCI Express Slots Option = ROMs.Video Card order is IGP first=2C so the Radeon shouldn't have video ou= tput unless after an OS is loaded.All common-sense options (VT-x=2C VT-d=2C= Hyper Threading=2C etc) I recognized are enabled.Additional controllers li= ke the ASMedia for SATA-3 Ports or Intel NIC booting ROM are disabled. SOFTWAREarchlinux-2013.12.01-dual.iso (Latest)I wrote the ISO to a Pendrive= with dd following these instructions here to make it boot with UEFI modeht= tps://wiki.archlinux.org/index.php/USB_Flash_Installation_Media#Using_dd_.2= 8Recommended_method.29 xen package from Arch User Repository (Should be 4.3.1-2)Some misc packages= . I do a fresh installation of Arch Linux following their wiki instructionsht= tps://wiki.archlinux.org/index.php/Beginners%27_Guide efivar -l gives output after booting from the UEFI Pendrive=2C confirming I= 'm running on UEFI mode.Partitioned the HD with gdisk. Reelevant partitions= are a 512 MiB EFI System Partition=2C a 9.5 GiB for Dom0 Arch Linux with X= en=2C and some bigger unformatted partitions for LVM.Formatted only the ESP= and next-to-be Dom0 partitions with FAT32 and EXT4 respectivel=2C using mk= fs.fat and mkfs.ext4Mounted /dev/sda2 to /mnt and /dev/sda1 to /mnt/boot.In= stalled Arch Linux to /mnt via pacstrap=2C with both base and base-devel pa= ckages.Used genfstab to generate /etc/fstab. Contents are the two mounted p= artitions.Chrotted into /mnt with /bin/bash parameters.Some basic configura= tion: /etc/vconsole.conf=2C uncommenting some lines on locale.gen=2C using = locale-gen then using export on one. Symlinked appropiate timezone.Enabled = DHCP service with systemctl to have Internet ready on next boot (Wired=2C c= omes via NIC).Used pacman to install grub=2C efibootmgr and dosfstools.Inst= alled GRUB with grub-install --target=3Dx86_64-efi --efi-directory=3D/boot = --bootloader-id=3Darch_grub --recheckModified /etc/default/grub to add GRUB= _DISABLE_SUBMENU=3Dy line to fix some errors that were popping out with gru= b-mkconfig and latest Arch Linux ISO.Generated grub.cfg with grub-mkconfig = -o /boot/grub/grub.cfgExited=2C umounted both partitions=2C rebooted. On the Boot tab=2C BIOS sees UEFI:arch_grub. It boots fine.After first boot= from the Arch Linux installation=2C I resume preparing for Xen: Modified /etc/pacman.conf to uncomment the [multilib] and its include line= =2C then did pacman -SyyuManually installed package-query and yaourt packag= es (curl -O=2C tar=2C makepkg) from the AUR repository. No issues to instal= l eitherUsed yaourt to download xen. It downloads xen and its dependancies = with no issues=2C compiles and install them Then=2C I follow the instruccions here:https://wiki.archlinux.org/index.php= /XenUse grub-mkconfig to add Xen to the GRUB menu options. It recognizes Xe= n image and completes sucessfully.Create the Network Bridge xenbr0 with net= ctl. It works.Use systemctl to enable xenstored.service=2C xenconsoled.serv= ice and xendomains.serviceReboot Now I have the Arch Xen option in the GRUB menu. Choosing it loads the imag= es=2C loads the RAMDisk=2C then changes my Monitor to 640x480 (Or it seems = like)=2C and starts to boot until it reachs the CPU detected step and black= screens. One of the things I managed to test was editing /etc/xen/grub.cfg= =2C by decommenting the XEN_HYPERVISOR_CMDLINE line with xsave=3D1 and addi= ng dom0_mem=3D2048M. After remaking grub.cfg with grub-mkconfig=2C it does = an extra step after CPU detection where it says "Scrubbing RAM"=2C after it= finishes it black screens. Several tries=2C fresh installations fully docu= mented (A bit more detailed than above)=2C I didn't manage to make it work.= The standalone Arch stills work fine. Booting with it=2C I checked the xenc= onsoled service status and it complains that it failed to start because Con= ditionPathExist=3D/proc/xen was not met. The only other place where I saw /= proc/xen was on a line that is recommended to be added to fstab for xenfs= =2C which I also tried. After rebooting=2C Arch Linux throws me to maintena= nce mode for as long as that line is there=2C and Arch Xen keeps black scre= ening on the same step. I suppose it could be because /proc/xen depends on = booting with the Xen image=2C which is what I wasn't able to do=2C so that = error is consequence of that.Additionally=2C I also did a manual install of= Syslinux for UEFI. I could get it working with Arch Linux=2C but as soon a= s I choose the Xen option=2C it instantly crashes. I'm using the parameters= from Arch Linux wiki Xen article:https://wiki.archlinux.org/index.php/xen#= Modification_of_the_bootloader After googling a lot=2C I got stuck in this point and didn't really manage = to go beyond it. I wasn't able to use Xen with UEFI. However=2C I'm not sur= e if Xen can or can't be used=2C at least for the 4.2 version I found this:= http://www.youtube.com/watch?v=3D-XFyPo7PacM...but not sure if it applies t= o 4.3+. The only ideas I have: 1 - Parameters that I can try for xen menu option in grub.cfg2 - I heared t= hat Xen can be compiled as a .efi file to be used with UEFI=2C but don't kn= ow if its mandatory or not. I would need a detailed guide about how to do s= o. I could post more data or logs if you tell me how to get them. Thanks for reading. =0A= =20 = --_c7e92d98-f6da-4e1b-802c-7df44e6237e7_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
I posted this on Arch Linux= Forums but didn't received any help=2C and due to the fact that I don't kn= ow if its an OS-related or Xen-related issue=2C I prefer to ask in both pla= ces to see if I can get an answer.
https://bbs.archlinux.org/view= topic.php?id=3D174184

Basically=2C the issue I hav= e goes like this: After installing Arch Linux in UEFI mode=2C I install Xen= on top of it following Arch Linux wiki instructions for Xen. GRUB allows m= e to choose to load Xen Arch=2C it starts to boot but suddently black scree= ns right after saying how many CPUs it has detected. If on xen.conf I limit= the amount of RAM for Dom0 then generate a grub.cfg file with the changes= =2C it black screens after the Scrubbing RAM step=2C which is an extra step= right after the CPU detection.

Some days ago I ma= naged to get Xen working relatively well on my current machine (I didn't ma= nage to do VGA passthrough - that will come at a later stage. But could ins= tall WXP on a LVM partition and the GPLPV Drivers)=2C however=2C at that ti= me I partitioned using MBR and my Boot Loader was Syslinux. As most example= s on Internet for the Xen Boot Loader configuration are for GRUB=2C not Sys= linux=2C I decided to reinstall from scratch and do a proper installation i= n UEFI mode and GPT partitioned. After several fresh and fully documented i= nstallations=2C I didn't manage to get Xen working since then.

Due to the fact that I'm still new on Linux (Le= ss than two weeks using Arch Linux) and still didn't learned how to properl= y use debugging tools=2C logs and such=2C I can't really put a log of actua= l issue unless someone explains me how to do so. So for a first Post=2C unt= il further instructions about what I can do to provide more info=2C the mos= t data that I can give you is just a step-by-step of what I do after a fres= h install of Arch Linux and Xen that causes the issue=2C to see if anyone c= an notice if I missed something which isn't on the wikis and not easy to go= ogle without the proper keywords.


<= br>

HARDWARE
Processor: Xeon E3-1245 V3 = (Haswell)
Motherboard: Supermicro X10SAT (Chipset C226)
RAM: 32 GB (4 * 8 GB) AMD Performance Edition RP1866 Unbuffered/Non-ECC
HD: Seagate Desktop HDD.15 4 TB
Video Card: Both integrat= ed Intel HD Graphics 4600 and a Radeon 5770 intended for GPU passthrough on= Xen=2C will add a second 5770 later
Power Supply: Seasonic S12II= -520
Monitors: Samsung SyncMaster 2370H (DVI) and 932N+ (VGA)=2C = both currently plugged on the Intel HD Graphics 4600

Any option that the BIOS allows me to choose between Legacy-only or UEFI= -only=2C is configured as UEFI-only. This applies to PCI Express Slots Opti= on ROMs.
Video Card order is IGP first=2C so the Radeon shouldn't= have video output unless after an OS is loaded.
All common-sense= options (VT-x=2C VT-d=2C Hyper Threading=2C etc) I recognized are enabled.=
Additional controllers like the ASMedia for SATA-3 Ports or Inte= l NIC booting ROM are disabled.


SOFTWARE
archlinux-2013.12.01-dual.iso (Latest)
=
I wrote the ISO to a Pendrive with dd following these instructions her= e to make it boot with UEFI mode
https://wiki.archlinux.org/index= .php/USB_Flash_Installation_Media#Using_dd_.28Recommended_method.29

xen package from Arch User Repository (Should be 4.3.1-2)=
Some misc packages.


I do= a fresh installation of Arch Linux following their wiki instructions
=
https://wiki.archlinux.org/index.php/Beginners%27_Guide

=
efivar -l gives output after booting from the UEFI Pendrive=2C c= onfirming I'm running on UEFI mode.
Partitioned the HD with gdisk= . Reelevant partitions are a 512 MiB EFI System Partition=2C a 9.5 GiB for = Dom0 Arch Linux with Xen=2C and some bigger unformatted partitions for LVM.=
Formatted only the ESP and next-to-be Dom0 partitions with FAT32= and EXT4 respectivel=2C using mkfs.fat and mkfs.ext4
Mounted /de= v/sda2 to /mnt and /dev/sda1 to /mnt/boot.
Installed Arch Linux t= o /mnt via pacstrap=2C with both base and base-devel packages.
Us= ed genfstab to generate /etc/fstab. Contents are the two mounted partitions= .
Chrotted into /mnt with /bin/bash parameters.
Some ba= sic configuration: /etc/vconsole.conf=2C uncommenting some lines on locale.= gen=2C using locale-gen then using export on one. Symlinked appropiate time= zone.
Enabled DHCP service with systemctl to have Internet ready = on next boot (Wired=2C comes via NIC).
Used pacman to install gru= b=2C efibootmgr and dosfstools.
Installed GRUB with grub-install = --target=3Dx86_64-efi --efi-directory=3D/boot --bootloader-id=3Darch_grub -= -recheck
Modified /etc/default/grub to add GRUB_DISABLE_SUBMENU= =3Dy line to fix some errors that were popping out with grub-mkconfig and l= atest Arch Linux ISO.
Generated grub.cfg with grub-mkconfig -o /b= oot/grub/grub.cfg
Exited=2C umounted both partitions=2C rebooted.=

On the Boot tab=2C BIOS sees UEFI:arch_grub. It b= oots fine.
After first boot from the Arch Linux installation=2C I= resume preparing for Xen:

Modified /etc/pacman.co= nf to uncomment the [multilib] and its include line=2C then did pacman -Syy= u
Manually installed package-query and yaourt packages (curl -O= =2C tar=2C makepkg) from the AUR repository. No issues to install either
Used yaourt to download xen. It downloads xen and its dependancies = with no issues=2C compiles and install them

Then= =2C I follow the instruccions here:
https://wiki.archlinux.org/in= dex.php/Xen
Use grub-mkconfig to add Xen to the GRUB menu options= . It recognizes Xen image and completes sucessfully.
Create the N= etwork Bridge xenbr0 with netctl. It works.
Use systemctl to enab= le xenstored.service=2C xenconsoled.service and xendomains.service
Reboot

Now I have the Arch Xen option in the GRU= B menu. Choosing it loads the images=2C loads the RAMDisk=2C then changes m= y Monitor to 640x480 (Or it seems like)=2C and starts to boot until it reac= hs the CPU detected step and black screens. One of the things I managed to = test was editing /etc/xen/grub.cfg=2C by decommenting the XEN_HYPERVISOR_CM= DLINE line with xsave=3D1 and adding dom0_mem=3D2048M. After remaking grub.= cfg with grub-mkconfig=2C it does an extra step after CPU detection where i= t says "Scrubbing RAM"=2C after it finishes it black screens. Several tries= =2C fresh installations fully documented (A bit more detailed than above)= =2C I didn't manage to make it work.
The standalone Arch stills w= ork fine. Booting with it=2C I checked the xenconsoled service status and i= t complains that it failed to start because ConditionPathExist=3D/proc/xen = was not met. The only other place where I saw /proc/xen was on a line that = is recommended to be added to fstab for xenfs=2C which I also tried. After = rebooting=2C Arch Linux throws me to maintenance mode for as long as that l= ine is there=2C and Arch Xen keeps black screening on the same step. I supp= ose it could be because /proc/xen depends on booting with the Xen image=2C = which is what I wasn't able to do=2C so that error is consequence of that.<= /div>
Additionally=2C I also did a manual install of Syslinux for UEFI.= I could get it working with Arch Linux=2C but as soon as I choose the Xen = option=2C it instantly crashes. I'm using the parameters from Arch Linux wi= ki Xen article:
https://wiki.archlinux.org/index.php/xen#Modifica= tion_of_the_bootloader



After googling a lot=2C I got stuck in this point and didn't really mana= ge to go beyond it. I wasn't able to use Xen with UEFI. However=2C I'm not = sure if Xen can or can't be used=2C at least for the 4.2 version I found th= is:
http://www.youtube.com/watch?v=3D-XFyPo7PacM
...but= not sure if it applies to 4.3+.


Th= e only ideas I have:

1 - Parameters that I can try= for xen menu option in grub.cfg
2 - I heared that Xen can be com= piled as a .efi file to be used with UEFI=2C but don't know if its mandator= y or not. I would need a detailed guide about how to do so.

<= /div>
I could post more data or logs if you tell me how to get them.


Thanks for reading.

=0A=  =3B
= --_c7e92d98-f6da-4e1b-802c-7df44e6237e7_-- --===============8226792391363804905== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============8226792391363804905==-- From xen-users-bounces@lists.xen.org Sun Dec 15 12:59:17 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 15 Dec 2013 12:59:17 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsBGe-0003Aa-OO; Sun, 15 Dec 2013 12:57:56 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vrj2Z-0005dp-AS for xen-users@lists.xen.org; Sat, 14 Dec 2013 06:49:31 +0000 Received: from [85.158.137.68:31159] by server-13.bemta-3.messagelabs.com id 50/8A-28603-A7FFBA25; Sat, 14 Dec 2013 06:49:30 +0000 X-Env-Sender: zir_blazer@hotmail.com X-Msg-Ref: server-4.tower-31.messagelabs.com!1387003767!3863463!1 X-Originating-IP: [65.54.190.99] X-SpamReason: No, hits=1.5 required=7.0 tests=BODY_RANDOM_LONG, FORGED_HOTMAIL_RCVD,HTML_10_20,HTML_MESSAGE,ML_RADAR_SPEW_LINKS_12, ML_RADAR_SPEW_LINKS_14,ML_RADAR_SPEW_LINKS_2,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 32732 invoked from network); 14 Dec 2013 06:49:27 -0000 Received: from bay0-omc2-s24.bay0.hotmail.com (HELO bay0-omc2-s24.bay0.hotmail.com) (65.54.190.99) by server-4.tower-31.messagelabs.com with SMTP; 14 Dec 2013 06:49:27 -0000 Received: from BAY170-W67 ([65.54.190.123]) by bay0-omc2-s24.bay0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Fri, 13 Dec 2013 22:49:26 -0800 X-TMN: [JDhLCRyosa/haCeuiS6BddgrrBo79xSkN0PqoHhaMbQ=] X-Originating-Email: [zir_blazer@hotmail.com] Message-ID: From: Zir Blazer To: "xen-users@lists.xen.org" Date: Sat, 14 Dec 2013 03:49:26 -0300 Importance: Normal MIME-Version: 1.0 X-OriginalArrivalTime: 14 Dec 2013 06:49:26.0408 (UTC) FILETIME=[A13BA080:01CEF898] X-Mailman-Approved-At: Sun, 15 Dec 2013 12:57:55 +0000 Subject: [Xen-users] Xen black screens while booting in Arch Linux with UEFI GRUB X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============8226792391363804905==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============8226792391363804905== Content-Type: multipart/alternative; boundary="_c7e92d98-f6da-4e1b-802c-7df44e6237e7_" --_c7e92d98-f6da-4e1b-802c-7df44e6237e7_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable I posted this on Arch Linux Forums but didn't received any help=2C and due = to the fact that I don't know if its an OS-related or Xen-related issue=2C = I prefer to ask in both places to see if I can get an answer.https://bbs.ar= chlinux.org/viewtopic.php?id=3D174184 Basically=2C the issue I have goes like this: After installing Arch Linux i= n UEFI mode=2C I install Xen on top of it following Arch Linux wiki instruc= tions for Xen. GRUB allows me to choose to load Xen Arch=2C it starts to bo= ot but suddently black screens right after saying how many CPUs it has dete= cted. If on xen.conf I limit the amount of RAM for Dom0 then generate a gru= b.cfg file with the changes=2C it black screens after the Scrubbing RAM ste= p=2C which is an extra step right after the CPU detection. Some days ago I managed to get Xen working relatively well on my current ma= chine (I didn't manage to do VGA passthrough - that will come at a later st= age. But could install WXP on a LVM partition and the GPLPV Drivers)=2C how= ever=2C at that time I partitioned using MBR and my Boot Loader was Syslinu= x. As most examples on Internet for the Xen Boot Loader configuration are f= or GRUB=2C not Syslinux=2C I decided to reinstall from scratch and do a pro= per installation in UEFI mode and GPT partitioned. After several fresh and = fully documented installations=2C I didn't manage to get Xen working since = then. Due to the fact that I'm still new on Linux (Less than two weeks using Arch= Linux) and still didn't learned how to properly use debugging tools=2C log= s and such=2C I can't really put a log of actual issue unless someone expla= ins me how to do so. So for a first Post=2C until further instructions abou= t what I can do to provide more info=2C the most data that I can give you i= s just a step-by-step of what I do after a fresh install of Arch Linux and = Xen that causes the issue=2C to see if anyone can notice if I missed someth= ing which isn't on the wikis and not easy to google without the proper keyw= ords. HARDWAREProcessor: Xeon E3-1245 V3 (Haswell)Motherboard: Supermicro X10SAT = (Chipset C226)RAM: 32 GB (4 * 8 GB) AMD Performance Edition RP1866 Unbuffer= ed/Non-ECCHD: Seagate Desktop HDD.15 4 TBVideo Card: Both integrated Intel = HD Graphics 4600 and a Radeon 5770 intended for GPU passthrough on Xen=2C w= ill add a second 5770 laterPower Supply: Seasonic S12II-520Monitors: Samsun= g SyncMaster 2370H (DVI) and 932N+ (VGA)=2C both currently plugged on the I= ntel HD Graphics 4600 Any option that the BIOS allows me to choose between Legacy-only or UEFI-on= ly=2C is configured as UEFI-only. This applies to PCI Express Slots Option = ROMs.Video Card order is IGP first=2C so the Radeon shouldn't have video ou= tput unless after an OS is loaded.All common-sense options (VT-x=2C VT-d=2C= Hyper Threading=2C etc) I recognized are enabled.Additional controllers li= ke the ASMedia for SATA-3 Ports or Intel NIC booting ROM are disabled. SOFTWAREarchlinux-2013.12.01-dual.iso (Latest)I wrote the ISO to a Pendrive= with dd following these instructions here to make it boot with UEFI modeht= tps://wiki.archlinux.org/index.php/USB_Flash_Installation_Media#Using_dd_.2= 8Recommended_method.29 xen package from Arch User Repository (Should be 4.3.1-2)Some misc packages= . I do a fresh installation of Arch Linux following their wiki instructionsht= tps://wiki.archlinux.org/index.php/Beginners%27_Guide efivar -l gives output after booting from the UEFI Pendrive=2C confirming I= 'm running on UEFI mode.Partitioned the HD with gdisk. Reelevant partitions= are a 512 MiB EFI System Partition=2C a 9.5 GiB for Dom0 Arch Linux with X= en=2C and some bigger unformatted partitions for LVM.Formatted only the ESP= and next-to-be Dom0 partitions with FAT32 and EXT4 respectivel=2C using mk= fs.fat and mkfs.ext4Mounted /dev/sda2 to /mnt and /dev/sda1 to /mnt/boot.In= stalled Arch Linux to /mnt via pacstrap=2C with both base and base-devel pa= ckages.Used genfstab to generate /etc/fstab. Contents are the two mounted p= artitions.Chrotted into /mnt with /bin/bash parameters.Some basic configura= tion: /etc/vconsole.conf=2C uncommenting some lines on locale.gen=2C using = locale-gen then using export on one. Symlinked appropiate timezone.Enabled = DHCP service with systemctl to have Internet ready on next boot (Wired=2C c= omes via NIC).Used pacman to install grub=2C efibootmgr and dosfstools.Inst= alled GRUB with grub-install --target=3Dx86_64-efi --efi-directory=3D/boot = --bootloader-id=3Darch_grub --recheckModified /etc/default/grub to add GRUB= _DISABLE_SUBMENU=3Dy line to fix some errors that were popping out with gru= b-mkconfig and latest Arch Linux ISO.Generated grub.cfg with grub-mkconfig = -o /boot/grub/grub.cfgExited=2C umounted both partitions=2C rebooted. On the Boot tab=2C BIOS sees UEFI:arch_grub. It boots fine.After first boot= from the Arch Linux installation=2C I resume preparing for Xen: Modified /etc/pacman.conf to uncomment the [multilib] and its include line= =2C then did pacman -SyyuManually installed package-query and yaourt packag= es (curl -O=2C tar=2C makepkg) from the AUR repository. No issues to instal= l eitherUsed yaourt to download xen. It downloads xen and its dependancies = with no issues=2C compiles and install them Then=2C I follow the instruccions here:https://wiki.archlinux.org/index.php= /XenUse grub-mkconfig to add Xen to the GRUB menu options. It recognizes Xe= n image and completes sucessfully.Create the Network Bridge xenbr0 with net= ctl. It works.Use systemctl to enable xenstored.service=2C xenconsoled.serv= ice and xendomains.serviceReboot Now I have the Arch Xen option in the GRUB menu. Choosing it loads the imag= es=2C loads the RAMDisk=2C then changes my Monitor to 640x480 (Or it seems = like)=2C and starts to boot until it reachs the CPU detected step and black= screens. One of the things I managed to test was editing /etc/xen/grub.cfg= =2C by decommenting the XEN_HYPERVISOR_CMDLINE line with xsave=3D1 and addi= ng dom0_mem=3D2048M. After remaking grub.cfg with grub-mkconfig=2C it does = an extra step after CPU detection where it says "Scrubbing RAM"=2C after it= finishes it black screens. Several tries=2C fresh installations fully docu= mented (A bit more detailed than above)=2C I didn't manage to make it work.= The standalone Arch stills work fine. Booting with it=2C I checked the xenc= onsoled service status and it complains that it failed to start because Con= ditionPathExist=3D/proc/xen was not met. The only other place where I saw /= proc/xen was on a line that is recommended to be added to fstab for xenfs= =2C which I also tried. After rebooting=2C Arch Linux throws me to maintena= nce mode for as long as that line is there=2C and Arch Xen keeps black scre= ening on the same step. I suppose it could be because /proc/xen depends on = booting with the Xen image=2C which is what I wasn't able to do=2C so that = error is consequence of that.Additionally=2C I also did a manual install of= Syslinux for UEFI. I could get it working with Arch Linux=2C but as soon a= s I choose the Xen option=2C it instantly crashes. I'm using the parameters= from Arch Linux wiki Xen article:https://wiki.archlinux.org/index.php/xen#= Modification_of_the_bootloader After googling a lot=2C I got stuck in this point and didn't really manage = to go beyond it. I wasn't able to use Xen with UEFI. However=2C I'm not sur= e if Xen can or can't be used=2C at least for the 4.2 version I found this:= http://www.youtube.com/watch?v=3D-XFyPo7PacM...but not sure if it applies t= o 4.3+. The only ideas I have: 1 - Parameters that I can try for xen menu option in grub.cfg2 - I heared t= hat Xen can be compiled as a .efi file to be used with UEFI=2C but don't kn= ow if its mandatory or not. I would need a detailed guide about how to do s= o. I could post more data or logs if you tell me how to get them. Thanks for reading. =0A= =20 = --_c7e92d98-f6da-4e1b-802c-7df44e6237e7_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
I posted this on Arch Linux= Forums but didn't received any help=2C and due to the fact that I don't kn= ow if its an OS-related or Xen-related issue=2C I prefer to ask in both pla= ces to see if I can get an answer.
https://bbs.archlinux.org/view= topic.php?id=3D174184

Basically=2C the issue I hav= e goes like this: After installing Arch Linux in UEFI mode=2C I install Xen= on top of it following Arch Linux wiki instructions for Xen. GRUB allows m= e to choose to load Xen Arch=2C it starts to boot but suddently black scree= ns right after saying how many CPUs it has detected. If on xen.conf I limit= the amount of RAM for Dom0 then generate a grub.cfg file with the changes= =2C it black screens after the Scrubbing RAM step=2C which is an extra step= right after the CPU detection.

Some days ago I ma= naged to get Xen working relatively well on my current machine (I didn't ma= nage to do VGA passthrough - that will come at a later stage. But could ins= tall WXP on a LVM partition and the GPLPV Drivers)=2C however=2C at that ti= me I partitioned using MBR and my Boot Loader was Syslinux. As most example= s on Internet for the Xen Boot Loader configuration are for GRUB=2C not Sys= linux=2C I decided to reinstall from scratch and do a proper installation i= n UEFI mode and GPT partitioned. After several fresh and fully documented i= nstallations=2C I didn't manage to get Xen working since then.

Due to the fact that I'm still new on Linux (Le= ss than two weeks using Arch Linux) and still didn't learned how to properl= y use debugging tools=2C logs and such=2C I can't really put a log of actua= l issue unless someone explains me how to do so. So for a first Post=2C unt= il further instructions about what I can do to provide more info=2C the mos= t data that I can give you is just a step-by-step of what I do after a fres= h install of Arch Linux and Xen that causes the issue=2C to see if anyone c= an notice if I missed something which isn't on the wikis and not easy to go= ogle without the proper keywords.


<= br>

HARDWARE
Processor: Xeon E3-1245 V3 = (Haswell)
Motherboard: Supermicro X10SAT (Chipset C226)
RAM: 32 GB (4 * 8 GB) AMD Performance Edition RP1866 Unbuffered/Non-ECC
HD: Seagate Desktop HDD.15 4 TB
Video Card: Both integrat= ed Intel HD Graphics 4600 and a Radeon 5770 intended for GPU passthrough on= Xen=2C will add a second 5770 later
Power Supply: Seasonic S12II= -520
Monitors: Samsung SyncMaster 2370H (DVI) and 932N+ (VGA)=2C = both currently plugged on the Intel HD Graphics 4600

Any option that the BIOS allows me to choose between Legacy-only or UEFI= -only=2C is configured as UEFI-only. This applies to PCI Express Slots Opti= on ROMs.
Video Card order is IGP first=2C so the Radeon shouldn't= have video output unless after an OS is loaded.
All common-sense= options (VT-x=2C VT-d=2C Hyper Threading=2C etc) I recognized are enabled.=
Additional controllers like the ASMedia for SATA-3 Ports or Inte= l NIC booting ROM are disabled.


SOFTWARE
archlinux-2013.12.01-dual.iso (Latest)
=
I wrote the ISO to a Pendrive with dd following these instructions her= e to make it boot with UEFI mode
https://wiki.archlinux.org/index= .php/USB_Flash_Installation_Media#Using_dd_.28Recommended_method.29

xen package from Arch User Repository (Should be 4.3.1-2)=
Some misc packages.


I do= a fresh installation of Arch Linux following their wiki instructions
=
https://wiki.archlinux.org/index.php/Beginners%27_Guide

=
efivar -l gives output after booting from the UEFI Pendrive=2C c= onfirming I'm running on UEFI mode.
Partitioned the HD with gdisk= . Reelevant partitions are a 512 MiB EFI System Partition=2C a 9.5 GiB for = Dom0 Arch Linux with Xen=2C and some bigger unformatted partitions for LVM.=
Formatted only the ESP and next-to-be Dom0 partitions with FAT32= and EXT4 respectivel=2C using mkfs.fat and mkfs.ext4
Mounted /de= v/sda2 to /mnt and /dev/sda1 to /mnt/boot.
Installed Arch Linux t= o /mnt via pacstrap=2C with both base and base-devel packages.
Us= ed genfstab to generate /etc/fstab. Contents are the two mounted partitions= .
Chrotted into /mnt with /bin/bash parameters.
Some ba= sic configuration: /etc/vconsole.conf=2C uncommenting some lines on locale.= gen=2C using locale-gen then using export on one. Symlinked appropiate time= zone.
Enabled DHCP service with systemctl to have Internet ready = on next boot (Wired=2C comes via NIC).
Used pacman to install gru= b=2C efibootmgr and dosfstools.
Installed GRUB with grub-install = --target=3Dx86_64-efi --efi-directory=3D/boot --bootloader-id=3Darch_grub -= -recheck
Modified /etc/default/grub to add GRUB_DISABLE_SUBMENU= =3Dy line to fix some errors that were popping out with grub-mkconfig and l= atest Arch Linux ISO.
Generated grub.cfg with grub-mkconfig -o /b= oot/grub/grub.cfg
Exited=2C umounted both partitions=2C rebooted.=

On the Boot tab=2C BIOS sees UEFI:arch_grub. It b= oots fine.
After first boot from the Arch Linux installation=2C I= resume preparing for Xen:

Modified /etc/pacman.co= nf to uncomment the [multilib] and its include line=2C then did pacman -Syy= u
Manually installed package-query and yaourt packages (curl -O= =2C tar=2C makepkg) from the AUR repository. No issues to install either
Used yaourt to download xen. It downloads xen and its dependancies = with no issues=2C compiles and install them

Then= =2C I follow the instruccions here:
https://wiki.archlinux.org/in= dex.php/Xen
Use grub-mkconfig to add Xen to the GRUB menu options= . It recognizes Xen image and completes sucessfully.
Create the N= etwork Bridge xenbr0 with netctl. It works.
Use systemctl to enab= le xenstored.service=2C xenconsoled.service and xendomains.service
Reboot

Now I have the Arch Xen option in the GRU= B menu. Choosing it loads the images=2C loads the RAMDisk=2C then changes m= y Monitor to 640x480 (Or it seems like)=2C and starts to boot until it reac= hs the CPU detected step and black screens. One of the things I managed to = test was editing /etc/xen/grub.cfg=2C by decommenting the XEN_HYPERVISOR_CM= DLINE line with xsave=3D1 and adding dom0_mem=3D2048M. After remaking grub.= cfg with grub-mkconfig=2C it does an extra step after CPU detection where i= t says "Scrubbing RAM"=2C after it finishes it black screens. Several tries= =2C fresh installations fully documented (A bit more detailed than above)= =2C I didn't manage to make it work.
The standalone Arch stills w= ork fine. Booting with it=2C I checked the xenconsoled service status and i= t complains that it failed to start because ConditionPathExist=3D/proc/xen = was not met. The only other place where I saw /proc/xen was on a line that = is recommended to be added to fstab for xenfs=2C which I also tried. After = rebooting=2C Arch Linux throws me to maintenance mode for as long as that l= ine is there=2C and Arch Xen keeps black screening on the same step. I supp= ose it could be because /proc/xen depends on booting with the Xen image=2C = which is what I wasn't able to do=2C so that error is consequence of that.<= /div>
Additionally=2C I also did a manual install of Syslinux for UEFI.= I could get it working with Arch Linux=2C but as soon as I choose the Xen = option=2C it instantly crashes. I'm using the parameters from Arch Linux wi= ki Xen article:
https://wiki.archlinux.org/index.php/xen#Modifica= tion_of_the_bootloader



After googling a lot=2C I got stuck in this point and didn't really mana= ge to go beyond it. I wasn't able to use Xen with UEFI. However=2C I'm not = sure if Xen can or can't be used=2C at least for the 4.2 version I found th= is:
http://www.youtube.com/watch?v=3D-XFyPo7PacM
...but= not sure if it applies to 4.3+.


Th= e only ideas I have:

1 - Parameters that I can try= for xen menu option in grub.cfg
2 - I heared that Xen can be com= piled as a .efi file to be used with UEFI=2C but don't know if its mandator= y or not. I would need a detailed guide about how to do so.

<= /div>
I could post more data or logs if you tell me how to get them.


Thanks for reading.

=0A=  =3B
= --_c7e92d98-f6da-4e1b-802c-7df44e6237e7_-- --===============8226792391363804905== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============8226792391363804905==-- From xen-users-bounces@lists.xen.org Mon Dec 16 08:17:18 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 08:17:18 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsTLc-0001k7-NK; Mon, 16 Dec 2013 08:16:16 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsTLa-0001jz-QT for xen-users@lists.xen.org; Mon, 16 Dec 2013 08:16:14 +0000 Received: from [85.158.143.35:46332] by server-3.bemta-4.messagelabs.com id 45/F6-32360-EC6BEA25; Mon, 16 Dec 2013 08:16:14 +0000 X-Env-Sender: peter@perkbv.com X-Msg-Ref: server-15.tower-21.messagelabs.com!1387181773!3351901!1 X-Originating-IP: [62.21.193.1] X-SpamReason: No, hits=0.0 required=7.0 tests=UNPARSEABLE_RELAY X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 6103 invoked from network); 16 Dec 2013 08:16:13 -0000 Received: from static.kpn.net (HELO perkbv.com) (62.21.193.1) by server-15.tower-21.messagelabs.com with SMTP; 16 Dec 2013 08:16:13 -0000 Received: from WorldClient by perkbv.com (MDaemon PRO v12.0.3) with ESMTP id md50000129396.msg for ; Mon, 16 Dec 2013 09:16:11 +0100 X-Spam-Processed: perkbv.com, Mon, 16 Dec 2013 09:16:11 +0100 (not processed: message from trusted or authenticated source) X-Authenticated-Sender: peter@perkbv.com X-Return-Path: peter@perkbv.com X-Envelope-From: peter@perkbv.com X-MDaemon-Deliver-To: xen-users@lists.xen.org Received: from [212.123.184.107] by perkbv.com via WorldClient with HTTP; Mon, 16 Dec 2013 09:16:09 +0100 Date: Mon, 16 Dec 2013 09:16:09 +0100 From: "peter" To: xen-users@lists.xen.org MIME-Version: 1.0 Message-ID: X-Mailer: WorldClient 12.0.3 Subject: [Xen-users] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Goodmorning, I'm currently playing with XEN/arm on my Allwinner A20 (cubieboard2) I would like to get the XENFB driver working on domU. But currently in xen/arm there's no support for VFB, atleast qemu is not supported. But this video http://www.youtube.com/watch?v=po1IeElg8tg and this one http://www.youtube.com/watch?v=Km6gBnIqaWo is showing a working framebuffer. So there are people which got a framebuffer working on domU. But still i couldn't find anything on the internet how to do this. Is there anyone with experience with VFB on xen/arm ? Greetings, Peter van der Perk _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 16 08:17:18 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 08:17:18 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsTLc-0001k7-NK; Mon, 16 Dec 2013 08:16:16 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsTLa-0001jz-QT for xen-users@lists.xen.org; Mon, 16 Dec 2013 08:16:14 +0000 Received: from [85.158.143.35:46332] by server-3.bemta-4.messagelabs.com id 45/F6-32360-EC6BEA25; Mon, 16 Dec 2013 08:16:14 +0000 X-Env-Sender: peter@perkbv.com X-Msg-Ref: server-15.tower-21.messagelabs.com!1387181773!3351901!1 X-Originating-IP: [62.21.193.1] X-SpamReason: No, hits=0.0 required=7.0 tests=UNPARSEABLE_RELAY X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 6103 invoked from network); 16 Dec 2013 08:16:13 -0000 Received: from static.kpn.net (HELO perkbv.com) (62.21.193.1) by server-15.tower-21.messagelabs.com with SMTP; 16 Dec 2013 08:16:13 -0000 Received: from WorldClient by perkbv.com (MDaemon PRO v12.0.3) with ESMTP id md50000129396.msg for ; Mon, 16 Dec 2013 09:16:11 +0100 X-Spam-Processed: perkbv.com, Mon, 16 Dec 2013 09:16:11 +0100 (not processed: message from trusted or authenticated source) X-Authenticated-Sender: peter@perkbv.com X-Return-Path: peter@perkbv.com X-Envelope-From: peter@perkbv.com X-MDaemon-Deliver-To: xen-users@lists.xen.org Received: from [212.123.184.107] by perkbv.com via WorldClient with HTTP; Mon, 16 Dec 2013 09:16:09 +0100 Date: Mon, 16 Dec 2013 09:16:09 +0100 From: "peter" To: xen-users@lists.xen.org MIME-Version: 1.0 Message-ID: X-Mailer: WorldClient 12.0.3 Subject: [Xen-users] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Goodmorning, I'm currently playing with XEN/arm on my Allwinner A20 (cubieboard2) I would like to get the XENFB driver working on domU. But currently in xen/arm there's no support for VFB, atleast qemu is not supported. But this video http://www.youtube.com/watch?v=po1IeElg8tg and this one http://www.youtube.com/watch?v=Km6gBnIqaWo is showing a working framebuffer. So there are people which got a framebuffer working on domU. But still i couldn't find anything on the internet how to do this. Is there anyone with experience with VFB on xen/arm ? Greetings, Peter van der Perk _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 16 08:46:51 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 08:46:51 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsToJ-0003aw-31; Mon, 16 Dec 2013 08:45:55 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsToH-0003ah-4H; Mon, 16 Dec 2013 08:45:53 +0000 Received: from [85.158.143.35:26457] by server-2.bemta-4.messagelabs.com id 66/4E-11386-0CDBEA25; Mon, 16 Dec 2013 08:45:52 +0000 X-Env-Sender: lars.kurth.xen@gmail.com X-Msg-Ref: server-13.tower-21.messagelabs.com!1387183550!4770383!1 X-Originating-IP: [209.85.219.42] X-SpamReason: No, hits=0.9 required=7.0 tests=HTML_40_50,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 21092 invoked from network); 16 Dec 2013 08:45:51 -0000 Received: from mail-oa0-f42.google.com (HELO mail-oa0-f42.google.com) (209.85.219.42) by server-13.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 16 Dec 2013 08:45:51 -0000 Received: by mail-oa0-f42.google.com with SMTP id i4so4687651oah.29 for ; Mon, 16 Dec 2013 00:45:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=VwX1CTQWwk9Qtq4k8J8h6uSyPh2U+kesdAHhe1AU8Ko=; b=ULbri8Hd3f02oxMQQb74b1TQgzzW8YaZpoFvg+US3+TWgZby+ysYfkn+73itMXpp2R fm9TRMq2rDWPOxK0cI9tu//mUNs0JNLGI4hCcYm0WALOaZOlCg7aFAWUcpd5sqjYzp6g UsYY6xHzqKjoi/QwWKva5iEhb0qQvSEDLpEDgs4Ah36fqe7tNmrf/NfY7vqVYKt/SW1O usymWht0sOci4CChRB8tgeQNefTEdp7TT9i65EedDK+pqVDjYoU6JvY4ohn8NYYJWKPu M32TMLxZGyEBaH/vWiYJVBuo0b3E5N1PJGBSYBlARxBJ66/LxTy/avipV7EuY/ERPhk0 MHkg== MIME-Version: 1.0 X-Received: by 10.60.78.9 with SMTP id x9mr588031oew.72.1387183549728; Mon, 16 Dec 2013 00:45:49 -0800 (PST) Received: by 10.60.29.39 with HTTP; Mon, 16 Dec 2013 00:45:49 -0800 (PST) In-Reply-To: References: Date: Mon, 16 Dec 2013 08:45:49 +0000 Message-ID: From: Lars Kurth To: peter Cc: "xen-users@lists.xen.org" , "xen-devel@lists.xen.org" Subject: Re: [Xen-users] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============5347370818312263816==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============5347370818312263816== Content-Type: multipart/alternative; boundary=089e0111bc64b84ead04eda2d6d3 --089e0111bc64b84ead04eda2d6d3 Content-Type: text/plain; charset=ISO-8859-1 Adding xen-devel Lars On Mon, Dec 16, 2013 at 8:16 AM, peter wrote: > Goodmorning, > > I'm currently playing with XEN/arm on my Allwinner A20 (cubieboard2) > I would like to get the XENFB driver working on domU. > But currently in xen/arm there's no support for VFB, atleast qemu is not > supported. > But this video http://www.youtube.com/watch?v=po1IeElg8tg and this one > http://www.youtube.com/watch?v=Km6gBnIqaWo is showing a working > framebuffer. > So there are people which got a framebuffer working on domU. > But still i couldn't find anything on the internet how to do this. > Is there anyone with experience with VFB on xen/arm ? > > Greetings, > > Peter van der Perk > > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > --089e0111bc64b84ead04eda2d6d3 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Adding xen-devel
Lars


On Mon, Dec 16, 2013 at 8:16 AM, p= eter <peter@perkbv.com> wrote:
Goodmorning,

I'm currently playing with XEN/arm on my Allwinner A20 (cubieboard2) I would like to get the XENFB driver working on domU.
But currently in xen/arm there's no support for VFB, atleast qemu is no= t
supported.
But this video http://www.youtube.com/watch?v=3Dpo1IeElg8tg and this on= e
= http://www.youtube.com/watch?v=3DKm6gBnIqaWo is showing a working frame= buffer.
So there are people which got a framebuffer working on domU.
But still i couldn't find anything on the internet how to do this.
Is there anyone with experience with VFB on xen/arm ?

Greetings,

Peter van der Perk



_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.x= en.org/xen-users

--089e0111bc64b84ead04eda2d6d3-- --===============5347370818312263816== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============5347370818312263816==-- From xen-users-bounces@lists.xen.org Mon Dec 16 08:46:51 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 08:46:51 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsToJ-0003aw-31; Mon, 16 Dec 2013 08:45:55 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsToH-0003ah-4H; Mon, 16 Dec 2013 08:45:53 +0000 Received: from [85.158.143.35:26457] by server-2.bemta-4.messagelabs.com id 66/4E-11386-0CDBEA25; Mon, 16 Dec 2013 08:45:52 +0000 X-Env-Sender: lars.kurth.xen@gmail.com X-Msg-Ref: server-13.tower-21.messagelabs.com!1387183550!4770383!1 X-Originating-IP: [209.85.219.42] X-SpamReason: No, hits=0.9 required=7.0 tests=HTML_40_50,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 21092 invoked from network); 16 Dec 2013 08:45:51 -0000 Received: from mail-oa0-f42.google.com (HELO mail-oa0-f42.google.com) (209.85.219.42) by server-13.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 16 Dec 2013 08:45:51 -0000 Received: by mail-oa0-f42.google.com with SMTP id i4so4687651oah.29 for ; Mon, 16 Dec 2013 00:45:49 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :cc:content-type; bh=VwX1CTQWwk9Qtq4k8J8h6uSyPh2U+kesdAHhe1AU8Ko=; b=ULbri8Hd3f02oxMQQb74b1TQgzzW8YaZpoFvg+US3+TWgZby+ysYfkn+73itMXpp2R fm9TRMq2rDWPOxK0cI9tu//mUNs0JNLGI4hCcYm0WALOaZOlCg7aFAWUcpd5sqjYzp6g UsYY6xHzqKjoi/QwWKva5iEhb0qQvSEDLpEDgs4Ah36fqe7tNmrf/NfY7vqVYKt/SW1O usymWht0sOci4CChRB8tgeQNefTEdp7TT9i65EedDK+pqVDjYoU6JvY4ohn8NYYJWKPu M32TMLxZGyEBaH/vWiYJVBuo0b3E5N1PJGBSYBlARxBJ66/LxTy/avipV7EuY/ERPhk0 MHkg== MIME-Version: 1.0 X-Received: by 10.60.78.9 with SMTP id x9mr588031oew.72.1387183549728; Mon, 16 Dec 2013 00:45:49 -0800 (PST) Received: by 10.60.29.39 with HTTP; Mon, 16 Dec 2013 00:45:49 -0800 (PST) In-Reply-To: References: Date: Mon, 16 Dec 2013 08:45:49 +0000 Message-ID: From: Lars Kurth To: peter Cc: "xen-users@lists.xen.org" , "xen-devel@lists.xen.org" Subject: Re: [Xen-users] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============5347370818312263816==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============5347370818312263816== Content-Type: multipart/alternative; boundary=089e0111bc64b84ead04eda2d6d3 --089e0111bc64b84ead04eda2d6d3 Content-Type: text/plain; charset=ISO-8859-1 Adding xen-devel Lars On Mon, Dec 16, 2013 at 8:16 AM, peter wrote: > Goodmorning, > > I'm currently playing with XEN/arm on my Allwinner A20 (cubieboard2) > I would like to get the XENFB driver working on domU. > But currently in xen/arm there's no support for VFB, atleast qemu is not > supported. > But this video http://www.youtube.com/watch?v=po1IeElg8tg and this one > http://www.youtube.com/watch?v=Km6gBnIqaWo is showing a working > framebuffer. > So there are people which got a framebuffer working on domU. > But still i couldn't find anything on the internet how to do this. > Is there anyone with experience with VFB on xen/arm ? > > Greetings, > > Peter van der Perk > > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > --089e0111bc64b84ead04eda2d6d3 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Adding xen-devel
Lars


On Mon, Dec 16, 2013 at 8:16 AM, p= eter <peter@perkbv.com> wrote:
Goodmorning,

I'm currently playing with XEN/arm on my Allwinner A20 (cubieboard2) I would like to get the XENFB driver working on domU.
But currently in xen/arm there's no support for VFB, atleast qemu is no= t
supported.
But this video http://www.youtube.com/watch?v=3Dpo1IeElg8tg and this on= e
= http://www.youtube.com/watch?v=3DKm6gBnIqaWo is showing a working frame= buffer.
So there are people which got a framebuffer working on domU.
But still i couldn't find anything on the internet how to do this.
Is there anyone with experience with VFB on xen/arm ?

Greetings,

Peter van der Perk



_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.x= en.org/xen-users

--089e0111bc64b84ead04eda2d6d3-- --===============5347370818312263816== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============5347370818312263816==-- From xen-users-bounces@lists.xen.org Mon Dec 16 09:59:50 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 09:59:50 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsUxI-0008U4-VA; Mon, 16 Dec 2013 09:59:16 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsUxH-0008Tn-DP; Mon, 16 Dec 2013 09:59:15 +0000 Received: from [85.158.137.68:42205] by server-15.bemta-3.messagelabs.com id DC/87-11556-2FECEA25; Mon, 16 Dec 2013 09:59:14 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-2.tower-31.messagelabs.com!1387187951!4157166!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11259 invoked from network); 16 Dec 2013 09:59:13 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-2.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 16 Dec 2013 09:59:13 -0000 X-IronPort-AV: E=Sophos;i="4.95,493,1384300800"; d="scan'208";a="84844984" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 16 Dec 2013 09:59:11 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL03.citrite.net (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Mon, 16 Dec 2013 04:59:10 -0500 Message-ID: <1387187949.20076.37.camel@kazak.uk.xensource.com> From: Ian Campbell To: peter Date: Mon, 16 Dec 2013 09:59:09 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA2 Cc: Lars Kurth , "xen-users@lists.xen.org" , "xen-devel@lists.xen.org" Subject: Re: [Xen-users] [Xen-devel] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Mon, 2013-12-16 at 08:45 +0000, Lars Kurth wrote: > On Mon, Dec 16, 2013 at 8:16 AM, peter wrote: > I'm currently playing with XEN/arm on my Allwinner A20 (cubieboard2) > I would like to get the XENFB driver working on domU. > But currently in xen/arm there's no support for VFB, atleast qemu is not > supported. > But this video http://www.youtube.com/watch?v=po1IeElg8tg and this one > http://www.youtube.com/watch?v=Km6gBnIqaWo is showing a working framebuffer. > So there are people which got a framebuffer working on domU. > But still i couldn't find anything on the internet how to do this. > Is there anyone with experience with VFB on xen/arm ? I'm not sure what the first link used but the second was using a form of hybrid GPU passthrough/paravirtualisation for which the code has not been reeleased and AFAIK has nothing to do with VFB. I've not tried VFB on ARM yet (busy with other things) but I suspect that if you were to build upstream qemu on ARM with Xen support enabled then it would just work. I would recommend giving that a go -- please let us know how you get on. Below is a patch which I wrote ages ago that I have just rebased onto current xen staging *without retesting*. It is supposed to DTWT and enable the qemu build for ARM (as well as providing a mechanism to start the correct dom0 qemu, which you don't need for vfb). As I say I haven't tested, or even built, and in particular I never tried PVFB with it even what I wrote it, so YMMV. Ian. commit 7b5d54c9a5d09c4138bec905c9accea34173ba77 Author: Ian Campbell Date: Wed May 15 16:34:55 2013 +0100 tools: build and launch correct qemu for architecture xl now provides a launch-dom0-qemu command which avoids the need to have the initscripts be aware of the specific qermu binary name, which differs by architecture and which also may have been specified by the user via the --with-system-qemu=PATH option to configure. Perhaps this should be a separate binary hidden in libexec? Signed-off-by: Ian Campbell diff --git a/config/arm32.mk b/config/arm32.mk index aa79d22..f3599a3 100644 --- a/config/arm32.mk +++ b/config/arm32.mk @@ -3,6 +3,8 @@ CONFIG_ARM_32 := y CONFIG_ARM_$(XEN_OS) := y CONFIG_XEN_INSTALL_SUFFIX := +CONFIG_QEMU_ARCH := arm +CONFIG_QEMU_TARGET := arm-softmmu # -march= -mcpu= diff --git a/config/arm64.mk b/config/arm64.mk index 15b57a4..4ff15e0 100644 --- a/config/arm64.mk +++ b/config/arm64.mk @@ -3,6 +3,8 @@ CONFIG_ARM_64 := y CONFIG_ARM_$(XEN_OS) := y CONFIG_XEN_INSTALL_SUFFIX := +CONFIG_QEMU_ARCH := aarch64 +CONFIG_QEMU_TARGET := arm-softmmu CFLAGS += #-marm -march= -mcpu= etc diff --git a/config/x86_32.mk b/config/x86_32.mk index 7f76b25..da3111d 100644 --- a/config/x86_32.mk +++ b/config/x86_32.mk @@ -2,6 +2,9 @@ CONFIG_X86 := y CONFIG_X86_32 := y CONFIG_X86_$(XEN_OS) := y +CONFIG_QEMU_ARCH := i386 +CONFIG_QEMU_TARGET := i386-softmmu + CONFIG_HVM := y CONFIG_MIGRATE := y CONFIG_XCUTILS := y diff --git a/config/x86_64.mk b/config/x86_64.mk index 11104bd..f59e36d 100644 --- a/config/x86_64.mk +++ b/config/x86_64.mk @@ -2,6 +2,9 @@ CONFIG_X86 := y CONFIG_X86_64 := y CONFIG_X86_$(XEN_OS) := y +CONFIG_QEMU_ARCH := x86_64 +CONFIG_QEMU_ARCH := i386-softmmu + CONFIG_COMPAT := y CONFIG_HVM := y CONFIG_MIGRATE := y diff --git a/tools/Makefile b/tools/Makefile index 00c69ee..250b931 100644 --- a/tools/Makefile +++ b/tools/Makefile @@ -107,7 +107,7 @@ distclean: subdirs-distclean config.cache autom4te.cache ifneq ($(XEN_COMPILE_ARCH),$(XEN_TARGET_ARCH)) -IOEMU_CONFIGURE_CROSS ?= --cpu=$(XEN_TARGET_ARCH) \ +IOEMU_CONFIGURE_CROSS ?= --cpu=$(CONFIG_QEMU_ARCH) \ --cross-prefix=$(CROSS_COMPILE) \ --interp-prefix=$(CROSS_SYS_ROOT) endif @@ -186,8 +186,7 @@ subdir-all-qemu-xen-dir: qemu-xen-dir-find source=.; \ fi; \ cd qemu-xen-dir; \ - $$source/configure --enable-xen --target-list=i386-softmmu \ - $(QEMU_XEN_ENABLE_DEBUG) \ + $$source/configure --enable-xen --target-list=$(CONFIG_QEMU_TARGET) \ --prefix=$(PREFIX) \ --source-path=$$source \ --extra-cflags="-I$(XEN_ROOT)/tools/include \ diff --git a/tools/hotplug/Linux/init.d/xencommons b/tools/hotplug/Linux/init.d/xencommons index 4ebd636..f568085 100644 --- a/tools/hotplug/Linux/init.d/xencommons +++ b/tools/hotplug/Linux/init.d/xencommons @@ -116,11 +116,7 @@ do_start () { echo Starting xenconsoled... test -z "$XENCONSOLED_TRACE" || XENCONSOLED_ARGS=" --log=$XENCONSOLED_TRACE" ${SBINDIR}/xenconsoled --pid-file=$XENCONSOLED_PIDFILE $XENCONSOLED_ARGS - echo Starting QEMU as disk backend for dom0 - test -z "$QEMU_XEN" && QEMU_XEN="${LIBEXEC}/qemu-system-i386" - $QEMU_XEN -xen-domid 0 -xen-attach -name dom0 -nographic -M xenpv -daemonize \ - -monitor /dev/null -serial /dev/null -parallel /dev/null \ - -pidfile $QEMU_PIDFILE + xl launch-dom0-qemu $QEMU_XEN } do_stop () { echo Stopping xenconsoled diff --git a/tools/libxl/Makefile b/tools/libxl/Makefile index d8495bb..d8b6a5c 100644 --- a/tools/libxl/Makefile +++ b/tools/libxl/Makefile @@ -27,6 +27,7 @@ CFLAGS_LIBXL += $(CFLAGS_libxenguest) CFLAGS_LIBXL += $(CFLAGS_libxenstore) CFLAGS_LIBXL += $(CFLAGS_libblktapctl) CFLAGS_LIBXL += -Wshadow +CFLAGS_LIBXL += -DCONFIG_QEMU_ARCH=\"$(CONFIG_QEMU_ARCH)\" LIBXL_LIBS-$(CONFIG_ARM) += -lfdt diff --git a/tools/libxl/libxl.h b/tools/libxl/libxl.h index 12d6c31..0287a35 100644 --- a/tools/libxl/libxl.h +++ b/tools/libxl/libxl.h @@ -605,6 +605,9 @@ int libxl_ctx_alloc(libxl_ctx **pctx, int version, xentoollog_logger *lg); int libxl_ctx_free(libxl_ctx *ctx /* 0 is OK */); +/* exec's device model for dom0 and does not return. */ +void libxl_launch_dom0_qemu(libxl_ctx *ctx, const char *qemu_path, const char *pidfile); + /* domain related functions */ int libxl_domain_create_new(libxl_ctx *ctx, libxl_domain_config *d_config, diff --git a/tools/libxl/libxl_dm.c b/tools/libxl/libxl_dm.c index f6f7bbd..f0b13a9 100644 --- a/tools/libxl/libxl_dm.c +++ b/tools/libxl/libxl_dm.c @@ -38,7 +38,7 @@ static const char *qemu_xen_path(libxl__gc *gc) #ifdef QEMU_XEN_PATH return QEMU_XEN_PATH; #else - return libxl__abs_path(gc, "qemu-system-i386", libxl__libexec_path()); + return libxl__abs_path(gc, "qemu-system-" CONFIG_QEMU_ARCH, libxl__libexec_path()); #endif } @@ -1560,6 +1560,37 @@ out: return ret; } +void libxl_launch_dom0_qemu(libxl_ctx *ctx, const char *qemu_path, const char *pidfile) +{ + GC_INIT(ctx); + + flexarray_t *dm_args = flexarray_make(gc, 16, 1); + + if (qemu_path == NULL) + qemu_path = qemu_xen_path(gc); + + flexarray_vappend(dm_args, + "-xen-domid", "0", + "-xen-attach", + "-name", "dom0", + "-nographic", + "-M" "xenpv", + "-daemonize", + "-monitor", "/dev/null", + "-serial", "/dev/null", + "-parallel", "/dev/null", + NULL); + if (pidfile) + flexarray_append_pair(dm_args, "-pidfile", libxl__strdup(gc, pidfile)); + + libxl__exec(gc, -1, -1, -1, + qemu_path, (char **)flexarray_contents(dm_args), NULL); + + /* Shouldn't return */ + LOG(CRITICAL, "Failed to exec dom0 device model"); + GC_FREE; +} + /* * Local variables: * mode: C diff --git a/tools/libxl/xl.h b/tools/libxl/xl.h index c876a33..1d7602c 100644 --- a/tools/libxl/xl.h +++ b/tools/libxl/xl.h @@ -106,6 +106,7 @@ int main_setenforce(int argc, char **argv); int main_loadpolicy(int argc, char **argv); int main_remus(int argc, char **argv); int main_devd(int argc, char **argv); +int main_launch_dom0_qemu(int argc, char **argv); void help(const char *command); diff --git a/tools/libxl/xl_cmdimpl.c b/tools/libxl/xl_cmdimpl.c index bd26bcc..108dfac 100644 --- a/tools/libxl/xl_cmdimpl.c +++ b/tools/libxl/xl_cmdimpl.c @@ -7313,6 +7313,31 @@ out: return ret; } +int main_launch_dom0_qemu(int argc, char **argv) +{ + int opt; + const char *qemu = NULL; + const char *pidfile = NULL; + + SWITCH_FOREACH_OPT(opt, "p:", NULL, "launch-dom-qemu", 0) { + case 'p': + pidfile = optarg; + break; + /* No options */ + } + if (optind < argc) + qemu = argv[optind]; + + fprintf(stderr, "argc %d\n", argc); + fprintf(stderr, "qemu = %s", qemu ? : ""); + + fprintf(stdout, "Starting QEMU as disk backend for dom0"); + + libxl_launch_dom0_qemu(ctx, qemu, pidfile); + + return 0; +} + /* * Local variables: * mode: C diff --git a/tools/libxl/xl_cmdtable.c b/tools/libxl/xl_cmdtable.c index ebe0220..ab4d56c 100644 --- a/tools/libxl/xl_cmdtable.c +++ b/tools/libxl/xl_cmdtable.c @@ -494,6 +494,12 @@ struct cmd_spec cmd_table[] = { "[options]", "-F Run in the foreground", }, + { "launch-dom0-qemu", + &main_launch_dom0_qemu, 0, 1, + "Start qemu process to service dom0 disk backends", + "[options] [QEMU_PATH]", + "-p PIDFILE Write a PIDFILE\n", + }, }; int cmdtable_len = sizeof(cmd_table)/sizeof(struct cmd_spec); _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 16 09:59:50 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 09:59:50 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsUxI-0008U4-VA; Mon, 16 Dec 2013 09:59:16 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsUxH-0008Tn-DP; Mon, 16 Dec 2013 09:59:15 +0000 Received: from [85.158.137.68:42205] by server-15.bemta-3.messagelabs.com id DC/87-11556-2FECEA25; Mon, 16 Dec 2013 09:59:14 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-2.tower-31.messagelabs.com!1387187951!4157166!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11259 invoked from network); 16 Dec 2013 09:59:13 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-2.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 16 Dec 2013 09:59:13 -0000 X-IronPort-AV: E=Sophos;i="4.95,493,1384300800"; d="scan'208";a="84844984" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 16 Dec 2013 09:59:11 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL03.citrite.net (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Mon, 16 Dec 2013 04:59:10 -0500 Message-ID: <1387187949.20076.37.camel@kazak.uk.xensource.com> From: Ian Campbell To: peter Date: Mon, 16 Dec 2013 09:59:09 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA2 Cc: Lars Kurth , "xen-users@lists.xen.org" , "xen-devel@lists.xen.org" Subject: Re: [Xen-users] [Xen-devel] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Mon, 2013-12-16 at 08:45 +0000, Lars Kurth wrote: > On Mon, Dec 16, 2013 at 8:16 AM, peter wrote: > I'm currently playing with XEN/arm on my Allwinner A20 (cubieboard2) > I would like to get the XENFB driver working on domU. > But currently in xen/arm there's no support for VFB, atleast qemu is not > supported. > But this video http://www.youtube.com/watch?v=po1IeElg8tg and this one > http://www.youtube.com/watch?v=Km6gBnIqaWo is showing a working framebuffer. > So there are people which got a framebuffer working on domU. > But still i couldn't find anything on the internet how to do this. > Is there anyone with experience with VFB on xen/arm ? I'm not sure what the first link used but the second was using a form of hybrid GPU passthrough/paravirtualisation for which the code has not been reeleased and AFAIK has nothing to do with VFB. I've not tried VFB on ARM yet (busy with other things) but I suspect that if you were to build upstream qemu on ARM with Xen support enabled then it would just work. I would recommend giving that a go -- please let us know how you get on. Below is a patch which I wrote ages ago that I have just rebased onto current xen staging *without retesting*. It is supposed to DTWT and enable the qemu build for ARM (as well as providing a mechanism to start the correct dom0 qemu, which you don't need for vfb). As I say I haven't tested, or even built, and in particular I never tried PVFB with it even what I wrote it, so YMMV. Ian. commit 7b5d54c9a5d09c4138bec905c9accea34173ba77 Author: Ian Campbell Date: Wed May 15 16:34:55 2013 +0100 tools: build and launch correct qemu for architecture xl now provides a launch-dom0-qemu command which avoids the need to have the initscripts be aware of the specific qermu binary name, which differs by architecture and which also may have been specified by the user via the --with-system-qemu=PATH option to configure. Perhaps this should be a separate binary hidden in libexec? Signed-off-by: Ian Campbell diff --git a/config/arm32.mk b/config/arm32.mk index aa79d22..f3599a3 100644 --- a/config/arm32.mk +++ b/config/arm32.mk @@ -3,6 +3,8 @@ CONFIG_ARM_32 := y CONFIG_ARM_$(XEN_OS) := y CONFIG_XEN_INSTALL_SUFFIX := +CONFIG_QEMU_ARCH := arm +CONFIG_QEMU_TARGET := arm-softmmu # -march= -mcpu= diff --git a/config/arm64.mk b/config/arm64.mk index 15b57a4..4ff15e0 100644 --- a/config/arm64.mk +++ b/config/arm64.mk @@ -3,6 +3,8 @@ CONFIG_ARM_64 := y CONFIG_ARM_$(XEN_OS) := y CONFIG_XEN_INSTALL_SUFFIX := +CONFIG_QEMU_ARCH := aarch64 +CONFIG_QEMU_TARGET := arm-softmmu CFLAGS += #-marm -march= -mcpu= etc diff --git a/config/x86_32.mk b/config/x86_32.mk index 7f76b25..da3111d 100644 --- a/config/x86_32.mk +++ b/config/x86_32.mk @@ -2,6 +2,9 @@ CONFIG_X86 := y CONFIG_X86_32 := y CONFIG_X86_$(XEN_OS) := y +CONFIG_QEMU_ARCH := i386 +CONFIG_QEMU_TARGET := i386-softmmu + CONFIG_HVM := y CONFIG_MIGRATE := y CONFIG_XCUTILS := y diff --git a/config/x86_64.mk b/config/x86_64.mk index 11104bd..f59e36d 100644 --- a/config/x86_64.mk +++ b/config/x86_64.mk @@ -2,6 +2,9 @@ CONFIG_X86 := y CONFIG_X86_64 := y CONFIG_X86_$(XEN_OS) := y +CONFIG_QEMU_ARCH := x86_64 +CONFIG_QEMU_ARCH := i386-softmmu + CONFIG_COMPAT := y CONFIG_HVM := y CONFIG_MIGRATE := y diff --git a/tools/Makefile b/tools/Makefile index 00c69ee..250b931 100644 --- a/tools/Makefile +++ b/tools/Makefile @@ -107,7 +107,7 @@ distclean: subdirs-distclean config.cache autom4te.cache ifneq ($(XEN_COMPILE_ARCH),$(XEN_TARGET_ARCH)) -IOEMU_CONFIGURE_CROSS ?= --cpu=$(XEN_TARGET_ARCH) \ +IOEMU_CONFIGURE_CROSS ?= --cpu=$(CONFIG_QEMU_ARCH) \ --cross-prefix=$(CROSS_COMPILE) \ --interp-prefix=$(CROSS_SYS_ROOT) endif @@ -186,8 +186,7 @@ subdir-all-qemu-xen-dir: qemu-xen-dir-find source=.; \ fi; \ cd qemu-xen-dir; \ - $$source/configure --enable-xen --target-list=i386-softmmu \ - $(QEMU_XEN_ENABLE_DEBUG) \ + $$source/configure --enable-xen --target-list=$(CONFIG_QEMU_TARGET) \ --prefix=$(PREFIX) \ --source-path=$$source \ --extra-cflags="-I$(XEN_ROOT)/tools/include \ diff --git a/tools/hotplug/Linux/init.d/xencommons b/tools/hotplug/Linux/init.d/xencommons index 4ebd636..f568085 100644 --- a/tools/hotplug/Linux/init.d/xencommons +++ b/tools/hotplug/Linux/init.d/xencommons @@ -116,11 +116,7 @@ do_start () { echo Starting xenconsoled... test -z "$XENCONSOLED_TRACE" || XENCONSOLED_ARGS=" --log=$XENCONSOLED_TRACE" ${SBINDIR}/xenconsoled --pid-file=$XENCONSOLED_PIDFILE $XENCONSOLED_ARGS - echo Starting QEMU as disk backend for dom0 - test -z "$QEMU_XEN" && QEMU_XEN="${LIBEXEC}/qemu-system-i386" - $QEMU_XEN -xen-domid 0 -xen-attach -name dom0 -nographic -M xenpv -daemonize \ - -monitor /dev/null -serial /dev/null -parallel /dev/null \ - -pidfile $QEMU_PIDFILE + xl launch-dom0-qemu $QEMU_XEN } do_stop () { echo Stopping xenconsoled diff --git a/tools/libxl/Makefile b/tools/libxl/Makefile index d8495bb..d8b6a5c 100644 --- a/tools/libxl/Makefile +++ b/tools/libxl/Makefile @@ -27,6 +27,7 @@ CFLAGS_LIBXL += $(CFLAGS_libxenguest) CFLAGS_LIBXL += $(CFLAGS_libxenstore) CFLAGS_LIBXL += $(CFLAGS_libblktapctl) CFLAGS_LIBXL += -Wshadow +CFLAGS_LIBXL += -DCONFIG_QEMU_ARCH=\"$(CONFIG_QEMU_ARCH)\" LIBXL_LIBS-$(CONFIG_ARM) += -lfdt diff --git a/tools/libxl/libxl.h b/tools/libxl/libxl.h index 12d6c31..0287a35 100644 --- a/tools/libxl/libxl.h +++ b/tools/libxl/libxl.h @@ -605,6 +605,9 @@ int libxl_ctx_alloc(libxl_ctx **pctx, int version, xentoollog_logger *lg); int libxl_ctx_free(libxl_ctx *ctx /* 0 is OK */); +/* exec's device model for dom0 and does not return. */ +void libxl_launch_dom0_qemu(libxl_ctx *ctx, const char *qemu_path, const char *pidfile); + /* domain related functions */ int libxl_domain_create_new(libxl_ctx *ctx, libxl_domain_config *d_config, diff --git a/tools/libxl/libxl_dm.c b/tools/libxl/libxl_dm.c index f6f7bbd..f0b13a9 100644 --- a/tools/libxl/libxl_dm.c +++ b/tools/libxl/libxl_dm.c @@ -38,7 +38,7 @@ static const char *qemu_xen_path(libxl__gc *gc) #ifdef QEMU_XEN_PATH return QEMU_XEN_PATH; #else - return libxl__abs_path(gc, "qemu-system-i386", libxl__libexec_path()); + return libxl__abs_path(gc, "qemu-system-" CONFIG_QEMU_ARCH, libxl__libexec_path()); #endif } @@ -1560,6 +1560,37 @@ out: return ret; } +void libxl_launch_dom0_qemu(libxl_ctx *ctx, const char *qemu_path, const char *pidfile) +{ + GC_INIT(ctx); + + flexarray_t *dm_args = flexarray_make(gc, 16, 1); + + if (qemu_path == NULL) + qemu_path = qemu_xen_path(gc); + + flexarray_vappend(dm_args, + "-xen-domid", "0", + "-xen-attach", + "-name", "dom0", + "-nographic", + "-M" "xenpv", + "-daemonize", + "-monitor", "/dev/null", + "-serial", "/dev/null", + "-parallel", "/dev/null", + NULL); + if (pidfile) + flexarray_append_pair(dm_args, "-pidfile", libxl__strdup(gc, pidfile)); + + libxl__exec(gc, -1, -1, -1, + qemu_path, (char **)flexarray_contents(dm_args), NULL); + + /* Shouldn't return */ + LOG(CRITICAL, "Failed to exec dom0 device model"); + GC_FREE; +} + /* * Local variables: * mode: C diff --git a/tools/libxl/xl.h b/tools/libxl/xl.h index c876a33..1d7602c 100644 --- a/tools/libxl/xl.h +++ b/tools/libxl/xl.h @@ -106,6 +106,7 @@ int main_setenforce(int argc, char **argv); int main_loadpolicy(int argc, char **argv); int main_remus(int argc, char **argv); int main_devd(int argc, char **argv); +int main_launch_dom0_qemu(int argc, char **argv); void help(const char *command); diff --git a/tools/libxl/xl_cmdimpl.c b/tools/libxl/xl_cmdimpl.c index bd26bcc..108dfac 100644 --- a/tools/libxl/xl_cmdimpl.c +++ b/tools/libxl/xl_cmdimpl.c @@ -7313,6 +7313,31 @@ out: return ret; } +int main_launch_dom0_qemu(int argc, char **argv) +{ + int opt; + const char *qemu = NULL; + const char *pidfile = NULL; + + SWITCH_FOREACH_OPT(opt, "p:", NULL, "launch-dom-qemu", 0) { + case 'p': + pidfile = optarg; + break; + /* No options */ + } + if (optind < argc) + qemu = argv[optind]; + + fprintf(stderr, "argc %d\n", argc); + fprintf(stderr, "qemu = %s", qemu ? : ""); + + fprintf(stdout, "Starting QEMU as disk backend for dom0"); + + libxl_launch_dom0_qemu(ctx, qemu, pidfile); + + return 0; +} + /* * Local variables: * mode: C diff --git a/tools/libxl/xl_cmdtable.c b/tools/libxl/xl_cmdtable.c index ebe0220..ab4d56c 100644 --- a/tools/libxl/xl_cmdtable.c +++ b/tools/libxl/xl_cmdtable.c @@ -494,6 +494,12 @@ struct cmd_spec cmd_table[] = { "[options]", "-F Run in the foreground", }, + { "launch-dom0-qemu", + &main_launch_dom0_qemu, 0, 1, + "Start qemu process to service dom0 disk backends", + "[options] [QEMU_PATH]", + "-p PIDFILE Write a PIDFILE\n", + }, }; int cmdtable_len = sizeof(cmd_table)/sizeof(struct cmd_spec); _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 16 10:13:36 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 10:13:36 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVAx-0001TS-HY; Mon, 16 Dec 2013 10:13:23 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVAv-0001TK-V8 for xen-users@lists.xen.org; Mon, 16 Dec 2013 10:13:22 +0000 Received: from [85.158.137.68:61987] by server-14.bemta-3.messagelabs.com id 02/61-06105-142DEA25; Mon, 16 Dec 2013 10:13:21 +0000 X-Env-Sender: paulojjs@gmail.com X-Msg-Ref: server-9.tower-31.messagelabs.com!1387188799!3016098!1 X-Originating-IP: [209.85.223.177] X-SpamReason: No, hits=0.4 required=7.0 tests=HTML_30_40,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 22847 invoked from network); 16 Dec 2013 10:13:20 -0000 Received: from mail-ie0-f177.google.com (HELO mail-ie0-f177.google.com) (209.85.223.177) by server-9.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 16 Dec 2013 10:13:20 -0000 Received: by mail-ie0-f177.google.com with SMTP id tp5so6156511ieb.36 for ; Mon, 16 Dec 2013 02:13:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=DM7V5YJndGqLl6rd+izSit19cYdANM4L9xUcx1a9v8Q=; b=RjjT25X6Xpjo1gn/9Col9gxzROBZlKJATCwvG1BRQ4XMaegy/Ul8mwRzDfFs35s8hb P+NcmNZVXi507ku81Za06pI1SmREnaxnbvhaH+XOOuIzL7RV4MlgLzFnXiiwF3ugWHQ9 E3l9KlCKFDSy9EcagJBuWqSgWsuBMrZtW1QR5+auyxlmEV5Fpc3oglP4tCPNobwjrwrO I8HHLUYz4Pd+hQURhk6qC0XTdzdfkYRDS692sbbDwqXUS0liHE/TIDbIhZL26lekqP2I eiwLsOy7Jvnp3HiiH6McI4oFzaxynSMGWjvnZEerDcesFwkvSXOW0rcZ6M2q7RmtxF0z 0Zgg== X-Received: by 10.50.117.103 with SMTP id kd7mr14078166igb.4.1387188798701; Mon, 16 Dec 2013 02:13:18 -0800 (PST) MIME-Version: 1.0 Received: by 10.50.225.148 with HTTP; Mon, 16 Dec 2013 02:12:58 -0800 (PST) From: Paulo Silva Date: Mon, 16 Dec 2013 10:12:58 +0000 Message-ID: To: xen-users@lists.xen.org Subject: [Xen-users] Problem with network counters in Windows gplpv drivers X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6141821301816350975==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6141821301816350975== Content-Type: multipart/alternative; boundary=089e013a084c955f1404eda40fe1 --089e013a084c955f1404eda40fe1 Content-Type: text/plain; charset=ISO-8859-1 Hi, I'm using the Windows gplpv drivers (0.11.0.372) on a Windows 2008 R2 x86_64 and I'm trying to retrieve the network interface statistics using WMI or SNMP. Both of them show values for Packets Sent, Packets Received and Bytes Sent but Bytes Received has always the value of 0, anyone has the same problem? Thanks -- Paulo Silva --089e013a084c955f1404eda40fe1 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi,

I'm using the Windows = gplpv drivers (0.11.0.372) on a Windows 2008 R2 x86_64 and I'm trying t= o retrieve the network interface statistics using WMI or SNMP.

Both of them show values for Packets Sent, Packets Received and Bytes Sent = but Bytes Received has always the value of 0, anyone has the same problem?<= br>
Thanks
--
Paulo Silva <paulojjs@gmail.com>
--089e013a084c955f1404eda40fe1-- --===============6141821301816350975== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6141821301816350975==-- From xen-users-bounces@lists.xen.org Mon Dec 16 10:13:36 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 10:13:36 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVAx-0001TS-HY; Mon, 16 Dec 2013 10:13:23 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVAv-0001TK-V8 for xen-users@lists.xen.org; Mon, 16 Dec 2013 10:13:22 +0000 Received: from [85.158.137.68:61987] by server-14.bemta-3.messagelabs.com id 02/61-06105-142DEA25; Mon, 16 Dec 2013 10:13:21 +0000 X-Env-Sender: paulojjs@gmail.com X-Msg-Ref: server-9.tower-31.messagelabs.com!1387188799!3016098!1 X-Originating-IP: [209.85.223.177] X-SpamReason: No, hits=0.4 required=7.0 tests=HTML_30_40,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 22847 invoked from network); 16 Dec 2013 10:13:20 -0000 Received: from mail-ie0-f177.google.com (HELO mail-ie0-f177.google.com) (209.85.223.177) by server-9.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 16 Dec 2013 10:13:20 -0000 Received: by mail-ie0-f177.google.com with SMTP id tp5so6156511ieb.36 for ; Mon, 16 Dec 2013 02:13:18 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=DM7V5YJndGqLl6rd+izSit19cYdANM4L9xUcx1a9v8Q=; b=RjjT25X6Xpjo1gn/9Col9gxzROBZlKJATCwvG1BRQ4XMaegy/Ul8mwRzDfFs35s8hb P+NcmNZVXi507ku81Za06pI1SmREnaxnbvhaH+XOOuIzL7RV4MlgLzFnXiiwF3ugWHQ9 E3l9KlCKFDSy9EcagJBuWqSgWsuBMrZtW1QR5+auyxlmEV5Fpc3oglP4tCPNobwjrwrO I8HHLUYz4Pd+hQURhk6qC0XTdzdfkYRDS692sbbDwqXUS0liHE/TIDbIhZL26lekqP2I eiwLsOy7Jvnp3HiiH6McI4oFzaxynSMGWjvnZEerDcesFwkvSXOW0rcZ6M2q7RmtxF0z 0Zgg== X-Received: by 10.50.117.103 with SMTP id kd7mr14078166igb.4.1387188798701; Mon, 16 Dec 2013 02:13:18 -0800 (PST) MIME-Version: 1.0 Received: by 10.50.225.148 with HTTP; Mon, 16 Dec 2013 02:12:58 -0800 (PST) From: Paulo Silva Date: Mon, 16 Dec 2013 10:12:58 +0000 Message-ID: To: xen-users@lists.xen.org Subject: [Xen-users] Problem with network counters in Windows gplpv drivers X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6141821301816350975==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6141821301816350975== Content-Type: multipart/alternative; boundary=089e013a084c955f1404eda40fe1 --089e013a084c955f1404eda40fe1 Content-Type: text/plain; charset=ISO-8859-1 Hi, I'm using the Windows gplpv drivers (0.11.0.372) on a Windows 2008 R2 x86_64 and I'm trying to retrieve the network interface statistics using WMI or SNMP. Both of them show values for Packets Sent, Packets Received and Bytes Sent but Bytes Received has always the value of 0, anyone has the same problem? Thanks -- Paulo Silva --089e013a084c955f1404eda40fe1 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi,

I'm using the Windows = gplpv drivers (0.11.0.372) on a Windows 2008 R2 x86_64 and I'm trying t= o retrieve the network interface statistics using WMI or SNMP.

Both of them show values for Packets Sent, Packets Received and Bytes Sent = but Bytes Received has always the value of 0, anyone has the same problem?<= br>
Thanks
--
Paulo Silva <paulojjs@gmail.com>
--089e013a084c955f1404eda40fe1-- --===============6141821301816350975== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6141821301816350975==-- From xen-users-bounces@lists.xen.org Mon Dec 16 10:27:27 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 10:27:27 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVOC-0002TK-4K; Mon, 16 Dec 2013 10:27:04 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVOA-0002TE-Ll for xen-users@lists.xen.org; Mon, 16 Dec 2013 10:27:03 +0000 Received: from [193.109.254.147:50053] by server-13.bemta-14.messagelabs.com id F4/0D-19374-675DEA25; Mon, 16 Dec 2013 10:27:02 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-12.tower-27.messagelabs.com!1387189619!5481067!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 29056 invoked from network); 16 Dec 2013 10:27:01 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-12.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 16 Dec 2013 10:27:01 -0000 X-IronPort-AV: E=Sophos;i="4.95,493,1384300800"; d="scan'208";a="84851007" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 16 Dec 2013 10:26:59 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL01.citrite.net (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Mon, 16 Dec 2013 05:26:58 -0500 Message-ID: <1387189617.20076.51.camel@kazak.uk.xensource.com> From: Ian Campbell To: Etzion Bar-Noy Date: Mon, 16 Dec 2013 10:26:57 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA2 Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] Nested virtualization instabilities X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Sat, 2013-12-14 at 00:40 +0200, Etzion Bar-Noy wrote: > Hi. > > I am using the unstable build-from-source of Xen community. It reports > as 4.4, and was pulled from Git two days ago. The problem I will > describe below appears on version 4.3.1, compiled from source as well. > In both cases - I used spec file to create my own RPMs, because it's > the right method of doing it. > > > Problem: When VM running under HVM which is a hypervisor (XenServer > 6.2 or VMware ESXi5.5) attempts to start a (HVM) virtual machine, the > following happens, 100% reproducible on this server. > > XenServer: domain crush. XenServer restarts itself. It doesn't happen > for PV on XenServer VM The guest Xen is crashing, or the host Xen? I think the guest. Nested virt is currently a tech preview and it certainly looks to me like you've found a bug. Please can you send your report to xen-devel@. See http://wiki.xen.org/wiki/Reporting_Bugs_against_Xen for some additional hints on what to include (actually, this report seems like a good start). I don't think you said if you were using Intel or AMD processors, but please CC the relevant maintainer as well as the list: AMD: Suravee Suthikulpanit Intel: Jun Nakajima , Eddie Dong Cheers, Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 16 10:27:27 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 10:27:27 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVOC-0002TK-4K; Mon, 16 Dec 2013 10:27:04 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVOA-0002TE-Ll for xen-users@lists.xen.org; Mon, 16 Dec 2013 10:27:03 +0000 Received: from [193.109.254.147:50053] by server-13.bemta-14.messagelabs.com id F4/0D-19374-675DEA25; Mon, 16 Dec 2013 10:27:02 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-12.tower-27.messagelabs.com!1387189619!5481067!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 29056 invoked from network); 16 Dec 2013 10:27:01 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-12.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 16 Dec 2013 10:27:01 -0000 X-IronPort-AV: E=Sophos;i="4.95,493,1384300800"; d="scan'208";a="84851007" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 16 Dec 2013 10:26:59 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL01.citrite.net (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Mon, 16 Dec 2013 05:26:58 -0500 Message-ID: <1387189617.20076.51.camel@kazak.uk.xensource.com> From: Ian Campbell To: Etzion Bar-Noy Date: Mon, 16 Dec 2013 10:26:57 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA2 Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] Nested virtualization instabilities X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Sat, 2013-12-14 at 00:40 +0200, Etzion Bar-Noy wrote: > Hi. > > I am using the unstable build-from-source of Xen community. It reports > as 4.4, and was pulled from Git two days ago. The problem I will > describe below appears on version 4.3.1, compiled from source as well. > In both cases - I used spec file to create my own RPMs, because it's > the right method of doing it. > > > Problem: When VM running under HVM which is a hypervisor (XenServer > 6.2 or VMware ESXi5.5) attempts to start a (HVM) virtual machine, the > following happens, 100% reproducible on this server. > > XenServer: domain crush. XenServer restarts itself. It doesn't happen > for PV on XenServer VM The guest Xen is crashing, or the host Xen? I think the guest. Nested virt is currently a tech preview and it certainly looks to me like you've found a bug. Please can you send your report to xen-devel@. See http://wiki.xen.org/wiki/Reporting_Bugs_against_Xen for some additional hints on what to include (actually, this report seems like a good start). I don't think you said if you were using Intel or AMD processors, but please CC the relevant maintainer as well as the list: AMD: Suravee Suthikulpanit Intel: Jun Nakajima , Eddie Dong Cheers, Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 16 10:49:51 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 10:49:51 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVjr-00047a-R3; Mon, 16 Dec 2013 10:49:27 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVjq-00047T-E7 for xen-users@lists.xen.org; Mon, 16 Dec 2013 10:49:26 +0000 Received: from [193.109.254.147:48715] by server-15.bemta-14.messagelabs.com id E6/5E-22186-5BADEA25; Mon, 16 Dec 2013 10:49:25 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-5.tower-27.messagelabs.com!1387190963!5494056!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 16904 invoked from network); 16 Dec 2013 10:49:25 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-5.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 16 Dec 2013 10:49:25 -0000 X-IronPort-AV: E=Sophos;i="4.95,494,1384300800"; d="scan'208";a="84855530" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 16 Dec 2013 10:49:23 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL01.citrite.net (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Mon, 16 Dec 2013 05:49:23 -0500 Message-ID: <1387190962.20076.65.camel@kazak.uk.xensource.com> From: Ian Campbell To: Zir Blazer Date: Mon, 16 Dec 2013 10:49:22 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA2 Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] Xen black screens while booting in Arch Linux with UEFI GRUB X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Sat, 2013-12-14 at 03:49 -0300, Zir Blazer wrote: > Basically, the issue I have goes like this: After installing Arch > Linux in UEFI mode, I install Xen on top of it following Arch Linux > wiki instructions for Xen. GRUB allows me to choose to load Xen Arch, I don't know if this is related but AFAIK Xen does not currently support being launched under UEFI via a bootloader. Instead xen.efi is a UEFI application which can be launched from the EFI shell directly (i.e. instead of grub.efi). http://xenbits.xen.org/docs/4.3-testing/misc/efi.html has some details of the config file used here. People are working on launching Xen via bootloaders under UEFI but I don't think it is complete/available yet in any released (or unreleased ror that matter) version of Xen. (BTW, you didn't say what version of Xen you are using, not too relevant this time, but please remember next time). Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 16 10:49:51 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 10:49:51 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVjr-00047a-R3; Mon, 16 Dec 2013 10:49:27 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVjq-00047T-E7 for xen-users@lists.xen.org; Mon, 16 Dec 2013 10:49:26 +0000 Received: from [193.109.254.147:48715] by server-15.bemta-14.messagelabs.com id E6/5E-22186-5BADEA25; Mon, 16 Dec 2013 10:49:25 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-5.tower-27.messagelabs.com!1387190963!5494056!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 16904 invoked from network); 16 Dec 2013 10:49:25 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-5.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 16 Dec 2013 10:49:25 -0000 X-IronPort-AV: E=Sophos;i="4.95,494,1384300800"; d="scan'208";a="84855530" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 16 Dec 2013 10:49:23 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL01.citrite.net (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Mon, 16 Dec 2013 05:49:23 -0500 Message-ID: <1387190962.20076.65.camel@kazak.uk.xensource.com> From: Ian Campbell To: Zir Blazer Date: Mon, 16 Dec 2013 10:49:22 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA2 Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] Xen black screens while booting in Arch Linux with UEFI GRUB X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Sat, 2013-12-14 at 03:49 -0300, Zir Blazer wrote: > Basically, the issue I have goes like this: After installing Arch > Linux in UEFI mode, I install Xen on top of it following Arch Linux > wiki instructions for Xen. GRUB allows me to choose to load Xen Arch, I don't know if this is related but AFAIK Xen does not currently support being launched under UEFI via a bootloader. Instead xen.efi is a UEFI application which can be launched from the EFI shell directly (i.e. instead of grub.efi). http://xenbits.xen.org/docs/4.3-testing/misc/efi.html has some details of the config file used here. People are working on launching Xen via bootloaders under UEFI but I don't think it is complete/available yet in any released (or unreleased ror that matter) version of Xen. (BTW, you didn't say what version of Xen you are using, not too relevant this time, but please remember next time). Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 16 10:54:30 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 10:54:30 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVoZ-0004zJ-KT; Mon, 16 Dec 2013 10:54:19 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVoY-0004z2-B1 for xen-users@lists.xen.org; Mon, 16 Dec 2013 10:54:18 +0000 Received: from [85.158.139.211:42257] by server-13.bemta-5.messagelabs.com id 63/36-11357-9DBDEA25; Mon, 16 Dec 2013 10:54:17 +0000 X-Env-Sender: etzion@barnoy.co.il X-Msg-Ref: server-16.tower-206.messagelabs.com!1387191254!3526531!1 X-Originating-IP: [209.85.192.181] X-SpamReason: No, hits=0.9 required=7.0 tests=BODY_DONG,HTML_30_40, HTML_MESSAGE,RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 15012 invoked from network); 16 Dec 2013 10:54:16 -0000 Received: from mail-pd0-f181.google.com (HELO mail-pd0-f181.google.com) (209.85.192.181) by server-16.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 16 Dec 2013 10:54:16 -0000 Received: by mail-pd0-f181.google.com with SMTP id p10so5136714pdj.26 for ; Mon, 16 Dec 2013 02:54:14 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=RT6sn+74sD0EktAJwdZt8ZAwvCuHGse1o2WvvlagcCM=; b=E27sY8fwesU6bojtxmqvCMs9Xj8+yfFroiC6FLiiy87ZUlqxQKOBZQkK+yfwT6rOez xZ2vl3nuZVzrmfZxzGFOiJOrH3iZxOpuzf91TWF3mIxTHjoxVnqPDT9LWEPxa4zFHb6L engY0iT1c1beCxSLEPaWKUxmWOxI/WN8uBF7B5IQbpwCeKeqqnoVllXkH4isb67HV8tx EZnVveFObnNIl6YI1EBh3PRNueEYVNRGd4/M3dhYNdFXKXxIj21JHvlAkMNCBFgm8RFn Ncz+2iUdb9rjvykOxwV+sanBf8CGW51hrKCrm2rZ7Y6zKYhxbeYshvxKAjtQ+b3wgDS3 yRaQ== X-Gm-Message-State: ALoCoQnPuOE7IgyPGeIQID+CfJN2+ORf9HKv/DIriN68oHSt9s7kdtiXcikBL7QywIZrGVFk1G/u MIME-Version: 1.0 X-Received: by 10.66.11.68 with SMTP id o4mr19446188pab.54.1387191253498; Mon, 16 Dec 2013 02:54:13 -0800 (PST) Received: by 10.66.147.166 with HTTP; Mon, 16 Dec 2013 02:54:13 -0800 (PST) X-Originating-IP: [85.64.43.73] In-Reply-To: <1387189617.20076.51.camel@kazak.uk.xensource.com> References: <1387189617.20076.51.camel@kazak.uk.xensource.com> Date: Mon, 16 Dec 2013 12:54:13 +0200 Message-ID: From: Etzion Bar-Noy To: Ian Campbell Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] Nested virtualization instabilities X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============2958263541409712121==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============2958263541409712121== Content-Type: multipart/alternative; boundary=bcaec520e8f5f08bbd04eda4a195 --bcaec520e8f5f08bbd04eda4a195 Content-Type: text/plain; charset=ISO-8859-1 Thanks. I will re-post at xen-devel and add both to CC, per your suggestion. This is Intel, and to clarify things: Host (physical hardware): is host. Nested hypervisor (level 1 virtualization): is the domain that crushes Nested VM (level 2 virtualization): is the domain that as soon as started (using HVM on the *nested Hypervisor*) causes the nested Hypervisor to crush. Etzion On Mon, Dec 16, 2013 at 12:26 PM, Ian Campbell wrote: > On Sat, 2013-12-14 at 00:40 +0200, Etzion Bar-Noy wrote: > > Hi. > > > > I am using the unstable build-from-source of Xen community. It reports > > as 4.4, and was pulled from Git two days ago. The problem I will > > describe below appears on version 4.3.1, compiled from source as well. > > In both cases - I used spec file to create my own RPMs, because it's > > the right method of doing it. > > > > > > Problem: When VM running under HVM which is a hypervisor (XenServer > > 6.2 or VMware ESXi5.5) attempts to start a (HVM) virtual machine, the > > following happens, 100% reproducible on this server. > > > > XenServer: domain crush. XenServer restarts itself. It doesn't happen > > for PV on XenServer VM > > The guest Xen is crashing, or the host Xen? I think the guest. > > Nested virt is currently a tech preview and it certainly looks to me > like you've found a bug. Please can you send your report to xen-devel@. > See http://wiki.xen.org/wiki/Reporting_Bugs_against_Xen for some > additional hints on what to include (actually, this report seems like a > good start). > > I don't think you said if you were using Intel or AMD processors, but > please CC the relevant maintainer as well as the list: > AMD: Suravee Suthikulpanit > Intel: Jun Nakajima , Eddie Dong < > eddie.dong@intel.com> > > Cheers, > Ian. > > > --bcaec520e8f5f08bbd04eda4a195 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Thanks. I will re-post at xen-devel an= d add both to CC, per your suggestion.
This is Intel, and to clarify thi= ngs:
Host (physical hardware): is host.
Nested hypervisor= (level 1 virtualization): is the domain that crushes
Nested VM (level 2 virtualization): is the domain that as soon as sta= rted (using HVM on the nested Hypervisor) causes the nested Hypervis= or to crush.

Etzion


On Mon, Dec 16, 2013 at 12:26 PM, Ian Ca= mpbell <Ian.Campbell@citrix.com> wrote:
On Sat, 2013-12-14 at 00:40 +0200, Etzion Bar-Noy wrote:<= br> > Hi.
>
> I am using the unstable build-from-source of Xen community. It reports=
> as 4.4, and was pulled from Git two days ago. The problem I will
> describe below appears on version 4.3.1, compiled from source as well.=
> In both cases - I used spec file to create my own RPMs, because it'= ;s
> the right method of doing it.
>
>
> Problem: When VM running under HVM which is a hypervisor (XenServer > 6.2 or VMware ESXi5.5) attempts to start a (HVM) virtual machine, the<= br> > following happens, 100% reproducible on this server.
>
> XenServer: domain crush. XenServer restarts itself. It doesn't hap= pen
> for PV on XenServer VM

The guest Xen is crashing, or the host Xen? I think the guest.

Nested virt is currently a tech preview and it certainly looks to me
like you've found a bug. Please can you send your report to xen-devel@.=
See http://wiki.xen.org/wiki/Reporting_Bugs_against_Xen for som= e
additional hints on what to include (actually, this report seems like a
good start).

I don't think you said if you were using Intel or AMD processors, but please CC the relevant maintainer as well as the list:
AMD: Suravee Suthikulpanit <suravee.suthikulpanit@amd.com>
Intel: Jun Nakajima <jun.nakaj= ima@intel.com>, Eddie Dong <eddie.dong@intel.com>

Cheers,
Ian.



--bcaec520e8f5f08bbd04eda4a195-- --===============2958263541409712121== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============2958263541409712121==-- From xen-users-bounces@lists.xen.org Mon Dec 16 10:54:30 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 10:54:30 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVoZ-0004zJ-KT; Mon, 16 Dec 2013 10:54:19 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsVoY-0004z2-B1 for xen-users@lists.xen.org; Mon, 16 Dec 2013 10:54:18 +0000 Received: from [85.158.139.211:42257] by server-13.bemta-5.messagelabs.com id 63/36-11357-9DBDEA25; Mon, 16 Dec 2013 10:54:17 +0000 X-Env-Sender: etzion@barnoy.co.il X-Msg-Ref: server-16.tower-206.messagelabs.com!1387191254!3526531!1 X-Originating-IP: [209.85.192.181] X-SpamReason: No, hits=0.9 required=7.0 tests=BODY_DONG,HTML_30_40, HTML_MESSAGE,RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 15012 invoked from network); 16 Dec 2013 10:54:16 -0000 Received: from mail-pd0-f181.google.com (HELO mail-pd0-f181.google.com) (209.85.192.181) by server-16.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 16 Dec 2013 10:54:16 -0000 Received: by mail-pd0-f181.google.com with SMTP id p10so5136714pdj.26 for ; Mon, 16 Dec 2013 02:54:14 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=RT6sn+74sD0EktAJwdZt8ZAwvCuHGse1o2WvvlagcCM=; b=E27sY8fwesU6bojtxmqvCMs9Xj8+yfFroiC6FLiiy87ZUlqxQKOBZQkK+yfwT6rOez xZ2vl3nuZVzrmfZxzGFOiJOrH3iZxOpuzf91TWF3mIxTHjoxVnqPDT9LWEPxa4zFHb6L engY0iT1c1beCxSLEPaWKUxmWOxI/WN8uBF7B5IQbpwCeKeqqnoVllXkH4isb67HV8tx EZnVveFObnNIl6YI1EBh3PRNueEYVNRGd4/M3dhYNdFXKXxIj21JHvlAkMNCBFgm8RFn Ncz+2iUdb9rjvykOxwV+sanBf8CGW51hrKCrm2rZ7Y6zKYhxbeYshvxKAjtQ+b3wgDS3 yRaQ== X-Gm-Message-State: ALoCoQnPuOE7IgyPGeIQID+CfJN2+ORf9HKv/DIriN68oHSt9s7kdtiXcikBL7QywIZrGVFk1G/u MIME-Version: 1.0 X-Received: by 10.66.11.68 with SMTP id o4mr19446188pab.54.1387191253498; Mon, 16 Dec 2013 02:54:13 -0800 (PST) Received: by 10.66.147.166 with HTTP; Mon, 16 Dec 2013 02:54:13 -0800 (PST) X-Originating-IP: [85.64.43.73] In-Reply-To: <1387189617.20076.51.camel@kazak.uk.xensource.com> References: <1387189617.20076.51.camel@kazak.uk.xensource.com> Date: Mon, 16 Dec 2013 12:54:13 +0200 Message-ID: From: Etzion Bar-Noy To: Ian Campbell Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] Nested virtualization instabilities X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============2958263541409712121==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============2958263541409712121== Content-Type: multipart/alternative; boundary=bcaec520e8f5f08bbd04eda4a195 --bcaec520e8f5f08bbd04eda4a195 Content-Type: text/plain; charset=ISO-8859-1 Thanks. I will re-post at xen-devel and add both to CC, per your suggestion. This is Intel, and to clarify things: Host (physical hardware): is host. Nested hypervisor (level 1 virtualization): is the domain that crushes Nested VM (level 2 virtualization): is the domain that as soon as started (using HVM on the *nested Hypervisor*) causes the nested Hypervisor to crush. Etzion On Mon, Dec 16, 2013 at 12:26 PM, Ian Campbell wrote: > On Sat, 2013-12-14 at 00:40 +0200, Etzion Bar-Noy wrote: > > Hi. > > > > I am using the unstable build-from-source of Xen community. It reports > > as 4.4, and was pulled from Git two days ago. The problem I will > > describe below appears on version 4.3.1, compiled from source as well. > > In both cases - I used spec file to create my own RPMs, because it's > > the right method of doing it. > > > > > > Problem: When VM running under HVM which is a hypervisor (XenServer > > 6.2 or VMware ESXi5.5) attempts to start a (HVM) virtual machine, the > > following happens, 100% reproducible on this server. > > > > XenServer: domain crush. XenServer restarts itself. It doesn't happen > > for PV on XenServer VM > > The guest Xen is crashing, or the host Xen? I think the guest. > > Nested virt is currently a tech preview and it certainly looks to me > like you've found a bug. Please can you send your report to xen-devel@. > See http://wiki.xen.org/wiki/Reporting_Bugs_against_Xen for some > additional hints on what to include (actually, this report seems like a > good start). > > I don't think you said if you were using Intel or AMD processors, but > please CC the relevant maintainer as well as the list: > AMD: Suravee Suthikulpanit > Intel: Jun Nakajima , Eddie Dong < > eddie.dong@intel.com> > > Cheers, > Ian. > > > --bcaec520e8f5f08bbd04eda4a195 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Thanks. I will re-post at xen-devel an= d add both to CC, per your suggestion.
This is Intel, and to clarify thi= ngs:
Host (physical hardware): is host.
Nested hypervisor= (level 1 virtualization): is the domain that crushes
Nested VM (level 2 virtualization): is the domain that as soon as sta= rted (using HVM on the nested Hypervisor) causes the nested Hypervis= or to crush.

Etzion


On Mon, Dec 16, 2013 at 12:26 PM, Ian Ca= mpbell <Ian.Campbell@citrix.com> wrote:
On Sat, 2013-12-14 at 00:40 +0200, Etzion Bar-Noy wrote:<= br> > Hi.
>
> I am using the unstable build-from-source of Xen community. It reports=
> as 4.4, and was pulled from Git two days ago. The problem I will
> describe below appears on version 4.3.1, compiled from source as well.=
> In both cases - I used spec file to create my own RPMs, because it'= ;s
> the right method of doing it.
>
>
> Problem: When VM running under HVM which is a hypervisor (XenServer > 6.2 or VMware ESXi5.5) attempts to start a (HVM) virtual machine, the<= br> > following happens, 100% reproducible on this server.
>
> XenServer: domain crush. XenServer restarts itself. It doesn't hap= pen
> for PV on XenServer VM

The guest Xen is crashing, or the host Xen? I think the guest.

Nested virt is currently a tech preview and it certainly looks to me
like you've found a bug. Please can you send your report to xen-devel@.=
See http://wiki.xen.org/wiki/Reporting_Bugs_against_Xen for som= e
additional hints on what to include (actually, this report seems like a
good start).

I don't think you said if you were using Intel or AMD processors, but please CC the relevant maintainer as well as the list:
AMD: Suravee Suthikulpanit <suravee.suthikulpanit@amd.com>
Intel: Jun Nakajima <jun.nakaj= ima@intel.com>, Eddie Dong <eddie.dong@intel.com>

Cheers,
Ian.



--bcaec520e8f5f08bbd04eda4a195-- --===============2958263541409712121== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============2958263541409712121==-- From xen-users-bounces@lists.xen.org Mon Dec 16 21:46:26 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 21:46:26 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vsfyd-0007Rd-BW; Mon, 16 Dec 2013 21:45:23 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vsfya-0007RE-9K; Mon, 16 Dec 2013 21:45:20 +0000 Received: from [193.109.254.147:29432] by server-12.bemta-14.messagelabs.com id 48/4B-13681-F647FA25; Mon, 16 Dec 2013 21:45:19 +0000 X-Env-Sender: russell.pavlicek.xen@gmail.com X-Msg-Ref: server-14.tower-27.messagelabs.com!1387230315!5657353!1 X-Originating-IP: [209.85.160.53] X-SpamReason: No, hits=2.5 required=7.0 tests=RCVD_BY_IP, SUSPICIOUS_RECIPS X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 28158 invoked from network); 16 Dec 2013 21:45:17 -0000 Received: from mail-pb0-f53.google.com (HELO mail-pb0-f53.google.com) (209.85.160.53) by server-14.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 16 Dec 2013 21:45:17 -0000 Received: by mail-pb0-f53.google.com with SMTP id ma3so6046352pbc.12 for ; Mon, 16 Dec 2013 13:45:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=/uEsoH1FeykVwEKECfpAXy9txQsBdW6tI2sNCJHk3PE=; b=dJmDlj9vQPo3VOsMDQjpG3tQbvw2IrmrHd7+OlRKXJlkL1QRmDCLB4TqB05z4RLSWb Os8QzR2xmMI5pkkUafnJmUwVOsWnVoSjsQjBjyra2hthk82OYqCDHRQAQdKivgCjyvMq XMJlFVIojUDG1zZ/0QrrLQCot2xXXxqBa0lS88AKRtXBL/xwbOlLQADJReF8VLx35oFA kOFY/hLXYYo3Wf/ZonG1C74QyizmSemipj7/EiptEDwJACOfhhhO2ppQRVdWNXVJewe+ UwClk021WFihhPKk8u1LznCKzPebePzeLy/ujdSdT6tyZJVhKnD5GaGBowhKQrgIubPy 2Rqg== MIME-Version: 1.0 X-Received: by 10.68.252.161 with SMTP id zt1mr23009874pbc.130.1387230314798; Mon, 16 Dec 2013 13:45:14 -0800 (PST) Received: by 10.68.78.137 with HTTP; Mon, 16 Dec 2013 13:45:14 -0800 (PST) Date: Mon, 16 Dec 2013 16:45:14 -0500 X-Google-Sender-Auth: EwEFb0s6T0ejSdkQHmy73X-ANP8 Message-ID: From: Russ Pavlicek To: "xen-users@lists.xen.org" , xen-devel@lists.xen.org, xen-api@lists.xen.org, cl-mirage@lists.cam.ac.uk, xs-devel@lists.xenserver.org Subject: [Xen-users] Xen Project User Summit 2014 Location Survey X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org We are beginning the plans for the 2014 Xen Project User Summit, but we have a problem: We are not sure where it should be held! Help us out by taking a 2 minute survey about location of the User Summit. Also, let us know if it should be colocated with some other conference like we did last year. Just go to the survey link and let us know what you think: https://www.surveymonkey.com/s/YJQCHJ6 Thanks! Russ Pavlicek Coordinator for XPUS 2014 _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 16 21:46:26 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 16 Dec 2013 21:46:26 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vsfyd-0007Rd-BW; Mon, 16 Dec 2013 21:45:23 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vsfya-0007RE-9K; Mon, 16 Dec 2013 21:45:20 +0000 Received: from [193.109.254.147:29432] by server-12.bemta-14.messagelabs.com id 48/4B-13681-F647FA25; Mon, 16 Dec 2013 21:45:19 +0000 X-Env-Sender: russell.pavlicek.xen@gmail.com X-Msg-Ref: server-14.tower-27.messagelabs.com!1387230315!5657353!1 X-Originating-IP: [209.85.160.53] X-SpamReason: No, hits=2.5 required=7.0 tests=RCVD_BY_IP, SUSPICIOUS_RECIPS X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 28158 invoked from network); 16 Dec 2013 21:45:17 -0000 Received: from mail-pb0-f53.google.com (HELO mail-pb0-f53.google.com) (209.85.160.53) by server-14.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 16 Dec 2013 21:45:17 -0000 Received: by mail-pb0-f53.google.com with SMTP id ma3so6046352pbc.12 for ; Mon, 16 Dec 2013 13:45:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=/uEsoH1FeykVwEKECfpAXy9txQsBdW6tI2sNCJHk3PE=; b=dJmDlj9vQPo3VOsMDQjpG3tQbvw2IrmrHd7+OlRKXJlkL1QRmDCLB4TqB05z4RLSWb Os8QzR2xmMI5pkkUafnJmUwVOsWnVoSjsQjBjyra2hthk82OYqCDHRQAQdKivgCjyvMq XMJlFVIojUDG1zZ/0QrrLQCot2xXXxqBa0lS88AKRtXBL/xwbOlLQADJReF8VLx35oFA kOFY/hLXYYo3Wf/ZonG1C74QyizmSemipj7/EiptEDwJACOfhhhO2ppQRVdWNXVJewe+ UwClk021WFihhPKk8u1LznCKzPebePzeLy/ujdSdT6tyZJVhKnD5GaGBowhKQrgIubPy 2Rqg== MIME-Version: 1.0 X-Received: by 10.68.252.161 with SMTP id zt1mr23009874pbc.130.1387230314798; Mon, 16 Dec 2013 13:45:14 -0800 (PST) Received: by 10.68.78.137 with HTTP; Mon, 16 Dec 2013 13:45:14 -0800 (PST) Date: Mon, 16 Dec 2013 16:45:14 -0500 X-Google-Sender-Auth: EwEFb0s6T0ejSdkQHmy73X-ANP8 Message-ID: From: Russ Pavlicek To: "xen-users@lists.xen.org" , xen-devel@lists.xen.org, xen-api@lists.xen.org, cl-mirage@lists.cam.ac.uk, xs-devel@lists.xenserver.org Subject: [Xen-users] Xen Project User Summit 2014 Location Survey X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org We are beginning the plans for the 2014 Xen Project User Summit, but we have a problem: We are not sure where it should be held! Help us out by taking a 2 minute survey about location of the User Summit. Also, let us know if it should be colocated with some other conference like we did last year. Just go to the survey link and let us know what you think: https://www.surveymonkey.com/s/YJQCHJ6 Thanks! Russ Pavlicek Coordinator for XPUS 2014 _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 17 07:21:35 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 07:21:35 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsoxF-0001c5-Ip; Tue, 17 Dec 2013 07:20:33 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsoxD-0001bq-8b; Tue, 17 Dec 2013 07:20:31 +0000 Received: from [85.158.137.68:10277] by server-5.bemta-3.messagelabs.com id 8F/04-25188-E3BFFA25; Tue, 17 Dec 2013 07:20:30 +0000 X-Env-Sender: peter@perkbv.com X-Msg-Ref: server-9.tower-31.messagelabs.com!1387264827!3218906!1 X-Originating-IP: [62.21.193.1] X-SpamReason: No, hits=0.0 required=7.0 tests=UNPARSEABLE_RELAY X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 13990 invoked from network); 17 Dec 2013 07:20:27 -0000 Received: from static.kpn.net (HELO perkbv.com) (62.21.193.1) by server-9.tower-31.messagelabs.com with SMTP; 17 Dec 2013 07:20:27 -0000 Received: from WorldClient by perkbv.com (MDaemon PRO v12.0.3) with ESMTP id md50000129728.msg; Tue, 17 Dec 2013 08:20:26 +0100 X-Spam-Processed: perkbv.com, Tue, 17 Dec 2013 08:20:26 +0100 (not processed: message from trusted or authenticated source) X-Authenticated-Sender: peter@perkbv.com X-Return-Path: peter@perkbv.com X-Envelope-From: peter@perkbv.com Received: from [212.123.184.107] by perkbv.com via WorldClient with HTTP; Tue, 17 Dec 2013 08:20:23 +0100 Date: Tue, 17 Dec 2013 08:20:23 +0100 From: "peter" To: "Ian Campbell" MIME-Version: 1.0 Message-ID: X-Mailer: WorldClient 12.0.3 In-Reply-To: <1387187949.20076.37.camel@kazak.uk.xensource.com> References: <1387187949.20076.37.camel@kazak.uk.xensource.com> Cc: Lars Kurth , xen-users@lists.xen.org, xen-devel@lists.xen.org Subject: Re: [Xen-users] [Xen-devel] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Thank you for the info/patch Ian. With some modifications to Qemu, I managed to cross compile qemu-system-arm with XEN support. Based on version: 1c514a7734b7f98625a0d18d5e8ee7581f26e50c (Merge remote branch 'perard/cpu-hotplug-port-v2' into xen-staging-master-7). And got my Qemu backend working. I can see that INPUT_XEN_KBDDEV_FRONTEND is working (d9) 6input: Xen Virtual Keyboard as /devices/virtual/input/input0 (d9) 6input: Xen Virtual Pointer as /devices/virtual/input/input1 And that XEN bus is prompting for VFB (d9) 6xenbus_probe_frontend: Device with no driver: device/vfb/0 But it seems that the xen-fbfront only supports PV and not PVH. (Linux kernel 3.12-RC5) Because the init code is returning on: if (!xen_pv_domain()) return -ENODEV; When I comment this code out. I do get these errors: [ 1698.899496] Failed to unmap pfn:5c081 rc:-2 (XEN) dom10 IPA 0x0000000000000000 (XEN) P2M @ 021b8300 mfn:0x4dc18 (XEN) 1ST[0x0] = 0x000000004da276ff (XEN) 2ND[0x0] = 0x000000006b6856ff (XEN) 3RD[0x0] = 0x0000000000000000 [ 1698.933034] Failed to map pfn to mfn rc:0:-22 pfn:5c349 mfn:0 (XEN) dom10 IPA 0x000000002777c000 (XEN) P2M @ 021b8300 mfn:0x4dc18 (XEN) 1ST[0x0] = 0x000000004da276ff (XEN) 2ND[0x13b] = 0x0000000000000000 [ 1698.951353] Failed to map pfn to mfn rc:0:-22 pfn:5c348 mfn:b6b2777c Yes lots of them, and my VFB is not working tough. So I've searched on the internet if someone got VFB on PVH working. But I couldn't find anything about, so is there someone who got VFB working on PVH (x86) ? -----Original Message----- From: Ian Campbell To: peter Cc: "xen-users@lists.xen.org" , "xen-devel@lists.xen.org" , Lars Kurth Date: Mon, 16 Dec 2013 09:59:09 +0000 Subject: Re: [Xen-devel] [Xen-users] XEN/arm XENFB support > On Mon, 2013-12-16 at 08:45 +0000, Lars Kurth wrote: > > > On Mon, Dec 16, 2013 at 8:16 AM, peter wrote: > > I'm currently playing with XEN/arm on my Allwinner A20 > (cubieboard2) > > I would like to get the XENFB driver working on domU. > > But currently in xen/arm there's no support for VFB, atleast > qemu is not > > supported. > > But this video http://www.youtube.com/watch?v=po1IeElg8tg and > this one > > http://www.youtube.com/watch?v=Km6gBnIqaWo is showing a > working framebuffer. > > So there are people which got a framebuffer working on domU. > > But still i couldn't find anything on the internet how to do > this. > > Is there anyone with experience with VFB on xen/arm ? > > I'm not sure what the first link used but the second was using a form > of > hybrid GPU passthrough/paravirtualisation for which the code has not > been reeleased and AFAIK has nothing to do with VFB. > > I've not tried VFB on ARM yet (busy with other things) but I suspect > that if you were to build upstream qemu on ARM with Xen support enabled > then it would just work. I would recommend giving that a go -- please > let us know how you get on. > > Below is a patch which I wrote ages ago that I have just rebased onto > current xen staging *without retesting*. It is supposed to DTWT and > enable the qemu build for ARM (as well as providing a mechanism to > start > the correct dom0 qemu, which you don't need for vfb). > > As I say I haven't tested, or even built, and in particular I never > tried PVFB with it even what I wrote it, so YMMV. > > Ian. > > > commit 7b5d54c9a5d09c4138bec905c9accea34173ba77 > Author: Ian Campbell > Date: Wed May 15 16:34:55 2013 +0100 > > tools: build and launch correct qemu for architecture > > xl now provides a launch-dom0-qemu command which avoids the need to > have the > initscripts be aware of the specific qermu binary name, which > differs by > architecture and which also may have been specified by the user via > the > --with-system-qemu=PATH option to configure. > > Perhaps this should be a separate binary hidden in libexec? > > Signed-off-by: Ian Campbell > > diff --git a/config/arm32.mk b/config/arm32.mk > index aa79d22..f3599a3 100644 > --- a/config/arm32.mk > +++ b/config/arm32.mk > @@ -3,6 +3,8 @@ CONFIG_ARM_32 := y > CONFIG_ARM_$(XEN_OS) := y > > CONFIG_XEN_INSTALL_SUFFIX := > +CONFIG_QEMU_ARCH := arm > +CONFIG_QEMU_TARGET := arm-softmmu > > # -march= -mcpu= > > diff --git a/config/arm64.mk b/config/arm64.mk > index 15b57a4..4ff15e0 100644 > --- a/config/arm64.mk > +++ b/config/arm64.mk > @@ -3,6 +3,8 @@ CONFIG_ARM_64 := y > CONFIG_ARM_$(XEN_OS) := y > > CONFIG_XEN_INSTALL_SUFFIX := > +CONFIG_QEMU_ARCH := aarch64 > +CONFIG_QEMU_TARGET := arm-softmmu > > CFLAGS += #-marm -march= -mcpu= etc > > diff --git a/config/x86_32.mk b/config/x86_32.mk > index 7f76b25..da3111d 100644 > --- a/config/x86_32.mk > +++ b/config/x86_32.mk > @@ -2,6 +2,9 @@ CONFIG_X86 := y > CONFIG_X86_32 := y > CONFIG_X86_$(XEN_OS) := y > > +CONFIG_QEMU_ARCH := i386 > +CONFIG_QEMU_TARGET := i386-softmmu > + > CONFIG_HVM := y > CONFIG_MIGRATE := y > CONFIG_XCUTILS := y > diff --git a/config/x86_64.mk b/config/x86_64.mk > index 11104bd..f59e36d 100644 > --- a/config/x86_64.mk > +++ b/config/x86_64.mk > @@ -2,6 +2,9 @@ CONFIG_X86 := y > CONFIG_X86_64 := y > CONFIG_X86_$(XEN_OS) := y > > +CONFIG_QEMU_ARCH := x86_64 > +CONFIG_QEMU_ARCH := i386-softmmu > + > CONFIG_COMPAT := y > CONFIG_HVM := y > CONFIG_MIGRATE := y > diff --git a/tools/Makefile b/tools/Makefile > index 00c69ee..250b931 100644 > --- a/tools/Makefile > +++ b/tools/Makefile > @@ -107,7 +107,7 @@ distclean: subdirs-distclean > config.cache autom4te.cache > > ifneq ($(XEN_COMPILE_ARCH),$(XEN_TARGET_ARCH)) > -IOEMU_CONFIGURE_CROSS ?= --cpu=$(XEN_TARGET_ARCH) \ > +IOEMU_CONFIGURE_CROSS ?= --cpu=$(CONFIG_QEMU_ARCH) \ > --cross-prefix=$(CROSS_COMPILE) \ > --interp-prefix=$(CROSS_SYS_ROOT) > endif > @@ -186,8 +186,7 @@ subdir-all-qemu-xen-dir: qemu-xen-dir-find > source=.; \ > fi; \ > cd qemu-xen-dir; \ > - $$source/configure --enable-xen --target-list=i386-softmmu \ > - $(QEMU_XEN_ENABLE_DEBUG) \ > + $$source/configure --enable-xen --target-list=$(CONFIG_QEMU_TARGET) \ > --prefix=$(PREFIX) \ > --source-path=$$source \ > --extra-cflags="-I$(XEN_ROOT)/tools/include \ > diff --git a/tools/hotplug/Linux/init.d/xencommons > b/tools/hotplug/Linux/init.d/xencommons > index 4ebd636..f568085 100644 > --- a/tools/hotplug/Linux/init.d/xencommons > +++ b/tools/hotplug/Linux/init.d/xencommons > @@ -116,11 +116,7 @@ do_start () { > echo Starting xenconsoled... > test -z "$XENCONSOLED_TRACE" || XENCONSOLED_ARGS=" > --log=$XENCONSOLED_TRACE" > ${SBINDIR}/xenconsoled --pid-file=$XENCONSOLED_PIDFILE > $XENCONSOLED_ARGS > - echo Starting QEMU as disk backend for dom0 > - test -z "$QEMU_XEN" && QEMU_XEN="${LIBEXEC}/qemu-system-i386" > - $QEMU_XEN -xen-domid 0 -xen-attach -name dom0 -nographic -M xenpv > -daemonize \ > - -monitor /dev/null -serial /dev/null -parallel /dev/null \ > - -pidfile $QEMU_PIDFILE > + xl launch-dom0-qemu $QEMU_XEN > } > do_stop () { > echo Stopping xenconsoled > diff --git a/tools/libxl/Makefile b/tools/libxl/Makefile > index d8495bb..d8b6a5c 100644 > --- a/tools/libxl/Makefile > +++ b/tools/libxl/Makefile > @@ -27,6 +27,7 @@ CFLAGS_LIBXL += $(CFLAGS_libxenguest) > CFLAGS_LIBXL += $(CFLAGS_libxenstore) > CFLAGS_LIBXL += $(CFLAGS_libblktapctl) > CFLAGS_LIBXL += -Wshadow > +CFLAGS_LIBXL += -DCONFIG_QEMU_ARCH=\"$(CONFIG_QEMU_ARCH)\" > > LIBXL_LIBS-$(CONFIG_ARM) += -lfdt > > diff --git a/tools/libxl/libxl.h b/tools/libxl/libxl.h > index 12d6c31..0287a35 100644 > --- a/tools/libxl/libxl.h > +++ b/tools/libxl/libxl.h > @@ -605,6 +605,9 @@ int libxl_ctx_alloc(libxl_ctx **pctx, int version, > xentoollog_logger *lg); > int libxl_ctx_free(libxl_ctx *ctx /* 0 is OK */); > > +/* exec's device model for dom0 and does not return. */ > +void libxl_launch_dom0_qemu(libxl_ctx *ctx, const char *qemu_path, > const char *pidfile); > + > /* domain related functions */ > > int libxl_domain_create_new(libxl_ctx *ctx, libxl_domain_config > *d_config, > diff --git a/tools/libxl/libxl_dm.c b/tools/libxl/libxl_dm.c > index f6f7bbd..f0b13a9 100644 > --- a/tools/libxl/libxl_dm.c > +++ b/tools/libxl/libxl_dm.c > @@ -38,7 +38,7 @@ static const char *qemu_xen_path(libxl__gc *gc) > #ifdef QEMU_XEN_PATH > return QEMU_XEN_PATH; > #else > - return libxl__abs_path(gc, "qemu-system-i386", > libxl__libexec_path()); > + return libxl__abs_path(gc, "qemu-system-" CONFIG_QEMU_ARCH, > libxl__libexec_path()); > #endif > } > > @@ -1560,6 +1560,37 @@ out: > return ret; > } > > +void libxl_launch_dom0_qemu(libxl_ctx *ctx, const char *qemu_path, > const char *pidfile) > +{ > + GC_INIT(ctx); > + > + flexarray_t *dm_args = flexarray_make(gc, 16, 1); > + > + if (qemu_path == NULL) > + qemu_path = qemu_xen_path(gc); > + > + flexarray_vappend(dm_args, > + "-xen-domid", "0", > + "-xen-attach", > + "-name", "dom0", > + "-nographic", > + "-M" "xenpv", > + "-daemonize", > + "-monitor", "/dev/null", > + "-serial", "/dev/null", > + "-parallel", "/dev/null", > + NULL); > + if (pidfile) > + flexarray_append_pair(dm_args, "-pidfile", libxl__strdup(gc, > pidfile)); > + > + libxl__exec(gc, -1, -1, -1, > + qemu_path, (char **)flexarray_contents(dm_args), > NULL); > + > + /* Shouldn't return */ > + LOG(CRITICAL, "Failed to exec dom0 device model"); > + GC_FREE; > +} > + > /* > * Local variables: > * mode: C > diff --git a/tools/libxl/xl.h b/tools/libxl/xl.h > index c876a33..1d7602c 100644 > --- a/tools/libxl/xl.h > +++ b/tools/libxl/xl.h > @@ -106,6 +106,7 @@ int main_setenforce(int argc, char **argv); > int main_loadpolicy(int argc, char **argv); > int main_remus(int argc, char **argv); > int main_devd(int argc, char **argv); > +int main_launch_dom0_qemu(int argc, char **argv); > > void help(const char *command); > > diff --git a/tools/libxl/xl_cmdimpl.c b/tools/libxl/xl_cmdimpl.c > index bd26bcc..108dfac 100644 > --- a/tools/libxl/xl_cmdimpl.c > +++ b/tools/libxl/xl_cmdimpl.c > @@ -7313,6 +7313,31 @@ out: > return ret; > } > > +int main_launch_dom0_qemu(int argc, char **argv) > +{ > + int opt; > + const char *qemu = NULL; > + const char *pidfile = NULL; > + > + SWITCH_FOREACH_OPT(opt, "p:", NULL, "launch-dom-qemu", 0) { > + case 'p': > + pidfile = optarg; > + break; > + /* No options */ > + } > + if (optind < argc) > + qemu = argv[optind]; > + > + fprintf(stderr, "argc %d\n", argc); > + fprintf(stderr, "qemu = %s", qemu ? : ""); > + > + fprintf(stdout, "Starting QEMU as disk backend for dom0"); > + > + libxl_launch_dom0_qemu(ctx, qemu, pidfile); > + > + return 0; > +} > + > /* > * Local variables: > * mode: C > diff --git a/tools/libxl/xl_cmdtable.c b/tools/libxl/xl_cmdtable.c > index ebe0220..ab4d56c 100644 > --- a/tools/libxl/xl_cmdtable.c > +++ b/tools/libxl/xl_cmdtable.c > @@ -494,6 +494,12 @@ struct cmd_spec cmd_table[] = { > "[options]", > "-F Run in the foreground", > }, > + { "launch-dom0-qemu", > + &main_launch_dom0_qemu, 0, 1, > + "Start qemu process to service dom0 disk backends", > + "[options] [QEMU_PATH]", > + "-p PIDFILE Write a PIDFILE\n", > + }, > }; > > int cmdtable_len = sizeof(cmd_table)/sizeof(struct cmd_spec); _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 17 07:21:35 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 07:21:35 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsoxF-0001c5-Ip; Tue, 17 Dec 2013 07:20:33 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsoxD-0001bq-8b; Tue, 17 Dec 2013 07:20:31 +0000 Received: from [85.158.137.68:10277] by server-5.bemta-3.messagelabs.com id 8F/04-25188-E3BFFA25; Tue, 17 Dec 2013 07:20:30 +0000 X-Env-Sender: peter@perkbv.com X-Msg-Ref: server-9.tower-31.messagelabs.com!1387264827!3218906!1 X-Originating-IP: [62.21.193.1] X-SpamReason: No, hits=0.0 required=7.0 tests=UNPARSEABLE_RELAY X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 13990 invoked from network); 17 Dec 2013 07:20:27 -0000 Received: from static.kpn.net (HELO perkbv.com) (62.21.193.1) by server-9.tower-31.messagelabs.com with SMTP; 17 Dec 2013 07:20:27 -0000 Received: from WorldClient by perkbv.com (MDaemon PRO v12.0.3) with ESMTP id md50000129728.msg; Tue, 17 Dec 2013 08:20:26 +0100 X-Spam-Processed: perkbv.com, Tue, 17 Dec 2013 08:20:26 +0100 (not processed: message from trusted or authenticated source) X-Authenticated-Sender: peter@perkbv.com X-Return-Path: peter@perkbv.com X-Envelope-From: peter@perkbv.com Received: from [212.123.184.107] by perkbv.com via WorldClient with HTTP; Tue, 17 Dec 2013 08:20:23 +0100 Date: Tue, 17 Dec 2013 08:20:23 +0100 From: "peter" To: "Ian Campbell" MIME-Version: 1.0 Message-ID: X-Mailer: WorldClient 12.0.3 In-Reply-To: <1387187949.20076.37.camel@kazak.uk.xensource.com> References: <1387187949.20076.37.camel@kazak.uk.xensource.com> Cc: Lars Kurth , xen-users@lists.xen.org, xen-devel@lists.xen.org Subject: Re: [Xen-users] [Xen-devel] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Thank you for the info/patch Ian. With some modifications to Qemu, I managed to cross compile qemu-system-arm with XEN support. Based on version: 1c514a7734b7f98625a0d18d5e8ee7581f26e50c (Merge remote branch 'perard/cpu-hotplug-port-v2' into xen-staging-master-7). And got my Qemu backend working. I can see that INPUT_XEN_KBDDEV_FRONTEND is working (d9) 6input: Xen Virtual Keyboard as /devices/virtual/input/input0 (d9) 6input: Xen Virtual Pointer as /devices/virtual/input/input1 And that XEN bus is prompting for VFB (d9) 6xenbus_probe_frontend: Device with no driver: device/vfb/0 But it seems that the xen-fbfront only supports PV and not PVH. (Linux kernel 3.12-RC5) Because the init code is returning on: if (!xen_pv_domain()) return -ENODEV; When I comment this code out. I do get these errors: [ 1698.899496] Failed to unmap pfn:5c081 rc:-2 (XEN) dom10 IPA 0x0000000000000000 (XEN) P2M @ 021b8300 mfn:0x4dc18 (XEN) 1ST[0x0] = 0x000000004da276ff (XEN) 2ND[0x0] = 0x000000006b6856ff (XEN) 3RD[0x0] = 0x0000000000000000 [ 1698.933034] Failed to map pfn to mfn rc:0:-22 pfn:5c349 mfn:0 (XEN) dom10 IPA 0x000000002777c000 (XEN) P2M @ 021b8300 mfn:0x4dc18 (XEN) 1ST[0x0] = 0x000000004da276ff (XEN) 2ND[0x13b] = 0x0000000000000000 [ 1698.951353] Failed to map pfn to mfn rc:0:-22 pfn:5c348 mfn:b6b2777c Yes lots of them, and my VFB is not working tough. So I've searched on the internet if someone got VFB on PVH working. But I couldn't find anything about, so is there someone who got VFB working on PVH (x86) ? -----Original Message----- From: Ian Campbell To: peter Cc: "xen-users@lists.xen.org" , "xen-devel@lists.xen.org" , Lars Kurth Date: Mon, 16 Dec 2013 09:59:09 +0000 Subject: Re: [Xen-devel] [Xen-users] XEN/arm XENFB support > On Mon, 2013-12-16 at 08:45 +0000, Lars Kurth wrote: > > > On Mon, Dec 16, 2013 at 8:16 AM, peter wrote: > > I'm currently playing with XEN/arm on my Allwinner A20 > (cubieboard2) > > I would like to get the XENFB driver working on domU. > > But currently in xen/arm there's no support for VFB, atleast > qemu is not > > supported. > > But this video http://www.youtube.com/watch?v=po1IeElg8tg and > this one > > http://www.youtube.com/watch?v=Km6gBnIqaWo is showing a > working framebuffer. > > So there are people which got a framebuffer working on domU. > > But still i couldn't find anything on the internet how to do > this. > > Is there anyone with experience with VFB on xen/arm ? > > I'm not sure what the first link used but the second was using a form > of > hybrid GPU passthrough/paravirtualisation for which the code has not > been reeleased and AFAIK has nothing to do with VFB. > > I've not tried VFB on ARM yet (busy with other things) but I suspect > that if you were to build upstream qemu on ARM with Xen support enabled > then it would just work. I would recommend giving that a go -- please > let us know how you get on. > > Below is a patch which I wrote ages ago that I have just rebased onto > current xen staging *without retesting*. It is supposed to DTWT and > enable the qemu build for ARM (as well as providing a mechanism to > start > the correct dom0 qemu, which you don't need for vfb). > > As I say I haven't tested, or even built, and in particular I never > tried PVFB with it even what I wrote it, so YMMV. > > Ian. > > > commit 7b5d54c9a5d09c4138bec905c9accea34173ba77 > Author: Ian Campbell > Date: Wed May 15 16:34:55 2013 +0100 > > tools: build and launch correct qemu for architecture > > xl now provides a launch-dom0-qemu command which avoids the need to > have the > initscripts be aware of the specific qermu binary name, which > differs by > architecture and which also may have been specified by the user via > the > --with-system-qemu=PATH option to configure. > > Perhaps this should be a separate binary hidden in libexec? > > Signed-off-by: Ian Campbell > > diff --git a/config/arm32.mk b/config/arm32.mk > index aa79d22..f3599a3 100644 > --- a/config/arm32.mk > +++ b/config/arm32.mk > @@ -3,6 +3,8 @@ CONFIG_ARM_32 := y > CONFIG_ARM_$(XEN_OS) := y > > CONFIG_XEN_INSTALL_SUFFIX := > +CONFIG_QEMU_ARCH := arm > +CONFIG_QEMU_TARGET := arm-softmmu > > # -march= -mcpu= > > diff --git a/config/arm64.mk b/config/arm64.mk > index 15b57a4..4ff15e0 100644 > --- a/config/arm64.mk > +++ b/config/arm64.mk > @@ -3,6 +3,8 @@ CONFIG_ARM_64 := y > CONFIG_ARM_$(XEN_OS) := y > > CONFIG_XEN_INSTALL_SUFFIX := > +CONFIG_QEMU_ARCH := aarch64 > +CONFIG_QEMU_TARGET := arm-softmmu > > CFLAGS += #-marm -march= -mcpu= etc > > diff --git a/config/x86_32.mk b/config/x86_32.mk > index 7f76b25..da3111d 100644 > --- a/config/x86_32.mk > +++ b/config/x86_32.mk > @@ -2,6 +2,9 @@ CONFIG_X86 := y > CONFIG_X86_32 := y > CONFIG_X86_$(XEN_OS) := y > > +CONFIG_QEMU_ARCH := i386 > +CONFIG_QEMU_TARGET := i386-softmmu > + > CONFIG_HVM := y > CONFIG_MIGRATE := y > CONFIG_XCUTILS := y > diff --git a/config/x86_64.mk b/config/x86_64.mk > index 11104bd..f59e36d 100644 > --- a/config/x86_64.mk > +++ b/config/x86_64.mk > @@ -2,6 +2,9 @@ CONFIG_X86 := y > CONFIG_X86_64 := y > CONFIG_X86_$(XEN_OS) := y > > +CONFIG_QEMU_ARCH := x86_64 > +CONFIG_QEMU_ARCH := i386-softmmu > + > CONFIG_COMPAT := y > CONFIG_HVM := y > CONFIG_MIGRATE := y > diff --git a/tools/Makefile b/tools/Makefile > index 00c69ee..250b931 100644 > --- a/tools/Makefile > +++ b/tools/Makefile > @@ -107,7 +107,7 @@ distclean: subdirs-distclean > config.cache autom4te.cache > > ifneq ($(XEN_COMPILE_ARCH),$(XEN_TARGET_ARCH)) > -IOEMU_CONFIGURE_CROSS ?= --cpu=$(XEN_TARGET_ARCH) \ > +IOEMU_CONFIGURE_CROSS ?= --cpu=$(CONFIG_QEMU_ARCH) \ > --cross-prefix=$(CROSS_COMPILE) \ > --interp-prefix=$(CROSS_SYS_ROOT) > endif > @@ -186,8 +186,7 @@ subdir-all-qemu-xen-dir: qemu-xen-dir-find > source=.; \ > fi; \ > cd qemu-xen-dir; \ > - $$source/configure --enable-xen --target-list=i386-softmmu \ > - $(QEMU_XEN_ENABLE_DEBUG) \ > + $$source/configure --enable-xen --target-list=$(CONFIG_QEMU_TARGET) \ > --prefix=$(PREFIX) \ > --source-path=$$source \ > --extra-cflags="-I$(XEN_ROOT)/tools/include \ > diff --git a/tools/hotplug/Linux/init.d/xencommons > b/tools/hotplug/Linux/init.d/xencommons > index 4ebd636..f568085 100644 > --- a/tools/hotplug/Linux/init.d/xencommons > +++ b/tools/hotplug/Linux/init.d/xencommons > @@ -116,11 +116,7 @@ do_start () { > echo Starting xenconsoled... > test -z "$XENCONSOLED_TRACE" || XENCONSOLED_ARGS=" > --log=$XENCONSOLED_TRACE" > ${SBINDIR}/xenconsoled --pid-file=$XENCONSOLED_PIDFILE > $XENCONSOLED_ARGS > - echo Starting QEMU as disk backend for dom0 > - test -z "$QEMU_XEN" && QEMU_XEN="${LIBEXEC}/qemu-system-i386" > - $QEMU_XEN -xen-domid 0 -xen-attach -name dom0 -nographic -M xenpv > -daemonize \ > - -monitor /dev/null -serial /dev/null -parallel /dev/null \ > - -pidfile $QEMU_PIDFILE > + xl launch-dom0-qemu $QEMU_XEN > } > do_stop () { > echo Stopping xenconsoled > diff --git a/tools/libxl/Makefile b/tools/libxl/Makefile > index d8495bb..d8b6a5c 100644 > --- a/tools/libxl/Makefile > +++ b/tools/libxl/Makefile > @@ -27,6 +27,7 @@ CFLAGS_LIBXL += $(CFLAGS_libxenguest) > CFLAGS_LIBXL += $(CFLAGS_libxenstore) > CFLAGS_LIBXL += $(CFLAGS_libblktapctl) > CFLAGS_LIBXL += -Wshadow > +CFLAGS_LIBXL += -DCONFIG_QEMU_ARCH=\"$(CONFIG_QEMU_ARCH)\" > > LIBXL_LIBS-$(CONFIG_ARM) += -lfdt > > diff --git a/tools/libxl/libxl.h b/tools/libxl/libxl.h > index 12d6c31..0287a35 100644 > --- a/tools/libxl/libxl.h > +++ b/tools/libxl/libxl.h > @@ -605,6 +605,9 @@ int libxl_ctx_alloc(libxl_ctx **pctx, int version, > xentoollog_logger *lg); > int libxl_ctx_free(libxl_ctx *ctx /* 0 is OK */); > > +/* exec's device model for dom0 and does not return. */ > +void libxl_launch_dom0_qemu(libxl_ctx *ctx, const char *qemu_path, > const char *pidfile); > + > /* domain related functions */ > > int libxl_domain_create_new(libxl_ctx *ctx, libxl_domain_config > *d_config, > diff --git a/tools/libxl/libxl_dm.c b/tools/libxl/libxl_dm.c > index f6f7bbd..f0b13a9 100644 > --- a/tools/libxl/libxl_dm.c > +++ b/tools/libxl/libxl_dm.c > @@ -38,7 +38,7 @@ static const char *qemu_xen_path(libxl__gc *gc) > #ifdef QEMU_XEN_PATH > return QEMU_XEN_PATH; > #else > - return libxl__abs_path(gc, "qemu-system-i386", > libxl__libexec_path()); > + return libxl__abs_path(gc, "qemu-system-" CONFIG_QEMU_ARCH, > libxl__libexec_path()); > #endif > } > > @@ -1560,6 +1560,37 @@ out: > return ret; > } > > +void libxl_launch_dom0_qemu(libxl_ctx *ctx, const char *qemu_path, > const char *pidfile) > +{ > + GC_INIT(ctx); > + > + flexarray_t *dm_args = flexarray_make(gc, 16, 1); > + > + if (qemu_path == NULL) > + qemu_path = qemu_xen_path(gc); > + > + flexarray_vappend(dm_args, > + "-xen-domid", "0", > + "-xen-attach", > + "-name", "dom0", > + "-nographic", > + "-M" "xenpv", > + "-daemonize", > + "-monitor", "/dev/null", > + "-serial", "/dev/null", > + "-parallel", "/dev/null", > + NULL); > + if (pidfile) > + flexarray_append_pair(dm_args, "-pidfile", libxl__strdup(gc, > pidfile)); > + > + libxl__exec(gc, -1, -1, -1, > + qemu_path, (char **)flexarray_contents(dm_args), > NULL); > + > + /* Shouldn't return */ > + LOG(CRITICAL, "Failed to exec dom0 device model"); > + GC_FREE; > +} > + > /* > * Local variables: > * mode: C > diff --git a/tools/libxl/xl.h b/tools/libxl/xl.h > index c876a33..1d7602c 100644 > --- a/tools/libxl/xl.h > +++ b/tools/libxl/xl.h > @@ -106,6 +106,7 @@ int main_setenforce(int argc, char **argv); > int main_loadpolicy(int argc, char **argv); > int main_remus(int argc, char **argv); > int main_devd(int argc, char **argv); > +int main_launch_dom0_qemu(int argc, char **argv); > > void help(const char *command); > > diff --git a/tools/libxl/xl_cmdimpl.c b/tools/libxl/xl_cmdimpl.c > index bd26bcc..108dfac 100644 > --- a/tools/libxl/xl_cmdimpl.c > +++ b/tools/libxl/xl_cmdimpl.c > @@ -7313,6 +7313,31 @@ out: > return ret; > } > > +int main_launch_dom0_qemu(int argc, char **argv) > +{ > + int opt; > + const char *qemu = NULL; > + const char *pidfile = NULL; > + > + SWITCH_FOREACH_OPT(opt, "p:", NULL, "launch-dom-qemu", 0) { > + case 'p': > + pidfile = optarg; > + break; > + /* No options */ > + } > + if (optind < argc) > + qemu = argv[optind]; > + > + fprintf(stderr, "argc %d\n", argc); > + fprintf(stderr, "qemu = %s", qemu ? : ""); > + > + fprintf(stdout, "Starting QEMU as disk backend for dom0"); > + > + libxl_launch_dom0_qemu(ctx, qemu, pidfile); > + > + return 0; > +} > + > /* > * Local variables: > * mode: C > diff --git a/tools/libxl/xl_cmdtable.c b/tools/libxl/xl_cmdtable.c > index ebe0220..ab4d56c 100644 > --- a/tools/libxl/xl_cmdtable.c > +++ b/tools/libxl/xl_cmdtable.c > @@ -494,6 +494,12 @@ struct cmd_spec cmd_table[] = { > "[options]", > "-F Run in the foreground", > }, > + { "launch-dom0-qemu", > + &main_launch_dom0_qemu, 0, 1, > + "Start qemu process to service dom0 disk backends", > + "[options] [QEMU_PATH]", > + "-p PIDFILE Write a PIDFILE\n", > + }, > }; > > int cmdtable_len = sizeof(cmd_table)/sizeof(struct cmd_spec); _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 17 11:50:05 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 11:50:05 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vst97-0001h0-0H; Tue, 17 Dec 2013 11:49:05 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vst94-0001fG-Jw; Tue, 17 Dec 2013 11:49:02 +0000 Received: from [85.158.139.211:53056] by server-3.bemta-5.messagelabs.com id 9E/50-04773-D2A30B25; Tue, 17 Dec 2013 11:49:01 +0000 X-Env-Sender: lars.kurth.xen@gmail.com X-Msg-Ref: server-2.tower-206.messagelabs.com!1387280941!5023172!1 X-Originating-IP: [74.125.82.48] X-SpamReason: No, hits=2.4 required=7.0 tests=RCVD_ILLEGAL_IP, SUSPICIOUS_RECIPS X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 18152 invoked from network); 17 Dec 2013 11:49:01 -0000 Received: from mail-wg0-f48.google.com (HELO mail-wg0-f48.google.com) (74.125.82.48) by server-2.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 17 Dec 2013 11:49:01 -0000 Received: by mail-wg0-f48.google.com with SMTP id z12so5830647wgg.15 for ; Tue, 17 Dec 2013 03:49:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:reply-to:user-agent:mime-version:to:cc :subject:content-type:content-transfer-encoding; bh=XDxH6RP4LerYX/NQCSmmM2TZbcIW2+mBi02OVpzZ+MM=; b=RdZN+2VW5tNQvbmtZUzsrlzote9HgwbTlf/7qaJZBV+YZrcbBrodjF7oOd47ZOe4yJ DbPsmdCG4/xCT/VmI4Ynrt5z/81k/TQY/YXc0D+TUaERs5++pwjmKT7NePuIjj9Qgjl3 KmBmMh+7pFiEIgEhxDNanZ+SCTSoWMCh4Bc5IPCB7tZXkM+iPbBrRftmwgieszAnN9Mh aikA/lo9gq/xeEzBEGdXFf4yjjtwuH+U8tlqk7jjVF17ke8a/yoKT5D1Io38ZVsKMJdl tHYGWJ3WTN1NBjmoJXYar66AWgkcbtS1sspxfsS86OVQO22M5fLc3H5VjgCeoSLDCAzW 2EMg== X-Received: by 10.194.237.99 with SMTP id vb3mr18930926wjc.28.1387280940992; Tue, 17 Dec 2013 03:49:00 -0800 (PST) Received: from [172.16.25.10] ([2.122.219.75]) by mx.google.com with ESMTPSA id q19sm34217028wiw.4.2013.12.17.03.48.59 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 17 Dec 2013 03:49:00 -0800 (PST) Message-ID: <52B03A2A.807@xen.org> Date: Tue, 17 Dec 2013 11:48:58 +0000 From: Lars Kurth User-Agent: Mozilla/5.0 (Windows NT 6.1; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: "xen-devel@lists.xen.org" , "xen-api@lists.xen.org" , mirageos-devel@lists.xenproject.org, "xen-users@lists.xen.org" Cc: "publicity@lists.xenproject.org" Subject: [Xen-users] Xen booth at FOSDEM : invitation to community members to help man the booth, show demos, have your hand-outs there, etc. X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list Reply-To: lars.kurth@xen.org List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi all, I was just informed by the FOSDEM organizers. I wanted to invite community members (as well as vendors who do open source stuff and didn't get a booth) to help man the booth, show demos, have your hand-outs/swag there, etc. If you are interested, please a) Sign up to http://lists.xenproject.org/cgi-bin/mailman/listinfo/publicity or send a mail to publicity-request@lists.xenproject.org with subscribe in the subject line, where we will be discussing details b) respond to this thread on what you may want to Best Regards Lars _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 17 11:50:05 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 11:50:05 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vst97-0001h0-0H; Tue, 17 Dec 2013 11:49:05 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vst94-0001fG-Jw; Tue, 17 Dec 2013 11:49:02 +0000 Received: from [85.158.139.211:53056] by server-3.bemta-5.messagelabs.com id 9E/50-04773-D2A30B25; Tue, 17 Dec 2013 11:49:01 +0000 X-Env-Sender: lars.kurth.xen@gmail.com X-Msg-Ref: server-2.tower-206.messagelabs.com!1387280941!5023172!1 X-Originating-IP: [74.125.82.48] X-SpamReason: No, hits=2.4 required=7.0 tests=RCVD_ILLEGAL_IP, SUSPICIOUS_RECIPS X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 18152 invoked from network); 17 Dec 2013 11:49:01 -0000 Received: from mail-wg0-f48.google.com (HELO mail-wg0-f48.google.com) (74.125.82.48) by server-2.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 17 Dec 2013 11:49:01 -0000 Received: by mail-wg0-f48.google.com with SMTP id z12so5830647wgg.15 for ; Tue, 17 Dec 2013 03:49:01 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:reply-to:user-agent:mime-version:to:cc :subject:content-type:content-transfer-encoding; bh=XDxH6RP4LerYX/NQCSmmM2TZbcIW2+mBi02OVpzZ+MM=; b=RdZN+2VW5tNQvbmtZUzsrlzote9HgwbTlf/7qaJZBV+YZrcbBrodjF7oOd47ZOe4yJ DbPsmdCG4/xCT/VmI4Ynrt5z/81k/TQY/YXc0D+TUaERs5++pwjmKT7NePuIjj9Qgjl3 KmBmMh+7pFiEIgEhxDNanZ+SCTSoWMCh4Bc5IPCB7tZXkM+iPbBrRftmwgieszAnN9Mh aikA/lo9gq/xeEzBEGdXFf4yjjtwuH+U8tlqk7jjVF17ke8a/yoKT5D1Io38ZVsKMJdl tHYGWJ3WTN1NBjmoJXYar66AWgkcbtS1sspxfsS86OVQO22M5fLc3H5VjgCeoSLDCAzW 2EMg== X-Received: by 10.194.237.99 with SMTP id vb3mr18930926wjc.28.1387280940992; Tue, 17 Dec 2013 03:49:00 -0800 (PST) Received: from [172.16.25.10] ([2.122.219.75]) by mx.google.com with ESMTPSA id q19sm34217028wiw.4.2013.12.17.03.48.59 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 17 Dec 2013 03:49:00 -0800 (PST) Message-ID: <52B03A2A.807@xen.org> Date: Tue, 17 Dec 2013 11:48:58 +0000 From: Lars Kurth User-Agent: Mozilla/5.0 (Windows NT 6.1; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: "xen-devel@lists.xen.org" , "xen-api@lists.xen.org" , mirageos-devel@lists.xenproject.org, "xen-users@lists.xen.org" Cc: "publicity@lists.xenproject.org" Subject: [Xen-users] Xen booth at FOSDEM : invitation to community members to help man the booth, show demos, have your hand-outs there, etc. X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list Reply-To: lars.kurth@xen.org List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi all, I was just informed by the FOSDEM organizers. I wanted to invite community members (as well as vendors who do open source stuff and didn't get a booth) to help man the booth, show demos, have your hand-outs/swag there, etc. If you are interested, please a) Sign up to http://lists.xenproject.org/cgi-bin/mailman/listinfo/publicity or send a mail to publicity-request@lists.xenproject.org with subscribe in the subject line, where we will be discussing details b) respond to this thread on what you may want to Best Regards Lars _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 17 15:57:06 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 15:57:06 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vswzq-0001qA-Cr; Tue, 17 Dec 2013 15:55:46 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vswzo-0001pv-8X; Tue, 17 Dec 2013 15:55:44 +0000 Received: from [193.109.254.147:14323] by server-12.bemta-14.messagelabs.com id 02/88-13681-FF370B25; Tue, 17 Dec 2013 15:55:43 +0000 X-Env-Sender: Stefano.Stabellini@citrix.com X-Msg-Ref: server-2.tower-27.messagelabs.com!1387295739!5849954!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 32495 invoked from network); 17 Dec 2013 15:55:41 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-2.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 17 Dec 2013 15:55:41 -0000 X-IronPort-AV: E=Sophos;i="4.95,502,1384300800"; d="scan'208";a="83112098" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 17 Dec 2013 15:55:38 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Tue, 17 Dec 2013 10:55:36 -0500 Received: from kaball.uk.xensource.com ([10.80.2.59]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1Vswzh-0004Sq-16; Tue, 17 Dec 2013 15:55:37 +0000 Date: Tue, 17 Dec 2013 15:55:05 +0000 From: Stefano Stabellini X-X-Sender: sstabellini@kaball.uk.xensource.com To: peter In-Reply-To: Message-ID: References: <1387187949.20076.37.camel@kazak.uk.xensource.com> User-Agent: Alpine 2.02 (DEB 1266 2009-07-14) MIME-Version: 1.0 X-DLP: MIA2 Cc: Lars Kurth , xen-users@lists.xen.org, Ian Campbell , xen-devel@lists.xen.org Subject: Re: [Xen-users] [Xen-devel] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, 17 Dec 2013, peter wrote: > Thank you for the info/patch Ian. > With some modifications to Qemu, I managed to cross compile > qemu-system-arm with XEN support. > Based on version: 1c514a7734b7f98625a0d18d5e8ee7581f26e50c (Merge remote > branch 'perard/cpu-hotplug-port-v2' into xen-staging-master-7). > And got my Qemu backend working. Nice! Could you please post your patch? > I can see that INPUT_XEN_KBDDEV_FRONTEND is working > (d9) 6input: Xen Virtual Keyboard as /devices/virtual/input/input0 > (d9) 6input: Xen Virtual Pointer as /devices/virtual/input/input1 > > And that XEN bus is prompting for VFB > (d9) 6xenbus_probe_frontend: Device with no driver: device/vfb/0 > > But it seems that the xen-fbfront only supports PV and not PVH. (Linux > kernel 3.12-RC5) > Because the init code is returning on: > > if (!xen_pv_domain()) > return -ENODEV; > > When I comment this code out. Yeah, it should be turned into: if (!xen_domain()) return -ENODEV; > I do get these errors: > > [ 1698.899496] Failed to unmap pfn:5c081 rc:-2 These ones should be unrelated and not fatal, and Julien is working to fix the underlying issue. > (XEN) dom10 IPA 0x0000000000000000 > (XEN) P2M @ 021b8300 mfn:0x4dc18 > (XEN) 1ST[0x0] = 0x000000004da276ff > (XEN) 2ND[0x0] = 0x000000006b6856ff > (XEN) 3RD[0x0] = 0x0000000000000000 > [ 1698.933034] Failed to map pfn to mfn rc:0:-22 pfn:5c349 mfn:0 > > (XEN) dom10 IPA 0x000000002777c000 > (XEN) P2M @ 021b8300 mfn:0x4dc18 > (XEN) 1ST[0x0] = 0x000000004da276ff > (XEN) 2ND[0x13b] = 0x0000000000000000 > [ 1698.951353] Failed to map pfn to mfn rc:0:-22 pfn:5c348 mfn:b6b2777c > > Yes lots of them, and my VFB is not working tough. I suspect these are the actual symptoms of the problem. Looking around the frontend and the backend I couldn't find the issue. If you post your patch I might give it a try. > So I've searched on the internet if someone got VFB on PVH working. > But I couldn't find anything about, so is there someone who got VFB > working on PVH (x86) ? > > > -----Original Message----- > From: Ian Campbell > To: peter > Cc: "xen-users@lists.xen.org" , > "xen-devel@lists.xen.org" , Lars Kurth > > Date: Mon, 16 Dec 2013 09:59:09 +0000 > Subject: Re: [Xen-devel] [Xen-users] XEN/arm XENFB support > > > On Mon, 2013-12-16 at 08:45 +0000, Lars Kurth wrote: > > > > > On Mon, Dec 16, 2013 at 8:16 AM, peter wrote: > > > I'm currently playing with XEN/arm on my Allwinner A20 > > (cubieboard2) > > > I would like to get the XENFB driver working on domU. > > > But currently in xen/arm there's no support for VFB, atleast > > qemu is not > > > supported. > > > But this video http://www.youtube.com/watch?v=po1IeElg8tg and > > this one > > > http://www.youtube.com/watch?v=Km6gBnIqaWo is showing a > > working framebuffer. > > > So there are people which got a framebuffer working on domU. > > > But still i couldn't find anything on the internet how to do > > this. > > > Is there anyone with experience with VFB on xen/arm ? > > > > I'm not sure what the first link used but the second was using a form > > of > > hybrid GPU passthrough/paravirtualisation for which the code has not > > been reeleased and AFAIK has nothing to do with VFB. > > > > I've not tried VFB on ARM yet (busy with other things) but I suspect > > that if you were to build upstream qemu on ARM with Xen support enabled > > then it would just work. I would recommend giving that a go -- please > > let us know how you get on. > > > > Below is a patch which I wrote ages ago that I have just rebased onto > > current xen staging *without retesting*. It is supposed to DTWT and > > enable the qemu build for ARM (as well as providing a mechanism to > > start > > the correct dom0 qemu, which you don't need for vfb). > > > > As I say I haven't tested, or even built, and in particular I never > > tried PVFB with it even what I wrote it, so YMMV. > > > > Ian. > > > > > > commit 7b5d54c9a5d09c4138bec905c9accea34173ba77 > > Author: Ian Campbell > > Date: Wed May 15 16:34:55 2013 +0100 > > > > tools: build and launch correct qemu for architecture > > > > xl now provides a launch-dom0-qemu command which avoids the need to > > have the > > initscripts be aware of the specific qermu binary name, which > > differs by > > architecture and which also may have been specified by the user via > > the > > --with-system-qemu=PATH option to configure. > > > > Perhaps this should be a separate binary hidden in libexec? > > > > Signed-off-by: Ian Campbell > > > > diff --git a/config/arm32.mk b/config/arm32.mk > > index aa79d22..f3599a3 100644 > > --- a/config/arm32.mk > > +++ b/config/arm32.mk > > @@ -3,6 +3,8 @@ CONFIG_ARM_32 := y > > CONFIG_ARM_$(XEN_OS) := y > > > > CONFIG_XEN_INSTALL_SUFFIX := > > +CONFIG_QEMU_ARCH := arm > > +CONFIG_QEMU_TARGET := arm-softmmu > > > > # -march= -mcpu= > > > > diff --git a/config/arm64.mk b/config/arm64.mk > > index 15b57a4..4ff15e0 100644 > > --- a/config/arm64.mk > > +++ b/config/arm64.mk > > @@ -3,6 +3,8 @@ CONFIG_ARM_64 := y > > CONFIG_ARM_$(XEN_OS) := y > > > > CONFIG_XEN_INSTALL_SUFFIX := > > +CONFIG_QEMU_ARCH := aarch64 > > +CONFIG_QEMU_TARGET := arm-softmmu > > > > CFLAGS += #-marm -march= -mcpu= etc > > > > diff --git a/config/x86_32.mk b/config/x86_32.mk > > index 7f76b25..da3111d 100644 > > --- a/config/x86_32.mk > > +++ b/config/x86_32.mk > > @@ -2,6 +2,9 @@ CONFIG_X86 := y > > CONFIG_X86_32 := y > > CONFIG_X86_$(XEN_OS) := y > > > > +CONFIG_QEMU_ARCH := i386 > > +CONFIG_QEMU_TARGET := i386-softmmu > > + > > CONFIG_HVM := y > > CONFIG_MIGRATE := y > > CONFIG_XCUTILS := y > > diff --git a/config/x86_64.mk b/config/x86_64.mk > > index 11104bd..f59e36d 100644 > > --- a/config/x86_64.mk > > +++ b/config/x86_64.mk > > @@ -2,6 +2,9 @@ CONFIG_X86 := y > > CONFIG_X86_64 := y > > CONFIG_X86_$(XEN_OS) := y > > > > +CONFIG_QEMU_ARCH := x86_64 > > +CONFIG_QEMU_ARCH := i386-softmmu > > + > > CONFIG_COMPAT := y > > CONFIG_HVM := y > > CONFIG_MIGRATE := y > > diff --git a/tools/Makefile b/tools/Makefile > > index 00c69ee..250b931 100644 > > --- a/tools/Makefile > > +++ b/tools/Makefile > > @@ -107,7 +107,7 @@ distclean: subdirs-distclean > > config.cache autom4te.cache > > > > ifneq ($(XEN_COMPILE_ARCH),$(XEN_TARGET_ARCH)) > > -IOEMU_CONFIGURE_CROSS ?= --cpu=$(XEN_TARGET_ARCH) \ > > +IOEMU_CONFIGURE_CROSS ?= --cpu=$(CONFIG_QEMU_ARCH) \ > > --cross-prefix=$(CROSS_COMPILE) \ > > --interp-prefix=$(CROSS_SYS_ROOT) > > endif > > @@ -186,8 +186,7 @@ subdir-all-qemu-xen-dir: qemu-xen-dir-find > > source=.; \ > > fi; \ > > cd qemu-xen-dir; \ > > - $$source/configure --enable-xen --target-list=i386-softmmu \ > > - $(QEMU_XEN_ENABLE_DEBUG) \ > > + $$source/configure --enable-xen --target-list=$(CONFIG_QEMU_TARGET) \ > > --prefix=$(PREFIX) \ > > --source-path=$$source \ > > --extra-cflags="-I$(XEN_ROOT)/tools/include \ > > diff --git a/tools/hotplug/Linux/init.d/xencommons > > b/tools/hotplug/Linux/init.d/xencommons > > index 4ebd636..f568085 100644 > > --- a/tools/hotplug/Linux/init.d/xencommons > > +++ b/tools/hotplug/Linux/init.d/xencommons > > @@ -116,11 +116,7 @@ do_start () { > > echo Starting xenconsoled... > > test -z "$XENCONSOLED_TRACE" || XENCONSOLED_ARGS=" > > --log=$XENCONSOLED_TRACE" > > ${SBINDIR}/xenconsoled --pid-file=$XENCONSOLED_PIDFILE > > $XENCONSOLED_ARGS > > - echo Starting QEMU as disk backend for dom0 > > - test -z "$QEMU_XEN" && QEMU_XEN="${LIBEXEC}/qemu-system-i386" > > - $QEMU_XEN -xen-domid 0 -xen-attach -name dom0 -nographic -M xenpv > > -daemonize \ > > - -monitor /dev/null -serial /dev/null -parallel /dev/null \ > > - -pidfile $QEMU_PIDFILE > > + xl launch-dom0-qemu $QEMU_XEN > > } > > do_stop () { > > echo Stopping xenconsoled > > diff --git a/tools/libxl/Makefile b/tools/libxl/Makefile > > index d8495bb..d8b6a5c 100644 > > --- a/tools/libxl/Makefile > > +++ b/tools/libxl/Makefile > > @@ -27,6 +27,7 @@ CFLAGS_LIBXL += $(CFLAGS_libxenguest) > > CFLAGS_LIBXL += $(CFLAGS_libxenstore) > > CFLAGS_LIBXL += $(CFLAGS_libblktapctl) > > CFLAGS_LIBXL += -Wshadow > > +CFLAGS_LIBXL += -DCONFIG_QEMU_ARCH=\"$(CONFIG_QEMU_ARCH)\" > > > > LIBXL_LIBS-$(CONFIG_ARM) += -lfdt > > > > diff --git a/tools/libxl/libxl.h b/tools/libxl/libxl.h > > index 12d6c31..0287a35 100644 > > --- a/tools/libxl/libxl.h > > +++ b/tools/libxl/libxl.h > > @@ -605,6 +605,9 @@ int libxl_ctx_alloc(libxl_ctx **pctx, int version, > > xentoollog_logger *lg); > > int libxl_ctx_free(libxl_ctx *ctx /* 0 is OK */); > > > > +/* exec's device model for dom0 and does not return. */ > > +void libxl_launch_dom0_qemu(libxl_ctx *ctx, const char *qemu_path, > > const char *pidfile); > > + > > /* domain related functions */ > > > > int libxl_domain_create_new(libxl_ctx *ctx, libxl_domain_config > > *d_config, > > diff --git a/tools/libxl/libxl_dm.c b/tools/libxl/libxl_dm.c > > index f6f7bbd..f0b13a9 100644 > > --- a/tools/libxl/libxl_dm.c > > +++ b/tools/libxl/libxl_dm.c > > @@ -38,7 +38,7 @@ static const char *qemu_xen_path(libxl__gc *gc) > > #ifdef QEMU_XEN_PATH > > return QEMU_XEN_PATH; > > #else > > - return libxl__abs_path(gc, "qemu-system-i386", > > libxl__libexec_path()); > > + return libxl__abs_path(gc, "qemu-system-" CONFIG_QEMU_ARCH, > > libxl__libexec_path()); > > #endif > > } > > > > @@ -1560,6 +1560,37 @@ out: > > return ret; > > } > > > > +void libxl_launch_dom0_qemu(libxl_ctx *ctx, const char *qemu_path, > > const char *pidfile) > > +{ > > + GC_INIT(ctx); > > + > > + flexarray_t *dm_args = flexarray_make(gc, 16, 1); > > + > > + if (qemu_path == NULL) > > + qemu_path = qemu_xen_path(gc); > > + > > + flexarray_vappend(dm_args, > > + "-xen-domid", "0", > > + "-xen-attach", > > + "-name", "dom0", > > + "-nographic", > > + "-M" "xenpv", > > + "-daemonize", > > + "-monitor", "/dev/null", > > + "-serial", "/dev/null", > > + "-parallel", "/dev/null", > > + NULL); > > + if (pidfile) > > + flexarray_append_pair(dm_args, "-pidfile", libxl__strdup(gc, > > pidfile)); > > + > > + libxl__exec(gc, -1, -1, -1, > > + qemu_path, (char **)flexarray_contents(dm_args), > > NULL); > > + > > + /* Shouldn't return */ > > + LOG(CRITICAL, "Failed to exec dom0 device model"); > > + GC_FREE; > > +} > > + > > /* > > * Local variables: > > * mode: C > > diff --git a/tools/libxl/xl.h b/tools/libxl/xl.h > > index c876a33..1d7602c 100644 > > --- a/tools/libxl/xl.h > > +++ b/tools/libxl/xl.h > > @@ -106,6 +106,7 @@ int main_setenforce(int argc, char **argv); > > int main_loadpolicy(int argc, char **argv); > > int main_remus(int argc, char **argv); > > int main_devd(int argc, char **argv); > > +int main_launch_dom0_qemu(int argc, char **argv); > > > > void help(const char *command); > > > > diff --git a/tools/libxl/xl_cmdimpl.c b/tools/libxl/xl_cmdimpl.c > > index bd26bcc..108dfac 100644 > > --- a/tools/libxl/xl_cmdimpl.c > > +++ b/tools/libxl/xl_cmdimpl.c > > @@ -7313,6 +7313,31 @@ out: > > return ret; > > } > > > > +int main_launch_dom0_qemu(int argc, char **argv) > > +{ > > + int opt; > > + const char *qemu = NULL; > > + const char *pidfile = NULL; > > + > > + SWITCH_FOREACH_OPT(opt, "p:", NULL, "launch-dom-qemu", 0) { > > + case 'p': > > + pidfile = optarg; > > + break; > > + /* No options */ > > + } > > + if (optind < argc) > > + qemu = argv[optind]; > > + > > + fprintf(stderr, "argc %d\n", argc); > > + fprintf(stderr, "qemu = %s", qemu ? : ""); > > + > > + fprintf(stdout, "Starting QEMU as disk backend for dom0"); > > + > > + libxl_launch_dom0_qemu(ctx, qemu, pidfile); > > + > > + return 0; > > +} > > + > > /* > > * Local variables: > > * mode: C > > diff --git a/tools/libxl/xl_cmdtable.c b/tools/libxl/xl_cmdtable.c > > index ebe0220..ab4d56c 100644 > > --- a/tools/libxl/xl_cmdtable.c > > +++ b/tools/libxl/xl_cmdtable.c > > @@ -494,6 +494,12 @@ struct cmd_spec cmd_table[] = { > > "[options]", > > "-F Run in the foreground", > > }, > > + { "launch-dom0-qemu", > > + &main_launch_dom0_qemu, 0, 1, > > + "Start qemu process to service dom0 disk backends", > > + "[options] [QEMU_PATH]", > > + "-p PIDFILE Write a PIDFILE\n", > > + }, > > }; > > > > int cmdtable_len = sizeof(cmd_table)/sizeof(struct cmd_spec); > > > > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xen.org > http://lists.xen.org/xen-devel > _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 17 15:57:06 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 15:57:06 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vswzq-0001qA-Cr; Tue, 17 Dec 2013 15:55:46 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vswzo-0001pv-8X; Tue, 17 Dec 2013 15:55:44 +0000 Received: from [193.109.254.147:14323] by server-12.bemta-14.messagelabs.com id 02/88-13681-FF370B25; Tue, 17 Dec 2013 15:55:43 +0000 X-Env-Sender: Stefano.Stabellini@citrix.com X-Msg-Ref: server-2.tower-27.messagelabs.com!1387295739!5849954!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 32495 invoked from network); 17 Dec 2013 15:55:41 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-2.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 17 Dec 2013 15:55:41 -0000 X-IronPort-AV: E=Sophos;i="4.95,502,1384300800"; d="scan'208";a="83112098" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 17 Dec 2013 15:55:38 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Tue, 17 Dec 2013 10:55:36 -0500 Received: from kaball.uk.xensource.com ([10.80.2.59]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1Vswzh-0004Sq-16; Tue, 17 Dec 2013 15:55:37 +0000 Date: Tue, 17 Dec 2013 15:55:05 +0000 From: Stefano Stabellini X-X-Sender: sstabellini@kaball.uk.xensource.com To: peter In-Reply-To: Message-ID: References: <1387187949.20076.37.camel@kazak.uk.xensource.com> User-Agent: Alpine 2.02 (DEB 1266 2009-07-14) MIME-Version: 1.0 X-DLP: MIA2 Cc: Lars Kurth , xen-users@lists.xen.org, Ian Campbell , xen-devel@lists.xen.org Subject: Re: [Xen-users] [Xen-devel] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, 17 Dec 2013, peter wrote: > Thank you for the info/patch Ian. > With some modifications to Qemu, I managed to cross compile > qemu-system-arm with XEN support. > Based on version: 1c514a7734b7f98625a0d18d5e8ee7581f26e50c (Merge remote > branch 'perard/cpu-hotplug-port-v2' into xen-staging-master-7). > And got my Qemu backend working. Nice! Could you please post your patch? > I can see that INPUT_XEN_KBDDEV_FRONTEND is working > (d9) 6input: Xen Virtual Keyboard as /devices/virtual/input/input0 > (d9) 6input: Xen Virtual Pointer as /devices/virtual/input/input1 > > And that XEN bus is prompting for VFB > (d9) 6xenbus_probe_frontend: Device with no driver: device/vfb/0 > > But it seems that the xen-fbfront only supports PV and not PVH. (Linux > kernel 3.12-RC5) > Because the init code is returning on: > > if (!xen_pv_domain()) > return -ENODEV; > > When I comment this code out. Yeah, it should be turned into: if (!xen_domain()) return -ENODEV; > I do get these errors: > > [ 1698.899496] Failed to unmap pfn:5c081 rc:-2 These ones should be unrelated and not fatal, and Julien is working to fix the underlying issue. > (XEN) dom10 IPA 0x0000000000000000 > (XEN) P2M @ 021b8300 mfn:0x4dc18 > (XEN) 1ST[0x0] = 0x000000004da276ff > (XEN) 2ND[0x0] = 0x000000006b6856ff > (XEN) 3RD[0x0] = 0x0000000000000000 > [ 1698.933034] Failed to map pfn to mfn rc:0:-22 pfn:5c349 mfn:0 > > (XEN) dom10 IPA 0x000000002777c000 > (XEN) P2M @ 021b8300 mfn:0x4dc18 > (XEN) 1ST[0x0] = 0x000000004da276ff > (XEN) 2ND[0x13b] = 0x0000000000000000 > [ 1698.951353] Failed to map pfn to mfn rc:0:-22 pfn:5c348 mfn:b6b2777c > > Yes lots of them, and my VFB is not working tough. I suspect these are the actual symptoms of the problem. Looking around the frontend and the backend I couldn't find the issue. If you post your patch I might give it a try. > So I've searched on the internet if someone got VFB on PVH working. > But I couldn't find anything about, so is there someone who got VFB > working on PVH (x86) ? > > > -----Original Message----- > From: Ian Campbell > To: peter > Cc: "xen-users@lists.xen.org" , > "xen-devel@lists.xen.org" , Lars Kurth > > Date: Mon, 16 Dec 2013 09:59:09 +0000 > Subject: Re: [Xen-devel] [Xen-users] XEN/arm XENFB support > > > On Mon, 2013-12-16 at 08:45 +0000, Lars Kurth wrote: > > > > > On Mon, Dec 16, 2013 at 8:16 AM, peter wrote: > > > I'm currently playing with XEN/arm on my Allwinner A20 > > (cubieboard2) > > > I would like to get the XENFB driver working on domU. > > > But currently in xen/arm there's no support for VFB, atleast > > qemu is not > > > supported. > > > But this video http://www.youtube.com/watch?v=po1IeElg8tg and > > this one > > > http://www.youtube.com/watch?v=Km6gBnIqaWo is showing a > > working framebuffer. > > > So there are people which got a framebuffer working on domU. > > > But still i couldn't find anything on the internet how to do > > this. > > > Is there anyone with experience with VFB on xen/arm ? > > > > I'm not sure what the first link used but the second was using a form > > of > > hybrid GPU passthrough/paravirtualisation for which the code has not > > been reeleased and AFAIK has nothing to do with VFB. > > > > I've not tried VFB on ARM yet (busy with other things) but I suspect > > that if you were to build upstream qemu on ARM with Xen support enabled > > then it would just work. I would recommend giving that a go -- please > > let us know how you get on. > > > > Below is a patch which I wrote ages ago that I have just rebased onto > > current xen staging *without retesting*. It is supposed to DTWT and > > enable the qemu build for ARM (as well as providing a mechanism to > > start > > the correct dom0 qemu, which you don't need for vfb). > > > > As I say I haven't tested, or even built, and in particular I never > > tried PVFB with it even what I wrote it, so YMMV. > > > > Ian. > > > > > > commit 7b5d54c9a5d09c4138bec905c9accea34173ba77 > > Author: Ian Campbell > > Date: Wed May 15 16:34:55 2013 +0100 > > > > tools: build and launch correct qemu for architecture > > > > xl now provides a launch-dom0-qemu command which avoids the need to > > have the > > initscripts be aware of the specific qermu binary name, which > > differs by > > architecture and which also may have been specified by the user via > > the > > --with-system-qemu=PATH option to configure. > > > > Perhaps this should be a separate binary hidden in libexec? > > > > Signed-off-by: Ian Campbell > > > > diff --git a/config/arm32.mk b/config/arm32.mk > > index aa79d22..f3599a3 100644 > > --- a/config/arm32.mk > > +++ b/config/arm32.mk > > @@ -3,6 +3,8 @@ CONFIG_ARM_32 := y > > CONFIG_ARM_$(XEN_OS) := y > > > > CONFIG_XEN_INSTALL_SUFFIX := > > +CONFIG_QEMU_ARCH := arm > > +CONFIG_QEMU_TARGET := arm-softmmu > > > > # -march= -mcpu= > > > > diff --git a/config/arm64.mk b/config/arm64.mk > > index 15b57a4..4ff15e0 100644 > > --- a/config/arm64.mk > > +++ b/config/arm64.mk > > @@ -3,6 +3,8 @@ CONFIG_ARM_64 := y > > CONFIG_ARM_$(XEN_OS) := y > > > > CONFIG_XEN_INSTALL_SUFFIX := > > +CONFIG_QEMU_ARCH := aarch64 > > +CONFIG_QEMU_TARGET := arm-softmmu > > > > CFLAGS += #-marm -march= -mcpu= etc > > > > diff --git a/config/x86_32.mk b/config/x86_32.mk > > index 7f76b25..da3111d 100644 > > --- a/config/x86_32.mk > > +++ b/config/x86_32.mk > > @@ -2,6 +2,9 @@ CONFIG_X86 := y > > CONFIG_X86_32 := y > > CONFIG_X86_$(XEN_OS) := y > > > > +CONFIG_QEMU_ARCH := i386 > > +CONFIG_QEMU_TARGET := i386-softmmu > > + > > CONFIG_HVM := y > > CONFIG_MIGRATE := y > > CONFIG_XCUTILS := y > > diff --git a/config/x86_64.mk b/config/x86_64.mk > > index 11104bd..f59e36d 100644 > > --- a/config/x86_64.mk > > +++ b/config/x86_64.mk > > @@ -2,6 +2,9 @@ CONFIG_X86 := y > > CONFIG_X86_64 := y > > CONFIG_X86_$(XEN_OS) := y > > > > +CONFIG_QEMU_ARCH := x86_64 > > +CONFIG_QEMU_ARCH := i386-softmmu > > + > > CONFIG_COMPAT := y > > CONFIG_HVM := y > > CONFIG_MIGRATE := y > > diff --git a/tools/Makefile b/tools/Makefile > > index 00c69ee..250b931 100644 > > --- a/tools/Makefile > > +++ b/tools/Makefile > > @@ -107,7 +107,7 @@ distclean: subdirs-distclean > > config.cache autom4te.cache > > > > ifneq ($(XEN_COMPILE_ARCH),$(XEN_TARGET_ARCH)) > > -IOEMU_CONFIGURE_CROSS ?= --cpu=$(XEN_TARGET_ARCH) \ > > +IOEMU_CONFIGURE_CROSS ?= --cpu=$(CONFIG_QEMU_ARCH) \ > > --cross-prefix=$(CROSS_COMPILE) \ > > --interp-prefix=$(CROSS_SYS_ROOT) > > endif > > @@ -186,8 +186,7 @@ subdir-all-qemu-xen-dir: qemu-xen-dir-find > > source=.; \ > > fi; \ > > cd qemu-xen-dir; \ > > - $$source/configure --enable-xen --target-list=i386-softmmu \ > > - $(QEMU_XEN_ENABLE_DEBUG) \ > > + $$source/configure --enable-xen --target-list=$(CONFIG_QEMU_TARGET) \ > > --prefix=$(PREFIX) \ > > --source-path=$$source \ > > --extra-cflags="-I$(XEN_ROOT)/tools/include \ > > diff --git a/tools/hotplug/Linux/init.d/xencommons > > b/tools/hotplug/Linux/init.d/xencommons > > index 4ebd636..f568085 100644 > > --- a/tools/hotplug/Linux/init.d/xencommons > > +++ b/tools/hotplug/Linux/init.d/xencommons > > @@ -116,11 +116,7 @@ do_start () { > > echo Starting xenconsoled... > > test -z "$XENCONSOLED_TRACE" || XENCONSOLED_ARGS=" > > --log=$XENCONSOLED_TRACE" > > ${SBINDIR}/xenconsoled --pid-file=$XENCONSOLED_PIDFILE > > $XENCONSOLED_ARGS > > - echo Starting QEMU as disk backend for dom0 > > - test -z "$QEMU_XEN" && QEMU_XEN="${LIBEXEC}/qemu-system-i386" > > - $QEMU_XEN -xen-domid 0 -xen-attach -name dom0 -nographic -M xenpv > > -daemonize \ > > - -monitor /dev/null -serial /dev/null -parallel /dev/null \ > > - -pidfile $QEMU_PIDFILE > > + xl launch-dom0-qemu $QEMU_XEN > > } > > do_stop () { > > echo Stopping xenconsoled > > diff --git a/tools/libxl/Makefile b/tools/libxl/Makefile > > index d8495bb..d8b6a5c 100644 > > --- a/tools/libxl/Makefile > > +++ b/tools/libxl/Makefile > > @@ -27,6 +27,7 @@ CFLAGS_LIBXL += $(CFLAGS_libxenguest) > > CFLAGS_LIBXL += $(CFLAGS_libxenstore) > > CFLAGS_LIBXL += $(CFLAGS_libblktapctl) > > CFLAGS_LIBXL += -Wshadow > > +CFLAGS_LIBXL += -DCONFIG_QEMU_ARCH=\"$(CONFIG_QEMU_ARCH)\" > > > > LIBXL_LIBS-$(CONFIG_ARM) += -lfdt > > > > diff --git a/tools/libxl/libxl.h b/tools/libxl/libxl.h > > index 12d6c31..0287a35 100644 > > --- a/tools/libxl/libxl.h > > +++ b/tools/libxl/libxl.h > > @@ -605,6 +605,9 @@ int libxl_ctx_alloc(libxl_ctx **pctx, int version, > > xentoollog_logger *lg); > > int libxl_ctx_free(libxl_ctx *ctx /* 0 is OK */); > > > > +/* exec's device model for dom0 and does not return. */ > > +void libxl_launch_dom0_qemu(libxl_ctx *ctx, const char *qemu_path, > > const char *pidfile); > > + > > /* domain related functions */ > > > > int libxl_domain_create_new(libxl_ctx *ctx, libxl_domain_config > > *d_config, > > diff --git a/tools/libxl/libxl_dm.c b/tools/libxl/libxl_dm.c > > index f6f7bbd..f0b13a9 100644 > > --- a/tools/libxl/libxl_dm.c > > +++ b/tools/libxl/libxl_dm.c > > @@ -38,7 +38,7 @@ static const char *qemu_xen_path(libxl__gc *gc) > > #ifdef QEMU_XEN_PATH > > return QEMU_XEN_PATH; > > #else > > - return libxl__abs_path(gc, "qemu-system-i386", > > libxl__libexec_path()); > > + return libxl__abs_path(gc, "qemu-system-" CONFIG_QEMU_ARCH, > > libxl__libexec_path()); > > #endif > > } > > > > @@ -1560,6 +1560,37 @@ out: > > return ret; > > } > > > > +void libxl_launch_dom0_qemu(libxl_ctx *ctx, const char *qemu_path, > > const char *pidfile) > > +{ > > + GC_INIT(ctx); > > + > > + flexarray_t *dm_args = flexarray_make(gc, 16, 1); > > + > > + if (qemu_path == NULL) > > + qemu_path = qemu_xen_path(gc); > > + > > + flexarray_vappend(dm_args, > > + "-xen-domid", "0", > > + "-xen-attach", > > + "-name", "dom0", > > + "-nographic", > > + "-M" "xenpv", > > + "-daemonize", > > + "-monitor", "/dev/null", > > + "-serial", "/dev/null", > > + "-parallel", "/dev/null", > > + NULL); > > + if (pidfile) > > + flexarray_append_pair(dm_args, "-pidfile", libxl__strdup(gc, > > pidfile)); > > + > > + libxl__exec(gc, -1, -1, -1, > > + qemu_path, (char **)flexarray_contents(dm_args), > > NULL); > > + > > + /* Shouldn't return */ > > + LOG(CRITICAL, "Failed to exec dom0 device model"); > > + GC_FREE; > > +} > > + > > /* > > * Local variables: > > * mode: C > > diff --git a/tools/libxl/xl.h b/tools/libxl/xl.h > > index c876a33..1d7602c 100644 > > --- a/tools/libxl/xl.h > > +++ b/tools/libxl/xl.h > > @@ -106,6 +106,7 @@ int main_setenforce(int argc, char **argv); > > int main_loadpolicy(int argc, char **argv); > > int main_remus(int argc, char **argv); > > int main_devd(int argc, char **argv); > > +int main_launch_dom0_qemu(int argc, char **argv); > > > > void help(const char *command); > > > > diff --git a/tools/libxl/xl_cmdimpl.c b/tools/libxl/xl_cmdimpl.c > > index bd26bcc..108dfac 100644 > > --- a/tools/libxl/xl_cmdimpl.c > > +++ b/tools/libxl/xl_cmdimpl.c > > @@ -7313,6 +7313,31 @@ out: > > return ret; > > } > > > > +int main_launch_dom0_qemu(int argc, char **argv) > > +{ > > + int opt; > > + const char *qemu = NULL; > > + const char *pidfile = NULL; > > + > > + SWITCH_FOREACH_OPT(opt, "p:", NULL, "launch-dom-qemu", 0) { > > + case 'p': > > + pidfile = optarg; > > + break; > > + /* No options */ > > + } > > + if (optind < argc) > > + qemu = argv[optind]; > > + > > + fprintf(stderr, "argc %d\n", argc); > > + fprintf(stderr, "qemu = %s", qemu ? : ""); > > + > > + fprintf(stdout, "Starting QEMU as disk backend for dom0"); > > + > > + libxl_launch_dom0_qemu(ctx, qemu, pidfile); > > + > > + return 0; > > +} > > + > > /* > > * Local variables: > > * mode: C > > diff --git a/tools/libxl/xl_cmdtable.c b/tools/libxl/xl_cmdtable.c > > index ebe0220..ab4d56c 100644 > > --- a/tools/libxl/xl_cmdtable.c > > +++ b/tools/libxl/xl_cmdtable.c > > @@ -494,6 +494,12 @@ struct cmd_spec cmd_table[] = { > > "[options]", > > "-F Run in the foreground", > > }, > > + { "launch-dom0-qemu", > > + &main_launch_dom0_qemu, 0, 1, > > + "Start qemu process to service dom0 disk backends", > > + "[options] [QEMU_PATH]", > > + "-p PIDFILE Write a PIDFILE\n", > > + }, > > }; > > > > int cmdtable_len = sizeof(cmd_table)/sizeof(struct cmd_spec); > > > > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xen.org > http://lists.xen.org/xen-devel > _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 17 16:43:56 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 16:43:56 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsxjY-000824-Pe; Tue, 17 Dec 2013 16:43:00 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsxjW-00081f-Vw; Tue, 17 Dec 2013 16:42:59 +0000 Received: from [193.109.254.147:27537] by server-7.bemta-14.messagelabs.com id F3/01-15500-21F70B25; Tue, 17 Dec 2013 16:42:58 +0000 X-Env-Sender: Stefano.Stabellini@citrix.com X-Msg-Ref: server-5.tower-27.messagelabs.com!1387298575!5890767!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 15740 invoked from network); 17 Dec 2013 16:42:57 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-5.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 17 Dec 2013 16:42:57 -0000 X-IronPort-AV: E=Sophos;i="4.95,502,1384300800"; d="scan'208";a="83135902" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 17 Dec 2013 16:42:55 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Tue, 17 Dec 2013 11:42:54 -0500 Received: from kaball.uk.xensource.com ([10.80.2.59]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VsxjT-0005CM-28; Tue, 17 Dec 2013 16:42:55 +0000 Date: Tue, 17 Dec 2013 16:42:23 +0000 From: Stefano Stabellini X-X-Sender: sstabellini@kaball.uk.xensource.com To: Stefano Stabellini In-Reply-To: Message-ID: References: <1387187949.20076.37.camel@kazak.uk.xensource.com> User-Agent: Alpine 2.02 (DEB 1266 2009-07-14) MIME-Version: 1.0 X-DLP: MIA2 Cc: Lars Kurth , xen-users@lists.xen.org, peter , Ian Campbell , xen-devel@lists.xen.org Subject: Re: [Xen-users] [Xen-devel] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, 17 Dec 2013, Stefano Stabellini wrote: > On Tue, 17 Dec 2013, peter wrote: > > Thank you for the info/patch Ian. > > With some modifications to Qemu, I managed to cross compile > > qemu-system-arm with XEN support. > > Based on version: 1c514a7734b7f98625a0d18d5e8ee7581f26e50c (Merge remote > > branch 'perard/cpu-hotplug-port-v2' into xen-staging-master-7). > > And got my Qemu backend working. > > Nice! Could you please post your patch? Actually I have just tried it out and with the appended QEMU patch works fine. I'll come up with a proper patch and send it upstream. diff --git a/hw/display/xenfb.c b/hw/display/xenfb.c index f0333a0..e9b1af8 100644 --- a/hw/display/xenfb.c +++ b/hw/display/xenfb.c @@ -409,7 +409,7 @@ static void input_event(struct XenDevice *xendev) /* -------------------------------------------------------------------- */ -static void xenfb_copy_mfns(int mode, int count, unsigned long *dst, void *src) +static void xenfb_copy_mfns(int mode, int count, xen_pfn_t *dst, void *src) { uint32_t *src32 = src; uint64_t *src64 = src; @@ -424,8 +424,8 @@ static int xenfb_map_fb(struct XenFB *xenfb) struct xenfb_page *page = xenfb->c.page; char *protocol = xenfb->c.xendev.protocol; int n_fbdirs; - unsigned long *pgmfns = NULL; - unsigned long *fbmfns = NULL; + xen_pfn_t *pgmfns = NULL; + xen_pfn_t *fbmfns = NULL; void *map, *pd; int mode, ret = -1; @@ -483,8 +483,8 @@ static int xenfb_map_fb(struct XenFB *xenfb) n_fbdirs = xenfb->fbpages * mode / 8; n_fbdirs = (n_fbdirs + (XC_PAGE_SIZE - 1)) / XC_PAGE_SIZE; - pgmfns = g_malloc0(sizeof(unsigned long) * n_fbdirs); - fbmfns = g_malloc0(sizeof(unsigned long) * xenfb->fbpages); + pgmfns = g_malloc0(sizeof(xen_pfn_t) * n_fbdirs); + fbmfns = g_malloc0(sizeof(xen_pfn_t) * xenfb->fbpages); xenfb_copy_mfns(mode, n_fbdirs, pgmfns, pd); map = xc_map_foreign_pages(xen_xc, xenfb->c.xendev.dom, diff --git a/xen-all.c b/xen-all.c index 4a594bd..d45180d 100644 --- a/xen-all.c +++ b/xen-all.c @@ -381,8 +381,6 @@ static int xen_remove_from_physmap(XenIOState *state, rc = xc_domain_add_to_physmap(xen_xc, xen_domid, XENMAPSPACE_gmfn, idx, gpfn); if (rc) { - fprintf(stderr, "add_to_physmap MFN %"PRI_xen_pfn" to PFN %" - PRI_xen_pfn" failed: %d\n", idx, gpfn, rc); return -rc; } } diff --git a/xen-mapcache.c b/xen-mapcache.c index eda914a..baea376 100644 --- a/xen-mapcache.c +++ b/xen-mapcache.c @@ -33,13 +33,8 @@ # define DPRINTF(fmt, ...) do { } while (0) #endif -#if defined(__i386__) # define MCACHE_BUCKET_SHIFT 16 # define MCACHE_MAX_SIZE (1UL<<31) /* 2GB Cap */ -#elif defined(__x86_64__) -# define MCACHE_BUCKET_SHIFT 20 -# define MCACHE_MAX_SIZE (1UL<<35) /* 32GB Cap */ -#endif #define MCACHE_BUCKET_SIZE (1UL << MCACHE_BUCKET_SHIFT) /* This is the size of the virtual address space reserve to QEMU that will not _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 17 16:43:56 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 16:43:56 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsxjY-000824-Pe; Tue, 17 Dec 2013 16:43:00 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsxjW-00081f-Vw; Tue, 17 Dec 2013 16:42:59 +0000 Received: from [193.109.254.147:27537] by server-7.bemta-14.messagelabs.com id F3/01-15500-21F70B25; Tue, 17 Dec 2013 16:42:58 +0000 X-Env-Sender: Stefano.Stabellini@citrix.com X-Msg-Ref: server-5.tower-27.messagelabs.com!1387298575!5890767!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 15740 invoked from network); 17 Dec 2013 16:42:57 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-5.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 17 Dec 2013 16:42:57 -0000 X-IronPort-AV: E=Sophos;i="4.95,502,1384300800"; d="scan'208";a="83135902" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 17 Dec 2013 16:42:55 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Tue, 17 Dec 2013 11:42:54 -0500 Received: from kaball.uk.xensource.com ([10.80.2.59]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VsxjT-0005CM-28; Tue, 17 Dec 2013 16:42:55 +0000 Date: Tue, 17 Dec 2013 16:42:23 +0000 From: Stefano Stabellini X-X-Sender: sstabellini@kaball.uk.xensource.com To: Stefano Stabellini In-Reply-To: Message-ID: References: <1387187949.20076.37.camel@kazak.uk.xensource.com> User-Agent: Alpine 2.02 (DEB 1266 2009-07-14) MIME-Version: 1.0 X-DLP: MIA2 Cc: Lars Kurth , xen-users@lists.xen.org, peter , Ian Campbell , xen-devel@lists.xen.org Subject: Re: [Xen-users] [Xen-devel] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, 17 Dec 2013, Stefano Stabellini wrote: > On Tue, 17 Dec 2013, peter wrote: > > Thank you for the info/patch Ian. > > With some modifications to Qemu, I managed to cross compile > > qemu-system-arm with XEN support. > > Based on version: 1c514a7734b7f98625a0d18d5e8ee7581f26e50c (Merge remote > > branch 'perard/cpu-hotplug-port-v2' into xen-staging-master-7). > > And got my Qemu backend working. > > Nice! Could you please post your patch? Actually I have just tried it out and with the appended QEMU patch works fine. I'll come up with a proper patch and send it upstream. diff --git a/hw/display/xenfb.c b/hw/display/xenfb.c index f0333a0..e9b1af8 100644 --- a/hw/display/xenfb.c +++ b/hw/display/xenfb.c @@ -409,7 +409,7 @@ static void input_event(struct XenDevice *xendev) /* -------------------------------------------------------------------- */ -static void xenfb_copy_mfns(int mode, int count, unsigned long *dst, void *src) +static void xenfb_copy_mfns(int mode, int count, xen_pfn_t *dst, void *src) { uint32_t *src32 = src; uint64_t *src64 = src; @@ -424,8 +424,8 @@ static int xenfb_map_fb(struct XenFB *xenfb) struct xenfb_page *page = xenfb->c.page; char *protocol = xenfb->c.xendev.protocol; int n_fbdirs; - unsigned long *pgmfns = NULL; - unsigned long *fbmfns = NULL; + xen_pfn_t *pgmfns = NULL; + xen_pfn_t *fbmfns = NULL; void *map, *pd; int mode, ret = -1; @@ -483,8 +483,8 @@ static int xenfb_map_fb(struct XenFB *xenfb) n_fbdirs = xenfb->fbpages * mode / 8; n_fbdirs = (n_fbdirs + (XC_PAGE_SIZE - 1)) / XC_PAGE_SIZE; - pgmfns = g_malloc0(sizeof(unsigned long) * n_fbdirs); - fbmfns = g_malloc0(sizeof(unsigned long) * xenfb->fbpages); + pgmfns = g_malloc0(sizeof(xen_pfn_t) * n_fbdirs); + fbmfns = g_malloc0(sizeof(xen_pfn_t) * xenfb->fbpages); xenfb_copy_mfns(mode, n_fbdirs, pgmfns, pd); map = xc_map_foreign_pages(xen_xc, xenfb->c.xendev.dom, diff --git a/xen-all.c b/xen-all.c index 4a594bd..d45180d 100644 --- a/xen-all.c +++ b/xen-all.c @@ -381,8 +381,6 @@ static int xen_remove_from_physmap(XenIOState *state, rc = xc_domain_add_to_physmap(xen_xc, xen_domid, XENMAPSPACE_gmfn, idx, gpfn); if (rc) { - fprintf(stderr, "add_to_physmap MFN %"PRI_xen_pfn" to PFN %" - PRI_xen_pfn" failed: %d\n", idx, gpfn, rc); return -rc; } } diff --git a/xen-mapcache.c b/xen-mapcache.c index eda914a..baea376 100644 --- a/xen-mapcache.c +++ b/xen-mapcache.c @@ -33,13 +33,8 @@ # define DPRINTF(fmt, ...) do { } while (0) #endif -#if defined(__i386__) # define MCACHE_BUCKET_SHIFT 16 # define MCACHE_MAX_SIZE (1UL<<31) /* 2GB Cap */ -#elif defined(__x86_64__) -# define MCACHE_BUCKET_SHIFT 20 -# define MCACHE_MAX_SIZE (1UL<<35) /* 32GB Cap */ -#endif #define MCACHE_BUCKET_SIZE (1UL << MCACHE_BUCKET_SHIFT) /* This is the size of the virtual address space reserve to QEMU that will not _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 17 16:50:56 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 16:50:56 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vsxr7-00017o-Fj; Tue, 17 Dec 2013 16:50:49 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vsxr6-00017V-5k; Tue, 17 Dec 2013 16:50:48 +0000 Received: from [85.158.139.211:12716] by server-2.bemta-5.messagelabs.com id CF/A6-29392-7E080B25; Tue, 17 Dec 2013 16:50:47 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-6.tower-206.messagelabs.com!1387299044!5134238!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 32628 invoked from network); 17 Dec 2013 16:50:46 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-6.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 17 Dec 2013 16:50:46 -0000 X-IronPort-AV: E=Sophos;i="4.95,502,1384300800"; d="scan'208";a="85399908" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 17 Dec 2013 16:50:44 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Tue, 17 Dec 2013 11:50:43 -0500 Received: from gateway-cbg.eng.citrite.net ([10.80.16.17] helo=[127.0.0.1]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1Vsxr1-0005IZ-Oh; Tue, 17 Dec 2013 16:50:43 +0000 Message-ID: <1387299043.1025.13.camel@dagon.hellion.org.uk> From: Ian Campbell To: Stefano Stabellini Date: Tue, 17 Dec 2013 16:50:43 +0000 In-Reply-To: References: <1387187949.20076.37.camel@kazak.uk.xensource.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-4+b1 MIME-Version: 1.0 X-DLP: MIA2 Cc: Lars Kurth , xen-users@lists.xen.org, peter , xen-devel@lists.xen.org Subject: Re: [Xen-users] [Xen-devel] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, 2013-12-17 at 16:42 +0000, Stefano Stabellini wrote: > diff --git a/xen-all.c b/xen-all.c > index 4a594bd..d45180d 100644 > --- a/xen-all.c > +++ b/xen-all.c > @@ -381,8 +381,6 @@ static int xen_remove_from_physmap(XenIOState *state, > > rc = xc_domain_add_to_physmap(xen_xc, xen_domid, XENMAPSPACE_gmfn, idx, gpfn); > if (rc) { > - fprintf(stderr, "add_to_physmap MFN %"PRI_xen_pfn" to PFN %" > - PRI_xen_pfn" failed: %d\n", idx, gpfn, rc); This message seemed useful to me... > return -rc; > } > } > > diff --git a/xen-mapcache.c b/xen-mapcache.c > index eda914a..baea376 100644 > --- a/xen-mapcache.c > +++ b/xen-mapcache.c > @@ -33,13 +33,8 @@ > # define DPRINTF(fmt, ...) do { } while (0) > #endif > > -#if defined(__i386__) > # define MCACHE_BUCKET_SHIFT 16 > # define MCACHE_MAX_SIZE (1UL<<31) /* 2GB Cap */ > -#elif defined(__x86_64__) > -# define MCACHE_BUCKET_SHIFT 20 > -# define MCACHE_MAX_SIZE (1UL<<35) /* 32GB Cap */ > -#endif This bit seems a unrelated? Or should it really be adding __arm__ and __aarch64__ bits and this was just a quick hack? It'd be good if someone would pick up Daniel De Graaf's frontend patches (see earlier in the thread) to use grants instead of priv mappings and implement the matching backend stuff in qemu... Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 17 16:50:56 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 16:50:56 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vsxr7-00017o-Fj; Tue, 17 Dec 2013 16:50:49 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vsxr6-00017V-5k; Tue, 17 Dec 2013 16:50:48 +0000 Received: from [85.158.139.211:12716] by server-2.bemta-5.messagelabs.com id CF/A6-29392-7E080B25; Tue, 17 Dec 2013 16:50:47 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-6.tower-206.messagelabs.com!1387299044!5134238!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 32628 invoked from network); 17 Dec 2013 16:50:46 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-6.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 17 Dec 2013 16:50:46 -0000 X-IronPort-AV: E=Sophos;i="4.95,502,1384300800"; d="scan'208";a="85399908" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 17 Dec 2013 16:50:44 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Tue, 17 Dec 2013 11:50:43 -0500 Received: from gateway-cbg.eng.citrite.net ([10.80.16.17] helo=[127.0.0.1]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1Vsxr1-0005IZ-Oh; Tue, 17 Dec 2013 16:50:43 +0000 Message-ID: <1387299043.1025.13.camel@dagon.hellion.org.uk> From: Ian Campbell To: Stefano Stabellini Date: Tue, 17 Dec 2013 16:50:43 +0000 In-Reply-To: References: <1387187949.20076.37.camel@kazak.uk.xensource.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-4+b1 MIME-Version: 1.0 X-DLP: MIA2 Cc: Lars Kurth , xen-users@lists.xen.org, peter , xen-devel@lists.xen.org Subject: Re: [Xen-users] [Xen-devel] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, 2013-12-17 at 16:42 +0000, Stefano Stabellini wrote: > diff --git a/xen-all.c b/xen-all.c > index 4a594bd..d45180d 100644 > --- a/xen-all.c > +++ b/xen-all.c > @@ -381,8 +381,6 @@ static int xen_remove_from_physmap(XenIOState *state, > > rc = xc_domain_add_to_physmap(xen_xc, xen_domid, XENMAPSPACE_gmfn, idx, gpfn); > if (rc) { > - fprintf(stderr, "add_to_physmap MFN %"PRI_xen_pfn" to PFN %" > - PRI_xen_pfn" failed: %d\n", idx, gpfn, rc); This message seemed useful to me... > return -rc; > } > } > > diff --git a/xen-mapcache.c b/xen-mapcache.c > index eda914a..baea376 100644 > --- a/xen-mapcache.c > +++ b/xen-mapcache.c > @@ -33,13 +33,8 @@ > # define DPRINTF(fmt, ...) do { } while (0) > #endif > > -#if defined(__i386__) > # define MCACHE_BUCKET_SHIFT 16 > # define MCACHE_MAX_SIZE (1UL<<31) /* 2GB Cap */ > -#elif defined(__x86_64__) > -# define MCACHE_BUCKET_SHIFT 20 > -# define MCACHE_MAX_SIZE (1UL<<35) /* 32GB Cap */ > -#endif This bit seems a unrelated? Or should it really be adding __arm__ and __aarch64__ bits and this was just a quick hack? It'd be good if someone would pick up Daniel De Graaf's frontend patches (see earlier in the thread) to use grants instead of priv mappings and implement the matching backend stuff in qemu... Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 17 16:55:31 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 16:55:31 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsxvZ-0001bz-Al; Tue, 17 Dec 2013 16:55:25 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsxvY-0001bW-4Z; Tue, 17 Dec 2013 16:55:24 +0000 Received: from [85.158.137.68:58153] by server-11.bemta-3.messagelabs.com id 72/26-19379-BF180B25; Tue, 17 Dec 2013 16:55:23 +0000 X-Env-Sender: Stefano.Stabellini@citrix.com X-Msg-Ref: server-2.tower-31.messagelabs.com!1387299320!4545302!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30750 invoked from network); 17 Dec 2013 16:55:22 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-2.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 17 Dec 2013 16:55:22 -0000 X-IronPort-AV: E=Sophos;i="4.95,502,1384300800"; d="scan'208";a="85401709" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 17 Dec 2013 16:55:20 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Tue, 17 Dec 2013 11:55:19 -0500 Received: from kaball.uk.xensource.com ([10.80.2.59]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VsxvT-0005Nh-SO; Tue, 17 Dec 2013 16:55:19 +0000 Date: Tue, 17 Dec 2013 16:54:48 +0000 From: Stefano Stabellini X-X-Sender: sstabellini@kaball.uk.xensource.com To: Ian Campbell In-Reply-To: <1387299043.1025.13.camel@dagon.hellion.org.uk> Message-ID: References: <1387187949.20076.37.camel@kazak.uk.xensource.com> <1387299043.1025.13.camel@dagon.hellion.org.uk> User-Agent: Alpine 2.02 (DEB 1266 2009-07-14) MIME-Version: 1.0 X-DLP: MIA1 Cc: Lars Kurth , xen-users@lists.xen.org, peter , xen-devel@lists.xen.org, Stefano Stabellini Subject: Re: [Xen-users] [Xen-devel] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, 17 Dec 2013, Ian Campbell wrote: > On Tue, 2013-12-17 at 16:42 +0000, Stefano Stabellini wrote: > > > diff --git a/xen-all.c b/xen-all.c > > index 4a594bd..d45180d 100644 > > --- a/xen-all.c > > +++ b/xen-all.c > > @@ -381,8 +381,6 @@ static int xen_remove_from_physmap(XenIOState *state, > > > > rc = xc_domain_add_to_physmap(xen_xc, xen_domid, XENMAPSPACE_gmfn, idx, gpfn); > > if (rc) { > > - fprintf(stderr, "add_to_physmap MFN %"PRI_xen_pfn" to PFN %" > > - PRI_xen_pfn" failed: %d\n", idx, gpfn, rc); > > This message seemed useful to me... Yeah, this is just a debug patch to show the concept. I am cleaning it up now. > > return -rc; > > } > > } > > > > diff --git a/xen-mapcache.c b/xen-mapcache.c > > index eda914a..baea376 100644 > > --- a/xen-mapcache.c > > +++ b/xen-mapcache.c > > @@ -33,13 +33,8 @@ > > # define DPRINTF(fmt, ...) do { } while (0) > > #endif > > > > -#if defined(__i386__) > > # define MCACHE_BUCKET_SHIFT 16 > > # define MCACHE_MAX_SIZE (1UL<<31) /* 2GB Cap */ > > -#elif defined(__x86_64__) > > -# define MCACHE_BUCKET_SHIFT 20 > > -# define MCACHE_MAX_SIZE (1UL<<35) /* 32GB Cap */ > > -#endif > > This bit seems a unrelated? Or should it really be adding __arm__ and > __aarch64__ bits and this was just a quick hack? Right, this was a quick hack. > It'd be good if someone would pick up Daniel De Graaf's frontend patches > (see earlier in the thread) to use grants instead of priv mappings and > implement the matching backend stuff in qemu... > > Ian. > > _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 17 16:55:31 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 16:55:31 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsxvZ-0001bz-Al; Tue, 17 Dec 2013 16:55:25 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsxvY-0001bW-4Z; Tue, 17 Dec 2013 16:55:24 +0000 Received: from [85.158.137.68:58153] by server-11.bemta-3.messagelabs.com id 72/26-19379-BF180B25; Tue, 17 Dec 2013 16:55:23 +0000 X-Env-Sender: Stefano.Stabellini@citrix.com X-Msg-Ref: server-2.tower-31.messagelabs.com!1387299320!4545302!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30750 invoked from network); 17 Dec 2013 16:55:22 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-2.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 17 Dec 2013 16:55:22 -0000 X-IronPort-AV: E=Sophos;i="4.95,502,1384300800"; d="scan'208";a="85401709" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 17 Dec 2013 16:55:20 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Tue, 17 Dec 2013 11:55:19 -0500 Received: from kaball.uk.xensource.com ([10.80.2.59]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VsxvT-0005Nh-SO; Tue, 17 Dec 2013 16:55:19 +0000 Date: Tue, 17 Dec 2013 16:54:48 +0000 From: Stefano Stabellini X-X-Sender: sstabellini@kaball.uk.xensource.com To: Ian Campbell In-Reply-To: <1387299043.1025.13.camel@dagon.hellion.org.uk> Message-ID: References: <1387187949.20076.37.camel@kazak.uk.xensource.com> <1387299043.1025.13.camel@dagon.hellion.org.uk> User-Agent: Alpine 2.02 (DEB 1266 2009-07-14) MIME-Version: 1.0 X-DLP: MIA1 Cc: Lars Kurth , xen-users@lists.xen.org, peter , xen-devel@lists.xen.org, Stefano Stabellini Subject: Re: [Xen-users] [Xen-devel] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, 17 Dec 2013, Ian Campbell wrote: > On Tue, 2013-12-17 at 16:42 +0000, Stefano Stabellini wrote: > > > diff --git a/xen-all.c b/xen-all.c > > index 4a594bd..d45180d 100644 > > --- a/xen-all.c > > +++ b/xen-all.c > > @@ -381,8 +381,6 @@ static int xen_remove_from_physmap(XenIOState *state, > > > > rc = xc_domain_add_to_physmap(xen_xc, xen_domid, XENMAPSPACE_gmfn, idx, gpfn); > > if (rc) { > > - fprintf(stderr, "add_to_physmap MFN %"PRI_xen_pfn" to PFN %" > > - PRI_xen_pfn" failed: %d\n", idx, gpfn, rc); > > This message seemed useful to me... Yeah, this is just a debug patch to show the concept. I am cleaning it up now. > > return -rc; > > } > > } > > > > diff --git a/xen-mapcache.c b/xen-mapcache.c > > index eda914a..baea376 100644 > > --- a/xen-mapcache.c > > +++ b/xen-mapcache.c > > @@ -33,13 +33,8 @@ > > # define DPRINTF(fmt, ...) do { } while (0) > > #endif > > > > -#if defined(__i386__) > > # define MCACHE_BUCKET_SHIFT 16 > > # define MCACHE_MAX_SIZE (1UL<<31) /* 2GB Cap */ > > -#elif defined(__x86_64__) > > -# define MCACHE_BUCKET_SHIFT 20 > > -# define MCACHE_MAX_SIZE (1UL<<35) /* 32GB Cap */ > > -#endif > > This bit seems a unrelated? Or should it really be adding __arm__ and > __aarch64__ bits and this was just a quick hack? Right, this was a quick hack. > It'd be good if someone would pick up Daniel De Graaf's frontend patches > (see earlier in the thread) to use grants instead of priv mappings and > implement the matching backend stuff in qemu... > > Ian. > > _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 17 19:01:03 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 19:01:03 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vszrv-0005nC-TB; Tue, 17 Dec 2013 18:59:47 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vszrt-0005n0-Od for xen-users@lists.xen.org; Tue, 17 Dec 2013 18:59:45 +0000 Received: from [85.158.139.211:10773] by server-13.bemta-5.messagelabs.com id 6E/FA-11357-12F90B25; Tue, 17 Dec 2013 18:59:45 +0000 X-Env-Sender: saurabh.globe@gmail.com X-Msg-Ref: server-11.tower-206.messagelabs.com!1387306783!4972487!1 X-Originating-IP: [209.85.128.169] X-SpamReason: No, hits=1.7 required=7.0 tests=BODY_RANDOM_LONG, HTML_20_30, HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14, RCVD_BY_IP, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 18009 invoked from network); 17 Dec 2013 18:59:44 -0000 Received: from mail-ve0-f169.google.com (HELO mail-ve0-f169.google.com) (209.85.128.169) by server-11.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 17 Dec 2013 18:59:44 -0000 Received: by mail-ve0-f169.google.com with SMTP id c14so4690549vea.0 for ; Tue, 17 Dec 2013 10:59:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=5MFcFbGtVSkC98vVMupVAL8c+Tq+6qruzdOIeg+bRb8=; b=bz5gLdAyhodfIIImIAoERYbcz00ElFPANCGYB7A8i4h0YrXChnfDPVCCGKqzi5kUxG ydv9TjDtJplxytg2vNlOVVmtM4GkF2ohqlFdJAD/DZI3oa+NwveFyPYcQ7X+r2MKHMKT LdJszw5ZrbLpUqxA60p2wosQZD+HUYO9mwYTPISKaLZ6rpNrE9BMG1lBNhpgd44o/lOh +acDafHWW058Wfb2XJlH5nRZmzJx/9bdKv2EjwT7gFPSYXABzSRq57/sbYy9CXt50NM6 4zzE0nAvVMp0UnoLkUdzIO2GdHMRkWX7xcEQckGOC2fY6weSFIJ5GhcDB/B3dv9QS0ay zDVg== MIME-Version: 1.0 X-Received: by 10.58.255.195 with SMTP id as3mr1932165ved.50.1387306782682; Tue, 17 Dec 2013 10:59:42 -0800 (PST) Received: by 10.58.154.228 with HTTP; Tue, 17 Dec 2013 10:59:42 -0800 (PST) Date: Tue, 17 Dec 2013 10:59:42 -0800 Message-ID: From: Saurabh Mishra To: xen-users@lists.xen.org Subject: [Xen-users] NUMA memory allocation differences between XM and XL toolchain X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============0526058539059541659==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============0526058539059541659== Content-Type: multipart/alternative; boundary=047d7bf0e9f0fa27c004edbf87b0 --047d7bf0e9f0fa27c004edbf87b0 Content-Type: text/plain; charset=ISO-8859-1 Hi, We are using Xen 4.2.2_06 on SLES SP3 Updates and wanted to know if there is a simple way to gather information about physical pages allocated for a HVM guest. We are trying to figure whether XL is better off in allocating contiguous huge/large pages for a guest or XM. I guess it does not matter since Xen's hypervisor would be implementing page allocation polices. With xl debug-key u, we know how much memory was allocated from each NUMA node, but we would also like to know whether how much of them were huge pages and were they contiguous or not. Basically we need to retrieve machine pfn and VM's pfn to do some comparison. (XEN) Memory location of each domain: (XEN) Domain 0 (total: 603765): (XEN) Node 0: 363652 (XEN) Node 1: 240113 (XEN) Domain 1 (total: 2096119): (XEN) Node 0: 1047804 (XEN) Node 1: 1048315 (XEN) Domain 2 (total: 25164798): (XEN) Node 0: 12582143 (XEN) Node 1: 12582655 We would like Xen to allocate as many as continuous huge/large pages for a HVM guest. So if there is a tunable, then please let me know. The HW is x86-64. Thanks, /Saurabh --047d7bf0e9f0fa27c004edbf87b0 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi,

We are using Xen 4.2.2_06 on SLES S= P3 Updates and wanted to know if there is a simple way to gather informatio= n about physical pages allocated for a HVM guest. We are trying to figure w= hether XL is better off in allocating=A0contiguous huge/large pages for a g= uest or XM. I guess it does not matter since Xen's hypervisor would be = implementing page allocation polices.

With xl debug-key u, we know how much memory was alloca= ted from each NUMA node, but we would also like to know whether how much of= them were huge pages and were they contiguous or not. Basically we need to= retrieve machine pfn and VM's pfn to do some comparison.

(XEN) Memory location of each domain:
(X= EN) Domain 0 (total: 603765):
(XEN) =A0 =A0 Node 0: 363652
<= div>(XEN) =A0 =A0 Node 1: 240113
(XEN) Domain 1 (total: 2096119):=
(XEN) =A0 =A0 Node 0: 1047804
(XEN) =A0 =A0 Node 1: 1048315<= /div>
(XEN) Domain 2 (total: 25164798):
(XEN) =A0 =A0 Node 0:= 12582143
(XEN) =A0 =A0 Node 1: 12582655


We would like Xen to allocate as many as continuous huge/large pages f= or a HVM guest. So if there is a tunable, then please let me know. The HW i= s x86-64.

Thanks,
/Saurabh
--047d7bf0e9f0fa27c004edbf87b0-- --===============0526058539059541659== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============0526058539059541659==-- From xen-users-bounces@lists.xen.org Tue Dec 17 19:01:03 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 19:01:03 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vszrv-0005nC-TB; Tue, 17 Dec 2013 18:59:47 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vszrt-0005n0-Od for xen-users@lists.xen.org; Tue, 17 Dec 2013 18:59:45 +0000 Received: from [85.158.139.211:10773] by server-13.bemta-5.messagelabs.com id 6E/FA-11357-12F90B25; Tue, 17 Dec 2013 18:59:45 +0000 X-Env-Sender: saurabh.globe@gmail.com X-Msg-Ref: server-11.tower-206.messagelabs.com!1387306783!4972487!1 X-Originating-IP: [209.85.128.169] X-SpamReason: No, hits=1.7 required=7.0 tests=BODY_RANDOM_LONG, HTML_20_30, HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14, RCVD_BY_IP, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 18009 invoked from network); 17 Dec 2013 18:59:44 -0000 Received: from mail-ve0-f169.google.com (HELO mail-ve0-f169.google.com) (209.85.128.169) by server-11.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 17 Dec 2013 18:59:44 -0000 Received: by mail-ve0-f169.google.com with SMTP id c14so4690549vea.0 for ; Tue, 17 Dec 2013 10:59:42 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=5MFcFbGtVSkC98vVMupVAL8c+Tq+6qruzdOIeg+bRb8=; b=bz5gLdAyhodfIIImIAoERYbcz00ElFPANCGYB7A8i4h0YrXChnfDPVCCGKqzi5kUxG ydv9TjDtJplxytg2vNlOVVmtM4GkF2ohqlFdJAD/DZI3oa+NwveFyPYcQ7X+r2MKHMKT LdJszw5ZrbLpUqxA60p2wosQZD+HUYO9mwYTPISKaLZ6rpNrE9BMG1lBNhpgd44o/lOh +acDafHWW058Wfb2XJlH5nRZmzJx/9bdKv2EjwT7gFPSYXABzSRq57/sbYy9CXt50NM6 4zzE0nAvVMp0UnoLkUdzIO2GdHMRkWX7xcEQckGOC2fY6weSFIJ5GhcDB/B3dv9QS0ay zDVg== MIME-Version: 1.0 X-Received: by 10.58.255.195 with SMTP id as3mr1932165ved.50.1387306782682; Tue, 17 Dec 2013 10:59:42 -0800 (PST) Received: by 10.58.154.228 with HTTP; Tue, 17 Dec 2013 10:59:42 -0800 (PST) Date: Tue, 17 Dec 2013 10:59:42 -0800 Message-ID: From: Saurabh Mishra To: xen-users@lists.xen.org Subject: [Xen-users] NUMA memory allocation differences between XM and XL toolchain X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============0526058539059541659==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============0526058539059541659== Content-Type: multipart/alternative; boundary=047d7bf0e9f0fa27c004edbf87b0 --047d7bf0e9f0fa27c004edbf87b0 Content-Type: text/plain; charset=ISO-8859-1 Hi, We are using Xen 4.2.2_06 on SLES SP3 Updates and wanted to know if there is a simple way to gather information about physical pages allocated for a HVM guest. We are trying to figure whether XL is better off in allocating contiguous huge/large pages for a guest or XM. I guess it does not matter since Xen's hypervisor would be implementing page allocation polices. With xl debug-key u, we know how much memory was allocated from each NUMA node, but we would also like to know whether how much of them were huge pages and were they contiguous or not. Basically we need to retrieve machine pfn and VM's pfn to do some comparison. (XEN) Memory location of each domain: (XEN) Domain 0 (total: 603765): (XEN) Node 0: 363652 (XEN) Node 1: 240113 (XEN) Domain 1 (total: 2096119): (XEN) Node 0: 1047804 (XEN) Node 1: 1048315 (XEN) Domain 2 (total: 25164798): (XEN) Node 0: 12582143 (XEN) Node 1: 12582655 We would like Xen to allocate as many as continuous huge/large pages for a HVM guest. So if there is a tunable, then please let me know. The HW is x86-64. Thanks, /Saurabh --047d7bf0e9f0fa27c004edbf87b0 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi,

We are using Xen 4.2.2_06 on SLES S= P3 Updates and wanted to know if there is a simple way to gather informatio= n about physical pages allocated for a HVM guest. We are trying to figure w= hether XL is better off in allocating=A0contiguous huge/large pages for a g= uest or XM. I guess it does not matter since Xen's hypervisor would be = implementing page allocation polices.

With xl debug-key u, we know how much memory was alloca= ted from each NUMA node, but we would also like to know whether how much of= them were huge pages and were they contiguous or not. Basically we need to= retrieve machine pfn and VM's pfn to do some comparison.

(XEN) Memory location of each domain:
(X= EN) Domain 0 (total: 603765):
(XEN) =A0 =A0 Node 0: 363652
<= div>(XEN) =A0 =A0 Node 1: 240113
(XEN) Domain 1 (total: 2096119):=
(XEN) =A0 =A0 Node 0: 1047804
(XEN) =A0 =A0 Node 1: 1048315<= /div>
(XEN) Domain 2 (total: 25164798):
(XEN) =A0 =A0 Node 0:= 12582143
(XEN) =A0 =A0 Node 1: 12582655


We would like Xen to allocate as many as continuous huge/large pages f= or a HVM guest. So if there is a tunable, then please let me know. The HW i= s x86-64.

Thanks,
/Saurabh
--047d7bf0e9f0fa27c004edbf87b0-- --===============0526058539059541659== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============0526058539059541659==-- From xen-users-bounces@lists.xen.org Tue Dec 17 19:38:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 19:38:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vt0TE-0000JN-8e; Tue, 17 Dec 2013 19:38:20 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vt0TD-0000Hu-1c for xen-users@lists.xen.org; Tue, 17 Dec 2013 19:38:19 +0000 Received: from [85.158.143.35:49553] by server-3.bemta-4.messagelabs.com id 42/DD-32360-A28A0B25; Tue, 17 Dec 2013 19:38:18 +0000 X-Env-Sender: mariusweiler@web.de X-Msg-Ref: server-5.tower-21.messagelabs.com!1387309097!6549231!1 X-Originating-IP: [212.227.17.11] X-SpamReason: No, hits=0.6 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjExID0+IDE4NTg2\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjExID0+IDE4NTg2\n,HTML_50_60,HTML_MESSAGE, MIME_HTML_ONLY X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 12864 invoked from network); 17 Dec 2013 19:38:17 -0000 Received: from mout.web.de (HELO mout.web.de) (212.227.17.11) by server-5.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 17 Dec 2013 19:38:17 -0000 Received: from 3capp-webde-bs37.server.lan ([172.19.170.37]) by mriweb.server.lan (mriweb001) with ESMTP (Nemesis) id 0Ltj9X-1VTt081gsn-011Ex4 for ; Tue, 17 Dec 2013 20:38:17 +0100 Received: from [46.22.223.18] by 3capp-webde-bs37.server.lan with HTTP; Tue Dec 17 20:38:17 CET 2013 MIME-Version: 1.0 Message-ID: From: "Marius Weiler" To: xen-users@lists.xen.org Date: Tue, 17 Dec 2013 20:38:17 +0100 (CET) Importance: normal Sensitivity: Normal X-Priority: 3 X-Provags-ID: V03:K0:9i+aOBi4ve+cnbBEz0YjZYktz5Mu1VamFgrQULDDOav 9YApybeb3icanzPnuc5njoETujYgLeH/cVBfphd9kHaD/Ag1yu U12Ex9RjmXcIWQoBHX5a8PYpTuJZaF2aOaJDS7b6EYYA7U27Jg +9x3wcHb25WDoyhc+vD9Wlq+RPnMbNF0s28jOQh46IaRFmRezN tH9uMnnRy1O5LCQ59vFGnPZt+5wn7KHaa9kwJmIwKTSj0cwOFy wBnymsNvfc651cLsqrlcR9fsV7Zlt0yOdAnELBT692PFgF3+MD tt8y5jpoduFI0uKRflR0iX5uK87 Subject: [Xen-users] Device 0 (vif) could not be connected. /etc/xen/scripts/vif-route failed; error detected X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============1547071799889618009==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============1547071799889618009== Content-Type: text/html; charset=UTF-8
Hello,
 
I set up the XEN Routing like described on:
 
http://www.virtualizor.com/wiki/Xen_Routing
 
I'm running CentOS 6.5 x64. In a virtual machine with CentOS 6.5 it worked without any problems.
 
I get this error:
 
Device 0 (vif) could not be connected. /etc/xen/scripts/vif-route failed; error detected
 
Any ideas?
 
Thanks
 
Regards
 
Marius
--===============1547071799889618009== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============1547071799889618009==-- From xen-users-bounces@lists.xen.org Tue Dec 17 19:38:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 17 Dec 2013 19:38:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vt0TE-0000JN-8e; Tue, 17 Dec 2013 19:38:20 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vt0TD-0000Hu-1c for xen-users@lists.xen.org; Tue, 17 Dec 2013 19:38:19 +0000 Received: from [85.158.143.35:49553] by server-3.bemta-4.messagelabs.com id 42/DD-32360-A28A0B25; Tue, 17 Dec 2013 19:38:18 +0000 X-Env-Sender: mariusweiler@web.de X-Msg-Ref: server-5.tower-21.messagelabs.com!1387309097!6549231!1 X-Originating-IP: [212.227.17.11] X-SpamReason: No, hits=0.6 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjExID0+IDE4NTg2\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjExID0+IDE4NTg2\n,HTML_50_60,HTML_MESSAGE, MIME_HTML_ONLY X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 12864 invoked from network); 17 Dec 2013 19:38:17 -0000 Received: from mout.web.de (HELO mout.web.de) (212.227.17.11) by server-5.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 17 Dec 2013 19:38:17 -0000 Received: from 3capp-webde-bs37.server.lan ([172.19.170.37]) by mriweb.server.lan (mriweb001) with ESMTP (Nemesis) id 0Ltj9X-1VTt081gsn-011Ex4 for ; Tue, 17 Dec 2013 20:38:17 +0100 Received: from [46.22.223.18] by 3capp-webde-bs37.server.lan with HTTP; Tue Dec 17 20:38:17 CET 2013 MIME-Version: 1.0 Message-ID: From: "Marius Weiler" To: xen-users@lists.xen.org Date: Tue, 17 Dec 2013 20:38:17 +0100 (CET) Importance: normal Sensitivity: Normal X-Priority: 3 X-Provags-ID: V03:K0:9i+aOBi4ve+cnbBEz0YjZYktz5Mu1VamFgrQULDDOav 9YApybeb3icanzPnuc5njoETujYgLeH/cVBfphd9kHaD/Ag1yu U12Ex9RjmXcIWQoBHX5a8PYpTuJZaF2aOaJDS7b6EYYA7U27Jg +9x3wcHb25WDoyhc+vD9Wlq+RPnMbNF0s28jOQh46IaRFmRezN tH9uMnnRy1O5LCQ59vFGnPZt+5wn7KHaa9kwJmIwKTSj0cwOFy wBnymsNvfc651cLsqrlcR9fsV7Zlt0yOdAnELBT692PFgF3+MD tt8y5jpoduFI0uKRflR0iX5uK87 Subject: [Xen-users] Device 0 (vif) could not be connected. /etc/xen/scripts/vif-route failed; error detected X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============1547071799889618009==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============1547071799889618009== Content-Type: text/html; charset=UTF-8
Hello,
 
I set up the XEN Routing like described on:
 
http://www.virtualizor.com/wiki/Xen_Routing
 
I'm running CentOS 6.5 x64. In a virtual machine with CentOS 6.5 it worked without any problems.
 
I get this error:
 
Device 0 (vif) could not be connected. /etc/xen/scripts/vif-route failed; error detected
 
Any ideas?
 
Thanks
 
Regards
 
Marius
--===============1547071799889618009== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============1547071799889618009==-- From xen-users-bounces@lists.xen.org Wed Dec 18 08:41:15 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 18 Dec 2013 08:41:15 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtCfs-0005ye-S8; Wed, 18 Dec 2013 08:40:12 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtCfr-0005yR-DK for xen-users@lists.xen.org; Wed, 18 Dec 2013 08:40:11 +0000 Received: from [85.158.137.68:18385] by server-16.bemta-3.messagelabs.com id 19/68-26128-A6F51B25; Wed, 18 Dec 2013 08:40:10 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-4.tower-31.messagelabs.com!1387356008!4670820!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 21334 invoked from network); 18 Dec 2013 08:40:09 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-4.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 18 Dec 2013 08:40:09 -0000 X-IronPort-AV: E=Sophos;i="4.95,506,1384300800"; d="scan'208";a="85655761" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 18 Dec 2013 08:40:07 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Wed, 18 Dec 2013 03:40:07 -0500 Received: from gateway-cbg.eng.citrite.net ([10.80.16.17] helo=[127.0.0.1]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VtCfn-0000us-3P; Wed, 18 Dec 2013 08:40:07 +0000 Message-ID: <1387356006.1025.46.camel@dagon.hellion.org.uk> From: Ian Campbell To: Zir Blazer Date: Wed, 18 Dec 2013 08:40:06 +0000 In-Reply-To: References: ,<1387190962.20076.65.camel@kazak.uk.xensource.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-4+b1 MIME-Version: 1.0 X-DLP: MIA2 Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] Xen black screens while booting in Arch Linux with UEFI GRUB X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Wed, 2013-12-18 at 04:03 -0300, Zir Blazer wrote: > GRUB UEFI-GPT: [...] > Syslinux UEFI-GPT: [...] > Gummiboot UEFI-GPT + EFI file: [...] > Due to the fact that I tested three different Boot Loaders As I said in my original reply xen.efi is supposed to be booted directly from the EFI shell, not via a bootloader. Whether or not that is your problem I don't know, but that is what I believe is supposed to work, whereas all these others are unknowns, so please try that. (this is because Xen needs to be called EFI Boot Services still available and bootloaders tend to call ExitBootServices before calling the kernel) If it still doesn't work then I think you should report to the -devel list as a potential bug. According to the MAINTAINERS the relevant maintainer to CC is Jan Beulich . > I *STILL* didn't managed to get my Radeon 5770 passthroughed properly > (I think I should leave this for another mail with a proper topic, > but...) Yes, please, VGA passthrough is an entirely different can of worms. > Its 4.3.1-2. I actually mentioned it in previous mail, but you > probabily missed it due to my amazing wall of text :D Yes I did, sorry. Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Wed Dec 18 08:41:15 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 18 Dec 2013 08:41:15 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtCfs-0005ye-S8; Wed, 18 Dec 2013 08:40:12 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtCfr-0005yR-DK for xen-users@lists.xen.org; Wed, 18 Dec 2013 08:40:11 +0000 Received: from [85.158.137.68:18385] by server-16.bemta-3.messagelabs.com id 19/68-26128-A6F51B25; Wed, 18 Dec 2013 08:40:10 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-4.tower-31.messagelabs.com!1387356008!4670820!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 21334 invoked from network); 18 Dec 2013 08:40:09 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-4.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 18 Dec 2013 08:40:09 -0000 X-IronPort-AV: E=Sophos;i="4.95,506,1384300800"; d="scan'208";a="85655761" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 18 Dec 2013 08:40:07 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Wed, 18 Dec 2013 03:40:07 -0500 Received: from gateway-cbg.eng.citrite.net ([10.80.16.17] helo=[127.0.0.1]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VtCfn-0000us-3P; Wed, 18 Dec 2013 08:40:07 +0000 Message-ID: <1387356006.1025.46.camel@dagon.hellion.org.uk> From: Ian Campbell To: Zir Blazer Date: Wed, 18 Dec 2013 08:40:06 +0000 In-Reply-To: References: ,<1387190962.20076.65.camel@kazak.uk.xensource.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-4+b1 MIME-Version: 1.0 X-DLP: MIA2 Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] Xen black screens while booting in Arch Linux with UEFI GRUB X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Wed, 2013-12-18 at 04:03 -0300, Zir Blazer wrote: > GRUB UEFI-GPT: [...] > Syslinux UEFI-GPT: [...] > Gummiboot UEFI-GPT + EFI file: [...] > Due to the fact that I tested three different Boot Loaders As I said in my original reply xen.efi is supposed to be booted directly from the EFI shell, not via a bootloader. Whether or not that is your problem I don't know, but that is what I believe is supposed to work, whereas all these others are unknowns, so please try that. (this is because Xen needs to be called EFI Boot Services still available and bootloaders tend to call ExitBootServices before calling the kernel) If it still doesn't work then I think you should report to the -devel list as a potential bug. According to the MAINTAINERS the relevant maintainer to CC is Jan Beulich . > I *STILL* didn't managed to get my Radeon 5770 passthroughed properly > (I think I should leave this for another mail with a proper topic, > but...) Yes, please, VGA passthrough is an entirely different can of worms. > Its 4.3.1-2. I actually mentioned it in previous mail, but you > probabily missed it due to my amazing wall of text :D Yes I did, sorry. Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Wed Dec 18 10:07:21 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 18 Dec 2013 10:07:21 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtE1E-0003ey-Mr; Wed, 18 Dec 2013 10:06:20 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtE1C-0003ef-DV for xen-users@lists.xen.org; Wed, 18 Dec 2013 10:06:18 +0000 Received: from [85.158.139.211:55367] by server-16.bemta-5.messagelabs.com id 8F/16-11843-99371B25; Wed, 18 Dec 2013 10:06:17 +0000 X-Env-Sender: dario.faggioli@citrix.com X-Msg-Ref: server-9.tower-206.messagelabs.com!1387361175!5306638!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n, ML_RADAR_SPEW_LINKS_8, spamassassin: , surbl: (ASYNC_NO) c3VyYmxfcmVjaGVja19kZWxheTogMCAoYWJhbmRv bmVkOiBhYm91dC5tZS9kYXJpby5mYWdnaW9s\naSk=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 5232 invoked from network); 18 Dec 2013 10:06:16 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-9.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 18 Dec 2013 10:06:16 -0000 X-IronPort-AV: E=Sophos;i="4.95,506,1384300800"; d="asc'?scan'208";a="83423551" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 18 Dec 2013 10:06:15 +0000 Received: from [127.0.0.1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Wed, 18 Dec 2013 05:06:14 -0500 Message-ID: <1387361173.3880.98.camel@Solace> From: Dario Faggioli To: Saurabh Mishra Date: Wed, 18 Dec 2013 11:06:13 +0100 In-Reply-To: References: X-Mailer: Evolution 3.8.5 (3.8.5-2.fc19) MIME-Version: 1.0 X-DLP: MIA1 Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] NUMA memory allocation differences between XM and XL toolchain X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6376610819526053157==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6376610819526053157== Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-FiWy87obBwpdSoR2wzbg" --=-FiWy87obBwpdSoR2wzbg Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On mar, 2013-12-17 at 10:59 -0800, Saurabh Mishra wrote: > Hi, > Mmm... I replied to this same e-mail on xen-devel already. For anyone interested, the answer is here: http://bugs.xenproject.org/xen/mid/%3C1387330709.3880.52.camel@Solace%3E That being said, please, avoid cross posting and/or posting the same e-mail to both -devel and -users, this will fragment the discussion and make it a lot less useful than it could be. I appreciate that this can be seen as something in the middle between a user and developer question, but that's not uncommon, and yet people usually post in either one ml _or_ the other. What you should do is try to guess where the message is better suited and send it only there... If, during the thread, we realize it would be better to move the discussion to the other mailing list, we'll do that at that time. Regards, Dario --=20 <> (Raistlin Majere) ----------------------------------------------------------------- Dario Faggioli, Ph.D, http://about.me/dario.faggioli Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK) --=-FiWy87obBwpdSoR2wzbg Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.15 (GNU/Linux) iEYEABECAAYFAlKxc5UACgkQk4XaBE3IOsQSdgCeMEpIb+M2OGK5R4k66ToOC9Hm xmcAn2KBagku37bQ6B4wy2nUxLQp0ifg =yM5d -----END PGP SIGNATURE----- --=-FiWy87obBwpdSoR2wzbg-- --===============6376610819526053157== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6376610819526053157==-- From xen-users-bounces@lists.xen.org Wed Dec 18 10:07:21 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 18 Dec 2013 10:07:21 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtE1E-0003ey-Mr; Wed, 18 Dec 2013 10:06:20 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtE1C-0003ef-DV for xen-users@lists.xen.org; Wed, 18 Dec 2013 10:06:18 +0000 Received: from [85.158.139.211:55367] by server-16.bemta-5.messagelabs.com id 8F/16-11843-99371B25; Wed, 18 Dec 2013 10:06:17 +0000 X-Env-Sender: dario.faggioli@citrix.com X-Msg-Ref: server-9.tower-206.messagelabs.com!1387361175!5306638!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n, ML_RADAR_SPEW_LINKS_8, spamassassin: , surbl: (ASYNC_NO) c3VyYmxfcmVjaGVja19kZWxheTogMCAoYWJhbmRv bmVkOiBhYm91dC5tZS9kYXJpby5mYWdnaW9s\naSk=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 5232 invoked from network); 18 Dec 2013 10:06:16 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-9.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 18 Dec 2013 10:06:16 -0000 X-IronPort-AV: E=Sophos;i="4.95,506,1384300800"; d="asc'?scan'208";a="83423551" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 18 Dec 2013 10:06:15 +0000 Received: from [127.0.0.1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Wed, 18 Dec 2013 05:06:14 -0500 Message-ID: <1387361173.3880.98.camel@Solace> From: Dario Faggioli To: Saurabh Mishra Date: Wed, 18 Dec 2013 11:06:13 +0100 In-Reply-To: References: X-Mailer: Evolution 3.8.5 (3.8.5-2.fc19) MIME-Version: 1.0 X-DLP: MIA1 Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] NUMA memory allocation differences between XM and XL toolchain X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6376610819526053157==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6376610819526053157== Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-FiWy87obBwpdSoR2wzbg" --=-FiWy87obBwpdSoR2wzbg Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On mar, 2013-12-17 at 10:59 -0800, Saurabh Mishra wrote: > Hi, > Mmm... I replied to this same e-mail on xen-devel already. For anyone interested, the answer is here: http://bugs.xenproject.org/xen/mid/%3C1387330709.3880.52.camel@Solace%3E That being said, please, avoid cross posting and/or posting the same e-mail to both -devel and -users, this will fragment the discussion and make it a lot less useful than it could be. I appreciate that this can be seen as something in the middle between a user and developer question, but that's not uncommon, and yet people usually post in either one ml _or_ the other. What you should do is try to guess where the message is better suited and send it only there... If, during the thread, we realize it would be better to move the discussion to the other mailing list, we'll do that at that time. Regards, Dario --=20 <> (Raistlin Majere) ----------------------------------------------------------------- Dario Faggioli, Ph.D, http://about.me/dario.faggioli Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK) --=-FiWy87obBwpdSoR2wzbg Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- Version: GnuPG v1.4.15 (GNU/Linux) iEYEABECAAYFAlKxc5UACgkQk4XaBE3IOsQSdgCeMEpIb+M2OGK5R4k66ToOC9Hm xmcAn2KBagku37bQ6B4wy2nUxLQp0ifg =yM5d -----END PGP SIGNATURE----- --=-FiWy87obBwpdSoR2wzbg-- --===============6376610819526053157== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6376610819526053157==-- From xen-users-bounces@lists.xen.org Wed Dec 18 10:57:20 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 18 Dec 2013 10:57:20 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtEoD-0007xI-A2; Wed, 18 Dec 2013 10:56:57 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtEoB-0007wz-CA for xen-users@lists.xen.org; Wed, 18 Dec 2013 10:56:55 +0000 Received: from [193.109.254.147:12628] by server-7.bemta-14.messagelabs.com id 3C/A2-15500-67F71B25; Wed, 18 Dec 2013 10:56:54 +0000 X-Env-Sender: andrewjregan@gmail.com X-Msg-Ref: server-15.tower-27.messagelabs.com!1387364212!6090418!1 X-Originating-IP: [209.85.213.179] X-SpamReason: No, hits=0.4 required=7.0 tests=HTML_30_40,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 29959 invoked from network); 18 Dec 2013 10:56:53 -0000 Received: from mail-ig0-f179.google.com (HELO mail-ig0-f179.google.com) (209.85.213.179) by server-15.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 18 Dec 2013 10:56:53 -0000 Received: by mail-ig0-f179.google.com with SMTP id hk11so799067igb.0 for ; Wed, 18 Dec 2013 02:56:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=/XrbUdjc6qtFhbj3PaCDp9zeWqg88LkATWw4Z8GviN4=; b=0oPRvbJ3UZ3svhGvFg8epJ2uOTk/4jE//S6COS6nOgcVUpzPWBnXYwSihuOrYIHlYT IQIeWK7B9GQURoyIe/j9PvCXUEKJIqO8uXnB9VTOJ2y0Ko5t7oUmFknr3WMrumm8MiSk bjoF9zBhzHUm06Pjc3qhmAgVDvvqD/YaKbCt32FyE/1RqJcOUVtpjXuYD4DL/2ndcBJC YrKtS5hlbcOVfD6scEBX7BqVzXsOnmlp44m4p1ElkHpsLy1J0nXgoh4Bk85CsBV3Xvaw +zWw/5VAPVyLBQDWNA7Yi3pIZLL2ENRz+ornId7NhdLsYaM+G8zfcB0wz/o5Khm8Qwgv sRVw== MIME-Version: 1.0 X-Received: by 10.43.106.198 with SMTP id dv6mr9224359icc.51.1387364212285; Wed, 18 Dec 2013 02:56:52 -0800 (PST) Received: by 10.64.23.176 with HTTP; Wed, 18 Dec 2013 02:56:52 -0800 (PST) Received: by 10.64.23.176 with HTTP; Wed, 18 Dec 2013 02:56:52 -0800 (PST) In-Reply-To: References: Date: Wed, 18 Dec 2013 10:56:52 +0000 Message-ID: From: Andy Regan To: xen-users@lists.xen.org Subject: Re: [Xen-users] Xen SR NFS mount options = soft X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============3202550376959775171==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============3202550376959775171== Content-Type: multipart/alternative; boundary=20cf303344f90c268004edcce749 --20cf303344f90c268004edcce749 Content-Type: text/plain; charset=ISO-8859-1 Hi Kelvin, Re: http://markmail.org/thread/7kmsum42sdeswvss How did your NFS driver changes work out for you? Did it stop the guests remounting read-only during the 50s-2m periods of NFS unavailability? Thanks! -- Andrew Regan --20cf303344f90c268004edcce749 Content-Type: text/html; charset=ISO-8859-1

Hi Kelvin,

Re: http://markmail.org/thread/7kmsum42sdeswvss

How did your NFS driver changes work out for you? Did it stop the guests remounting read-only during the 50s-2m periods of NFS unavailability? Thanks!

--
Andrew Regan

--20cf303344f90c268004edcce749-- --===============3202550376959775171== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============3202550376959775171==-- From xen-users-bounces@lists.xen.org Wed Dec 18 10:57:20 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 18 Dec 2013 10:57:20 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtEoD-0007xI-A2; Wed, 18 Dec 2013 10:56:57 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtEoB-0007wz-CA for xen-users@lists.xen.org; Wed, 18 Dec 2013 10:56:55 +0000 Received: from [193.109.254.147:12628] by server-7.bemta-14.messagelabs.com id 3C/A2-15500-67F71B25; Wed, 18 Dec 2013 10:56:54 +0000 X-Env-Sender: andrewjregan@gmail.com X-Msg-Ref: server-15.tower-27.messagelabs.com!1387364212!6090418!1 X-Originating-IP: [209.85.213.179] X-SpamReason: No, hits=0.4 required=7.0 tests=HTML_30_40,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 29959 invoked from network); 18 Dec 2013 10:56:53 -0000 Received: from mail-ig0-f179.google.com (HELO mail-ig0-f179.google.com) (209.85.213.179) by server-15.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 18 Dec 2013 10:56:53 -0000 Received: by mail-ig0-f179.google.com with SMTP id hk11so799067igb.0 for ; Wed, 18 Dec 2013 02:56:52 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=/XrbUdjc6qtFhbj3PaCDp9zeWqg88LkATWw4Z8GviN4=; b=0oPRvbJ3UZ3svhGvFg8epJ2uOTk/4jE//S6COS6nOgcVUpzPWBnXYwSihuOrYIHlYT IQIeWK7B9GQURoyIe/j9PvCXUEKJIqO8uXnB9VTOJ2y0Ko5t7oUmFknr3WMrumm8MiSk bjoF9zBhzHUm06Pjc3qhmAgVDvvqD/YaKbCt32FyE/1RqJcOUVtpjXuYD4DL/2ndcBJC YrKtS5hlbcOVfD6scEBX7BqVzXsOnmlp44m4p1ElkHpsLy1J0nXgoh4Bk85CsBV3Xvaw +zWw/5VAPVyLBQDWNA7Yi3pIZLL2ENRz+ornId7NhdLsYaM+G8zfcB0wz/o5Khm8Qwgv sRVw== MIME-Version: 1.0 X-Received: by 10.43.106.198 with SMTP id dv6mr9224359icc.51.1387364212285; Wed, 18 Dec 2013 02:56:52 -0800 (PST) Received: by 10.64.23.176 with HTTP; Wed, 18 Dec 2013 02:56:52 -0800 (PST) Received: by 10.64.23.176 with HTTP; Wed, 18 Dec 2013 02:56:52 -0800 (PST) In-Reply-To: References: Date: Wed, 18 Dec 2013 10:56:52 +0000 Message-ID: From: Andy Regan To: xen-users@lists.xen.org Subject: Re: [Xen-users] Xen SR NFS mount options = soft X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============3202550376959775171==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============3202550376959775171== Content-Type: multipart/alternative; boundary=20cf303344f90c268004edcce749 --20cf303344f90c268004edcce749 Content-Type: text/plain; charset=ISO-8859-1 Hi Kelvin, Re: http://markmail.org/thread/7kmsum42sdeswvss How did your NFS driver changes work out for you? Did it stop the guests remounting read-only during the 50s-2m periods of NFS unavailability? Thanks! -- Andrew Regan --20cf303344f90c268004edcce749 Content-Type: text/html; charset=ISO-8859-1

Hi Kelvin,

Re: http://markmail.org/thread/7kmsum42sdeswvss

How did your NFS driver changes work out for you? Did it stop the guests remounting read-only during the 50s-2m periods of NFS unavailability? Thanks!

--
Andrew Regan

--20cf303344f90c268004edcce749-- --===============3202550376959775171== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============3202550376959775171==-- From xen-users-bounces@lists.xen.org Wed Dec 18 11:05:29 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 18 Dec 2013 11:05:29 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtEw3-0000Rq-1Y; Wed, 18 Dec 2013 11:05:03 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtEw0-0000Rl-2w for xen-users@lists.xen.org; Wed, 18 Dec 2013 11:05:00 +0000 Received: from [85.158.143.35:65276] by server-3.bemta-4.messagelabs.com id 50/7C-32360-B5181B25; Wed, 18 Dec 2013 11:04:59 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-16.tower-21.messagelabs.com!1387364697!6633014!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 15422 invoked from network); 18 Dec 2013 11:04:58 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-16.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 18 Dec 2013 11:04:58 -0000 X-IronPort-AV: E=Sophos;i="4.95,507,1384300800"; d="scan'208";a="85689939" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 18 Dec 2013 11:04:42 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL02.citrite.net (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Wed, 18 Dec 2013 06:04:41 -0500 Message-ID: <1387364680.27441.106.camel@kazak.uk.xensource.com> From: Ian Campbell To: Marius Weiler Date: Wed, 18 Dec 2013 11:04:40 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA1 Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] Device 0 (vif) could not be connected. /etc/xen/scripts/vif-route failed; error detected X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, 2013-12-17 at 20:38 +0100, Marius Weiler wrote: > Hello, > > I set up the XEN Routing like described on: > > http://www.virtualizor.com/wiki/Xen_Routing > > I'm running CentOS 6.5 x64. In a virtual machine with CentOS 6.5 it > worked without any problems. > > I get this error: > > Device 0 (vif) could not be connected. /etc/xen/scripts/vif-route > failed; error detected Some versions of the scripts log a more useful to xenstore, so you might find it there. I thought xend and xl from 4.2 onwards would pick up and log that string too, I don't know which you are using or on what version. If that doesn't help then my usual tactic is to add near top of the hotplug script: exec >>/tmp/hotplug.log 1>&2 and then have a poke and try and figure out what is going wrong, looking for failed commands etc. Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Wed Dec 18 11:05:29 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 18 Dec 2013 11:05:29 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtEw3-0000Rq-1Y; Wed, 18 Dec 2013 11:05:03 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtEw0-0000Rl-2w for xen-users@lists.xen.org; Wed, 18 Dec 2013 11:05:00 +0000 Received: from [85.158.143.35:65276] by server-3.bemta-4.messagelabs.com id 50/7C-32360-B5181B25; Wed, 18 Dec 2013 11:04:59 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-16.tower-21.messagelabs.com!1387364697!6633014!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 15422 invoked from network); 18 Dec 2013 11:04:58 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-16.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 18 Dec 2013 11:04:58 -0000 X-IronPort-AV: E=Sophos;i="4.95,507,1384300800"; d="scan'208";a="85689939" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 18 Dec 2013 11:04:42 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL02.citrite.net (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Wed, 18 Dec 2013 06:04:41 -0500 Message-ID: <1387364680.27441.106.camel@kazak.uk.xensource.com> From: Ian Campbell To: Marius Weiler Date: Wed, 18 Dec 2013 11:04:40 +0000 In-Reply-To: References: Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA1 Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] Device 0 (vif) could not be connected. /etc/xen/scripts/vif-route failed; error detected X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, 2013-12-17 at 20:38 +0100, Marius Weiler wrote: > Hello, > > I set up the XEN Routing like described on: > > http://www.virtualizor.com/wiki/Xen_Routing > > I'm running CentOS 6.5 x64. In a virtual machine with CentOS 6.5 it > worked without any problems. > > I get this error: > > Device 0 (vif) could not be connected. /etc/xen/scripts/vif-route > failed; error detected Some versions of the scripts log a more useful to xenstore, so you might find it there. I thought xend and xl from 4.2 onwards would pick up and log that string too, I don't know which you are using or on what version. If that doesn't help then my usual tactic is to add near top of the hotplug script: exec >>/tmp/hotplug.log 1>&2 and then have a poke and try and figure out what is going wrong, looking for failed commands etc. Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Wed Dec 18 11:16:46 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 18 Dec 2013 11:16:46 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtF71-0002Ar-Cj; Wed, 18 Dec 2013 11:16:23 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtF6z-0002AV-N2 for xen-users@lists.xen.org; Wed, 18 Dec 2013 11:16:21 +0000 Received: from [85.158.137.68:45619] by server-16.bemta-3.messagelabs.com id 12/0E-26128-40481B25; Wed, 18 Dec 2013 11:16:20 +0000 X-Env-Sender: etzion@barnoy.co.il X-Msg-Ref: server-5.tower-31.messagelabs.com!1387365378!4696996!1 X-Originating-IP: [209.85.219.48] X-SpamReason: No, hits=0.9 required=7.0 tests=HTML_40_50,HTML_MESSAGE, RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 19657 invoked from network); 18 Dec 2013 11:16:19 -0000 Received: from mail-oa0-f48.google.com (HELO mail-oa0-f48.google.com) (209.85.219.48) by server-5.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 18 Dec 2013 11:16:19 -0000 Received: by mail-oa0-f48.google.com with SMTP id l6so7971090oag.7 for ; Wed, 18 Dec 2013 03:16:18 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=v8TymCGKhGPX/Y8O0l/KrIlP4Iad0XDLcozi8EsSCQY=; b=CbdNjMn0ihOPqcgOJJnfNvfJqMsiCefmXOe5ZVIGW30Zo1KY57wLU4r+HtZ8WM+1sS 6VabbQaXBqT6+aqbVCio81sqoedwS6kaRith3Z8qZaOD2WG/C78Ah5HfDkJevs7V6drq FJjDVbbbuWp0iEfF2m7+MlPwv868I2mWrziIIMozVwMRDOAAQv8Co/GVZs02zNJ+mr5K NXV+lro2qGGm3G4dz/CsUb6ViaSelKvu2BwVnoFDch+qB2ZiswWJ136IV+7dIyerv20X 0jCneoceU39M5d+qMHZM4ZwaT1xN3Ki1xyxymLvdto6jK00aaQbhdX+wM2+oUaoL2Xfz +CMw== X-Gm-Message-State: ALoCoQnQJa8KF8/Oy7+3fJCS6WATze+Xz/PTpzGvS+UC68yLT+R+OVqtLa5BJGCnHwvl1EKTifRk MIME-Version: 1.0 X-Received: by 10.182.142.37 with SMTP id rt5mr1239367obb.76.1387365378143; Wed, 18 Dec 2013 03:16:18 -0800 (PST) Received: by 10.76.174.98 with HTTP; Wed, 18 Dec 2013 03:16:17 -0800 (PST) X-Originating-IP: [85.64.253.53] Received: by 10.76.174.98 with HTTP; Wed, 18 Dec 2013 03:16:17 -0800 (PST) In-Reply-To: References: Date: Wed, 18 Dec 2013 13:16:17 +0200 Message-ID: From: Etzion Bar-Noy To: Andy Regan Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] Xen SR NFS mount options = soft X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============1901227038881466029==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============1901227038881466029== Content-Type: multipart/alternative; boundary=001a11c2ec9a89ce7304edcd2caf --001a11c2ec9a89ce7304edcd2caf Content-Type: text/plain; charset=ISO-8859-1 Hi. I have changed the settings on some of my systems to 'hard', and VM reliability has increased, especially during storage failover events. And about the Nexenta timeouts - it could be related to over-used zil device. Etzion On Dec 18, 2013 12:58 PM, "Andy Regan" wrote: > Hi Kelvin, > > Re: http://markmail.org/thread/7kmsum42sdeswvss > > How did your NFS driver changes work out for you? Did it stop the guests > remounting read-only during the 50s-2m periods of NFS unavailability? > Thanks! > > -- > Andrew Regan > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > --001a11c2ec9a89ce7304edcd2caf Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

Hi.
I have changed the settings on some of my systems to 'hard', and VM= reliability has increased, especially during storage failover events.

And about the Nexenta timeouts - it could be related to over= -used zil device.

Etzion

On Dec 18, 2013 12:58 PM, "Andy Regan"= <andrewjregan@gmail.com&g= t; wrote:

Hi Kelvin,

Re: http://markmail.org/thread/7kmsum42sdeswvss

How did your NFS driver changes work out for you? Did it sto= p the guests remounting read-only during the 50s-2m periods of NFS unavaila= bility? Thanks!

--
Andrew Regan


_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.x= en.org/xen-users
--001a11c2ec9a89ce7304edcd2caf-- --===============1901227038881466029== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============1901227038881466029==-- From xen-users-bounces@lists.xen.org Wed Dec 18 11:16:46 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 18 Dec 2013 11:16:46 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtF71-0002Ar-Cj; Wed, 18 Dec 2013 11:16:23 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtF6z-0002AV-N2 for xen-users@lists.xen.org; Wed, 18 Dec 2013 11:16:21 +0000 Received: from [85.158.137.68:45619] by server-16.bemta-3.messagelabs.com id 12/0E-26128-40481B25; Wed, 18 Dec 2013 11:16:20 +0000 X-Env-Sender: etzion@barnoy.co.il X-Msg-Ref: server-5.tower-31.messagelabs.com!1387365378!4696996!1 X-Originating-IP: [209.85.219.48] X-SpamReason: No, hits=0.9 required=7.0 tests=HTML_40_50,HTML_MESSAGE, RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 19657 invoked from network); 18 Dec 2013 11:16:19 -0000 Received: from mail-oa0-f48.google.com (HELO mail-oa0-f48.google.com) (209.85.219.48) by server-5.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 18 Dec 2013 11:16:19 -0000 Received: by mail-oa0-f48.google.com with SMTP id l6so7971090oag.7 for ; Wed, 18 Dec 2013 03:16:18 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:in-reply-to:references:date :message-id:subject:from:to:cc:content-type; bh=v8TymCGKhGPX/Y8O0l/KrIlP4Iad0XDLcozi8EsSCQY=; b=CbdNjMn0ihOPqcgOJJnfNvfJqMsiCefmXOe5ZVIGW30Zo1KY57wLU4r+HtZ8WM+1sS 6VabbQaXBqT6+aqbVCio81sqoedwS6kaRith3Z8qZaOD2WG/C78Ah5HfDkJevs7V6drq FJjDVbbbuWp0iEfF2m7+MlPwv868I2mWrziIIMozVwMRDOAAQv8Co/GVZs02zNJ+mr5K NXV+lro2qGGm3G4dz/CsUb6ViaSelKvu2BwVnoFDch+qB2ZiswWJ136IV+7dIyerv20X 0jCneoceU39M5d+qMHZM4ZwaT1xN3Ki1xyxymLvdto6jK00aaQbhdX+wM2+oUaoL2Xfz +CMw== X-Gm-Message-State: ALoCoQnQJa8KF8/Oy7+3fJCS6WATze+Xz/PTpzGvS+UC68yLT+R+OVqtLa5BJGCnHwvl1EKTifRk MIME-Version: 1.0 X-Received: by 10.182.142.37 with SMTP id rt5mr1239367obb.76.1387365378143; Wed, 18 Dec 2013 03:16:18 -0800 (PST) Received: by 10.76.174.98 with HTTP; Wed, 18 Dec 2013 03:16:17 -0800 (PST) X-Originating-IP: [85.64.253.53] Received: by 10.76.174.98 with HTTP; Wed, 18 Dec 2013 03:16:17 -0800 (PST) In-Reply-To: References: Date: Wed, 18 Dec 2013 13:16:17 +0200 Message-ID: From: Etzion Bar-Noy To: Andy Regan Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] Xen SR NFS mount options = soft X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============1901227038881466029==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============1901227038881466029== Content-Type: multipart/alternative; boundary=001a11c2ec9a89ce7304edcd2caf --001a11c2ec9a89ce7304edcd2caf Content-Type: text/plain; charset=ISO-8859-1 Hi. I have changed the settings on some of my systems to 'hard', and VM reliability has increased, especially during storage failover events. And about the Nexenta timeouts - it could be related to over-used zil device. Etzion On Dec 18, 2013 12:58 PM, "Andy Regan" wrote: > Hi Kelvin, > > Re: http://markmail.org/thread/7kmsum42sdeswvss > > How did your NFS driver changes work out for you? Did it stop the guests > remounting read-only during the 50s-2m periods of NFS unavailability? > Thanks! > > -- > Andrew Regan > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > --001a11c2ec9a89ce7304edcd2caf Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

Hi.
I have changed the settings on some of my systems to 'hard', and VM= reliability has increased, especially during storage failover events.

And about the Nexenta timeouts - it could be related to over= -used zil device.

Etzion

On Dec 18, 2013 12:58 PM, "Andy Regan"= <andrewjregan@gmail.com&g= t; wrote:

Hi Kelvin,

Re: http://markmail.org/thread/7kmsum42sdeswvss

How did your NFS driver changes work out for you? Did it sto= p the guests remounting read-only during the 50s-2m periods of NFS unavaila= bility? Thanks!

--
Andrew Regan


_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.x= en.org/xen-users
--001a11c2ec9a89ce7304edcd2caf-- --===============1901227038881466029== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============1901227038881466029==-- From xen-users-bounces@lists.xen.org Wed Dec 18 21:55:13 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 18 Dec 2013 21:55:13 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtP4E-0007Cn-9m; Wed, 18 Dec 2013 21:54:10 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtP4B-0007C0-Be; Wed, 18 Dec 2013 21:54:07 +0000 Received: from [85.158.139.211:39902] by server-16.bemta-5.messagelabs.com id 61/93-11843-E7912B25; Wed, 18 Dec 2013 21:54:06 +0000 X-Env-Sender: russell.pavlicek.xen@gmail.com X-Msg-Ref: server-4.tower-206.messagelabs.com!1387403643!5455892!1 X-Originating-IP: [209.85.220.44] X-SpamReason: No, hits=0.3 required=7.0 tests=RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 2269 invoked from network); 18 Dec 2013 21:54:05 -0000 Received: from mail-pa0-f44.google.com (HELO mail-pa0-f44.google.com) (209.85.220.44) by server-4.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 18 Dec 2013 21:54:05 -0000 Received: by mail-pa0-f44.google.com with SMTP id fa1so247322pad.3 for ; Wed, 18 Dec 2013 13:54:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=ES8kVAsVvXGtUsXcLPyrqw+lXDy3D4VSHQDxDjeIS4Y=; b=jod1ZhXG8qeWj37Tq6yUsoDnrqOnN6UFaxNZiOjm80yscBZGnYQTa/lYqbau8gEWDs nUMfkxhOKwUK7JYcxmlZQilQusHEXvDYlA1fFVknvTw2MT9m+NlpclyE5YXkUahUDk5Y avGU85iAuwJ6Osq8nP9G5z62+oWNLmj5shJpei+0FdVrzOQrzReUI29QUInqPiAyUXGH vIuHqdb3xyCR6TGiWMYPPhjqbq1Q6TRsxc3Uomw/RBTW0JRQwb6bglyECCd2drIdyRad JHiMUF5KTkcHb2KnwV5gUkMgHfecsZHJ6CZ6QnlfE3+HuYJ9mhBQZ64rmLtRHw5ntZYq RIBQ== MIME-Version: 1.0 X-Received: by 10.66.158.132 with SMTP id wu4mr36883968pab.66.1387403643523; Wed, 18 Dec 2013 13:54:03 -0800 (PST) Received: by 10.68.78.137 with HTTP; Wed, 18 Dec 2013 13:54:03 -0800 (PST) Date: Wed, 18 Dec 2013 16:54:03 -0500 X-Google-Sender-Auth: XwMwKVfrSjD9E8xavsFe_Lx18Gw Message-ID: From: Russ Pavlicek To: "xen-users@lists.xen.org" , xen-devel@lists.xen.org, publicity@lists.xenproject.org, xen-api@lists.xen.org Subject: [Xen-users] Cast your vote for Virtualization Product of the Year at LinuxQuestions.org X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Here is an opportunity for Xen folks to voice their support in the LinuxQuestions.org Virtualization Product of the Year: http://www.linuxquestions.org/questions/2013-linuxquestions-org-members-choice-awards-109/virtualization-product-of-the-year-4175488214/ This is a chance to speak up and not simply let other virtualization technologies take center stage. Russ Pavlicek _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Wed Dec 18 21:55:13 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 18 Dec 2013 21:55:13 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtP4E-0007Cn-9m; Wed, 18 Dec 2013 21:54:10 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtP4B-0007C0-Be; Wed, 18 Dec 2013 21:54:07 +0000 Received: from [85.158.139.211:39902] by server-16.bemta-5.messagelabs.com id 61/93-11843-E7912B25; Wed, 18 Dec 2013 21:54:06 +0000 X-Env-Sender: russell.pavlicek.xen@gmail.com X-Msg-Ref: server-4.tower-206.messagelabs.com!1387403643!5455892!1 X-Originating-IP: [209.85.220.44] X-SpamReason: No, hits=0.3 required=7.0 tests=RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 2269 invoked from network); 18 Dec 2013 21:54:05 -0000 Received: from mail-pa0-f44.google.com (HELO mail-pa0-f44.google.com) (209.85.220.44) by server-4.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 18 Dec 2013 21:54:05 -0000 Received: by mail-pa0-f44.google.com with SMTP id fa1so247322pad.3 for ; Wed, 18 Dec 2013 13:54:03 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=ES8kVAsVvXGtUsXcLPyrqw+lXDy3D4VSHQDxDjeIS4Y=; b=jod1ZhXG8qeWj37Tq6yUsoDnrqOnN6UFaxNZiOjm80yscBZGnYQTa/lYqbau8gEWDs nUMfkxhOKwUK7JYcxmlZQilQusHEXvDYlA1fFVknvTw2MT9m+NlpclyE5YXkUahUDk5Y avGU85iAuwJ6Osq8nP9G5z62+oWNLmj5shJpei+0FdVrzOQrzReUI29QUInqPiAyUXGH vIuHqdb3xyCR6TGiWMYPPhjqbq1Q6TRsxc3Uomw/RBTW0JRQwb6bglyECCd2drIdyRad JHiMUF5KTkcHb2KnwV5gUkMgHfecsZHJ6CZ6QnlfE3+HuYJ9mhBQZ64rmLtRHw5ntZYq RIBQ== MIME-Version: 1.0 X-Received: by 10.66.158.132 with SMTP id wu4mr36883968pab.66.1387403643523; Wed, 18 Dec 2013 13:54:03 -0800 (PST) Received: by 10.68.78.137 with HTTP; Wed, 18 Dec 2013 13:54:03 -0800 (PST) Date: Wed, 18 Dec 2013 16:54:03 -0500 X-Google-Sender-Auth: XwMwKVfrSjD9E8xavsFe_Lx18Gw Message-ID: From: Russ Pavlicek To: "xen-users@lists.xen.org" , xen-devel@lists.xen.org, publicity@lists.xenproject.org, xen-api@lists.xen.org Subject: [Xen-users] Cast your vote for Virtualization Product of the Year at LinuxQuestions.org X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Here is an opportunity for Xen folks to voice their support in the LinuxQuestions.org Virtualization Product of the Year: http://www.linuxquestions.org/questions/2013-linuxquestions-org-members-choice-awards-109/virtualization-product-of-the-year-4175488214/ This is a chance to speak up and not simply let other virtualization technologies take center stage. Russ Pavlicek _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 19 02:21:31 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 19 Dec 2013 02:21:31 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtTDu-00026M-Eg; Thu, 19 Dec 2013 02:20:26 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtTDt-00026H-5c for xen-users@lists.xen.org; Thu, 19 Dec 2013 02:20:25 +0000 Received: from [193.109.254.147:12052] by server-11.bemta-14.messagelabs.com id 56/E2-20576-8E752B25; Thu, 19 Dec 2013 02:20:24 +0000 X-Env-Sender: kevin.zhang@octlink.com X-Msg-Ref: server-8.tower-27.messagelabs.com!1387419620!6284087!1 X-Originating-IP: [222.128.79.248] X-SpamReason: No, hits=0.8 required=7.0 tests=HTML_40_50,HTML_MESSAGE, MIME_BOUND_NEXTPART X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23444 invoked from network); 19 Dec 2013 02:20:21 -0000 Received: from unknown (HELO mail.octlink.com) (222.128.79.248) by server-8.tower-27.messagelabs.com with SMTP; 19 Dec 2013 02:20:21 -0000 Received: from localhost (localhost [127.0.0.1]) by mail.octlink.com (Postfix) with SMTP id C1253E643A for ; Thu, 19 Dec 2013 10:20:18 +0800 (CST) Received: from zhangpei-PC (pfsense.localdomain [192.168.10.253]) by mail.octlink.com (Postfix) with ESMTPA id 1BDF2E643B for ; Thu, 19 Dec 2013 10:20:05 +0800 (CST) Date: Thu, 19 Dec 2013 10:20:01 +0800 From: "kevin.zhang@octlink.com" To: xen-users References: X-Priority: 3 X-Has-Attach: no X-Mailer: Foxmail 7, 1, 3, 52[cn] Mime-Version: 1.0 Message-ID: <2013121910200013972216@octlink.com> X-DSPAM-Result: Whitelisted X-DSPAM-Processed: Thu Dec 19 10:20:18 2013 X-DSPAM-Confidence: 0.9909 X-DSPAM-Probability: 0.0000 X-DSPAM-Signature: 3,52b257e27151684244473 X-DSPAM-Factors: 27, !, 0.00376, !, 0.00376, Message-ID*octlink.com>, 0.00649, No, 0.00810, No, 0.00810, vm, 0.00816, vm, 0.00816, create, 0.00916, create, 0.00916, vga+val, 0.01000, vga+val, 0.01000, failed, 0.01000, failed, 0.01000, True)+ , 0.01000, 6/dist, 0.01000, 6/dist, 0.01000, args+fdb, 0.01000, args+fdb, 0.01000, 2407), 0.01000, 2407), 0.01000, failed , 0.01000, acpi+val, 0.01000, acpi+val, 0.01000, allocate, 0.01000, allocate, 0.01000, all+the, 0.01000, all+the, 0.01000 Subject: [Xen-users] HVM migrate failed on both xen 4.1 and xen 4.2 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6229027794299851928==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a multi-part message in MIME format. --===============6229027794299851928== Content-Type: multipart/alternative; boundary="----=_001_NextPart482123223363_=----" This is a multi-part message in MIME format. ------=_001_NextPart482123223363_=---- Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 SGkgYWxsLA0KDQogICAgICAgIFRoZXNlIGRheXMgSSBhbSB0ZXN0aW5nIHhlbiBsaXZlIG1pZ3Jh dGlvbiB3aXRoIHhlbi4gDQpUaGUgcmVzdWx0IGlzIHRoYXQ6IA0KICAgICAgIFBWTSBtaWdyYXRp b24gd29ya3Mgd2VsbCBhbGwgdGhlIHRpbWUuDQogICAgICAgSG93ZXZlciwgSFZNIHdpbmRvd3Mg dm0gbWlncmF0aW9uIGFsd2F5cyBmYWlsZWQuICBJJ20gdXNpbmcgeGVuIDQuMSBhbmQgNC4yIHdp dGggTkZTIGFzIHNoYXJlZCBzdG9yYWdlLCBhbmQgYm90aCBmYWlsZWQgd2l0aCBIVk0gbWlncmF0 aW9uLg0KV2UgYXJlIG1haW5seSB1c2luZyB4ZW5kIHRvb2xzdGFjay4gIEFmdGVyIHNlYXJjaGlu ZyBmb3IgdGhlIGVycm9yIG1lc3NhZ2VzLCBJIGZvdW5kIGxvdHMgb2YgcGVvcGxlIGhhZCB0aGlz IHByb2JsZW0sIGFuZCBpdCByZWxhdGVkIHRvIGh2bSByZXN0b3JlIGZ1bmN0aW9uIGJ1Zy4NCkNv dWxkIGFueW9uZSBoZWxwIHVzPyBUaGFuayB5b3UgdmVyeSBtdWNoIQ0KRXJyb3IgbWVzc2FnZXMg YXJlOg0KWzIwMTMtMTItMTkgMTA6MTE6NDUgMjAyN10gSU5GTyAoWGVuZENoZWNrcG9pbnQ6MjYw KSByZXN0b3JlIGh2bSBkb21haW4gNCwgYXBpYz0xLCBwYWU9MQ0KWzIwMTMtMTItMTkgMTA6MTE6 NDUgMjAyN10gREVCVUcgKGltYWdlOjMzNykgU3RvcmVkIGEgVk5DIHBhc3N3b3JkIGZvciB2ZmIg YWNjZXNzDQpbMjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoaW1hZ2U6ODkxKSBhcmdz OiBib290LCB2YWw6IGRjDQpbMjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoaW1hZ2U6 ODkxKSBhcmdzOiBmZGEsIHZhbDogTm9uZQ0KWzIwMTMtMTItMTkgMTA6MTE6NDUgMjAyN10gREVC VUcgKGltYWdlOjg5MSkgYXJnczogZmRiLCB2YWw6IE5vbmUNClsyMDEzLTEyLTE5IDEwOjExOjQ1 IDIwMjddIERFQlVHIChpbWFnZTo4OTEpIGFyZ3M6IHNvdW5kaHcsIHZhbDogTm9uZQ0KWzIwMTMt MTItMTkgMTA6MTE6NDUgMjAyN10gREVCVUcgKGltYWdlOjg5MSkgYXJnczogbG9jYWx0aW1lLCB2 YWw6IDANClsyMDEzLTEyLTE5IDEwOjExOjQ1IDIwMjddIERFQlVHIChpbWFnZTo4OTEpIGFyZ3M6 IHNlcmlhbCwgdmFsOiBbJ3B0eSddDQpbMjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAo aW1hZ2U6ODkxKSBhcmdzOiBzdGQtdmdhLCB2YWw6IDANClsyMDEzLTEyLTE5IDEwOjExOjQ1IDIw MjddIERFQlVHIChpbWFnZTo4OTEpIGFyZ3M6IGlzYSwgdmFsOiAwDQpbMjAxMy0xMi0xOSAxMDox MTo0NSAyMDI3XSBERUJVRyAoaW1hZ2U6ODkxKSBhcmdzOiBhY3BpLCB2YWw6IDENClsyMDEzLTEy LTE5IDEwOjExOjQ1IDIwMjddIERFQlVHIChpbWFnZTo4OTEpIGFyZ3M6IHVzYiwgdmFsOiAwDQpb MjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoaW1hZ2U6ODkxKSBhcmdzOiB1c2JkZXZp Y2UsIHZhbDogdGFibGV0DQpbMjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoaW1hZ2U6 ODkxKSBhcmdzOiBnZnhfcGFzc3RocnUsIHZhbDogTm9uZQ0KWzIwMTMtMTItMTkgMTA6MTE6NDUg MjAyN10gSU5GTyAoaW1hZ2U6ODIyKSBOZWVkIHRvIGNyZWF0ZSBwbGF0Zm9ybSBkZXZpY2UuW2Rv bWlkOjRdDQpbMjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoWGVuZENoZWNrcG9pbnQ6 Mjc4KSByZXN0b3JlOnNoYWRvdz0weGMsIF9zdGF0aWNfbWF4PTB4NDAwMDAwMDAsIF9zdGF0aWNf bWluPTB4MCwgDQpbMjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoWGVuZENoZWNrcG9p bnQ6MzA1KSBbeGNfcmVzdG9yZV06IC91c3IvbGliL3hlbi9iaW4veGNfcmVzdG9yZSA0IDQgNiA3 IDEgMSAxIDANClsyMDEzLTEyLTE5IDEwOjEyOjEwIDIwMjddIElORk8gKFhlbmRDaGVja3BvaW50 OjQyMykgeGM6IGVycm9yOiBGYWlsZWQgdG8gYWxsb2NhdGUgbWVtb3J5IGZvciBiYXRjaC4hOiBJ bnRlcm5hbCBlcnJvcg0KWzIwMTMtMTItMTkgMTA6MTI6MTEgMjAyN10gREVCVUcgKFhlbmREb21h aW5JbmZvOjMwNzcpIFhlbmREb21haW5JbmZvLmRlc3Ryb3k6IGRvbWlkPTQNClsyMDEzLTEyLTE5 IDEwOjEyOjExIDIwMjddIEVSUk9SIChYZW5kRG9tYWluSW5mbzozMDkxKSBYZW5kRG9tYWluSW5m by5kZXN0cm95OiBkb21haW4gZGVzdHJ1Y3Rpb24gZmFpbGVkLg0KVHJhY2ViYWNrIChtb3N0IHJl Y2VudCBjYWxsIGxhc3QpOg0KICBGaWxlICIvdXNyL2xvY2FsL2xpYi9weXRob24yLjYvZGlzdC1w YWNrYWdlcy94ZW4veGVuZC9YZW5kRG9tYWluSW5mby5weSIsIGxpbmUgMzA4NCwgaW4gZGVzdHJv eQ0KICAgIHhjLmRvbWFpbl9wYXVzZShzZWxmLmRvbWlkKQ0KRXJyb3I6ICgzLCAnTm8gc3VjaCBw cm9jZXNzJykNClsyMDEzLTEyLTE5IDEwOjEyOjExIDIwMjddIERFQlVHIChYZW5kRG9tYWluSW5m bzoyNDA3KSBObyBkZXZpY2UgbW9kZWwNClsyMDEzLTEyLTE5IDEwOjEyOjExIDIwMjddIERFQlVH IChYZW5kRG9tYWluSW5mbzoyNDA5KSBSZWxlYXNpbmcgZGV2aWNlcw0KWzIwMTMtMTItMTkgMTA6 MTI6MTEgMjAyN10gREVCVUcgKFhlbmREb21haW5JbmZvOjI0MTUpIFJlbW92aW5nIGNvbnNvbGUv MA0KWzIwMTMtMTItMTkgMTA6MTI6MTEgMjAyN10gREVCVUcgKFhlbmREb21haW5JbmZvOjEyNzYp IFhlbmREb21haW5JbmZvLmRlc3Ryb3lEZXZpY2U6IGRldmljZUNsYXNzID0gY29uc29sZSwgZGV2 aWNlID0gY29uc29sZS8wDQpbMjAxMy0xMi0xOSAxMDoxMjoxMSAyMDI3XSBERUJVRyAoWGVuZERv bWFpbkluZm86MjQxNSkgUmVtb3ZpbmcgdmZiLzANClsyMDEzLTEyLTE5IDEwOjEyOjExIDIwMjdd IERFQlVHIChYZW5kRG9tYWluSW5mbzoxMjc2KSBYZW5kRG9tYWluSW5mby5kZXN0cm95RGV2aWNl OiBkZXZpY2VDbGFzcyA9IHZmYiwgZGV2aWNlID0gdmZiLzANClsyMDEzLTEyLTE5IDEwOjEyOjEx IDIwMjddIElORk8gKFhlbmREb21haW46MTEyNikgRG9tYWluIHdpbjA4IChjOGJmODBjOC1kNjNj LTRhYmUtYTUyMy0yNmZiMjQzOWY4MTYpIGRlbGV0ZWQuDQpbMjAxMy0xMi0xOSAxMDoxMjoxMSAy MDI3XSBFUlJPUiAoWGVuZENoZWNrcG9pbnQ6MzU3KSAvdXNyL2xpYi94ZW4vYmluL3hjX3Jlc3Rv cmUgNCA0IDYgNyAxIDEgMSAwIGZhaWxlZA0KVHJhY2ViYWNrIChtb3N0IHJlY2VudCBjYWxsIGxh c3QpOg0KICBGaWxlICIvdXNyL2xvY2FsL2xpYi9weXRob24yLjYvZGlzdC1wYWNrYWdlcy94ZW4v eGVuZC9YZW5kQ2hlY2twb2ludC5weSIsIGxpbmUgMzA5LCBpbiByZXN0b3JlDQogICAgZm9ya0hl bHBlcihjbWQsIGZkLCBoYW5kbGVyLmhhbmRsZXIsIFRydWUpDQogIEZpbGUgIi91c3IvbG9jYWwv bGliL3B5dGhvbjIuNi9kaXN0LXBhY2thZ2VzL3hlbi94ZW5kL1hlbmRDaGVja3BvaW50LnB5Iiwg bGluZSA0MTEsIGluIGZvcmtIZWxwZXINCiAgICByYWlzZSBYZW5kRXJyb3IoIiVzIGZhaWxlZCIg JSBzdHJpbmcuam9pbihjbWQpKQ0KWGVuZEVycm9yOiAvdXNyL2xpYi94ZW4vYmluL3hjX3Jlc3Rv cmUgNCA0IDYgNyAxIDEgMSAwIGZhaWxlZA0KWzIwMTMtMTItMTkgMTA6MTI6MTEgMjAyN10gRVJS T1IgKFhlbmREb21haW46MTE5NCkgUmVzdG9yZSBmYWlsZWQNClRyYWNlYmFjayAobW9zdCByZWNl bnQgY2FsbCBsYXN0KToNCiAgRmlsZSAiL3Vzci9sb2NhbC9saWIvcHl0aG9uMi42L2Rpc3QtcGFj a2FnZXMveGVuL3hlbmQvWGVuZERvbWFpbi5weSIsIGxpbmUgMTE3OCwgaW4gZG9tYWluX3Jlc3Rv cmVfZmQNCiAgICBkb21pbmZvID0gWGVuZENoZWNrcG9pbnQucmVzdG9yZShzZWxmLCBmZCwgcGF1 c2VkPXBhdXNlZCwgcmVsb2NhdGluZz1yZWxvY2F0aW5nKQ0KICBGaWxlICIvdXNyL2xvY2FsL2xp Yi9weXRob24yLjYvZGlzdC1wYWNrYWdlcy94ZW4veGVuZC9YZW5kQ2hlY2twb2ludC5weSIsIGxp bmUgMzU4LCBpbiByZXN0b3JlDQogICAgcmFpc2UgZXhuDQpYZW5kRXJyb3I6IC91c3IvbGliL3hl bi9iaW4veGNfcmVzdG9yZSA0IDQgNiA3IDEgMSAxIDAgZmFpbGVkDQogDQogIA== ------=_001_NextPart482123223363_=---- Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable =EF=BB=BF
Hi all,
 
        These days I am testing xe= n live=20 migration with xen.
The result is that:
       PVM migration works well all the= =20 time.
       However, HVM windows vm migratio= n=20 always failed.  I'm using xen 4.1 and 4.2 with NFS as shared storage,= and=20 both failed with HVM migration.
We are mainly using xend toolstack.  After searching for the err= or=20 messages, I found lots of people had this problem, and it related to hvm r= estore=20 function bug.
Could anyone help us? Thank you very much!
Error messages are:
[2013-12-19 10:11:45 202= 7] INFO=20 (XendCheckpoint:260) restore hvm domain 4, apic=3D1, pae=3D1
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:337) Stored a VNC password for vfb access
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: boot, val: dc
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: fda, val: None
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: fdb, val: None
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: soundhw, val: None
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: localtime, val: 0
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: serial, val: ['pty']
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: std-vga, val: 0
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: isa, val: 0
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: acpi, val: 1
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: usb, val: 0
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: usbdevice, val: tablet
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: gfx_passthru, val: None
[2013-12-19 10:11:45 202= 7] INFO=20 (image:822) Need to create platform device.[domid:4]
[2013-12-19 10:11:45 202= 7] DEBUG=20 (XendCheckpoint:278) restore:shadow=3D0xc, _static_max=3D0x40000000,=20 _static_min=3D0x0,
[2013-12-19 10:11:45 202= 7] DEBUG=20 (XendCheckpoint:305) [xc_restore]: /usr/lib/xen/bin/xc_restore 4 4 6 7= 1 1 1=20 0
[2013-12-19 10:12:10 202= 7] INFO=20 (XendCheckpoint:423) xc: error: Failed to allocate memory for batch.!:= =20 Internal error
[2013-12-19 10:12:11 202= 7] DEBUG=20 (XendDomainInfo:3077) XendDomainInfo.destroy: domid=3D4
[2013-12-19 10:12:11 202= 7] ERROR=20 (XendDomainInfo:3091) XendDomainInfo.destroy: domain destruction=20 failed.
Traceback (most recent c= all=20 last):
  File=20 "/usr/local/lib/python2.6/dist-packages/xen/xend/XendDomainInfo.py", l= ine=20 3084, in destroy
   =20 xc.domain_pause(self.domid)
Error: (3, 'No such=20 process')
[2013-12-19 10:12:11 202= 7] DEBUG=20 (XendDomainInfo:2407) No device model
[2013-12-19 10:12:11 202= 7] DEBUG=20 (XendDomainInfo:2409) Releasing devices
[2013-12-19 10:12:11 202= 7] DEBUG=20 (XendDomainInfo:2415) Removing console/0
[2013-12-19 10:12:11 202= 7] DEBUG=20 (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass =3D co= nsole,=20 device =3D console/0
[2013-12-19 10:12:11 202= 7] DEBUG=20 (XendDomainInfo:2415) Removing vfb/0
[2013-12-19 10:12:11 202= 7] DEBUG=20 (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass =3D vf= b,=20 device =3D vfb/0
[2013-12-19 10:12:11 202= 7] INFO=20 (XendDomain:1126) Domain win08 (c8bf80c8-d63c-4abe-a523-26fb2439f816)=20 deleted.
[2013-12-19 10:12:11 202= 7] ERROR=20 (XendCheckpoint:357) /usr/lib/xen/bin/xc_restore 4 4 6 7 1 1 1 0=20 failed
Traceback (most recent c= all=20 last):
  File=20 "/usr/local/lib/python2.6/dist-packages/xen/xend/XendCheckpoint.py", l= ine=20 309, in restore
   =20 forkHelper(cmd, fd, handler.handler, True)
  File=20 "/usr/local/lib/python2.6/dist-packages/xen/xend/XendCheckpoint.py", l= ine=20 411, in forkHelper
    raise= =20 XendError("%s failed" % string.join(cmd))
XendError:=20 /usr/lib/xen/bin/xc_restore 4 4 6 7 1 1 1 0 failed
[2013-12-19 10:12:11 202= 7] ERROR=20 (XendDomain:1194) Restore failed
Traceback (most recent c= all=20 last):
  File=20 "/usr/local/lib/python2.6/dist-packages/xen/xend/XendDomain.py", line = 1178,=20 in domain_restore_fd
    domin= fo =3D=20 XendCheckpoint.restore(self, fd, paused=3Dpaused, relocating=3Drelocat= ing)
  File=20 "/usr/local/lib/python2.6/dist-packages/xen/xend/XendCheckpoint.py", l= ine=20 358, in restore
    raise= =20 exn
XendError:=20 /usr/lib/xen/bin/xc_restore 4 4 6 7 1 1 1 0=20 failed
 
 
------=_001_NextPart482123223363_=------ --===============6229027794299851928== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6229027794299851928==-- From xen-users-bounces@lists.xen.org Thu Dec 19 02:21:31 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 19 Dec 2013 02:21:31 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtTDu-00026M-Eg; Thu, 19 Dec 2013 02:20:26 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtTDt-00026H-5c for xen-users@lists.xen.org; Thu, 19 Dec 2013 02:20:25 +0000 Received: from [193.109.254.147:12052] by server-11.bemta-14.messagelabs.com id 56/E2-20576-8E752B25; Thu, 19 Dec 2013 02:20:24 +0000 X-Env-Sender: kevin.zhang@octlink.com X-Msg-Ref: server-8.tower-27.messagelabs.com!1387419620!6284087!1 X-Originating-IP: [222.128.79.248] X-SpamReason: No, hits=0.8 required=7.0 tests=HTML_40_50,HTML_MESSAGE, MIME_BOUND_NEXTPART X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23444 invoked from network); 19 Dec 2013 02:20:21 -0000 Received: from unknown (HELO mail.octlink.com) (222.128.79.248) by server-8.tower-27.messagelabs.com with SMTP; 19 Dec 2013 02:20:21 -0000 Received: from localhost (localhost [127.0.0.1]) by mail.octlink.com (Postfix) with SMTP id C1253E643A for ; Thu, 19 Dec 2013 10:20:18 +0800 (CST) Received: from zhangpei-PC (pfsense.localdomain [192.168.10.253]) by mail.octlink.com (Postfix) with ESMTPA id 1BDF2E643B for ; Thu, 19 Dec 2013 10:20:05 +0800 (CST) Date: Thu, 19 Dec 2013 10:20:01 +0800 From: "kevin.zhang@octlink.com" To: xen-users References: X-Priority: 3 X-Has-Attach: no X-Mailer: Foxmail 7, 1, 3, 52[cn] Mime-Version: 1.0 Message-ID: <2013121910200013972216@octlink.com> X-DSPAM-Result: Whitelisted X-DSPAM-Processed: Thu Dec 19 10:20:18 2013 X-DSPAM-Confidence: 0.9909 X-DSPAM-Probability: 0.0000 X-DSPAM-Signature: 3,52b257e27151684244473 X-DSPAM-Factors: 27, !, 0.00376, !, 0.00376, Message-ID*octlink.com>, 0.00649, No, 0.00810, No, 0.00810, vm, 0.00816, vm, 0.00816, create, 0.00916, create, 0.00916, vga+val, 0.01000, vga+val, 0.01000, failed, 0.01000, failed, 0.01000, True)+ , 0.01000, 6/dist, 0.01000, 6/dist, 0.01000, args+fdb, 0.01000, args+fdb, 0.01000, 2407), 0.01000, 2407), 0.01000, failed , 0.01000, acpi+val, 0.01000, acpi+val, 0.01000, allocate, 0.01000, allocate, 0.01000, all+the, 0.01000, all+the, 0.01000 Subject: [Xen-users] HVM migrate failed on both xen 4.1 and xen 4.2 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6229027794299851928==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a multi-part message in MIME format. --===============6229027794299851928== Content-Type: multipart/alternative; boundary="----=_001_NextPart482123223363_=----" This is a multi-part message in MIME format. ------=_001_NextPart482123223363_=---- Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 SGkgYWxsLA0KDQogICAgICAgIFRoZXNlIGRheXMgSSBhbSB0ZXN0aW5nIHhlbiBsaXZlIG1pZ3Jh dGlvbiB3aXRoIHhlbi4gDQpUaGUgcmVzdWx0IGlzIHRoYXQ6IA0KICAgICAgIFBWTSBtaWdyYXRp b24gd29ya3Mgd2VsbCBhbGwgdGhlIHRpbWUuDQogICAgICAgSG93ZXZlciwgSFZNIHdpbmRvd3Mg dm0gbWlncmF0aW9uIGFsd2F5cyBmYWlsZWQuICBJJ20gdXNpbmcgeGVuIDQuMSBhbmQgNC4yIHdp dGggTkZTIGFzIHNoYXJlZCBzdG9yYWdlLCBhbmQgYm90aCBmYWlsZWQgd2l0aCBIVk0gbWlncmF0 aW9uLg0KV2UgYXJlIG1haW5seSB1c2luZyB4ZW5kIHRvb2xzdGFjay4gIEFmdGVyIHNlYXJjaGlu ZyBmb3IgdGhlIGVycm9yIG1lc3NhZ2VzLCBJIGZvdW5kIGxvdHMgb2YgcGVvcGxlIGhhZCB0aGlz IHByb2JsZW0sIGFuZCBpdCByZWxhdGVkIHRvIGh2bSByZXN0b3JlIGZ1bmN0aW9uIGJ1Zy4NCkNv dWxkIGFueW9uZSBoZWxwIHVzPyBUaGFuayB5b3UgdmVyeSBtdWNoIQ0KRXJyb3IgbWVzc2FnZXMg YXJlOg0KWzIwMTMtMTItMTkgMTA6MTE6NDUgMjAyN10gSU5GTyAoWGVuZENoZWNrcG9pbnQ6MjYw KSByZXN0b3JlIGh2bSBkb21haW4gNCwgYXBpYz0xLCBwYWU9MQ0KWzIwMTMtMTItMTkgMTA6MTE6 NDUgMjAyN10gREVCVUcgKGltYWdlOjMzNykgU3RvcmVkIGEgVk5DIHBhc3N3b3JkIGZvciB2ZmIg YWNjZXNzDQpbMjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoaW1hZ2U6ODkxKSBhcmdz OiBib290LCB2YWw6IGRjDQpbMjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoaW1hZ2U6 ODkxKSBhcmdzOiBmZGEsIHZhbDogTm9uZQ0KWzIwMTMtMTItMTkgMTA6MTE6NDUgMjAyN10gREVC VUcgKGltYWdlOjg5MSkgYXJnczogZmRiLCB2YWw6IE5vbmUNClsyMDEzLTEyLTE5IDEwOjExOjQ1 IDIwMjddIERFQlVHIChpbWFnZTo4OTEpIGFyZ3M6IHNvdW5kaHcsIHZhbDogTm9uZQ0KWzIwMTMt MTItMTkgMTA6MTE6NDUgMjAyN10gREVCVUcgKGltYWdlOjg5MSkgYXJnczogbG9jYWx0aW1lLCB2 YWw6IDANClsyMDEzLTEyLTE5IDEwOjExOjQ1IDIwMjddIERFQlVHIChpbWFnZTo4OTEpIGFyZ3M6 IHNlcmlhbCwgdmFsOiBbJ3B0eSddDQpbMjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAo aW1hZ2U6ODkxKSBhcmdzOiBzdGQtdmdhLCB2YWw6IDANClsyMDEzLTEyLTE5IDEwOjExOjQ1IDIw MjddIERFQlVHIChpbWFnZTo4OTEpIGFyZ3M6IGlzYSwgdmFsOiAwDQpbMjAxMy0xMi0xOSAxMDox MTo0NSAyMDI3XSBERUJVRyAoaW1hZ2U6ODkxKSBhcmdzOiBhY3BpLCB2YWw6IDENClsyMDEzLTEy LTE5IDEwOjExOjQ1IDIwMjddIERFQlVHIChpbWFnZTo4OTEpIGFyZ3M6IHVzYiwgdmFsOiAwDQpb MjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoaW1hZ2U6ODkxKSBhcmdzOiB1c2JkZXZp Y2UsIHZhbDogdGFibGV0DQpbMjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoaW1hZ2U6 ODkxKSBhcmdzOiBnZnhfcGFzc3RocnUsIHZhbDogTm9uZQ0KWzIwMTMtMTItMTkgMTA6MTE6NDUg MjAyN10gSU5GTyAoaW1hZ2U6ODIyKSBOZWVkIHRvIGNyZWF0ZSBwbGF0Zm9ybSBkZXZpY2UuW2Rv bWlkOjRdDQpbMjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoWGVuZENoZWNrcG9pbnQ6 Mjc4KSByZXN0b3JlOnNoYWRvdz0weGMsIF9zdGF0aWNfbWF4PTB4NDAwMDAwMDAsIF9zdGF0aWNf bWluPTB4MCwgDQpbMjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoWGVuZENoZWNrcG9p bnQ6MzA1KSBbeGNfcmVzdG9yZV06IC91c3IvbGliL3hlbi9iaW4veGNfcmVzdG9yZSA0IDQgNiA3 IDEgMSAxIDANClsyMDEzLTEyLTE5IDEwOjEyOjEwIDIwMjddIElORk8gKFhlbmRDaGVja3BvaW50 OjQyMykgeGM6IGVycm9yOiBGYWlsZWQgdG8gYWxsb2NhdGUgbWVtb3J5IGZvciBiYXRjaC4hOiBJ bnRlcm5hbCBlcnJvcg0KWzIwMTMtMTItMTkgMTA6MTI6MTEgMjAyN10gREVCVUcgKFhlbmREb21h aW5JbmZvOjMwNzcpIFhlbmREb21haW5JbmZvLmRlc3Ryb3k6IGRvbWlkPTQNClsyMDEzLTEyLTE5 IDEwOjEyOjExIDIwMjddIEVSUk9SIChYZW5kRG9tYWluSW5mbzozMDkxKSBYZW5kRG9tYWluSW5m by5kZXN0cm95OiBkb21haW4gZGVzdHJ1Y3Rpb24gZmFpbGVkLg0KVHJhY2ViYWNrIChtb3N0IHJl Y2VudCBjYWxsIGxhc3QpOg0KICBGaWxlICIvdXNyL2xvY2FsL2xpYi9weXRob24yLjYvZGlzdC1w YWNrYWdlcy94ZW4veGVuZC9YZW5kRG9tYWluSW5mby5weSIsIGxpbmUgMzA4NCwgaW4gZGVzdHJv eQ0KICAgIHhjLmRvbWFpbl9wYXVzZShzZWxmLmRvbWlkKQ0KRXJyb3I6ICgzLCAnTm8gc3VjaCBw cm9jZXNzJykNClsyMDEzLTEyLTE5IDEwOjEyOjExIDIwMjddIERFQlVHIChYZW5kRG9tYWluSW5m bzoyNDA3KSBObyBkZXZpY2UgbW9kZWwNClsyMDEzLTEyLTE5IDEwOjEyOjExIDIwMjddIERFQlVH IChYZW5kRG9tYWluSW5mbzoyNDA5KSBSZWxlYXNpbmcgZGV2aWNlcw0KWzIwMTMtMTItMTkgMTA6 MTI6MTEgMjAyN10gREVCVUcgKFhlbmREb21haW5JbmZvOjI0MTUpIFJlbW92aW5nIGNvbnNvbGUv MA0KWzIwMTMtMTItMTkgMTA6MTI6MTEgMjAyN10gREVCVUcgKFhlbmREb21haW5JbmZvOjEyNzYp IFhlbmREb21haW5JbmZvLmRlc3Ryb3lEZXZpY2U6IGRldmljZUNsYXNzID0gY29uc29sZSwgZGV2 aWNlID0gY29uc29sZS8wDQpbMjAxMy0xMi0xOSAxMDoxMjoxMSAyMDI3XSBERUJVRyAoWGVuZERv bWFpbkluZm86MjQxNSkgUmVtb3ZpbmcgdmZiLzANClsyMDEzLTEyLTE5IDEwOjEyOjExIDIwMjdd IERFQlVHIChYZW5kRG9tYWluSW5mbzoxMjc2KSBYZW5kRG9tYWluSW5mby5kZXN0cm95RGV2aWNl OiBkZXZpY2VDbGFzcyA9IHZmYiwgZGV2aWNlID0gdmZiLzANClsyMDEzLTEyLTE5IDEwOjEyOjEx IDIwMjddIElORk8gKFhlbmREb21haW46MTEyNikgRG9tYWluIHdpbjA4IChjOGJmODBjOC1kNjNj LTRhYmUtYTUyMy0yNmZiMjQzOWY4MTYpIGRlbGV0ZWQuDQpbMjAxMy0xMi0xOSAxMDoxMjoxMSAy MDI3XSBFUlJPUiAoWGVuZENoZWNrcG9pbnQ6MzU3KSAvdXNyL2xpYi94ZW4vYmluL3hjX3Jlc3Rv cmUgNCA0IDYgNyAxIDEgMSAwIGZhaWxlZA0KVHJhY2ViYWNrIChtb3N0IHJlY2VudCBjYWxsIGxh c3QpOg0KICBGaWxlICIvdXNyL2xvY2FsL2xpYi9weXRob24yLjYvZGlzdC1wYWNrYWdlcy94ZW4v eGVuZC9YZW5kQ2hlY2twb2ludC5weSIsIGxpbmUgMzA5LCBpbiByZXN0b3JlDQogICAgZm9ya0hl bHBlcihjbWQsIGZkLCBoYW5kbGVyLmhhbmRsZXIsIFRydWUpDQogIEZpbGUgIi91c3IvbG9jYWwv bGliL3B5dGhvbjIuNi9kaXN0LXBhY2thZ2VzL3hlbi94ZW5kL1hlbmRDaGVja3BvaW50LnB5Iiwg bGluZSA0MTEsIGluIGZvcmtIZWxwZXINCiAgICByYWlzZSBYZW5kRXJyb3IoIiVzIGZhaWxlZCIg JSBzdHJpbmcuam9pbihjbWQpKQ0KWGVuZEVycm9yOiAvdXNyL2xpYi94ZW4vYmluL3hjX3Jlc3Rv cmUgNCA0IDYgNyAxIDEgMSAwIGZhaWxlZA0KWzIwMTMtMTItMTkgMTA6MTI6MTEgMjAyN10gRVJS T1IgKFhlbmREb21haW46MTE5NCkgUmVzdG9yZSBmYWlsZWQNClRyYWNlYmFjayAobW9zdCByZWNl bnQgY2FsbCBsYXN0KToNCiAgRmlsZSAiL3Vzci9sb2NhbC9saWIvcHl0aG9uMi42L2Rpc3QtcGFj a2FnZXMveGVuL3hlbmQvWGVuZERvbWFpbi5weSIsIGxpbmUgMTE3OCwgaW4gZG9tYWluX3Jlc3Rv cmVfZmQNCiAgICBkb21pbmZvID0gWGVuZENoZWNrcG9pbnQucmVzdG9yZShzZWxmLCBmZCwgcGF1 c2VkPXBhdXNlZCwgcmVsb2NhdGluZz1yZWxvY2F0aW5nKQ0KICBGaWxlICIvdXNyL2xvY2FsL2xp Yi9weXRob24yLjYvZGlzdC1wYWNrYWdlcy94ZW4veGVuZC9YZW5kQ2hlY2twb2ludC5weSIsIGxp bmUgMzU4LCBpbiByZXN0b3JlDQogICAgcmFpc2UgZXhuDQpYZW5kRXJyb3I6IC91c3IvbGliL3hl bi9iaW4veGNfcmVzdG9yZSA0IDQgNiA3IDEgMSAxIDAgZmFpbGVkDQogDQogIA== ------=_001_NextPart482123223363_=---- Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable =EF=BB=BF
Hi all,
 
        These days I am testing xe= n live=20 migration with xen.
The result is that:
       PVM migration works well all the= =20 time.
       However, HVM windows vm migratio= n=20 always failed.  I'm using xen 4.1 and 4.2 with NFS as shared storage,= and=20 both failed with HVM migration.
We are mainly using xend toolstack.  After searching for the err= or=20 messages, I found lots of people had this problem, and it related to hvm r= estore=20 function bug.
Could anyone help us? Thank you very much!
Error messages are:
[2013-12-19 10:11:45 202= 7] INFO=20 (XendCheckpoint:260) restore hvm domain 4, apic=3D1, pae=3D1
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:337) Stored a VNC password for vfb access
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: boot, val: dc
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: fda, val: None
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: fdb, val: None
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: soundhw, val: None
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: localtime, val: 0
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: serial, val: ['pty']
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: std-vga, val: 0
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: isa, val: 0
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: acpi, val: 1
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: usb, val: 0
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: usbdevice, val: tablet
[2013-12-19 10:11:45 202= 7] DEBUG=20 (image:891) args: gfx_passthru, val: None
[2013-12-19 10:11:45 202= 7] INFO=20 (image:822) Need to create platform device.[domid:4]
[2013-12-19 10:11:45 202= 7] DEBUG=20 (XendCheckpoint:278) restore:shadow=3D0xc, _static_max=3D0x40000000,=20 _static_min=3D0x0,
[2013-12-19 10:11:45 202= 7] DEBUG=20 (XendCheckpoint:305) [xc_restore]: /usr/lib/xen/bin/xc_restore 4 4 6 7= 1 1 1=20 0
[2013-12-19 10:12:10 202= 7] INFO=20 (XendCheckpoint:423) xc: error: Failed to allocate memory for batch.!:= =20 Internal error
[2013-12-19 10:12:11 202= 7] DEBUG=20 (XendDomainInfo:3077) XendDomainInfo.destroy: domid=3D4
[2013-12-19 10:12:11 202= 7] ERROR=20 (XendDomainInfo:3091) XendDomainInfo.destroy: domain destruction=20 failed.
Traceback (most recent c= all=20 last):
  File=20 "/usr/local/lib/python2.6/dist-packages/xen/xend/XendDomainInfo.py", l= ine=20 3084, in destroy
   =20 xc.domain_pause(self.domid)
Error: (3, 'No such=20 process')
[2013-12-19 10:12:11 202= 7] DEBUG=20 (XendDomainInfo:2407) No device model
[2013-12-19 10:12:11 202= 7] DEBUG=20 (XendDomainInfo:2409) Releasing devices
[2013-12-19 10:12:11 202= 7] DEBUG=20 (XendDomainInfo:2415) Removing console/0
[2013-12-19 10:12:11 202= 7] DEBUG=20 (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass =3D co= nsole,=20 device =3D console/0
[2013-12-19 10:12:11 202= 7] DEBUG=20 (XendDomainInfo:2415) Removing vfb/0
[2013-12-19 10:12:11 202= 7] DEBUG=20 (XendDomainInfo:1276) XendDomainInfo.destroyDevice: deviceClass =3D vf= b,=20 device =3D vfb/0
[2013-12-19 10:12:11 202= 7] INFO=20 (XendDomain:1126) Domain win08 (c8bf80c8-d63c-4abe-a523-26fb2439f816)=20 deleted.
[2013-12-19 10:12:11 202= 7] ERROR=20 (XendCheckpoint:357) /usr/lib/xen/bin/xc_restore 4 4 6 7 1 1 1 0=20 failed
Traceback (most recent c= all=20 last):
  File=20 "/usr/local/lib/python2.6/dist-packages/xen/xend/XendCheckpoint.py", l= ine=20 309, in restore
   =20 forkHelper(cmd, fd, handler.handler, True)
  File=20 "/usr/local/lib/python2.6/dist-packages/xen/xend/XendCheckpoint.py", l= ine=20 411, in forkHelper
    raise= =20 XendError("%s failed" % string.join(cmd))
XendError:=20 /usr/lib/xen/bin/xc_restore 4 4 6 7 1 1 1 0 failed
[2013-12-19 10:12:11 202= 7] ERROR=20 (XendDomain:1194) Restore failed
Traceback (most recent c= all=20 last):
  File=20 "/usr/local/lib/python2.6/dist-packages/xen/xend/XendDomain.py", line = 1178,=20 in domain_restore_fd
    domin= fo =3D=20 XendCheckpoint.restore(self, fd, paused=3Dpaused, relocating=3Drelocat= ing)
  File=20 "/usr/local/lib/python2.6/dist-packages/xen/xend/XendCheckpoint.py", l= ine=20 358, in restore
    raise= =20 exn
XendError:=20 /usr/lib/xen/bin/xc_restore 4 4 6 7 1 1 1 0=20 failed
 
 
------=_001_NextPart482123223363_=------ --===============6229027794299851928== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6229027794299851928==-- From xen-users-bounces@lists.xen.org Thu Dec 19 12:14:31 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 19 Dec 2013 12:14:31 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtcTw-0005DT-CT; Thu, 19 Dec 2013 12:13:36 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtcTu-0005DI-HI for xen-users@lists.xen.org; Thu, 19 Dec 2013 12:13:34 +0000 Received: from [85.158.139.211:12571] by server-10.bemta-5.messagelabs.com id 0F/8D-01405-DE2E2B25; Thu, 19 Dec 2013 12:13:33 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-12.tower-206.messagelabs.com!1387455211!5597814!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 17560 invoked from network); 19 Dec 2013 12:13:33 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-12.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 19 Dec 2013 12:13:33 -0000 X-IronPort-AV: E=Sophos;i="4.95,512,1384300800"; d="scan'208";a="86115703" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 19 Dec 2013 12:13:22 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Thu, 19 Dec 2013 07:13:21 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VtcN3-0000aV-Ry; Thu, 19 Dec 2013 12:06:29 +0000 Date: Thu, 19 Dec 2013 12:06:29 +0000 From: Wei Liu To: "kevin.zhang@octlink.com" Message-ID: <20131219120629.GJ25969@zion.uk.xensource.com> References: <2013121910200013972216@octlink.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <2013121910200013972216@octlink.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: xen-users , wei.liu2@citrix.com Subject: Re: [Xen-users] HVM migrate failed on both xen 4.1 and xen 4.2 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Thu, Dec 19, 2013 at 10:20:01AM +0800, kevin.zhang@octlink.com wrote: > Hi all, > > These days I am testing xen live migration with xen. > The result is that: > PVM migration works well all the time. > However, HVM windows vm migration always failed. I'm using xen 4.1 and 4.2 with NFS as shared storage, and both failed with HVM migration. > We are mainly using xend toolstack. After searching for the error messages, I found lots of people had this problem, and it related to hvm restore function bug. > Could anyone help us? Thank you very much! > Error messages are: > [2013-12-19 10:11:45 2027] INFO (XendCheckpoint:260) restore hvm domain 4, apic=1, pae=1 > [2013-12-19 10:11:45 2027] DEBUG (image:337) Stored a VNC password for vfb access > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: boot, val: dc > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: fda, val: None > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: fdb, val: None > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: soundhw, val: None > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: localtime, val: 0 > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: serial, val: ['pty'] > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: std-vga, val: 0 > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: isa, val: 0 > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: acpi, val: 1 > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: usb, val: 0 > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: usbdevice, val: tablet > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: gfx_passthru, val: None > [2013-12-19 10:11:45 2027] INFO (image:822) Need to create platform device.[domid:4] > [2013-12-19 10:11:45 2027] DEBUG (XendCheckpoint:278) restore:shadow=0xc, _static_max=0x40000000, _static_min=0x0, > [2013-12-19 10:11:45 2027] DEBUG (XendCheckpoint:305) [xc_restore]: /usr/lib/xen/bin/xc_restore 4 4 6 7 1 1 1 0 > [2013-12-19 10:12:10 2027] INFO (XendCheckpoint:423) xc: error: Failed to allocate memory for batch.!: Internal error Looks like this is the culprit? I looked at the code in question in libxc just now. If it *always* fails, my very wild guess would be the memory size calculation is broken when restoring HVM domain so that hypervisor fails to allocate memory for it. It would be worth knowing whether this is a libxc bug or Xend bug. Could you try xl? If xl works then it's a Xend bug, otherwise this is probably a bug in libxc. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 19 12:14:31 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 19 Dec 2013 12:14:31 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtcTw-0005DT-CT; Thu, 19 Dec 2013 12:13:36 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtcTu-0005DI-HI for xen-users@lists.xen.org; Thu, 19 Dec 2013 12:13:34 +0000 Received: from [85.158.139.211:12571] by server-10.bemta-5.messagelabs.com id 0F/8D-01405-DE2E2B25; Thu, 19 Dec 2013 12:13:33 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-12.tower-206.messagelabs.com!1387455211!5597814!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 17560 invoked from network); 19 Dec 2013 12:13:33 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-12.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 19 Dec 2013 12:13:33 -0000 X-IronPort-AV: E=Sophos;i="4.95,512,1384300800"; d="scan'208";a="86115703" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 19 Dec 2013 12:13:22 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Thu, 19 Dec 2013 07:13:21 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VtcN3-0000aV-Ry; Thu, 19 Dec 2013 12:06:29 +0000 Date: Thu, 19 Dec 2013 12:06:29 +0000 From: Wei Liu To: "kevin.zhang@octlink.com" Message-ID: <20131219120629.GJ25969@zion.uk.xensource.com> References: <2013121910200013972216@octlink.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <2013121910200013972216@octlink.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: xen-users , wei.liu2@citrix.com Subject: Re: [Xen-users] HVM migrate failed on both xen 4.1 and xen 4.2 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Thu, Dec 19, 2013 at 10:20:01AM +0800, kevin.zhang@octlink.com wrote: > Hi all, > > These days I am testing xen live migration with xen. > The result is that: > PVM migration works well all the time. > However, HVM windows vm migration always failed. I'm using xen 4.1 and 4.2 with NFS as shared storage, and both failed with HVM migration. > We are mainly using xend toolstack. After searching for the error messages, I found lots of people had this problem, and it related to hvm restore function bug. > Could anyone help us? Thank you very much! > Error messages are: > [2013-12-19 10:11:45 2027] INFO (XendCheckpoint:260) restore hvm domain 4, apic=1, pae=1 > [2013-12-19 10:11:45 2027] DEBUG (image:337) Stored a VNC password for vfb access > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: boot, val: dc > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: fda, val: None > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: fdb, val: None > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: soundhw, val: None > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: localtime, val: 0 > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: serial, val: ['pty'] > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: std-vga, val: 0 > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: isa, val: 0 > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: acpi, val: 1 > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: usb, val: 0 > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: usbdevice, val: tablet > [2013-12-19 10:11:45 2027] DEBUG (image:891) args: gfx_passthru, val: None > [2013-12-19 10:11:45 2027] INFO (image:822) Need to create platform device.[domid:4] > [2013-12-19 10:11:45 2027] DEBUG (XendCheckpoint:278) restore:shadow=0xc, _static_max=0x40000000, _static_min=0x0, > [2013-12-19 10:11:45 2027] DEBUG (XendCheckpoint:305) [xc_restore]: /usr/lib/xen/bin/xc_restore 4 4 6 7 1 1 1 0 > [2013-12-19 10:12:10 2027] INFO (XendCheckpoint:423) xc: error: Failed to allocate memory for batch.!: Internal error Looks like this is the culprit? I looked at the code in question in libxc just now. If it *always* fails, my very wild guess would be the memory size calculation is broken when restoring HVM domain so that hypervisor fails to allocate memory for it. It would be worth knowing whether this is a libxc bug or Xend bug. Could you try xl? If xl works then it's a Xend bug, otherwise this is probably a bug in libxc. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 20 01:05:43 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 20 Dec 2013 01:05:43 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtoVn-00083E-4H; Fri, 20 Dec 2013 01:04:19 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtoVl-000839-QC for xen-users@lists.xen.org; Fri, 20 Dec 2013 01:04:17 +0000 Received: from [85.158.139.211:21696] by server-9.bemta-5.messagelabs.com id 4A/92-15098-09793B25; Fri, 20 Dec 2013 01:04:16 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-7.tower-206.messagelabs.com!1387501444!3057883!1 X-Originating-IP: [203.16.207.99] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 16552 invoked from network); 20 Dec 2013 01:04:15 -0000 Received: from mail.bendigoit.com.au (HELO smtp2.bendigoit.com.au) (203.16.207.99) by server-7.tower-206.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 20 Dec 2013 01:04:15 -0000 Received: from bitcom1.int.sbss.com.au ([192.168.200.237]) by smtp2.bendigoit.com.au with esmtp (Exim 4.80) (envelope-from ) id 1VtoVQ-0004Jr-Il for xen-users@lists.xen.org; Fri, 20 Dec 2013 12:03:56 +1100 Received: from BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d]) by BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d%12]) with mapi id 14.03.0174.001; Fri, 20 Dec 2013 12:03:52 +1100 From: James Harper To: "xen-users@lists.xen.org" Thread-Topic: qdisk and debian Thread-Index: Ac79HzNI2OfP7KyvQ8OhxHPB+CkVGQ== Date: Fri, 20 Dec 2013 01:03:49 +0000 Message-ID: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> Accept-Language: en-AU, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.200.54] x-tm-as-product-ver: SMEX-11.0.0.1191-7.000.1014-20372.003 x-tm-as-result: No--36.245300-0.000000-31 x-tm-as-user-approved-sender: Yes x-tm-as-user-blocked-sender: No MIME-Version: 1.0 X-Really-From-Bendigo-IT: magichashvalue Subject: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org In what version of xen and qemu did qdisk get introduced? Debian "Jessie" packages xen 4.3.0 and qemu 1.7.0, but seems to lack any support for qdisk as a block backend. Thanks James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 20 01:05:43 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 20 Dec 2013 01:05:43 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtoVn-00083E-4H; Fri, 20 Dec 2013 01:04:19 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtoVl-000839-QC for xen-users@lists.xen.org; Fri, 20 Dec 2013 01:04:17 +0000 Received: from [85.158.139.211:21696] by server-9.bemta-5.messagelabs.com id 4A/92-15098-09793B25; Fri, 20 Dec 2013 01:04:16 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-7.tower-206.messagelabs.com!1387501444!3057883!1 X-Originating-IP: [203.16.207.99] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 16552 invoked from network); 20 Dec 2013 01:04:15 -0000 Received: from mail.bendigoit.com.au (HELO smtp2.bendigoit.com.au) (203.16.207.99) by server-7.tower-206.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 20 Dec 2013 01:04:15 -0000 Received: from bitcom1.int.sbss.com.au ([192.168.200.237]) by smtp2.bendigoit.com.au with esmtp (Exim 4.80) (envelope-from ) id 1VtoVQ-0004Jr-Il for xen-users@lists.xen.org; Fri, 20 Dec 2013 12:03:56 +1100 Received: from BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d]) by BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d%12]) with mapi id 14.03.0174.001; Fri, 20 Dec 2013 12:03:52 +1100 From: James Harper To: "xen-users@lists.xen.org" Thread-Topic: qdisk and debian Thread-Index: Ac79HzNI2OfP7KyvQ8OhxHPB+CkVGQ== Date: Fri, 20 Dec 2013 01:03:49 +0000 Message-ID: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> Accept-Language: en-AU, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [192.168.200.54] x-tm-as-product-ver: SMEX-11.0.0.1191-7.000.1014-20372.003 x-tm-as-result: No--36.245300-0.000000-31 x-tm-as-user-approved-sender: Yes x-tm-as-user-blocked-sender: No MIME-Version: 1.0 X-Really-From-Bendigo-IT: magichashvalue Subject: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org In what version of xen and qemu did qdisk get introduced? Debian "Jessie" packages xen 4.3.0 and qemu 1.7.0, but seems to lack any support for qdisk as a block backend. Thanks James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 20 08:56:45 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 20 Dec 2013 08:56:45 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vtvs0-00069g-K2; Fri, 20 Dec 2013 08:55:44 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vtvrz-00069P-1S for xen-users@lists.xensource.com; Fri, 20 Dec 2013 08:55:43 +0000 Received: from [85.158.137.68:40811] by server-9.bemta-3.messagelabs.com id 76/8D-13104-E0604B25; Fri, 20 Dec 2013 08:55:42 +0000 X-Env-Sender: fantonifabio@tiscali.it X-Msg-Ref: server-7.tower-31.messagelabs.com!1387529740!5243876!1 X-Originating-IP: [216.139.236.26] X-SpamReason: No, hits=0.0 required=7.0 tests=ML_RADAR_SPEW_LINKS_14, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 16688 invoked from network); 20 Dec 2013 08:55:41 -0000 Received: from sam.nabble.com (HELO sam.nabble.com) (216.139.236.26) by server-7.tower-31.messagelabs.com with AES256-SHA encrypted SMTP; 20 Dec 2013 08:55:41 -0000 Received: from [192.168.236.26] (helo=sam.nabble.com) by sam.nabble.com with esmtp (Exim 4.72) (envelope-from ) id 1Vtvrv-0001kM-Lz for xen-users@lists.xensource.com; Fri, 20 Dec 2013 00:55:39 -0800 Date: Fri, 20 Dec 2013 00:55:39 -0800 (PST) From: Fantu To: xen-users@lists.xensource.com Message-ID: <1387529739347-5720484.post@n5.nabble.com> In-Reply-To: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> References: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> MIME-Version: 1.0 Subject: Re: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org I started to use qdisk with xen from qemu 1.3 and I already used it also with qemu 1.7 without found problem. I had also tested qemu debian package with xen compiled from source since qemu 1.4, I not tested the latest from debian package but should be working, qemu debian package have also some features missed on upstream qemu compiled from xen (for example spice and usbredirection). Probably your problem can be related to bad hvm domUs support on xen debian package: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=731038 If your problem is another please post details and I'll try to help you. -- View this message in context: http://xen.1045712.n5.nabble.com/qdisk-and-debian-tp5720483p5720484.html Sent from the Xen - User mailing list archive at Nabble.com. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 20 08:56:45 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 20 Dec 2013 08:56:45 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vtvs0-00069g-K2; Fri, 20 Dec 2013 08:55:44 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vtvrz-00069P-1S for xen-users@lists.xensource.com; Fri, 20 Dec 2013 08:55:43 +0000 Received: from [85.158.137.68:40811] by server-9.bemta-3.messagelabs.com id 76/8D-13104-E0604B25; Fri, 20 Dec 2013 08:55:42 +0000 X-Env-Sender: fantonifabio@tiscali.it X-Msg-Ref: server-7.tower-31.messagelabs.com!1387529740!5243876!1 X-Originating-IP: [216.139.236.26] X-SpamReason: No, hits=0.0 required=7.0 tests=ML_RADAR_SPEW_LINKS_14, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 16688 invoked from network); 20 Dec 2013 08:55:41 -0000 Received: from sam.nabble.com (HELO sam.nabble.com) (216.139.236.26) by server-7.tower-31.messagelabs.com with AES256-SHA encrypted SMTP; 20 Dec 2013 08:55:41 -0000 Received: from [192.168.236.26] (helo=sam.nabble.com) by sam.nabble.com with esmtp (Exim 4.72) (envelope-from ) id 1Vtvrv-0001kM-Lz for xen-users@lists.xensource.com; Fri, 20 Dec 2013 00:55:39 -0800 Date: Fri, 20 Dec 2013 00:55:39 -0800 (PST) From: Fantu To: xen-users@lists.xensource.com Message-ID: <1387529739347-5720484.post@n5.nabble.com> In-Reply-To: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> References: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> MIME-Version: 1.0 Subject: Re: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org I started to use qdisk with xen from qemu 1.3 and I already used it also with qemu 1.7 without found problem. I had also tested qemu debian package with xen compiled from source since qemu 1.4, I not tested the latest from debian package but should be working, qemu debian package have also some features missed on upstream qemu compiled from xen (for example spice and usbredirection). Probably your problem can be related to bad hvm domUs support on xen debian package: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=731038 If your problem is another please post details and I'll try to help you. -- View this message in context: http://xen.1045712.n5.nabble.com/qdisk-and-debian-tp5720483p5720484.html Sent from the Xen - User mailing list archive at Nabble.com. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 20 10:27:04 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 20 Dec 2013 10:27:04 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtxHP-00060b-Gb; Fri, 20 Dec 2013 10:26:03 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtxHO-00060W-Fw for xen-users@lists.xensource.com; Fri, 20 Dec 2013 10:26:02 +0000 Received: from [85.158.137.68:19289] by server-3.bemta-3.messagelabs.com id 6C/90-10658-93B14B25; Fri, 20 Dec 2013 10:26:01 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-2.tower-31.messagelabs.com!1387535156!5218739!1 X-Originating-IP: [203.16.207.99] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 4790 invoked from network); 20 Dec 2013 10:25:59 -0000 Received: from mail.bendigoit.com.au (HELO smtp2.bendigoit.com.au) (203.16.207.99) by server-2.tower-31.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 20 Dec 2013 10:25:59 -0000 Received: from bitcom1.int.sbss.com.au ([192.168.200.237]) by smtp2.bendigoit.com.au with esmtp (Exim 4.80) (envelope-from ) id 1VtxHE-00087N-6c; Fri, 20 Dec 2013 21:25:52 +1100 Received: from BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d]) by BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d%12]) with mapi id 14.03.0174.001; Fri, 20 Dec 2013 21:25:51 +1100 From: James Harper To: Fantu , "xen-users@lists.xensource.com" Thread-Topic: [Xen-users] qdisk and debian Thread-Index: Ac79HzNI2OfP7KyvQ8OhxHPB+CkVGf//y7WA//8w9fA= Date: Fri, 20 Dec 2013 10:25:49 +0000 Message-ID: <6035A0D088A63A46850C3988ED045A4B66CD8E75@BITCOM1.int.sbss.com.au> References: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> <1387529739347-5720484.post@n5.nabble.com> In-Reply-To: <1387529739347-5720484.post@n5.nabble.com> Accept-Language: en-AU, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.16.3.239] x-tm-as-product-ver: SMEX-11.0.0.1191-7.000.1014-20372.006 x-tm-as-result: No--40.547300-0.000000-31 x-tm-as-user-approved-sender: Yes x-tm-as-user-blocked-sender: No MIME-Version: 1.0 X-Really-From-Bendigo-IT: magichashvalue Subject: Re: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > > I started to use qdisk with xen from qemu 1.3 and I already used it also with > qemu 1.7 without found problem. > I had also tested qemu debian package with xen compiled from source since > qemu 1.4, I not tested the latest from debian package but should be working, > qemu debian package have also some features missed on upstream qemu > compiled > from xen (for example spice and usbredirection). > Probably your problem can be related to bad hvm domUs support on xen > debian > package: > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=731038 > > If your problem is another please post details and I'll try to help you. > Thanks I think I figured it out. I had to add backendtype=qdisk onto the end. The instructions at http://xenbits.xen.org/docs/4.3-testing/misc/xl-disk-configuration.txt didn't work for the pure "=" type specification, at least under debian. I had to tack 'backendtype=qdisk' to the end of a fixed position parameter style configuration. With qdisk enabled under a current Jessie install, qemu-system-i386 was sitting on a steady 12.3% cpu though, even though the domu should have been idle. As soon as I ran an strace against the process it dropped to idle%, so I don't know what was going on... maybe the domu really was just busy. Rebuilding debian qemu package with rbd support now... hopefully that works without any fuss! Thanks again! James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 20 10:27:04 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 20 Dec 2013 10:27:04 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtxHP-00060b-Gb; Fri, 20 Dec 2013 10:26:03 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtxHO-00060W-Fw for xen-users@lists.xensource.com; Fri, 20 Dec 2013 10:26:02 +0000 Received: from [85.158.137.68:19289] by server-3.bemta-3.messagelabs.com id 6C/90-10658-93B14B25; Fri, 20 Dec 2013 10:26:01 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-2.tower-31.messagelabs.com!1387535156!5218739!1 X-Originating-IP: [203.16.207.99] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 4790 invoked from network); 20 Dec 2013 10:25:59 -0000 Received: from mail.bendigoit.com.au (HELO smtp2.bendigoit.com.au) (203.16.207.99) by server-2.tower-31.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 20 Dec 2013 10:25:59 -0000 Received: from bitcom1.int.sbss.com.au ([192.168.200.237]) by smtp2.bendigoit.com.au with esmtp (Exim 4.80) (envelope-from ) id 1VtxHE-00087N-6c; Fri, 20 Dec 2013 21:25:52 +1100 Received: from BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d]) by BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d%12]) with mapi id 14.03.0174.001; Fri, 20 Dec 2013 21:25:51 +1100 From: James Harper To: Fantu , "xen-users@lists.xensource.com" Thread-Topic: [Xen-users] qdisk and debian Thread-Index: Ac79HzNI2OfP7KyvQ8OhxHPB+CkVGf//y7WA//8w9fA= Date: Fri, 20 Dec 2013 10:25:49 +0000 Message-ID: <6035A0D088A63A46850C3988ED045A4B66CD8E75@BITCOM1.int.sbss.com.au> References: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> <1387529739347-5720484.post@n5.nabble.com> In-Reply-To: <1387529739347-5720484.post@n5.nabble.com> Accept-Language: en-AU, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.16.3.239] x-tm-as-product-ver: SMEX-11.0.0.1191-7.000.1014-20372.006 x-tm-as-result: No--40.547300-0.000000-31 x-tm-as-user-approved-sender: Yes x-tm-as-user-blocked-sender: No MIME-Version: 1.0 X-Really-From-Bendigo-IT: magichashvalue Subject: Re: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > > I started to use qdisk with xen from qemu 1.3 and I already used it also with > qemu 1.7 without found problem. > I had also tested qemu debian package with xen compiled from source since > qemu 1.4, I not tested the latest from debian package but should be working, > qemu debian package have also some features missed on upstream qemu > compiled > from xen (for example spice and usbredirection). > Probably your problem can be related to bad hvm domUs support on xen > debian > package: > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=731038 > > If your problem is another please post details and I'll try to help you. > Thanks I think I figured it out. I had to add backendtype=qdisk onto the end. The instructions at http://xenbits.xen.org/docs/4.3-testing/misc/xl-disk-configuration.txt didn't work for the pure "=" type specification, at least under debian. I had to tack 'backendtype=qdisk' to the end of a fixed position parameter style configuration. With qdisk enabled under a current Jessie install, qemu-system-i386 was sitting on a steady 12.3% cpu though, even though the domu should have been idle. As soon as I ran an strace against the process it dropped to idle%, so I don't know what was going on... maybe the domu really was just busy. Rebuilding debian qemu package with rbd support now... hopefully that works without any fuss! Thanks again! James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 20 13:18:42 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 20 Dec 2013 13:18:42 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vtzxa-0006cz-NT; Fri, 20 Dec 2013 13:17:46 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtzxY-0006cU-Od for xen-users@lists.xensource.com; Fri, 20 Dec 2013 13:17:45 +0000 Received: from [85.158.137.68:5468] by server-9.bemta-3.messagelabs.com id 7F/0B-13104-77344B25; Fri, 20 Dec 2013 13:17:43 +0000 X-Env-Sender: fantonifabio@tiscali.it X-Msg-Ref: server-13.tower-31.messagelabs.com!1387545462!5310942!1 X-Originating-IP: [94.23.245.208] X-SpamReason: No, hits=0.0 required=7.0 tests=ML_RADAR_SPEW_LINKS_14, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 24085 invoked from network); 20 Dec 2013 13:17:43 -0000 Received: from lnx3.fantu.it (HELO lnx3.fantu.it) (94.23.245.208) by server-13.tower-31.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 20 Dec 2013 13:17:43 -0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by lnx3.fantu.it (Postfix) with ESMTP id 9E19740022F; Fri, 20 Dec 2013 14:17:42 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at lnx3.fantu.it Received: from lnx3.fantu.it ([127.0.0.1]) by localhost (lnx3.fantu.it [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jcwpauJ3+RqJ; Fri, 20 Dec 2013 14:17:42 +0100 (CET) Received: from [192.168.178.50] (host102-89-dynamic.0-87-r.retail.telecomitalia.it [87.0.89.102]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: prova@fantu.it) by lnx3.fantu.it (Postfix) with ESMTPSA id 1133E40010E; Fri, 20 Dec 2013 14:17:40 +0100 (CET) Message-ID: <52B44371.5040700@tiscali.it> Date: Fri, 20 Dec 2013 14:17:37 +0100 From: Fabio Fantoni User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: James Harper , "xen-users@lists.xensource.com" References: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> <1387529739347-5720484.post@n5.nabble.com> <6035A0D088A63A46850C3988ED045A4B66CD8E75@BITCOM1.int.sbss.com.au> In-Reply-To: <6035A0D088A63A46850C3988ED045A4B66CD8E75@BITCOM1.int.sbss.com.au> Subject: Re: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list Reply-To: fantonifabio@tiscali.it List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============2939700794264747520==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a cryptographically signed message in MIME format. --===============2939700794264747520== Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha1; boundary="------------ms050606060704000007020902" This is a cryptographically signed message in MIME format. --------------ms050606060704000007020902 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: quoted-printable Il 20/12/2013 11:25, James Harper ha scritto: >> I started to use qdisk with xen from qemu 1.3 and I already used it al= so with >> qemu 1.7 without found problem. >> I had also tested qemu debian package with xen compiled from source si= nce >> qemu 1.4, I not tested the latest from debian package but should be wo= rking, >> qemu debian package have also some features missed on upstream qemu >> compiled >> from xen (for example spice and usbredirection). >> Probably your problem can be related to bad hvm domUs support on xen >> debian >> package: >> http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=3D731038 >> >> If your problem is another please post details and I'll try to help yo= u. > Thanks I think I figured it out. I had to add backendtype=3Dqdisk onto = the end. The instructions at http://xenbits.xen.org/docs/4.3-testing/misc= /xl-disk-configuration.txt didn't work for the pure "=3D" typ= e specification, at least under debian. I had to tack 'backendtype=3Dqdis= k' to the end of a fixed position parameter style configuration. > > With qdisk enabled under a current Jessie install, qemu-system-i386 was= sitting on a steady 12.3% cpu though, even though the domu should have b= een idle. As soon as I ran an strace against the process it dropped to id= le%, so I don't know what was going on... maybe the domu really was just = busy. > > Rebuilding debian qemu package with rbd support now... hopefully that w= orks without any fuss! If your problem is only about rbd support there is a bug open on debian=20 about it: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=3D689239 I not tested it for now but with fast watch on bugtracker seems there=20 was a regression with build and the qemu maintainer removed the rbd=20 support, if with your tested you saw that regression is solved can be=20 useful reply about this. > > Thanks again! > > James > > > ----- > Nessun virus nel messaggio. > Controllato da AVG - www.avg.com > Versione: 2014.0.4259 / Database dei virus: 3658/6935 - Data di rilasc= io: 19/12/2013 > > > --------------ms050606060704000007020902 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: Firma crittografica S/MIME MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIINhjCC BjQwggQcoAMCAQICASAwDQYJKoZIhvcNAQEFBQAwfTELMAkGA1UEBhMCSUwxFjAUBgNVBAoT DVN0YXJ0Q29tIEx0ZC4xKzApBgNVBAsTIlNlY3VyZSBEaWdpdGFsIENlcnRpZmljYXRlIFNp Z25pbmcxKTAnBgNVBAMTIFN0YXJ0Q29tIENlcnRpZmljYXRpb24gQXV0aG9yaXR5MB4XDTA3 MTAyNDIxMDI1NVoXDTE3MTAyNDIxMDI1NVowgYwxCzAJBgNVBAYTAklMMRYwFAYDVQQKEw1T dGFydENvbSBMdGQuMSswKQYDVQQLEyJTZWN1cmUgRGlnaXRhbCBDZXJ0aWZpY2F0ZSBTaWdu aW5nMTgwNgYDVQQDEy9TdGFydENvbSBDbGFzcyAyIFByaW1hcnkgSW50ZXJtZWRpYXRlIENs aWVudCBDQTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAMsohUWcASz7GfKrpTOM KqANy9BV7V0igWdGxA8IU77L3aTxErQ+fcxtDYZ36Z6GH0YFn7fq5RADteP0AYzrCA+EQTfi 8q1+kA3m0nwtwXG94M5sIqsvs7lRP1aycBke/s5g9hJHryZ2acScnzczjBCAo7X1v5G3yw8M DP2m2RCye0KfgZ4nODerZJVzhAlOD9YejvAXZqHksw56HzElVIoYSZ3q4+RJuPXXfIoyby+Y 2m1E+YzX5iCZXBx05gk6MKAW1vaw4/v2OOLy6FZH3XHHtOkzUreG//CsFnB9+uaYSlR65cdG zTsmoIK8WH1ygoXhRBm98SD7Hf/r3FELNvUCAwEAAaOCAa0wggGpMA8GA1UdEwEB/wQFMAMB Af8wDgYDVR0PAQH/BAQDAgEGMB0GA1UdDgQWBBSuVYNv7DHKufcd+q9rMfPIHeOsuzAfBgNV HSMEGDAWgBROC+8apEBbpRdphzDKNGhD0EGu8jBmBggrBgEFBQcBAQRaMFgwJwYIKwYBBQUH MAGGG2h0dHA6Ly9vY3NwLnN0YXJ0c3NsLmNvbS9jYTAtBggrBgEFBQcwAoYhaHR0cDovL3d3 dy5zdGFydHNzbC5jb20vc2ZzY2EuY3J0MFsGA1UdHwRUMFIwJ6AloCOGIWh0dHA6Ly93d3cu c3RhcnRzc2wuY29tL3Nmc2NhLmNybDAnoCWgI4YhaHR0cDovL2NybC5zdGFydHNzbC5jb20v c2ZzY2EuY3JsMIGABgNVHSAEeTB3MHUGCysGAQQBgbU3AQIBMGYwLgYIKwYBBQUHAgEWImh0 dHA6Ly93d3cuc3RhcnRzc2wuY29tL3BvbGljeS5wZGYwNAYIKwYBBQUHAgEWKGh0dHA6Ly93 d3cuc3RhcnRzc2wuY29tL2ludGVybWVkaWF0ZS5wZGYwDQYJKoZIhvcNAQEFBQADggIBADqp Jw3I07QWke9plNBpxUxcffc7nUrIQpJHDci91DFG7fVhHRkMZ1J+BKg5UNUxIFJ2Z9B90Mic c/NXcs7kPBRdn6XGO/vPc87Y6R+cWS9Nc9+fp3Enmsm94OxOwI9wn8qnr/6o3mD4noP9Jphw UPTXwHovjavRnhUQHLfo/i2NG0XXgTHXS2Xm0kVUozXqpYpAdumMiB/vezj1QHQJDmUdPYMc p+reg9901zkyT3fDW/ivJVv6pWtkh6Pw2ytZT7mvg7YhX3V50Nv860cV11mocUVcqBLv0gcT +HBDYtbuvexNftwNQKD5193A7zN4vG7CTYkXxytSjKuXrpEatEiFPxWgb84nVj25SU5q/r1X hwby6mLhkbaXslkVtwEWT3Van49rKjlK4XrUKYYWtnfzq6aSak5u0Vpxd1rY79tWhD3EdCvO hNz/QplNa+VkIsrcp7+8ZhP1l1b2U6MaxIVteuVMD3X0vziIwr7jxYae9FZjbxlpUemqXjcC 0QaFfN7qI0JsQMALL7iGRBg7K0CoOBzECdD3fuZil5kU/LP9cr1BK31U0Uy651bFnAMMMkqh AChIbn0ei72VnbpSsrrSdF0BAGYQ8vyHae5aCg+H75dVCV33K6FuxZrf09yTz+Vx/PkdRUYk XmZz/OTfyJXsUOUXrym6KvI2rYpccSk5MIIHSjCCBjKgAwIBAgICHmMwDQYJKoZIhvcNAQEF BQAwgYwxCzAJBgNVBAYTAklMMRYwFAYDVQQKEw1TdGFydENvbSBMdGQuMSswKQYDVQQLEyJT ZWN1cmUgRGlnaXRhbCBDZXJ0aWZpY2F0ZSBTaWduaW5nMTgwNgYDVQQDEy9TdGFydENvbSBD bGFzcyAyIFByaW1hcnkgSW50ZXJtZWRpYXRlIENsaWVudCBDQTAeFw0xMjAzMTgyMjE0MzBa Fw0xNDAzMjAwODU3MDlaMIGMMRkwFwYDVQQNExBlQjZPRTM3UlJOUHlsNW0yMQswCQYDVQQG EwJJVDEQMA4GA1UECBMHQmVyZ2FtbzEQMA4GA1UEBxMHUm92ZXR0YTEWMBQGA1UEAxMNRmFi aW8gRmFudG9uaTEmMCQGCSqGSIb3DQEJARYXZmFudG9uaWZhYmlvQHRpc2NhbGkuaXQwggEi MA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC1XhckXsX23vgJq76s2f0KT8U8Msov5QgV 10eQBb2wL/TzcmqtZotI7ztKVhio3ehHg+mfu+3EqOkX9Umgut8rP0bPi7AGjkPXbOTT/cSU Xz2Kw31VGOmiOVoUFGvpQitp3weCkhUJLBipI8EpNyBXpjtQ9yCpnIAqfuc77ybfSnCy7tTR MBq1BUkfjH1+GL45riosuS4+F+MSUvlYzLiT4rAduAX1Y2IuORDsf9Bce8GBxa6syP9rCyzl Vk7DIX5k8j2vlnyRATIypn5CQLQxGT6e0f6ac4gvWOHwO2QEBsmZKKs1ZidE4q/9OoNXYX6A jnHtp1H1vcrek/vVcs19AgMBAAGjggOyMIIDrjAJBgNVHRMEAjAAMAsGA1UdDwQEAwIEsDAd BgNVHSUEFjAUBggrBgEFBQcDAgYIKwYBBQUHAwQwHQYDVR0OBBYEFFan8cbEWWBmSTWFtLk2 YNdAcGUbMB8GA1UdIwQYMBaAFK5Vg2/sMcq59x36r2sx88gd46y7MCIGA1UdEQQbMBmBF2Zh bnRvbmlmYWJpb0B0aXNjYWxpLml0MIICIQYDVR0gBIICGDCCAhQwggIQBgsrBgEEAYG1NwEC AjCCAf8wLgYIKwYBBQUHAgEWImh0dHA6Ly93d3cuc3RhcnRzc2wuY29tL3BvbGljeS5wZGYw NAYIKwYBBQUHAgEWKGh0dHA6Ly93d3cuc3RhcnRzc2wuY29tL2ludGVybWVkaWF0ZS5wZGYw gfcGCCsGAQUFBwICMIHqMCcWIFN0YXJ0Q29tIENlcnRpZmljYXRpb24gQXV0aG9yaXR5MAMC AQEagb5UaGlzIGNlcnRpZmljYXRlIHdhcyBpc3N1ZWQgYWNjb3JkaW5nIHRvIHRoZSBDbGFz cyAyIFZhbGlkYXRpb24gcmVxdWlyZW1lbnRzIG9mIHRoZSBTdGFydENvbSBDQSBwb2xpY3ks IHJlbGlhbmNlIG9ubHkgZm9yIHRoZSBpbnRlbmRlZCBwdXJwb3NlIGluIGNvbXBsaWFuY2Ug b2YgdGhlIHJlbHlpbmcgcGFydHkgb2JsaWdhdGlvbnMuMIGcBggrBgEFBQcCAjCBjzAnFiBT dGFydENvbSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTADAgECGmRMaWFiaWxpdHkgYW5kIHdh cnJhbnRpZXMgYXJlIGxpbWl0ZWQhIFNlZSBzZWN0aW9uICJMZWdhbCBhbmQgTGltaXRhdGlv bnMiIG9mIHRoZSBTdGFydENvbSBDQSBwb2xpY3kuMDYGA1UdHwQvMC0wK6ApoCeGJWh0dHA6 Ly9jcmwuc3RhcnRzc2wuY29tL2NydHUyLWNybC5jcmwwgY4GCCsGAQUFBwEBBIGBMH8wOQYI KwYBBQUHMAGGLWh0dHA6Ly9vY3NwLnN0YXJ0c3NsLmNvbS9zdWIvY2xhc3MyL2NsaWVudC9j YTBCBggrBgEFBQcwAoY2aHR0cDovL2FpYS5zdGFydHNzbC5jb20vY2VydHMvc3ViLmNsYXNz Mi5jbGllbnQuY2EuY3J0MCMGA1UdEgQcMBqGGGh0dHA6Ly93d3cuc3RhcnRzc2wuY29tLzAN BgkqhkiG9w0BAQUFAAOCAQEAjzHNqifpDVMkH1TSPFZVIiQ4fh49/V5JMpstgqEZPDaDe5r8 h+fMBZtUa6LLMco03Z9BNEXlqlXKiFk8feVYB8obEjz7YYq1XhO9q7JUmkSs0WGIH4xU0XB1 kPC8T8H+5E//84poYSFHE4pA+Ff68UANP2/EuFJWMjegiefnOr8aM42OAcUkjEWSlautIIX8 oD2GizwQYjWdDDjEonbuMKFP6rY2xGI3PSLI3IVU2opb0/itNhQui3WRxafloJqTlriY8m8+ qSLr2HGftbBlbyzVWB8o//aW0H0LMabjkIvrm7Zmh2vcCxiSxGBwYASuSYXGuQiKAgGptUs1 XJLZuzGCA9owggPWAgEBMIGTMIGMMQswCQYDVQQGEwJJTDEWMBQGA1UEChMNU3RhcnRDb20g THRkLjErMCkGA1UECxMiU2VjdXJlIERpZ2l0YWwgQ2VydGlmaWNhdGUgU2lnbmluZzE4MDYG A1UEAxMvU3RhcnRDb20gQ2xhc3MgMiBQcmltYXJ5IEludGVybWVkaWF0ZSBDbGllbnQgQ0EC Ah5jMAkGBSsOAwIaBQCgggIbMBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcN AQkFMQ8XDTEzMTIyMDEzMTczN1owIwYJKoZIhvcNAQkEMRYEFP5vkv4Tn+eHc6vcbjhiLgMY 7jARMGwGCSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAKBggqhkiG 9w0DBzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcN AwICASgwgaQGCSsGAQQBgjcQBDGBljCBkzCBjDELMAkGA1UEBhMCSUwxFjAUBgNVBAoTDVN0 YXJ0Q29tIEx0ZC4xKzApBgNVBAsTIlNlY3VyZSBEaWdpdGFsIENlcnRpZmljYXRlIFNpZ25p bmcxODA2BgNVBAMTL1N0YXJ0Q29tIENsYXNzIDIgUHJpbWFyeSBJbnRlcm1lZGlhdGUgQ2xp ZW50IENBAgIeYzCBpgYLKoZIhvcNAQkQAgsxgZaggZMwgYwxCzAJBgNVBAYTAklMMRYwFAYD VQQKEw1TdGFydENvbSBMdGQuMSswKQYDVQQLEyJTZWN1cmUgRGlnaXRhbCBDZXJ0aWZpY2F0 ZSBTaWduaW5nMTgwNgYDVQQDEy9TdGFydENvbSBDbGFzcyAyIFByaW1hcnkgSW50ZXJtZWRp YXRlIENsaWVudCBDQQICHmMwDQYJKoZIhvcNAQEBBQAEggEAf5F77RahxYM5rj3MtiuOvoA7 Cdy/iGhGoT7bkb+f6UDz+4m1S12aFavrhs59/foMntTO1xiCkbRM7FJd77sMhouOwWZCO0mP g546OaNdAZhZIelSbzkFWoYY+GwmoOi9tcvuFSDIKbwyK5uLZ0xcH3iJmz18VNCgHdUJ5/Mm MHuDpL5x4idI9Fk+G/C0Penbe6GyC8lnAcJER+NH0n4DP8snf8NOhS6ZWjZGgUHscCQ4PFSL ufvFbUpl4l1PfVlVcajftcFX1QVs9UsO/E/dZXDCIjekkhIINBdaUIFizW4VZMIVrnHa0gOK pdhRlFoQDvp2E166dmISD48BbkEIAwAAAAAAAA== --------------ms050606060704000007020902-- --===============2939700794264747520== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============2939700794264747520==-- From xen-users-bounces@lists.xen.org Fri Dec 20 13:18:42 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 20 Dec 2013 13:18:42 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vtzxa-0006cz-NT; Fri, 20 Dec 2013 13:17:46 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtzxY-0006cU-Od for xen-users@lists.xensource.com; Fri, 20 Dec 2013 13:17:45 +0000 Received: from [85.158.137.68:5468] by server-9.bemta-3.messagelabs.com id 7F/0B-13104-77344B25; Fri, 20 Dec 2013 13:17:43 +0000 X-Env-Sender: fantonifabio@tiscali.it X-Msg-Ref: server-13.tower-31.messagelabs.com!1387545462!5310942!1 X-Originating-IP: [94.23.245.208] X-SpamReason: No, hits=0.0 required=7.0 tests=ML_RADAR_SPEW_LINKS_14, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 24085 invoked from network); 20 Dec 2013 13:17:43 -0000 Received: from lnx3.fantu.it (HELO lnx3.fantu.it) (94.23.245.208) by server-13.tower-31.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 20 Dec 2013 13:17:43 -0000 Received: from localhost (localhost.localdomain [127.0.0.1]) by lnx3.fantu.it (Postfix) with ESMTP id 9E19740022F; Fri, 20 Dec 2013 14:17:42 +0100 (CET) X-Virus-Scanned: Debian amavisd-new at lnx3.fantu.it Received: from lnx3.fantu.it ([127.0.0.1]) by localhost (lnx3.fantu.it [127.0.0.1]) (amavisd-new, port 10024) with ESMTP id jcwpauJ3+RqJ; Fri, 20 Dec 2013 14:17:42 +0100 (CET) Received: from [192.168.178.50] (host102-89-dynamic.0-87-r.retail.telecomitalia.it [87.0.89.102]) (using TLSv1 with cipher DHE-RSA-AES256-SHA (256/256 bits)) (No client certificate requested) (Authenticated sender: prova@fantu.it) by lnx3.fantu.it (Postfix) with ESMTPSA id 1133E40010E; Fri, 20 Dec 2013 14:17:40 +0100 (CET) Message-ID: <52B44371.5040700@tiscali.it> Date: Fri, 20 Dec 2013 14:17:37 +0100 From: Fabio Fantoni User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: James Harper , "xen-users@lists.xensource.com" References: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> <1387529739347-5720484.post@n5.nabble.com> <6035A0D088A63A46850C3988ED045A4B66CD8E75@BITCOM1.int.sbss.com.au> In-Reply-To: <6035A0D088A63A46850C3988ED045A4B66CD8E75@BITCOM1.int.sbss.com.au> Subject: Re: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list Reply-To: fantonifabio@tiscali.it List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============2939700794264747520==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a cryptographically signed message in MIME format. --===============2939700794264747520== Content-Type: multipart/signed; protocol="application/pkcs7-signature"; micalg=sha1; boundary="------------ms050606060704000007020902" This is a cryptographically signed message in MIME format. --------------ms050606060704000007020902 Content-Type: text/plain; charset=us-ascii; format=flowed Content-Transfer-Encoding: quoted-printable Il 20/12/2013 11:25, James Harper ha scritto: >> I started to use qdisk with xen from qemu 1.3 and I already used it al= so with >> qemu 1.7 without found problem. >> I had also tested qemu debian package with xen compiled from source si= nce >> qemu 1.4, I not tested the latest from debian package but should be wo= rking, >> qemu debian package have also some features missed on upstream qemu >> compiled >> from xen (for example spice and usbredirection). >> Probably your problem can be related to bad hvm domUs support on xen >> debian >> package: >> http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=3D731038 >> >> If your problem is another please post details and I'll try to help yo= u. > Thanks I think I figured it out. I had to add backendtype=3Dqdisk onto = the end. The instructions at http://xenbits.xen.org/docs/4.3-testing/misc= /xl-disk-configuration.txt didn't work for the pure "=3D" typ= e specification, at least under debian. I had to tack 'backendtype=3Dqdis= k' to the end of a fixed position parameter style configuration. > > With qdisk enabled under a current Jessie install, qemu-system-i386 was= sitting on a steady 12.3% cpu though, even though the domu should have b= een idle. As soon as I ran an strace against the process it dropped to id= le%, so I don't know what was going on... maybe the domu really was just = busy. > > Rebuilding debian qemu package with rbd support now... hopefully that w= orks without any fuss! If your problem is only about rbd support there is a bug open on debian=20 about it: http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=3D689239 I not tested it for now but with fast watch on bugtracker seems there=20 was a regression with build and the qemu maintainer removed the rbd=20 support, if with your tested you saw that regression is solved can be=20 useful reply about this. > > Thanks again! > > James > > > ----- > Nessun virus nel messaggio. > Controllato da AVG - www.avg.com > Versione: 2014.0.4259 / Database dei virus: 3658/6935 - Data di rilasc= io: 19/12/2013 > > > --------------ms050606060704000007020902 Content-Type: application/pkcs7-signature; name="smime.p7s" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="smime.p7s" Content-Description: Firma crittografica S/MIME MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIINhjCC BjQwggQcoAMCAQICASAwDQYJKoZIhvcNAQEFBQAwfTELMAkGA1UEBhMCSUwxFjAUBgNVBAoT DVN0YXJ0Q29tIEx0ZC4xKzApBgNVBAsTIlNlY3VyZSBEaWdpdGFsIENlcnRpZmljYXRlIFNp Z25pbmcxKTAnBgNVBAMTIFN0YXJ0Q29tIENlcnRpZmljYXRpb24gQXV0aG9yaXR5MB4XDTA3 MTAyNDIxMDI1NVoXDTE3MTAyNDIxMDI1NVowgYwxCzAJBgNVBAYTAklMMRYwFAYDVQQKEw1T dGFydENvbSBMdGQuMSswKQYDVQQLEyJTZWN1cmUgRGlnaXRhbCBDZXJ0aWZpY2F0ZSBTaWdu aW5nMTgwNgYDVQQDEy9TdGFydENvbSBDbGFzcyAyIFByaW1hcnkgSW50ZXJtZWRpYXRlIENs aWVudCBDQTCCASIwDQYJKoZIhvcNAQEBBQADggEPADCCAQoCggEBAMsohUWcASz7GfKrpTOM KqANy9BV7V0igWdGxA8IU77L3aTxErQ+fcxtDYZ36Z6GH0YFn7fq5RADteP0AYzrCA+EQTfi 8q1+kA3m0nwtwXG94M5sIqsvs7lRP1aycBke/s5g9hJHryZ2acScnzczjBCAo7X1v5G3yw8M DP2m2RCye0KfgZ4nODerZJVzhAlOD9YejvAXZqHksw56HzElVIoYSZ3q4+RJuPXXfIoyby+Y 2m1E+YzX5iCZXBx05gk6MKAW1vaw4/v2OOLy6FZH3XHHtOkzUreG//CsFnB9+uaYSlR65cdG zTsmoIK8WH1ygoXhRBm98SD7Hf/r3FELNvUCAwEAAaOCAa0wggGpMA8GA1UdEwEB/wQFMAMB Af8wDgYDVR0PAQH/BAQDAgEGMB0GA1UdDgQWBBSuVYNv7DHKufcd+q9rMfPIHeOsuzAfBgNV HSMEGDAWgBROC+8apEBbpRdphzDKNGhD0EGu8jBmBggrBgEFBQcBAQRaMFgwJwYIKwYBBQUH MAGGG2h0dHA6Ly9vY3NwLnN0YXJ0c3NsLmNvbS9jYTAtBggrBgEFBQcwAoYhaHR0cDovL3d3 dy5zdGFydHNzbC5jb20vc2ZzY2EuY3J0MFsGA1UdHwRUMFIwJ6AloCOGIWh0dHA6Ly93d3cu c3RhcnRzc2wuY29tL3Nmc2NhLmNybDAnoCWgI4YhaHR0cDovL2NybC5zdGFydHNzbC5jb20v c2ZzY2EuY3JsMIGABgNVHSAEeTB3MHUGCysGAQQBgbU3AQIBMGYwLgYIKwYBBQUHAgEWImh0 dHA6Ly93d3cuc3RhcnRzc2wuY29tL3BvbGljeS5wZGYwNAYIKwYBBQUHAgEWKGh0dHA6Ly93 d3cuc3RhcnRzc2wuY29tL2ludGVybWVkaWF0ZS5wZGYwDQYJKoZIhvcNAQEFBQADggIBADqp Jw3I07QWke9plNBpxUxcffc7nUrIQpJHDci91DFG7fVhHRkMZ1J+BKg5UNUxIFJ2Z9B90Mic c/NXcs7kPBRdn6XGO/vPc87Y6R+cWS9Nc9+fp3Enmsm94OxOwI9wn8qnr/6o3mD4noP9Jphw UPTXwHovjavRnhUQHLfo/i2NG0XXgTHXS2Xm0kVUozXqpYpAdumMiB/vezj1QHQJDmUdPYMc p+reg9901zkyT3fDW/ivJVv6pWtkh6Pw2ytZT7mvg7YhX3V50Nv860cV11mocUVcqBLv0gcT +HBDYtbuvexNftwNQKD5193A7zN4vG7CTYkXxytSjKuXrpEatEiFPxWgb84nVj25SU5q/r1X hwby6mLhkbaXslkVtwEWT3Van49rKjlK4XrUKYYWtnfzq6aSak5u0Vpxd1rY79tWhD3EdCvO hNz/QplNa+VkIsrcp7+8ZhP1l1b2U6MaxIVteuVMD3X0vziIwr7jxYae9FZjbxlpUemqXjcC 0QaFfN7qI0JsQMALL7iGRBg7K0CoOBzECdD3fuZil5kU/LP9cr1BK31U0Uy651bFnAMMMkqh AChIbn0ei72VnbpSsrrSdF0BAGYQ8vyHae5aCg+H75dVCV33K6FuxZrf09yTz+Vx/PkdRUYk XmZz/OTfyJXsUOUXrym6KvI2rYpccSk5MIIHSjCCBjKgAwIBAgICHmMwDQYJKoZIhvcNAQEF BQAwgYwxCzAJBgNVBAYTAklMMRYwFAYDVQQKEw1TdGFydENvbSBMdGQuMSswKQYDVQQLEyJT ZWN1cmUgRGlnaXRhbCBDZXJ0aWZpY2F0ZSBTaWduaW5nMTgwNgYDVQQDEy9TdGFydENvbSBD bGFzcyAyIFByaW1hcnkgSW50ZXJtZWRpYXRlIENsaWVudCBDQTAeFw0xMjAzMTgyMjE0MzBa Fw0xNDAzMjAwODU3MDlaMIGMMRkwFwYDVQQNExBlQjZPRTM3UlJOUHlsNW0yMQswCQYDVQQG EwJJVDEQMA4GA1UECBMHQmVyZ2FtbzEQMA4GA1UEBxMHUm92ZXR0YTEWMBQGA1UEAxMNRmFi aW8gRmFudG9uaTEmMCQGCSqGSIb3DQEJARYXZmFudG9uaWZhYmlvQHRpc2NhbGkuaXQwggEi MA0GCSqGSIb3DQEBAQUAA4IBDwAwggEKAoIBAQC1XhckXsX23vgJq76s2f0KT8U8Msov5QgV 10eQBb2wL/TzcmqtZotI7ztKVhio3ehHg+mfu+3EqOkX9Umgut8rP0bPi7AGjkPXbOTT/cSU Xz2Kw31VGOmiOVoUFGvpQitp3weCkhUJLBipI8EpNyBXpjtQ9yCpnIAqfuc77ybfSnCy7tTR MBq1BUkfjH1+GL45riosuS4+F+MSUvlYzLiT4rAduAX1Y2IuORDsf9Bce8GBxa6syP9rCyzl Vk7DIX5k8j2vlnyRATIypn5CQLQxGT6e0f6ac4gvWOHwO2QEBsmZKKs1ZidE4q/9OoNXYX6A jnHtp1H1vcrek/vVcs19AgMBAAGjggOyMIIDrjAJBgNVHRMEAjAAMAsGA1UdDwQEAwIEsDAd BgNVHSUEFjAUBggrBgEFBQcDAgYIKwYBBQUHAwQwHQYDVR0OBBYEFFan8cbEWWBmSTWFtLk2 YNdAcGUbMB8GA1UdIwQYMBaAFK5Vg2/sMcq59x36r2sx88gd46y7MCIGA1UdEQQbMBmBF2Zh bnRvbmlmYWJpb0B0aXNjYWxpLml0MIICIQYDVR0gBIICGDCCAhQwggIQBgsrBgEEAYG1NwEC AjCCAf8wLgYIKwYBBQUHAgEWImh0dHA6Ly93d3cuc3RhcnRzc2wuY29tL3BvbGljeS5wZGYw NAYIKwYBBQUHAgEWKGh0dHA6Ly93d3cuc3RhcnRzc2wuY29tL2ludGVybWVkaWF0ZS5wZGYw gfcGCCsGAQUFBwICMIHqMCcWIFN0YXJ0Q29tIENlcnRpZmljYXRpb24gQXV0aG9yaXR5MAMC AQEagb5UaGlzIGNlcnRpZmljYXRlIHdhcyBpc3N1ZWQgYWNjb3JkaW5nIHRvIHRoZSBDbGFz cyAyIFZhbGlkYXRpb24gcmVxdWlyZW1lbnRzIG9mIHRoZSBTdGFydENvbSBDQSBwb2xpY3ks IHJlbGlhbmNlIG9ubHkgZm9yIHRoZSBpbnRlbmRlZCBwdXJwb3NlIGluIGNvbXBsaWFuY2Ug b2YgdGhlIHJlbHlpbmcgcGFydHkgb2JsaWdhdGlvbnMuMIGcBggrBgEFBQcCAjCBjzAnFiBT dGFydENvbSBDZXJ0aWZpY2F0aW9uIEF1dGhvcml0eTADAgECGmRMaWFiaWxpdHkgYW5kIHdh cnJhbnRpZXMgYXJlIGxpbWl0ZWQhIFNlZSBzZWN0aW9uICJMZWdhbCBhbmQgTGltaXRhdGlv bnMiIG9mIHRoZSBTdGFydENvbSBDQSBwb2xpY3kuMDYGA1UdHwQvMC0wK6ApoCeGJWh0dHA6 Ly9jcmwuc3RhcnRzc2wuY29tL2NydHUyLWNybC5jcmwwgY4GCCsGAQUFBwEBBIGBMH8wOQYI KwYBBQUHMAGGLWh0dHA6Ly9vY3NwLnN0YXJ0c3NsLmNvbS9zdWIvY2xhc3MyL2NsaWVudC9j YTBCBggrBgEFBQcwAoY2aHR0cDovL2FpYS5zdGFydHNzbC5jb20vY2VydHMvc3ViLmNsYXNz Mi5jbGllbnQuY2EuY3J0MCMGA1UdEgQcMBqGGGh0dHA6Ly93d3cuc3RhcnRzc2wuY29tLzAN BgkqhkiG9w0BAQUFAAOCAQEAjzHNqifpDVMkH1TSPFZVIiQ4fh49/V5JMpstgqEZPDaDe5r8 h+fMBZtUa6LLMco03Z9BNEXlqlXKiFk8feVYB8obEjz7YYq1XhO9q7JUmkSs0WGIH4xU0XB1 kPC8T8H+5E//84poYSFHE4pA+Ff68UANP2/EuFJWMjegiefnOr8aM42OAcUkjEWSlautIIX8 oD2GizwQYjWdDDjEonbuMKFP6rY2xGI3PSLI3IVU2opb0/itNhQui3WRxafloJqTlriY8m8+ qSLr2HGftbBlbyzVWB8o//aW0H0LMabjkIvrm7Zmh2vcCxiSxGBwYASuSYXGuQiKAgGptUs1 XJLZuzGCA9owggPWAgEBMIGTMIGMMQswCQYDVQQGEwJJTDEWMBQGA1UEChMNU3RhcnRDb20g THRkLjErMCkGA1UECxMiU2VjdXJlIERpZ2l0YWwgQ2VydGlmaWNhdGUgU2lnbmluZzE4MDYG A1UEAxMvU3RhcnRDb20gQ2xhc3MgMiBQcmltYXJ5IEludGVybWVkaWF0ZSBDbGllbnQgQ0EC Ah5jMAkGBSsOAwIaBQCgggIbMBgGCSqGSIb3DQEJAzELBgkqhkiG9w0BBwEwHAYJKoZIhvcN AQkFMQ8XDTEzMTIyMDEzMTczN1owIwYJKoZIhvcNAQkEMRYEFP5vkv4Tn+eHc6vcbjhiLgMY 7jARMGwGCSqGSIb3DQEJDzFfMF0wCwYJYIZIAWUDBAEqMAsGCWCGSAFlAwQBAjAKBggqhkiG 9w0DBzAOBggqhkiG9w0DAgICAIAwDQYIKoZIhvcNAwICAUAwBwYFKw4DAgcwDQYIKoZIhvcN AwICASgwgaQGCSsGAQQBgjcQBDGBljCBkzCBjDELMAkGA1UEBhMCSUwxFjAUBgNVBAoTDVN0 YXJ0Q29tIEx0ZC4xKzApBgNVBAsTIlNlY3VyZSBEaWdpdGFsIENlcnRpZmljYXRlIFNpZ25p bmcxODA2BgNVBAMTL1N0YXJ0Q29tIENsYXNzIDIgUHJpbWFyeSBJbnRlcm1lZGlhdGUgQ2xp ZW50IENBAgIeYzCBpgYLKoZIhvcNAQkQAgsxgZaggZMwgYwxCzAJBgNVBAYTAklMMRYwFAYD VQQKEw1TdGFydENvbSBMdGQuMSswKQYDVQQLEyJTZWN1cmUgRGlnaXRhbCBDZXJ0aWZpY2F0 ZSBTaWduaW5nMTgwNgYDVQQDEy9TdGFydENvbSBDbGFzcyAyIFByaW1hcnkgSW50ZXJtZWRp YXRlIENsaWVudCBDQQICHmMwDQYJKoZIhvcNAQEBBQAEggEAf5F77RahxYM5rj3MtiuOvoA7 Cdy/iGhGoT7bkb+f6UDz+4m1S12aFavrhs59/foMntTO1xiCkbRM7FJd77sMhouOwWZCO0mP g546OaNdAZhZIelSbzkFWoYY+GwmoOi9tcvuFSDIKbwyK5uLZ0xcH3iJmz18VNCgHdUJ5/Mm MHuDpL5x4idI9Fk+G/C0Penbe6GyC8lnAcJER+NH0n4DP8snf8NOhS6ZWjZGgUHscCQ4PFSL ufvFbUpl4l1PfVlVcajftcFX1QVs9UsO/E/dZXDCIjekkhIINBdaUIFizW4VZMIVrnHa0gOK pdhRlFoQDvp2E166dmISD48BbkEIAwAAAAAAAA== --------------ms050606060704000007020902-- --===============2939700794264747520== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============2939700794264747520==-- From xen-users-bounces@lists.xen.org Fri Dec 20 22:28:33 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 20 Dec 2013 22:28:33 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vu8XF-0000jW-B0; Fri, 20 Dec 2013 22:27:09 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vu8XC-0000jO-VK for xen-users@lists.xensource.com; Fri, 20 Dec 2013 22:27:07 +0000 Received: from [85.158.139.211:6692] by server-10.bemta-5.messagelabs.com id 8A/AD-01405-934C4B25; Fri, 20 Dec 2013 22:27:05 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-16.tower-206.messagelabs.com!1387578422!4731736!1 X-Originating-IP: [203.16.224.4] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 32162 invoked from network); 20 Dec 2013 22:27:04 -0000 Received: from smtp1.bendigoit.com.au (HELO smtp1.bendigoit.com.au) (203.16.224.4) by server-16.tower-206.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 20 Dec 2013 22:27:04 -0000 Received: from smtp2.bendigoit.com.au ([203.16.207.99] helo=BITCOM1.int.sbss.com.au) by smtp1.bendigoit.com.au with esmtp (Exim 4.80) (envelope-from ) id 1Vu8Xd-0005s7-RW; Sat, 21 Dec 2013 09:27:34 +1100 Received: from BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d]) by BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d%12]) with mapi id 14.03.0174.001; Sat, 21 Dec 2013 09:26:47 +1100 From: James Harper To: "fantonifabio@tiscali.it" , "xen-users@lists.xensource.com" Thread-Topic: [Xen-users] qdisk and debian Thread-Index: Ac79HzNI2OfP7KyvQ8OhxHPB+CkVGf//y7WA//8w9fCAARg8gP/+rpLw Date: Fri, 20 Dec 2013 22:26:46 +0000 Message-ID: <6035A0D088A63A46850C3988ED045A4B66CD9BB7@BITCOM1.int.sbss.com.au> References: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> <1387529739347-5720484.post@n5.nabble.com> <6035A0D088A63A46850C3988ED045A4B66CD8E75@BITCOM1.int.sbss.com.au> <52B44371.5040700@tiscali.it> In-Reply-To: <52B44371.5040700@tiscali.it> Accept-Language: en-AU, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.16.3.239] x-tm-as-product-ver: SMEX-11.0.0.1191-7.000.1014-20374.001 x-tm-as-result: No--31.774200-0.000000-31 x-tm-as-user-approved-sender: Yes x-tm-as-user-blocked-sender: No MIME-Version: 1.0 X-Really-From-Bendigo-IT: magichashvalue Subject: Re: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > > If your problem is only about rbd support there is a bug open on debian > about it: > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=689239 > I not tested it for now but with fast watch on bugtracker seems there > was a regression with build and the qemu maintainer removed the rbd > support, if with your tested you saw that regression is solved can be > useful reply about this. > I just turned off build of qemu-user (failed to link rbd static) and I now have a qemu that should work with rbd. But xen doesn't seem to allow me to select rbd. How should I express a rbd configuration in disk= ? Or do I now need to rebuild xen with rbd support? Thanks James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 20 22:28:33 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 20 Dec 2013 22:28:33 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vu8XF-0000jW-B0; Fri, 20 Dec 2013 22:27:09 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vu8XC-0000jO-VK for xen-users@lists.xensource.com; Fri, 20 Dec 2013 22:27:07 +0000 Received: from [85.158.139.211:6692] by server-10.bemta-5.messagelabs.com id 8A/AD-01405-934C4B25; Fri, 20 Dec 2013 22:27:05 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-16.tower-206.messagelabs.com!1387578422!4731736!1 X-Originating-IP: [203.16.224.4] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 32162 invoked from network); 20 Dec 2013 22:27:04 -0000 Received: from smtp1.bendigoit.com.au (HELO smtp1.bendigoit.com.au) (203.16.224.4) by server-16.tower-206.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 20 Dec 2013 22:27:04 -0000 Received: from smtp2.bendigoit.com.au ([203.16.207.99] helo=BITCOM1.int.sbss.com.au) by smtp1.bendigoit.com.au with esmtp (Exim 4.80) (envelope-from ) id 1Vu8Xd-0005s7-RW; Sat, 21 Dec 2013 09:27:34 +1100 Received: from BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d]) by BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d%12]) with mapi id 14.03.0174.001; Sat, 21 Dec 2013 09:26:47 +1100 From: James Harper To: "fantonifabio@tiscali.it" , "xen-users@lists.xensource.com" Thread-Topic: [Xen-users] qdisk and debian Thread-Index: Ac79HzNI2OfP7KyvQ8OhxHPB+CkVGf//y7WA//8w9fCAARg8gP/+rpLw Date: Fri, 20 Dec 2013 22:26:46 +0000 Message-ID: <6035A0D088A63A46850C3988ED045A4B66CD9BB7@BITCOM1.int.sbss.com.au> References: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> <1387529739347-5720484.post@n5.nabble.com> <6035A0D088A63A46850C3988ED045A4B66CD8E75@BITCOM1.int.sbss.com.au> <52B44371.5040700@tiscali.it> In-Reply-To: <52B44371.5040700@tiscali.it> Accept-Language: en-AU, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.16.3.239] x-tm-as-product-ver: SMEX-11.0.0.1191-7.000.1014-20374.001 x-tm-as-result: No--31.774200-0.000000-31 x-tm-as-user-approved-sender: Yes x-tm-as-user-blocked-sender: No MIME-Version: 1.0 X-Really-From-Bendigo-IT: magichashvalue Subject: Re: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > > If your problem is only about rbd support there is a bug open on debian > about it: > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=689239 > I not tested it for now but with fast watch on bugtracker seems there > was a regression with build and the qemu maintainer removed the rbd > support, if with your tested you saw that regression is solved can be > useful reply about this. > I just turned off build of qemu-user (failed to link rbd static) and I now have a qemu that should work with rbd. But xen doesn't seem to allow me to select rbd. How should I express a rbd configuration in disk= ? Or do I now need to rebuild xen with rbd support? Thanks James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 20 23:47:06 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 20 Dec 2013 23:47:06 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vu9lp-0005vM-1B; Fri, 20 Dec 2013 23:46:17 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vu9ln-0005vH-7q for xen-users@lists.xensource.com; Fri, 20 Dec 2013 23:46:15 +0000 Received: from [85.158.143.35:38370] by server-3.bemta-4.messagelabs.com id 4C/EA-32360-6C6D4B25; Fri, 20 Dec 2013 23:46:14 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-2.tower-21.messagelabs.com!1387583170!7380780!1 X-Originating-IP: [203.16.224.4] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 3379 invoked from network); 20 Dec 2013 23:46:13 -0000 Received: from smtp1.bendigoit.com.au (HELO smtp1.bendigoit.com.au) (203.16.224.4) by server-2.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 20 Dec 2013 23:46:13 -0000 Received: from smtp2.bendigoit.com.au ([203.16.207.99] helo=BITCOM1.int.sbss.com.au) by smtp1.bendigoit.com.au with esmtp (Exim 4.80) (envelope-from ) id 1Vu9mH-0006Vi-0y; Sat, 21 Dec 2013 10:46:45 +1100 Received: from BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d]) by BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d%12]) with mapi id 14.03.0174.001; Sat, 21 Dec 2013 10:46:03 +1100 From: James Harper To: "fantonifabio@tiscali.it" , "xen-users@lists.xensource.com" Thread-Topic: [Xen-users] qdisk and debian (and rbd) Thread-Index: Ac793NJdEpnqH18jQxagS9XlrhA0mA== Date: Fri, 20 Dec 2013 23:46:01 +0000 Message-ID: <6035A0D088A63A46850C3988ED045A4B66CD9CC5@BITCOM1.int.sbss.com.au> Accept-Language: en-AU, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.16.3.239] x-tm-as-product-ver: SMEX-11.0.0.1191-7.000.1014-20374.002 x-tm-as-result: No--35.139400-0.000000-31 x-tm-as-user-approved-sender: Yes x-tm-as-user-blocked-sender: No MIME-Version: 1.0 X-Really-From-Bendigo-IT: magichashvalue Subject: Re: [Xen-users] qdisk and debian (and rbd) X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > > I just turned off build of qemu-user (failed to link rbd static) and I now have a > qemu that should work with rbd. But xen doesn't seem to allow me to select > rbd. How should I express a rbd configuration in disk= ? Or do I now need to > rebuild xen with rbd support? > Hmmm... it seems that xl (in 4.3.0 at least) artificially restricts the allowed formats. I had to add a "LIBXL_DISK_FORMAT_RBD" in a few places to get it to work. It would be better if backendtype=qdisk left the format parsing up to qemu rather than put artificial restrictions in and requiring a patch every time a new format is added to qemu... James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 20 23:47:06 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 20 Dec 2013 23:47:06 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vu9lp-0005vM-1B; Fri, 20 Dec 2013 23:46:17 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vu9ln-0005vH-7q for xen-users@lists.xensource.com; Fri, 20 Dec 2013 23:46:15 +0000 Received: from [85.158.143.35:38370] by server-3.bemta-4.messagelabs.com id 4C/EA-32360-6C6D4B25; Fri, 20 Dec 2013 23:46:14 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-2.tower-21.messagelabs.com!1387583170!7380780!1 X-Originating-IP: [203.16.224.4] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 3379 invoked from network); 20 Dec 2013 23:46:13 -0000 Received: from smtp1.bendigoit.com.au (HELO smtp1.bendigoit.com.au) (203.16.224.4) by server-2.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 20 Dec 2013 23:46:13 -0000 Received: from smtp2.bendigoit.com.au ([203.16.207.99] helo=BITCOM1.int.sbss.com.au) by smtp1.bendigoit.com.au with esmtp (Exim 4.80) (envelope-from ) id 1Vu9mH-0006Vi-0y; Sat, 21 Dec 2013 10:46:45 +1100 Received: from BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d]) by BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d%12]) with mapi id 14.03.0174.001; Sat, 21 Dec 2013 10:46:03 +1100 From: James Harper To: "fantonifabio@tiscali.it" , "xen-users@lists.xensource.com" Thread-Topic: [Xen-users] qdisk and debian (and rbd) Thread-Index: Ac793NJdEpnqH18jQxagS9XlrhA0mA== Date: Fri, 20 Dec 2013 23:46:01 +0000 Message-ID: <6035A0D088A63A46850C3988ED045A4B66CD9CC5@BITCOM1.int.sbss.com.au> Accept-Language: en-AU, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.16.3.239] x-tm-as-product-ver: SMEX-11.0.0.1191-7.000.1014-20374.002 x-tm-as-result: No--35.139400-0.000000-31 x-tm-as-user-approved-sender: Yes x-tm-as-user-blocked-sender: No MIME-Version: 1.0 X-Really-From-Bendigo-IT: magichashvalue Subject: Re: [Xen-users] qdisk and debian (and rbd) X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > > I just turned off build of qemu-user (failed to link rbd static) and I now have a > qemu that should work with rbd. But xen doesn't seem to allow me to select > rbd. How should I express a rbd configuration in disk= ? Or do I now need to > rebuild xen with rbd support? > Hmmm... it seems that xl (in 4.3.0 at least) artificially restricts the allowed formats. I had to add a "LIBXL_DISK_FORMAT_RBD" in a few places to get it to work. It would be better if backendtype=qdisk left the format parsing up to qemu rather than put artificial restrictions in and requiring a patch every time a new format is added to qemu... James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sun Dec 22 12:30:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 12:30:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VuiA7-0003fV-La; Sun, 22 Dec 2013 12:29:39 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsrLj-0001cN-SK for xen-users@lists.xen.org; Tue, 17 Dec 2013 09:54:00 +0000 Received: from [85.158.139.211:60964] by server-15.bemta-5.messagelabs.com id C5/C8-08490-73F10B25; Tue, 17 Dec 2013 09:53:59 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-10.tower-206.messagelabs.com!1387274035!4996688!2 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 22823 invoked from network); 17 Dec 2013 09:53:58 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-10.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 17 Dec 2013 09:53:58 -0000 X-IronPort-AV: E=Sophos;i="4.95,500,1384300800"; d="scan'208";a="82984262" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 17 Dec 2013 09:53:55 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL02.citrite.net (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Tue, 17 Dec 2013 04:53:54 -0500 Message-ID: <1387274033.27441.17.camel@kazak.uk.xensource.com> From: Ian Campbell To: peter Date: Tue, 17 Dec 2013 09:53:53 +0000 In-Reply-To: References: <1387187949.20076.37.camel@kazak.uk.xensource.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA2 X-Mailman-Approved-At: Sun, 22 Dec 2013 12:29:38 +0000 Cc: xen-devel@lists.xen.org Subject: Re: [Xen-users] [Xen-devel] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, 2013-12-17 at 08:20 +0100, peter wrote: Please can you avoid top posting on the -devel list. I've put -users and Lars to bcc since I think we are now well into -devel territory. > Thank you for the info/patch Ian. > With some modifications to Qemu, I managed to cross compile > qemu-system-arm with XEN support. > Based on version: 1c514a7734b7f98625a0d18d5e8ee7581f26e50c (Merge remote > branch 'perard/cpu-hotplug-port-v2' into xen-staging-master-7). > And got my Qemu backend working. > > I can see that INPUT_XEN_KBDDEV_FRONTEND is working > (d9) 6input: Xen Virtual Keyboard as /devices/virtual/input/input0 > (d9) 6input: Xen Virtual Pointer as /devices/virtual/input/input1 > > And that XEN bus is prompting for VFB > (d9) 6xenbus_probe_frontend: Device with no driver: device/vfb/0 > > But it seems that the xen-fbfront only supports PV and not PVH. (Linux > kernel 3.12-RC5) > Because the init code is returning on: > > if (!xen_pv_domain()) > return -ENODEV; > > When I comment this code out. > I do get these errors: > > [ 1698.899496] Failed to unmap pfn:5c081 rc:-2 > > (XEN) dom10 IPA 0x0000000000000000 > (XEN) P2M @ 021b8300 mfn:0x4dc18 > (XEN) 1ST[0x0] = 0x000000004da276ff > (XEN) 2ND[0x0] = 0x000000006b6856ff > (XEN) 3RD[0x0] = 0x0000000000000000 > [ 1698.933034] Failed to map pfn to mfn rc:0:-22 pfn:5c349 mfn:0 > > (XEN) dom10 IPA 0x000000002777c000 > (XEN) P2M @ 021b8300 mfn:0x4dc18 > (XEN) 1ST[0x0] = 0x000000004da276ff > (XEN) 2ND[0x13b] = 0x0000000000000000 > [ 1698.951353] Failed to map pfn to mfn rc:0:-22 pfn:5c348 mfn:b6b2777c > > Yes lots of them, and my VFB is not working tough. > > So I've searched on the internet if someone got VFB on PVH working. > But I couldn't find anything about, so is there someone who got VFB > working on PVH (x86) ? I've not heard of anyone, the focus of x86-PVH has been on getting the basic functionality going. In general PV drivers should just work but in some corner cases they need adjustments for the "autotranslate" (i.e. hardware assisted paging) case which is one of the key areas where both ARM, PVH-x86 and HVM-x86 differ from traditional PV-x86 guests. So it might be that the vfb driver requires some such adjustment, or it might be that the foreign mapping stuff is not working for you -- which would be the same issue as you are having with domain building in the other thread. Given that I think we should try and get to the bottom of the foreign mapping stuff first. Eventually it might be worth investigating http://xen.1045712.n5.nabble.com/PATCH-Add-grant-references-for-fbfront-kbdfront-td3332068.html since the fb driver didn't really ought to be using foreign mappings anyway -- it should use grant references. However those patches only cover the frontend case and the author was using something other than qemu as the backend, so there is at least some actual development work required here. Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sun Dec 22 12:30:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 12:30:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VuiA8-0003fn-Qh; Sun, 22 Dec 2013 12:29:41 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VuN7J-0004Uh-9v for xen-users@lists.xen.org; Sat, 21 Dec 2013 14:01:21 +0000 Received: from [193.109.254.147:8874] by server-3.bemta-14.messagelabs.com id 12/30-11000-03F95B25; Sat, 21 Dec 2013 14:01:20 +0000 X-Env-Sender: zir_blazer@hotmail.com X-Msg-Ref: server-8.tower-27.messagelabs.com!1387634477!6875868!1 X-Originating-IP: [65.54.190.92] X-SpamReason: No, hits=1.5 required=7.0 tests=BODY_RANDOM_LONG, FORGED_HOTMAIL_RCVD,HTML_10_20,HTML_MESSAGE,ML_RADAR_SPEW_LINKS_12, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 4572 invoked from network); 21 Dec 2013 14:01:18 -0000 Received: from bay0-omc2-s17.bay0.hotmail.com (HELO bay0-omc2-s17.bay0.hotmail.com) (65.54.190.92) by server-8.tower-27.messagelabs.com with SMTP; 21 Dec 2013 14:01:18 -0000 Received: from BAY170-W127 ([65.54.190.123]) by bay0-omc2-s17.bay0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Sat, 21 Dec 2013 06:01:17 -0800 X-TMN: [YOyAPJjK8zz6x7FEkXPaf/+24Kw/eT8x7ThzurPchzw=] X-Originating-Email: [zir_blazer@hotmail.com] Message-ID: From: Zir Blazer To: Ian Campbell Date: Sat, 21 Dec 2013 11:01:16 -0300 Importance: Normal In-Reply-To: <1387356006.1025.46.camel@dagon.hellion.org.uk> References: , , <1387190962.20076.65.camel@kazak.uk.xensource.com>, , <1387356006.1025.46.camel@dagon.hellion.org.uk> MIME-Version: 1.0 X-OriginalArrivalTime: 21 Dec 2013 14:01:17.0566 (UTC) FILETIME=[1E60D1E0:01CEFE55] X-Mailman-Approved-At: Sun, 22 Dec 2013 12:29:38 +0000 Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] Xen black screens while booting in Arch Linux with UEFI GRUB X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6216593211267801594==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6216593211267801594== Content-Type: multipart/alternative; boundary="_403ae6d9-4f6e-4098-bcfc-825e22cc3fd4_" --_403ae6d9-4f6e-4098-bcfc-825e22cc3fd4_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable > As I said in my original reply xen.efi is supposed to be booted directly > from the EFI shell=2C not via a bootloader. >=20 > Whether or not that is your problem I don't know=2C but that is what I > believe is supposed to work=2C whereas all these others are unknowns=2C s= o > please try that. (this is because Xen needs to be called EFI Boot > Services still available and bootloaders tend to call ExitBootServices > before calling the kernel) Do you have instructions on how to launch it from the EFI Shell so I can te= st that? I know my Motherboard has an embedded EFI Shell and I know how to = boot to it=2C but there isn't a lot of information on how to use it. Checking again Gummiboot=2C Gummiboot isn't actually a true Boot Loader=2C = but a Boot Manager:http://freedesktop.org/wiki/Software/gummiboot/Its purpo= se seems to be to not have to launch EFI executables manually via EFI Shell= and instead having them consolidated in a cute menu. But just to make sure= =2C I'l test it your way if you can tell me what commands I have to use aft= er booting to the EFI Shell. Additionally=2C I have some more info: While experimenting with BIOS settings=2C I discovered that if instead of u= sing as primary video device the Haswell GPU=2C I use the Radeon 5770=2C Xe= n actually goes further. It reachs "unpacking initramfs" and hangs there. I= searched around a bit to find if there was any way to get more detailed lo= gs=2C so I modified /boot/xen-4.3.1.cfg (Xen EFI file is xen-4.3.1.efi): [global]default=3Dxen [xen]options=3Dconsole=3Dvga vga=3Dcurrent loglvl=3Dall norebootkernel=3Dvm= linuz-linux root=3DUUID=3D7af1797c-00af-4219-a141-27a718f39858 rw ignore_lo= glevel earlyprintk=3Dvga=2Ckeepramdisk=3Dinitramfs-linux.img=20 It consistently hangs while detecting PCI devices=2C through not always on = the same line. I manually wrote what is on screen one of the times it hange= d (I skipped the first bracket of every line with some numbers on them that= appears to be seconds=2C but last line usually is around 5.0xxx): e820: reserve RAM buffer [mem 0x8826e000-0x8bffffff]e820: reserve RAM buffe= r [mem 0x88b4e000-0x8bffffff]e820: reserve RAM buffer [mem 0x992ed000-0x9bf= fffff]e820: reserve RAM buffer [mem 0x993eb000-0x9bffffff]e820: reserve RAM= buffer [mem 0x993eb000-0x9bffffff]e820: reserve RAM buffer [mem 0x85ee0000= 0-0x85fffffff]NetLabel: InitializingNetLabel: domain hash size =3D 128NetL= abel: protocols =3D UNLABELED CIPSOv4NetLabel: unlabeled traffic allowed b= y defaultSwitched to clocksource xenpnp: PnP ACPI: disabledpci 0000:00:1c.4= : bridge window [io 0x1000-0x0fff] to [bus 0c-44] add_size 1000pci 0000:00:= 1c.4: res[13]=3D[io 0x1000-0x0fff] get_res_add_size add_size 1000pci 0000:= 00:1c.4: BAR 13: assigned [io 0x1000-0x1fff]pci 0000:00:01.0: PCI bridge to= [bus 01]pci 0000:00:01.0: bridge window [io 0xe000-0xefff]pci 0000:00:01= .0: bridge window [mem 0xeee00000-0xeeefffff]pci 0000:00:01.0: bridge win= dow [mem 0xc40000000-0xc4fffffff 64bit pref]pci 0000:00:1c.0: PCI bridge to= [bus 02]pci 0000:00:1c.0: bridge window [io 0xd000-0xdfff]pci 0000:00:1c.= 0: bridge window [mem 0xeed00000-0xeedfffff]pci 0000:04:01.0: PCI bridge t= o [bus 05]pci 0000:04:04.0: PCI bridge to [bus 06]pci 0000:04:05.0: PCI bri= dge to [bus 07]pci 0000:04:07.0: PCI bridge to [bus 08]pci 0000:04:07.0: b= ridge window [mem 0xeea00000-0xeeafffff]pci 0000:09:00.0: PCI bridge to [bu= s 0a]pci 0000:09:00.0: bridge window [mem 0xee800000-0xee8fffff]pci 0000:0= 4:09.0: PCI bridge to [bus 09-0a]pci 0000:04:09.0: bridge window [mem 0xee= 800000-0xee9fffff]pci 0000:03:00.0: PCI bridge to [bus 04-0a]pci 0000:03:00= .0: bridge window [mem 0xee800000-0xeeafffff]pci 0000:00:1c.1: PCI bridge = to [bus 03-04]pci 0000:00:1c.1: bridge window [mem 0xee800000-0xeebfffff]p= ci 0000:00:1c.3: PCI bridge to [bus 0b]pci 0000:00:1c.3: bridge window [io= 0xc000-0xcfff]pci 0000:00:1c.3: bridge window [mem 0xeec00000-0xeecfffff= ]pci 0000:00:1c.4: PCI bridge to [bus 0c-44]pci 0000:00:1c.4: bridge windo= w [io 0x1000-0x1fff]pci 0000:00:1c.4: bridge window [mem 0xd8000000-0xee0= fffff]pci 0000:00:1c.4: bridge window [mem 0xb0000000-0xd1ffffff 64bit pre= f]pci_bus 0000:00: resource 4 [io 0x0000-0xffff]pci_bus 0000:00: resource = 5 [mem 0x00000000-0x7fffffffff] Something that I paid attention is that it says that PnP ACPI is disabled= =2C while when I boot on classic Arch Linux instead of using the xen.efi=2C= dmesg mentions this: Switched to clocksource hpetpnp: PnP ACPI initACPI: bus type PNP registered ...plus around 20-30 lines before pci and pci_bus appear. I don't know if t= hat Xen fails to work with ACPI may be related - I should test if my BIOS-b= ased Xen installation also doesn't work with ACPI.. Just in case it is needed=2C this is the current output of lspci when I boo= t on classic Arch Linux instead of using the Xen-modified one: 00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v3 Processor DRAM Contr= oller (rev 06)00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v3/4th Gen= Core Processor PCI Express x16 Controller (rev 06)00:02.0 Display controll= er: Intel Corporation Xeon E3-1200 v3 Processor Integrated Graphics Control= ler (rev 06)00:03.0 Audio device: Intel Corporation Xeon E3-1200 v3/4th Gen= Core Processor HD Audio Controller (rev 06)00:14.0 USB controller: Intel C= orporation 8 Series/C220 Series Chipset Family USB xHCI (rev 05)00:16.0 Com= munication controller: Intel Corporation 8 Series/C220 Series Chipset Famil= y MEI Controller #1 (rev 04)00:19.0 Ethernet controller: Intel Corporation = Ethernet Connection I217-LM (rev 05)00:1a.0 USB controller: Intel Corporati= on 8 Series/C220 Series Chipset Family USB EHCI #2 (rev 05)00:1b.0 Audio de= vice: Intel Corporation 8 Series/C220 Series Chipset High Definition Audio = Controller (rev 05)00:1c.0 PCI bridge: Intel Corporation 8 Series/C220 Seri= es Chipset Family PCI Express Root Port #1 (rev d5)00:1c.1 PCI bridge: Inte= l Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #2 = (rev d5)00:1c.3 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset = Family PCI Express Root Port #4 (rev d5)00:1c.4 PCI bridge: Intel Corporati= on 8 Series/C220 Series Chipset Family PCI Express Root Port #5 (rev d5)00:= 1d.0 USB controller: Intel Corporation 8 Series/C220 Series Chipset Family = USB EHCI #1 (rev 05)00:1f.0 ISA bridge: Intel Corporation C226 Series Chips= et Family Server Advanced SKU LPC Controller (rev 05)00:1f.2 SATA controlle= r: Intel Corporation 8 Series/C220 Series Chipset Family 6-port SATA Contro= ller 1 [AHCI mode] (rev 05)00:1f.3 SMBus: Intel Corporation 8 Series/C220 S= eries Chipset Family SMBus Controller (rev 05)00:1f.6 Signal processing con= troller: Intel Corporation 8 Series Chipset Family Thermal Management Contr= oller (rev 05)01:00.0 VGA compatible controller: Advanced Micro Devices=2C = Inc. [AMD/ATI] Juniper XT [Radeon HD 5770]01:00.1 Audio device: Advanced Mi= cro Devices=2C Inc. [AMD/ATI] Juniper HDMI Audio [Radeon HD 5700 Series]02:= 00.0 SATA controller: ASMedia Technology Inc. ASM1062 Serial ATA Controller= (rev 01)03:00.0 PCI bridge: PLX Technology=2C Inc. PEX 8606 6 Lane=2C 6 Po= rt PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)04:01.0 PCI bridge: PLX Tech= nology=2C Inc. PEX 8606 6 Lane=2C 6 Port PCI Express Gen 2 (5.0 GT/s) Switc= h (rev ba)04:04.0 PCI bridge: PLX Technology=2C Inc. PEX 8606 6 Lane=2C 6 P= ort PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)04:05.0 PCI bridge: PLX Tec= hnology=2C Inc. PEX 8606 6 Lane=2C 6 Port PCI Express Gen 2 (5.0 GT/s) Swit= ch (rev ba)04:07.0 PCI bridge: PLX Technology=2C Inc. PEX 8606 6 Lane=2C 6 = Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)04:09.0 PCI bridge: PLX Te= chnology=2C Inc. PEX 8606 6 Lane=2C 6 Port PCI Express Gen 2 (5.0 GT/s) Swi= tch (rev ba)08:00.0 USB controller: Renesas Technology Corp. uPD720201 USB = 3.0 Host Controller (rev 03)09:00.0 PCI bridge: Texas Instruments XIO2213A/= B/XIO2221 PCI Express to PCI Bridge [Cheetah Express] (rev 01)0a:00.0 FireW= ire (IEEE 1394): Texas Instruments XIO2213A/B/XIO2221 IEEE-1394b OHCI Contr= oller [Cheetah Express] (rev 01)0b:00.0 Ethernet controller: Intel Corporat= ion I210 Gigabit Network Connection (rev 03) Is there any more info I can provide to see if someone has an idea about wh= y I can't get it working? I suppose someone should have more ideas now that= I tracked the issue a bit more. = --_403ae6d9-4f6e-4098-bcfc-825e22cc3fd4_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable




>=3B As I said in my original reply xen.= efi is supposed to be booted directly
>=3B from the = EFI shell=2C not via a bootloader.
>=3B
>=3B Whether or not that= is your problem I don't know=2C but that is what I
>=3B believe is su= pposed to work=2C whereas all these others are unknowns=2C so
>=3B ple= ase try that. (this is because Xen needs to be called EFI Boot
>=3B Se= rvices still available and bootloaders tend to call ExitBootServices
>= =3B before calling the kernel)

Do you have instruc= tions on how to launch it from the EFI Shell so I can test that? I know my = Motherboard has an embedded EFI Shell and I know how to boot to it=2C but t= here isn't a lot of information on how to use it.

= Checking again Gummiboot=2C Gummiboot isn't actually a true Boot Loader=2C = but a Boot Manager:
Its purpose seems to be to= not have to launch EFI executables manually via EFI Shell and instead havi= ng them consolidated in a cute menu. But just to make sure=2C I'l test it y= our way if you can tell me what commands I have to use after booting to the= EFI Shell.




Additionally=2C I have some more info:

Whil= e experimenting with BIOS settings=2C I discovered that if instead of using= as primary video device the Haswell GPU=2C I use the Radeon 5770=2C Xen ac= tually goes further. It reachs "unpacking initramfs" and hangs there. I sea= rched around a bit to find if there was any way to get more detailed logs= =2C so I modified /boot/xen-4.3.1.cfg (Xen EFI file is xen-4.3.1.efi):


[global]
default=3Dxen

[xen]
options=3Dconsole=3Dvga vga=3Dcurre= nt loglvl=3Dall noreboot
kernel=3Dvmlinuz-linux root=3DUUID=3D7af= 1797c-00af-4219-a141-27a718f39858 rw ignore_loglevel earlyprintk=3Dvga=2Cke= ep
ramdisk=3Dinitramfs-linux.img =3B


It consistently hangs while detecting PCI devices=2C = through not always on the same line. I manually wrote what is on screen one= of the times it hanged (I skipped the first bracket of every line with som= e numbers on them that appears to be seconds=2C but last line usually is ar= ound 5.0xxx):



e= 820: reserve RAM buffer [mem 0x8826e000-0x8bffffff]
e820: reserve= RAM buffer [mem 0x88b4e000-0x8bffffff]
e820: reserve RAM buffer = [mem 0x992ed000-0x9bffffff]
e820: reserve RAM buffer [mem 0x993eb= 000-0x9bffffff]
e820: reserve RAM buffer [mem 0x993eb000-0x9bffff= ff]
e820: reserve RAM buffer [mem 0x85ee00000-0x85fffffff]
<= div>NetLabel: Initializing
NetLabel:  =3Bdomain hash size =3D= 128
NetLabel:  =3Bprotocols =3D UNLABELED CIPSOv4
= NetLabel: unlabeled traffic allowed by default
Switched to clocks= ource xen
pnp: PnP ACPI: disabled
pci 0000:00:1c.4: bri= dge window [io 0x1000-0x0fff] to [bus 0c-44] add_size 1000
pci 00= 00:00:1c.4: res[13]=3D[io  =3B0x1000-0x0fff] get_res_add_size add_size = 1000
pci 0000:00:1c.4: BAR 13: assigned [io 0x1000-0x1fff]
<= div>pci 0000:00:01.0: PCI bridge to [bus 01]
pci 0000:00:01.0: &n= bsp=3Bbridge window [io  =3B0xe000-0xefff]
pci 0000:00:01.0: =  =3Bbridge window [mem 0xeee00000-0xeeefffff]
pci 0000:00:01.= 0:  =3Bbridge window [mem 0xc40000000-0xc4fffffff 64bit pref]
pci 0000:00:1c.0: PCI bridge to [bus 02]
pci 0000:00:1c.0:  = =3Bbridge window [io 0xd000-0xdfff]
pci 0000:00:1c.0:  =3Bbri= dge window [mem 0xeed00000-0xeedfffff]
pci 0000:04:01.0: PCI brid= ge to [bus 05]
pci 0000:04:04.0: PCI bridge to [bus 06]
pci 0000:04:05.0: PCI bridge to [bus 07]
pci 0000:04:07.0: PCI b= ridge to [bus 08]
pci 0000:04:07.0:  =3Bbridge window [mem 0x= eea00000-0xeeafffff]
pci 0000:09:00.0: PCI bridge to [bus 0a]
pci 0000:09:00.0:  =3Bbridge window [mem 0xee800000-0xee8fffff]<= /div>
pci 0000:04:09.0: PCI bridge to [bus 09-0a]
pci 0000:04= :09.0:  =3Bbridge window [mem 0xee800000-0xee9fffff]
pci 0000= :03:00.0: PCI bridge to [bus 04-0a]
pci 0000:03:00.0:  =3Bbri= dge window [mem 0xee800000-0xeeafffff]
pci 0000:00:1c.1: PCI brid= ge to [bus 03-04]
pci 0000:00:1c.1:  =3Bbridge window [mem 0x= ee800000-0xeebfffff]
pci 0000:00:1c.3: PCI bridge to [bus 0b]
pci 0000:00:1c.3:  =3Bbridge window [io  =3B0xc000-0xcfff]
pci 0000:00:1c.3:  =3Bbridge window [mem 0xeec00000-0xeecfffff= ]
pci 0000:00:1c.4: PCI bridge to [bus 0c-44]
pci 0000:= 00:1c.4:  =3Bbridge window [io  =3B0x1000-0x1fff]
pci 000= 0:00:1c.4:  =3Bbridge window [mem 0xd8000000-0xee0fffff]
pci = 0000:00:1c.4:  =3Bbridge window [mem 0xb0000000-0xd1ffffff 64bit pref]<= /div>
pci_bus 0000:00: resource 4 [io  =3B0x0000-0xffff]
= pci_bus 0000:00: resource 5 [mem 0x00000000-0x7fffffffff]
<= br>

Something that I paid attention is that it say= s that PnP ACPI is disabled=2C while when I boot on classic Arch Linux inst= ead of using the xen.efi=2C dmesg mentions this:

<= div>Switched to clocksource hpet
pnp: PnP ACPI init
ACP= I: bus type PNP registered

...plus around 20= -30 lines before pci and pci_bus appear. I don't know if that Xen fails to = work with ACPI may be related - I should test if my BIOS-based Xen installa= tion also doesn't work with ACPI..


= Just in case it is needed=2C this is the current output of lspci when I boo= t on classic Arch Linux instead of using the Xen-modified one:
00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v3 Pr= ocessor DRAM Controller (rev 06)
00:01.0 PCI bridge: Intel Corpor= ation Xeon E3-1200 v3/4th Gen Core Processor PCI Express x16 Controller (re= v 06)
00:02.0 Display controller: Intel Corporation Xeon E3-1200 = v3 Processor Integrated Graphics Controller (rev 06)
00:03.0 Audi= o device: Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor HD Audio= Controller (rev 06)
00:14.0 USB controller: Intel Corporation 8 = Series/C220 Series Chipset Family USB xHCI (rev 05)
00:16.0 Commu= nication controller: Intel Corporation 8 Series/C220 Series Chipset Family = MEI Controller #1 (rev 04)
00:19.0 Ethernet controller: Intel Cor= poration Ethernet Connection I217-LM (rev 05)
00:1a.0 USB control= ler: Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #2 (rev= 05)
00:1b.0 Audio device: Intel Corporation 8 Series/C220 Series= Chipset High Definition Audio Controller (rev 05)
00:1c.0 PCI br= idge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Roo= t Port #1 (rev d5)
00:1c.1 PCI bridge: Intel Corporation 8 Series= /C220 Series Chipset Family PCI Express Root Port #2 (rev d5)
00:= 1c.3 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI = Express Root Port #4 (rev d5)
00:1c.4 PCI bridge: Intel Corporati= on 8 Series/C220 Series Chipset Family PCI Express Root Port #5 (rev d5)
00:1d.0 USB controller: Intel Corporation 8 Series/C220 Series Chip= set Family USB EHCI #1 (rev 05)
00:1f.0 ISA bridge: Intel Corpora= tion C226 Series Chipset Family Server Advanced SKU LPC Controller (rev 05)=
00:1f.2 SATA controller: Intel Corporation 8 Series/C220 Series = Chipset Family 6-port SATA Controller 1 [AHCI mode] (rev 05)
00:1= f.3 SMBus: Intel Corporation 8 Series/C220 Series Chipset Family SMBus Cont= roller (rev 05)
00:1f.6 Signal processing controller: Intel Corpo= ration 8 Series Chipset Family Thermal Management Controller (rev 05)
=
01:00.0 VGA compatible controller: Advanced Micro Devices=2C Inc. [AMD= /ATI] Juniper XT [Radeon HD 5770]
01:00.1 Audio device: Advanced = Micro Devices=2C Inc. [AMD/ATI] Juniper HDMI Audio [Radeon HD 5700 Series]<= /div>
02:00.0 SATA controller: ASMedia Technology Inc. ASM1062 Serial A= TA Controller (rev 01)
03:00.0 PCI bridge: PLX Technology=2C Inc.= PEX 8606 6 Lane=2C 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
04:01.0 PCI bridge: PLX Technology=2C Inc. PEX 8606 6 Lane=2C 6 Port= PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
04:04.0 PCI bridge:= PLX Technology=2C Inc. PEX 8606 6 Lane=2C 6 Port PCI Express Gen 2 (5.0 GT= /s) Switch (rev ba)
04:05.0 PCI bridge: PLX Technology=2C Inc. PE= X 8606 6 Lane=2C 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
<= div>04:07.0 PCI bridge: PLX Technology=2C Inc. PEX 8606 6 Lane=2C 6 Port PC= I Express Gen 2 (5.0 GT/s) Switch (rev ba)
04:09.0 PCI bridge: PL= X Technology=2C Inc. PEX 8606 6 Lane=2C 6 Port PCI Express Gen 2 (5.0 GT/s)= Switch (rev ba)
08:00.0 USB controller: Renesas Technology Corp.= uPD720201 USB 3.0 Host Controller (rev 03)
09:00.0 PCI bridge: T= exas Instruments XIO2213A/B/XIO2221 PCI Express to PCI Bridge [Cheetah Expr= ess] (rev 01)
0a:00.0 FireWire (IEEE 1394): Texas Instruments XIO= 2213A/B/XIO2221 IEEE-1394b OHCI Controller [Cheetah Express] (rev 01)
=
0b:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Co= nnection (rev 03)



<= div>
Is there any more info I can provide to see if someone h= as an idea about why I can't get it working? I suppose someone should have = more ideas now that I tracked the issue a bit more.
= = --_403ae6d9-4f6e-4098-bcfc-825e22cc3fd4_-- --===============6216593211267801594== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6216593211267801594==-- From xen-users-bounces@lists.xen.org Sun Dec 22 12:30:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 12:30:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VuiA7-0003fV-La; Sun, 22 Dec 2013 12:29:39 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VsrLj-0001cN-SK for xen-users@lists.xen.org; Tue, 17 Dec 2013 09:54:00 +0000 Received: from [85.158.139.211:60964] by server-15.bemta-5.messagelabs.com id C5/C8-08490-73F10B25; Tue, 17 Dec 2013 09:53:59 +0000 X-Env-Sender: Ian.Campbell@citrix.com X-Msg-Ref: server-10.tower-206.messagelabs.com!1387274035!4996688!2 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 22823 invoked from network); 17 Dec 2013 09:53:58 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-10.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 17 Dec 2013 09:53:58 -0000 X-IronPort-AV: E=Sophos;i="4.95,500,1384300800"; d="scan'208";a="82984262" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 17 Dec 2013 09:53:55 +0000 Received: from [10.80.2.80] (10.80.2.80) by FTLPEX01CL02.citrite.net (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Tue, 17 Dec 2013 04:53:54 -0500 Message-ID: <1387274033.27441.17.camel@kazak.uk.xensource.com> From: Ian Campbell To: peter Date: Tue, 17 Dec 2013 09:53:53 +0000 In-Reply-To: References: <1387187949.20076.37.camel@kazak.uk.xensource.com> Organization: Citrix Systems, Inc. X-Mailer: Evolution 3.4.4-3 MIME-Version: 1.0 X-Originating-IP: [10.80.2.80] X-DLP: MIA2 X-Mailman-Approved-At: Sun, 22 Dec 2013 12:29:38 +0000 Cc: xen-devel@lists.xen.org Subject: Re: [Xen-users] [Xen-devel] XEN/arm XENFB support X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, 2013-12-17 at 08:20 +0100, peter wrote: Please can you avoid top posting on the -devel list. I've put -users and Lars to bcc since I think we are now well into -devel territory. > Thank you for the info/patch Ian. > With some modifications to Qemu, I managed to cross compile > qemu-system-arm with XEN support. > Based on version: 1c514a7734b7f98625a0d18d5e8ee7581f26e50c (Merge remote > branch 'perard/cpu-hotplug-port-v2' into xen-staging-master-7). > And got my Qemu backend working. > > I can see that INPUT_XEN_KBDDEV_FRONTEND is working > (d9) 6input: Xen Virtual Keyboard as /devices/virtual/input/input0 > (d9) 6input: Xen Virtual Pointer as /devices/virtual/input/input1 > > And that XEN bus is prompting for VFB > (d9) 6xenbus_probe_frontend: Device with no driver: device/vfb/0 > > But it seems that the xen-fbfront only supports PV and not PVH. (Linux > kernel 3.12-RC5) > Because the init code is returning on: > > if (!xen_pv_domain()) > return -ENODEV; > > When I comment this code out. > I do get these errors: > > [ 1698.899496] Failed to unmap pfn:5c081 rc:-2 > > (XEN) dom10 IPA 0x0000000000000000 > (XEN) P2M @ 021b8300 mfn:0x4dc18 > (XEN) 1ST[0x0] = 0x000000004da276ff > (XEN) 2ND[0x0] = 0x000000006b6856ff > (XEN) 3RD[0x0] = 0x0000000000000000 > [ 1698.933034] Failed to map pfn to mfn rc:0:-22 pfn:5c349 mfn:0 > > (XEN) dom10 IPA 0x000000002777c000 > (XEN) P2M @ 021b8300 mfn:0x4dc18 > (XEN) 1ST[0x0] = 0x000000004da276ff > (XEN) 2ND[0x13b] = 0x0000000000000000 > [ 1698.951353] Failed to map pfn to mfn rc:0:-22 pfn:5c348 mfn:b6b2777c > > Yes lots of them, and my VFB is not working tough. > > So I've searched on the internet if someone got VFB on PVH working. > But I couldn't find anything about, so is there someone who got VFB > working on PVH (x86) ? I've not heard of anyone, the focus of x86-PVH has been on getting the basic functionality going. In general PV drivers should just work but in some corner cases they need adjustments for the "autotranslate" (i.e. hardware assisted paging) case which is one of the key areas where both ARM, PVH-x86 and HVM-x86 differ from traditional PV-x86 guests. So it might be that the vfb driver requires some such adjustment, or it might be that the foreign mapping stuff is not working for you -- which would be the same issue as you are having with domain building in the other thread. Given that I think we should try and get to the bottom of the foreign mapping stuff first. Eventually it might be worth investigating http://xen.1045712.n5.nabble.com/PATCH-Add-grant-references-for-fbfront-kbdfront-td3332068.html since the fb driver didn't really ought to be using foreign mappings anyway -- it should use grant references. However those patches only cover the frontend case and the author was using something other than qemu as the backend, so there is at least some actual development work required here. Ian. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sun Dec 22 12:30:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 12:30:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VuiA8-0003fn-Qh; Sun, 22 Dec 2013 12:29:41 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VuN7J-0004Uh-9v for xen-users@lists.xen.org; Sat, 21 Dec 2013 14:01:21 +0000 Received: from [193.109.254.147:8874] by server-3.bemta-14.messagelabs.com id 12/30-11000-03F95B25; Sat, 21 Dec 2013 14:01:20 +0000 X-Env-Sender: zir_blazer@hotmail.com X-Msg-Ref: server-8.tower-27.messagelabs.com!1387634477!6875868!1 X-Originating-IP: [65.54.190.92] X-SpamReason: No, hits=1.5 required=7.0 tests=BODY_RANDOM_LONG, FORGED_HOTMAIL_RCVD,HTML_10_20,HTML_MESSAGE,ML_RADAR_SPEW_LINKS_12, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 4572 invoked from network); 21 Dec 2013 14:01:18 -0000 Received: from bay0-omc2-s17.bay0.hotmail.com (HELO bay0-omc2-s17.bay0.hotmail.com) (65.54.190.92) by server-8.tower-27.messagelabs.com with SMTP; 21 Dec 2013 14:01:18 -0000 Received: from BAY170-W127 ([65.54.190.123]) by bay0-omc2-s17.bay0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Sat, 21 Dec 2013 06:01:17 -0800 X-TMN: [YOyAPJjK8zz6x7FEkXPaf/+24Kw/eT8x7ThzurPchzw=] X-Originating-Email: [zir_blazer@hotmail.com] Message-ID: From: Zir Blazer To: Ian Campbell Date: Sat, 21 Dec 2013 11:01:16 -0300 Importance: Normal In-Reply-To: <1387356006.1025.46.camel@dagon.hellion.org.uk> References: , , <1387190962.20076.65.camel@kazak.uk.xensource.com>, , <1387356006.1025.46.camel@dagon.hellion.org.uk> MIME-Version: 1.0 X-OriginalArrivalTime: 21 Dec 2013 14:01:17.0566 (UTC) FILETIME=[1E60D1E0:01CEFE55] X-Mailman-Approved-At: Sun, 22 Dec 2013 12:29:38 +0000 Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] Xen black screens while booting in Arch Linux with UEFI GRUB X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6216593211267801594==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6216593211267801594== Content-Type: multipart/alternative; boundary="_403ae6d9-4f6e-4098-bcfc-825e22cc3fd4_" --_403ae6d9-4f6e-4098-bcfc-825e22cc3fd4_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable > As I said in my original reply xen.efi is supposed to be booted directly > from the EFI shell=2C not via a bootloader. >=20 > Whether or not that is your problem I don't know=2C but that is what I > believe is supposed to work=2C whereas all these others are unknowns=2C s= o > please try that. (this is because Xen needs to be called EFI Boot > Services still available and bootloaders tend to call ExitBootServices > before calling the kernel) Do you have instructions on how to launch it from the EFI Shell so I can te= st that? I know my Motherboard has an embedded EFI Shell and I know how to = boot to it=2C but there isn't a lot of information on how to use it. Checking again Gummiboot=2C Gummiboot isn't actually a true Boot Loader=2C = but a Boot Manager:http://freedesktop.org/wiki/Software/gummiboot/Its purpo= se seems to be to not have to launch EFI executables manually via EFI Shell= and instead having them consolidated in a cute menu. But just to make sure= =2C I'l test it your way if you can tell me what commands I have to use aft= er booting to the EFI Shell. Additionally=2C I have some more info: While experimenting with BIOS settings=2C I discovered that if instead of u= sing as primary video device the Haswell GPU=2C I use the Radeon 5770=2C Xe= n actually goes further. It reachs "unpacking initramfs" and hangs there. I= searched around a bit to find if there was any way to get more detailed lo= gs=2C so I modified /boot/xen-4.3.1.cfg (Xen EFI file is xen-4.3.1.efi): [global]default=3Dxen [xen]options=3Dconsole=3Dvga vga=3Dcurrent loglvl=3Dall norebootkernel=3Dvm= linuz-linux root=3DUUID=3D7af1797c-00af-4219-a141-27a718f39858 rw ignore_lo= glevel earlyprintk=3Dvga=2Ckeepramdisk=3Dinitramfs-linux.img=20 It consistently hangs while detecting PCI devices=2C through not always on = the same line. I manually wrote what is on screen one of the times it hange= d (I skipped the first bracket of every line with some numbers on them that= appears to be seconds=2C but last line usually is around 5.0xxx): e820: reserve RAM buffer [mem 0x8826e000-0x8bffffff]e820: reserve RAM buffe= r [mem 0x88b4e000-0x8bffffff]e820: reserve RAM buffer [mem 0x992ed000-0x9bf= fffff]e820: reserve RAM buffer [mem 0x993eb000-0x9bffffff]e820: reserve RAM= buffer [mem 0x993eb000-0x9bffffff]e820: reserve RAM buffer [mem 0x85ee0000= 0-0x85fffffff]NetLabel: InitializingNetLabel: domain hash size =3D 128NetL= abel: protocols =3D UNLABELED CIPSOv4NetLabel: unlabeled traffic allowed b= y defaultSwitched to clocksource xenpnp: PnP ACPI: disabledpci 0000:00:1c.4= : bridge window [io 0x1000-0x0fff] to [bus 0c-44] add_size 1000pci 0000:00:= 1c.4: res[13]=3D[io 0x1000-0x0fff] get_res_add_size add_size 1000pci 0000:= 00:1c.4: BAR 13: assigned [io 0x1000-0x1fff]pci 0000:00:01.0: PCI bridge to= [bus 01]pci 0000:00:01.0: bridge window [io 0xe000-0xefff]pci 0000:00:01= .0: bridge window [mem 0xeee00000-0xeeefffff]pci 0000:00:01.0: bridge win= dow [mem 0xc40000000-0xc4fffffff 64bit pref]pci 0000:00:1c.0: PCI bridge to= [bus 02]pci 0000:00:1c.0: bridge window [io 0xd000-0xdfff]pci 0000:00:1c.= 0: bridge window [mem 0xeed00000-0xeedfffff]pci 0000:04:01.0: PCI bridge t= o [bus 05]pci 0000:04:04.0: PCI bridge to [bus 06]pci 0000:04:05.0: PCI bri= dge to [bus 07]pci 0000:04:07.0: PCI bridge to [bus 08]pci 0000:04:07.0: b= ridge window [mem 0xeea00000-0xeeafffff]pci 0000:09:00.0: PCI bridge to [bu= s 0a]pci 0000:09:00.0: bridge window [mem 0xee800000-0xee8fffff]pci 0000:0= 4:09.0: PCI bridge to [bus 09-0a]pci 0000:04:09.0: bridge window [mem 0xee= 800000-0xee9fffff]pci 0000:03:00.0: PCI bridge to [bus 04-0a]pci 0000:03:00= .0: bridge window [mem 0xee800000-0xeeafffff]pci 0000:00:1c.1: PCI bridge = to [bus 03-04]pci 0000:00:1c.1: bridge window [mem 0xee800000-0xeebfffff]p= ci 0000:00:1c.3: PCI bridge to [bus 0b]pci 0000:00:1c.3: bridge window [io= 0xc000-0xcfff]pci 0000:00:1c.3: bridge window [mem 0xeec00000-0xeecfffff= ]pci 0000:00:1c.4: PCI bridge to [bus 0c-44]pci 0000:00:1c.4: bridge windo= w [io 0x1000-0x1fff]pci 0000:00:1c.4: bridge window [mem 0xd8000000-0xee0= fffff]pci 0000:00:1c.4: bridge window [mem 0xb0000000-0xd1ffffff 64bit pre= f]pci_bus 0000:00: resource 4 [io 0x0000-0xffff]pci_bus 0000:00: resource = 5 [mem 0x00000000-0x7fffffffff] Something that I paid attention is that it says that PnP ACPI is disabled= =2C while when I boot on classic Arch Linux instead of using the xen.efi=2C= dmesg mentions this: Switched to clocksource hpetpnp: PnP ACPI initACPI: bus type PNP registered ...plus around 20-30 lines before pci and pci_bus appear. I don't know if t= hat Xen fails to work with ACPI may be related - I should test if my BIOS-b= ased Xen installation also doesn't work with ACPI.. Just in case it is needed=2C this is the current output of lspci when I boo= t on classic Arch Linux instead of using the Xen-modified one: 00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v3 Processor DRAM Contr= oller (rev 06)00:01.0 PCI bridge: Intel Corporation Xeon E3-1200 v3/4th Gen= Core Processor PCI Express x16 Controller (rev 06)00:02.0 Display controll= er: Intel Corporation Xeon E3-1200 v3 Processor Integrated Graphics Control= ler (rev 06)00:03.0 Audio device: Intel Corporation Xeon E3-1200 v3/4th Gen= Core Processor HD Audio Controller (rev 06)00:14.0 USB controller: Intel C= orporation 8 Series/C220 Series Chipset Family USB xHCI (rev 05)00:16.0 Com= munication controller: Intel Corporation 8 Series/C220 Series Chipset Famil= y MEI Controller #1 (rev 04)00:19.0 Ethernet controller: Intel Corporation = Ethernet Connection I217-LM (rev 05)00:1a.0 USB controller: Intel Corporati= on 8 Series/C220 Series Chipset Family USB EHCI #2 (rev 05)00:1b.0 Audio de= vice: Intel Corporation 8 Series/C220 Series Chipset High Definition Audio = Controller (rev 05)00:1c.0 PCI bridge: Intel Corporation 8 Series/C220 Seri= es Chipset Family PCI Express Root Port #1 (rev d5)00:1c.1 PCI bridge: Inte= l Corporation 8 Series/C220 Series Chipset Family PCI Express Root Port #2 = (rev d5)00:1c.3 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset = Family PCI Express Root Port #4 (rev d5)00:1c.4 PCI bridge: Intel Corporati= on 8 Series/C220 Series Chipset Family PCI Express Root Port #5 (rev d5)00:= 1d.0 USB controller: Intel Corporation 8 Series/C220 Series Chipset Family = USB EHCI #1 (rev 05)00:1f.0 ISA bridge: Intel Corporation C226 Series Chips= et Family Server Advanced SKU LPC Controller (rev 05)00:1f.2 SATA controlle= r: Intel Corporation 8 Series/C220 Series Chipset Family 6-port SATA Contro= ller 1 [AHCI mode] (rev 05)00:1f.3 SMBus: Intel Corporation 8 Series/C220 S= eries Chipset Family SMBus Controller (rev 05)00:1f.6 Signal processing con= troller: Intel Corporation 8 Series Chipset Family Thermal Management Contr= oller (rev 05)01:00.0 VGA compatible controller: Advanced Micro Devices=2C = Inc. [AMD/ATI] Juniper XT [Radeon HD 5770]01:00.1 Audio device: Advanced Mi= cro Devices=2C Inc. [AMD/ATI] Juniper HDMI Audio [Radeon HD 5700 Series]02:= 00.0 SATA controller: ASMedia Technology Inc. ASM1062 Serial ATA Controller= (rev 01)03:00.0 PCI bridge: PLX Technology=2C Inc. PEX 8606 6 Lane=2C 6 Po= rt PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)04:01.0 PCI bridge: PLX Tech= nology=2C Inc. PEX 8606 6 Lane=2C 6 Port PCI Express Gen 2 (5.0 GT/s) Switc= h (rev ba)04:04.0 PCI bridge: PLX Technology=2C Inc. PEX 8606 6 Lane=2C 6 P= ort PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)04:05.0 PCI bridge: PLX Tec= hnology=2C Inc. PEX 8606 6 Lane=2C 6 Port PCI Express Gen 2 (5.0 GT/s) Swit= ch (rev ba)04:07.0 PCI bridge: PLX Technology=2C Inc. PEX 8606 6 Lane=2C 6 = Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)04:09.0 PCI bridge: PLX Te= chnology=2C Inc. PEX 8606 6 Lane=2C 6 Port PCI Express Gen 2 (5.0 GT/s) Swi= tch (rev ba)08:00.0 USB controller: Renesas Technology Corp. uPD720201 USB = 3.0 Host Controller (rev 03)09:00.0 PCI bridge: Texas Instruments XIO2213A/= B/XIO2221 PCI Express to PCI Bridge [Cheetah Express] (rev 01)0a:00.0 FireW= ire (IEEE 1394): Texas Instruments XIO2213A/B/XIO2221 IEEE-1394b OHCI Contr= oller [Cheetah Express] (rev 01)0b:00.0 Ethernet controller: Intel Corporat= ion I210 Gigabit Network Connection (rev 03) Is there any more info I can provide to see if someone has an idea about wh= y I can't get it working? I suppose someone should have more ideas now that= I tracked the issue a bit more. = --_403ae6d9-4f6e-4098-bcfc-825e22cc3fd4_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable




>=3B As I said in my original reply xen.= efi is supposed to be booted directly
>=3B from the = EFI shell=2C not via a bootloader.
>=3B
>=3B Whether or not that= is your problem I don't know=2C but that is what I
>=3B believe is su= pposed to work=2C whereas all these others are unknowns=2C so
>=3B ple= ase try that. (this is because Xen needs to be called EFI Boot
>=3B Se= rvices still available and bootloaders tend to call ExitBootServices
>= =3B before calling the kernel)

Do you have instruc= tions on how to launch it from the EFI Shell so I can test that? I know my = Motherboard has an embedded EFI Shell and I know how to boot to it=2C but t= here isn't a lot of information on how to use it.

= Checking again Gummiboot=2C Gummiboot isn't actually a true Boot Loader=2C = but a Boot Manager:
Its purpose seems to be to= not have to launch EFI executables manually via EFI Shell and instead havi= ng them consolidated in a cute menu. But just to make sure=2C I'l test it y= our way if you can tell me what commands I have to use after booting to the= EFI Shell.




Additionally=2C I have some more info:

Whil= e experimenting with BIOS settings=2C I discovered that if instead of using= as primary video device the Haswell GPU=2C I use the Radeon 5770=2C Xen ac= tually goes further. It reachs "unpacking initramfs" and hangs there. I sea= rched around a bit to find if there was any way to get more detailed logs= =2C so I modified /boot/xen-4.3.1.cfg (Xen EFI file is xen-4.3.1.efi):


[global]
default=3Dxen

[xen]
options=3Dconsole=3Dvga vga=3Dcurre= nt loglvl=3Dall noreboot
kernel=3Dvmlinuz-linux root=3DUUID=3D7af= 1797c-00af-4219-a141-27a718f39858 rw ignore_loglevel earlyprintk=3Dvga=2Cke= ep
ramdisk=3Dinitramfs-linux.img =3B


It consistently hangs while detecting PCI devices=2C = through not always on the same line. I manually wrote what is on screen one= of the times it hanged (I skipped the first bracket of every line with som= e numbers on them that appears to be seconds=2C but last line usually is ar= ound 5.0xxx):



e= 820: reserve RAM buffer [mem 0x8826e000-0x8bffffff]
e820: reserve= RAM buffer [mem 0x88b4e000-0x8bffffff]
e820: reserve RAM buffer = [mem 0x992ed000-0x9bffffff]
e820: reserve RAM buffer [mem 0x993eb= 000-0x9bffffff]
e820: reserve RAM buffer [mem 0x993eb000-0x9bffff= ff]
e820: reserve RAM buffer [mem 0x85ee00000-0x85fffffff]
<= div>NetLabel: Initializing
NetLabel:  =3Bdomain hash size =3D= 128
NetLabel:  =3Bprotocols =3D UNLABELED CIPSOv4
= NetLabel: unlabeled traffic allowed by default
Switched to clocks= ource xen
pnp: PnP ACPI: disabled
pci 0000:00:1c.4: bri= dge window [io 0x1000-0x0fff] to [bus 0c-44] add_size 1000
pci 00= 00:00:1c.4: res[13]=3D[io  =3B0x1000-0x0fff] get_res_add_size add_size = 1000
pci 0000:00:1c.4: BAR 13: assigned [io 0x1000-0x1fff]
<= div>pci 0000:00:01.0: PCI bridge to [bus 01]
pci 0000:00:01.0: &n= bsp=3Bbridge window [io  =3B0xe000-0xefff]
pci 0000:00:01.0: =  =3Bbridge window [mem 0xeee00000-0xeeefffff]
pci 0000:00:01.= 0:  =3Bbridge window [mem 0xc40000000-0xc4fffffff 64bit pref]
pci 0000:00:1c.0: PCI bridge to [bus 02]
pci 0000:00:1c.0:  = =3Bbridge window [io 0xd000-0xdfff]
pci 0000:00:1c.0:  =3Bbri= dge window [mem 0xeed00000-0xeedfffff]
pci 0000:04:01.0: PCI brid= ge to [bus 05]
pci 0000:04:04.0: PCI bridge to [bus 06]
pci 0000:04:05.0: PCI bridge to [bus 07]
pci 0000:04:07.0: PCI b= ridge to [bus 08]
pci 0000:04:07.0:  =3Bbridge window [mem 0x= eea00000-0xeeafffff]
pci 0000:09:00.0: PCI bridge to [bus 0a]
pci 0000:09:00.0:  =3Bbridge window [mem 0xee800000-0xee8fffff]<= /div>
pci 0000:04:09.0: PCI bridge to [bus 09-0a]
pci 0000:04= :09.0:  =3Bbridge window [mem 0xee800000-0xee9fffff]
pci 0000= :03:00.0: PCI bridge to [bus 04-0a]
pci 0000:03:00.0:  =3Bbri= dge window [mem 0xee800000-0xeeafffff]
pci 0000:00:1c.1: PCI brid= ge to [bus 03-04]
pci 0000:00:1c.1:  =3Bbridge window [mem 0x= ee800000-0xeebfffff]
pci 0000:00:1c.3: PCI bridge to [bus 0b]
pci 0000:00:1c.3:  =3Bbridge window [io  =3B0xc000-0xcfff]
pci 0000:00:1c.3:  =3Bbridge window [mem 0xeec00000-0xeecfffff= ]
pci 0000:00:1c.4: PCI bridge to [bus 0c-44]
pci 0000:= 00:1c.4:  =3Bbridge window [io  =3B0x1000-0x1fff]
pci 000= 0:00:1c.4:  =3Bbridge window [mem 0xd8000000-0xee0fffff]
pci = 0000:00:1c.4:  =3Bbridge window [mem 0xb0000000-0xd1ffffff 64bit pref]<= /div>
pci_bus 0000:00: resource 4 [io  =3B0x0000-0xffff]
= pci_bus 0000:00: resource 5 [mem 0x00000000-0x7fffffffff]
<= br>

Something that I paid attention is that it say= s that PnP ACPI is disabled=2C while when I boot on classic Arch Linux inst= ead of using the xen.efi=2C dmesg mentions this:

<= div>Switched to clocksource hpet
pnp: PnP ACPI init
ACP= I: bus type PNP registered

...plus around 20= -30 lines before pci and pci_bus appear. I don't know if that Xen fails to = work with ACPI may be related - I should test if my BIOS-based Xen installa= tion also doesn't work with ACPI..


= Just in case it is needed=2C this is the current output of lspci when I boo= t on classic Arch Linux instead of using the Xen-modified one:
00:00.0 Host bridge: Intel Corporation Xeon E3-1200 v3 Pr= ocessor DRAM Controller (rev 06)
00:01.0 PCI bridge: Intel Corpor= ation Xeon E3-1200 v3/4th Gen Core Processor PCI Express x16 Controller (re= v 06)
00:02.0 Display controller: Intel Corporation Xeon E3-1200 = v3 Processor Integrated Graphics Controller (rev 06)
00:03.0 Audi= o device: Intel Corporation Xeon E3-1200 v3/4th Gen Core Processor HD Audio= Controller (rev 06)
00:14.0 USB controller: Intel Corporation 8 = Series/C220 Series Chipset Family USB xHCI (rev 05)
00:16.0 Commu= nication controller: Intel Corporation 8 Series/C220 Series Chipset Family = MEI Controller #1 (rev 04)
00:19.0 Ethernet controller: Intel Cor= poration Ethernet Connection I217-LM (rev 05)
00:1a.0 USB control= ler: Intel Corporation 8 Series/C220 Series Chipset Family USB EHCI #2 (rev= 05)
00:1b.0 Audio device: Intel Corporation 8 Series/C220 Series= Chipset High Definition Audio Controller (rev 05)
00:1c.0 PCI br= idge: Intel Corporation 8 Series/C220 Series Chipset Family PCI Express Roo= t Port #1 (rev d5)
00:1c.1 PCI bridge: Intel Corporation 8 Series= /C220 Series Chipset Family PCI Express Root Port #2 (rev d5)
00:= 1c.3 PCI bridge: Intel Corporation 8 Series/C220 Series Chipset Family PCI = Express Root Port #4 (rev d5)
00:1c.4 PCI bridge: Intel Corporati= on 8 Series/C220 Series Chipset Family PCI Express Root Port #5 (rev d5)
00:1d.0 USB controller: Intel Corporation 8 Series/C220 Series Chip= set Family USB EHCI #1 (rev 05)
00:1f.0 ISA bridge: Intel Corpora= tion C226 Series Chipset Family Server Advanced SKU LPC Controller (rev 05)=
00:1f.2 SATA controller: Intel Corporation 8 Series/C220 Series = Chipset Family 6-port SATA Controller 1 [AHCI mode] (rev 05)
00:1= f.3 SMBus: Intel Corporation 8 Series/C220 Series Chipset Family SMBus Cont= roller (rev 05)
00:1f.6 Signal processing controller: Intel Corpo= ration 8 Series Chipset Family Thermal Management Controller (rev 05)
=
01:00.0 VGA compatible controller: Advanced Micro Devices=2C Inc. [AMD= /ATI] Juniper XT [Radeon HD 5770]
01:00.1 Audio device: Advanced = Micro Devices=2C Inc. [AMD/ATI] Juniper HDMI Audio [Radeon HD 5700 Series]<= /div>
02:00.0 SATA controller: ASMedia Technology Inc. ASM1062 Serial A= TA Controller (rev 01)
03:00.0 PCI bridge: PLX Technology=2C Inc.= PEX 8606 6 Lane=2C 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
04:01.0 PCI bridge: PLX Technology=2C Inc. PEX 8606 6 Lane=2C 6 Port= PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
04:04.0 PCI bridge:= PLX Technology=2C Inc. PEX 8606 6 Lane=2C 6 Port PCI Express Gen 2 (5.0 GT= /s) Switch (rev ba)
04:05.0 PCI bridge: PLX Technology=2C Inc. PE= X 8606 6 Lane=2C 6 Port PCI Express Gen 2 (5.0 GT/s) Switch (rev ba)
<= div>04:07.0 PCI bridge: PLX Technology=2C Inc. PEX 8606 6 Lane=2C 6 Port PC= I Express Gen 2 (5.0 GT/s) Switch (rev ba)
04:09.0 PCI bridge: PL= X Technology=2C Inc. PEX 8606 6 Lane=2C 6 Port PCI Express Gen 2 (5.0 GT/s)= Switch (rev ba)
08:00.0 USB controller: Renesas Technology Corp.= uPD720201 USB 3.0 Host Controller (rev 03)
09:00.0 PCI bridge: T= exas Instruments XIO2213A/B/XIO2221 PCI Express to PCI Bridge [Cheetah Expr= ess] (rev 01)
0a:00.0 FireWire (IEEE 1394): Texas Instruments XIO= 2213A/B/XIO2221 IEEE-1394b OHCI Controller [Cheetah Express] (rev 01)
=
0b:00.0 Ethernet controller: Intel Corporation I210 Gigabit Network Co= nnection (rev 03)



<= div>
Is there any more info I can provide to see if someone h= as an idea about why I can't get it working? I suppose someone should have = more ideas now that I tracked the issue a bit more.
= = --_403ae6d9-4f6e-4098-bcfc-825e22cc3fd4_-- --===============6216593211267801594== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6216593211267801594==-- From xen-users-bounces@lists.xen.org Sun Dec 22 12:30:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 12:30:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VuiA8-0003fe-79; Sun, 22 Dec 2013 12:29:40 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtBA8-0000Sx-Kn for xen-users@lists.xen.org; Wed, 18 Dec 2013 07:03:21 +0000 Received: from [193.109.254.147:27545] by server-6.bemta-14.messagelabs.com id 67/3A-14958-7B841B25; Wed, 18 Dec 2013 07:03:19 +0000 X-Env-Sender: zir_blazer@hotmail.com X-Msg-Ref: server-10.tower-27.messagelabs.com!1387350197!6030345!1 X-Originating-IP: [65.54.190.89] X-SpamReason: No, hits=1.5 required=7.0 tests=BODY_RANDOM_LONG, FORGED_HOTMAIL_RCVD,HTML_10_20,HTML_MESSAGE,ML_RADAR_SPEW_LINKS_12, ML_RADAR_SPEW_LINKS_14,ML_RADAR_SPEW_LINKS_2,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 7594 invoked from network); 18 Dec 2013 07:03:17 -0000 Received: from bay0-omc2-s14.bay0.hotmail.com (HELO bay0-omc2-s14.bay0.hotmail.com) (65.54.190.89) by server-10.tower-27.messagelabs.com with SMTP; 18 Dec 2013 07:03:17 -0000 Received: from BAY170-W11 ([65.54.190.123]) by bay0-omc2-s14.bay0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Tue, 17 Dec 2013 23:03:16 -0800 X-TMN: [MyQKezzg2pXx0EW07T5I7h/pwhUq/Ad+vI6aUHwtVhY=] X-Originating-Email: [zir_blazer@hotmail.com] Message-ID: From: Zir Blazer To: Ian Campbell Date: Wed, 18 Dec 2013 04:03:16 -0300 Importance: Normal In-Reply-To: <1387190962.20076.65.camel@kazak.uk.xensource.com> References: , <1387190962.20076.65.camel@kazak.uk.xensource.com> MIME-Version: 1.0 X-OriginalArrivalTime: 18 Dec 2013 07:03:16.0679 (UTC) FILETIME=[39C3ED70:01CEFBBF] X-Mailman-Approved-At: Sun, 22 Dec 2013 12:29:38 +0000 Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] Xen black screens while booting in Arch Linux with UEFI GRUB X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============5234338703307830304==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============5234338703307830304== Content-Type: multipart/alternative; boundary="_e2fec9a9-43c6-440f-ab94-36ea4c4f64be_" --_e2fec9a9-43c6-440f-ab94-36ea4c4f64be_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable > On Sat=2C 2013-12-14 at 03:49 -0300=2C Zir Blazer wrote: > > Basically=2C the issue I have goes like this: After installing Arch > > Linux in UEFI mode=2C I install Xen on top of it following Arch Linux > > wiki instructions for Xen. GRUB allows me to choose to load Xen Arch=2C >=20 > I don't know if this is related but AFAIK Xen does not currently support > being launched under UEFI via a bootloader. >=20 > Instead xen.efi is a UEFI application which can be launched from the EFI > shell directly (i.e. instead of grub.efi). >=20 > http://xenbits.xen.org/docs/4.3-testing/misc/efi.html has some details > of the config file used here. >=20 > People are working on launching Xen via bootloaders under UEFI but I > don't think it is complete/available yet in any released (or unreleased > ror that matter) version of Xen. There was a guy that posted recently a guide of how to build the xen.efi fi= le on Arch Linux Forums=2C here:https://bbs.archlinux.org/viewtopic.php?id= =3D174226 I followed his instructions modifying binutils for x86_64-pep support=2C an= d also when building Xen=2C I uncommented a PKGBUILD line that was for a Ra= deon passthrough patch. It builded sucessfully and I got my hands on the xe= n-4.3.1.efi file=2C that I tried to use with Gummiboot=2C but it also faile= d to boot.=20 So far=2C I tested the following combinations: GRUB UEFI-GPT: Black screens after either "Dom0 detected maximum 4 vCPUs" (= It should be 8=2C not 4)=2C or "Scrubbing RAM" if I modify /etc/xen/grub.co= nf to add a limit to Dom0 visible RAM to make a new grub.cfg. After choosin= g it from the boot menu=2C by default it uses what looks like a DOS VGA 640= x480 mode. Arch Linux manages to boot fine.Syslinux UEFI-GPT: Crashes as so= on as I choose Xen from the menu - doesn't even says that it loaded the ima= ges or made the RAMDisk. Arch Linux manages to boot fine with this one=2C t= oo.Gummiboot UEFI-GPT + EFI file: Goes a bit further than with GRUB=2C but = ultimately fails. It detects 8 vCPUs=2C and throws in 4 more lines than whe= n I try to boot with GRUB (Too fast to look what they say). By default it u= ses some text-based video mode with very large letters that looks quite bad= when compared to VGA 640x480. Arch Linux also works fine when booted from = Gummiboot. Due to the fact that I tested three different Boot Loaders on the same base= Arch Linux installation and touched a lot of things trying to make Xen wor= k=2C there are chances that I screwed something in the process (This includ= es some obscure BIOS setting=2C for that matter). So maybe the last combina= tion COULD work if I do it with a fresh install=2C as this is supposed to b= e the proper way to do it and there is already a guy claiming sucess doing = this. However=2C I would love to know if there is anything else that I coul= d test before starting from scratch again=2C as there seems to be too many = variables involved and I need a miracle to hit all the correct ones at the = same time. I have been ramming my head to the wall for the last two weeks a= nd I feel tired already of trying tons of things to no avail. Additionally=2C this is what it worked for me: Syslinux BIOS-GPT: This is the only one I managed to get working=2C also bu= ilding xen with the Radeon patch uncommented in PKGBUILD. At the moment=2C = I'm running a sort of hybrid combination=2C as Syslinux wrote on the HD MBR= to make booteable the partition where that Arch Linux + Xen installation i= s located=2C yet I can also choose from the BIOS to launch Gummiboot and fr= om it=2C boot to my everyday Arch Linux installation. Albeit it seems that Xen plays nice in this fashion=2C I *STILL* didn't man= aged to get my Radeon 5770 passthroughed properly (I think I should leave t= his for another mail with a proper topic=2C but...). Steps I did: - Connecting second VGA Monitor on the Radeon DVI-I port with a DVI-I to VG= A adapter. Should work=2C it used to do so in my old computer with Windows = XP.- I used xl pci-assignable-add to hide the Radeon from Xen=2C but my lat= er test had them included in /boot/syslinux/syslinux.cfg. Xen option looks = like this: LABEL xen MENU LABEL Xen KERNEL mboot.c32 APPEND ../xen-4.3.1.gz -= -- ../vmlinuz-linux console=3Dtty0 root=3D/dev/sda5 rw xen-pciback.hide=3D(= 01:00.0)(01:00.1) --- ../initramfs-linux.img - Making sure both devices (GPU and HDMI sound device) appears when using x= l pci-assignable-list. - Making sure the VM .cfg file is correctly set with these devices. VM's .c= fg is this: name =3D "wxpmain"kernel =3D "/usr/lib/xen/boot/hvmloader"builder =3D 'hvm'= memory =3D 1536boot =3D "c"vcpus =3D 4vif =3D ['bridge=3Dxenbr0']device_mod= el =3D 'qemu-xen-traditional'serial =3D 'pty'pae =3D 1acpi =3D 1apic =3D 1d= isk =3D ['file:/root/wxp_sp3.img=2Chda=2Cw']opengl =3D 1sdl =3D 0vnc =3D 1v= nclisten =3D ""vncpasswd =3D ""stdvga =3D 0gfx_passthru =3D 0pci =3D ['01:0= 0.0'=2C'01:00.1'] Its using less than 2 GB of RAM just to make sure that I'm not hitting the = old 2 GB memory wall bug when using VGA passthrough=2C and qemu-xen-traditi= onal instead of qemu-dm because I heared that last qemu-vm version had issu= es with VGA passthrough=2C too.I'm using a IMG disk image=2C not a LVM part= ition this time.I NEVER managed to get it working with gfx_passthru =3D 1 b= ecause xl create throws libxl errors and doesn't creates the VM. - Create the VM using xl create=2C and accessing it using vncviewer. Also t= ested a bit with sdl =3D 1.- Windows XP was installed without the devices p= assed to it=2C I think I also did the installation with the Cirrus Logic VG= A (stdvga =3D 0). I installed the GPLVM Drivers too=2C before stopping and = recreate the VM to pass the Radeon. When I create the VM with the Radeon in= cluded=2C it also complains that it detects a "xen pci device #0" that it d= oesn't have Drivers for=2C through by googling a bit seems to be normal beh= aviator.- After installing Catalyst=2C testing both full CCC or Driver-only= =2C I didn't managed to get it working properly. Usually=2C it sees the Rad= eon 5770 with a yellow exclamation mark and says it throws a Code 12 error = in Device Manager (Not enough resources). I googled the error=2C supposedly= a possible solution was using qemu-xen-traditional as I am doing (Heck=2C = you Ian=2C and Gordan too=2C appear on pretty much all of those Mailing Lis= t Threads!).- I tried with both Cirrus Logic and Standard VGA. If I disable= Cirrus Logic from Safe Mode and reboot to force Windows to use the Radeon= =2C it takes around one or two minutes after the WXP splash screen for the = Monitor to finally turns on instead of being in standby=2C but it displays = yet another black screen=2C and on vncviewer I see a BSOD complaining about= a file of ATI Drivers (ati2dvag if I recall correctly) some seconds after = the Monitor turns on. Monitor never display neither image or garbage=2C its= just a black screen.- Due to the Radeon issue when rebooting VMs due to no= Soft Device Reset or something like that=2C I tried rebooting the computer= everytime I was going to create the VM to test if it worked or not. Actual= ly=2C the Monitor stays turned on with a black screen after each failed try= until I reboot the machine=2C which I suppose that is the lack of Soft Dev= ice Reset in action.- There was only ONE time I actually saw an image on th= e Monitor connected to the Radeon=2C and it was the first time I tried Xen = with Syslinux BIOS-GPT before messing with Xen and UEFI two weeks ago. It d= isplayed a screen where white pixel lines were filling in=2C like what it u= sually does with vncviewer or SDL when the VM changes its VGA mode (Like wh= en it goes from DOS like boot to Windows loading screen). Crashed after doi= ng that if I recall correctly=2C and couldn't reproduce it again. > (BTW=2C you didn't say what version of Xen you are using=2C not too relev= ant > this time=2C but please remember next time). Its 4.3.1-2. I actually mentioned it in previous mail=2C but you probabily = missed it due to my amazing wall of text :D Thanks for reading. = --_e2fec9a9-43c6-440f-ab94-36ea4c4f64be_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
>=3B On Sat=2C 2013-12-14 at 03:49 -0300=2C Zir Blazer wrote:
>=3B >=3B Basically=2C the issue I have goes like thi= s: After installing Arch
>=3B >=3B Linux in UEFI mode=2C I install X= en on top of it following Arch Linux
>=3B >=3B wiki instructions for= Xen. GRUB allows me to choose to load Xen Arch=2C
>=3B
>=3B I d= on't know if this is related but AFAIK Xen does not currently support
&g= t=3B being launched under UEFI via a bootloader.
>=3B
>=3B Inste= ad xen.efi is a UEFI application which can be launched from the EFI
>= =3B shell directly (i.e. instead of grub.efi).
>=3B
>=3B http://= xenbits.xen.org/docs/4.3-testing/misc/efi.html has some details
>=3B o= f the config file used here.
>=3B
>=3B People are working on lau= nching Xen via bootloaders under UEFI but I
>=3B don't think it is com= plete/available yet in any released (or unreleased
>=3B ror that matte= r) version of Xen.

There was a guy that posted recently a guide of h= ow to build the xen.efi file on Arch Linux Forums=2C here:

I followed his instructions modifying binutils for x86_64-pep suppor= t=2C and also when building Xen=2C I uncommented a PKGBUILD line that was f= or a Radeon passthrough patch. It builded sucessfully and I got my hands on= the xen-4.3.1.efi file=2C that I tried to use with Gummiboot=2C but it als= o failed to boot. =3B

So far=2C I tested the f= ollowing combinations:

GRUB UEFI-GPT: Black screen= s after either "Dom0 detected maximum 4 vCPUs" (It should be 8=2C not 4)=2C= or "Scrubbing RAM" if I modify /etc/xen/grub.conf to add a limit to Dom0 v= isible RAM to make a new grub.cfg. After choosing it from the boot menu=2C = by default it uses what looks like a DOS VGA 640x480 mode. Arch Linux manag= es to boot fine.
Syslinux UEFI-GPT: Crashes as soon as I choose X= en from the menu - doesn't even says that it loaded the images or made the = RAMDisk. Arch Linux manages to boot fine with this one=2C too.
Gu= mmiboot UEFI-GPT + EFI file: Goes a bit further than with GRUB=2C but ultim= ately fails. It detects 8 vCPUs=2C and throws in 4 more lines than when I t= ry to boot with GRUB (Too fast to look what they say). By default it uses s= ome text-based video mode with very large letters that looks quite bad when= compared to VGA 640x480. Arch Linux also works fine when booted from Gummi= boot.

Due to the fact that I tested three differen= t Boot Loaders on the same base Arch Linux installation and touched a lot o= f things trying to make Xen work=2C there are chances that I screwed someth= ing in the process (This includes some obscure BIOS setting=2C for that mat= ter). So maybe the last combination COULD work if I do it with a fresh inst= all=2C as this is supposed to be the proper way to do it and there is alrea= dy a guy claiming sucess doing this. However=2C I would love to know if the= re is anything else that I could test before starting from scratch again=2C= as there seems to be too many variables involved and I need a miracle to h= it all the correct ones at the same time. I have been ramming my head to th= e wall for the last two weeks and I feel tired already of trying tons of th= ings to no avail.


Additionally=2C t= his is what it worked for me:

Syslinux BIOS-GPT: T= his is the only one I managed to get working=2C also building xen with the = Radeon patch uncommented in PKGBUILD. At the moment=2C I'm running a sort o= f hybrid combination=2C as Syslinux wrote on the HD MBR to make booteable t= he partition where that Arch Linux + Xen installation is located=2C yet I c= an also choose from the BIOS to launch Gummiboot and from it=2C boot to my = everyday Arch Linux installation.


A= lbeit it seems that Xen plays nice in this fashion=2C I *STILL* didn't mana= ged to get my Radeon 5770 passthroughed properly (I think I should leave th= is for another mail with a proper topic=2C but...). =3BSteps I did:

- Connectin= g second VGA Monitor on the Radeon DVI-I port with a DVI-I to VGA adapter. = Should work=2C it used to do so in my old computer with Windows XP.
- I used xl pci-assignable-add to hide the Radeon from Xen=2C but my lat= er test had them included in /boot/syslinux/syslinux.cfg. Xen option looks = like this:

LABEL xen
 =3B  = =3B MENU LABEL Xen
 =3B  =3B KERNEL mboot.c32
&= nbsp=3B  =3B APPEND ../xen-4.3.1.gz --- ../vmlinuz-linux console=3Dtty0= root=3D/dev/sda5 rw xen-pciback.hide=3D(01:00.0)(01:00.1) --- ../initramfs= -linux.img

- Making sure both devices (GPU a= nd HDMI sound device) appears when using xl pci-assignable-list.
- Makin= g sure the VM .cfg file is correctly set with these devices. VM's .cfg is t= his:

name =3D "wxpmain"
kernel =3D = "/usr/lib/xen/boot/hvmloader"
builder =3D 'hvm'
memory = =3D 1536
boot =3D "c"
vcpus =3D 4
vif =3D ['b= ridge=3Dxenbr0']
device_model =3D 'qemu-xen-traditional'
serial =3D 'pty'
pae =3D 1
acpi =3D 1
apic = =3D 1
disk =3D ['file:/root/wxp_sp3.img=2Chda=2Cw']
ope= ngl =3D 1
sdl =3D 0
vnc =3D 1
vnclisten =3D "= "
vncpasswd =3D ""
stdvga =3D 0
gfx_passthru = =3D 0
pci =3D ['01:00.0'=2C'01:00.1']

It= s using less than 2 GB of RAM just to make sure that I'm not hitting the ol= d 2 GB memory wall bug when using VGA passthrough=2C and qemu-xen-tradition= al instead of qemu-dm because I heared that last qemu-vm version had issues= with VGA passthrough=2C too.
I'm using a IMG disk image=2C not a= LVM partition this time.
I NEVER managed to get it working with&= nbsp=3Bgfx_passthru =3D 1 because xl cre= ate throws libxl errors and doesn't creates the VM.

- Create the VM using xl create=2C and accessing it using vncviewer. Al= so tested a bit with sdl =3D 1.
- Windows XP was installed withou= t the devices passed to it=2C I think I also did the installation with the = Cirrus Logic VGA (stdvga =3D 0). I installed the GPLVM Drivers too=2C befor= e stopping and recreate the VM to pass the Radeon. When I create the VM wit= h the Radeon included=2C it also complains that it detects a "xen pci devic= e #0" that it doesn't have Drivers for=2C through by googling a bit seems t= o be normal behaviator.
- After installing Catalyst=2C testing bo= th full CCC or Driver-only=2C I didn't managed to get it working properly. = Usually=2C it sees the Radeon 5770 with a yellow exclamation mark and says = it throws a Code 12 error in Device Manager (Not enough resources). I googl= ed the error=2C supposedly a possible solution was using qemu-xen-tradition= al as I am doing (Heck=2C you Ian=2C and Gordan too=2C appear on pretty muc= h all of those Mailing List Threads!).
- I tried with both Cirrus= Logic and Standard VGA. If I disable Cirrus Logic from Safe Mode and reboo= t to force Windows to use the Radeon=2C it takes around one or two minutes = after the WXP splash screen for the Monitor to finally turns on instead of = being in standby=2C but it displays yet another black screen=2C and on vncv= iewer I see a BSOD complaining about a file of ATI Drivers =3B(ati2dvag if I recall correctly) =3Bsome seconds after the Monitor turns on. M= onitor never display neither image or garbage=2C its just a black screen.
- Due to the Radeon issue when rebooting VMs due to no Soft= Device Reset or something like that=2C I tried rebooting the computer ever= ytime I was going to create the VM to test if it worked or not. Actually=2C= the Monitor stays turned on with a black screen after each failed try unti= l I reboot the machine=2C which I suppose that is the lack of Soft Device R= eset in action.
- There was only ONE time I actually saw an image= on the Monitor connected to the Radeon=2C and it was the first time I trie= d Xen with Syslinux BIOS-GPT before messing with Xen and UEFI two weeks ago= . It displayed a screen where white pixel lines were filling in=2C like wha= t it usually does with vncviewer or SDL when the VM changes its VGA mode (L= ike when it goes from DOS like boot to Windows loading screen). Crashed aft= er doing that if I recall correctly=2C and couldn't reproduce it again.
=


>=3B (BTW=2C you didn't say what version of Xen you are using= =2C not too relevant
>=3B this time=2C but please remember next time).=

Its 4.3.1-2. I actually mentioned it in previ= ous mail=2C but you probabily missed it due to my amazing wall of text :D


Thanks for reading.
=
= --_e2fec9a9-43c6-440f-ab94-36ea4c4f64be_-- --===============5234338703307830304== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============5234338703307830304==-- From xen-users-bounces@lists.xen.org Sun Dec 22 12:30:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 12:30:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VuiA8-0003fe-79; Sun, 22 Dec 2013 12:29:40 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VtBA8-0000Sx-Kn for xen-users@lists.xen.org; Wed, 18 Dec 2013 07:03:21 +0000 Received: from [193.109.254.147:27545] by server-6.bemta-14.messagelabs.com id 67/3A-14958-7B841B25; Wed, 18 Dec 2013 07:03:19 +0000 X-Env-Sender: zir_blazer@hotmail.com X-Msg-Ref: server-10.tower-27.messagelabs.com!1387350197!6030345!1 X-Originating-IP: [65.54.190.89] X-SpamReason: No, hits=1.5 required=7.0 tests=BODY_RANDOM_LONG, FORGED_HOTMAIL_RCVD,HTML_10_20,HTML_MESSAGE,ML_RADAR_SPEW_LINKS_12, ML_RADAR_SPEW_LINKS_14,ML_RADAR_SPEW_LINKS_2,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 7594 invoked from network); 18 Dec 2013 07:03:17 -0000 Received: from bay0-omc2-s14.bay0.hotmail.com (HELO bay0-omc2-s14.bay0.hotmail.com) (65.54.190.89) by server-10.tower-27.messagelabs.com with SMTP; 18 Dec 2013 07:03:17 -0000 Received: from BAY170-W11 ([65.54.190.123]) by bay0-omc2-s14.bay0.hotmail.com with Microsoft SMTPSVC(6.0.3790.4675); Tue, 17 Dec 2013 23:03:16 -0800 X-TMN: [MyQKezzg2pXx0EW07T5I7h/pwhUq/Ad+vI6aUHwtVhY=] X-Originating-Email: [zir_blazer@hotmail.com] Message-ID: From: Zir Blazer To: Ian Campbell Date: Wed, 18 Dec 2013 04:03:16 -0300 Importance: Normal In-Reply-To: <1387190962.20076.65.camel@kazak.uk.xensource.com> References: , <1387190962.20076.65.camel@kazak.uk.xensource.com> MIME-Version: 1.0 X-OriginalArrivalTime: 18 Dec 2013 07:03:16.0679 (UTC) FILETIME=[39C3ED70:01CEFBBF] X-Mailman-Approved-At: Sun, 22 Dec 2013 12:29:38 +0000 Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] Xen black screens while booting in Arch Linux with UEFI GRUB X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============5234338703307830304==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============5234338703307830304== Content-Type: multipart/alternative; boundary="_e2fec9a9-43c6-440f-ab94-36ea4c4f64be_" --_e2fec9a9-43c6-440f-ab94-36ea4c4f64be_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable > On Sat=2C 2013-12-14 at 03:49 -0300=2C Zir Blazer wrote: > > Basically=2C the issue I have goes like this: After installing Arch > > Linux in UEFI mode=2C I install Xen on top of it following Arch Linux > > wiki instructions for Xen. GRUB allows me to choose to load Xen Arch=2C >=20 > I don't know if this is related but AFAIK Xen does not currently support > being launched under UEFI via a bootloader. >=20 > Instead xen.efi is a UEFI application which can be launched from the EFI > shell directly (i.e. instead of grub.efi). >=20 > http://xenbits.xen.org/docs/4.3-testing/misc/efi.html has some details > of the config file used here. >=20 > People are working on launching Xen via bootloaders under UEFI but I > don't think it is complete/available yet in any released (or unreleased > ror that matter) version of Xen. There was a guy that posted recently a guide of how to build the xen.efi fi= le on Arch Linux Forums=2C here:https://bbs.archlinux.org/viewtopic.php?id= =3D174226 I followed his instructions modifying binutils for x86_64-pep support=2C an= d also when building Xen=2C I uncommented a PKGBUILD line that was for a Ra= deon passthrough patch. It builded sucessfully and I got my hands on the xe= n-4.3.1.efi file=2C that I tried to use with Gummiboot=2C but it also faile= d to boot.=20 So far=2C I tested the following combinations: GRUB UEFI-GPT: Black screens after either "Dom0 detected maximum 4 vCPUs" (= It should be 8=2C not 4)=2C or "Scrubbing RAM" if I modify /etc/xen/grub.co= nf to add a limit to Dom0 visible RAM to make a new grub.cfg. After choosin= g it from the boot menu=2C by default it uses what looks like a DOS VGA 640= x480 mode. Arch Linux manages to boot fine.Syslinux UEFI-GPT: Crashes as so= on as I choose Xen from the menu - doesn't even says that it loaded the ima= ges or made the RAMDisk. Arch Linux manages to boot fine with this one=2C t= oo.Gummiboot UEFI-GPT + EFI file: Goes a bit further than with GRUB=2C but = ultimately fails. It detects 8 vCPUs=2C and throws in 4 more lines than whe= n I try to boot with GRUB (Too fast to look what they say). By default it u= ses some text-based video mode with very large letters that looks quite bad= when compared to VGA 640x480. Arch Linux also works fine when booted from = Gummiboot. Due to the fact that I tested three different Boot Loaders on the same base= Arch Linux installation and touched a lot of things trying to make Xen wor= k=2C there are chances that I screwed something in the process (This includ= es some obscure BIOS setting=2C for that matter). So maybe the last combina= tion COULD work if I do it with a fresh install=2C as this is supposed to b= e the proper way to do it and there is already a guy claiming sucess doing = this. However=2C I would love to know if there is anything else that I coul= d test before starting from scratch again=2C as there seems to be too many = variables involved and I need a miracle to hit all the correct ones at the = same time. I have been ramming my head to the wall for the last two weeks a= nd I feel tired already of trying tons of things to no avail. Additionally=2C this is what it worked for me: Syslinux BIOS-GPT: This is the only one I managed to get working=2C also bu= ilding xen with the Radeon patch uncommented in PKGBUILD. At the moment=2C = I'm running a sort of hybrid combination=2C as Syslinux wrote on the HD MBR= to make booteable the partition where that Arch Linux + Xen installation i= s located=2C yet I can also choose from the BIOS to launch Gummiboot and fr= om it=2C boot to my everyday Arch Linux installation. Albeit it seems that Xen plays nice in this fashion=2C I *STILL* didn't man= aged to get my Radeon 5770 passthroughed properly (I think I should leave t= his for another mail with a proper topic=2C but...). Steps I did: - Connecting second VGA Monitor on the Radeon DVI-I port with a DVI-I to VG= A adapter. Should work=2C it used to do so in my old computer with Windows = XP.- I used xl pci-assignable-add to hide the Radeon from Xen=2C but my lat= er test had them included in /boot/syslinux/syslinux.cfg. Xen option looks = like this: LABEL xen MENU LABEL Xen KERNEL mboot.c32 APPEND ../xen-4.3.1.gz -= -- ../vmlinuz-linux console=3Dtty0 root=3D/dev/sda5 rw xen-pciback.hide=3D(= 01:00.0)(01:00.1) --- ../initramfs-linux.img - Making sure both devices (GPU and HDMI sound device) appears when using x= l pci-assignable-list. - Making sure the VM .cfg file is correctly set with these devices. VM's .c= fg is this: name =3D "wxpmain"kernel =3D "/usr/lib/xen/boot/hvmloader"builder =3D 'hvm'= memory =3D 1536boot =3D "c"vcpus =3D 4vif =3D ['bridge=3Dxenbr0']device_mod= el =3D 'qemu-xen-traditional'serial =3D 'pty'pae =3D 1acpi =3D 1apic =3D 1d= isk =3D ['file:/root/wxp_sp3.img=2Chda=2Cw']opengl =3D 1sdl =3D 0vnc =3D 1v= nclisten =3D ""vncpasswd =3D ""stdvga =3D 0gfx_passthru =3D 0pci =3D ['01:0= 0.0'=2C'01:00.1'] Its using less than 2 GB of RAM just to make sure that I'm not hitting the = old 2 GB memory wall bug when using VGA passthrough=2C and qemu-xen-traditi= onal instead of qemu-dm because I heared that last qemu-vm version had issu= es with VGA passthrough=2C too.I'm using a IMG disk image=2C not a LVM part= ition this time.I NEVER managed to get it working with gfx_passthru =3D 1 b= ecause xl create throws libxl errors and doesn't creates the VM. - Create the VM using xl create=2C and accessing it using vncviewer. Also t= ested a bit with sdl =3D 1.- Windows XP was installed without the devices p= assed to it=2C I think I also did the installation with the Cirrus Logic VG= A (stdvga =3D 0). I installed the GPLVM Drivers too=2C before stopping and = recreate the VM to pass the Radeon. When I create the VM with the Radeon in= cluded=2C it also complains that it detects a "xen pci device #0" that it d= oesn't have Drivers for=2C through by googling a bit seems to be normal beh= aviator.- After installing Catalyst=2C testing both full CCC or Driver-only= =2C I didn't managed to get it working properly. Usually=2C it sees the Rad= eon 5770 with a yellow exclamation mark and says it throws a Code 12 error = in Device Manager (Not enough resources). I googled the error=2C supposedly= a possible solution was using qemu-xen-traditional as I am doing (Heck=2C = you Ian=2C and Gordan too=2C appear on pretty much all of those Mailing Lis= t Threads!).- I tried with both Cirrus Logic and Standard VGA. If I disable= Cirrus Logic from Safe Mode and reboot to force Windows to use the Radeon= =2C it takes around one or two minutes after the WXP splash screen for the = Monitor to finally turns on instead of being in standby=2C but it displays = yet another black screen=2C and on vncviewer I see a BSOD complaining about= a file of ATI Drivers (ati2dvag if I recall correctly) some seconds after = the Monitor turns on. Monitor never display neither image or garbage=2C its= just a black screen.- Due to the Radeon issue when rebooting VMs due to no= Soft Device Reset or something like that=2C I tried rebooting the computer= everytime I was going to create the VM to test if it worked or not. Actual= ly=2C the Monitor stays turned on with a black screen after each failed try= until I reboot the machine=2C which I suppose that is the lack of Soft Dev= ice Reset in action.- There was only ONE time I actually saw an image on th= e Monitor connected to the Radeon=2C and it was the first time I tried Xen = with Syslinux BIOS-GPT before messing with Xen and UEFI two weeks ago. It d= isplayed a screen where white pixel lines were filling in=2C like what it u= sually does with vncviewer or SDL when the VM changes its VGA mode (Like wh= en it goes from DOS like boot to Windows loading screen). Crashed after doi= ng that if I recall correctly=2C and couldn't reproduce it again. > (BTW=2C you didn't say what version of Xen you are using=2C not too relev= ant > this time=2C but please remember next time). Its 4.3.1-2. I actually mentioned it in previous mail=2C but you probabily = missed it due to my amazing wall of text :D Thanks for reading. = --_e2fec9a9-43c6-440f-ab94-36ea4c4f64be_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
>=3B On Sat=2C 2013-12-14 at 03:49 -0300=2C Zir Blazer wrote:
>=3B >=3B Basically=2C the issue I have goes like thi= s: After installing Arch
>=3B >=3B Linux in UEFI mode=2C I install X= en on top of it following Arch Linux
>=3B >=3B wiki instructions for= Xen. GRUB allows me to choose to load Xen Arch=2C
>=3B
>=3B I d= on't know if this is related but AFAIK Xen does not currently support
&g= t=3B being launched under UEFI via a bootloader.
>=3B
>=3B Inste= ad xen.efi is a UEFI application which can be launched from the EFI
>= =3B shell directly (i.e. instead of grub.efi).
>=3B
>=3B http://= xenbits.xen.org/docs/4.3-testing/misc/efi.html has some details
>=3B o= f the config file used here.
>=3B
>=3B People are working on lau= nching Xen via bootloaders under UEFI but I
>=3B don't think it is com= plete/available yet in any released (or unreleased
>=3B ror that matte= r) version of Xen.

There was a guy that posted recently a guide of h= ow to build the xen.efi file on Arch Linux Forums=2C here:

I followed his instructions modifying binutils for x86_64-pep suppor= t=2C and also when building Xen=2C I uncommented a PKGBUILD line that was f= or a Radeon passthrough patch. It builded sucessfully and I got my hands on= the xen-4.3.1.efi file=2C that I tried to use with Gummiboot=2C but it als= o failed to boot. =3B

So far=2C I tested the f= ollowing combinations:

GRUB UEFI-GPT: Black screen= s after either "Dom0 detected maximum 4 vCPUs" (It should be 8=2C not 4)=2C= or "Scrubbing RAM" if I modify /etc/xen/grub.conf to add a limit to Dom0 v= isible RAM to make a new grub.cfg. After choosing it from the boot menu=2C = by default it uses what looks like a DOS VGA 640x480 mode. Arch Linux manag= es to boot fine.
Syslinux UEFI-GPT: Crashes as soon as I choose X= en from the menu - doesn't even says that it loaded the images or made the = RAMDisk. Arch Linux manages to boot fine with this one=2C too.
Gu= mmiboot UEFI-GPT + EFI file: Goes a bit further than with GRUB=2C but ultim= ately fails. It detects 8 vCPUs=2C and throws in 4 more lines than when I t= ry to boot with GRUB (Too fast to look what they say). By default it uses s= ome text-based video mode with very large letters that looks quite bad when= compared to VGA 640x480. Arch Linux also works fine when booted from Gummi= boot.

Due to the fact that I tested three differen= t Boot Loaders on the same base Arch Linux installation and touched a lot o= f things trying to make Xen work=2C there are chances that I screwed someth= ing in the process (This includes some obscure BIOS setting=2C for that mat= ter). So maybe the last combination COULD work if I do it with a fresh inst= all=2C as this is supposed to be the proper way to do it and there is alrea= dy a guy claiming sucess doing this. However=2C I would love to know if the= re is anything else that I could test before starting from scratch again=2C= as there seems to be too many variables involved and I need a miracle to h= it all the correct ones at the same time. I have been ramming my head to th= e wall for the last two weeks and I feel tired already of trying tons of th= ings to no avail.


Additionally=2C t= his is what it worked for me:

Syslinux BIOS-GPT: T= his is the only one I managed to get working=2C also building xen with the = Radeon patch uncommented in PKGBUILD. At the moment=2C I'm running a sort o= f hybrid combination=2C as Syslinux wrote on the HD MBR to make booteable t= he partition where that Arch Linux + Xen installation is located=2C yet I c= an also choose from the BIOS to launch Gummiboot and from it=2C boot to my = everyday Arch Linux installation.


A= lbeit it seems that Xen plays nice in this fashion=2C I *STILL* didn't mana= ged to get my Radeon 5770 passthroughed properly (I think I should leave th= is for another mail with a proper topic=2C but...). =3BSteps I did:

- Connectin= g second VGA Monitor on the Radeon DVI-I port with a DVI-I to VGA adapter. = Should work=2C it used to do so in my old computer with Windows XP.
- I used xl pci-assignable-add to hide the Radeon from Xen=2C but my lat= er test had them included in /boot/syslinux/syslinux.cfg. Xen option looks = like this:

LABEL xen
 =3B  = =3B MENU LABEL Xen
 =3B  =3B KERNEL mboot.c32
&= nbsp=3B  =3B APPEND ../xen-4.3.1.gz --- ../vmlinuz-linux console=3Dtty0= root=3D/dev/sda5 rw xen-pciback.hide=3D(01:00.0)(01:00.1) --- ../initramfs= -linux.img

- Making sure both devices (GPU a= nd HDMI sound device) appears when using xl pci-assignable-list.
- Makin= g sure the VM .cfg file is correctly set with these devices. VM's .cfg is t= his:

name =3D "wxpmain"
kernel =3D = "/usr/lib/xen/boot/hvmloader"
builder =3D 'hvm'
memory = =3D 1536
boot =3D "c"
vcpus =3D 4
vif =3D ['b= ridge=3Dxenbr0']
device_model =3D 'qemu-xen-traditional'
serial =3D 'pty'
pae =3D 1
acpi =3D 1
apic = =3D 1
disk =3D ['file:/root/wxp_sp3.img=2Chda=2Cw']
ope= ngl =3D 1
sdl =3D 0
vnc =3D 1
vnclisten =3D "= "
vncpasswd =3D ""
stdvga =3D 0
gfx_passthru = =3D 0
pci =3D ['01:00.0'=2C'01:00.1']

It= s using less than 2 GB of RAM just to make sure that I'm not hitting the ol= d 2 GB memory wall bug when using VGA passthrough=2C and qemu-xen-tradition= al instead of qemu-dm because I heared that last qemu-vm version had issues= with VGA passthrough=2C too.
I'm using a IMG disk image=2C not a= LVM partition this time.
I NEVER managed to get it working with&= nbsp=3Bgfx_passthru =3D 1 because xl cre= ate throws libxl errors and doesn't creates the VM.

- Create the VM using xl create=2C and accessing it using vncviewer. Al= so tested a bit with sdl =3D 1.
- Windows XP was installed withou= t the devices passed to it=2C I think I also did the installation with the = Cirrus Logic VGA (stdvga =3D 0). I installed the GPLVM Drivers too=2C befor= e stopping and recreate the VM to pass the Radeon. When I create the VM wit= h the Radeon included=2C it also complains that it detects a "xen pci devic= e #0" that it doesn't have Drivers for=2C through by googling a bit seems t= o be normal behaviator.
- After installing Catalyst=2C testing bo= th full CCC or Driver-only=2C I didn't managed to get it working properly. = Usually=2C it sees the Radeon 5770 with a yellow exclamation mark and says = it throws a Code 12 error in Device Manager (Not enough resources). I googl= ed the error=2C supposedly a possible solution was using qemu-xen-tradition= al as I am doing (Heck=2C you Ian=2C and Gordan too=2C appear on pretty muc= h all of those Mailing List Threads!).
- I tried with both Cirrus= Logic and Standard VGA. If I disable Cirrus Logic from Safe Mode and reboo= t to force Windows to use the Radeon=2C it takes around one or two minutes = after the WXP splash screen for the Monitor to finally turns on instead of = being in standby=2C but it displays yet another black screen=2C and on vncv= iewer I see a BSOD complaining about a file of ATI Drivers =3B(ati2dvag if I recall correctly) =3Bsome seconds after the Monitor turns on. M= onitor never display neither image or garbage=2C its just a black screen.
- Due to the Radeon issue when rebooting VMs due to no Soft= Device Reset or something like that=2C I tried rebooting the computer ever= ytime I was going to create the VM to test if it worked or not. Actually=2C= the Monitor stays turned on with a black screen after each failed try unti= l I reboot the machine=2C which I suppose that is the lack of Soft Device R= eset in action.
- There was only ONE time I actually saw an image= on the Monitor connected to the Radeon=2C and it was the first time I trie= d Xen with Syslinux BIOS-GPT before messing with Xen and UEFI two weeks ago= . It displayed a screen where white pixel lines were filling in=2C like wha= t it usually does with vncviewer or SDL when the VM changes its VGA mode (L= ike when it goes from DOS like boot to Windows loading screen). Crashed aft= er doing that if I recall correctly=2C and couldn't reproduce it again.
=


>=3B (BTW=2C you didn't say what version of Xen you are using= =2C not too relevant
>=3B this time=2C but please remember next time).=

Its 4.3.1-2. I actually mentioned it in previ= ous mail=2C but you probabily missed it due to my amazing wall of text :D


Thanks for reading.
=
= --_e2fec9a9-43c6-440f-ab94-36ea4c4f64be_-- --===============5234338703307830304== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============5234338703307830304==-- From xen-users-bounces@lists.xen.org Sun Dec 22 14:08:41 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 14:08:41 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vujgf-0007NI-Bu; Sun, 22 Dec 2013 14:07:21 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vujge-0007ND-1D for xen-users@lists.xen.org; Sun, 22 Dec 2013 14:07:20 +0000 Received: from [85.158.137.68:46354] by server-3.bemta-3.messagelabs.com id BA/AB-10658-712F6B25; Sun, 22 Dec 2013 14:07:19 +0000 X-Env-Sender: m.mairkeimberger@gmail.com X-Msg-Ref: server-15.tower-31.messagelabs.com!1387721237!1893289!1 X-Originating-IP: [209.85.214.53] X-SpamReason: No, hits=0.0 required=7.0 tests=ML_RADAR_SPEW_LINKS_14, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 22208 invoked from network); 22 Dec 2013 14:07:17 -0000 Received: from mail-bk0-f53.google.com (HELO mail-bk0-f53.google.com) (209.85.214.53) by server-15.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 22 Dec 2013 14:07:17 -0000 Received: by mail-bk0-f53.google.com with SMTP id na10so1735241bkb.40 for ; Sun, 22 Dec 2013 06:07:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:subject:message-id:mail-followup-to:mime-version :content-type:content-disposition:user-agent; bh=YF58PRbQub/gW1C0jhGXVca0RT4jD2ZAO/WhHbg95N0=; b=aJkMtRHc3EsfyJE7/IrWmdaa/BNGDajpWa5Fg7mP9f+mwa3DemTTXbGIr21uCCFTwS MLTEK158YvQyORWoqU7Tm7vSodS178RdvDS61wuVbXmK8rH9T1tny0Alcib/fJuLCsY9 VY2DGuWHEkLaEoPX38YmEpjnA65z4Hj63o5OtCAVSTl8y+ezfDK7V7mKtG0C2gtl2+oZ lh8g5/B81iATP+GNYHaTZyMu+DSt1li4tNNwvhTL+v9q88uRbP1eRf8eE1zAbM2QCK+i y8pizFcrAQPNZKzQFsXp3SfchJIlZnp34aGXhup4bYPRUXCWHszF/VSrq0affFlFmxdL g2tQ== X-Received: by 10.204.80.78 with SMTP id s14mr8843775bkk.6.1387721237444; Sun, 22 Dec 2013 06:07:17 -0800 (PST) Received: from asterix ([80.66.44.3]) by mx.google.com with ESMTPSA id lr9sm12335016bkb.2.2013.12.22.06.07.16 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 22 Dec 2013 06:07:16 -0800 (PST) Date: Sun, 22 Dec 2013 15:08:21 +0100 From: Michaael Mair-Keimberger To: xen-users@lists.xen.org Message-ID: <20131222140821.GB7095@asterix> Mail-Followup-To: xen-users@lists.xen.org MIME-Version: 1.0 Content-Disposition: inline User-Agent: Mutt/1.5.22 (2013-10-16) Subject: [Xen-users] vga passthrogh on mainboards with broken ivrs tables X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi Lists, I'm having troubles getting vga passthrough working again with latest xen-4.3.1. My system is a bulldozer amd 8core cpu with a gigabyte GA-990FXA-UD5 motherboard. The host system uses a amd hd6850 while the guest (windows 7) uses a amd hd 7970. So far everything worked great until xsa-36 [1]. I've haven't updated xen since this "fix", but yesterday i'll gave it another try. I've updated to xen-4.3.1 and tried to fix those broken ivrs tables with the newly introduced ivrx_ioapic kernel parameter. I'm not sure if this should help me, but at least it sounds promising. However i didn't get it to work and i hope someone can give my some hints how to fix that, otherwise i have to downgrade xen again. grub2 config: menuentry 'Gentoo Linux XEN' { root=hd0,1 multiboot /boot/xen.gz dom0_mem=8192M,max:8192M iommu=1 dom0_max_vcpus=4 dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 module /boot/gentoo-3.12.6 root=/dev/md3 radeon.pcie_gen2=1 radeon.dpm=1 softlevel=xen xen-pciback.permissive xen-pciback.hide=(01:00.0)(01:00.1)(00:12.0)(00:12.2) } lspci: 00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (external gfx0 port B) (rev 02) 00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD/ATI] RD990 I/O Memory Management Unit (IOMMU) 00:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (PCI express gpp port B) 00:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (PCI express gpp port H) 00:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (external gfx1 port A) 00:0d.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (external gfx1 port B) 00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] (rev 40) 00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller 00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller 00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller 00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 SMBus Controller (rev 42) 00:14.1 IDE interface: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 IDE Controller (rev 40) 00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 Azalia (Intel HDA) (rev 40) 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 LPC host controller (rev 40) 00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 PCI to PCI Bridge (rev 40) 00:14.5 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI2 Controller 00:15.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 PCI to PCI bridge (PCIE port 0) 00:15.1 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 PCI to PCI bridge (PCIE port 1) 00:15.2 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI bridge (PCIE port 2) 00:15.3 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI bridge (PCIE port 3) 00:16.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller 00:16.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 0 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 1 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 2 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 3 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 4 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 5 01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Tahiti XT [Radeon HD 7970] 01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Tahiti XT HDMI Audio [Radeon HD 7970 Series] 02:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller (rev 01) 03:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA 6Gb/s Controller (rev 11) 04:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Barts PRO [Radeon HD 6850] 04:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Barts HDMI Audio [Radeon HD 6800 Series] 05:0e.0 FireWire (IEEE 1394): VIA Technologies, Inc. VT6306/7/8 [Fire II(M)] IEEE 1394 OHCI Controller (rev c0) 06:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06) 07:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller (rev 01) 08:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA 6Gb/s Controller (rev 11) lspci -t: -[0000:00]-+-00.0 +-00.2 +-02.0-[01]--+-00.0 | \-00.1 +-09.0-[02]----00.0 +-0a.0-[03]----00.0 +-0d.0-[04]--+-00.0 | \-00.1 +-11.0 +-12.0 +-12.2 +-13.0 +-13.2 +-14.0 +-14.1 +-14.2 +-14.3 +-14.4-[05]----0e.0 +-14.5 +-15.0-[06]----00.0 +-15.1-[07]----00.0 +-15.2-[08]----00.0 +-15.3-[09]-- +-16.0 +-16.2 +-18.0 +-18.1 +-18.2 +-18.3 +-18.4 \-18.5 xl dmesg (shorten): (XEN) Xen version 4.3.1 (@xonet.at) (x86_64-pc-linux-gnu-gcc (Gentoo 4.8.2 p1.0, pie-0.5.8) 4.8.2) debug=n Sat Dec 21 11:55:39 CET 2013 (XEN) Latest ChangeSet: (XEN) Bootloader: GRUB 2.02~beta1 (XEN) Command line: dom0_mem=8192M,max:8192M iommu=1 dom0_max_vcpus=4 dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 ... (XEN) IOAPIC[0]: apic_id 8, version 33, address 0xfec00000, GSI 0-23 (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Detected 4026.984 MHz processor. (XEN) Initing memory sharing. (XEN) xstate_init: using cntxt_size: 0x3c0 and states: 0x4000000000000007 (XEN) IVHD Error: Conflicting IO-APIC 0x8 entries (XEN) AMD-Vi: Error initialization (XEN) I/O virtualisation disabled (XEN) ENABLING IO-APIC IRQs (XEN) -> Using new ACK method (XEN) Platform timer is 14.318MHz HPET (XEN) Allocated console ring of 16 KiB. (XEN) HVM: ASIDs enabled. (XEN) SVM: Supported advanced features: (XEN) - Nested Page Tables (NPT) (XEN) - Last Branch Record (LBR) Virtualisation (XEN) - Next-RIP Saved on #VMEXIT (XEN) - VMCB Clean Bits (XEN) - DecodeAssists (XEN) - Pause-Intercept Filter (XEN) - TSC Rate MSR (XEN) HVM: SVM enabled (XEN) HVM: Hardware Assisted Paging (HAP) detected (XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB (XEN) spurious 8259A interrupt: IRQ7. I've tried a few other configuration's (like adding the ivrs_ioapic parameter to the module line in grub or also adding vfio_iommu_type1.allow_unsafe_interrupts=1 to the cmdline), but so far i couldn't get it to work. Since i'm not completely sure what i actually have to insert at the kernel parameter i'm glad if someone could give me some insight. However, since the output of xl dmesg is always the same, even though with or without the parameter, i might missed some additional parameters. If you need any more information, I'll be glad to provide them. Thanks in advance. Michael [1] http://lists.xen.org/archives/html/xen-announce/2013-02/msg00002.html _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sun Dec 22 14:08:41 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 14:08:41 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vujgf-0007NI-Bu; Sun, 22 Dec 2013 14:07:21 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vujge-0007ND-1D for xen-users@lists.xen.org; Sun, 22 Dec 2013 14:07:20 +0000 Received: from [85.158.137.68:46354] by server-3.bemta-3.messagelabs.com id BA/AB-10658-712F6B25; Sun, 22 Dec 2013 14:07:19 +0000 X-Env-Sender: m.mairkeimberger@gmail.com X-Msg-Ref: server-15.tower-31.messagelabs.com!1387721237!1893289!1 X-Originating-IP: [209.85.214.53] X-SpamReason: No, hits=0.0 required=7.0 tests=ML_RADAR_SPEW_LINKS_14, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 22208 invoked from network); 22 Dec 2013 14:07:17 -0000 Received: from mail-bk0-f53.google.com (HELO mail-bk0-f53.google.com) (209.85.214.53) by server-15.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 22 Dec 2013 14:07:17 -0000 Received: by mail-bk0-f53.google.com with SMTP id na10so1735241bkb.40 for ; Sun, 22 Dec 2013 06:07:17 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:subject:message-id:mail-followup-to:mime-version :content-type:content-disposition:user-agent; bh=YF58PRbQub/gW1C0jhGXVca0RT4jD2ZAO/WhHbg95N0=; b=aJkMtRHc3EsfyJE7/IrWmdaa/BNGDajpWa5Fg7mP9f+mwa3DemTTXbGIr21uCCFTwS MLTEK158YvQyORWoqU7Tm7vSodS178RdvDS61wuVbXmK8rH9T1tny0Alcib/fJuLCsY9 VY2DGuWHEkLaEoPX38YmEpjnA65z4Hj63o5OtCAVSTl8y+ezfDK7V7mKtG0C2gtl2+oZ lh8g5/B81iATP+GNYHaTZyMu+DSt1li4tNNwvhTL+v9q88uRbP1eRf8eE1zAbM2QCK+i y8pizFcrAQPNZKzQFsXp3SfchJIlZnp34aGXhup4bYPRUXCWHszF/VSrq0affFlFmxdL g2tQ== X-Received: by 10.204.80.78 with SMTP id s14mr8843775bkk.6.1387721237444; Sun, 22 Dec 2013 06:07:17 -0800 (PST) Received: from asterix ([80.66.44.3]) by mx.google.com with ESMTPSA id lr9sm12335016bkb.2.2013.12.22.06.07.16 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Sun, 22 Dec 2013 06:07:16 -0800 (PST) Date: Sun, 22 Dec 2013 15:08:21 +0100 From: Michaael Mair-Keimberger To: xen-users@lists.xen.org Message-ID: <20131222140821.GB7095@asterix> Mail-Followup-To: xen-users@lists.xen.org MIME-Version: 1.0 Content-Disposition: inline User-Agent: Mutt/1.5.22 (2013-10-16) Subject: [Xen-users] vga passthrogh on mainboards with broken ivrs tables X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi Lists, I'm having troubles getting vga passthrough working again with latest xen-4.3.1. My system is a bulldozer amd 8core cpu with a gigabyte GA-990FXA-UD5 motherboard. The host system uses a amd hd6850 while the guest (windows 7) uses a amd hd 7970. So far everything worked great until xsa-36 [1]. I've haven't updated xen since this "fix", but yesterday i'll gave it another try. I've updated to xen-4.3.1 and tried to fix those broken ivrs tables with the newly introduced ivrx_ioapic kernel parameter. I'm not sure if this should help me, but at least it sounds promising. However i didn't get it to work and i hope someone can give my some hints how to fix that, otherwise i have to downgrade xen again. grub2 config: menuentry 'Gentoo Linux XEN' { root=hd0,1 multiboot /boot/xen.gz dom0_mem=8192M,max:8192M iommu=1 dom0_max_vcpus=4 dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 module /boot/gentoo-3.12.6 root=/dev/md3 radeon.pcie_gen2=1 radeon.dpm=1 softlevel=xen xen-pciback.permissive xen-pciback.hide=(01:00.0)(01:00.1)(00:12.0)(00:12.2) } lspci: 00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (external gfx0 port B) (rev 02) 00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD/ATI] RD990 I/O Memory Management Unit (IOMMU) 00:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (PCI express gpp port B) 00:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (PCI express gpp port H) 00:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (external gfx1 port A) 00:0d.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (external gfx1 port B) 00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] (rev 40) 00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller 00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller 00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller 00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 SMBus Controller (rev 42) 00:14.1 IDE interface: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 IDE Controller (rev 40) 00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 Azalia (Intel HDA) (rev 40) 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 LPC host controller (rev 40) 00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 PCI to PCI Bridge (rev 40) 00:14.5 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI2 Controller 00:15.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 PCI to PCI bridge (PCIE port 0) 00:15.1 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 PCI to PCI bridge (PCIE port 1) 00:15.2 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI bridge (PCIE port 2) 00:15.3 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI bridge (PCIE port 3) 00:16.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller 00:16.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 0 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 1 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 2 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 3 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 4 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 5 01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Tahiti XT [Radeon HD 7970] 01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Tahiti XT HDMI Audio [Radeon HD 7970 Series] 02:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller (rev 01) 03:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA 6Gb/s Controller (rev 11) 04:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Barts PRO [Radeon HD 6850] 04:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Barts HDMI Audio [Radeon HD 6800 Series] 05:0e.0 FireWire (IEEE 1394): VIA Technologies, Inc. VT6306/7/8 [Fire II(M)] IEEE 1394 OHCI Controller (rev c0) 06:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06) 07:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller (rev 01) 08:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA 6Gb/s Controller (rev 11) lspci -t: -[0000:00]-+-00.0 +-00.2 +-02.0-[01]--+-00.0 | \-00.1 +-09.0-[02]----00.0 +-0a.0-[03]----00.0 +-0d.0-[04]--+-00.0 | \-00.1 +-11.0 +-12.0 +-12.2 +-13.0 +-13.2 +-14.0 +-14.1 +-14.2 +-14.3 +-14.4-[05]----0e.0 +-14.5 +-15.0-[06]----00.0 +-15.1-[07]----00.0 +-15.2-[08]----00.0 +-15.3-[09]-- +-16.0 +-16.2 +-18.0 +-18.1 +-18.2 +-18.3 +-18.4 \-18.5 xl dmesg (shorten): (XEN) Xen version 4.3.1 (@xonet.at) (x86_64-pc-linux-gnu-gcc (Gentoo 4.8.2 p1.0, pie-0.5.8) 4.8.2) debug=n Sat Dec 21 11:55:39 CET 2013 (XEN) Latest ChangeSet: (XEN) Bootloader: GRUB 2.02~beta1 (XEN) Command line: dom0_mem=8192M,max:8192M iommu=1 dom0_max_vcpus=4 dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 ... (XEN) IOAPIC[0]: apic_id 8, version 33, address 0xfec00000, GSI 0-23 (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Detected 4026.984 MHz processor. (XEN) Initing memory sharing. (XEN) xstate_init: using cntxt_size: 0x3c0 and states: 0x4000000000000007 (XEN) IVHD Error: Conflicting IO-APIC 0x8 entries (XEN) AMD-Vi: Error initialization (XEN) I/O virtualisation disabled (XEN) ENABLING IO-APIC IRQs (XEN) -> Using new ACK method (XEN) Platform timer is 14.318MHz HPET (XEN) Allocated console ring of 16 KiB. (XEN) HVM: ASIDs enabled. (XEN) SVM: Supported advanced features: (XEN) - Nested Page Tables (NPT) (XEN) - Last Branch Record (LBR) Virtualisation (XEN) - Next-RIP Saved on #VMEXIT (XEN) - VMCB Clean Bits (XEN) - DecodeAssists (XEN) - Pause-Intercept Filter (XEN) - TSC Rate MSR (XEN) HVM: SVM enabled (XEN) HVM: Hardware Assisted Paging (HAP) detected (XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB (XEN) spurious 8259A interrupt: IRQ7. I've tried a few other configuration's (like adding the ivrs_ioapic parameter to the module line in grub or also adding vfio_iommu_type1.allow_unsafe_interrupts=1 to the cmdline), but so far i couldn't get it to work. Since i'm not completely sure what i actually have to insert at the kernel parameter i'm glad if someone could give me some insight. However, since the output of xl dmesg is always the same, even though with or without the parameter, i might missed some additional parameters. If you need any more information, I'll be glad to provide them. Thanks in advance. Michael [1] http://lists.xen.org/archives/html/xen-announce/2013-02/msg00002.html _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sun Dec 22 15:29:47 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 15:29:47 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VukxH-0002Du-5o; Sun, 22 Dec 2013 15:28:35 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VukxF-0002CJ-B0 for xen-users@lists.xen.org; Sun, 22 Dec 2013 15:28:33 +0000 Received: from [85.158.137.68:50613] by server-14.bemta-3.messagelabs.com id FD/EA-06105-02507B25; Sun, 22 Dec 2013 15:28:32 +0000 X-Env-Sender: tlund@nxs.se X-Msg-Ref: server-15.tower-31.messagelabs.com!1387726111!1899628!1 X-Originating-IP: [212.247.200.182] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23379 invoked from network); 22 Dec 2013 15:28:31 -0000 Received: from envy.nxs.se (HELO envy.nxs.se) (212.247.200.182) by server-15.tower-31.messagelabs.com with SMTP; 22 Dec 2013 15:28:31 -0000 Received: by envy.nxs.se (Postfix, from userid 1000) id 528E767CC7; Sun, 22 Dec 2013 16:28:30 +0100 (CET) Received: from localhost (localhost [127.0.0.1]) by envy.nxs.se (Postfix) with ESMTP id 4D5402BEBD for ; Sun, 22 Dec 2013 16:28:30 +0100 (CET) Date: Sun, 22 Dec 2013 16:28:30 +0100 (CET) From: Tomas Agartz To: xen-users@lists.xen.org Message-ID: MIME-Version: 1.0 Subject: [Xen-users] After upgrade from 4.1 -> 4.3 domU will not boot with iommu=soft X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org My system is a Thinkpad x220 laptop with Debian 7.3 x64 (kernel 3.2 and xen 4.1). I have one DomU and it has two PCI-devices assigned. The domU kernel needs to boot with "iommu=soft" for this to work properly. Everything working as expected in both dom0 and domU except dom0 acpi suspend/resume. (suspends fine, but does not wake up on resume). After spening some time on google I find out that resume is not really working with 3.2 kernel and xen 4.1 (needs atleast 3.11 and 4.2.2). I upgrade to the 3.12 kernel and xen 4.3 packages from from debian unstable. Doing acpi suspend/resume now works witout any other modification to the system. However, the domU will no longer boot. When pygrub starts the kernel (after running "xm start -c domu"), there is ZERO output and I get the prompt of the dom0 back after about 3-4 seconds. (I removed the "quiet" option from the kernel, ofc). xend.log just says "Domain has crashed". If i remove the "iommu=soft" option from the domU kernel, it boots fine (but the PCI devices are not working in the domU). After searching for people with similar problems I increased the domU memory from 256 to 512 Mbyte. I also tried upgrading the domU kernel to the same 3.12 kernel as the dom0 is using, but neither of those things helped. Looking for any hints on how to go forwards :) Best regards, Tomas _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sun Dec 22 15:29:47 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 15:29:47 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VukxH-0002Du-5o; Sun, 22 Dec 2013 15:28:35 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VukxF-0002CJ-B0 for xen-users@lists.xen.org; Sun, 22 Dec 2013 15:28:33 +0000 Received: from [85.158.137.68:50613] by server-14.bemta-3.messagelabs.com id FD/EA-06105-02507B25; Sun, 22 Dec 2013 15:28:32 +0000 X-Env-Sender: tlund@nxs.se X-Msg-Ref: server-15.tower-31.messagelabs.com!1387726111!1899628!1 X-Originating-IP: [212.247.200.182] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23379 invoked from network); 22 Dec 2013 15:28:31 -0000 Received: from envy.nxs.se (HELO envy.nxs.se) (212.247.200.182) by server-15.tower-31.messagelabs.com with SMTP; 22 Dec 2013 15:28:31 -0000 Received: by envy.nxs.se (Postfix, from userid 1000) id 528E767CC7; Sun, 22 Dec 2013 16:28:30 +0100 (CET) Received: from localhost (localhost [127.0.0.1]) by envy.nxs.se (Postfix) with ESMTP id 4D5402BEBD for ; Sun, 22 Dec 2013 16:28:30 +0100 (CET) Date: Sun, 22 Dec 2013 16:28:30 +0100 (CET) From: Tomas Agartz To: xen-users@lists.xen.org Message-ID: MIME-Version: 1.0 Subject: [Xen-users] After upgrade from 4.1 -> 4.3 domU will not boot with iommu=soft X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org My system is a Thinkpad x220 laptop with Debian 7.3 x64 (kernel 3.2 and xen 4.1). I have one DomU and it has two PCI-devices assigned. The domU kernel needs to boot with "iommu=soft" for this to work properly. Everything working as expected in both dom0 and domU except dom0 acpi suspend/resume. (suspends fine, but does not wake up on resume). After spening some time on google I find out that resume is not really working with 3.2 kernel and xen 4.1 (needs atleast 3.11 and 4.2.2). I upgrade to the 3.12 kernel and xen 4.3 packages from from debian unstable. Doing acpi suspend/resume now works witout any other modification to the system. However, the domU will no longer boot. When pygrub starts the kernel (after running "xm start -c domu"), there is ZERO output and I get the prompt of the dom0 back after about 3-4 seconds. (I removed the "quiet" option from the kernel, ofc). xend.log just says "Domain has crashed". If i remove the "iommu=soft" option from the domU kernel, it boots fine (but the PCI devices are not working in the domU). After searching for people with similar problems I increased the domU memory from 256 to 512 Mbyte. I also tried upgrading the domU kernel to the same 3.12 kernel as the dom0 is using, but neither of those things helped. Looking for any hints on how to go forwards :) Best regards, Tomas _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Sun Dec 22 15:57:39 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 15:57:39 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VulP7-0003dA-A7; Sun, 22 Dec 2013 15:57:21 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VulP4-0003cv-JE; Sun, 22 Dec 2013 15:57:19 +0000 Received: from [85.158.143.35:59228] by server-1.bemta-4.messagelabs.com id B9/06-02132-DDB07B25; Sun, 22 Dec 2013 15:57:17 +0000 X-Env-Sender: wargo.john25@gmail.com X-Msg-Ref: server-12.tower-21.messagelabs.com!1387727835!7515280!1 X-Originating-IP: [209.85.215.54] X-SpamReason: No, hits=1.4 required=7.0 tests=BODY_RANDOM_LONG, HTML_40_50, HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14, RCVD_BY_IP, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30716 invoked from network); 22 Dec 2013 15:57:16 -0000 Received: from mail-la0-f54.google.com (HELO mail-la0-f54.google.com) (209.85.215.54) by server-12.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 22 Dec 2013 15:57:16 -0000 Received: by mail-la0-f54.google.com with SMTP id b8so1923783lan.27 for ; Sun, 22 Dec 2013 07:57:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=DFiFOYt20tWg6xeKWADAB6gUDZqa0KUlqKmTnhmktxM=; b=z1Gy0iFrwZm+lW0BNUaEtnozbo3pBMemVE4i2+e4qY10iRgdZPCv7TAR7G0wORNbpT ZwyRVlfbRS0libJw9oF10k0xRHeFQcI5IGo3bVBH0PUClsh8e/uM8D8cGRfpAfRaudS6 A1Xxt/ZWwqsqiAwakrXQx8wIIuiVlD90DIzfWFRrJ/qJfTCGEebpGxBd3v3dHsxGvfxw ZlTYzFAizWVt/i/TMUdVkf/CgP5Y8vSVHGSOVW5tWAjD6fkmx4peaDGTa+lM1VMzWU73 +NIxOc+SXJqKTeXbIJqtozGJ5PQIR15BPqDv1Bh92qUG2IJ3vhEsZAxENdwd2yVB2oHd +9ew== MIME-Version: 1.0 X-Received: by 10.152.238.34 with SMTP id vh2mr1000898lac.50.1387727835202; Sun, 22 Dec 2013 07:57:15 -0800 (PST) Received: by 10.114.183.131 with HTTP; Sun, 22 Dec 2013 07:57:15 -0800 (PST) Date: Sun, 22 Dec 2013 09:57:15 -0600 Message-ID: From: John Wargo To: Xen Users , "xen-devel@lists.xen.org" Content-Type: multipart/mixed; boundary=001a1134989caaac4e04ee219014 Subject: [Xen-users] Undefined Symbol : libxl_cpu_bitmap_alloc X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --001a1134989caaac4e04ee219014 Content-Type: multipart/alternative; boundary=001a1134989caaac4b04ee219012 --001a1134989caaac4b04ee219012 Content-Type: text/plain; charset=ISO-8859-1 Geniuses, I'm not 100% sure where this should go, so I'm going to send it to users (for help) and to the development list (using 4.4-unstable). I just updated to the latest unstable, and every time I try to create my windows 8 machine, I get the following error: > *# xl -vvv create win8.cfg*Parsing config from win8.cfg > xl: symbol lookup error: xl: undefined symbol: libxl_cpu_bitmap_alloc To install it, I ran *make uninstall* on my old xen source. Then I followed the usual: *git clone git://xenbits.xen.org/xen.git * *cd xen* *./configure --prefix=/usr --libdir=/usr/lib64* *make world* *patch -p1 < ati-passthrough.patch* *make world* *make install* */sbin/ldconfig* *reboot* Attached are the outputs of *xl info* and *xl dmesg*, in addition to my windows 8 config. If any more information is needed, just ask. -John --001a1134989caaac4b04ee219012 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Geniuses,

I'm not 100% sure where t= his should go, so I'm going to send it to users (for help) and to the d= evelopment list (using 4.4-unstable).

I just updat= ed to the latest unstable, and every time I try to create my windows 8 mach= ine, I get the following error:

# xl -vvv create win8.cfg
Pa= rsing config from win8.cfg
xl: symbol lookup error: xl: undefined symbol: libxl_cpu_bitmap_alloc

To install it, I ran make uninstall=A0on = my old xen source.

Then I followed the usual:

git clone git://xenbits.xen.org/xen.git
cd xen
./configure --prefix=3D/usr --libdir=3D/usr/lib64
make wo= rld
patch -p1 < ati-passthrough.patch
make world
make install
/sbin/ldconfig
<= b>reboot

Attached are the outputs= of xl info=A0and xl dmesg, in addition to my windows 8 confi= g.

If any more information is needed, just ask.
=
-John
--001a1134989caaac4b04ee219012-- --001a1134989caaac4e04ee219014 Content-Type: text/plain; charset=US-ASCII; name="dmesg.txt" Content-Disposition: attachment; filename="dmesg.txt" Content-Transfer-Encoding: base64 X-Attachment-Id: f_hpiha23h0 IFhlbiA0LjQtdW5zdGFibGUKKFhFTikgWGVuIHZlcnNpb24gNC40LXVuc3RhYmxlIChyb290QCkg KGdjYyAoR0NDKSA0LjguMiAyMDEzMTIxMiAoUmVkIEhhdCA0LjguMi03KSkgZGVidWc9eSBTdW4g RGVjIDIyIDA3OjU4OjA1IENTVCAyMDEzCihYRU4pIExhdGVzdCBDaGFuZ2VTZXQ6IEZyaSBEZWMg MjAgMTI6MDI6MDYgMjAxMyArMDEwMCBnaXQ6OWE4MGQ1MAooWEVOKSBCb290bG9hZGVyOiBHUlVC IDIuMDAKKFhFTikgQ29tbWFuZCBsaW5lOiBwbGFjZWhvbGRlciBkb20wX21lbT04MTkyTSxtYXg6 ODE5Mk0gZG9tMF9tYXhfdmNwdXM9NiBkb20wX3ZjcHVzX3BpbiBpb21tdT0xIGxvZ2x2bD1hbGwg Z3Vlc3RfbG9nbHZsPWFsbCBuby1yZWFsLW1vZGUgZWRkPW9mZgooWEVOKSBWaWRlbyBpbmZvcm1h dGlvbjoKKFhFTikgIFZHQSBpcyB0ZXh0IG1vZGUgODB4MjUsIGZvbnQgOHgxNgooWEVOKSBEaXNj IGluZm9ybWF0aW9uOgooWEVOKSAgRm91bmQgMCBNQlIgc2lnbmF0dXJlcwooWEVOKSAgRm91bmQg MCBFREQgaW5mb3JtYXRpb24gc3RydWN0dXJlcwooWEVOKSBNdWx0aWJvb3QtZTgyMCBSQU0gbWFw OgooWEVOKSAgMDAwMDAwMDAwMDAwMDAwMCAtIDAwMDAwMDAwMDAwYTAwMDAgKHVzYWJsZSkKKFhF TikgIDAwMDAwMDAwMDAxMDAwMDAgLSAwMDAwMDAwMGFhN2Q5MDAwICh1c2FibGUpCihYRU4pICAw MDAwMDAwMGFhN2Q5MDAwIC0gMDAwMDAwMDBhYWFiNTAwMCAocmVzZXJ2ZWQpCihYRU4pICAwMDAw MDAwMGFhYWI1MDAwIC0gMDAwMDAwMDBhYWFjNTAwMCAoQUNQSSBkYXRhKQooWEVOKSAgMDAwMDAw MDBhYWFjNTAwMCAtIDAwMDAwMDAwYWI4YzgwMDAgKEFDUEkgTlZTKQooWEVOKSAgMDAwMDAwMDBh YjhjODAwMCAtIDAwMDAwMDAwYWNhMzcwMDAgKHJlc2VydmVkKQooWEVOKSAgMDAwMDAwMDBhY2Ez NzAwMCAtIDAwMDAwMDAwYWNhMzgwMDAgKHVzYWJsZSkKKFhFTikgIDAwMDAwMDAwYWNhMzgwMDAg LSAwMDAwMDAwMGFjYzNlMDAwIChBQ1BJIE5WUykKKFhFTikgIDAwMDAwMDAwYWNjM2UwMDAgLSAw MDAwMDAwMGFkMDgzMDAwICh1c2FibGUpCihYRU4pICAwMDAwMDAwMGFkMDgzMDAwIC0gMDAwMDAw MDBhZDdmNDAwMCAocmVzZXJ2ZWQpCihYRU4pICAwMDAwMDAwMGFkN2Y0MDAwIC0gMDAwMDAwMDBh ZDgwMDAwMCAodXNhYmxlKQooWEVOKSAgMDAwMDAwMDBmODAwMDAwMCAtIDAwMDAwMDAwZmMwMDAw MDAgKHJlc2VydmVkKQooWEVOKSAgMDAwMDAwMDBmZWMwMDAwMCAtIDAwMDAwMDAwZmVjMDEwMDAg KHJlc2VydmVkKQooWEVOKSAgMDAwMDAwMDBmZWMxMDAwMCAtIDAwMDAwMDAwZmVjMTEwMDAgKHJl c2VydmVkKQooWEVOKSAgMDAwMDAwMDBmZWMyMDAwMCAtIDAwMDAwMDAwZmVjMjEwMDAgKHJlc2Vy dmVkKQooWEVOKSAgMDAwMDAwMDBmZWQwMDAwMCAtIDAwMDAwMDAwZmVkMDEwMDAgKHJlc2VydmVk KQooWEVOKSAgMDAwMDAwMDBmZWQ2MTAwMCAtIDAwMDAwMDAwZmVkNzEwMDAgKHJlc2VydmVkKQoo WEVOKSAgMDAwMDAwMDBmZWQ4MDAwMCAtIDAwMDAwMDAwZmVkOTAwMDAgKHJlc2VydmVkKQooWEVO KSAgMDAwMDAwMDBmZWYwMDAwMCAtIDAwMDAwMDAxMDAwMDAwMDAgKHJlc2VydmVkKQooWEVOKSAg MDAwMDAwMDEwMDAwMTAwMCAtIDAwMDAwMDA0NGYwMDAwMDAgKHVzYWJsZSkKKFhFTikgQUNQSTog UlNEUCAwMDBGRDUzMCwgMDAyNCAocjIgQUxBU0tBKQooWEVOKSBBQ1BJOiBYU0RUIEFBQUJEMDcw LCAwMDVDIChyMSBBTEFTS0EgICAgQSBNIEkgIDEwNzIwMDkgQU1JICAgICAxMDAxMykKKFhFTikg QUNQSTogRkFDUCBBQUFDNDFFOCwgMDEwQyAocjUgQUxBU0tBICAgIEEgTSBJICAxMDcyMDA5IEFN SSAgICAgMTAwMTMpCihYRU4pIEFDUEkgV2FybmluZyAodGJmYWR0LTA0NjQpOiBPcHRpb25hbCBm aWVsZCAiUG0yQ29udHJvbEJsb2NrIiBoYXMgemVybyBhZGRyZXNzIG9yIGxlbmd0aDogMDAwMDAw MDAwMDAwMDAwMC8xIFsyMDA3MDEyNl0KKFhFTikgQUNQSTogRFNEVCBBQUFCRDE2OCwgNzA3OSAo cjIgQUxBU0tBICAgIEEgTSBJICAgICAgICAwIElOVEwgMjAwNTExMTcpCihYRU4pIEFDUEk6IEZB Q1MgQUI4QzJGODAsIDAwNDAKKFhFTikgQUNQSTogQVBJQyBBQUFDNDJGOCwgMDA4RSAocjMgQUxB U0tBICAgIEEgTSBJICAxMDcyMDA5IEFNSSAgICAgMTAwMTMpCihYRU4pIEFDUEk6IEZQRFQgQUFB QzQzODgsIDAwNDQgKHIxIEFMQVNLQSAgICBBIE0gSSAgMTA3MjAwOSBBTUkgICAgIDEwMDEzKQoo WEVOKSBBQ1BJOiBNQ0ZHIEFBQUM0M0QwLCAwMDNDIChyMSBBTEFTS0EgICAgQSBNIEkgIDEwNzIw MDkgTVNGVCAgICAxMDAxMykKKFhFTikgQUNQSTogSFBFVCBBQUFDNDQxMCwgMDAzOCAocjEgQUxB U0tBICAgIEEgTSBJICAxMDcyMDA5IEFNSSAgICAgICAgIDUpCihYRU4pIEFDUEk6IElWUlMgQUFB QzQ2RjAsIDAwRTggKHIxICBBTUQgICAgIFJEODkwUyAgIDIwMjAzMSBBTUQgICAgICAgICAwKQoo WEVOKSBBQ1BJOiBTU0RUIEFBQUM0NEEwLCAwMjRDIChyMSBBTUQgICAgUE9XRVJOT1cgICAgICAg IDEgQU1EICAgICAgICAgMSkKKFhFTikgU3lzdGVtIFJBTTogMTYyODNNQiAoMTY2NzQ2MDBrQikK KFhFTikgTm8gTlVNQSBjb25maWd1cmF0aW9uIGZvdW5kCihYRU4pIEZha2luZyBhIG5vZGUgYXQg MDAwMDAwMDAwMDAwMDAwMC0wMDAwMDAwNDRmMDAwMDAwCihYRU4pIERvbWFpbiBoZWFwIGluaXRp YWxpc2VkCihYRU4pIERNSSAyLjcgcHJlc2VudC4KKFhFTikgVXNpbmcgQVBJQyBkcml2ZXIgZGVm YXVsdAooWEVOKSBBQ1BJOiBQTS1UaW1lciBJTyBQb3J0OiAweDgwOAooWEVOKSBBQ1BJOiB2NSBT TEVFUCBJTkZPOiBjb250cm9sWzA6MF0sIHN0YXR1c1swOjBdCihYRU4pIEFDUEk6IFNMRUVQIElO Rk86IHBtMXhfY250WzgwNCwwXSwgcG0xeF9ldnRbODAwLDBdCihYRU4pIEFDUEk6IDMyLzY0WCBG QUNTIGFkZHJlc3MgbWlzbWF0Y2ggaW4gRkFEVCAtIGFiOGMyZjgwLzAwMDAwMDAwMDAwMDAwMDAs IHVzaW5nIDMyCihYRU4pIEFDUEk6ICAgICAgICAgICAgIHdha2V1cF92ZWNbYWI4YzJmOGNdLCB2 ZWNfc2l6ZVsyMF0KKFhFTikgQUNQSTogTG9jYWwgQVBJQyBhZGRyZXNzIDB4ZmVlMDAwMDAKKFhF TikgQUNQSTogTEFQSUMgKGFjcGlfaWRbMHgwMV0gbGFwaWNfaWRbMHgxMF0gZW5hYmxlZCkKKFhF TikgUHJvY2Vzc29yICMxNiA1OjIgQVBJQyB2ZXJzaW9uIDE2CihYRU4pIEFDUEk6IExBUElDIChh Y3BpX2lkWzB4MDJdIGxhcGljX2lkWzB4MTFdIGVuYWJsZWQpCihYRU4pIFByb2Nlc3NvciAjMTcg NToyIEFQSUMgdmVyc2lvbiAxNgooWEVOKSBBQ1BJOiBMQVBJQyAoYWNwaV9pZFsweDAzXSBsYXBp Y19pZFsweDEyXSBlbmFibGVkKQooWEVOKSBQcm9jZXNzb3IgIzE4IDU6MiBBUElDIHZlcnNpb24g MTYKKFhFTikgQUNQSTogTEFQSUMgKGFjcGlfaWRbMHgwNF0gbGFwaWNfaWRbMHgxM10gZW5hYmxl ZCkKKFhFTikgUHJvY2Vzc29yICMxOSA1OjIgQVBJQyB2ZXJzaW9uIDE2CihYRU4pIEFDUEk6IExB UElDIChhY3BpX2lkWzB4MDVdIGxhcGljX2lkWzB4MTRdIGVuYWJsZWQpCihYRU4pIFByb2Nlc3Nv ciAjMjAgNToyIEFQSUMgdmVyc2lvbiAxNgooWEVOKSBBQ1BJOiBMQVBJQyAoYWNwaV9pZFsweDA2 XSBsYXBpY19pZFsweDE1XSBlbmFibGVkKQooWEVOKSBQcm9jZXNzb3IgIzIxIDU6MiBBUElDIHZl cnNpb24gMTYKKFhFTikgQUNQSTogTEFQSUNfTk1JIChhY3BpX2lkWzB4ZmZdIGhpZ2ggZWRnZSBs aW50WzB4MV0pCihYRU4pIEFDUEk6IElPQVBJQyAoaWRbMHgwN10gYWRkcmVzc1sweGZlYzAwMDAw XSBnc2lfYmFzZVswXSkKKFhFTikgSU9BUElDWzBdOiBhcGljX2lkIDcsIHZlcnNpb24gMzMsIGFk ZHJlc3MgMHhmZWMwMDAwMCwgR1NJIDAtMjMKKFhFTikgQUNQSTogSU9BUElDIChpZFsweDA4XSBh ZGRyZXNzWzB4ZmVjMjAwMDBdIGdzaV9iYXNlWzI0XSkKKFhFTikgSU9BUElDWzFdOiBhcGljX2lk IDgsIHZlcnNpb24gMzMsIGFkZHJlc3MgMHhmZWMyMDAwMCwgR1NJIDI0LTU1CihYRU4pIEFDUEk6 IElOVF9TUkNfT1ZSIChidXMgMCBidXNfaXJxIDAgZ2xvYmFsX2lycSAyIGRmbCBkZmwpCihYRU4p IEFDUEk6IElOVF9TUkNfT1ZSIChidXMgMCBidXNfaXJxIDkgZ2xvYmFsX2lycSA5IGxvdyBsZXZl bCkKKFhFTikgQUNQSTogSVJRMCB1c2VkIGJ5IG92ZXJyaWRlLgooWEVOKSBBQ1BJOiBJUlEyIHVz ZWQgYnkgb3ZlcnJpZGUuCihYRU4pIEFDUEk6IElSUTkgdXNlZCBieSBvdmVycmlkZS4KKFhFTikg RW5hYmxpbmcgQVBJQyBtb2RlOiAgRmxhdC4gIFVzaW5nIDIgSS9PIEFQSUNzCihYRU4pIEFDUEk6 IEhQRVQgaWQ6IDB4NDM1MzgyMTAgYmFzZTogMHhmZWQwMDAwMAooWEVOKSBFUlNUIHRhYmxlIHdh cyBub3QgZm91bmQKKFhFTikgVXNpbmcgQUNQSSAoTUFEVCkgZm9yIFNNUCBjb25maWd1cmF0aW9u IGluZm9ybWF0aW9uCihYRU4pIFNNUDogQWxsb3dpbmcgNiBDUFVzICgwIGhvdHBsdWcgQ1BVcykK KFhFTikgSVJRIGxpbWl0czogNTYgR1NJLCAxMTEyIE1TSS9NU0ktWAooWEVOKSBVc2luZyBzY2hl ZHVsZXI6IFNNUCBDcmVkaXQgU2NoZWR1bGVyIChjcmVkaXQpCihYRU4pIERldGVjdGVkIDQ2MTUu ODA1IE1IeiBwcm9jZXNzb3IuCihYRU4pIEluaXRpbmcgbWVtb3J5IHNoYXJpbmcuCihYRU4pIHhz dGF0ZV9pbml0OiB1c2luZyBjbnR4dF9zaXplOiAweDNjMCBhbmQgc3RhdGVzOiAweDQwMDAwMDAw MDAwMDAwMDcKKFhFTikgQU1EIEZhbTE1aCBtYWNoaW5lIGNoZWNrIHJlcG9ydGluZyBlbmFibGVk CihYRU4pIFBDSTogTUNGRyBjb25maWd1cmF0aW9uIDA6IGJhc2UgZTAwMDAwMDAgc2VnbWVudCAw MDAwIGJ1c2VzIDAwIC0gZmYKKFhFTikgUENJOiBOb3QgdXNpbmcgTUNGRyBmb3Igc2VnbWVudCAw MDAwIGJ1cyAwMC1mZgooWEVOKSBBTUQtVmk6IElPTU1VIDAgRW5hYmxlZC4KKFhFTikgSS9PIHZp cnR1YWxpc2F0aW9uIGVuYWJsZWQKKFhFTikgIC0gRG9tMCBtb2RlOiBSZWxheGVkCihYRU4pIElu dGVycnVwdCByZW1hcHBpbmcgZW5hYmxlZAooWEVOKSBFTkFCTElORyBJTy1BUElDIElSUXMKKFhF TikgIC0+IFVzaW5nIG5ldyBBQ0sgbWV0aG9kCihYRU4pIC4uVElNRVI6IHZlY3Rvcj0weEYwIGFw aWMxPTAgcGluMT0yIGFwaWMyPS0xIHBpbjI9LTEKKFhFTikgUGxhdGZvcm0gdGltZXIgaXMgMTQu MzE4TUh6IEhQRVQKKFhFTikgQWxsb2NhdGVkIGNvbnNvbGUgcmluZyBvZiA2NCBLaUIuCihYRU4p IEhWTTogQVNJRHMgZW5hYmxlZC4KKFhFTikgU1ZNOiBTdXBwb3J0ZWQgYWR2YW5jZWQgZmVhdHVy ZXM6CihYRU4pICAtIE5lc3RlZCBQYWdlIFRhYmxlcyAoTlBUKQooWEVOKSAgLSBMYXN0IEJyYW5j aCBSZWNvcmQgKExCUikgVmlydHVhbGlzYXRpb24KKFhFTikgIC0gTmV4dC1SSVAgU2F2ZWQgb24g I1ZNRVhJVAooWEVOKSAgLSBWTUNCIENsZWFuIEJpdHMKKFhFTikgIC0gRGVjb2RlQXNzaXN0cwoo WEVOKSAgLSBQYXVzZS1JbnRlcmNlcHQgRmlsdGVyCihYRU4pICAtIFRTQyBSYXRlIE1TUgooWEVO KSBIVk06IFNWTSBlbmFibGVkCihYRU4pIEhWTTogSGFyZHdhcmUgQXNzaXN0ZWQgUGFnaW5nIChI QVApIGRldGVjdGVkCihYRU4pIEhWTTogSEFQIHBhZ2Ugc2l6ZXM6IDRrQiwgMk1CLCAxR0IKKFhF TikgSFZNOiBQVkggbW9kZSBub3Qgc3VwcG9ydGVkIG9uIHRoaXMgcGxhdGZvcm0KKFhFTikgbWlj cm9jb2RlOiBDUFUxIGNvbGxlY3RfY3B1X2luZm86IHBhdGNoX2lkPTB4NjAwMDgxZgooWEVOKSBt aWNyb2NvZGU6IENQVTIgY29sbGVjdF9jcHVfaW5mbzogcGF0Y2hfaWQ9MHg2MDAwODFmCihYRU4p IG1pY3JvY29kZTogQ1BVMyBjb2xsZWN0X2NwdV9pbmZvOiBwYXRjaF9pZD0weDYwMDA4MWYKKFhF TikgbWljcm9jb2RlOiBDUFU0IGNvbGxlY3RfY3B1X2luZm86IHBhdGNoX2lkPTB4NjAwMDgxZgoo WEVOKSBtaWNyb2NvZGU6IENQVTUgY29sbGVjdF9jcHVfaW5mbzogcGF0Y2hfaWQ9MHg2MDAwODFm CihYRU4pIEJyb3VnaHQgdXAgNiBDUFVzCihYRU4pIEFDUEkgc2xlZXAgbW9kZXM6IFMzCihYRU4p IE1DQTogVXNlIGh3IHRocmVzaG9sZGluZyB0byBhZGp1c3QgcG9sbGluZyBmcmVxdWVuY3kKKFhF TikgbWNoZWNrX3BvbGw6IE1hY2hpbmUgY2hlY2sgcG9sbGluZyB0aW1lciBzdGFydGVkLgooWEVO KSAqKiogTE9BRElORyBET01BSU4gMCAqKioKKFhFTikgZWxmX3BhcnNlX2JpbmFyeTogcGhkcjog cGFkZHI9MHgxMDAwMDAwIG1lbXN6PTB4YWNkMDAwCihYRU4pIGVsZl9wYXJzZV9iaW5hcnk6IHBo ZHI6IHBhZGRyPTB4MWMwMDAwMCBtZW1zej0weGY4MGYwCihYRU4pIGVsZl9wYXJzZV9iaW5hcnk6 IHBoZHI6IHBhZGRyPTB4MWNmOTAwMCBtZW1zej0weDE0ZTQwCihYRU4pIGVsZl9wYXJzZV9iaW5h cnk6IHBoZHI6IHBhZGRyPTB4MWQwZTAwMCBtZW1zej0weDZmOTAwMAooWEVOKSBlbGZfcGFyc2Vf YmluYXJ5OiBtZW1vcnk6IDB4MTAwMDAwMCAtPiAweDI0MDcwMDAKKFhFTikgZWxmX3hlbl9wYXJz ZV9ub3RlOiBHVUVTVF9PUyA9ICJsaW51eCIKKFhFTikgZWxmX3hlbl9wYXJzZV9ub3RlOiBHVUVT VF9WRVJTSU9OID0gIjIuNiIKKFhFTikgZWxmX3hlbl9wYXJzZV9ub3RlOiBYRU5fVkVSU0lPTiA9 ICJ4ZW4tMy4wIgooWEVOKSBlbGZfeGVuX3BhcnNlX25vdGU6IFZJUlRfQkFTRSA9IDB4ZmZmZmZm ZmY4MDAwMDAwMAooWEVOKSBlbGZfeGVuX3BhcnNlX25vdGU6IEVOVFJZID0gMHhmZmZmZmZmZjgx ZDBlMWUwCihYRU4pIGVsZl94ZW5fcGFyc2Vfbm90ZTogSFlQRVJDQUxMX1BBR0UgPSAweGZmZmZm ZmZmODEwMDEwMDAKKFhFTikgZWxmX3hlbl9wYXJzZV9ub3RlOiBGRUFUVVJFUyA9ICIhd3JpdGFi bGVfcGFnZV90YWJsZXN8cGFlX3BnZGlyX2Fib3ZlXzRnYiIKKFhFTikgZWxmX3hlbl9wYXJzZV9u b3RlOiBQQUVfTU9ERSA9ICJ5ZXMiCihYRU4pIGVsZl94ZW5fcGFyc2Vfbm90ZTogTE9BREVSID0g ImdlbmVyaWMiCihYRU4pIGVsZl94ZW5fcGFyc2Vfbm90ZTogdW5rbm93biB4ZW4gZWxmIG5vdGUg KDB4ZCkKKFhFTikgZWxmX3hlbl9wYXJzZV9ub3RlOiBTVVNQRU5EX0NBTkNFTCA9IDB4MQooWEVO KSBlbGZfeGVuX3BhcnNlX25vdGU6IEhWX1NUQVJUX0xPVyA9IDB4ZmZmZjgwMDAwMDAwMDAwMAoo WEVOKSBlbGZfeGVuX3BhcnNlX25vdGU6IFBBRERSX09GRlNFVCA9IDB4MAooWEVOKSBlbGZfeGVu X2FkZHJfY2FsY19jaGVjazogYWRkcmVzc2VzOgooWEVOKSAgICAgdmlydF9iYXNlICAgICAgICA9 IDB4ZmZmZmZmZmY4MDAwMDAwMAooWEVOKSAgICAgZWxmX3BhZGRyX29mZnNldCA9IDB4MAooWEVO KSAgICAgdmlydF9vZmZzZXQgICAgICA9IDB4ZmZmZmZmZmY4MDAwMDAwMAooWEVOKSAgICAgdmly dF9rc3RhcnQgICAgICA9IDB4ZmZmZmZmZmY4MTAwMDAwMAooWEVOKSAgICAgdmlydF9rZW5kICAg ICAgICA9IDB4ZmZmZmZmZmY4MjQwNzAwMAooWEVOKSAgICAgdmlydF9lbnRyeSAgICAgICA9IDB4 ZmZmZmZmZmY4MWQwZTFlMAooWEVOKSAgICAgcDJtX2Jhc2UgICAgICAgICA9IDB4ZmZmZmZmZmZm ZmZmZmZmZgooWEVOKSAgWGVuICBrZXJuZWw6IDY0LWJpdCwgbHNiLCBjb21wYXQzMgooWEVOKSAg RG9tMCBrZXJuZWw6IDY0LWJpdCwgUEFFLCBsc2IsIHBhZGRyIDB4MTAwMDAwMCAtPiAweDI0MDcw MDAKKFhFTikgUEhZU0lDQUwgTUVNT1JZIEFSUkFOR0VNRU5UOgooWEVOKSAgRG9tMCBhbGxvYy46 ICAgMDAwMDAwMDQzYzAwMDAwMC0+MDAwMDAwMDQ0MDAwMDAwMCAoMjA3NTQzMSBwYWdlcyB0byBi ZSBhbGxvY2F0ZWQpCihYRU4pICBJbml0LiByYW1kaXNrOiAwMDAwMDAwNDRkYjI3MDAwLT4wMDAw MDAwNDRlZmZmNjAwCihYRU4pIFZJUlRVQUwgTUVNT1JZIEFSUkFOR0VNRU5UOgooWEVOKSAgTG9h ZGVkIGtlcm5lbDogZmZmZmZmZmY4MTAwMDAwMC0+ZmZmZmZmZmY4MjQwNzAwMAooWEVOKSAgSW5p dC4gcmFtZGlzazogZmZmZmZmZmY4MjQwNzAwMC0+ZmZmZmZmZmY4MzhkZjYwMAooWEVOKSAgUGh5 cy1NYWNoIG1hcDogZmZmZmZmZmY4MzhlMDAwMC0+ZmZmZmZmZmY4NDhlMDAwMAooWEVOKSAgU3Rh cnQgaW5mbzogICAgZmZmZmZmZmY4NDhlMDAwMC0+ZmZmZmZmZmY4NDhlMDRiNAooWEVOKSAgUGFn ZSB0YWJsZXM6ICAgZmZmZmZmZmY4NDhlMTAwMC0+ZmZmZmZmZmY4NDkwYTAwMAooWEVOKSAgQm9v dCBzdGFjazogICAgZmZmZmZmZmY4NDkwYTAwMC0+ZmZmZmZmZmY4NDkwYjAwMAooWEVOKSAgVE9U QUw6ICAgICAgICAgZmZmZmZmZmY4MDAwMDAwMC0+ZmZmZmZmZmY4NGMwMDAwMAooWEVOKSAgRU5U UlkgQUREUkVTUzogZmZmZmZmZmY4MWQwZTFlMAooWEVOKSBEb20wIGhhcyBtYXhpbXVtIDYgVkNQ VXMKKFhFTikgZWxmX2xvYWRfYmluYXJ5OiBwaGRyIDAgYXQgMHhmZmZmZmZmZjgxMDAwMDAwIC0+ IDB4ZmZmZmZmZmY4MWFjZDAwMAooWEVOKSBlbGZfbG9hZF9iaW5hcnk6IHBoZHIgMSBhdCAweGZm ZmZmZmZmODFjMDAwMDAgLT4gMHhmZmZmZmZmZjgxY2Y4MGYwCihYRU4pIGVsZl9sb2FkX2JpbmFy eTogcGhkciAyIGF0IDB4ZmZmZmZmZmY4MWNmOTAwMCAtPiAweGZmZmZmZmZmODFkMGRlNDAKKFhF TikgZWxmX2xvYWRfYmluYXJ5OiBwaGRyIDMgYXQgMHhmZmZmZmZmZjgxZDBlMDAwIC0+IDB4ZmZm ZmZmZmY4MWU2MzAwMAooWEVOKSBTY3J1YmJpbmcgRnJlZSBSQU06IC4uLi4uLi4uLi4uLi4uLi4u Li4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4u Li4uLi4uZG9uZS4KKFhFTikgSW5pdGlhbCBsb3cgbWVtb3J5IHZpcnEgdGhyZXNob2xkIHNldCBh dCAweDQwMDAgcGFnZXMuCihYRU4pIFN0ZC4gTG9nbGV2ZWw6IEFsbAooWEVOKSBHdWVzdCBMb2ds ZXZlbDogQWxsCihYRU4pIFhlbiBpcyByZWxpbnF1aXNoaW5nIFZHQSBjb25zb2xlLgooWEVOKSAq KiogU2VyaWFsIGlucHV0IC0+IERPTTAgKHR5cGUgJ0NUUkwtYScgdGhyZWUgdGltZXMgdG8gc3dp dGNoIGlucHV0IHRvIFhlbikKKFhFTikgRnJlZWQgMjU2a0IgaW5pdCBtZW1vcnkuCihYRU4pIHRy YXBzLmM6MjUxNjpkMCBEb21haW4gYXR0ZW1wdGVkIFdSTVNSIDAwMDAwMDAwYzAwMTAyMDEgZnJv bSAweDAwMDAwMDAwMDAwMDAwMDAgdG8gMHgwMDAwMDAwMDAwMDBmZmZmLgooWEVOKSBQQ0kgYWRk IGRldmljZSAwMDAwOjAwOjAwLjAKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDowMDowMC4yCihY RU4pIFBDSSBhZGQgZGV2aWNlIDAwMDA6MDA6MDIuMAooWEVOKSBQQ0kgYWRkIGRldmljZSAwMDAw OjAwOjAzLjAKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDowMDowNC4wCihYRU4pIFBDSSBhZGQg ZGV2aWNlIDAwMDA6MDA6MDUuMAooWEVOKSBQQ0kgYWRkIGRldmljZSAwMDAwOjAwOjA2LjAKKFhF TikgUENJIGFkZCBkZXZpY2UgMDAwMDowMDowNy4wCihYRU4pIFBDSSBhZGQgZGV2aWNlIDAwMDA6 MDA6MDkuMAooWEVOKSBQQ0kgYWRkIGRldmljZSAwMDAwOjAwOjExLjAKKFhFTikgUENJIGFkZCBk ZXZpY2UgMDAwMDowMDoxMi4wCihYRU4pIFBDSSBhZGQgZGV2aWNlIDAwMDA6MDA6MTIuMgooWEVO KSBQQ0kgYWRkIGRldmljZSAwMDAwOjAwOjEzLjAKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDow MDoxMy4yCihYRU4pIFBDSSBhZGQgZGV2aWNlIDAwMDA6MDA6MTQuMAooWEVOKSBQQ0kgYWRkIGRl dmljZSAwMDAwOjAwOjE0LjIKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDowMDoxNC4zCihYRU4p IFBDSSBhZGQgZGV2aWNlIDAwMDA6MDA6MTQuNAooWEVOKSBQQ0kgYWRkIGRldmljZSAwMDAwOjAw OjE0LjUKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDowMDoxNi4wCihYRU4pIFBDSSBhZGQgZGV2 aWNlIDAwMDA6MDA6MTYuMgooWEVOKSBQQ0kgYWRkIGRldmljZSAwMDAwOjAwOjE4LjAKKFhFTikg UENJIGFkZCBkZXZpY2UgMDAwMDowMDoxOC4xCihYRU4pIFBDSSBhZGQgZGV2aWNlIDAwMDA6MDA6 MTguMgooWEVOKSBQQ0kgYWRkIGRldmljZSAwMDAwOjAwOjE4LjMKKFhFTikgUENJIGFkZCBkZXZp Y2UgMDAwMDowMDoxOC40CihYRU4pIFBDSSBhZGQgZGV2aWNlIDAwMDA6MDA6MTguNQooWEVOKSBQ Q0kgYWRkIGRldmljZSAwMDAwOjAxOjAwLjAKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDowMTow MC4xCihYRU4pIFBDSSBhZGQgZGV2aWNlIDAwMDA6MDI6MDAuMAooWEVOKSBQQ0kgYWRkIGRldmlj ZSAwMDAwOjAyOjAwLjEKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDowMzowMC4wCihYRU4pIFBD SSBhZGQgZGV2aWNlIDAwMDA6MDQ6MDAuMAooWEVOKSBQQ0kgYWRkIGRldmljZSAwMDAwOjA1OjAw LjAKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDowNjowMC4wCihYRU4pIFBDSSBhZGQgZGV2aWNl IDAwMDA6MDc6MDAuMAo= --001a1134989caaac4e04ee219014 Content-Type: text/plain; charset=US-ASCII; name="info.txt" Content-Disposition: attachment; filename="info.txt" Content-Transfer-Encoding: base64 X-Attachment-Id: f_hpiha55q1 aG9zdCAgICAgICAgICAgICAgICAgICA6IEh5cGVydmlzb3IKcmVsZWFzZSAgICAgICAgICAgICAg ICA6IDMuMTEuOS0yMDAuZmMxOS54ODZfNjQKdmVyc2lvbiAgICAgICAgICAgICAgICA6ICMxIFNN UCBXZWQgTm92IDIwIDIxOjIyOjI0IFVUQyAyMDEzCm1hY2hpbmUgICAgICAgICAgICAgICAgOiB4 ODZfNjQKbnJfY3B1cyAgICAgICAgICAgICAgICA6IDYKbWF4X2NwdV9pZCAgICAgICAgICAgICA6 IDUKbnJfbm9kZXMgICAgICAgICAgICAgICA6IDEKY29yZXNfcGVyX3NvY2tldCAgICAgICA6IDMK dGhyZWFkc19wZXJfY29yZSAgICAgICA6IDIKY3B1X21oeiAgICAgICAgICAgICAgICA6IDQ2MTUK aHdfY2FwcyAgICAgICAgICAgICAgICA6IDE3OGJmM2ZmOjJmZDNmYmZmOjAwMDAwMDAwOjAwMDAx NzAwOjM2OTgzMjAzOjAwMDAwMDAwOjAxZWJiZmZmOjAwMDAwMDA4CnZpcnRfY2FwcyAgICAgICAg ICAgICAgOiBodm0gaHZtX2RpcmVjdGlvCnRvdGFsX21lbW9yeSAgICAgICAgICAgOiAxNjI4Mwpm cmVlX21lbW9yeSAgICAgICAgICAgIDogNzkwNwpzaGFyaW5nX2ZyZWVkX21lbW9yeSAgIDogMApz aGFyaW5nX3VzZWRfbWVtb3J5ICAgIDogMApvdXRzdGFuZGluZ19jbGFpbXMgICAgIDogMApmcmVl X2NwdXMgICAgICAgICAgICAgIDogMAp4ZW5fbWFqb3IgICAgICAgICAgICAgIDogNAp4ZW5fbWlu b3IgICAgICAgICAgICAgIDogNAp4ZW5fZXh0cmEgICAgICAgICAgICAgIDogLXVuc3RhYmxlCnhl bl92ZXJzaW9uICAgICAgICAgICAgOiA0LjQtdW5zdGFibGUKeGVuX2NhcHMgICAgICAgICAgICAg ICA6IHhlbi0zLjAteDg2XzY0IHhlbi0zLjAteDg2XzMycCBodm0tMy4wLXg4Nl8zMiBodm0tMy4w LXg4Nl8zMnAgaHZtLTMuMC14ODZfNjQgCnhlbl9zY2hlZHVsZXIgICAgICAgICAgOiBjcmVkaXQK eGVuX3BhZ2VzaXplICAgICAgICAgICA6IDQwOTYKcGxhdGZvcm1fcGFyYW1zICAgICAgICA6IHZp cnRfc3RhcnQ9MHhmZmZmODAwMDAwMDAwMDAwCnhlbl9jaGFuZ2VzZXQgICAgICAgICAgOiBGcmkg RGVjIDIwIDEyOjAyOjA2IDIwMTMgKzAxMDAgZ2l0OjlhODBkNTAKeGVuX2NvbW1hbmRsaW5lICAg ICAgICA6IHBsYWNlaG9sZGVyIGRvbTBfbWVtPTgxOTJNLG1heDo4MTkyTSBkb20wX21heF92Y3B1 cz02IGRvbTBfdmNwdXNfcGluIGlvbW11PTEgbG9nbHZsPWFsbCBndWVzdF9sb2dsdmw9YWxsIG5v LXJlYWwtbW9kZSBlZGQ9b2ZmCmNjX2NvbXBpbGVyICAgICAgICAgICAgOiBnY2MgKEdDQykgNC44 LjIgMjAxMzEyMTIgKFJlZCBIYXQgNC44LjItNykKY2NfY29tcGlsZV9ieSAgICAgICAgICA6IHJv b3QKY2NfY29tcGlsZV9kb21haW4gICAgICA6IApjY19jb21waWxlX2RhdGUgICAgICAgIDogU3Vu IERlYyAyMiAwNzo1ODowNSBDU1QgMjAxMwp4ZW5kX2NvbmZpZ19mb3JtYXQgICAgIDogNAo= --001a1134989caaac4e04ee219014 Content-Type: application/octet-stream; name="win8.cfg" Content-Disposition: attachment; filename="win8.cfg" Content-Transfer-Encoding: base64 X-Attachment-Id: f_hpiham3y2 IyBOYW1lIGZvciB0aGUgSFZNCm5hbWUgICAgICAgICAgICAgICAgID0gIndpbjgiCiMgVXNlIEhW TQpidWlsZGVyICAgICAgICAgICAgICA9ICJodm0iCiMgQ3JlYXRlIDQgY3B1cyBvbiBwaHlzaWNh bCBjb3JlcyAyLTUKdmNwdXMgICAgICAgICAgICAgICAgPSA0CiNjcHVzICAgICAgICAgICAgICAg ICA9IFswLDEsMiwzLDQsNV0KIyA2R0IgbWVtb3J5Cm1lbW9yeSAgICAgICAgICAgICAgID0gNzE2 OAptYXhtZW0gICAgICAgICAgICAgICA9IDcxNjgKIyBVc2UgbHZtIGZvciB3aW5kb3dzIHJvb3Qs IGFuZCBwYXNzIGluIGNkcm9tIGZvciBpbnN0YWxsCmRpc2sgICAgICAgICAgICAgPSBbJ3BoeTov ZGV2L3NkYTYsaGRhLHcnLCAncGh5Oi9kZXYvc3IwLGhkYzpjZHJvbSxyJ10KIyBVbmNvbW1lbnQg YW5kIGNvbmZpZ3VyZSBvbmNlIGlzIGNyZWF0ZWQKdmlmID0gWydicmlkZ2U9dmlyYnIwJ10KIyBC b290IGNkIHJvbSBpZiBIREQgaXMgdW5hdmFpbGFibGUKYm9vdCAgICAgICAgICAgICAgICAgPSAi ZGMiICNkIgojIFVzZSBncmFwaGljcyBjYXJkIChSYWRlb24gNzg1MCkgYXMgc2Vjb25kYXJ5Cmdm eF9wYXNzdGhyb3VnaCAgICAgID0gMAojIFBhc3MgdGhyb3VnaCB2YXJpb3VzIFBDSSBkZXZpY2Vz CiMgMjowMC4wIC0gUmFkZW9uIDY2NzAKIyAyOjAwLjEgLSBSYWRlb24gNjY3MCAoU291bmQpCiMg MDoxMy4wIC0gVVNCIERldmljZXMgKE1vdXNlIC8gS2V5Ym9hcmQpCiMgMDoxMy4yIC0gVVNCIEZs YXNoIERyaXZlIChTYW1lIHBvcnRzKQojcGNpID0gWycwMDoxMy4wJywgJzAwOjEzLjInXSAjIFVz ZSB0aGlzIGZvciBpbml0aWFsIGluc3RhbGwKcGNpICAgICAgICAgICAgICAgICAgPSBbJzAyOjAw LjAnLCAnMDI6MDAuMScsICcwMDoxMy4wJywgJzAwOjEzLjInXQpwY2lfcG93ZXJfbWdtdD0xCnBj aV9tc2l0cmFuc2xhdGUgICAgID0gMAojIFVzZSB0cmFkaXRpb25hbCBwYXRjaGVkIHhlbgpkZXZp Y2VfbW9kZWxfdmVyc2lvbiA9ICJxZW11LXhlbi10cmFkaXRpb25hbCIKIyBBbGxvdyBhY2Nlc3Mg dG8gaXJxIDE4CmlycXMgICAgICAgICAgICAgICAgID0gWycxOCddCiMgUGFzcyB0aHJvdWdoIHZp cmlkaWFuIGluZm9ybWF0aW9uCnZpcmlkaWFuICAgICAgICAgICAgID0gMQp4ZW5fcGxhdGZvcm1f cGNpPTEKIyBTdGFuZGFyZCB2Z2EKdmdhICAgICAgICAgICAgICAgICAgPSAic3RkdmdhIgojIFBh c3MgdGhyb3VnaCB0aW1lCmxvY2FsdGltZSAgICAgICAgICAgID0gMQpocGV0PTEKI2FjcGk9MQph cGljPTEKcGFlPTEKCg== --001a1134989caaac4e04ee219014 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --001a1134989caaac4e04ee219014-- From xen-users-bounces@lists.xen.org Sun Dec 22 15:57:39 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 15:57:39 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VulP7-0003dA-A7; Sun, 22 Dec 2013 15:57:21 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VulP4-0003cv-JE; Sun, 22 Dec 2013 15:57:19 +0000 Received: from [85.158.143.35:59228] by server-1.bemta-4.messagelabs.com id B9/06-02132-DDB07B25; Sun, 22 Dec 2013 15:57:17 +0000 X-Env-Sender: wargo.john25@gmail.com X-Msg-Ref: server-12.tower-21.messagelabs.com!1387727835!7515280!1 X-Originating-IP: [209.85.215.54] X-SpamReason: No, hits=1.4 required=7.0 tests=BODY_RANDOM_LONG, HTML_40_50, HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14, RCVD_BY_IP, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30716 invoked from network); 22 Dec 2013 15:57:16 -0000 Received: from mail-la0-f54.google.com (HELO mail-la0-f54.google.com) (209.85.215.54) by server-12.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 22 Dec 2013 15:57:16 -0000 Received: by mail-la0-f54.google.com with SMTP id b8so1923783lan.27 for ; Sun, 22 Dec 2013 07:57:15 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=DFiFOYt20tWg6xeKWADAB6gUDZqa0KUlqKmTnhmktxM=; b=z1Gy0iFrwZm+lW0BNUaEtnozbo3pBMemVE4i2+e4qY10iRgdZPCv7TAR7G0wORNbpT ZwyRVlfbRS0libJw9oF10k0xRHeFQcI5IGo3bVBH0PUClsh8e/uM8D8cGRfpAfRaudS6 A1Xxt/ZWwqsqiAwakrXQx8wIIuiVlD90DIzfWFRrJ/qJfTCGEebpGxBd3v3dHsxGvfxw ZlTYzFAizWVt/i/TMUdVkf/CgP5Y8vSVHGSOVW5tWAjD6fkmx4peaDGTa+lM1VMzWU73 +NIxOc+SXJqKTeXbIJqtozGJ5PQIR15BPqDv1Bh92qUG2IJ3vhEsZAxENdwd2yVB2oHd +9ew== MIME-Version: 1.0 X-Received: by 10.152.238.34 with SMTP id vh2mr1000898lac.50.1387727835202; Sun, 22 Dec 2013 07:57:15 -0800 (PST) Received: by 10.114.183.131 with HTTP; Sun, 22 Dec 2013 07:57:15 -0800 (PST) Date: Sun, 22 Dec 2013 09:57:15 -0600 Message-ID: From: John Wargo To: Xen Users , "xen-devel@lists.xen.org" Content-Type: multipart/mixed; boundary=001a1134989caaac4e04ee219014 Subject: [Xen-users] Undefined Symbol : libxl_cpu_bitmap_alloc X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --001a1134989caaac4e04ee219014 Content-Type: multipart/alternative; boundary=001a1134989caaac4b04ee219012 --001a1134989caaac4b04ee219012 Content-Type: text/plain; charset=ISO-8859-1 Geniuses, I'm not 100% sure where this should go, so I'm going to send it to users (for help) and to the development list (using 4.4-unstable). I just updated to the latest unstable, and every time I try to create my windows 8 machine, I get the following error: > *# xl -vvv create win8.cfg*Parsing config from win8.cfg > xl: symbol lookup error: xl: undefined symbol: libxl_cpu_bitmap_alloc To install it, I ran *make uninstall* on my old xen source. Then I followed the usual: *git clone git://xenbits.xen.org/xen.git * *cd xen* *./configure --prefix=/usr --libdir=/usr/lib64* *make world* *patch -p1 < ati-passthrough.patch* *make world* *make install* */sbin/ldconfig* *reboot* Attached are the outputs of *xl info* and *xl dmesg*, in addition to my windows 8 config. If any more information is needed, just ask. -John --001a1134989caaac4b04ee219012 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Geniuses,

I'm not 100% sure where t= his should go, so I'm going to send it to users (for help) and to the d= evelopment list (using 4.4-unstable).

I just updat= ed to the latest unstable, and every time I try to create my windows 8 mach= ine, I get the following error:

# xl -vvv create win8.cfg
Pa= rsing config from win8.cfg
xl: symbol lookup error: xl: undefined symbol: libxl_cpu_bitmap_alloc

To install it, I ran make uninstall=A0on = my old xen source.

Then I followed the usual:

git clone git://xenbits.xen.org/xen.git
cd xen
./configure --prefix=3D/usr --libdir=3D/usr/lib64
make wo= rld
patch -p1 < ati-passthrough.patch
make world
make install
/sbin/ldconfig
<= b>reboot

Attached are the outputs= of xl info=A0and xl dmesg, in addition to my windows 8 confi= g.

If any more information is needed, just ask.
=
-John
--001a1134989caaac4b04ee219012-- --001a1134989caaac4e04ee219014 Content-Type: text/plain; charset=US-ASCII; name="dmesg.txt" Content-Disposition: attachment; filename="dmesg.txt" Content-Transfer-Encoding: base64 X-Attachment-Id: f_hpiha23h0 IFhlbiA0LjQtdW5zdGFibGUKKFhFTikgWGVuIHZlcnNpb24gNC40LXVuc3RhYmxlIChyb290QCkg KGdjYyAoR0NDKSA0LjguMiAyMDEzMTIxMiAoUmVkIEhhdCA0LjguMi03KSkgZGVidWc9eSBTdW4g RGVjIDIyIDA3OjU4OjA1IENTVCAyMDEzCihYRU4pIExhdGVzdCBDaGFuZ2VTZXQ6IEZyaSBEZWMg MjAgMTI6MDI6MDYgMjAxMyArMDEwMCBnaXQ6OWE4MGQ1MAooWEVOKSBCb290bG9hZGVyOiBHUlVC IDIuMDAKKFhFTikgQ29tbWFuZCBsaW5lOiBwbGFjZWhvbGRlciBkb20wX21lbT04MTkyTSxtYXg6 ODE5Mk0gZG9tMF9tYXhfdmNwdXM9NiBkb20wX3ZjcHVzX3BpbiBpb21tdT0xIGxvZ2x2bD1hbGwg Z3Vlc3RfbG9nbHZsPWFsbCBuby1yZWFsLW1vZGUgZWRkPW9mZgooWEVOKSBWaWRlbyBpbmZvcm1h dGlvbjoKKFhFTikgIFZHQSBpcyB0ZXh0IG1vZGUgODB4MjUsIGZvbnQgOHgxNgooWEVOKSBEaXNj IGluZm9ybWF0aW9uOgooWEVOKSAgRm91bmQgMCBNQlIgc2lnbmF0dXJlcwooWEVOKSAgRm91bmQg MCBFREQgaW5mb3JtYXRpb24gc3RydWN0dXJlcwooWEVOKSBNdWx0aWJvb3QtZTgyMCBSQU0gbWFw OgooWEVOKSAgMDAwMDAwMDAwMDAwMDAwMCAtIDAwMDAwMDAwMDAwYTAwMDAgKHVzYWJsZSkKKFhF TikgIDAwMDAwMDAwMDAxMDAwMDAgLSAwMDAwMDAwMGFhN2Q5MDAwICh1c2FibGUpCihYRU4pICAw MDAwMDAwMGFhN2Q5MDAwIC0gMDAwMDAwMDBhYWFiNTAwMCAocmVzZXJ2ZWQpCihYRU4pICAwMDAw MDAwMGFhYWI1MDAwIC0gMDAwMDAwMDBhYWFjNTAwMCAoQUNQSSBkYXRhKQooWEVOKSAgMDAwMDAw MDBhYWFjNTAwMCAtIDAwMDAwMDAwYWI4YzgwMDAgKEFDUEkgTlZTKQooWEVOKSAgMDAwMDAwMDBh YjhjODAwMCAtIDAwMDAwMDAwYWNhMzcwMDAgKHJlc2VydmVkKQooWEVOKSAgMDAwMDAwMDBhY2Ez NzAwMCAtIDAwMDAwMDAwYWNhMzgwMDAgKHVzYWJsZSkKKFhFTikgIDAwMDAwMDAwYWNhMzgwMDAg LSAwMDAwMDAwMGFjYzNlMDAwIChBQ1BJIE5WUykKKFhFTikgIDAwMDAwMDAwYWNjM2UwMDAgLSAw MDAwMDAwMGFkMDgzMDAwICh1c2FibGUpCihYRU4pICAwMDAwMDAwMGFkMDgzMDAwIC0gMDAwMDAw MDBhZDdmNDAwMCAocmVzZXJ2ZWQpCihYRU4pICAwMDAwMDAwMGFkN2Y0MDAwIC0gMDAwMDAwMDBh ZDgwMDAwMCAodXNhYmxlKQooWEVOKSAgMDAwMDAwMDBmODAwMDAwMCAtIDAwMDAwMDAwZmMwMDAw MDAgKHJlc2VydmVkKQooWEVOKSAgMDAwMDAwMDBmZWMwMDAwMCAtIDAwMDAwMDAwZmVjMDEwMDAg KHJlc2VydmVkKQooWEVOKSAgMDAwMDAwMDBmZWMxMDAwMCAtIDAwMDAwMDAwZmVjMTEwMDAgKHJl c2VydmVkKQooWEVOKSAgMDAwMDAwMDBmZWMyMDAwMCAtIDAwMDAwMDAwZmVjMjEwMDAgKHJlc2Vy dmVkKQooWEVOKSAgMDAwMDAwMDBmZWQwMDAwMCAtIDAwMDAwMDAwZmVkMDEwMDAgKHJlc2VydmVk KQooWEVOKSAgMDAwMDAwMDBmZWQ2MTAwMCAtIDAwMDAwMDAwZmVkNzEwMDAgKHJlc2VydmVkKQoo WEVOKSAgMDAwMDAwMDBmZWQ4MDAwMCAtIDAwMDAwMDAwZmVkOTAwMDAgKHJlc2VydmVkKQooWEVO KSAgMDAwMDAwMDBmZWYwMDAwMCAtIDAwMDAwMDAxMDAwMDAwMDAgKHJlc2VydmVkKQooWEVOKSAg MDAwMDAwMDEwMDAwMTAwMCAtIDAwMDAwMDA0NGYwMDAwMDAgKHVzYWJsZSkKKFhFTikgQUNQSTog UlNEUCAwMDBGRDUzMCwgMDAyNCAocjIgQUxBU0tBKQooWEVOKSBBQ1BJOiBYU0RUIEFBQUJEMDcw LCAwMDVDIChyMSBBTEFTS0EgICAgQSBNIEkgIDEwNzIwMDkgQU1JICAgICAxMDAxMykKKFhFTikg QUNQSTogRkFDUCBBQUFDNDFFOCwgMDEwQyAocjUgQUxBU0tBICAgIEEgTSBJICAxMDcyMDA5IEFN SSAgICAgMTAwMTMpCihYRU4pIEFDUEkgV2FybmluZyAodGJmYWR0LTA0NjQpOiBPcHRpb25hbCBm aWVsZCAiUG0yQ29udHJvbEJsb2NrIiBoYXMgemVybyBhZGRyZXNzIG9yIGxlbmd0aDogMDAwMDAw MDAwMDAwMDAwMC8xIFsyMDA3MDEyNl0KKFhFTikgQUNQSTogRFNEVCBBQUFCRDE2OCwgNzA3OSAo cjIgQUxBU0tBICAgIEEgTSBJICAgICAgICAwIElOVEwgMjAwNTExMTcpCihYRU4pIEFDUEk6IEZB Q1MgQUI4QzJGODAsIDAwNDAKKFhFTikgQUNQSTogQVBJQyBBQUFDNDJGOCwgMDA4RSAocjMgQUxB U0tBICAgIEEgTSBJICAxMDcyMDA5IEFNSSAgICAgMTAwMTMpCihYRU4pIEFDUEk6IEZQRFQgQUFB QzQzODgsIDAwNDQgKHIxIEFMQVNLQSAgICBBIE0gSSAgMTA3MjAwOSBBTUkgICAgIDEwMDEzKQoo WEVOKSBBQ1BJOiBNQ0ZHIEFBQUM0M0QwLCAwMDNDIChyMSBBTEFTS0EgICAgQSBNIEkgIDEwNzIw MDkgTVNGVCAgICAxMDAxMykKKFhFTikgQUNQSTogSFBFVCBBQUFDNDQxMCwgMDAzOCAocjEgQUxB U0tBICAgIEEgTSBJICAxMDcyMDA5IEFNSSAgICAgICAgIDUpCihYRU4pIEFDUEk6IElWUlMgQUFB QzQ2RjAsIDAwRTggKHIxICBBTUQgICAgIFJEODkwUyAgIDIwMjAzMSBBTUQgICAgICAgICAwKQoo WEVOKSBBQ1BJOiBTU0RUIEFBQUM0NEEwLCAwMjRDIChyMSBBTUQgICAgUE9XRVJOT1cgICAgICAg IDEgQU1EICAgICAgICAgMSkKKFhFTikgU3lzdGVtIFJBTTogMTYyODNNQiAoMTY2NzQ2MDBrQikK KFhFTikgTm8gTlVNQSBjb25maWd1cmF0aW9uIGZvdW5kCihYRU4pIEZha2luZyBhIG5vZGUgYXQg MDAwMDAwMDAwMDAwMDAwMC0wMDAwMDAwNDRmMDAwMDAwCihYRU4pIERvbWFpbiBoZWFwIGluaXRp YWxpc2VkCihYRU4pIERNSSAyLjcgcHJlc2VudC4KKFhFTikgVXNpbmcgQVBJQyBkcml2ZXIgZGVm YXVsdAooWEVOKSBBQ1BJOiBQTS1UaW1lciBJTyBQb3J0OiAweDgwOAooWEVOKSBBQ1BJOiB2NSBT TEVFUCBJTkZPOiBjb250cm9sWzA6MF0sIHN0YXR1c1swOjBdCihYRU4pIEFDUEk6IFNMRUVQIElO Rk86IHBtMXhfY250WzgwNCwwXSwgcG0xeF9ldnRbODAwLDBdCihYRU4pIEFDUEk6IDMyLzY0WCBG QUNTIGFkZHJlc3MgbWlzbWF0Y2ggaW4gRkFEVCAtIGFiOGMyZjgwLzAwMDAwMDAwMDAwMDAwMDAs IHVzaW5nIDMyCihYRU4pIEFDUEk6ICAgICAgICAgICAgIHdha2V1cF92ZWNbYWI4YzJmOGNdLCB2 ZWNfc2l6ZVsyMF0KKFhFTikgQUNQSTogTG9jYWwgQVBJQyBhZGRyZXNzIDB4ZmVlMDAwMDAKKFhF TikgQUNQSTogTEFQSUMgKGFjcGlfaWRbMHgwMV0gbGFwaWNfaWRbMHgxMF0gZW5hYmxlZCkKKFhF TikgUHJvY2Vzc29yICMxNiA1OjIgQVBJQyB2ZXJzaW9uIDE2CihYRU4pIEFDUEk6IExBUElDIChh Y3BpX2lkWzB4MDJdIGxhcGljX2lkWzB4MTFdIGVuYWJsZWQpCihYRU4pIFByb2Nlc3NvciAjMTcg NToyIEFQSUMgdmVyc2lvbiAxNgooWEVOKSBBQ1BJOiBMQVBJQyAoYWNwaV9pZFsweDAzXSBsYXBp Y19pZFsweDEyXSBlbmFibGVkKQooWEVOKSBQcm9jZXNzb3IgIzE4IDU6MiBBUElDIHZlcnNpb24g MTYKKFhFTikgQUNQSTogTEFQSUMgKGFjcGlfaWRbMHgwNF0gbGFwaWNfaWRbMHgxM10gZW5hYmxl ZCkKKFhFTikgUHJvY2Vzc29yICMxOSA1OjIgQVBJQyB2ZXJzaW9uIDE2CihYRU4pIEFDUEk6IExB UElDIChhY3BpX2lkWzB4MDVdIGxhcGljX2lkWzB4MTRdIGVuYWJsZWQpCihYRU4pIFByb2Nlc3Nv ciAjMjAgNToyIEFQSUMgdmVyc2lvbiAxNgooWEVOKSBBQ1BJOiBMQVBJQyAoYWNwaV9pZFsweDA2 XSBsYXBpY19pZFsweDE1XSBlbmFibGVkKQooWEVOKSBQcm9jZXNzb3IgIzIxIDU6MiBBUElDIHZl cnNpb24gMTYKKFhFTikgQUNQSTogTEFQSUNfTk1JIChhY3BpX2lkWzB4ZmZdIGhpZ2ggZWRnZSBs aW50WzB4MV0pCihYRU4pIEFDUEk6IElPQVBJQyAoaWRbMHgwN10gYWRkcmVzc1sweGZlYzAwMDAw XSBnc2lfYmFzZVswXSkKKFhFTikgSU9BUElDWzBdOiBhcGljX2lkIDcsIHZlcnNpb24gMzMsIGFk ZHJlc3MgMHhmZWMwMDAwMCwgR1NJIDAtMjMKKFhFTikgQUNQSTogSU9BUElDIChpZFsweDA4XSBh ZGRyZXNzWzB4ZmVjMjAwMDBdIGdzaV9iYXNlWzI0XSkKKFhFTikgSU9BUElDWzFdOiBhcGljX2lk IDgsIHZlcnNpb24gMzMsIGFkZHJlc3MgMHhmZWMyMDAwMCwgR1NJIDI0LTU1CihYRU4pIEFDUEk6 IElOVF9TUkNfT1ZSIChidXMgMCBidXNfaXJxIDAgZ2xvYmFsX2lycSAyIGRmbCBkZmwpCihYRU4p IEFDUEk6IElOVF9TUkNfT1ZSIChidXMgMCBidXNfaXJxIDkgZ2xvYmFsX2lycSA5IGxvdyBsZXZl bCkKKFhFTikgQUNQSTogSVJRMCB1c2VkIGJ5IG92ZXJyaWRlLgooWEVOKSBBQ1BJOiBJUlEyIHVz ZWQgYnkgb3ZlcnJpZGUuCihYRU4pIEFDUEk6IElSUTkgdXNlZCBieSBvdmVycmlkZS4KKFhFTikg RW5hYmxpbmcgQVBJQyBtb2RlOiAgRmxhdC4gIFVzaW5nIDIgSS9PIEFQSUNzCihYRU4pIEFDUEk6 IEhQRVQgaWQ6IDB4NDM1MzgyMTAgYmFzZTogMHhmZWQwMDAwMAooWEVOKSBFUlNUIHRhYmxlIHdh cyBub3QgZm91bmQKKFhFTikgVXNpbmcgQUNQSSAoTUFEVCkgZm9yIFNNUCBjb25maWd1cmF0aW9u IGluZm9ybWF0aW9uCihYRU4pIFNNUDogQWxsb3dpbmcgNiBDUFVzICgwIGhvdHBsdWcgQ1BVcykK KFhFTikgSVJRIGxpbWl0czogNTYgR1NJLCAxMTEyIE1TSS9NU0ktWAooWEVOKSBVc2luZyBzY2hl ZHVsZXI6IFNNUCBDcmVkaXQgU2NoZWR1bGVyIChjcmVkaXQpCihYRU4pIERldGVjdGVkIDQ2MTUu ODA1IE1IeiBwcm9jZXNzb3IuCihYRU4pIEluaXRpbmcgbWVtb3J5IHNoYXJpbmcuCihYRU4pIHhz dGF0ZV9pbml0OiB1c2luZyBjbnR4dF9zaXplOiAweDNjMCBhbmQgc3RhdGVzOiAweDQwMDAwMDAw MDAwMDAwMDcKKFhFTikgQU1EIEZhbTE1aCBtYWNoaW5lIGNoZWNrIHJlcG9ydGluZyBlbmFibGVk CihYRU4pIFBDSTogTUNGRyBjb25maWd1cmF0aW9uIDA6IGJhc2UgZTAwMDAwMDAgc2VnbWVudCAw MDAwIGJ1c2VzIDAwIC0gZmYKKFhFTikgUENJOiBOb3QgdXNpbmcgTUNGRyBmb3Igc2VnbWVudCAw MDAwIGJ1cyAwMC1mZgooWEVOKSBBTUQtVmk6IElPTU1VIDAgRW5hYmxlZC4KKFhFTikgSS9PIHZp cnR1YWxpc2F0aW9uIGVuYWJsZWQKKFhFTikgIC0gRG9tMCBtb2RlOiBSZWxheGVkCihYRU4pIElu dGVycnVwdCByZW1hcHBpbmcgZW5hYmxlZAooWEVOKSBFTkFCTElORyBJTy1BUElDIElSUXMKKFhF TikgIC0+IFVzaW5nIG5ldyBBQ0sgbWV0aG9kCihYRU4pIC4uVElNRVI6IHZlY3Rvcj0weEYwIGFw aWMxPTAgcGluMT0yIGFwaWMyPS0xIHBpbjI9LTEKKFhFTikgUGxhdGZvcm0gdGltZXIgaXMgMTQu MzE4TUh6IEhQRVQKKFhFTikgQWxsb2NhdGVkIGNvbnNvbGUgcmluZyBvZiA2NCBLaUIuCihYRU4p IEhWTTogQVNJRHMgZW5hYmxlZC4KKFhFTikgU1ZNOiBTdXBwb3J0ZWQgYWR2YW5jZWQgZmVhdHVy ZXM6CihYRU4pICAtIE5lc3RlZCBQYWdlIFRhYmxlcyAoTlBUKQooWEVOKSAgLSBMYXN0IEJyYW5j aCBSZWNvcmQgKExCUikgVmlydHVhbGlzYXRpb24KKFhFTikgIC0gTmV4dC1SSVAgU2F2ZWQgb24g I1ZNRVhJVAooWEVOKSAgLSBWTUNCIENsZWFuIEJpdHMKKFhFTikgIC0gRGVjb2RlQXNzaXN0cwoo WEVOKSAgLSBQYXVzZS1JbnRlcmNlcHQgRmlsdGVyCihYRU4pICAtIFRTQyBSYXRlIE1TUgooWEVO KSBIVk06IFNWTSBlbmFibGVkCihYRU4pIEhWTTogSGFyZHdhcmUgQXNzaXN0ZWQgUGFnaW5nIChI QVApIGRldGVjdGVkCihYRU4pIEhWTTogSEFQIHBhZ2Ugc2l6ZXM6IDRrQiwgMk1CLCAxR0IKKFhF TikgSFZNOiBQVkggbW9kZSBub3Qgc3VwcG9ydGVkIG9uIHRoaXMgcGxhdGZvcm0KKFhFTikgbWlj cm9jb2RlOiBDUFUxIGNvbGxlY3RfY3B1X2luZm86IHBhdGNoX2lkPTB4NjAwMDgxZgooWEVOKSBt aWNyb2NvZGU6IENQVTIgY29sbGVjdF9jcHVfaW5mbzogcGF0Y2hfaWQ9MHg2MDAwODFmCihYRU4p IG1pY3JvY29kZTogQ1BVMyBjb2xsZWN0X2NwdV9pbmZvOiBwYXRjaF9pZD0weDYwMDA4MWYKKFhF TikgbWljcm9jb2RlOiBDUFU0IGNvbGxlY3RfY3B1X2luZm86IHBhdGNoX2lkPTB4NjAwMDgxZgoo WEVOKSBtaWNyb2NvZGU6IENQVTUgY29sbGVjdF9jcHVfaW5mbzogcGF0Y2hfaWQ9MHg2MDAwODFm CihYRU4pIEJyb3VnaHQgdXAgNiBDUFVzCihYRU4pIEFDUEkgc2xlZXAgbW9kZXM6IFMzCihYRU4p IE1DQTogVXNlIGh3IHRocmVzaG9sZGluZyB0byBhZGp1c3QgcG9sbGluZyBmcmVxdWVuY3kKKFhF TikgbWNoZWNrX3BvbGw6IE1hY2hpbmUgY2hlY2sgcG9sbGluZyB0aW1lciBzdGFydGVkLgooWEVO KSAqKiogTE9BRElORyBET01BSU4gMCAqKioKKFhFTikgZWxmX3BhcnNlX2JpbmFyeTogcGhkcjog cGFkZHI9MHgxMDAwMDAwIG1lbXN6PTB4YWNkMDAwCihYRU4pIGVsZl9wYXJzZV9iaW5hcnk6IHBo ZHI6IHBhZGRyPTB4MWMwMDAwMCBtZW1zej0weGY4MGYwCihYRU4pIGVsZl9wYXJzZV9iaW5hcnk6 IHBoZHI6IHBhZGRyPTB4MWNmOTAwMCBtZW1zej0weDE0ZTQwCihYRU4pIGVsZl9wYXJzZV9iaW5h cnk6IHBoZHI6IHBhZGRyPTB4MWQwZTAwMCBtZW1zej0weDZmOTAwMAooWEVOKSBlbGZfcGFyc2Vf YmluYXJ5OiBtZW1vcnk6IDB4MTAwMDAwMCAtPiAweDI0MDcwMDAKKFhFTikgZWxmX3hlbl9wYXJz ZV9ub3RlOiBHVUVTVF9PUyA9ICJsaW51eCIKKFhFTikgZWxmX3hlbl9wYXJzZV9ub3RlOiBHVUVT VF9WRVJTSU9OID0gIjIuNiIKKFhFTikgZWxmX3hlbl9wYXJzZV9ub3RlOiBYRU5fVkVSU0lPTiA9 ICJ4ZW4tMy4wIgooWEVOKSBlbGZfeGVuX3BhcnNlX25vdGU6IFZJUlRfQkFTRSA9IDB4ZmZmZmZm ZmY4MDAwMDAwMAooWEVOKSBlbGZfeGVuX3BhcnNlX25vdGU6IEVOVFJZID0gMHhmZmZmZmZmZjgx ZDBlMWUwCihYRU4pIGVsZl94ZW5fcGFyc2Vfbm90ZTogSFlQRVJDQUxMX1BBR0UgPSAweGZmZmZm ZmZmODEwMDEwMDAKKFhFTikgZWxmX3hlbl9wYXJzZV9ub3RlOiBGRUFUVVJFUyA9ICIhd3JpdGFi bGVfcGFnZV90YWJsZXN8cGFlX3BnZGlyX2Fib3ZlXzRnYiIKKFhFTikgZWxmX3hlbl9wYXJzZV9u b3RlOiBQQUVfTU9ERSA9ICJ5ZXMiCihYRU4pIGVsZl94ZW5fcGFyc2Vfbm90ZTogTE9BREVSID0g ImdlbmVyaWMiCihYRU4pIGVsZl94ZW5fcGFyc2Vfbm90ZTogdW5rbm93biB4ZW4gZWxmIG5vdGUg KDB4ZCkKKFhFTikgZWxmX3hlbl9wYXJzZV9ub3RlOiBTVVNQRU5EX0NBTkNFTCA9IDB4MQooWEVO KSBlbGZfeGVuX3BhcnNlX25vdGU6IEhWX1NUQVJUX0xPVyA9IDB4ZmZmZjgwMDAwMDAwMDAwMAoo WEVOKSBlbGZfeGVuX3BhcnNlX25vdGU6IFBBRERSX09GRlNFVCA9IDB4MAooWEVOKSBlbGZfeGVu X2FkZHJfY2FsY19jaGVjazogYWRkcmVzc2VzOgooWEVOKSAgICAgdmlydF9iYXNlICAgICAgICA9 IDB4ZmZmZmZmZmY4MDAwMDAwMAooWEVOKSAgICAgZWxmX3BhZGRyX29mZnNldCA9IDB4MAooWEVO KSAgICAgdmlydF9vZmZzZXQgICAgICA9IDB4ZmZmZmZmZmY4MDAwMDAwMAooWEVOKSAgICAgdmly dF9rc3RhcnQgICAgICA9IDB4ZmZmZmZmZmY4MTAwMDAwMAooWEVOKSAgICAgdmlydF9rZW5kICAg ICAgICA9IDB4ZmZmZmZmZmY4MjQwNzAwMAooWEVOKSAgICAgdmlydF9lbnRyeSAgICAgICA9IDB4 ZmZmZmZmZmY4MWQwZTFlMAooWEVOKSAgICAgcDJtX2Jhc2UgICAgICAgICA9IDB4ZmZmZmZmZmZm ZmZmZmZmZgooWEVOKSAgWGVuICBrZXJuZWw6IDY0LWJpdCwgbHNiLCBjb21wYXQzMgooWEVOKSAg RG9tMCBrZXJuZWw6IDY0LWJpdCwgUEFFLCBsc2IsIHBhZGRyIDB4MTAwMDAwMCAtPiAweDI0MDcw MDAKKFhFTikgUEhZU0lDQUwgTUVNT1JZIEFSUkFOR0VNRU5UOgooWEVOKSAgRG9tMCBhbGxvYy46 ICAgMDAwMDAwMDQzYzAwMDAwMC0+MDAwMDAwMDQ0MDAwMDAwMCAoMjA3NTQzMSBwYWdlcyB0byBi ZSBhbGxvY2F0ZWQpCihYRU4pICBJbml0LiByYW1kaXNrOiAwMDAwMDAwNDRkYjI3MDAwLT4wMDAw MDAwNDRlZmZmNjAwCihYRU4pIFZJUlRVQUwgTUVNT1JZIEFSUkFOR0VNRU5UOgooWEVOKSAgTG9h ZGVkIGtlcm5lbDogZmZmZmZmZmY4MTAwMDAwMC0+ZmZmZmZmZmY4MjQwNzAwMAooWEVOKSAgSW5p dC4gcmFtZGlzazogZmZmZmZmZmY4MjQwNzAwMC0+ZmZmZmZmZmY4MzhkZjYwMAooWEVOKSAgUGh5 cy1NYWNoIG1hcDogZmZmZmZmZmY4MzhlMDAwMC0+ZmZmZmZmZmY4NDhlMDAwMAooWEVOKSAgU3Rh cnQgaW5mbzogICAgZmZmZmZmZmY4NDhlMDAwMC0+ZmZmZmZmZmY4NDhlMDRiNAooWEVOKSAgUGFn ZSB0YWJsZXM6ICAgZmZmZmZmZmY4NDhlMTAwMC0+ZmZmZmZmZmY4NDkwYTAwMAooWEVOKSAgQm9v dCBzdGFjazogICAgZmZmZmZmZmY4NDkwYTAwMC0+ZmZmZmZmZmY4NDkwYjAwMAooWEVOKSAgVE9U QUw6ICAgICAgICAgZmZmZmZmZmY4MDAwMDAwMC0+ZmZmZmZmZmY4NGMwMDAwMAooWEVOKSAgRU5U UlkgQUREUkVTUzogZmZmZmZmZmY4MWQwZTFlMAooWEVOKSBEb20wIGhhcyBtYXhpbXVtIDYgVkNQ VXMKKFhFTikgZWxmX2xvYWRfYmluYXJ5OiBwaGRyIDAgYXQgMHhmZmZmZmZmZjgxMDAwMDAwIC0+ IDB4ZmZmZmZmZmY4MWFjZDAwMAooWEVOKSBlbGZfbG9hZF9iaW5hcnk6IHBoZHIgMSBhdCAweGZm ZmZmZmZmODFjMDAwMDAgLT4gMHhmZmZmZmZmZjgxY2Y4MGYwCihYRU4pIGVsZl9sb2FkX2JpbmFy eTogcGhkciAyIGF0IDB4ZmZmZmZmZmY4MWNmOTAwMCAtPiAweGZmZmZmZmZmODFkMGRlNDAKKFhF TikgZWxmX2xvYWRfYmluYXJ5OiBwaGRyIDMgYXQgMHhmZmZmZmZmZjgxZDBlMDAwIC0+IDB4ZmZm ZmZmZmY4MWU2MzAwMAooWEVOKSBTY3J1YmJpbmcgRnJlZSBSQU06IC4uLi4uLi4uLi4uLi4uLi4u Li4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4uLi4u Li4uLi4uZG9uZS4KKFhFTikgSW5pdGlhbCBsb3cgbWVtb3J5IHZpcnEgdGhyZXNob2xkIHNldCBh dCAweDQwMDAgcGFnZXMuCihYRU4pIFN0ZC4gTG9nbGV2ZWw6IEFsbAooWEVOKSBHdWVzdCBMb2ds ZXZlbDogQWxsCihYRU4pIFhlbiBpcyByZWxpbnF1aXNoaW5nIFZHQSBjb25zb2xlLgooWEVOKSAq KiogU2VyaWFsIGlucHV0IC0+IERPTTAgKHR5cGUgJ0NUUkwtYScgdGhyZWUgdGltZXMgdG8gc3dp dGNoIGlucHV0IHRvIFhlbikKKFhFTikgRnJlZWQgMjU2a0IgaW5pdCBtZW1vcnkuCihYRU4pIHRy YXBzLmM6MjUxNjpkMCBEb21haW4gYXR0ZW1wdGVkIFdSTVNSIDAwMDAwMDAwYzAwMTAyMDEgZnJv bSAweDAwMDAwMDAwMDAwMDAwMDAgdG8gMHgwMDAwMDAwMDAwMDBmZmZmLgooWEVOKSBQQ0kgYWRk IGRldmljZSAwMDAwOjAwOjAwLjAKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDowMDowMC4yCihY RU4pIFBDSSBhZGQgZGV2aWNlIDAwMDA6MDA6MDIuMAooWEVOKSBQQ0kgYWRkIGRldmljZSAwMDAw OjAwOjAzLjAKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDowMDowNC4wCihYRU4pIFBDSSBhZGQg ZGV2aWNlIDAwMDA6MDA6MDUuMAooWEVOKSBQQ0kgYWRkIGRldmljZSAwMDAwOjAwOjA2LjAKKFhF TikgUENJIGFkZCBkZXZpY2UgMDAwMDowMDowNy4wCihYRU4pIFBDSSBhZGQgZGV2aWNlIDAwMDA6 MDA6MDkuMAooWEVOKSBQQ0kgYWRkIGRldmljZSAwMDAwOjAwOjExLjAKKFhFTikgUENJIGFkZCBk ZXZpY2UgMDAwMDowMDoxMi4wCihYRU4pIFBDSSBhZGQgZGV2aWNlIDAwMDA6MDA6MTIuMgooWEVO KSBQQ0kgYWRkIGRldmljZSAwMDAwOjAwOjEzLjAKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDow MDoxMy4yCihYRU4pIFBDSSBhZGQgZGV2aWNlIDAwMDA6MDA6MTQuMAooWEVOKSBQQ0kgYWRkIGRl dmljZSAwMDAwOjAwOjE0LjIKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDowMDoxNC4zCihYRU4p IFBDSSBhZGQgZGV2aWNlIDAwMDA6MDA6MTQuNAooWEVOKSBQQ0kgYWRkIGRldmljZSAwMDAwOjAw OjE0LjUKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDowMDoxNi4wCihYRU4pIFBDSSBhZGQgZGV2 aWNlIDAwMDA6MDA6MTYuMgooWEVOKSBQQ0kgYWRkIGRldmljZSAwMDAwOjAwOjE4LjAKKFhFTikg UENJIGFkZCBkZXZpY2UgMDAwMDowMDoxOC4xCihYRU4pIFBDSSBhZGQgZGV2aWNlIDAwMDA6MDA6 MTguMgooWEVOKSBQQ0kgYWRkIGRldmljZSAwMDAwOjAwOjE4LjMKKFhFTikgUENJIGFkZCBkZXZp Y2UgMDAwMDowMDoxOC40CihYRU4pIFBDSSBhZGQgZGV2aWNlIDAwMDA6MDA6MTguNQooWEVOKSBQ Q0kgYWRkIGRldmljZSAwMDAwOjAxOjAwLjAKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDowMTow MC4xCihYRU4pIFBDSSBhZGQgZGV2aWNlIDAwMDA6MDI6MDAuMAooWEVOKSBQQ0kgYWRkIGRldmlj ZSAwMDAwOjAyOjAwLjEKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDowMzowMC4wCihYRU4pIFBD SSBhZGQgZGV2aWNlIDAwMDA6MDQ6MDAuMAooWEVOKSBQQ0kgYWRkIGRldmljZSAwMDAwOjA1OjAw LjAKKFhFTikgUENJIGFkZCBkZXZpY2UgMDAwMDowNjowMC4wCihYRU4pIFBDSSBhZGQgZGV2aWNl IDAwMDA6MDc6MDAuMAo= --001a1134989caaac4e04ee219014 Content-Type: text/plain; charset=US-ASCII; name="info.txt" Content-Disposition: attachment; filename="info.txt" Content-Transfer-Encoding: base64 X-Attachment-Id: f_hpiha55q1 aG9zdCAgICAgICAgICAgICAgICAgICA6IEh5cGVydmlzb3IKcmVsZWFzZSAgICAgICAgICAgICAg ICA6IDMuMTEuOS0yMDAuZmMxOS54ODZfNjQKdmVyc2lvbiAgICAgICAgICAgICAgICA6ICMxIFNN UCBXZWQgTm92IDIwIDIxOjIyOjI0IFVUQyAyMDEzCm1hY2hpbmUgICAgICAgICAgICAgICAgOiB4 ODZfNjQKbnJfY3B1cyAgICAgICAgICAgICAgICA6IDYKbWF4X2NwdV9pZCAgICAgICAgICAgICA6 IDUKbnJfbm9kZXMgICAgICAgICAgICAgICA6IDEKY29yZXNfcGVyX3NvY2tldCAgICAgICA6IDMK dGhyZWFkc19wZXJfY29yZSAgICAgICA6IDIKY3B1X21oeiAgICAgICAgICAgICAgICA6IDQ2MTUK aHdfY2FwcyAgICAgICAgICAgICAgICA6IDE3OGJmM2ZmOjJmZDNmYmZmOjAwMDAwMDAwOjAwMDAx NzAwOjM2OTgzMjAzOjAwMDAwMDAwOjAxZWJiZmZmOjAwMDAwMDA4CnZpcnRfY2FwcyAgICAgICAg ICAgICAgOiBodm0gaHZtX2RpcmVjdGlvCnRvdGFsX21lbW9yeSAgICAgICAgICAgOiAxNjI4Mwpm cmVlX21lbW9yeSAgICAgICAgICAgIDogNzkwNwpzaGFyaW5nX2ZyZWVkX21lbW9yeSAgIDogMApz aGFyaW5nX3VzZWRfbWVtb3J5ICAgIDogMApvdXRzdGFuZGluZ19jbGFpbXMgICAgIDogMApmcmVl X2NwdXMgICAgICAgICAgICAgIDogMAp4ZW5fbWFqb3IgICAgICAgICAgICAgIDogNAp4ZW5fbWlu b3IgICAgICAgICAgICAgIDogNAp4ZW5fZXh0cmEgICAgICAgICAgICAgIDogLXVuc3RhYmxlCnhl bl92ZXJzaW9uICAgICAgICAgICAgOiA0LjQtdW5zdGFibGUKeGVuX2NhcHMgICAgICAgICAgICAg ICA6IHhlbi0zLjAteDg2XzY0IHhlbi0zLjAteDg2XzMycCBodm0tMy4wLXg4Nl8zMiBodm0tMy4w LXg4Nl8zMnAgaHZtLTMuMC14ODZfNjQgCnhlbl9zY2hlZHVsZXIgICAgICAgICAgOiBjcmVkaXQK eGVuX3BhZ2VzaXplICAgICAgICAgICA6IDQwOTYKcGxhdGZvcm1fcGFyYW1zICAgICAgICA6IHZp cnRfc3RhcnQ9MHhmZmZmODAwMDAwMDAwMDAwCnhlbl9jaGFuZ2VzZXQgICAgICAgICAgOiBGcmkg RGVjIDIwIDEyOjAyOjA2IDIwMTMgKzAxMDAgZ2l0OjlhODBkNTAKeGVuX2NvbW1hbmRsaW5lICAg ICAgICA6IHBsYWNlaG9sZGVyIGRvbTBfbWVtPTgxOTJNLG1heDo4MTkyTSBkb20wX21heF92Y3B1 cz02IGRvbTBfdmNwdXNfcGluIGlvbW11PTEgbG9nbHZsPWFsbCBndWVzdF9sb2dsdmw9YWxsIG5v LXJlYWwtbW9kZSBlZGQ9b2ZmCmNjX2NvbXBpbGVyICAgICAgICAgICAgOiBnY2MgKEdDQykgNC44 LjIgMjAxMzEyMTIgKFJlZCBIYXQgNC44LjItNykKY2NfY29tcGlsZV9ieSAgICAgICAgICA6IHJv b3QKY2NfY29tcGlsZV9kb21haW4gICAgICA6IApjY19jb21waWxlX2RhdGUgICAgICAgIDogU3Vu IERlYyAyMiAwNzo1ODowNSBDU1QgMjAxMwp4ZW5kX2NvbmZpZ19mb3JtYXQgICAgIDogNAo= --001a1134989caaac4e04ee219014 Content-Type: application/octet-stream; name="win8.cfg" Content-Disposition: attachment; filename="win8.cfg" Content-Transfer-Encoding: base64 X-Attachment-Id: f_hpiham3y2 IyBOYW1lIGZvciB0aGUgSFZNCm5hbWUgICAgICAgICAgICAgICAgID0gIndpbjgiCiMgVXNlIEhW TQpidWlsZGVyICAgICAgICAgICAgICA9ICJodm0iCiMgQ3JlYXRlIDQgY3B1cyBvbiBwaHlzaWNh bCBjb3JlcyAyLTUKdmNwdXMgICAgICAgICAgICAgICAgPSA0CiNjcHVzICAgICAgICAgICAgICAg ICA9IFswLDEsMiwzLDQsNV0KIyA2R0IgbWVtb3J5Cm1lbW9yeSAgICAgICAgICAgICAgID0gNzE2 OAptYXhtZW0gICAgICAgICAgICAgICA9IDcxNjgKIyBVc2UgbHZtIGZvciB3aW5kb3dzIHJvb3Qs IGFuZCBwYXNzIGluIGNkcm9tIGZvciBpbnN0YWxsCmRpc2sgICAgICAgICAgICAgPSBbJ3BoeTov ZGV2L3NkYTYsaGRhLHcnLCAncGh5Oi9kZXYvc3IwLGhkYzpjZHJvbSxyJ10KIyBVbmNvbW1lbnQg YW5kIGNvbmZpZ3VyZSBvbmNlIGlzIGNyZWF0ZWQKdmlmID0gWydicmlkZ2U9dmlyYnIwJ10KIyBC b290IGNkIHJvbSBpZiBIREQgaXMgdW5hdmFpbGFibGUKYm9vdCAgICAgICAgICAgICAgICAgPSAi ZGMiICNkIgojIFVzZSBncmFwaGljcyBjYXJkIChSYWRlb24gNzg1MCkgYXMgc2Vjb25kYXJ5Cmdm eF9wYXNzdGhyb3VnaCAgICAgID0gMAojIFBhc3MgdGhyb3VnaCB2YXJpb3VzIFBDSSBkZXZpY2Vz CiMgMjowMC4wIC0gUmFkZW9uIDY2NzAKIyAyOjAwLjEgLSBSYWRlb24gNjY3MCAoU291bmQpCiMg MDoxMy4wIC0gVVNCIERldmljZXMgKE1vdXNlIC8gS2V5Ym9hcmQpCiMgMDoxMy4yIC0gVVNCIEZs YXNoIERyaXZlIChTYW1lIHBvcnRzKQojcGNpID0gWycwMDoxMy4wJywgJzAwOjEzLjInXSAjIFVz ZSB0aGlzIGZvciBpbml0aWFsIGluc3RhbGwKcGNpICAgICAgICAgICAgICAgICAgPSBbJzAyOjAw LjAnLCAnMDI6MDAuMScsICcwMDoxMy4wJywgJzAwOjEzLjInXQpwY2lfcG93ZXJfbWdtdD0xCnBj aV9tc2l0cmFuc2xhdGUgICAgID0gMAojIFVzZSB0cmFkaXRpb25hbCBwYXRjaGVkIHhlbgpkZXZp Y2VfbW9kZWxfdmVyc2lvbiA9ICJxZW11LXhlbi10cmFkaXRpb25hbCIKIyBBbGxvdyBhY2Nlc3Mg dG8gaXJxIDE4CmlycXMgICAgICAgICAgICAgICAgID0gWycxOCddCiMgUGFzcyB0aHJvdWdoIHZp cmlkaWFuIGluZm9ybWF0aW9uCnZpcmlkaWFuICAgICAgICAgICAgID0gMQp4ZW5fcGxhdGZvcm1f cGNpPTEKIyBTdGFuZGFyZCB2Z2EKdmdhICAgICAgICAgICAgICAgICAgPSAic3RkdmdhIgojIFBh c3MgdGhyb3VnaCB0aW1lCmxvY2FsdGltZSAgICAgICAgICAgID0gMQpocGV0PTEKI2FjcGk9MQph cGljPTEKcGFlPTEKCg== --001a1134989caaac4e04ee219014 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --001a1134989caaac4e04ee219014-- From xen-users-bounces@lists.xen.org Sun Dec 22 17:21:07 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 17:21:07 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VumhH-0007Sd-48; Sun, 22 Dec 2013 17:20:11 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VumhF-0007SY-6H for xen-users@lists.xen.org; Sun, 22 Dec 2013 17:20:09 +0000 Received: from [85.158.139.211:46526] by server-7.bemta-5.messagelabs.com id 8D/76-04824-84F17B25; Sun, 22 Dec 2013 17:20:08 +0000 X-Env-Sender: wargo.john25@gmail.com X-Msg-Ref: server-2.tower-206.messagelabs.com!1387732806!6141453!1 X-Originating-IP: [209.85.217.179] X-SpamReason: No, hits=0.4 required=7.0 tests=HTML_50_60,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 26056 invoked from network); 22 Dec 2013 17:20:07 -0000 Received: from mail-lb0-f179.google.com (HELO mail-lb0-f179.google.com) (209.85.217.179) by server-2.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 22 Dec 2013 17:20:07 -0000 Received: by mail-lb0-f179.google.com with SMTP id w7so1934216lbi.10 for ; Sun, 22 Dec 2013 09:20:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=E2h8fjug4YdE1V5dQmOvm1GmVnJwDZ6F4O3yVlKW/zQ=; b=u+R+MlOOZ1KdsXoZZwyGgE8+1YxyWjvDH0z//yPiK/guRpLFMHhY/9UXsbWHuFnwJE XoPIxH04SMRLJ40ivSMybZ/uSNVoZlsvbOghxwwfVyIUXZxCIHG+vPxcdnuCI4H9kLIu 6nXn2a5ptMtnort3GfhkUFrRPlK7xB+aGrl1IkfZc3UvnZpXDqiX6a2J5FLPgwzAs9kD leCp/ka5BcuBggeYKdg9ULhRArn3edmrUxHAg9IA1jafB15SPlRe6zB5gGeiHhjvchNo sab/QbNs99lBeufb3neunatpEs9Wzs0cMV6gnWEriSeZ06uxiM9pLbvls6BZVjC9SAnv wKXQ== MIME-Version: 1.0 X-Received: by 10.112.77.35 with SMTP id p3mr962828lbw.59.1387732806232; Sun, 22 Dec 2013 09:20:06 -0800 (PST) Received: by 10.114.183.131 with HTTP; Sun, 22 Dec 2013 09:20:06 -0800 (PST) In-Reply-To: <52B70DD9.1000301@citrix.com> References: <52B70DD9.1000301@citrix.com> Date: Sun, 22 Dec 2013 11:20:06 -0600 Message-ID: From: John Wargo To: Andrew Cooper , Xen Users Subject: Re: [Xen-users] [Xen-devel] Undefined Symbol : libxl_cpu_bitmap_alloc X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============1462276363232124158==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============1462276363232124158== Content-Type: multipart/alternative; boundary=001a11c3ff64f57a3604ee22b824 --001a11c3ff64f57a3604ee22b824 Content-Type: text/plain; charset=ISO-8859-1 Andrew, It appears to me that it is trying to use the 4.3 libraries, but I'm not positive, and I don't know how to fix it. *# ldd /usr/sbin/xl* linux-vdso.so.1 => (0x00007fffe6000000) libxlutil.so.4.3 => /lib64/libxlutil.so.4.3 (0x00007ffd05dc8000) libxenlight.so.4.3 => /lib/libxenlight.so.4.3 (0x00000039d9a00000) libxenctrl.so.4.3 => /lib64/libxenctrl.so.4.3 (0x00007ffd05ba0000) libyajl.so.2 => /lib64/libyajl.so.2 (0x0000003faba00000) libpthread.so.0 => /lib64/libpthread.so.0 (0x0000003fa1600000) libc.so.6 => /lib64/libc.so.6 (0x0000003fa0a00000) libxenguest.so.4.3 => /lib64/libxenguest.so.4.3 (0x00007ffd05970000) libxenstore.so.3.0 => /lib64/libxenstore.so.3.0 (0x00007ffd05760000) libblktapctl.so.1.0 => /lib/libblktapctl.so.1.0 (0x0000003fa0e00000) libutil.so.1 => /lib64/libutil.so.1 (0x0000003fc1800000) libuuid.so.1 => /lib64/libuuid.so.1 (0x0000003fa4e00000) libdl.so.2 => /lib64/libdl.so.2 (0x0000003fa1200000) /lib64/ld-linux-x86-64.so.2 (0x0000003fa0600000) libbz2.so.1 => /lib64/libbz2.so.1 (0x00007ffd05550000) liblzma.so.5 => /lib64/liblzma.so.5 (0x0000003fa6e00000) libz.so.1 => /lib64/libz.so.1 (0x0000003fa1a00000) -John On Sun, Dec 22, 2013 at 10:05 AM, Andrew Cooper wrote: > On 22/12/2013 15:57, John Wargo wrote: > > Geniuses, > > I'm not 100% sure where this should go, so I'm going to send it to users > (for help) and to the development list (using 4.4-unstable). > > I just updated to the latest unstable, and every time I try to create my > windows 8 machine, I get the following error: > > >> *# xl -vvv create win8.cfg *Parsing config from win8.cfg >> xl: symbol lookup error: xl: undefined symbol: libxl_cpu_bitmap_alloc > > > Your libxl.so is out of date with respect to xl. (Although I would expect > your instructions below to be sufficient) > > Can you use ldd to find out which library xl is attempting to use? > > ~Andrew > > > To install it, I ran *make uninstall* on my old xen source. > > Then I followed the usual: > > *git clone git://xenbits.xen.org/xen.git > * > *cd xen* > *./configure --prefix=/usr --libdir=/usr/lib64* > *make world* > *patch -p1 < ati-passthrough.patch* > *make world* > *make install* > */sbin/ldconfig* > *reboot* > > Attached are the outputs of *xl info* and *xl dmesg*, in addition to my > windows 8 config. > > If any more information is needed, just ask. > > -John > > > _______________________________________________ > Xen-devel mailing listXen-devel@lists.xen.orghttp://lists.xen.org/xen-devel > > > --001a11c3ff64f57a3604ee22b824 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Andrew,

It appears to me that it is try= ing to use the 4.3 libraries, but I'm not positive, and I don't kno= w how to fix it.

# ldd /usr/sbin/xl
=A0 =A0 =A0 =A0 linux-vdso.so.1 =3D> =A0(0x00007fffe6000000)
<= div>=A0 =A0 =A0 =A0 libxlutil.so.4.3 =3D> /lib64/libxlutil.so.4.3 (0x000= 07ffd05dc8000)
=A0 =A0 =A0 =A0 libxenlight.so.4.3 =3D> /lib/li= bxenlight.so.4.3 (0x00000039d9a00000)
=A0 =A0 =A0 =A0 libxenctrl.so.4.3 =3D> /lib64/libxenctrl.so.4.3 (0x= 00007ffd05ba0000)
=A0 =A0 =A0 =A0 libyajl.so.2 =3D> /lib64/lib= yajl.so.2 (0x0000003faba00000)
=A0 =A0 =A0 =A0 libpthread.so.0 = =3D> /lib64/libpthread.so.0 (0x0000003fa1600000)
=A0 =A0 =A0 =A0 libc.so.6 =3D> /lib64/libc.so.6 (0x0000003fa0a00000= )
=A0 =A0 =A0 =A0 libxenguest.so.4.3 =3D> /lib64/libxenguest.s= o.4.3 (0x00007ffd05970000)
=A0 =A0 =A0 =A0 libxenstore.so.3.0 =3D= > /lib64/libxenstore.so.3.0 (0x00007ffd05760000)
=A0 =A0 =A0 =A0 libblktapctl.so.1.0 =3D> /lib/libblktapctl.so.1.0 (= 0x0000003fa0e00000)
=A0 =A0 =A0 =A0 libutil.so.1 =3D> /lib64/l= ibutil.so.1 (0x0000003fc1800000)
=A0 =A0 =A0 =A0 libuuid.so.1 =3D= > /lib64/libuuid.so.1 (0x0000003fa4e00000)
=A0 =A0 =A0 =A0 libdl.so.2 =3D> /lib64/libdl.so.2 (0x0000003fa12000= 00)
=A0 =A0 =A0 =A0 /lib64/ld-linux-x86-64.so.2 (0x0000003fa06000= 00)
=A0 =A0 =A0 =A0 libbz2.so.1 =3D> /lib64/libbz2.so.1 (0x000= 07ffd05550000)
=A0 =A0 =A0 =A0 liblzma.so.5 =3D> /lib64/liblzma.so.5 (0x0000003fa6e0000= 0)
=A0 =A0 =A0 =A0 libz.so.1 =3D> /lib64/libz.so.1 (0x0000003f= a1a00000)

-John

On Sun, Dec 22, 2013 at 10:05 AM, Andrew Cooper <andrew.cooper3@ci= trix.com> wrote:
=20 =20 =20
On 22/12/2013 15:57, John Wargo wrote:
=20
Geniuses,

I'm not 100% sure where this should go, so I'm going t= o send it to users (for help) and to the development list (using 4.4-unstable).

I just updated to the latest unstable, and every time I try to create my windows 8 machine, I get the following error:

# xl -vvv create win8.cfg
Parsing config from win8.cfg
xl: symbol lookup error: xl: undefined symbol: libxl_cpu_bitmap_alloc

Your libxl.so is out of date with respect to xl.=A0 (Although I would expect your instructions below to be sufficient)

Can you use ldd to find out which library xl is attempting to use?

~Andrew


To install it, I ran make uninstall=A0on my old xen source.

Then I followed the usual:

git clone git://xenbits.xen.org/xen.git
cd xen
./configure --prefix=3D/usr --libdir=3D/usr/lib64
make world
patch -p1 < ati-passthrough.patch
make world
make install
/sbin/ldconfig
reboot

Attached are the outputs of xl info=A0and xl dmesg, in addition to my windows 8 config.

If any more information is needed, just ask.

-John


_______________________________________________
Xen-devel mailing list
Xen-devel@list=
s.xen.org
http://lists.x=
en.org/xen-devel


--001a11c3ff64f57a3604ee22b824-- --===============1462276363232124158== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============1462276363232124158==-- From xen-users-bounces@lists.xen.org Sun Dec 22 17:21:07 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 17:21:07 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VumhH-0007Sd-48; Sun, 22 Dec 2013 17:20:11 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VumhF-0007SY-6H for xen-users@lists.xen.org; Sun, 22 Dec 2013 17:20:09 +0000 Received: from [85.158.139.211:46526] by server-7.bemta-5.messagelabs.com id 8D/76-04824-84F17B25; Sun, 22 Dec 2013 17:20:08 +0000 X-Env-Sender: wargo.john25@gmail.com X-Msg-Ref: server-2.tower-206.messagelabs.com!1387732806!6141453!1 X-Originating-IP: [209.85.217.179] X-SpamReason: No, hits=0.4 required=7.0 tests=HTML_50_60,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 26056 invoked from network); 22 Dec 2013 17:20:07 -0000 Received: from mail-lb0-f179.google.com (HELO mail-lb0-f179.google.com) (209.85.217.179) by server-2.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 22 Dec 2013 17:20:07 -0000 Received: by mail-lb0-f179.google.com with SMTP id w7so1934216lbi.10 for ; Sun, 22 Dec 2013 09:20:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=E2h8fjug4YdE1V5dQmOvm1GmVnJwDZ6F4O3yVlKW/zQ=; b=u+R+MlOOZ1KdsXoZZwyGgE8+1YxyWjvDH0z//yPiK/guRpLFMHhY/9UXsbWHuFnwJE XoPIxH04SMRLJ40ivSMybZ/uSNVoZlsvbOghxwwfVyIUXZxCIHG+vPxcdnuCI4H9kLIu 6nXn2a5ptMtnort3GfhkUFrRPlK7xB+aGrl1IkfZc3UvnZpXDqiX6a2J5FLPgwzAs9kD leCp/ka5BcuBggeYKdg9ULhRArn3edmrUxHAg9IA1jafB15SPlRe6zB5gGeiHhjvchNo sab/QbNs99lBeufb3neunatpEs9Wzs0cMV6gnWEriSeZ06uxiM9pLbvls6BZVjC9SAnv wKXQ== MIME-Version: 1.0 X-Received: by 10.112.77.35 with SMTP id p3mr962828lbw.59.1387732806232; Sun, 22 Dec 2013 09:20:06 -0800 (PST) Received: by 10.114.183.131 with HTTP; Sun, 22 Dec 2013 09:20:06 -0800 (PST) In-Reply-To: <52B70DD9.1000301@citrix.com> References: <52B70DD9.1000301@citrix.com> Date: Sun, 22 Dec 2013 11:20:06 -0600 Message-ID: From: John Wargo To: Andrew Cooper , Xen Users Subject: Re: [Xen-users] [Xen-devel] Undefined Symbol : libxl_cpu_bitmap_alloc X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============1462276363232124158==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============1462276363232124158== Content-Type: multipart/alternative; boundary=001a11c3ff64f57a3604ee22b824 --001a11c3ff64f57a3604ee22b824 Content-Type: text/plain; charset=ISO-8859-1 Andrew, It appears to me that it is trying to use the 4.3 libraries, but I'm not positive, and I don't know how to fix it. *# ldd /usr/sbin/xl* linux-vdso.so.1 => (0x00007fffe6000000) libxlutil.so.4.3 => /lib64/libxlutil.so.4.3 (0x00007ffd05dc8000) libxenlight.so.4.3 => /lib/libxenlight.so.4.3 (0x00000039d9a00000) libxenctrl.so.4.3 => /lib64/libxenctrl.so.4.3 (0x00007ffd05ba0000) libyajl.so.2 => /lib64/libyajl.so.2 (0x0000003faba00000) libpthread.so.0 => /lib64/libpthread.so.0 (0x0000003fa1600000) libc.so.6 => /lib64/libc.so.6 (0x0000003fa0a00000) libxenguest.so.4.3 => /lib64/libxenguest.so.4.3 (0x00007ffd05970000) libxenstore.so.3.0 => /lib64/libxenstore.so.3.0 (0x00007ffd05760000) libblktapctl.so.1.0 => /lib/libblktapctl.so.1.0 (0x0000003fa0e00000) libutil.so.1 => /lib64/libutil.so.1 (0x0000003fc1800000) libuuid.so.1 => /lib64/libuuid.so.1 (0x0000003fa4e00000) libdl.so.2 => /lib64/libdl.so.2 (0x0000003fa1200000) /lib64/ld-linux-x86-64.so.2 (0x0000003fa0600000) libbz2.so.1 => /lib64/libbz2.so.1 (0x00007ffd05550000) liblzma.so.5 => /lib64/liblzma.so.5 (0x0000003fa6e00000) libz.so.1 => /lib64/libz.so.1 (0x0000003fa1a00000) -John On Sun, Dec 22, 2013 at 10:05 AM, Andrew Cooper wrote: > On 22/12/2013 15:57, John Wargo wrote: > > Geniuses, > > I'm not 100% sure where this should go, so I'm going to send it to users > (for help) and to the development list (using 4.4-unstable). > > I just updated to the latest unstable, and every time I try to create my > windows 8 machine, I get the following error: > > >> *# xl -vvv create win8.cfg *Parsing config from win8.cfg >> xl: symbol lookup error: xl: undefined symbol: libxl_cpu_bitmap_alloc > > > Your libxl.so is out of date with respect to xl. (Although I would expect > your instructions below to be sufficient) > > Can you use ldd to find out which library xl is attempting to use? > > ~Andrew > > > To install it, I ran *make uninstall* on my old xen source. > > Then I followed the usual: > > *git clone git://xenbits.xen.org/xen.git > * > *cd xen* > *./configure --prefix=/usr --libdir=/usr/lib64* > *make world* > *patch -p1 < ati-passthrough.patch* > *make world* > *make install* > */sbin/ldconfig* > *reboot* > > Attached are the outputs of *xl info* and *xl dmesg*, in addition to my > windows 8 config. > > If any more information is needed, just ask. > > -John > > > _______________________________________________ > Xen-devel mailing listXen-devel@lists.xen.orghttp://lists.xen.org/xen-devel > > > --001a11c3ff64f57a3604ee22b824 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Andrew,

It appears to me that it is try= ing to use the 4.3 libraries, but I'm not positive, and I don't kno= w how to fix it.

# ldd /usr/sbin/xl
=A0 =A0 =A0 =A0 linux-vdso.so.1 =3D> =A0(0x00007fffe6000000)
<= div>=A0 =A0 =A0 =A0 libxlutil.so.4.3 =3D> /lib64/libxlutil.so.4.3 (0x000= 07ffd05dc8000)
=A0 =A0 =A0 =A0 libxenlight.so.4.3 =3D> /lib/li= bxenlight.so.4.3 (0x00000039d9a00000)
=A0 =A0 =A0 =A0 libxenctrl.so.4.3 =3D> /lib64/libxenctrl.so.4.3 (0x= 00007ffd05ba0000)
=A0 =A0 =A0 =A0 libyajl.so.2 =3D> /lib64/lib= yajl.so.2 (0x0000003faba00000)
=A0 =A0 =A0 =A0 libpthread.so.0 = =3D> /lib64/libpthread.so.0 (0x0000003fa1600000)
=A0 =A0 =A0 =A0 libc.so.6 =3D> /lib64/libc.so.6 (0x0000003fa0a00000= )
=A0 =A0 =A0 =A0 libxenguest.so.4.3 =3D> /lib64/libxenguest.s= o.4.3 (0x00007ffd05970000)
=A0 =A0 =A0 =A0 libxenstore.so.3.0 =3D= > /lib64/libxenstore.so.3.0 (0x00007ffd05760000)
=A0 =A0 =A0 =A0 libblktapctl.so.1.0 =3D> /lib/libblktapctl.so.1.0 (= 0x0000003fa0e00000)
=A0 =A0 =A0 =A0 libutil.so.1 =3D> /lib64/l= ibutil.so.1 (0x0000003fc1800000)
=A0 =A0 =A0 =A0 libuuid.so.1 =3D= > /lib64/libuuid.so.1 (0x0000003fa4e00000)
=A0 =A0 =A0 =A0 libdl.so.2 =3D> /lib64/libdl.so.2 (0x0000003fa12000= 00)
=A0 =A0 =A0 =A0 /lib64/ld-linux-x86-64.so.2 (0x0000003fa06000= 00)
=A0 =A0 =A0 =A0 libbz2.so.1 =3D> /lib64/libbz2.so.1 (0x000= 07ffd05550000)
=A0 =A0 =A0 =A0 liblzma.so.5 =3D> /lib64/liblzma.so.5 (0x0000003fa6e0000= 0)
=A0 =A0 =A0 =A0 libz.so.1 =3D> /lib64/libz.so.1 (0x0000003f= a1a00000)

-John

On Sun, Dec 22, 2013 at 10:05 AM, Andrew Cooper <andrew.cooper3@ci= trix.com> wrote:
=20 =20 =20
On 22/12/2013 15:57, John Wargo wrote:
=20
Geniuses,

I'm not 100% sure where this should go, so I'm going t= o send it to users (for help) and to the development list (using 4.4-unstable).

I just updated to the latest unstable, and every time I try to create my windows 8 machine, I get the following error:

# xl -vvv create win8.cfg
Parsing config from win8.cfg
xl: symbol lookup error: xl: undefined symbol: libxl_cpu_bitmap_alloc

Your libxl.so is out of date with respect to xl.=A0 (Although I would expect your instructions below to be sufficient)

Can you use ldd to find out which library xl is attempting to use?

~Andrew


To install it, I ran make uninstall=A0on my old xen source.

Then I followed the usual:

git clone git://xenbits.xen.org/xen.git
cd xen
./configure --prefix=3D/usr --libdir=3D/usr/lib64
make world
patch -p1 < ati-passthrough.patch
make world
make install
/sbin/ldconfig
reboot

Attached are the outputs of xl info=A0and xl dmesg, in addition to my windows 8 config.

If any more information is needed, just ask.

-John


_______________________________________________
Xen-devel mailing list
Xen-devel@list=
s.xen.org
http://lists.x=
en.org/xen-devel


--001a11c3ff64f57a3604ee22b824-- --===============1462276363232124158== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============1462276363232124158==-- From xen-users-bounces@lists.xen.org Sun Dec 22 18:10:14 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 18:10:14 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VunTB-0000rA-IV; Sun, 22 Dec 2013 18:09:41 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vun9g-0000WG-Kl for xen-users@lists.xen.org; Sun, 22 Dec 2013 17:49:32 +0000 Received: from [85.158.143.35:63757] by server-3.bemta-4.messagelabs.com id 1F/4F-32360-C2627B25; Sun, 22 Dec 2013 17:49:32 +0000 X-Env-Sender: Andrew.Cooper3@citrix.com X-Msg-Ref: server-8.tower-21.messagelabs.com!1387734569!7683940!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 20286 invoked from network); 22 Dec 2013 17:49:31 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-8.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 22 Dec 2013 17:49:31 -0000 X-IronPort-AV: E=Sophos;i="4.95,532,1384300800"; d="scan'208,217";a="84806860" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 22 Dec 2013 17:49:26 +0000 Received: from AMSPEX01CL03.citrite.net (10.69.46.34) by FTLPEX01CL02.citrite.net (10.13.107.79) with Microsoft SMTP Server (TLS) id 14.2.342.4; Sun, 22 Dec 2013 12:49:26 -0500 Received: from [192.168.1.84] (10.68.19.21) by AMSPEX01CL03.citrite.net (10.69.46.34) with Microsoft SMTP Server id 14.2.342.4; Sun, 22 Dec 2013 18:49:24 +0100 Message-ID: <52B72624.9060600@citrix.com> Date: Sun, 22 Dec 2013 17:49:24 +0000 From: Andrew Cooper User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: John Wargo , Xen Users References: <52B70DD9.1000301@citrix.com> In-Reply-To: X-Originating-IP: [10.68.19.21] X-DLP: MIA2 X-Mailman-Approved-At: Sun, 22 Dec 2013 18:09:39 +0000 Subject: Re: [Xen-users] [Xen-devel] Undefined Symbol : libxl_cpu_bitmap_alloc X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6585938126697724868==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6585938126697724868== Content-Type: multipart/alternative; boundary="------------000102020507040607030001" --------------000102020507040607030001 Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit On 22/12/2013 17:20, John Wargo wrote: > Andrew, > > It appears to me that it is trying to use the 4.3 libraries, but I'm > not positive, and I don't know how to fix it. The ABI version is still 4.3, so this is correct > > *# ldd /usr/sbin/xl* > linux-vdso.so.1 => (0x00007fffe6000000) > libxlutil.so.4.3 => /lib64/libxlutil.so.4.3 (0x00007ffd05dc8000) > libxenlight.so.4.3 => /lib/libxenlight.so.4.3 (0x00000039d9a00000) So this is using the lib from /lib > libxenctrl.so.4.3 => /lib64/libxenctrl.so.4.3 (0x00007ffd05ba0000) And this from /lib64 You presumably have /lib64/libxenlight.so.4.3 which is the one you build yourself, but it is behind /lib in the search path, so you are constantly using an old libxenlight.so. If you remove all trace of the xen libraries from /lib, then it should start working. I suspect this is because "make uninstall" will use whichever is the currently configured libdir, rather than the last one you installed into. ~Andrew --------------000102020507040607030001 Content-Type: text/html; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit
On 22/12/2013 17:20, John Wargo wrote:
Andrew,

It appears to me that it is trying to use the 4.3 libraries, but I'm not positive, and I don't know how to fix it.

The ABI version is still 4.3, so this is correct


# ldd /usr/sbin/xl
        linux-vdso.so.1 =>  (0x00007fffe6000000)
        libxlutil.so.4.3 => /lib64/libxlutil.so.4.3 (0x00007ffd05dc8000)
        libxenlight.so.4.3 => /lib/libxenlight.so.4.3 (0x00000039d9a00000)

So this is using the lib from /lib

        libxenctrl.so.4.3 => /lib64/libxenctrl.so.4.3 (0x00007ffd05ba0000)

And this from /lib64

You presumably have /lib64/libxenlight.so.4.3 which is the one you build yourself, but it is behind /lib in the search path, so you are constantly using an old libxenlight.so.

If you remove all trace of the xen libraries from /lib, then it should start working.  I suspect this is because "make uninstall" will use whichever is the currently configured libdir, rather than the last one you installed into.

~Andrew --------------000102020507040607030001-- --===============6585938126697724868== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6585938126697724868==-- From xen-users-bounces@lists.xen.org Sun Dec 22 18:10:14 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 18:10:14 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VunTA-0000r1-WD; Sun, 22 Dec 2013 18:09:41 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VulXV-0004ee-Aa; Sun, 22 Dec 2013 16:06:01 +0000 Received: from [193.109.254.147:39683] by server-6.bemta-14.messagelabs.com id E6/F8-14958-8ED07B25; Sun, 22 Dec 2013 16:06:00 +0000 X-Env-Sender: Andrew.Cooper3@citrix.com X-Msg-Ref: server-8.tower-27.messagelabs.com!1387728349!6993007!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 16532 invoked from network); 22 Dec 2013 16:05:50 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-8.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 22 Dec 2013 16:05:50 -0000 X-IronPort-AV: E=Sophos;i="4.95,531,1384300800"; d="scan'208,217";a="84796230" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 22 Dec 2013 16:05:49 +0000 Received: from AMSPEX01CL02.citrite.net (10.69.46.33) by FTLPEX01CL03.citrite.net (10.13.107.80) with Microsoft SMTP Server (TLS) id 14.2.342.4; Sun, 22 Dec 2013 11:05:48 -0500 Received: from [192.168.1.84] (10.68.19.21) by AMSPEX01CL02.citrite.net (10.69.46.33) with Microsoft SMTP Server id 14.2.342.4; Sun, 22 Dec 2013 17:05:47 +0100 Message-ID: <52B70DD9.1000301@citrix.com> Date: Sun, 22 Dec 2013 16:05:45 +0000 From: Andrew Cooper User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: John Wargo , Xen Users , "xen-devel@lists.xen.org" References: In-Reply-To: X-Originating-IP: [10.68.19.21] X-DLP: MIA1 X-Mailman-Approved-At: Sun, 22 Dec 2013 18:09:39 +0000 Subject: Re: [Xen-users] [Xen-devel] Undefined Symbol : libxl_cpu_bitmap_alloc X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============8805980583511074742==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============8805980583511074742== Content-Type: multipart/alternative; boundary="------------030108090701090909050808" --------------030108090701090909050808 Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit On 22/12/2013 15:57, John Wargo wrote: > Geniuses, > > I'm not 100% sure where this should go, so I'm going to send it to > users (for help) and to the development list (using 4.4-unstable). > > I just updated to the latest unstable, and every time I try to create > my windows 8 machine, I get the following error: > > *# xl -vvv create win8.cfg > *Parsing config from win8.cfg > xl: symbol lookup error: xl: undefined symbol: libxl_cpu_bitmap_alloc > Your libxl.so is out of date with respect to xl. (Although I would expect your instructions below to be sufficient) Can you use ldd to find out which library xl is attempting to use? ~Andrew > > To install it, I ran *make uninstall* on my old xen source. > > Then I followed the usual: > > *git clone git://xenbits.xen.org/xen.git * > *cd xen* > *./configure --prefix=/usr --libdir=/usr/lib64* > *make world* > *patch -p1 < ati-passthrough.patch* > *make world* > *make install* > */sbin/ldconfig* > *reboot* > * > * > Attached are the outputs of *xl info* and *xl dmesg*, in addition to > my windows 8 config. > > If any more information is needed, just ask. > > -John > > > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xen.org > http://lists.xen.org/xen-devel --------------030108090701090909050808 Content-Type: text/html; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit
On 22/12/2013 15:57, John Wargo wrote:
Geniuses,

I'm not 100% sure where this should go, so I'm going to send it to users (for help) and to the development list (using 4.4-unstable).

I just updated to the latest unstable, and every time I try to create my windows 8 machine, I get the following error:

# xl -vvv create win8.cfg
Parsing config from win8.cfg
xl: symbol lookup error: xl: undefined symbol: libxl_cpu_bitmap_alloc

Your libxl.so is out of date with respect to xl.  (Although I would expect your instructions below to be sufficient)

Can you use ldd to find out which library xl is attempting to use?

~Andrew


To install it, I ran make uninstall on my old xen source.

Then I followed the usual:

git clone git://xenbits.xen.org/xen.git
cd xen
./configure --prefix=/usr --libdir=/usr/lib64
make world
patch -p1 < ati-passthrough.patch
make world
make install
/sbin/ldconfig
reboot

Attached are the outputs of xl info and xl dmesg, in addition to my windows 8 config.

If any more information is needed, just ask.

-John


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

--------------030108090701090909050808-- --===============8805980583511074742== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============8805980583511074742==-- From xen-users-bounces@lists.xen.org Sun Dec 22 18:10:14 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 18:10:14 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VunTB-0000rA-IV; Sun, 22 Dec 2013 18:09:41 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vun9g-0000WG-Kl for xen-users@lists.xen.org; Sun, 22 Dec 2013 17:49:32 +0000 Received: from [85.158.143.35:63757] by server-3.bemta-4.messagelabs.com id 1F/4F-32360-C2627B25; Sun, 22 Dec 2013 17:49:32 +0000 X-Env-Sender: Andrew.Cooper3@citrix.com X-Msg-Ref: server-8.tower-21.messagelabs.com!1387734569!7683940!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 20286 invoked from network); 22 Dec 2013 17:49:31 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-8.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 22 Dec 2013 17:49:31 -0000 X-IronPort-AV: E=Sophos;i="4.95,532,1384300800"; d="scan'208,217";a="84806860" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 22 Dec 2013 17:49:26 +0000 Received: from AMSPEX01CL03.citrite.net (10.69.46.34) by FTLPEX01CL02.citrite.net (10.13.107.79) with Microsoft SMTP Server (TLS) id 14.2.342.4; Sun, 22 Dec 2013 12:49:26 -0500 Received: from [192.168.1.84] (10.68.19.21) by AMSPEX01CL03.citrite.net (10.69.46.34) with Microsoft SMTP Server id 14.2.342.4; Sun, 22 Dec 2013 18:49:24 +0100 Message-ID: <52B72624.9060600@citrix.com> Date: Sun, 22 Dec 2013 17:49:24 +0000 From: Andrew Cooper User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: John Wargo , Xen Users References: <52B70DD9.1000301@citrix.com> In-Reply-To: X-Originating-IP: [10.68.19.21] X-DLP: MIA2 X-Mailman-Approved-At: Sun, 22 Dec 2013 18:09:39 +0000 Subject: Re: [Xen-users] [Xen-devel] Undefined Symbol : libxl_cpu_bitmap_alloc X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6585938126697724868==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6585938126697724868== Content-Type: multipart/alternative; boundary="------------000102020507040607030001" --------------000102020507040607030001 Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit On 22/12/2013 17:20, John Wargo wrote: > Andrew, > > It appears to me that it is trying to use the 4.3 libraries, but I'm > not positive, and I don't know how to fix it. The ABI version is still 4.3, so this is correct > > *# ldd /usr/sbin/xl* > linux-vdso.so.1 => (0x00007fffe6000000) > libxlutil.so.4.3 => /lib64/libxlutil.so.4.3 (0x00007ffd05dc8000) > libxenlight.so.4.3 => /lib/libxenlight.so.4.3 (0x00000039d9a00000) So this is using the lib from /lib > libxenctrl.so.4.3 => /lib64/libxenctrl.so.4.3 (0x00007ffd05ba0000) And this from /lib64 You presumably have /lib64/libxenlight.so.4.3 which is the one you build yourself, but it is behind /lib in the search path, so you are constantly using an old libxenlight.so. If you remove all trace of the xen libraries from /lib, then it should start working. I suspect this is because "make uninstall" will use whichever is the currently configured libdir, rather than the last one you installed into. ~Andrew --------------000102020507040607030001 Content-Type: text/html; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit
On 22/12/2013 17:20, John Wargo wrote:
Andrew,

It appears to me that it is trying to use the 4.3 libraries, but I'm not positive, and I don't know how to fix it.

The ABI version is still 4.3, so this is correct


# ldd /usr/sbin/xl
        linux-vdso.so.1 =>  (0x00007fffe6000000)
        libxlutil.so.4.3 => /lib64/libxlutil.so.4.3 (0x00007ffd05dc8000)
        libxenlight.so.4.3 => /lib/libxenlight.so.4.3 (0x00000039d9a00000)

So this is using the lib from /lib

        libxenctrl.so.4.3 => /lib64/libxenctrl.so.4.3 (0x00007ffd05ba0000)

And this from /lib64

You presumably have /lib64/libxenlight.so.4.3 which is the one you build yourself, but it is behind /lib in the search path, so you are constantly using an old libxenlight.so.

If you remove all trace of the xen libraries from /lib, then it should start working.  I suspect this is because "make uninstall" will use whichever is the currently configured libdir, rather than the last one you installed into.

~Andrew --------------000102020507040607030001-- --===============6585938126697724868== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6585938126697724868==-- From xen-users-bounces@lists.xen.org Sun Dec 22 18:10:14 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 18:10:14 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VunTA-0000r1-WD; Sun, 22 Dec 2013 18:09:41 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VulXV-0004ee-Aa; Sun, 22 Dec 2013 16:06:01 +0000 Received: from [193.109.254.147:39683] by server-6.bemta-14.messagelabs.com id E6/F8-14958-8ED07B25; Sun, 22 Dec 2013 16:06:00 +0000 X-Env-Sender: Andrew.Cooper3@citrix.com X-Msg-Ref: server-8.tower-27.messagelabs.com!1387728349!6993007!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 16532 invoked from network); 22 Dec 2013 16:05:50 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-8.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 22 Dec 2013 16:05:50 -0000 X-IronPort-AV: E=Sophos;i="4.95,531,1384300800"; d="scan'208,217";a="84796230" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 22 Dec 2013 16:05:49 +0000 Received: from AMSPEX01CL02.citrite.net (10.69.46.33) by FTLPEX01CL03.citrite.net (10.13.107.80) with Microsoft SMTP Server (TLS) id 14.2.342.4; Sun, 22 Dec 2013 11:05:48 -0500 Received: from [192.168.1.84] (10.68.19.21) by AMSPEX01CL02.citrite.net (10.69.46.33) with Microsoft SMTP Server id 14.2.342.4; Sun, 22 Dec 2013 17:05:47 +0100 Message-ID: <52B70DD9.1000301@citrix.com> Date: Sun, 22 Dec 2013 16:05:45 +0000 From: Andrew Cooper User-Agent: Mozilla/5.0 (Windows NT 6.1; WOW64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: John Wargo , Xen Users , "xen-devel@lists.xen.org" References: In-Reply-To: X-Originating-IP: [10.68.19.21] X-DLP: MIA1 X-Mailman-Approved-At: Sun, 22 Dec 2013 18:09:39 +0000 Subject: Re: [Xen-users] [Xen-devel] Undefined Symbol : libxl_cpu_bitmap_alloc X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============8805980583511074742==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============8805980583511074742== Content-Type: multipart/alternative; boundary="------------030108090701090909050808" --------------030108090701090909050808 Content-Type: text/plain; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit On 22/12/2013 15:57, John Wargo wrote: > Geniuses, > > I'm not 100% sure where this should go, so I'm going to send it to > users (for help) and to the development list (using 4.4-unstable). > > I just updated to the latest unstable, and every time I try to create > my windows 8 machine, I get the following error: > > *# xl -vvv create win8.cfg > *Parsing config from win8.cfg > xl: symbol lookup error: xl: undefined symbol: libxl_cpu_bitmap_alloc > Your libxl.so is out of date with respect to xl. (Although I would expect your instructions below to be sufficient) Can you use ldd to find out which library xl is attempting to use? ~Andrew > > To install it, I ran *make uninstall* on my old xen source. > > Then I followed the usual: > > *git clone git://xenbits.xen.org/xen.git * > *cd xen* > *./configure --prefix=/usr --libdir=/usr/lib64* > *make world* > *patch -p1 < ati-passthrough.patch* > *make world* > *make install* > */sbin/ldconfig* > *reboot* > * > * > Attached are the outputs of *xl info* and *xl dmesg*, in addition to > my windows 8 config. > > If any more information is needed, just ask. > > -John > > > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xen.org > http://lists.xen.org/xen-devel --------------030108090701090909050808 Content-Type: text/html; charset="ISO-8859-1" Content-Transfer-Encoding: 7bit
On 22/12/2013 15:57, John Wargo wrote:
Geniuses,

I'm not 100% sure where this should go, so I'm going to send it to users (for help) and to the development list (using 4.4-unstable).

I just updated to the latest unstable, and every time I try to create my windows 8 machine, I get the following error:

# xl -vvv create win8.cfg
Parsing config from win8.cfg
xl: symbol lookup error: xl: undefined symbol: libxl_cpu_bitmap_alloc

Your libxl.so is out of date with respect to xl.  (Although I would expect your instructions below to be sufficient)

Can you use ldd to find out which library xl is attempting to use?

~Andrew


To install it, I ran make uninstall on my old xen source.

Then I followed the usual:

git clone git://xenbits.xen.org/xen.git
cd xen
./configure --prefix=/usr --libdir=/usr/lib64
make world
patch -p1 < ati-passthrough.patch
make world
make install
/sbin/ldconfig
reboot

Attached are the outputs of xl info and xl dmesg, in addition to my windows 8 config.

If any more information is needed, just ask.

-John


_______________________________________________
Xen-devel mailing list
Xen-devel@lists.xen.org
http://lists.xen.org/xen-devel

--------------030108090701090909050808-- --===============8805980583511074742== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============8805980583511074742==-- From xen-users-bounces@lists.xen.org Sun Dec 22 21:34:04 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 21:34:04 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vuqe0-0000Sh-6B; Sun, 22 Dec 2013 21:33:04 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vuqdx-0000SO-KA for xen-users@lists.xen.org; Sun, 22 Dec 2013 21:33:02 +0000 Received: from [193.109.254.147:56299] by server-4.bemta-14.messagelabs.com id B7/58-03916-C8A57B25; Sun, 22 Dec 2013 21:33:00 +0000 X-Env-Sender: zhangwqh@126.com X-Msg-Ref: server-14.tower-27.messagelabs.com!1387747978!7018446!1 X-Originating-IP: [220.181.15.11] X-SpamReason: No, hits=0.9 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjE1LjExID0+IDEwNTI5\n,sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjE1LjExID0+IDEwNTI5\n, BODY_RANDOM_LONG, HTML_30_40, HTML_MESSAGE,MIME_BASE64_TEXT,UNPARSEABLE_RELAY X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30662 invoked from network); 22 Dec 2013 21:32:59 -0000 Received: from m15-11.126.com (HELO m15-11.126.com) (220.181.15.11) by server-14.tower-27.messagelabs.com with SMTP; 22 Dec 2013 21:32:59 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=126.com; s=s110527; h=Date:From:Subject:MIME-Version:Message-ID; bh=Tjol0 xl3aXUrM9bpZi8TqHLb+hRym/Cjx8h2/8DDBmw=; b=J1yKNBSeR5ud90oT/e0KW oXg1x5814NwB2ExJ0r+YOUS3MeRa4GBLzRIowy/xzlxatBCb6ILja9AU73ry4Etr QxW3pj4xjxJBqLY/9otmIPyv8E87VPcJfofk1L+unapENO+2R3JwpUq+f+OumnnH gsOPppZvFLISGdCxQ7dTn0= Received: from zhangwqh$126.com ( [128.164.93.106, 54.215.2.217] ) by ajax-webmail-wmsvr11 (Coremail) ; Mon, 23 Dec 2013 05:32:55 +0800 (CST) X-Originating-IP: [128.164.93.106, 54.215.2.217] Date: Mon, 23 Dec 2013 05:32:55 +0800 (CST) From: =?GBK?B?1cXOsA==?= To: xen-users@lists.xen.org X-Priority: 3 X-Mailer: Coremail Webmail Server Version SP_ntes V3.5 build 20131204(24406.5820.5783) Copyright (c) 2002-2013 www.mailtech.cn 126com X-CM-CTRLDATA: 5Aunm2Zvb3Rlcl9odG09OTIzOjgx MIME-Version: 1.0 Message-ID: <232347eb.1ea.1431c39a232.Coremail.zhangwqh@126.com> X-CM-TRANSID: C8qowGAJ+0GIWrdS3UwRAA--.8426W X-CM-SenderInfo: x2kd0wxztkqiyswou0bp/1tbifgb76VGfOYDhGwAAsn X-Coremail-Antispam: 1U5529EdanIXcx71UUUUU7vcSsGvfC2KfnxnUU== Subject: [Xen-users] remus network buffering configuraion X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============8280592921969112765==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============8280592921969112765== Content-Type: multipart/alternative; boundary="----=_Part_1928_942779349.1387747975730" ------=_Part_1928_942779349.1387747975730 Content-Type: text/plain; charset=GBK Content-Transfer-Encoding: base64 SGkgYWxsLAoKCkRvZXMgYW55Ym9keSBrbm93IHRoYXQgdGhlIGZ1bmN0aW9uIG9mIGlmYiBpbiB4 ZW4gcmVtdXMgcHJvamVjdD8gSSBjYW4gbm90IHVuZGVyc3RhbmQgd2h5IHJlbXVzIG5ldHdvcmsg YnVmZmVyaW5nIG5lZWRzIGlmYiBkZXZpY2UuIEluIG5ldyB4ZW4gYW5kIGxpbnV4IHZlcnNpb24s IHRoZSBrZXJuZWwgcWRpc2MgbW9kdWxlIHNjaF9wbHVnIHByb3ZpZGVzIHRoZSBuZXR3b3JrIGJ1 ZmZlcmluZy4gSWYgYSB2aXJ0dWFsIG1hY2hpbmUgLSBlZyBkb21haW4gaWQgaXMgMS4gSW4gZG9t YWluMCwgdmlmIGlzIHZpZjEuMCh0YyBxZGlzYyBhZGQgZGV2IHZpZjEuMCByb290IHBsdWcpLiBX aHkgbm90IGRpcmVjdGx5IHVzZSB0aGUgcGx1ZyBxZGlzYyBvbiB0aGlzIHZpZjEuMC4gUmVtdXMg bmVlZHMgdG8gIHVzZSBpZmIgZGV2aWNlLiBUaGUgcGFja2V0cyBvZiB2aWYxLjAgbmVlZHMgdG8g cmVkaXJlY3QgdG8gaWZiMC4gCgoKaXAgbGluayBzZXQgaWZiMCB1cAoKCnRjIHFkaXNjIGFkZCBk ZXYgaWZiMCByb290IHBsdWcKCgp0YyBxZGlzYyBhZGQgZGV2IHZpZjEuMCBpbmdyZXNzCgoKdGMg ZmlsdGVyIGFkZCBkZXYgIHZpZjEuMCAgcGFyZW50IGZmZmY6IHByb3RvIGlwIHByZWYgMTAgdTMy IG1hdGNoIHUzMiAwIDAgYWN0aW9uIG1pcnJlZCBlZ3Jlc3MgcmVkaXJlY3QgZGV2IGlmYjAKCg== ------=_Part_1928_942779349.1387747975730 Content-Type: text/html; charset=GBK Content-Transfer-Encoding: base64 PGRpdiBzdHlsZT0ibGluZS1oZWlnaHQ6MS43O2NvbG9yOiMwMDAwMDA7Zm9udC1zaXplOjE0cHg7 Zm9udC1mYW1pbHk6YXJpYWwiPkhpIGFsbCw8ZGl2Pjxicj48L2Rpdj48ZGl2PkRvZXMgYW55Ym9k eSBrbm93IHRoYXQgdGhlIGZ1bmN0aW9uIG9mIGlmYiBpbiB4ZW4gcmVtdXMgcHJvamVjdD8gSSBj YW4gbm90IHVuZGVyc3RhbmQgd2h5IHJlbXVzIG5ldHdvcmsgYnVmZmVyaW5nIG5lZWRzIGlmYiBk ZXZpY2UuIEluIG5ldyB4ZW4gYW5kIGxpbnV4IHZlcnNpb24sIHRoZSBrZXJuZWwgcWRpc2MgbW9k dWxlIHNjaF9wbHVnIHByb3ZpZGVzIHRoZSBuZXR3b3JrIGJ1ZmZlcmluZy4gSWYgYSB2aXJ0dWFs IG1hY2hpbmUgLSBlZyBkb21haW4gaWQgaXMgMS4gSW4gZG9tYWluMCwgdmlmIGlzIHZpZjEuMCh0 YyBxZGlzYyBhZGQgZGV2IHZpZjEuMCByb290IHBsdWcpLiBXaHkgbm90IGRpcmVjdGx5IHVzZSB0 aGUgcGx1ZyBxZGlzYyBvbiB0aGlzIHZpZjEuMC4gUmVtdXMgbmVlZHMgdG8gJm5ic3A7dXNlIGlm YiBkZXZpY2UuIFRoZSBwYWNrZXRzIG9mIHZpZjEuMCBuZWVkcyB0byByZWRpcmVjdCB0byBpZmIw LiZuYnNwOzwvZGl2PjxkaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5pcCBsaW5rIHNldCBpZmIwIHVw PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj50YyBxZGlzYyBhZGQgZGV2IGlmYjAgcm9vdCBwbHVn PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj50YyBxZGlzYyBhZGQgZGV2IHZpZjEuMCBpbmdyZXNz PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj50YyBmaWx0ZXIgYWRkIGRldiAmbmJzcDt2aWYxLjAg Jm5ic3A7cGFyZW50IGZmZmY6IHByb3RvIGlwIHByZWYgMTAgdTMyIG1hdGNoIHUzMiAwIDAgYWN0 aW9uIG1pcnJlZCBlZ3Jlc3MgcmVkaXJlY3QgZGV2IGlmYjA8L2Rpdj48L2Rpdj48ZGl2Pjxicj48 L2Rpdj48L2Rpdj48YnI+PGJyPjxzcGFuIHRpdGxlPSJuZXRlYXNlZm9vdGVyIj48c3BhbiBpZD0i bmV0ZWFzZV9tYWlsX2Zvb3RlciI+PC9zcGFuPjwvc3Bhbj4= ------=_Part_1928_942779349.1387747975730-- --===============8280592921969112765== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============8280592921969112765==-- From xen-users-bounces@lists.xen.org Sun Dec 22 21:34:04 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 21:34:04 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vuqdr-0000SB-Ff; Sun, 22 Dec 2013 21:32:55 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vuqdp-0000S6-RG for xen-users@lists.xen.org; Sun, 22 Dec 2013 21:32:54 +0000 Received: from [85.158.143.35:40884] by server-1.bemta-4.messagelabs.com id A4/AB-02132-58A57B25; Sun, 22 Dec 2013 21:32:53 +0000 X-Env-Sender: wargo.john25@gmail.com X-Msg-Ref: server-15.tower-21.messagelabs.com!1387747971!5025125!1 X-Originating-IP: [209.85.217.173] X-SpamReason: No, hits=0.9 required=7.0 tests=HTML_40_50,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 10737 invoked from network); 22 Dec 2013 21:32:52 -0000 Received: from mail-lb0-f173.google.com (HELO mail-lb0-f173.google.com) (209.85.217.173) by server-15.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 22 Dec 2013 21:32:52 -0000 Received: by mail-lb0-f173.google.com with SMTP id z5so1961749lbh.18 for ; Sun, 22 Dec 2013 13:32:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=B8MCfgN8/FTRFx7l6x8LRUjwW1xLaAD4lyevWV6tEK4=; b=ohl56qTJpcO7KNuQvLDmzZo2LdFU1eIAYw+fdO9grBofrT7/H4sFEQ7CQWdN6h8/Tm pN2GUK6mbBQ3sdnRX92v5Zc1wwWie8ctK5vhYDwBHloDZ+34sj5tNC3X20HxaYtDOQiG Ltuqgj8uVKi4m7A728NrBCQy0fIZYF6JgBfKFnoT0rA7uAAd6BJt/p/83j2e3+VQylNT mqk+XozeqOEigOvzfPpq/rNo/N5HYqgAst0oxsg9iXvUZZbVABDcpyrea1dpNJIKaoX4 zOvdJGujRYiSpN/xpQVjbFHojAheUpN9FjwFCj2coUDov4Yxr+Dm9vi+rpYz39D6GC1j IF5g== MIME-Version: 1.0 X-Received: by 10.152.44.225 with SMTP id h1mr9262818lam.22.1387747971433; Sun, 22 Dec 2013 13:32:51 -0800 (PST) Received: by 10.114.183.131 with HTTP; Sun, 22 Dec 2013 13:32:51 -0800 (PST) Received: by 10.114.183.131 with HTTP; Sun, 22 Dec 2013 13:32:51 -0800 (PST) In-Reply-To: <52B72624.9060600@citrix.com> References: <52B70DD9.1000301@citrix.com> <52B72624.9060600@citrix.com> Date: Sun, 22 Dec 2013 15:32:51 -0600 Message-ID: From: John Wargo To: Andrew Cooper , Xen Users Subject: Re: [Xen-users] [Xen-devel] Undefined Symbol : libxl_cpu_bitmap_alloc X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============5573377098679875305==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============5573377098679875305== Content-Type: multipart/alternative; boundary=089e0160b7bee0680a04ee2640be --089e0160b7bee0680a04ee2640be Content-Type: text/plain; charset=ISO-8859-1 That was it. Thanks for your time, -John On Dec 22, 2013 11:49 AM, "Andrew Cooper" wrote: > On 22/12/2013 17:20, John Wargo wrote: > > Andrew, > > It appears to me that it is trying to use the 4.3 libraries, but I'm not > positive, and I don't know how to fix it. > > > The ABI version is still 4.3, so this is correct > > > *# ldd /usr/sbin/xl* > linux-vdso.so.1 => (0x00007fffe6000000) > libxlutil.so.4.3 => /lib64/libxlutil.so.4.3 (0x00007ffd05dc8000) > libxenlight.so.4.3 => /lib/libxenlight.so.4.3 (0x00000039d9a00000) > > > So this is using the lib from /lib > > libxenctrl.so.4.3 => /lib64/libxenctrl.so.4.3 > (0x00007ffd05ba0000) > > > And this from /lib64 > > You presumably have /lib64/libxenlight.so.4.3 which is the one you build > yourself, but it is behind /lib in the search path, so you are constantly > using an old libxenlight.so. > > If you remove all trace of the xen libraries from /lib, then it should > start working. I suspect this is because "make uninstall" will use > whichever is the currently configured libdir, rather than the last one you > installed into. > > ~Andrew > --089e0160b7bee0680a04ee2640be Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

That was it.

Thanks for your time,
-John

On Dec 22, 2013 11:49 AM, "Andrew Cooper&qu= ot; <andrew.cooper3@citrix.= com> wrote:
=20 =20 =20
On 22/12/2013 17:20, John Wargo wrote:
=20
Andrew,

It appears to me that it is trying to use the 4.3 libraries, but I'm not positive, and I don't know how to = fix it.

The ABI version is still 4.3, so this is correct


# ldd /usr/sbin/xl
=A0 =A0 =A0 =A0 linux-vdso.so.1 =3D> =A0(0x00007fffe60000= 00)
=A0 =A0 =A0 =A0 libxlutil.so.4.3 =3D> /lib64/libxlutil.so= .4.3 (0x00007ffd05dc8000)
=A0 =A0 =A0 =A0 libxenlight.so.4.3 =3D> /lib/libxenlight.= so.4.3 (0x00000039d9a00000)

So this is using the lib from /lib

=A0 =A0 =A0 =A0 libxenctrl.so.4.3 =3D> /lib64/libxenctrl.= so.4.3 (0x00007ffd05ba0000)

And this from /lib64

You presumably have /lib64/libxenlight.so.4.3 which is the one you build yourself, but it is behind /lib in the search path, so you are constantly using an old libxenlight.so.

If you remove all trace of the xen libraries from /lib, then it should start working.=A0 I suspect this is because "make uninstall= " will use whichever is the currently configured libdir, rather than the last one you installed into.

~Andrew
--089e0160b7bee0680a04ee2640be-- --===============5573377098679875305== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============5573377098679875305==-- From xen-users-bounces@lists.xen.org Sun Dec 22 21:34:04 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 21:34:04 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vuqe0-0000Sh-6B; Sun, 22 Dec 2013 21:33:04 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vuqdx-0000SO-KA for xen-users@lists.xen.org; Sun, 22 Dec 2013 21:33:02 +0000 Received: from [193.109.254.147:56299] by server-4.bemta-14.messagelabs.com id B7/58-03916-C8A57B25; Sun, 22 Dec 2013 21:33:00 +0000 X-Env-Sender: zhangwqh@126.com X-Msg-Ref: server-14.tower-27.messagelabs.com!1387747978!7018446!1 X-Originating-IP: [220.181.15.11] X-SpamReason: No, hits=0.9 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjE1LjExID0+IDEwNTI5\n,sa_preprocessor: QmFkIElQOiAyMjAuMTgxLjE1LjExID0+IDEwNTI5\n, BODY_RANDOM_LONG, HTML_30_40, HTML_MESSAGE,MIME_BASE64_TEXT,UNPARSEABLE_RELAY X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30662 invoked from network); 22 Dec 2013 21:32:59 -0000 Received: from m15-11.126.com (HELO m15-11.126.com) (220.181.15.11) by server-14.tower-27.messagelabs.com with SMTP; 22 Dec 2013 21:32:59 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=126.com; s=s110527; h=Date:From:Subject:MIME-Version:Message-ID; bh=Tjol0 xl3aXUrM9bpZi8TqHLb+hRym/Cjx8h2/8DDBmw=; b=J1yKNBSeR5ud90oT/e0KW oXg1x5814NwB2ExJ0r+YOUS3MeRa4GBLzRIowy/xzlxatBCb6ILja9AU73ry4Etr QxW3pj4xjxJBqLY/9otmIPyv8E87VPcJfofk1L+unapENO+2R3JwpUq+f+OumnnH gsOPppZvFLISGdCxQ7dTn0= Received: from zhangwqh$126.com ( [128.164.93.106, 54.215.2.217] ) by ajax-webmail-wmsvr11 (Coremail) ; Mon, 23 Dec 2013 05:32:55 +0800 (CST) X-Originating-IP: [128.164.93.106, 54.215.2.217] Date: Mon, 23 Dec 2013 05:32:55 +0800 (CST) From: =?GBK?B?1cXOsA==?= To: xen-users@lists.xen.org X-Priority: 3 X-Mailer: Coremail Webmail Server Version SP_ntes V3.5 build 20131204(24406.5820.5783) Copyright (c) 2002-2013 www.mailtech.cn 126com X-CM-CTRLDATA: 5Aunm2Zvb3Rlcl9odG09OTIzOjgx MIME-Version: 1.0 Message-ID: <232347eb.1ea.1431c39a232.Coremail.zhangwqh@126.com> X-CM-TRANSID: C8qowGAJ+0GIWrdS3UwRAA--.8426W X-CM-SenderInfo: x2kd0wxztkqiyswou0bp/1tbifgb76VGfOYDhGwAAsn X-Coremail-Antispam: 1U5529EdanIXcx71UUUUU7vcSsGvfC2KfnxnUU== Subject: [Xen-users] remus network buffering configuraion X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============8280592921969112765==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============8280592921969112765== Content-Type: multipart/alternative; boundary="----=_Part_1928_942779349.1387747975730" ------=_Part_1928_942779349.1387747975730 Content-Type: text/plain; charset=GBK Content-Transfer-Encoding: base64 SGkgYWxsLAoKCkRvZXMgYW55Ym9keSBrbm93IHRoYXQgdGhlIGZ1bmN0aW9uIG9mIGlmYiBpbiB4 ZW4gcmVtdXMgcHJvamVjdD8gSSBjYW4gbm90IHVuZGVyc3RhbmQgd2h5IHJlbXVzIG5ldHdvcmsg YnVmZmVyaW5nIG5lZWRzIGlmYiBkZXZpY2UuIEluIG5ldyB4ZW4gYW5kIGxpbnV4IHZlcnNpb24s IHRoZSBrZXJuZWwgcWRpc2MgbW9kdWxlIHNjaF9wbHVnIHByb3ZpZGVzIHRoZSBuZXR3b3JrIGJ1 ZmZlcmluZy4gSWYgYSB2aXJ0dWFsIG1hY2hpbmUgLSBlZyBkb21haW4gaWQgaXMgMS4gSW4gZG9t YWluMCwgdmlmIGlzIHZpZjEuMCh0YyBxZGlzYyBhZGQgZGV2IHZpZjEuMCByb290IHBsdWcpLiBX aHkgbm90IGRpcmVjdGx5IHVzZSB0aGUgcGx1ZyBxZGlzYyBvbiB0aGlzIHZpZjEuMC4gUmVtdXMg bmVlZHMgdG8gIHVzZSBpZmIgZGV2aWNlLiBUaGUgcGFja2V0cyBvZiB2aWYxLjAgbmVlZHMgdG8g cmVkaXJlY3QgdG8gaWZiMC4gCgoKaXAgbGluayBzZXQgaWZiMCB1cAoKCnRjIHFkaXNjIGFkZCBk ZXYgaWZiMCByb290IHBsdWcKCgp0YyBxZGlzYyBhZGQgZGV2IHZpZjEuMCBpbmdyZXNzCgoKdGMg ZmlsdGVyIGFkZCBkZXYgIHZpZjEuMCAgcGFyZW50IGZmZmY6IHByb3RvIGlwIHByZWYgMTAgdTMy IG1hdGNoIHUzMiAwIDAgYWN0aW9uIG1pcnJlZCBlZ3Jlc3MgcmVkaXJlY3QgZGV2IGlmYjAKCg== ------=_Part_1928_942779349.1387747975730 Content-Type: text/html; charset=GBK Content-Transfer-Encoding: base64 PGRpdiBzdHlsZT0ibGluZS1oZWlnaHQ6MS43O2NvbG9yOiMwMDAwMDA7Zm9udC1zaXplOjE0cHg7 Zm9udC1mYW1pbHk6YXJpYWwiPkhpIGFsbCw8ZGl2Pjxicj48L2Rpdj48ZGl2PkRvZXMgYW55Ym9k eSBrbm93IHRoYXQgdGhlIGZ1bmN0aW9uIG9mIGlmYiBpbiB4ZW4gcmVtdXMgcHJvamVjdD8gSSBj YW4gbm90IHVuZGVyc3RhbmQgd2h5IHJlbXVzIG5ldHdvcmsgYnVmZmVyaW5nIG5lZWRzIGlmYiBk ZXZpY2UuIEluIG5ldyB4ZW4gYW5kIGxpbnV4IHZlcnNpb24sIHRoZSBrZXJuZWwgcWRpc2MgbW9k dWxlIHNjaF9wbHVnIHByb3ZpZGVzIHRoZSBuZXR3b3JrIGJ1ZmZlcmluZy4gSWYgYSB2aXJ0dWFs IG1hY2hpbmUgLSBlZyBkb21haW4gaWQgaXMgMS4gSW4gZG9tYWluMCwgdmlmIGlzIHZpZjEuMCh0 YyBxZGlzYyBhZGQgZGV2IHZpZjEuMCByb290IHBsdWcpLiBXaHkgbm90IGRpcmVjdGx5IHVzZSB0 aGUgcGx1ZyBxZGlzYyBvbiB0aGlzIHZpZjEuMC4gUmVtdXMgbmVlZHMgdG8gJm5ic3A7dXNlIGlm YiBkZXZpY2UuIFRoZSBwYWNrZXRzIG9mIHZpZjEuMCBuZWVkcyB0byByZWRpcmVjdCB0byBpZmIw LiZuYnNwOzwvZGl2PjxkaXY+PGRpdj48YnI+PC9kaXY+PGRpdj5pcCBsaW5rIHNldCBpZmIwIHVw PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj50YyBxZGlzYyBhZGQgZGV2IGlmYjAgcm9vdCBwbHVn PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj50YyBxZGlzYyBhZGQgZGV2IHZpZjEuMCBpbmdyZXNz PC9kaXY+PGRpdj48YnI+PC9kaXY+PGRpdj50YyBmaWx0ZXIgYWRkIGRldiAmbmJzcDt2aWYxLjAg Jm5ic3A7cGFyZW50IGZmZmY6IHByb3RvIGlwIHByZWYgMTAgdTMyIG1hdGNoIHUzMiAwIDAgYWN0 aW9uIG1pcnJlZCBlZ3Jlc3MgcmVkaXJlY3QgZGV2IGlmYjA8L2Rpdj48L2Rpdj48ZGl2Pjxicj48 L2Rpdj48L2Rpdj48YnI+PGJyPjxzcGFuIHRpdGxlPSJuZXRlYXNlZm9vdGVyIj48c3BhbiBpZD0i bmV0ZWFzZV9tYWlsX2Zvb3RlciI+PC9zcGFuPjwvc3Bhbj4= ------=_Part_1928_942779349.1387747975730-- --===============8280592921969112765== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============8280592921969112765==-- From xen-users-bounces@lists.xen.org Sun Dec 22 21:34:04 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sun, 22 Dec 2013 21:34:04 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vuqdr-0000SB-Ff; Sun, 22 Dec 2013 21:32:55 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vuqdp-0000S6-RG for xen-users@lists.xen.org; Sun, 22 Dec 2013 21:32:54 +0000 Received: from [85.158.143.35:40884] by server-1.bemta-4.messagelabs.com id A4/AB-02132-58A57B25; Sun, 22 Dec 2013 21:32:53 +0000 X-Env-Sender: wargo.john25@gmail.com X-Msg-Ref: server-15.tower-21.messagelabs.com!1387747971!5025125!1 X-Originating-IP: [209.85.217.173] X-SpamReason: No, hits=0.9 required=7.0 tests=HTML_40_50,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 10737 invoked from network); 22 Dec 2013 21:32:52 -0000 Received: from mail-lb0-f173.google.com (HELO mail-lb0-f173.google.com) (209.85.217.173) by server-15.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 22 Dec 2013 21:32:52 -0000 Received: by mail-lb0-f173.google.com with SMTP id z5so1961749lbh.18 for ; Sun, 22 Dec 2013 13:32:51 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=B8MCfgN8/FTRFx7l6x8LRUjwW1xLaAD4lyevWV6tEK4=; b=ohl56qTJpcO7KNuQvLDmzZo2LdFU1eIAYw+fdO9grBofrT7/H4sFEQ7CQWdN6h8/Tm pN2GUK6mbBQ3sdnRX92v5Zc1wwWie8ctK5vhYDwBHloDZ+34sj5tNC3X20HxaYtDOQiG Ltuqgj8uVKi4m7A728NrBCQy0fIZYF6JgBfKFnoT0rA7uAAd6BJt/p/83j2e3+VQylNT mqk+XozeqOEigOvzfPpq/rNo/N5HYqgAst0oxsg9iXvUZZbVABDcpyrea1dpNJIKaoX4 zOvdJGujRYiSpN/xpQVjbFHojAheUpN9FjwFCj2coUDov4Yxr+Dm9vi+rpYz39D6GC1j IF5g== MIME-Version: 1.0 X-Received: by 10.152.44.225 with SMTP id h1mr9262818lam.22.1387747971433; Sun, 22 Dec 2013 13:32:51 -0800 (PST) Received: by 10.114.183.131 with HTTP; Sun, 22 Dec 2013 13:32:51 -0800 (PST) Received: by 10.114.183.131 with HTTP; Sun, 22 Dec 2013 13:32:51 -0800 (PST) In-Reply-To: <52B72624.9060600@citrix.com> References: <52B70DD9.1000301@citrix.com> <52B72624.9060600@citrix.com> Date: Sun, 22 Dec 2013 15:32:51 -0600 Message-ID: From: John Wargo To: Andrew Cooper , Xen Users Subject: Re: [Xen-users] [Xen-devel] Undefined Symbol : libxl_cpu_bitmap_alloc X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============5573377098679875305==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============5573377098679875305== Content-Type: multipart/alternative; boundary=089e0160b7bee0680a04ee2640be --089e0160b7bee0680a04ee2640be Content-Type: text/plain; charset=ISO-8859-1 That was it. Thanks for your time, -John On Dec 22, 2013 11:49 AM, "Andrew Cooper" wrote: > On 22/12/2013 17:20, John Wargo wrote: > > Andrew, > > It appears to me that it is trying to use the 4.3 libraries, but I'm not > positive, and I don't know how to fix it. > > > The ABI version is still 4.3, so this is correct > > > *# ldd /usr/sbin/xl* > linux-vdso.so.1 => (0x00007fffe6000000) > libxlutil.so.4.3 => /lib64/libxlutil.so.4.3 (0x00007ffd05dc8000) > libxenlight.so.4.3 => /lib/libxenlight.so.4.3 (0x00000039d9a00000) > > > So this is using the lib from /lib > > libxenctrl.so.4.3 => /lib64/libxenctrl.so.4.3 > (0x00007ffd05ba0000) > > > And this from /lib64 > > You presumably have /lib64/libxenlight.so.4.3 which is the one you build > yourself, but it is behind /lib in the search path, so you are constantly > using an old libxenlight.so. > > If you remove all trace of the xen libraries from /lib, then it should > start working. I suspect this is because "make uninstall" will use > whichever is the currently configured libdir, rather than the last one you > installed into. > > ~Andrew > --089e0160b7bee0680a04ee2640be Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable

That was it.

Thanks for your time,
-John

On Dec 22, 2013 11:49 AM, "Andrew Cooper&qu= ot; <andrew.cooper3@citrix.= com> wrote:
=20 =20 =20
On 22/12/2013 17:20, John Wargo wrote:
=20
Andrew,

It appears to me that it is trying to use the 4.3 libraries, but I'm not positive, and I don't know how to = fix it.

The ABI version is still 4.3, so this is correct


# ldd /usr/sbin/xl
=A0 =A0 =A0 =A0 linux-vdso.so.1 =3D> =A0(0x00007fffe60000= 00)
=A0 =A0 =A0 =A0 libxlutil.so.4.3 =3D> /lib64/libxlutil.so= .4.3 (0x00007ffd05dc8000)
=A0 =A0 =A0 =A0 libxenlight.so.4.3 =3D> /lib/libxenlight.= so.4.3 (0x00000039d9a00000)

So this is using the lib from /lib

=A0 =A0 =A0 =A0 libxenctrl.so.4.3 =3D> /lib64/libxenctrl.= so.4.3 (0x00007ffd05ba0000)

And this from /lib64

You presumably have /lib64/libxenlight.so.4.3 which is the one you build yourself, but it is behind /lib in the search path, so you are constantly using an old libxenlight.so.

If you remove all trace of the xen libraries from /lib, then it should start working.=A0 I suspect this is because "make uninstall= " will use whichever is the currently configured libdir, rather than the last one you installed into.

~Andrew
--089e0160b7bee0680a04ee2640be-- --===============5573377098679875305== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============5573377098679875305==-- From xen-users-bounces@lists.xen.org Mon Dec 23 01:47:38 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 23 Dec 2013 01:47:38 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VuubL-0005M9-Dt; Mon, 23 Dec 2013 01:46:35 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VuubK-0005M4-Gr for xen-users@lists.xen.org; Mon, 23 Dec 2013 01:46:35 +0000 Received: from [193.109.254.147:33443] by server-15.bemta-14.messagelabs.com id 74/72-22186-9F597B25; Mon, 23 Dec 2013 01:46:33 +0000 X-Env-Sender: ehouby@yahoo.com X-Msg-Ref: server-4.tower-27.messagelabs.com!1387763191!3537642!1 X-Originating-IP: [98.139.213.95] X-SpamReason: No, hits=1.1 required=7.0 tests=BODY_RANDOM_LONG, FORGED_YAHOO_RCVD,ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 20165 invoked from network); 23 Dec 2013 01:46:32 -0000 Received: from nm8-vm0.bullet.mail.bf1.yahoo.com (HELO nm8-vm0.bullet.mail.bf1.yahoo.com) (98.139.213.95) by server-4.tower-27.messagelabs.com with SMTP; 23 Dec 2013 01:46:32 -0000 Received: from [98.139.212.149] by nm8.bullet.mail.bf1.yahoo.com with NNFMP; 23 Dec 2013 01:46:31 -0000 Received: from [98.139.213.10] by tm6.bullet.mail.bf1.yahoo.com with NNFMP; 23 Dec 2013 01:46:31 -0000 Received: from [127.0.0.1] by smtp110.mail.bf1.yahoo.com with NNFMP; 23 Dec 2013 01:46:31 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1387763191; bh=aaQjera5EZ9dkKD1fElWQux0urskYRDcxs83iCxKVvQ=; h=X-Yahoo-Newman-Id:X-Yahoo-Newman-Property:X-YMail-OSG:X-Yahoo-SMTP:X-Rocket-Received:From:To:References:In-Reply-To:Subject:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:X-Mailer:Content-Language:Thread-Index; b=Uj9bho7vHVBxUg2CyA8/frhACBj2AiKzboJWbvBrw2oBXxAoeO5bt8J/Sk1NrhL8UlkJI6doOoEUdlIeOX3svNiyNyW95xkcTNZehQoI+aAKMHejykMKsco1ODp1vG4QvosXVXphAqHKrvkhLXrlBzQXkFg/Kdk4dPpJWFpSRPY= X-Yahoo-Newman-Id: 657112.13878.bm@smtp110.mail.bf1.yahoo.com X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: S2okJyEVM1kNDKO.5V6t2j0.fL75lXsV4J7IiPdR3wH74Qm AMSSAiWWJg4TR3yT93ClSSwEKcAqWJM9NBWQbFbeI.xm5XQWIfXZQM3k_7j. LJ43cHCqf48NVKUWAQ2tBA16qodjdTHgvLK9AoKwRvAe4fsiNjrX5swa5FcQ IqHlg7oZLXpRtGAZVQhoKLV7wbe0odsPNvYAx.W1iA9nDX3Wp3eWe0NLQiuU 5yxVyPM_4wtha39sf_NvUXJGqY0IdCdHIvXF_IYY5jjZbpoJtF3bEfgEPDxb 44NBwLwrPIvUne2uxnzmk.CJcgH6.euROySRZd9xuUxrN5xvFB7mk7O1oYEO xZ6pK54OeN0krWkt4Lzq_lmB4ZTDW18vt9FwKTyeCy.FX497BwR16uwqZ.ms EdUAgpeEfVPPa2M9klSOkv9v0uJgf_cXzT34ePNL.QVV67.00jLCnirM_Q4t DNz1hZWiod_8uzbbBAQtZzQIlgILkzCl1VV9mAesgewN2sOLYALDmFuUHYEd O8MrHJZGj5.zNFGdq5JSMuNxEBvw18RkN7ZxbjJ8Whql2QnLiTJ5JSbyLRGl eziogiktOniHDu6gGTERdsbdw5juKnnynIoUNU6Z4o2t.vLNqK45GJuKLUnb J7Sf8Z2.9BQ-- X-Yahoo-SMTP: QpZsTh.swBBbiXoX3lukB1DLTA-- X-Rocket-Received: from mars (ehouby@71.196.207.87 with plain [98.138.105.21]) by smtp110.mail.bf1.yahoo.com with SMTP; 22 Dec 2013 17:46:31 -0800 PST From: "Eric Houby" To: "'Michaael Mair-Keimberger'" , References: <20131222140821.GB7095@asterix> In-Reply-To: <20131222140821.GB7095@asterix> Date: Sun, 22 Dec 2013 18:46:29 -0700 Message-ID: <00bb01ceff80$cdae1dc0$690a5940$@yahoo.com> MIME-Version: 1.0 X-Mailer: Microsoft Outlook 14.0 Content-Language: en-us Thread-Index: AQGZlYK36b84yUdNG3pyEhhUL/BDQJrLy7CQ Subject: Re: [Xen-users] vga passthrogh on mainboards with broken ivrs tables X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Michael, I have a GA-990FXA-UD3 H/W ver 1.1 that will boot up Xen 4.3.1 (Fedora 20) with IOMMU enabled. (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x1 handle 0x8 (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x2 handle 0 (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0 (XEN) AMD-Vi: IVHD Special: 0000:00:00.1 variety 0x1 handle 0x8 (XEN) IVHD Error: Conflicting IO-APIC 0x8 entries (XEN) AMD-Vi: IOMMU 0 Enabled. (XEN) AMD-Vi: Enabling global vector map (XEN) AMD-Vi: Using global interrupt remap table is not recommended (see XSA-36)! (XEN) I/O virtualisation enabled (XEN) - Dom0 mode: Relaxed (XEN) Interrupt remapping enabled (XEN) ENABLING IO-APIC IRQs My xen command line is: dom0_mem=2048M,max:2048M dom0_max_vcpus=2 dom0_vcpus_pin loglvl=all guest_loglvl=all iommu=debug,verbose,no-amd-iommu-perdev-intremap PCI passthrough of USB controllers works without issues, but I have not been able to passthrough a secondary graphics card (HD 5750) without getting a BSoD on my Win7 HVM. I have had the same 5750 and VM image working on a GA-890FXA, but have not been able to get the combination working on the GA-990FXA. If you are able to get IOMMU enabled, I will be interested to see if you get the graphics card to passthrough. Good luck. -Eric -----Original Message----- From: xen-users-bounces@lists.xen.org [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Michaael Mair-Keimberger Sent: Sunday, December 22, 2013 7:08 AM To: xen-users@lists.xen.org Subject: [Xen-users] vga passthrogh on mainboards with broken ivrs tables Hi Lists, I'm having troubles getting vga passthrough working again with latest xen-4.3.1. My system is a bulldozer amd 8core cpu with a gigabyte GA-990FXA-UD5 motherboard. The host system uses a amd hd6850 while the guest (windows 7) uses a amd hd 7970. So far everything worked great until xsa-36 [1]. I've haven't updated xen since this "fix", but yesterday i'll gave it another try. I've updated to xen-4.3.1 and tried to fix those broken ivrs tables with the newly introduced ivrx_ioapic kernel parameter. I'm not sure if this should help me, but at least it sounds promising. However i didn't get it to work and i hope someone can give my some hints how to fix that, otherwise i have to downgrade xen again. grub2 config: menuentry 'Gentoo Linux XEN' { root=hd0,1 multiboot /boot/xen.gz dom0_mem=8192M,max:8192M iommu=1 dom0_max_vcpus=4 dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 module /boot/gentoo-3.12.6 root=/dev/md3 radeon.pcie_gen2=1 radeon.dpm=1 softlevel=xen xen-pciback.permissive xen-pciback.hide=(01:00.0)(01:00.1)(00:12.0)(00:12.2) } lspci: 00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (external gfx0 port B) (rev 02) 00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD/ATI] RD990 I/O Memory Management Unit (IOMMU) 00:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (PCI express gpp port B) 00:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (PCI express gpp port H) 00:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (external gfx1 port A) 00:0d.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (external gfx1 port B) 00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] (rev 40) 00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller 00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller 00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller 00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 SMBus Controller (rev 42) 00:14.1 IDE interface: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 IDE Controller (rev 40) 00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 Azalia (Intel HDA) (rev 40) 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 LPC host controller (rev 40) 00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 PCI to PCI Bridge (rev 40) 00:14.5 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI2 Controller 00:15.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 PCI to PCI bridge (PCIE port 0) 00:15.1 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 PCI to PCI bridge (PCIE port 1) 00:15.2 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI bridge (PCIE port 2) 00:15.3 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI bridge (PCIE port 3) 00:16.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller 00:16.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 0 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 1 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 2 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 3 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 4 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 5 01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Tahiti XT [Radeon HD 7970] 01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Tahiti XT HDMI Audio [Radeon HD 7970 Series] 02:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller (rev 01) 03:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA 6Gb/s Controller (rev 11) 04:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Barts PRO [Radeon HD 6850] 04:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Barts HDMI Audio [Radeon HD 6800 Series] 05:0e.0 FireWire (IEEE 1394): VIA Technologies, Inc. VT6306/7/8 [Fire II(M)] IEEE 1394 OHCI Controller (rev c0) 06:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06) 07:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller (rev 01) 08:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA 6Gb/s Controller (rev 11) lspci -t: -[0000:00]-+-00.0 +-00.2 +-02.0-[01]--+-00.0 | \-00.1 +-09.0-[02]----00.0 +-0a.0-[03]----00.0 +-0d.0-[04]--+-00.0 | \-00.1 +-11.0 +-12.0 +-12.2 +-13.0 +-13.2 +-14.0 +-14.1 +-14.2 +-14.3 +-14.4-[05]----0e.0 +-14.5 +-15.0-[06]----00.0 +-15.1-[07]----00.0 +-15.2-[08]----00.0 +-15.3-[09]-- +-16.0 +-16.2 +-18.0 +-18.1 +-18.2 +-18.3 +-18.4 \-18.5 xl dmesg (shorten): (XEN) Xen version 4.3.1 (@xonet.at) (x86_64-pc-linux-gnu-gcc (Gentoo 4.8.2 p1.0, pie-0.5.8) 4.8.2) debug=n Sat Dec 21 11:55:39 CET 2013 (XEN) Latest ChangeSet: (XEN) Bootloader: GRUB 2.02~beta1 (XEN) Command line: dom0_mem=8192M,max:8192M iommu=1 dom0_max_vcpus=4 dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 ... (XEN) IOAPIC[0]: apic_id 8, version 33, address 0xfec00000, GSI 0-23 (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Detected 4026.984 MHz processor. (XEN) Initing memory sharing. (XEN) xstate_init: using cntxt_size: 0x3c0 and states: 0x4000000000000007 (XEN) IVHD Error: Conflicting IO-APIC 0x8 entries (XEN) AMD-Vi: Error initialization (XEN) I/O virtualisation disabled (XEN) ENABLING IO-APIC IRQs (XEN) -> Using new ACK method (XEN) Platform timer is 14.318MHz HPET (XEN) Allocated console ring of 16 KiB. (XEN) HVM: ASIDs enabled. (XEN) SVM: Supported advanced features: (XEN) - Nested Page Tables (NPT) (XEN) - Last Branch Record (LBR) Virtualisation (XEN) - Next-RIP Saved on #VMEXIT (XEN) - VMCB Clean Bits (XEN) - DecodeAssists (XEN) - Pause-Intercept Filter (XEN) - TSC Rate MSR (XEN) HVM: SVM enabled (XEN) HVM: Hardware Assisted Paging (HAP) detected (XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB (XEN) spurious 8259A interrupt: IRQ7. I've tried a few other configuration's (like adding the ivrs_ioapic parameter to the module line in grub or also adding vfio_iommu_type1.allow_unsafe_interrupts=1 to the cmdline), but so far i couldn't get it to work. Since i'm not completely sure what i actually have to insert at the kernel parameter i'm glad if someone could give me some insight. However, since the output of xl dmesg is always the same, even though with or without the parameter, i might missed some additional parameters. If you need any more information, I'll be glad to provide them. Thanks in advance. Michael [1] http://lists.xen.org/archives/html/xen-announce/2013-02/msg00002.html _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 23 01:47:38 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 23 Dec 2013 01:47:38 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VuubL-0005M9-Dt; Mon, 23 Dec 2013 01:46:35 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VuubK-0005M4-Gr for xen-users@lists.xen.org; Mon, 23 Dec 2013 01:46:35 +0000 Received: from [193.109.254.147:33443] by server-15.bemta-14.messagelabs.com id 74/72-22186-9F597B25; Mon, 23 Dec 2013 01:46:33 +0000 X-Env-Sender: ehouby@yahoo.com X-Msg-Ref: server-4.tower-27.messagelabs.com!1387763191!3537642!1 X-Originating-IP: [98.139.213.95] X-SpamReason: No, hits=1.1 required=7.0 tests=BODY_RANDOM_LONG, FORGED_YAHOO_RCVD,ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 20165 invoked from network); 23 Dec 2013 01:46:32 -0000 Received: from nm8-vm0.bullet.mail.bf1.yahoo.com (HELO nm8-vm0.bullet.mail.bf1.yahoo.com) (98.139.213.95) by server-4.tower-27.messagelabs.com with SMTP; 23 Dec 2013 01:46:32 -0000 Received: from [98.139.212.149] by nm8.bullet.mail.bf1.yahoo.com with NNFMP; 23 Dec 2013 01:46:31 -0000 Received: from [98.139.213.10] by tm6.bullet.mail.bf1.yahoo.com with NNFMP; 23 Dec 2013 01:46:31 -0000 Received: from [127.0.0.1] by smtp110.mail.bf1.yahoo.com with NNFMP; 23 Dec 2013 01:46:31 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1387763191; bh=aaQjera5EZ9dkKD1fElWQux0urskYRDcxs83iCxKVvQ=; h=X-Yahoo-Newman-Id:X-Yahoo-Newman-Property:X-YMail-OSG:X-Yahoo-SMTP:X-Rocket-Received:From:To:References:In-Reply-To:Subject:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:X-Mailer:Content-Language:Thread-Index; b=Uj9bho7vHVBxUg2CyA8/frhACBj2AiKzboJWbvBrw2oBXxAoeO5bt8J/Sk1NrhL8UlkJI6doOoEUdlIeOX3svNiyNyW95xkcTNZehQoI+aAKMHejykMKsco1ODp1vG4QvosXVXphAqHKrvkhLXrlBzQXkFg/Kdk4dPpJWFpSRPY= X-Yahoo-Newman-Id: 657112.13878.bm@smtp110.mail.bf1.yahoo.com X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: S2okJyEVM1kNDKO.5V6t2j0.fL75lXsV4J7IiPdR3wH74Qm AMSSAiWWJg4TR3yT93ClSSwEKcAqWJM9NBWQbFbeI.xm5XQWIfXZQM3k_7j. LJ43cHCqf48NVKUWAQ2tBA16qodjdTHgvLK9AoKwRvAe4fsiNjrX5swa5FcQ IqHlg7oZLXpRtGAZVQhoKLV7wbe0odsPNvYAx.W1iA9nDX3Wp3eWe0NLQiuU 5yxVyPM_4wtha39sf_NvUXJGqY0IdCdHIvXF_IYY5jjZbpoJtF3bEfgEPDxb 44NBwLwrPIvUne2uxnzmk.CJcgH6.euROySRZd9xuUxrN5xvFB7mk7O1oYEO xZ6pK54OeN0krWkt4Lzq_lmB4ZTDW18vt9FwKTyeCy.FX497BwR16uwqZ.ms EdUAgpeEfVPPa2M9klSOkv9v0uJgf_cXzT34ePNL.QVV67.00jLCnirM_Q4t DNz1hZWiod_8uzbbBAQtZzQIlgILkzCl1VV9mAesgewN2sOLYALDmFuUHYEd O8MrHJZGj5.zNFGdq5JSMuNxEBvw18RkN7ZxbjJ8Whql2QnLiTJ5JSbyLRGl eziogiktOniHDu6gGTERdsbdw5juKnnynIoUNU6Z4o2t.vLNqK45GJuKLUnb J7Sf8Z2.9BQ-- X-Yahoo-SMTP: QpZsTh.swBBbiXoX3lukB1DLTA-- X-Rocket-Received: from mars (ehouby@71.196.207.87 with plain [98.138.105.21]) by smtp110.mail.bf1.yahoo.com with SMTP; 22 Dec 2013 17:46:31 -0800 PST From: "Eric Houby" To: "'Michaael Mair-Keimberger'" , References: <20131222140821.GB7095@asterix> In-Reply-To: <20131222140821.GB7095@asterix> Date: Sun, 22 Dec 2013 18:46:29 -0700 Message-ID: <00bb01ceff80$cdae1dc0$690a5940$@yahoo.com> MIME-Version: 1.0 X-Mailer: Microsoft Outlook 14.0 Content-Language: en-us Thread-Index: AQGZlYK36b84yUdNG3pyEhhUL/BDQJrLy7CQ Subject: Re: [Xen-users] vga passthrogh on mainboards with broken ivrs tables X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Michael, I have a GA-990FXA-UD3 H/W ver 1.1 that will boot up Xen 4.3.1 (Fedora 20) with IOMMU enabled. (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x1 handle 0x8 (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x2 handle 0 (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0 (XEN) AMD-Vi: IVHD Special: 0000:00:00.1 variety 0x1 handle 0x8 (XEN) IVHD Error: Conflicting IO-APIC 0x8 entries (XEN) AMD-Vi: IOMMU 0 Enabled. (XEN) AMD-Vi: Enabling global vector map (XEN) AMD-Vi: Using global interrupt remap table is not recommended (see XSA-36)! (XEN) I/O virtualisation enabled (XEN) - Dom0 mode: Relaxed (XEN) Interrupt remapping enabled (XEN) ENABLING IO-APIC IRQs My xen command line is: dom0_mem=2048M,max:2048M dom0_max_vcpus=2 dom0_vcpus_pin loglvl=all guest_loglvl=all iommu=debug,verbose,no-amd-iommu-perdev-intremap PCI passthrough of USB controllers works without issues, but I have not been able to passthrough a secondary graphics card (HD 5750) without getting a BSoD on my Win7 HVM. I have had the same 5750 and VM image working on a GA-890FXA, but have not been able to get the combination working on the GA-990FXA. If you are able to get IOMMU enabled, I will be interested to see if you get the graphics card to passthrough. Good luck. -Eric -----Original Message----- From: xen-users-bounces@lists.xen.org [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Michaael Mair-Keimberger Sent: Sunday, December 22, 2013 7:08 AM To: xen-users@lists.xen.org Subject: [Xen-users] vga passthrogh on mainboards with broken ivrs tables Hi Lists, I'm having troubles getting vga passthrough working again with latest xen-4.3.1. My system is a bulldozer amd 8core cpu with a gigabyte GA-990FXA-UD5 motherboard. The host system uses a amd hd6850 while the guest (windows 7) uses a amd hd 7970. So far everything worked great until xsa-36 [1]. I've haven't updated xen since this "fix", but yesterday i'll gave it another try. I've updated to xen-4.3.1 and tried to fix those broken ivrs tables with the newly introduced ivrx_ioapic kernel parameter. I'm not sure if this should help me, but at least it sounds promising. However i didn't get it to work and i hope someone can give my some hints how to fix that, otherwise i have to downgrade xen again. grub2 config: menuentry 'Gentoo Linux XEN' { root=hd0,1 multiboot /boot/xen.gz dom0_mem=8192M,max:8192M iommu=1 dom0_max_vcpus=4 dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 module /boot/gentoo-3.12.6 root=/dev/md3 radeon.pcie_gen2=1 radeon.dpm=1 softlevel=xen xen-pciback.permissive xen-pciback.hide=(01:00.0)(01:00.1)(00:12.0)(00:12.2) } lspci: 00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (external gfx0 port B) (rev 02) 00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD/ATI] RD990 I/O Memory Management Unit (IOMMU) 00:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (PCI express gpp port B) 00:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (PCI express gpp port H) 00:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (external gfx1 port A) 00:0d.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI bridge (external gfx1 port B) 00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] (rev 40) 00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller 00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller 00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller 00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 SMBus Controller (rev 42) 00:14.1 IDE interface: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 IDE Controller (rev 40) 00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 Azalia (Intel HDA) (rev 40) 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 LPC host controller (rev 40) 00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 PCI to PCI Bridge (rev 40) 00:14.5 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI2 Controller 00:15.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 PCI to PCI bridge (PCIE port 0) 00:15.1 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 PCI to PCI bridge (PCIE port 1) 00:15.2 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI bridge (PCIE port 2) 00:15.3 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI bridge (PCIE port 3) 00:16.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB OHCI0 Controller 00:16.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 USB EHCI Controller 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 0 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 1 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 2 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 3 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 4 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor Function 5 01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Tahiti XT [Radeon HD 7970] 01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Tahiti XT HDMI Audio [Radeon HD 7970 Series] 02:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller (rev 01) 03:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA 6Gb/s Controller (rev 11) 04:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] Barts PRO [Radeon HD 6850] 04:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Barts HDMI Audio [Radeon HD 6800 Series] 05:0e.0 FireWire (IEEE 1394): VIA Technologies, Inc. VT6306/7/8 [Fire II(M)] IEEE 1394 OHCI Controller (rev c0) 06:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06) 07:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller (rev 01) 08:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA 6Gb/s Controller (rev 11) lspci -t: -[0000:00]-+-00.0 +-00.2 +-02.0-[01]--+-00.0 | \-00.1 +-09.0-[02]----00.0 +-0a.0-[03]----00.0 +-0d.0-[04]--+-00.0 | \-00.1 +-11.0 +-12.0 +-12.2 +-13.0 +-13.2 +-14.0 +-14.1 +-14.2 +-14.3 +-14.4-[05]----0e.0 +-14.5 +-15.0-[06]----00.0 +-15.1-[07]----00.0 +-15.2-[08]----00.0 +-15.3-[09]-- +-16.0 +-16.2 +-18.0 +-18.1 +-18.2 +-18.3 +-18.4 \-18.5 xl dmesg (shorten): (XEN) Xen version 4.3.1 (@xonet.at) (x86_64-pc-linux-gnu-gcc (Gentoo 4.8.2 p1.0, pie-0.5.8) 4.8.2) debug=n Sat Dec 21 11:55:39 CET 2013 (XEN) Latest ChangeSet: (XEN) Bootloader: GRUB 2.02~beta1 (XEN) Command line: dom0_mem=8192M,max:8192M iommu=1 dom0_max_vcpus=4 dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 ... (XEN) IOAPIC[0]: apic_id 8, version 33, address 0xfec00000, GSI 0-23 (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs (XEN) Using scheduler: SMP Credit Scheduler (credit) (XEN) Detected 4026.984 MHz processor. (XEN) Initing memory sharing. (XEN) xstate_init: using cntxt_size: 0x3c0 and states: 0x4000000000000007 (XEN) IVHD Error: Conflicting IO-APIC 0x8 entries (XEN) AMD-Vi: Error initialization (XEN) I/O virtualisation disabled (XEN) ENABLING IO-APIC IRQs (XEN) -> Using new ACK method (XEN) Platform timer is 14.318MHz HPET (XEN) Allocated console ring of 16 KiB. (XEN) HVM: ASIDs enabled. (XEN) SVM: Supported advanced features: (XEN) - Nested Page Tables (NPT) (XEN) - Last Branch Record (LBR) Virtualisation (XEN) - Next-RIP Saved on #VMEXIT (XEN) - VMCB Clean Bits (XEN) - DecodeAssists (XEN) - Pause-Intercept Filter (XEN) - TSC Rate MSR (XEN) HVM: SVM enabled (XEN) HVM: Hardware Assisted Paging (HAP) detected (XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB (XEN) spurious 8259A interrupt: IRQ7. I've tried a few other configuration's (like adding the ivrs_ioapic parameter to the module line in grub or also adding vfio_iommu_type1.allow_unsafe_interrupts=1 to the cmdline), but so far i couldn't get it to work. Since i'm not completely sure what i actually have to insert at the kernel parameter i'm glad if someone could give me some insight. However, since the output of xl dmesg is always the same, even though with or without the parameter, i might missed some additional parameters. If you need any more information, I'll be glad to provide them. Thanks in advance. Michael [1] http://lists.xen.org/archives/html/xen-announce/2013-02/msg00002.html _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 23 18:36:16 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 23 Dec 2013 18:36:16 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvALT-0007kv-5f; Mon, 23 Dec 2013 18:35:15 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvALQ-0007kg-Tj; Mon, 23 Dec 2013 18:35:13 +0000 Received: from [193.109.254.147:24643] by server-14.bemta-14.messagelabs.com id D7/F9-12628-06288B25; Mon, 23 Dec 2013 18:35:12 +0000 X-Env-Sender: russell.pavlicek@citrix.com X-Msg-Ref: server-10.tower-27.messagelabs.com!1387823698!7190838!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n, ML_RADAR_SPEW_LINKS_8, spamassassin: , async_handler: YXN5bmNfZGVsYXk6IDcwNDUxNDQgKHRpbWVvdXQp\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23723 invoked from network); 23 Dec 2013 18:34:59 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-10.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 23 Dec 2013 18:34:59 -0000 X-IronPort-AV: E=Sophos;i="4.95,538,1384300800"; d="scan'208,217";a="87307156" Received: from sjcpex01cl02.citrite.net ([10.216.14.144]) by FTLPIPO01.CITRIX.COM with ESMTP/TLS/AES128-SHA; 23 Dec 2013 18:34:56 +0000 Received: from SJCPEX01CL03.citrite.net ([169.254.3.162]) by SJCPEX01CL02.citrite.net ([10.216.14.144]) with mapi id 14.02.0342.004; Mon, 23 Dec 2013 10:34:55 -0800 From: Russell Pavlicek To: "xen-users@lists.xen.org" , "xen-devel@lists.xen.org" Thread-Topic: Serious issues with xenpaging Thread-Index: AQHPAA2s8bKeK4bMikuvJcx+WW34jw== Date: Mon, 23 Dec 2013 18:34:55 +0000 Message-ID: <55E78A57290FB64FA0D3CF672F9F3DA211C793@SJCPEX01CL03.citrite.net> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.13.112.13] MIME-Version: 1.0 Subject: [Xen-users] Serious issues with xenpaging X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============0238858847778410627==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============0238858847778410627== Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_55E78A57290FB64FA0D3CF672F9F3DA211C793SJCPEX01CL03citri_" --_000_55E78A57290FB64FA0D3CF672F9F3DA211C793SJCPEX01CL03citri_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable On Twitter, Florian Heigl sent a out a few messages about issues with xenpa= ging: --- 19-Dec: Anyone successfully use #xen #xenpaging? docs are at SLES manual, rest is mostly this: http://www.gossamer-thre= ads.com/lists/xen/devel/255798 dead feature or usab= le? 22-Dec: @lars_kurth @RCPavlicek Hey guys, I wrote down as much as I could https://pira= tenpad.de/p/Ik3lOBLniq1L5TEM (since I'm on holi= day and not constant online) 22-Dec: Yay, tested #xen = Xenpaging (memory overcommit) [x] largely untested [x] docs outdated [x] syntax+logic changed [x] broken --- [I've taken the liberty of removing the colorful expletive from the final p= ost] Is Florian's assessment correct, or is there somewhere we can point him for= help? I'm on vacation this week, but if someone replies to me, I will try= to forward the information appropriately. Thanks, Russ Pavlicek Xen Project Evangelist, Citrix Systems Home Office: +1-301-829-5327 Mobile: +1-240-397-0199 UK VoIP: +44 1223 852 894 --_000_55E78A57290FB64FA0D3CF672F9F3DA211C793SJCPEX01CL03citri_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
On Twitter, Florian Heigl sent a out a few messages about issues wit= h xenpaging:

---
19-Dec: Anyone successfully use #xen #xenpaging? docs are at SLES manual, res= t is mostly this: http://www.gossamer-threads.com/lists/xen/devel/255798 dead feature or usable?

22-Dec: @lars_kurth @RCPavlicek Hey guys, I wrote down as much as I could https://piratenpad.de/p/Ik3lOBLniq1L5TEM   (since I'm o= n holiday and not constant online)

22-Dec: Yay, tested #xen Xenpaging (memory overcommit)
[x] largely untested
[x] docs outdated
[x] syntax+logic changed
[x] broken
---

[I've taken the liberty of removing the colorful expletive from the final p= ost]

Is Florian's assessment correct, or is there somewhere we can point him for= help?  I'm on vacation this week, but if someone replies to me, I wil= l try to forward the information appropriately.

Thanks,

Russ Pavlicek
Xen Project Evangelist, Citrix Systems
Home Office: +1-301-829-5327
Mobile: +1-240-397-0199
UK VoIP: +44 1223 852 894
--_000_55E78A57290FB64FA0D3CF672F9F3DA211C793SJCPEX01CL03citri_-- --===============0238858847778410627== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============0238858847778410627==-- From xen-users-bounces@lists.xen.org Mon Dec 23 18:36:16 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 23 Dec 2013 18:36:16 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvALT-0007kv-5f; Mon, 23 Dec 2013 18:35:15 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvALQ-0007kg-Tj; Mon, 23 Dec 2013 18:35:13 +0000 Received: from [193.109.254.147:24643] by server-14.bemta-14.messagelabs.com id D7/F9-12628-06288B25; Mon, 23 Dec 2013 18:35:12 +0000 X-Env-Sender: russell.pavlicek@citrix.com X-Msg-Ref: server-10.tower-27.messagelabs.com!1387823698!7190838!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n, ML_RADAR_SPEW_LINKS_8, spamassassin: , async_handler: YXN5bmNfZGVsYXk6IDcwNDUxNDQgKHRpbWVvdXQp\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23723 invoked from network); 23 Dec 2013 18:34:59 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-10.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 23 Dec 2013 18:34:59 -0000 X-IronPort-AV: E=Sophos;i="4.95,538,1384300800"; d="scan'208,217";a="87307156" Received: from sjcpex01cl02.citrite.net ([10.216.14.144]) by FTLPIPO01.CITRIX.COM with ESMTP/TLS/AES128-SHA; 23 Dec 2013 18:34:56 +0000 Received: from SJCPEX01CL03.citrite.net ([169.254.3.162]) by SJCPEX01CL02.citrite.net ([10.216.14.144]) with mapi id 14.02.0342.004; Mon, 23 Dec 2013 10:34:55 -0800 From: Russell Pavlicek To: "xen-users@lists.xen.org" , "xen-devel@lists.xen.org" Thread-Topic: Serious issues with xenpaging Thread-Index: AQHPAA2s8bKeK4bMikuvJcx+WW34jw== Date: Mon, 23 Dec 2013 18:34:55 +0000 Message-ID: <55E78A57290FB64FA0D3CF672F9F3DA211C793@SJCPEX01CL03.citrite.net> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [10.13.112.13] MIME-Version: 1.0 Subject: [Xen-users] Serious issues with xenpaging X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============0238858847778410627==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============0238858847778410627== Content-Language: en-US Content-Type: multipart/alternative; boundary="_000_55E78A57290FB64FA0D3CF672F9F3DA211C793SJCPEX01CL03citri_" --_000_55E78A57290FB64FA0D3CF672F9F3DA211C793SJCPEX01CL03citri_ Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable On Twitter, Florian Heigl sent a out a few messages about issues with xenpa= ging: --- 19-Dec: Anyone successfully use #xen #xenpaging? docs are at SLES manual, rest is mostly this: http://www.gossamer-thre= ads.com/lists/xen/devel/255798 dead feature or usab= le? 22-Dec: @lars_kurth @RCPavlicek Hey guys, I wrote down as much as I could https://pira= tenpad.de/p/Ik3lOBLniq1L5TEM (since I'm on holi= day and not constant online) 22-Dec: Yay, tested #xen = Xenpaging (memory overcommit) [x] largely untested [x] docs outdated [x] syntax+logic changed [x] broken --- [I've taken the liberty of removing the colorful expletive from the final p= ost] Is Florian's assessment correct, or is there somewhere we can point him for= help? I'm on vacation this week, but if someone replies to me, I will try= to forward the information appropriately. Thanks, Russ Pavlicek Xen Project Evangelist, Citrix Systems Home Office: +1-301-829-5327 Mobile: +1-240-397-0199 UK VoIP: +44 1223 852 894 --_000_55E78A57290FB64FA0D3CF672F9F3DA211C793SJCPEX01CL03citri_ Content-Type: text/html; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable
On Twitter, Florian Heigl sent a out a few messages about issues wit= h xenpaging:

---
19-Dec: Anyone successfully use #xen #xenpaging? docs are at SLES manual, res= t is mostly this: http://www.gossamer-threads.com/lists/xen/devel/255798 dead feature or usable?

22-Dec: @lars_kurth @RCPavlicek Hey guys, I wrote down as much as I could https://piratenpad.de/p/Ik3lOBLniq1L5TEM   (since I'm o= n holiday and not constant online)

22-Dec: Yay, tested #xen Xenpaging (memory overcommit)
[x] largely untested
[x] docs outdated
[x] syntax+logic changed
[x] broken
---

[I've taken the liberty of removing the colorful expletive from the final p= ost]

Is Florian's assessment correct, or is there somewhere we can point him for= help?  I'm on vacation this week, but if someone replies to me, I wil= l try to forward the information appropriately.

Thanks,

Russ Pavlicek
Xen Project Evangelist, Citrix Systems
Home Office: +1-301-829-5327
Mobile: +1-240-397-0199
UK VoIP: +44 1223 852 894
--_000_55E78A57290FB64FA0D3CF672F9F3DA211C793SJCPEX01CL03citri_-- --===============0238858847778410627== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============0238858847778410627==-- From xen-users-bounces@lists.xen.org Tue Dec 24 09:52:57 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 24 Dec 2013 09:52:57 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvOeE-0006f6-OI; Tue, 24 Dec 2013 09:51:34 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvOeC-0006f1-MB for xen-users@lists.xen.org; Tue, 24 Dec 2013 09:51:32 +0000 Received: from [85.158.143.35:37289] by server-1.bemta-4.messagelabs.com id D1/2A-02132-32959B25; Tue, 24 Dec 2013 09:51:31 +0000 X-Env-Sender: mlg-hessigheim@gmx.de X-Msg-Ref: server-5.tower-21.messagelabs.com!1387878691!8010316!1 X-Originating-IP: [212.227.15.19] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE1LjE5ID0+IDI1MjI5\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE1LjE5ID0+IDI1MjI5\n,ML_RADAR_SPEW_LINKS_14, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30086 invoked from network); 24 Dec 2013 09:51:31 -0000 Received: from mout.gmx.net (HELO mout.gmx.net) (212.227.15.19) by server-5.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 24 Dec 2013 09:51:31 -0000 Received: from [192.168.2.101] ([91.89.92.96]) by mail.gmx.com (mrgmx102) with ESMTPSA (Nemesis) id 0MAkkB-1VkhOj3w9j-00BrY3 for ; Tue, 24 Dec 2013 10:51:30 +0100 Message-ID: <52B95918.5050206@gmx.de> Date: Tue, 24 Dec 2013 10:51:20 +0100 From: Martin Lang User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: "xen-users@lists.xen.org" X-Provags-ID: V03:K0:VFVw8WMSdJ+ohmA++g2+NMvSGa+BcsSLXaTIuCQzZVw54hhuxah uoYGbI5AyDSDxs3hGZwh4SVFwFtmGyDoCKbZhMa3dOvOTRXoaZtzJKyVNRa5PCWBTAiguQV obRu3CcrUX6se/5xK4Cm5m8L/lp78aPTUQ8ckeS8BMiyow4Ez3J5RzjdZECqtJzk67qhG0M d6t3yz3KGEuHIFkZX3D4Q== Subject: [Xen-users] Boot problem with Debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi all, I have a Xen server based on Debian Wheezy 7.1 runnung. I recently did an apt-get update to the latest Wheezy version. Since then I have a problem booting the kernel with xen(Dom0). Booting without xen is not a problem. I always get an error: swapper/0 Not tainted 3.2.0.4-686-pae Last function on stack trace is: xen_prepare_smp_cpus No I tried the Jessie tree of debian with kernel 3.11 but the same result. Same stack trace. No further information in any log file found. Any hints how I can get my server up again? _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 24 09:52:57 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 24 Dec 2013 09:52:57 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvOeE-0006f6-OI; Tue, 24 Dec 2013 09:51:34 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvOeC-0006f1-MB for xen-users@lists.xen.org; Tue, 24 Dec 2013 09:51:32 +0000 Received: from [85.158.143.35:37289] by server-1.bemta-4.messagelabs.com id D1/2A-02132-32959B25; Tue, 24 Dec 2013 09:51:31 +0000 X-Env-Sender: mlg-hessigheim@gmx.de X-Msg-Ref: server-5.tower-21.messagelabs.com!1387878691!8010316!1 X-Originating-IP: [212.227.15.19] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE1LjE5ID0+IDI1MjI5\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE1LjE5ID0+IDI1MjI5\n,ML_RADAR_SPEW_LINKS_14, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30086 invoked from network); 24 Dec 2013 09:51:31 -0000 Received: from mout.gmx.net (HELO mout.gmx.net) (212.227.15.19) by server-5.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 24 Dec 2013 09:51:31 -0000 Received: from [192.168.2.101] ([91.89.92.96]) by mail.gmx.com (mrgmx102) with ESMTPSA (Nemesis) id 0MAkkB-1VkhOj3w9j-00BrY3 for ; Tue, 24 Dec 2013 10:51:30 +0100 Message-ID: <52B95918.5050206@gmx.de> Date: Tue, 24 Dec 2013 10:51:20 +0100 From: Martin Lang User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: "xen-users@lists.xen.org" X-Provags-ID: V03:K0:VFVw8WMSdJ+ohmA++g2+NMvSGa+BcsSLXaTIuCQzZVw54hhuxah uoYGbI5AyDSDxs3hGZwh4SVFwFtmGyDoCKbZhMa3dOvOTRXoaZtzJKyVNRa5PCWBTAiguQV obRu3CcrUX6se/5xK4Cm5m8L/lp78aPTUQ8ckeS8BMiyow4Ez3J5RzjdZECqtJzk67qhG0M d6t3yz3KGEuHIFkZX3D4Q== Subject: [Xen-users] Boot problem with Debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi all, I have a Xen server based on Debian Wheezy 7.1 runnung. I recently did an apt-get update to the latest Wheezy version. Since then I have a problem booting the kernel with xen(Dom0). Booting without xen is not a problem. I always get an error: swapper/0 Not tainted 3.2.0.4-686-pae Last function on stack trace is: xen_prepare_smp_cpus No I tried the Jessie tree of debian with kernel 3.11 but the same result. Same stack trace. No further information in any log file found. Any hints how I can get my server up again? _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 24 10:13:48 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 24 Dec 2013 10:13:48 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvOzM-0007Xu-QW; Tue, 24 Dec 2013 10:13:24 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvOzL-0007Xp-EY for xen-users@lists.xen.org; Tue, 24 Dec 2013 10:13:23 +0000 Received: from [85.158.143.35:8858] by server-1.bemta-4.messagelabs.com id CB/86-02132-24E59B25; Tue, 24 Dec 2013 10:13:22 +0000 X-Env-Sender: mlg-hessigheim@gmx.de X-Msg-Ref: server-12.tower-21.messagelabs.com!1387880001!7851467!1 X-Originating-IP: [212.227.17.22] X-SpamReason: No, hits=0.5 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjIyID0+IDIxMDU4\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjIyID0+IDIxMDU4\n,BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 18212 invoked from network); 24 Dec 2013 10:13:22 -0000 Received: from mout.gmx.net (HELO mout.gmx.net) (212.227.17.22) by server-12.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 24 Dec 2013 10:13:22 -0000 Received: from [192.168.2.101] ([91.89.92.96]) by mail.gmx.com (mrgmx103) with ESMTPSA (Nemesis) id 0MZlEg-1WCMq529c6-00LYFX for ; Tue, 24 Dec 2013 11:13:15 +0100 Message-ID: <52B95E3B.6070303@gmx.de> Date: Tue, 24 Dec 2013 11:13:15 +0100 From: Martin Lang User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: "xen-users@lists.xen.org" X-Provags-ID: V03:K0:+cn0rdMifm9nzeYV/BuJOtaSiwMIf02r7inrO4uPc/RlqGbvo2H F+rCXSC33KKz/5r1I3lxWEKNPhbM2xQVFznMo5qzDnlvHA1ZPEXML/lWkETnFksq4MA0dQ8 3r2lxY1f1zXw7dcwFP/k10FeLDMCfBRYd3W8qudfBtU9tBfTgDsAYrqkb+8x4ZtLCmH0fdQ WLiejqOltoWI6ztm9zl8A== Subject: [Xen-users] [Solved] Boot problem with debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi all, I solved the problem. During upgrade the grub.cfg got modified by the installation procedure and the xen boot options were deleted. After inserting lapic option again it works. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 24 10:13:48 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 24 Dec 2013 10:13:48 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvOzM-0007Xu-QW; Tue, 24 Dec 2013 10:13:24 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvOzL-0007Xp-EY for xen-users@lists.xen.org; Tue, 24 Dec 2013 10:13:23 +0000 Received: from [85.158.143.35:8858] by server-1.bemta-4.messagelabs.com id CB/86-02132-24E59B25; Tue, 24 Dec 2013 10:13:22 +0000 X-Env-Sender: mlg-hessigheim@gmx.de X-Msg-Ref: server-12.tower-21.messagelabs.com!1387880001!7851467!1 X-Originating-IP: [212.227.17.22] X-SpamReason: No, hits=0.5 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjIyID0+IDIxMDU4\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjIyID0+IDIxMDU4\n,BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 18212 invoked from network); 24 Dec 2013 10:13:22 -0000 Received: from mout.gmx.net (HELO mout.gmx.net) (212.227.17.22) by server-12.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 24 Dec 2013 10:13:22 -0000 Received: from [192.168.2.101] ([91.89.92.96]) by mail.gmx.com (mrgmx103) with ESMTPSA (Nemesis) id 0MZlEg-1WCMq529c6-00LYFX for ; Tue, 24 Dec 2013 11:13:15 +0100 Message-ID: <52B95E3B.6070303@gmx.de> Date: Tue, 24 Dec 2013 11:13:15 +0100 From: Martin Lang User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: "xen-users@lists.xen.org" X-Provags-ID: V03:K0:+cn0rdMifm9nzeYV/BuJOtaSiwMIf02r7inrO4uPc/RlqGbvo2H F+rCXSC33KKz/5r1I3lxWEKNPhbM2xQVFznMo5qzDnlvHA1ZPEXML/lWkETnFksq4MA0dQ8 3r2lxY1f1zXw7dcwFP/k10FeLDMCfBRYd3W8qudfBtU9tBfTgDsAYrqkb+8x4ZtLCmH0fdQ WLiejqOltoWI6ztm9zl8A== Subject: [Xen-users] [Solved] Boot problem with debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi all, I solved the problem. During upgrade the grub.cfg got modified by the installation procedure and the xen boot options were deleted. After inserting lapic option again it works. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 24 12:42:33 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 24 Dec 2013 12:42:33 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvRId-0006El-Qs; Tue, 24 Dec 2013 12:41:27 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvRIc-0006Eg-25 for xen-users@lists.xen.org; Tue, 24 Dec 2013 12:41:26 +0000 Received: from [85.158.143.35:32353] by server-2.bemta-4.messagelabs.com id 23/03-11386-5F089B25; Tue, 24 Dec 2013 12:41:25 +0000 X-Env-Sender: m.mairkeimberger@gmail.com X-Msg-Ref: server-13.tower-21.messagelabs.com!1387888883!6760689!1 X-Originating-IP: [209.85.215.177] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 16619 invoked from network); 24 Dec 2013 12:41:24 -0000 Received: from mail-ea0-f177.google.com (HELO mail-ea0-f177.google.com) (209.85.215.177) by server-13.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 24 Dec 2013 12:41:24 -0000 Received: by mail-ea0-f177.google.com with SMTP id n15so2852490ead.22 for ; Tue, 24 Dec 2013 04:41:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:subject:message-id:mail-followup-to:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=eOwAq9amWxvrEnvX2X75lMc/i6ESBKAC6unJP2zjoB0=; b=jHg42OvqmKJWQKi/WRNB8vWd6nB7gE29v3YD/lE55hcZHcRlvEXPuedASA3yRIGfj9 PUTuUll2BP3f4yosI19Xk4sgiXBq3vLvYRyRnGjJYAu52ulvfwyBr4530mYPLPRDa/HU XNsCt473K38rEg3P+faRdfYSDz3chG368I5/1n9tZ0lzUtVXXlPGNAaxp9x2uNcwf1sG Q7jtkI5hRacMlE67hoVpmvE4gpgWoAPf5V6T9srYnDloLCq1n2PDF8u3CG+xHISvPjNt fHfWHgjoYVOd5fpzvslFAygSZ5X1soOCHBG9nwicsfR6jc4Xkq30euhAsGh3tRvBR0RL SKBg== X-Received: by 10.14.175.131 with SMTP id z3mr2402337eel.65.1387888883839; Tue, 24 Dec 2013 04:41:23 -0800 (PST) Received: from asterix ([80.66.44.3]) by mx.google.com with ESMTPSA id h48sm54679806eev.3.2013.12.24.04.41.22 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 24 Dec 2013 04:41:22 -0800 (PST) Date: Tue, 24 Dec 2013 13:42:25 +0100 From: Michaael Mair-Keimberger To: xen-users@lists.xen.org Message-ID: <20131224124225.GA3203@asterix> Mail-Followup-To: xen-users@lists.xen.org References: <20131222140821.GB7095@asterix> <00bb01ceff80$cdae1dc0$690a5940$@yahoo.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <00bb01ceff80$cdae1dc0$690a5940$@yahoo.com> User-Agent: Mutt/1.5.22 (2013-10-16) Subject: Re: [Xen-users] vga passthrogh on mainboards with broken ivrs tables X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi Eric, I still couldn't get it to work. However, since the ivrs_ioapic kernel parameter didn't do anything (i didn't even got any log messages about it) i've dug further into this parameter. Sadly i found out it's not included in xen-4.3.1 and since gentoo doesn't provide git ebuilds for xen i'll gonna wait until next xen will be released. xen-4.4 should be release on 21.01.14 - Thats not that far away and i guess i can wait for it :) If you want to passthrough your graphic card i suggest you to install a older version of xen. Personally i have my own xen-4.2.1 ebuild which don't include XSA-36. That one works perfectly well. If irvs_ioapic won't help with next xen I'll go back too... Regards, Michael On Sun, Dec 22, 2013 at 06:46:29PM -0700, Eric Houby wrote: > Michael, > > I have a GA-990FXA-UD3 H/W ver 1.1 that will boot up Xen 4.3.1 (Fedora 20) > with IOMMU enabled. > > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 > (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x1 handle 0x8 > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 > (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x2 handle 0 > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0 > (XEN) AMD-Vi: IVHD Special: 0000:00:00.1 variety 0x1 handle 0x8 > (XEN) IVHD Error: Conflicting IO-APIC 0x8 entries > (XEN) AMD-Vi: IOMMU 0 Enabled. > (XEN) AMD-Vi: Enabling global vector map > (XEN) AMD-Vi: Using global interrupt remap table is not recommended (see > XSA-36)! > (XEN) I/O virtualisation enabled > (XEN) - Dom0 mode: Relaxed > (XEN) Interrupt remapping enabled > (XEN) ENABLING IO-APIC IRQs > > My xen command line is: > > dom0_mem=2048M,max:2048M dom0_max_vcpus=2 dom0_vcpus_pin loglvl=all > guest_loglvl=all iommu=debug,verbose,no-amd-iommu-perdev-intremap > > PCI passthrough of USB controllers works without issues, but I have not been > able to passthrough a secondary graphics card (HD 5750) without getting a > BSoD on my Win7 HVM. I have had the same 5750 and VM image working on a > GA-890FXA, but have not been able to get the combination working on the > GA-990FXA. If you are able to get IOMMU enabled, I will be interested to > see if you get the graphics card to passthrough. > > Good luck. > > -Eric > > > > > -----Original Message----- > From: xen-users-bounces@lists.xen.org > [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Michaael > Mair-Keimberger > Sent: Sunday, December 22, 2013 7:08 AM > To: xen-users@lists.xen.org > Subject: [Xen-users] vga passthrogh on mainboards with broken ivrs tables > > Hi Lists, > > I'm having troubles getting vga passthrough working again with latest > xen-4.3.1. > > My system is a bulldozer amd 8core cpu with a gigabyte GA-990FXA-UD5 > motherboard. > The host system uses a amd hd6850 while the guest (windows 7) uses a amd hd > 7970. > > So far everything worked great until xsa-36 [1]. I've haven't updated xen > since this "fix", but yesterday i'll gave it another try. I've updated to > xen-4.3.1 and tried to fix those broken ivrs tables with the newly > introduced ivrx_ioapic kernel parameter. I'm not sure if this should help > me, but at least it sounds promising. > However i didn't get it to work and i hope someone can give my some hints > how to fix that, otherwise i have to downgrade xen again. > > > grub2 config: > > menuentry 'Gentoo Linux XEN' { > root=hd0,1 > multiboot /boot/xen.gz dom0_mem=8192M,max:8192M iommu=1 > dom0_max_vcpus=4 dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 > module /boot/gentoo-3.12.6 root=/dev/md3 radeon.pcie_gen2=1 > radeon.dpm=1 softlevel=xen xen-pciback.permissive > xen-pciback.hide=(01:00.0)(01:00.1)(00:12.0)(00:12.2) > } > > lspci: > > 00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI > bridge (external gfx0 port B) (rev 02) > 00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD/ATI] RD990 I/O Memory > Management Unit (IOMMU) > 00:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI > bridge (PCI express gpp port B) > 00:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI > bridge (PCI express gpp port H) > 00:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI > bridge (external gfx1 port A) > 00:0d.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI > bridge (external gfx1 port B) > 00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] (rev 40) > 00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI0 Controller > 00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB EHCI Controller > 00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI0 Controller > 00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB EHCI Controller > 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 SMBus Controller > (rev 42) > 00:14.1 IDE interface: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 IDE Controller (rev 40) > 00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 Azalia > (Intel HDA) (rev 40) > 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 > LPC host controller (rev 40) > 00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 PCI to PCI > Bridge (rev 40) > 00:14.5 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI2 Controller > 00:15.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 > PCI to PCI bridge (PCIE port 0) > 00:15.1 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 > PCI to PCI bridge (PCIE port 1) > 00:15.2 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI > bridge (PCIE port 2) > 00:15.3 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI > bridge (PCIE port 3) > 00:16.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI0 Controller > 00:16.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB EHCI Controller > 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor > Function 0 > 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor > Function 1 > 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor > Function 2 > 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor > Function 3 > 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor > Function 4 > 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor > Function 5 > 01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] > Tahiti XT [Radeon HD 7970] > 01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Tahiti XT HDMI > Audio [Radeon HD 7970 Series] > 02:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller > (rev 01) > 03:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA 6Gb/s > Controller (rev 11) > 04:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] > Barts PRO [Radeon HD 6850] > 04:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Barts HDMI > Audio [Radeon HD 6800 Series] > 05:0e.0 FireWire (IEEE 1394): VIA Technologies, Inc. VT6306/7/8 [Fire II(M)] > IEEE 1394 OHCI Controller (rev c0) > 06:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. > RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06) > 07:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller > (rev 01) > 08:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA 6Gb/s > Controller (rev 11) > > lspci -t: > > -[0000:00]-+-00.0 > +-00.2 > +-02.0-[01]--+-00.0 > | \-00.1 > +-09.0-[02]----00.0 > +-0a.0-[03]----00.0 > +-0d.0-[04]--+-00.0 > | \-00.1 > +-11.0 > +-12.0 > +-12.2 > +-13.0 > +-13.2 > +-14.0 > +-14.1 > +-14.2 > +-14.3 > +-14.4-[05]----0e.0 > +-14.5 > +-15.0-[06]----00.0 > +-15.1-[07]----00.0 > +-15.2-[08]----00.0 > +-15.3-[09]-- > +-16.0 > +-16.2 > +-18.0 > +-18.1 > +-18.2 > +-18.3 > +-18.4 > \-18.5 > > xl dmesg (shorten): > > (XEN) Xen version 4.3.1 (@xonet.at) (x86_64-pc-linux-gnu-gcc (Gentoo 4.8.2 > p1.0, pie-0.5.8) 4.8.2) debug=n Sat Dec 21 11:55:39 CET 2013 > (XEN) Latest ChangeSet: > (XEN) Bootloader: GRUB 2.02~beta1 > (XEN) Command line: dom0_mem=8192M,max:8192M iommu=1 dom0_max_vcpus=4 > dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 ... > (XEN) IOAPIC[0]: apic_id 8, version 33, address 0xfec00000, GSI 0-23 > (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs > (XEN) Using scheduler: SMP Credit Scheduler (credit) > (XEN) Detected 4026.984 MHz processor. > (XEN) Initing memory sharing. > (XEN) xstate_init: using cntxt_size: 0x3c0 and states: 0x4000000000000007 > (XEN) IVHD Error: Conflicting IO-APIC 0x8 entries > (XEN) AMD-Vi: Error initialization > (XEN) I/O virtualisation disabled > (XEN) ENABLING IO-APIC IRQs > (XEN) -> Using new ACK method > (XEN) Platform timer is 14.318MHz HPET > (XEN) Allocated console ring of 16 KiB. > (XEN) HVM: ASIDs enabled. > (XEN) SVM: Supported advanced features: > (XEN) - Nested Page Tables (NPT) > (XEN) - Last Branch Record (LBR) Virtualisation > (XEN) - Next-RIP Saved on #VMEXIT > (XEN) - VMCB Clean Bits > (XEN) - DecodeAssists > (XEN) - Pause-Intercept Filter > (XEN) - TSC Rate MSR > (XEN) HVM: SVM enabled > (XEN) HVM: Hardware Assisted Paging (HAP) detected > (XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB > (XEN) spurious 8259A interrupt: IRQ7. > > > I've tried a few other configuration's (like adding the ivrs_ioapic > parameter to the module line in grub or also adding > vfio_iommu_type1.allow_unsafe_interrupts=1 > to the cmdline), but so far i couldn't get it to work. > > Since i'm not completely sure what i actually have to insert at the kernel > parameter i'm glad if someone could give me some insight. However, since the > output of xl dmesg is always the same, even though with or without the > parameter, i might missed some additional parameters. > > If you need any more information, I'll be glad to provide them. > > Thanks in advance. > > Michael > > > > > > > > > [1] http://lists.xen.org/archives/html/xen-announce/2013-02/msg00002.html > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 24 12:42:33 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 24 Dec 2013 12:42:33 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvRId-0006El-Qs; Tue, 24 Dec 2013 12:41:27 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvRIc-0006Eg-25 for xen-users@lists.xen.org; Tue, 24 Dec 2013 12:41:26 +0000 Received: from [85.158.143.35:32353] by server-2.bemta-4.messagelabs.com id 23/03-11386-5F089B25; Tue, 24 Dec 2013 12:41:25 +0000 X-Env-Sender: m.mairkeimberger@gmail.com X-Msg-Ref: server-13.tower-21.messagelabs.com!1387888883!6760689!1 X-Originating-IP: [209.85.215.177] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 16619 invoked from network); 24 Dec 2013 12:41:24 -0000 Received: from mail-ea0-f177.google.com (HELO mail-ea0-f177.google.com) (209.85.215.177) by server-13.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 24 Dec 2013 12:41:24 -0000 Received: by mail-ea0-f177.google.com with SMTP id n15so2852490ead.22 for ; Tue, 24 Dec 2013 04:41:23 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=date:from:to:subject:message-id:mail-followup-to:references :mime-version:content-type:content-disposition:in-reply-to :user-agent; bh=eOwAq9amWxvrEnvX2X75lMc/i6ESBKAC6unJP2zjoB0=; b=jHg42OvqmKJWQKi/WRNB8vWd6nB7gE29v3YD/lE55hcZHcRlvEXPuedASA3yRIGfj9 PUTuUll2BP3f4yosI19Xk4sgiXBq3vLvYRyRnGjJYAu52ulvfwyBr4530mYPLPRDa/HU XNsCt473K38rEg3P+faRdfYSDz3chG368I5/1n9tZ0lzUtVXXlPGNAaxp9x2uNcwf1sG Q7jtkI5hRacMlE67hoVpmvE4gpgWoAPf5V6T9srYnDloLCq1n2PDF8u3CG+xHISvPjNt fHfWHgjoYVOd5fpzvslFAygSZ5X1soOCHBG9nwicsfR6jc4Xkq30euhAsGh3tRvBR0RL SKBg== X-Received: by 10.14.175.131 with SMTP id z3mr2402337eel.65.1387888883839; Tue, 24 Dec 2013 04:41:23 -0800 (PST) Received: from asterix ([80.66.44.3]) by mx.google.com with ESMTPSA id h48sm54679806eev.3.2013.12.24.04.41.22 for (version=TLSv1.2 cipher=ECDHE-RSA-AES128-GCM-SHA256 bits=128/128); Tue, 24 Dec 2013 04:41:22 -0800 (PST) Date: Tue, 24 Dec 2013 13:42:25 +0100 From: Michaael Mair-Keimberger To: xen-users@lists.xen.org Message-ID: <20131224124225.GA3203@asterix> Mail-Followup-To: xen-users@lists.xen.org References: <20131222140821.GB7095@asterix> <00bb01ceff80$cdae1dc0$690a5940$@yahoo.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <00bb01ceff80$cdae1dc0$690a5940$@yahoo.com> User-Agent: Mutt/1.5.22 (2013-10-16) Subject: Re: [Xen-users] vga passthrogh on mainboards with broken ivrs tables X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi Eric, I still couldn't get it to work. However, since the ivrs_ioapic kernel parameter didn't do anything (i didn't even got any log messages about it) i've dug further into this parameter. Sadly i found out it's not included in xen-4.3.1 and since gentoo doesn't provide git ebuilds for xen i'll gonna wait until next xen will be released. xen-4.4 should be release on 21.01.14 - Thats not that far away and i guess i can wait for it :) If you want to passthrough your graphic card i suggest you to install a older version of xen. Personally i have my own xen-4.2.1 ebuild which don't include XSA-36. That one works perfectly well. If irvs_ioapic won't help with next xen I'll go back too... Regards, Michael On Sun, Dec 22, 2013 at 06:46:29PM -0700, Eric Houby wrote: > Michael, > > I have a GA-990FXA-UD3 H/W ver 1.1 that will boot up Xen 4.3.1 (Fedora 20) > with IOMMU enabled. > > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 > (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x1 handle 0x8 > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 > (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x2 handle 0 > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0 > (XEN) AMD-Vi: IVHD Special: 0000:00:00.1 variety 0x1 handle 0x8 > (XEN) IVHD Error: Conflicting IO-APIC 0x8 entries > (XEN) AMD-Vi: IOMMU 0 Enabled. > (XEN) AMD-Vi: Enabling global vector map > (XEN) AMD-Vi: Using global interrupt remap table is not recommended (see > XSA-36)! > (XEN) I/O virtualisation enabled > (XEN) - Dom0 mode: Relaxed > (XEN) Interrupt remapping enabled > (XEN) ENABLING IO-APIC IRQs > > My xen command line is: > > dom0_mem=2048M,max:2048M dom0_max_vcpus=2 dom0_vcpus_pin loglvl=all > guest_loglvl=all iommu=debug,verbose,no-amd-iommu-perdev-intremap > > PCI passthrough of USB controllers works without issues, but I have not been > able to passthrough a secondary graphics card (HD 5750) without getting a > BSoD on my Win7 HVM. I have had the same 5750 and VM image working on a > GA-890FXA, but have not been able to get the combination working on the > GA-990FXA. If you are able to get IOMMU enabled, I will be interested to > see if you get the graphics card to passthrough. > > Good luck. > > -Eric > > > > > -----Original Message----- > From: xen-users-bounces@lists.xen.org > [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Michaael > Mair-Keimberger > Sent: Sunday, December 22, 2013 7:08 AM > To: xen-users@lists.xen.org > Subject: [Xen-users] vga passthrogh on mainboards with broken ivrs tables > > Hi Lists, > > I'm having troubles getting vga passthrough working again with latest > xen-4.3.1. > > My system is a bulldozer amd 8core cpu with a gigabyte GA-990FXA-UD5 > motherboard. > The host system uses a amd hd6850 while the guest (windows 7) uses a amd hd > 7970. > > So far everything worked great until xsa-36 [1]. I've haven't updated xen > since this "fix", but yesterday i'll gave it another try. I've updated to > xen-4.3.1 and tried to fix those broken ivrs tables with the newly > introduced ivrx_ioapic kernel parameter. I'm not sure if this should help > me, but at least it sounds promising. > However i didn't get it to work and i hope someone can give my some hints > how to fix that, otherwise i have to downgrade xen again. > > > grub2 config: > > menuentry 'Gentoo Linux XEN' { > root=hd0,1 > multiboot /boot/xen.gz dom0_mem=8192M,max:8192M iommu=1 > dom0_max_vcpus=4 dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 > module /boot/gentoo-3.12.6 root=/dev/md3 radeon.pcie_gen2=1 > radeon.dpm=1 softlevel=xen xen-pciback.permissive > xen-pciback.hide=(01:00.0)(01:00.1)(00:12.0)(00:12.2) > } > > lspci: > > 00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI > bridge (external gfx0 port B) (rev 02) > 00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD/ATI] RD990 I/O Memory > Management Unit (IOMMU) > 00:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI > bridge (PCI express gpp port B) > 00:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI > bridge (PCI express gpp port H) > 00:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI > bridge (external gfx1 port A) > 00:0d.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI to PCI > bridge (external gfx1 port B) > 00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] (rev 40) > 00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI0 Controller > 00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB EHCI Controller > 00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI0 Controller > 00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB EHCI Controller > 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 SMBus Controller > (rev 42) > 00:14.1 IDE interface: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 IDE Controller (rev 40) > 00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 Azalia > (Intel HDA) (rev 40) > 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB7x0/SB8x0/SB9x0 > LPC host controller (rev 40) > 00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 PCI to PCI > Bridge (rev 40) > 00:14.5 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI2 Controller > 00:15.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 > PCI to PCI bridge (PCIE port 0) > 00:15.1 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB700/SB800/SB900 > PCI to PCI bridge (PCIE port 1) > 00:15.2 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI > bridge (PCIE port 2) > 00:15.3 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI to PCI > bridge (PCIE port 3) > 00:16.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI0 Controller > 00:16.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB EHCI Controller > 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor > Function 0 > 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor > Function 1 > 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor > Function 2 > 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor > Function 3 > 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor > Function 4 > 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h Processor > Function 5 > 01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] > Tahiti XT [Radeon HD 7970] > 01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Tahiti XT HDMI > Audio [Radeon HD 7970 Series] > 02:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller > (rev 01) > 03:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA 6Gb/s > Controller (rev 11) > 04:00.0 VGA compatible controller: Advanced Micro Devices, Inc. [AMD/ATI] > Barts PRO [Radeon HD 6850] > 04:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Barts HDMI > Audio [Radeon HD 6800 Series] > 05:0e.0 FireWire (IEEE 1394): VIA Technologies, Inc. VT6306/7/8 [Fire II(M)] > IEEE 1394 OHCI Controller (rev c0) > 06:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. > RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06) > 07:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host Controller > (rev 01) > 08:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA 6Gb/s > Controller (rev 11) > > lspci -t: > > -[0000:00]-+-00.0 > +-00.2 > +-02.0-[01]--+-00.0 > | \-00.1 > +-09.0-[02]----00.0 > +-0a.0-[03]----00.0 > +-0d.0-[04]--+-00.0 > | \-00.1 > +-11.0 > +-12.0 > +-12.2 > +-13.0 > +-13.2 > +-14.0 > +-14.1 > +-14.2 > +-14.3 > +-14.4-[05]----0e.0 > +-14.5 > +-15.0-[06]----00.0 > +-15.1-[07]----00.0 > +-15.2-[08]----00.0 > +-15.3-[09]-- > +-16.0 > +-16.2 > +-18.0 > +-18.1 > +-18.2 > +-18.3 > +-18.4 > \-18.5 > > xl dmesg (shorten): > > (XEN) Xen version 4.3.1 (@xonet.at) (x86_64-pc-linux-gnu-gcc (Gentoo 4.8.2 > p1.0, pie-0.5.8) 4.8.2) debug=n Sat Dec 21 11:55:39 CET 2013 > (XEN) Latest ChangeSet: > (XEN) Bootloader: GRUB 2.02~beta1 > (XEN) Command line: dom0_mem=8192M,max:8192M iommu=1 dom0_max_vcpus=4 > dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 ... > (XEN) IOAPIC[0]: apic_id 8, version 33, address 0xfec00000, GSI 0-23 > (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs > (XEN) Using scheduler: SMP Credit Scheduler (credit) > (XEN) Detected 4026.984 MHz processor. > (XEN) Initing memory sharing. > (XEN) xstate_init: using cntxt_size: 0x3c0 and states: 0x4000000000000007 > (XEN) IVHD Error: Conflicting IO-APIC 0x8 entries > (XEN) AMD-Vi: Error initialization > (XEN) I/O virtualisation disabled > (XEN) ENABLING IO-APIC IRQs > (XEN) -> Using new ACK method > (XEN) Platform timer is 14.318MHz HPET > (XEN) Allocated console ring of 16 KiB. > (XEN) HVM: ASIDs enabled. > (XEN) SVM: Supported advanced features: > (XEN) - Nested Page Tables (NPT) > (XEN) - Last Branch Record (LBR) Virtualisation > (XEN) - Next-RIP Saved on #VMEXIT > (XEN) - VMCB Clean Bits > (XEN) - DecodeAssists > (XEN) - Pause-Intercept Filter > (XEN) - TSC Rate MSR > (XEN) HVM: SVM enabled > (XEN) HVM: Hardware Assisted Paging (HAP) detected > (XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB > (XEN) spurious 8259A interrupt: IRQ7. > > > I've tried a few other configuration's (like adding the ivrs_ioapic > parameter to the module line in grub or also adding > vfio_iommu_type1.allow_unsafe_interrupts=1 > to the cmdline), but so far i couldn't get it to work. > > Since i'm not completely sure what i actually have to insert at the kernel > parameter i'm glad if someone could give me some insight. However, since the > output of xl dmesg is always the same, even though with or without the > parameter, i might missed some additional parameters. > > If you need any more information, I'll be glad to provide them. > > Thanks in advance. > > Michael > > > > > > > > > [1] http://lists.xen.org/archives/html/xen-announce/2013-02/msg00002.html > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 24 15:09:07 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 24 Dec 2013 15:09:07 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvTaK-0002PS-O7; Tue, 24 Dec 2013 15:07:52 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvTaI-0002PN-SY for xen-users@lists.xen.org; Tue, 24 Dec 2013 15:07:51 +0000 Received: from [193.109.254.147:32483] by server-2.bemta-14.messagelabs.com id 90/5D-00361-643A9B25; Tue, 24 Dec 2013 15:07:50 +0000 X-Env-Sender: nix@myproxylists.com X-Msg-Ref: server-7.tower-27.messagelabs.com!1387897669!7351158!1 X-Originating-IP: [62.236.108.236] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 14944 invoked from network); 24 Dec 2013 15:07:49 -0000 Received: from gameframe.net (HELO gameframe.net) (62.236.108.236) by server-7.tower-27.messagelabs.com with SMTP; 24 Dec 2013 15:07:49 -0000 Received: (qmail 6157 invoked by uid 0); 24 Dec 2013 15:06:37 -0000 X-Originating-IP: 127.0.0.1 X-Qmail-Scanner-Diagnostics: from 127.0.0.1 (daemon@127.0.0.1) by gameframe.net (envelope-from , uid 98) with qmail-scanner-2.11 (spamassassin: 3.3.2. Clear:RC:1(127.0.0.1):. Processed in 0.0263 secs); 24 Dec 2013 15:06:37 -0000 Received: from unknown (HELO gameframe.net) (daemon@127.0.0.1) by gameframe.net with SMTP; 24 Dec 2013 15:06:37 -0000 Received: from localhost ([127.0.0.1]) (SquirrelMail authenticated user nix@myproxylists.com) by gameframe.net with HTTP; Tue, 24 Dec 2013 17:06:37 +0200 Message-ID: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> Date: Tue, 24 Dec 2013 17:06:37 +0200 From: "NiX" To: xen-users@lists.xen.org User-Agent: SquirrelMail/1.4.22 MIME-Version: 1.0 X-Priority: 3 (Normal) Importance: Normal Subject: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi. I am running a XEN VM in PV mode. This VM has four cores enabled. VM network config is as follows: vif = ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] Dom0 is dual XEON X5450 with 16GB of RAM. I can barely zmap at 10mbps ~ 12k packets/second on this VM Dec 24 16:56:43.393 [WARN] monitor: Failed to send 1502 packets/sec (998980 total failures) 13:04 0% (1d20h left); send: 9335298 11.9 Kp/s (11.9 Kp/s avg); recv: 3509 4 p/s (4 p/s avg); drops: 0 p/s (0 p/s avg); hits: 0.04% On Dom0 netback/0 utilize pretty much one core (95% CPU). While zmap is running at about 10mbps, everything starts lagging on SSH console when typing commands. I tried anything above 10mbps and I cannot no longer type at all any commands with a reasonable delay on SSH console... Dom0 is using bridged network. Is there anything that can be done to improve performance? Dom0 is attached to 1gbps network so I am 100% sure that the network is not a bottleneck. I got the following speed on Dom0 while zmap was running: Connecting to caesar.acc.umu.se (caesar.acc.umu.se)|130.239.18.142|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 679477248 (648M) [application/x-iso9660-image] Saving to: `debian-7.3.0-i386-CD-1.iso' 679,477,248 20.1M/s in 23s _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 24 15:09:07 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 24 Dec 2013 15:09:07 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvTaK-0002PS-O7; Tue, 24 Dec 2013 15:07:52 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvTaI-0002PN-SY for xen-users@lists.xen.org; Tue, 24 Dec 2013 15:07:51 +0000 Received: from [193.109.254.147:32483] by server-2.bemta-14.messagelabs.com id 90/5D-00361-643A9B25; Tue, 24 Dec 2013 15:07:50 +0000 X-Env-Sender: nix@myproxylists.com X-Msg-Ref: server-7.tower-27.messagelabs.com!1387897669!7351158!1 X-Originating-IP: [62.236.108.236] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 14944 invoked from network); 24 Dec 2013 15:07:49 -0000 Received: from gameframe.net (HELO gameframe.net) (62.236.108.236) by server-7.tower-27.messagelabs.com with SMTP; 24 Dec 2013 15:07:49 -0000 Received: (qmail 6157 invoked by uid 0); 24 Dec 2013 15:06:37 -0000 X-Originating-IP: 127.0.0.1 X-Qmail-Scanner-Diagnostics: from 127.0.0.1 (daemon@127.0.0.1) by gameframe.net (envelope-from , uid 98) with qmail-scanner-2.11 (spamassassin: 3.3.2. Clear:RC:1(127.0.0.1):. Processed in 0.0263 secs); 24 Dec 2013 15:06:37 -0000 Received: from unknown (HELO gameframe.net) (daemon@127.0.0.1) by gameframe.net with SMTP; 24 Dec 2013 15:06:37 -0000 Received: from localhost ([127.0.0.1]) (SquirrelMail authenticated user nix@myproxylists.com) by gameframe.net with HTTP; Tue, 24 Dec 2013 17:06:37 +0200 Message-ID: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> Date: Tue, 24 Dec 2013 17:06:37 +0200 From: "NiX" To: xen-users@lists.xen.org User-Agent: SquirrelMail/1.4.22 MIME-Version: 1.0 X-Priority: 3 (Normal) Importance: Normal Subject: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi. I am running a XEN VM in PV mode. This VM has four cores enabled. VM network config is as follows: vif = ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] Dom0 is dual XEON X5450 with 16GB of RAM. I can barely zmap at 10mbps ~ 12k packets/second on this VM Dec 24 16:56:43.393 [WARN] monitor: Failed to send 1502 packets/sec (998980 total failures) 13:04 0% (1d20h left); send: 9335298 11.9 Kp/s (11.9 Kp/s avg); recv: 3509 4 p/s (4 p/s avg); drops: 0 p/s (0 p/s avg); hits: 0.04% On Dom0 netback/0 utilize pretty much one core (95% CPU). While zmap is running at about 10mbps, everything starts lagging on SSH console when typing commands. I tried anything above 10mbps and I cannot no longer type at all any commands with a reasonable delay on SSH console... Dom0 is using bridged network. Is there anything that can be done to improve performance? Dom0 is attached to 1gbps network so I am 100% sure that the network is not a bottleneck. I got the following speed on Dom0 while zmap was running: Connecting to caesar.acc.umu.se (caesar.acc.umu.se)|130.239.18.142|:80... connected. HTTP request sent, awaiting response... 200 OK Length: 679477248 (648M) [application/x-iso9660-image] Saving to: `debian-7.3.0-i386-CD-1.iso' 679,477,248 20.1M/s in 23s _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 24 18:26:12 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 24 Dec 2013 18:26:12 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvWf2-0002i7-6d; Tue, 24 Dec 2013 18:24:56 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvWf0-0002i2-Hq for xen-users@lists.xen.org; Tue, 24 Dec 2013 18:24:54 +0000 Received: from [85.158.143.35:7720] by server-3.bemta-4.messagelabs.com id F4/FD-32360-571D9B25; Tue, 24 Dec 2013 18:24:53 +0000 X-Env-Sender: rickardbrown@hushmail.com X-Msg-Ref: server-5.tower-21.messagelabs.com!1387909491!8087167!1 X-Originating-IP: [65.39.178.235] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_8,spamassassin: ,surbl: (ASYNC_NO) c3VyYmxfcmVjaGVja19kZWxheTogMCAoYWJhbmRvbmVkOiBzaXRlcy5nb29nbGUuY29tL3Npd GUv\nbW9uZXljb21wMSk=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 24980 invoked from network); 24 Dec 2013 18:24:52 -0000 Received: from smtp5a.hushmail.com (HELO smtp5.hushmail.com) (65.39.178.235) by server-5.tower-21.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 24 Dec 2013 18:24:52 -0000 Received: from smtp5.hushmail.com (smtp5a.hushmail.com [65.39.178.235]) by smtp5.hushmail.com (Postfix) with SMTP id EAA516014D for ; Tue, 24 Dec 2013 17:49:28 +0000 (UTC) X-hush-relay-time: 214 X-hush-relay-id: 473ccb327b891ddac9c92aab03ede216 Received: from smtp.hushmail.com (w6.hushmail.com [65.39.178.92]) by smtp5.hushmail.com (Postfix) with ESMTP for ; Tue, 24 Dec 2013 17:49:28 +0000 (UTC) Received: by smtp.hushmail.com (Postfix, from userid 99) id CC3E86020E; Tue, 24 Dec 2013 17:49:28 +0000 (UTC) MIME-Version: 1.0 Date: Tue, 24 Dec 2013 17:49:28 +0000 To: xen-users@lists.xen.org From: rickardbrown@hushmail.com Message-Id: <20131224174928.CC3E86020E@smtp.hushmail.com> Subject: [Xen-users] Fake Conferences CSCI and WORLDCOMP of Hamid Arabnia X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org RmFrZSBDb25mZXJlbmNlcyBDU0NJIGFuZCBXT1JMRENPTVAgb2YgSGFtaWQgQXJhYm5pYQoKCkhh bWlkIEFyYWJuaWEgZnJvbSBVbml2ZXJzaXR5IG9mIEdlb3JnaWEgaXMgd2VsbCBrbm93biAKZm9y IGhpcyBmYWtlIFdPUkxEQ09NUCBjb25mZXJlbmNlcyAKaHR0cHM6Ly9zaXRlcy5nb29nbGUuY29t L3NpdGUvZHVtcGNvbmYgIFRoaXMgd2Vic2l0ZSAKaGFzIGFuIG9wZW4gY2hhbGxlbmdlIHBvc3Rl ZCBzb21ldGltZSBpbiAyMDEyIGFuZCBpdCAKYWxzbyBoYXMgY29tbWVudHMgZnJvbSBzZXZlcmFs IHdlbGwta25vd24gcmVzZWFyY2hlcnMgCm9uIFdPUkxEQ09NUC4gSGFtZCBBcmFibmlhIG5ldmVy IHJlc3BvbmRlZCB0byB0aGVzZSAKYmVjYXVzZSBoaXMgY29uZmVyZW5jZXMgYXJlIGJvZ3VzLgoK CkhhbWlkIEFyYWJuaWEgKHRoZSBtb25leSBodW5ncnkgcHJvZmVzc29yKSBoYXMgCnJlY2VudGx5 IHN0YXJ0ZWQgMjAxNCBJbnRlcm5hdGlvbmFsIENvbmZlcmVuY2Ugb24gCkNvbXB1dGF0aW9uYWwg U2NpZW5jZSBhbmQgQ29tcHV0YXRpb25hbCBJbnRlbGxpZ2VuY2UgCihDU0NJJzE0KSBodHRwOi8v d3d3LmFtZXJpY2FuY3NlLm9yZyB0byBkZWNlaXZlIApyZXNlYXJjaGVycyBmdXJ0aGVyLiBDU0NJ JzE0IGlzIHN0YXJ0ZWQgdW5kZXIgdGhlIAp0aXRsZSBvZiDigJxBbWVyaWNhbiBDb3VuY2lsIG9u IFNjaWVuY2UgYW5kIEVkdWNhdGlvbuKAnSAKd2hpY2ggaXMgYSBkdW1teSBjb3Jwb3JhdGlvbiAo ZG9lcyBub3QgZXhpc3QgYW55d2hlcmUgCmluIHRoZSB3b3JsZCkuIEhhbWlkIEFyYWJuaWEgYnVy aWVkIGhpcyBuYW1lIGluIHRoZSAKbGlzdCBvZiBuYW1lcyBvZiBvdGhlciBpbm5vY2VudCBzdGVl cmluZyBhbmQgcHJvZ3JhbSAKY29tbWl0dGVlIG1lbWJlcnMgb2YgQ1NDSeKAmTE0IHRvIGF2b2lk IGFueSBzcGVjaWFsIAphdHRlbnRpb24uIEhlIGtub3dzIHRoYXQgaWYgaGlzIG5hbWUgaXMgZ2l2 ZW4gYW55IApzcGVjaWFsIGF0dGVudGlvbiB0aGVuIHJlc2VhcmNoZXJzIGltbWVkaWF0ZWx5IG5v dGljZSAKdGhhdCB0aGUgY29uZmVyZW5jZSBpcyBmYWtlIGR1ZSB0byBoaXMg4oCcdHJhY2sgcmVj b3Jk4oCdIAp3aXRoIFdPUkxEQ09NUC4gSGFtaWQgQXJhYm5pYSAoR3VydSBvZiBGYWtlIApDb25m ZXJlbmNlcyBhbmQgY2hhbXBpb24gb2YgYWNhZGVtaWMgc2NhbSkgc3BvaWxlZCB0aGUgCnJlcHV0 YXRpb25zIGFuZCBjYXJlZXJzIG9mIG1hbnkgYXV0aG9ycyB3aG8gc3VibWl0dGVkIApwYXBlcnMg dG8gaGlzIGluZmFtb3VzIFdPUkxEQ09NUCBmb3IgbW9yZSB0aGFuIGEgCmRlY2FkZSBhbmQgaGUg aXMgbm93IHJlYWR5IHRvIGRvIHRoZSBzYW1lIHVzaW5nIENTQ0kuCgoKSW50ZXJlc3RpbmdseSwg Q1NDSSBpcyBzY2hlZHVsZWQgdG8gYmUgaGVsZCBhdCB0aGUgCnNhbWUgdmVudWUgd2hlcmUgV09S TERDT01QIHdhcyBoZWxkIHVudGlsIDIwMTIuIENTQ0kgCmhhcyBubyBnZW5lcmFsIGNoYWlyLiBJ dCBoYXMgbm8gcGh5c2ljYWwgcGVyc29u4oCZcyAKbmFtZSBvciBwaHlzaWNhbCBhZGRyZXNzIG9y IHBob25lIG51bWJlciB0byBjb250YWN0LiBPbmx5IApjb250YWN0IGFkZHJlc3MgaXMgYW4gZW1h aWwgYWRkcmVzcy4gSGFtaWQgQXJhYm5pYSBhbmQgCmhpcyBwdXBwZXRzIGFuc3dlciB0aGUgZW1h aWxzLCBpZiBuZWVkZWQsIHVzaW5nIGZha2UgbmFtZXMuIApEbyBub3Qgc3BvaWwgeW91ciByZXN1 bWUgYnkgc3VibWl0dGluZyB5b3VyIHBhcGVycyBpbiB0aGlzIApib2d1cyBjb25mZXJlbmNlIENT Q0kgd2hpY2ggd2lsbCBub3QgYmUgaGVsZCBiZXlvbmQgMjAxNC4KQ1NDSSB3aWxsIG5vdCBiZSBp bmRleGVkIGJ5IERCTFAuCiAKClJlY2VudGx5LCBIYW1pZCBBcmFibmlhIHBhaWQgbW9uZXkgYW5k IHB1Ymxpc2hlZCBmZXcgCuKAnG5ld3MgYXJ0aWNsZXPigJ0gY2xhaW1pbmcgaGltIGEgdmljdGlt IG9mIG9ubGluZSBoYXJhc3NtZW50IAphbmQgY3liZXIgYnVsbHlpbmcuIE5vdyBoZSBzdGFydGVk IHBvc3RpbmcgKHVzaW5nIGZha2UgCm5hbWVzIGFuZCB0aHJvdWdoIGhpcyBwdXBwZXRzKSBpbiB2 YXJpb3VzIGVtYWlscywgYmxvZ3MgCmFuZCBmb3J1bXMsIHJlZmVycmluZyB0byB0aG9zZSDigJxu ZXdzIGFydGljbGVz4oCdIGFuZCB0cnlpbmcgCnRvIGdldCBiYWNrIHN5bXBhdGh5IGFuZCB0cnVz dCBvZiB0aGUgcmVzZWFyY2ggY29tbXVuaXR5IAp0byBtYWtlIGhpcyBDU0NJIHN1Y2Nlc3NmdWwu IEhhbWlkIEFyYWJuaWEgaXMgYSBXb2xmIGluIAphIFNoZWVw4oCZcyBza2luLgoKCldlIGNoYWxs ZW5nZSBIYW1pZCBBcmFibmlhIHRvIG9wZW5seSBwdWJsaXNoIHRoZSBuYW1lcyBhbmQgCmFmZmls aWF0aW9uIGRldGFpbHMgb2YgdGhlIHJldmlld2VycyBmb3IgdGhvdXNhbmRzIG9mIApyZXNlYXJj aCBwYXBlcnMgc3VibWl0dGVkIHRvIFdPUkxEQ09NUCBmb3IgdGhlIGxhc3QgCnRoaXJ0ZWVuIHll YXJzLiBXZSBhbHNvIGNoYWxsZW5nZSBIYW1pZCBBcmFibmlhIHRvIG9wZW5seSAKcHVibGlzaCBh bGwgdGhlIHJldmlld3MgKGFmdGVyIHJlbW92aW5nIGF1dGhvcnMgCmlkZW50aWZpY2F0aW9uIGRl dGFpbHMpIGZvciBhbGwgdGhlIHRob3VzYW5kcyBvZiByZXNlYXJjaCAKcGFwZXJzIHN1Ym1pdHRl ZCB0byBXT1JMRENPTVAgZm9yIHRoZSBsYXN0IHRoaXJ0ZWVuIHllYXJzLiAKVGhlcmUgYXJlIG1v cmUgY2hhbGxlbmdlcyBhdCAKaHR0cHM6Ly9zaXRlcy5nb29nbGUuY29tL3NpdGUvbW9uZXljb21w MSBXZSBrbm93IHRoYXQgaGUgCm5ldmVyIGFjY2VwdHMgdGhlc2UgY2hhbGxlbmdlcyBiZWNhdXNl IHRoZXJlIHdlcmUgbm8gCnJldmlld3MgYW5kIG5vIHJldmlld2VycyBhbmQgaGUgc2ltcGx5IGNo ZWF0ZWQgdGhlIHJlc2VhcmNoIApjb21tdW5pdHkgZm9yIGFsbCB0aGVzZSB5ZWFycy4gV2UgYXJl IG5vdCBzdXJwcmlzZWQgaWYgaGUgCmNvbWVzIG91dCB0b21vcnJvdyBjbGFpbWluZyB0aGF0IGhp cyBjb21wdXRlciBjcmFzaGVkIGFuZCBoZSAKbG9zdCB0aGUgcmV2aWV3cyBhbmQgcmV2aWV3ZXJz 4oCZIGRldGFpbHMuIEhlIGNhbiBwbGF5IGFueSAKZGVjZWl2aW5nIHRyaWNrLgoKClNlZSB0aGUg aW1wb3J0YW50IHdlYnNpdGUgCmh0dHBzOi8vc2l0ZXMuZ29vZ2xlLmNvbS9zaXRlL3dvcmxkZHVt cDEgZm9yIG1vcmUgCmluZm9ybWF0aW9uIG9uIFdPUkxEQ09NUCwgaW5jbHVkaW5nIGxpbmtzIHRv IERCTFAgc3RvcCAKaW5kZXhpbmcgV09STERDT01QIHByb2NlZWRpbmdzLiBTZWUgCmh0dHA6Ly93 b3JsZGNvbXAtZmFrZS1ib2d1cy5ibG9nc3BvdC5jb20gZm9yIEhhbWlkIEFyYWJuaWEgCmFuZCBo aXMgcHVwcGV04oCZcyBBbnRpLUNocmlzdG1hcyBHcmVldGluZ3MgY2FtcGFpZ24uCgoKV2UgYXNr IEhhbWlkIEFyYWJuaWEgYW5kIGhpcyBwdXBwZXRzIHRvIGFkZHJlc3MgdGhlIGFib3ZlIAppc3N1 ZXMgYW5kIGNoYWxsZW5nZXMgYmVmb3JlIHBvc3RpbmcgYW55IG90aGVyIG1lc3NhZ2UuICAKCgpE byBub3Qgc3BvaWwgeW91ciByZXN1bWUgYnkgcHVibGlzaGluZyBpbiB0aGUgZmFrZSAKY29uZmVy ZW5jZXMgb2YgSGFtaWQgQXJhYm5pYS4KCgpTaW5jZXJlbHksCgpNYW55IHJlc2VhcmNoZXJzIGNo ZWF0ZWQgYnkgdGhlIGNvbmZlcmVuY2VzIG9mIEhhbWlkIEFyYWJuaWEKCgpfX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpYZW4tdXNlcnMgbWFpbGluZyBsaXN0 Clhlbi11c2Vyc0BsaXN0cy54ZW4ub3JnCmh0dHA6Ly9saXN0cy54ZW4ub3JnL3hlbi11c2Vycw== From xen-users-bounces@lists.xen.org Tue Dec 24 18:26:12 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 24 Dec 2013 18:26:12 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvWf2-0002i7-6d; Tue, 24 Dec 2013 18:24:56 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvWf0-0002i2-Hq for xen-users@lists.xen.org; Tue, 24 Dec 2013 18:24:54 +0000 Received: from [85.158.143.35:7720] by server-3.bemta-4.messagelabs.com id F4/FD-32360-571D9B25; Tue, 24 Dec 2013 18:24:53 +0000 X-Env-Sender: rickardbrown@hushmail.com X-Msg-Ref: server-5.tower-21.messagelabs.com!1387909491!8087167!1 X-Originating-IP: [65.39.178.235] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_8,spamassassin: ,surbl: (ASYNC_NO) c3VyYmxfcmVjaGVja19kZWxheTogMCAoYWJhbmRvbmVkOiBzaXRlcy5nb29nbGUuY29tL3Npd GUv\nbW9uZXljb21wMSk=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 24980 invoked from network); 24 Dec 2013 18:24:52 -0000 Received: from smtp5a.hushmail.com (HELO smtp5.hushmail.com) (65.39.178.235) by server-5.tower-21.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 24 Dec 2013 18:24:52 -0000 Received: from smtp5.hushmail.com (smtp5a.hushmail.com [65.39.178.235]) by smtp5.hushmail.com (Postfix) with SMTP id EAA516014D for ; Tue, 24 Dec 2013 17:49:28 +0000 (UTC) X-hush-relay-time: 214 X-hush-relay-id: 473ccb327b891ddac9c92aab03ede216 Received: from smtp.hushmail.com (w6.hushmail.com [65.39.178.92]) by smtp5.hushmail.com (Postfix) with ESMTP for ; Tue, 24 Dec 2013 17:49:28 +0000 (UTC) Received: by smtp.hushmail.com (Postfix, from userid 99) id CC3E86020E; Tue, 24 Dec 2013 17:49:28 +0000 (UTC) MIME-Version: 1.0 Date: Tue, 24 Dec 2013 17:49:28 +0000 To: xen-users@lists.xen.org From: rickardbrown@hushmail.com Message-Id: <20131224174928.CC3E86020E@smtp.hushmail.com> Subject: [Xen-users] Fake Conferences CSCI and WORLDCOMP of Hamid Arabnia X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org RmFrZSBDb25mZXJlbmNlcyBDU0NJIGFuZCBXT1JMRENPTVAgb2YgSGFtaWQgQXJhYm5pYQoKCkhh bWlkIEFyYWJuaWEgZnJvbSBVbml2ZXJzaXR5IG9mIEdlb3JnaWEgaXMgd2VsbCBrbm93biAKZm9y IGhpcyBmYWtlIFdPUkxEQ09NUCBjb25mZXJlbmNlcyAKaHR0cHM6Ly9zaXRlcy5nb29nbGUuY29t L3NpdGUvZHVtcGNvbmYgIFRoaXMgd2Vic2l0ZSAKaGFzIGFuIG9wZW4gY2hhbGxlbmdlIHBvc3Rl ZCBzb21ldGltZSBpbiAyMDEyIGFuZCBpdCAKYWxzbyBoYXMgY29tbWVudHMgZnJvbSBzZXZlcmFs IHdlbGwta25vd24gcmVzZWFyY2hlcnMgCm9uIFdPUkxEQ09NUC4gSGFtZCBBcmFibmlhIG5ldmVy IHJlc3BvbmRlZCB0byB0aGVzZSAKYmVjYXVzZSBoaXMgY29uZmVyZW5jZXMgYXJlIGJvZ3VzLgoK CkhhbWlkIEFyYWJuaWEgKHRoZSBtb25leSBodW5ncnkgcHJvZmVzc29yKSBoYXMgCnJlY2VudGx5 IHN0YXJ0ZWQgMjAxNCBJbnRlcm5hdGlvbmFsIENvbmZlcmVuY2Ugb24gCkNvbXB1dGF0aW9uYWwg U2NpZW5jZSBhbmQgQ29tcHV0YXRpb25hbCBJbnRlbGxpZ2VuY2UgCihDU0NJJzE0KSBodHRwOi8v d3d3LmFtZXJpY2FuY3NlLm9yZyB0byBkZWNlaXZlIApyZXNlYXJjaGVycyBmdXJ0aGVyLiBDU0NJ JzE0IGlzIHN0YXJ0ZWQgdW5kZXIgdGhlIAp0aXRsZSBvZiDigJxBbWVyaWNhbiBDb3VuY2lsIG9u IFNjaWVuY2UgYW5kIEVkdWNhdGlvbuKAnSAKd2hpY2ggaXMgYSBkdW1teSBjb3Jwb3JhdGlvbiAo ZG9lcyBub3QgZXhpc3QgYW55d2hlcmUgCmluIHRoZSB3b3JsZCkuIEhhbWlkIEFyYWJuaWEgYnVy aWVkIGhpcyBuYW1lIGluIHRoZSAKbGlzdCBvZiBuYW1lcyBvZiBvdGhlciBpbm5vY2VudCBzdGVl cmluZyBhbmQgcHJvZ3JhbSAKY29tbWl0dGVlIG1lbWJlcnMgb2YgQ1NDSeKAmTE0IHRvIGF2b2lk IGFueSBzcGVjaWFsIAphdHRlbnRpb24uIEhlIGtub3dzIHRoYXQgaWYgaGlzIG5hbWUgaXMgZ2l2 ZW4gYW55IApzcGVjaWFsIGF0dGVudGlvbiB0aGVuIHJlc2VhcmNoZXJzIGltbWVkaWF0ZWx5IG5v dGljZSAKdGhhdCB0aGUgY29uZmVyZW5jZSBpcyBmYWtlIGR1ZSB0byBoaXMg4oCcdHJhY2sgcmVj b3Jk4oCdIAp3aXRoIFdPUkxEQ09NUC4gSGFtaWQgQXJhYm5pYSAoR3VydSBvZiBGYWtlIApDb25m ZXJlbmNlcyBhbmQgY2hhbXBpb24gb2YgYWNhZGVtaWMgc2NhbSkgc3BvaWxlZCB0aGUgCnJlcHV0 YXRpb25zIGFuZCBjYXJlZXJzIG9mIG1hbnkgYXV0aG9ycyB3aG8gc3VibWl0dGVkIApwYXBlcnMg dG8gaGlzIGluZmFtb3VzIFdPUkxEQ09NUCBmb3IgbW9yZSB0aGFuIGEgCmRlY2FkZSBhbmQgaGUg aXMgbm93IHJlYWR5IHRvIGRvIHRoZSBzYW1lIHVzaW5nIENTQ0kuCgoKSW50ZXJlc3RpbmdseSwg Q1NDSSBpcyBzY2hlZHVsZWQgdG8gYmUgaGVsZCBhdCB0aGUgCnNhbWUgdmVudWUgd2hlcmUgV09S TERDT01QIHdhcyBoZWxkIHVudGlsIDIwMTIuIENTQ0kgCmhhcyBubyBnZW5lcmFsIGNoYWlyLiBJ dCBoYXMgbm8gcGh5c2ljYWwgcGVyc29u4oCZcyAKbmFtZSBvciBwaHlzaWNhbCBhZGRyZXNzIG9y IHBob25lIG51bWJlciB0byBjb250YWN0LiBPbmx5IApjb250YWN0IGFkZHJlc3MgaXMgYW4gZW1h aWwgYWRkcmVzcy4gSGFtaWQgQXJhYm5pYSBhbmQgCmhpcyBwdXBwZXRzIGFuc3dlciB0aGUgZW1h aWxzLCBpZiBuZWVkZWQsIHVzaW5nIGZha2UgbmFtZXMuIApEbyBub3Qgc3BvaWwgeW91ciByZXN1 bWUgYnkgc3VibWl0dGluZyB5b3VyIHBhcGVycyBpbiB0aGlzIApib2d1cyBjb25mZXJlbmNlIENT Q0kgd2hpY2ggd2lsbCBub3QgYmUgaGVsZCBiZXlvbmQgMjAxNC4KQ1NDSSB3aWxsIG5vdCBiZSBp bmRleGVkIGJ5IERCTFAuCiAKClJlY2VudGx5LCBIYW1pZCBBcmFibmlhIHBhaWQgbW9uZXkgYW5k IHB1Ymxpc2hlZCBmZXcgCuKAnG5ld3MgYXJ0aWNsZXPigJ0gY2xhaW1pbmcgaGltIGEgdmljdGlt IG9mIG9ubGluZSBoYXJhc3NtZW50IAphbmQgY3liZXIgYnVsbHlpbmcuIE5vdyBoZSBzdGFydGVk IHBvc3RpbmcgKHVzaW5nIGZha2UgCm5hbWVzIGFuZCB0aHJvdWdoIGhpcyBwdXBwZXRzKSBpbiB2 YXJpb3VzIGVtYWlscywgYmxvZ3MgCmFuZCBmb3J1bXMsIHJlZmVycmluZyB0byB0aG9zZSDigJxu ZXdzIGFydGljbGVz4oCdIGFuZCB0cnlpbmcgCnRvIGdldCBiYWNrIHN5bXBhdGh5IGFuZCB0cnVz dCBvZiB0aGUgcmVzZWFyY2ggY29tbXVuaXR5IAp0byBtYWtlIGhpcyBDU0NJIHN1Y2Nlc3NmdWwu IEhhbWlkIEFyYWJuaWEgaXMgYSBXb2xmIGluIAphIFNoZWVw4oCZcyBza2luLgoKCldlIGNoYWxs ZW5nZSBIYW1pZCBBcmFibmlhIHRvIG9wZW5seSBwdWJsaXNoIHRoZSBuYW1lcyBhbmQgCmFmZmls aWF0aW9uIGRldGFpbHMgb2YgdGhlIHJldmlld2VycyBmb3IgdGhvdXNhbmRzIG9mIApyZXNlYXJj aCBwYXBlcnMgc3VibWl0dGVkIHRvIFdPUkxEQ09NUCBmb3IgdGhlIGxhc3QgCnRoaXJ0ZWVuIHll YXJzLiBXZSBhbHNvIGNoYWxsZW5nZSBIYW1pZCBBcmFibmlhIHRvIG9wZW5seSAKcHVibGlzaCBh bGwgdGhlIHJldmlld3MgKGFmdGVyIHJlbW92aW5nIGF1dGhvcnMgCmlkZW50aWZpY2F0aW9uIGRl dGFpbHMpIGZvciBhbGwgdGhlIHRob3VzYW5kcyBvZiByZXNlYXJjaCAKcGFwZXJzIHN1Ym1pdHRl ZCB0byBXT1JMRENPTVAgZm9yIHRoZSBsYXN0IHRoaXJ0ZWVuIHllYXJzLiAKVGhlcmUgYXJlIG1v cmUgY2hhbGxlbmdlcyBhdCAKaHR0cHM6Ly9zaXRlcy5nb29nbGUuY29tL3NpdGUvbW9uZXljb21w MSBXZSBrbm93IHRoYXQgaGUgCm5ldmVyIGFjY2VwdHMgdGhlc2UgY2hhbGxlbmdlcyBiZWNhdXNl IHRoZXJlIHdlcmUgbm8gCnJldmlld3MgYW5kIG5vIHJldmlld2VycyBhbmQgaGUgc2ltcGx5IGNo ZWF0ZWQgdGhlIHJlc2VhcmNoIApjb21tdW5pdHkgZm9yIGFsbCB0aGVzZSB5ZWFycy4gV2UgYXJl IG5vdCBzdXJwcmlzZWQgaWYgaGUgCmNvbWVzIG91dCB0b21vcnJvdyBjbGFpbWluZyB0aGF0IGhp cyBjb21wdXRlciBjcmFzaGVkIGFuZCBoZSAKbG9zdCB0aGUgcmV2aWV3cyBhbmQgcmV2aWV3ZXJz 4oCZIGRldGFpbHMuIEhlIGNhbiBwbGF5IGFueSAKZGVjZWl2aW5nIHRyaWNrLgoKClNlZSB0aGUg aW1wb3J0YW50IHdlYnNpdGUgCmh0dHBzOi8vc2l0ZXMuZ29vZ2xlLmNvbS9zaXRlL3dvcmxkZHVt cDEgZm9yIG1vcmUgCmluZm9ybWF0aW9uIG9uIFdPUkxEQ09NUCwgaW5jbHVkaW5nIGxpbmtzIHRv IERCTFAgc3RvcCAKaW5kZXhpbmcgV09STERDT01QIHByb2NlZWRpbmdzLiBTZWUgCmh0dHA6Ly93 b3JsZGNvbXAtZmFrZS1ib2d1cy5ibG9nc3BvdC5jb20gZm9yIEhhbWlkIEFyYWJuaWEgCmFuZCBo aXMgcHVwcGV04oCZcyBBbnRpLUNocmlzdG1hcyBHcmVldGluZ3MgY2FtcGFpZ24uCgoKV2UgYXNr IEhhbWlkIEFyYWJuaWEgYW5kIGhpcyBwdXBwZXRzIHRvIGFkZHJlc3MgdGhlIGFib3ZlIAppc3N1 ZXMgYW5kIGNoYWxsZW5nZXMgYmVmb3JlIHBvc3RpbmcgYW55IG90aGVyIG1lc3NhZ2UuICAKCgpE byBub3Qgc3BvaWwgeW91ciByZXN1bWUgYnkgcHVibGlzaGluZyBpbiB0aGUgZmFrZSAKY29uZmVy ZW5jZXMgb2YgSGFtaWQgQXJhYm5pYS4KCgpTaW5jZXJlbHksCgpNYW55IHJlc2VhcmNoZXJzIGNo ZWF0ZWQgYnkgdGhlIGNvbmZlcmVuY2VzIG9mIEhhbWlkIEFyYWJuaWEKCgpfX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpYZW4tdXNlcnMgbWFpbGluZyBsaXN0 Clhlbi11c2Vyc0BsaXN0cy54ZW4ub3JnCmh0dHA6Ly9saXN0cy54ZW4ub3JnL3hlbi11c2Vycw== From xen-users-bounces@lists.xen.org Wed Dec 25 02:14:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 25 Dec 2013 02:14:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvdyU-0002eF-V3; Wed, 25 Dec 2013 02:13:30 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvdyT-0002eA-IN for xen-users@lists.xen.org; Wed, 25 Dec 2013 02:13:29 +0000 Received: from [85.158.139.211:52012] by server-15.bemta-5.messagelabs.com id 9A/FF-08490-84F3AB25; Wed, 25 Dec 2013 02:13:28 +0000 X-Env-Sender: kevin.zhang@octlink.com X-Msg-Ref: server-3.tower-206.messagelabs.com!1387937605!6322433!1 X-Originating-IP: [222.128.79.249] X-SpamReason: No, hits=0.5 required=7.0 tests=HTML_60_70,HTML_MESSAGE, MIME_BOUND_NEXTPART X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 9177 invoked from network); 25 Dec 2013 02:13:26 -0000 Received: from unknown (HELO mail.octlink.com) (222.128.79.249) by server-3.tower-206.messagelabs.com with SMTP; 25 Dec 2013 02:13:26 -0000 Received: from localhost (localhost [127.0.0.1]) by mail.octlink.com (Postfix) with SMTP id 06A0CE205B for ; Wed, 25 Dec 2013 10:13:23 +0800 (CST) Received: from zhangpei-PC (pfsense.localdomain [192.168.10.253]) by mail.octlink.com (Postfix) with ESMTPA id ADFCCE205A; Wed, 25 Dec 2013 10:13:10 +0800 (CST) Date: Wed, 25 Dec 2013 10:13:07 +0800 From: "kevin.zhang@octlink.com" To: "Wei Liu" References: , <2013121910200013972216@octlink.com>, <20131219120629.GJ25969@zion.uk.xensource.com> X-Priority: 3 X-Has-Attach: no X-Mailer: Foxmail 7, 1, 3, 52[cn] Mime-Version: 1.0 Message-ID: <201312251013049257389@octlink.com> X-DSPAM-Result: Whitelisted X-DSPAM-Processed: Wed Dec 25 10:13:23 2013 X-DSPAM-Confidence: 0.9913 X-DSPAM-Probability: 0.0000 X-DSPAM-Signature: 3,52ba3f437154352567128 X-DSPAM-Factors: 27, Date+2013, 0.00270, !, 0.00366, !, 0.00366, Message-ID*octlink.com>, 0.00639, vm, 0.00784, vm, 0.00784, Dec, 0.00829, Dec, 0.00829, try, 0.00868, try, 0.00868, create, 0.00881, create, 0.00881, 2013+at, 0.01000, 2013+at, 0.01000, vga+val, 0.01000, vga+val, 0.01000, try+xl?, 0.01000, try+xl?, 0.01000, 337)+Stored, 0.01000, 337)+Stored, 0.01000, failed+on, 0.01000, failed+on, 0.01000, 12pt">Best, 0.01000, 260), 0.01000, 260), 0.01000, face=Calibri>, "wei.liu2@citrix.com" Subject: Re: [Xen-users] HVM migrate failed on both xen 4.1 and xen 4.2 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============3652099717482143737==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a multi-part message in MIME format. --===============3652099717482143737== Content-Type: multipart/alternative; boundary="----=_001_NextPart705486135640_=----" This is a multi-part message in MIME format. ------=_001_NextPart705486135640_=---- Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 SGkgV2VpIExpdSwNCg0KICAgICBUaGFuayB5b3UgZm9yIHlvdXIgcmVwbHkuDQogICAgIExhc3Qg d2VlayBJIHRlc3RlZCBvbiB4ZW4gNC4yLjMgYW5kIFhlbiA0LjEgYW5kIGZpbmQgb3V0IHRoYXQg aXQgd2FzIHRoZSBYZW5BUEkgQyBiaW5kaW5nIHByb2JsZW1zLg0KICAgICBBbGwgd29ya3Mgd2Vs bCBmb3IgYm90aCB4bCBhbmQgeGVuZCB0b29sc3RhY2sgbm93LiAgICAgDQoNCg0KDQoNCkJlc3Qg UmVnYXJkcw0KRnJvbTogV2VpIExpdQ0KRGF0ZTogMjAxMy0xMi0xOSAyMDowNg0KVG86IGtldmlu LnpoYW5nQG9jdGxpbmsuY29tDQpDQzogeGVuLXVzZXJzOyB3ZWkubGl1MkBjaXRyaXguY29tDQpT dWJqZWN0OiBSZTogW1hlbi11c2Vyc10gSFZNIG1pZ3JhdGUgZmFpbGVkIG9uIGJvdGggeGVuIDQu MSBhbmQgeGVuIDQuMg0KT24gVGh1LCBEZWMgMTksIDIwMTMgYXQgMTA6MjA6MDFBTSArMDgwMCwg a2V2aW4uemhhbmdAb2N0bGluay5jb20gd3JvdGU6DQo+IEhpIGFsbCwNCj4gDQo+ICAgICAgICAg VGhlc2UgZGF5cyBJIGFtIHRlc3RpbmcgeGVuIGxpdmUgbWlncmF0aW9uIHdpdGggeGVuLiANCj4g VGhlIHJlc3VsdCBpcyB0aGF0OiANCj4gICAgICAgIFBWTSBtaWdyYXRpb24gd29ya3Mgd2VsbCBh bGwgdGhlIHRpbWUuDQo+ICAgICAgICBIb3dldmVyLCBIVk0gd2luZG93cyB2bSBtaWdyYXRpb24g YWx3YXlzIGZhaWxlZC4gIEknbSB1c2luZyB4ZW4gNC4xIGFuZCA0LjIgd2l0aCBORlMgYXMgc2hh cmVkIHN0b3JhZ2UsIGFuZCBib3RoIGZhaWxlZCB3aXRoIEhWTSBtaWdyYXRpb24uDQo+IFdlIGFy ZSBtYWlubHkgdXNpbmcgeGVuZCB0b29sc3RhY2suICBBZnRlciBzZWFyY2hpbmcgZm9yIHRoZSBl cnJvciBtZXNzYWdlcywgSSBmb3VuZCBsb3RzIG9mIHBlb3BsZSBoYWQgdGhpcyBwcm9ibGVtLCBh bmQgaXQgcmVsYXRlZCB0byBodm0gcmVzdG9yZSBmdW5jdGlvbiBidWcuDQo+IENvdWxkIGFueW9u ZSBoZWxwIHVzPyBUaGFuayB5b3UgdmVyeSBtdWNoIQ0KPiBFcnJvciBtZXNzYWdlcyBhcmU6DQo+ IFsyMDEzLTEyLTE5IDEwOjExOjQ1IDIwMjddIElORk8gKFhlbmRDaGVja3BvaW50OjI2MCkgcmVz dG9yZSBodm0gZG9tYWluIDQsIGFwaWM9MSwgcGFlPTENCj4gWzIwMTMtMTItMTkgMTA6MTE6NDUg MjAyN10gREVCVUcgKGltYWdlOjMzNykgU3RvcmVkIGEgVk5DIHBhc3N3b3JkIGZvciB2ZmIgYWNj ZXNzDQo+IFsyMDEzLTEyLTE5IDEwOjExOjQ1IDIwMjddIERFQlVHIChpbWFnZTo4OTEpIGFyZ3M6 IGJvb3QsIHZhbDogZGMNCj4gWzIwMTMtMTItMTkgMTA6MTE6NDUgMjAyN10gREVCVUcgKGltYWdl Ojg5MSkgYXJnczogZmRhLCB2YWw6IE5vbmUNCj4gWzIwMTMtMTItMTkgMTA6MTE6NDUgMjAyN10g REVCVUcgKGltYWdlOjg5MSkgYXJnczogZmRiLCB2YWw6IE5vbmUNCj4gWzIwMTMtMTItMTkgMTA6 MTE6NDUgMjAyN10gREVCVUcgKGltYWdlOjg5MSkgYXJnczogc291bmRodywgdmFsOiBOb25lDQo+ IFsyMDEzLTEyLTE5IDEwOjExOjQ1IDIwMjddIERFQlVHIChpbWFnZTo4OTEpIGFyZ3M6IGxvY2Fs dGltZSwgdmFsOiAwDQo+IFsyMDEzLTEyLTE5IDEwOjExOjQ1IDIwMjddIERFQlVHIChpbWFnZTo4 OTEpIGFyZ3M6IHNlcmlhbCwgdmFsOiBbJ3B0eSddDQo+IFsyMDEzLTEyLTE5IDEwOjExOjQ1IDIw MjddIERFQlVHIChpbWFnZTo4OTEpIGFyZ3M6IHN0ZC12Z2EsIHZhbDogMA0KPiBbMjAxMy0xMi0x OSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoaW1hZ2U6ODkxKSBhcmdzOiBpc2EsIHZhbDogMA0KPiBb MjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoaW1hZ2U6ODkxKSBhcmdzOiBhY3BpLCB2 YWw6IDENCj4gWzIwMTMtMTItMTkgMTA6MTE6NDUgMjAyN10gREVCVUcgKGltYWdlOjg5MSkgYXJn czogdXNiLCB2YWw6IDANCj4gWzIwMTMtMTItMTkgMTA6MTE6NDUgMjAyN10gREVCVUcgKGltYWdl Ojg5MSkgYXJnczogdXNiZGV2aWNlLCB2YWw6IHRhYmxldA0KPiBbMjAxMy0xMi0xOSAxMDoxMTo0 NSAyMDI3XSBERUJVRyAoaW1hZ2U6ODkxKSBhcmdzOiBnZnhfcGFzc3RocnUsIHZhbDogTm9uZQ0K PiBbMjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBJTkZPIChpbWFnZTo4MjIpIE5lZWQgdG8gY3Jl YXRlIHBsYXRmb3JtIGRldmljZS5bZG9taWQ6NF0NCj4gWzIwMTMtMTItMTkgMTA6MTE6NDUgMjAy N10gREVCVUcgKFhlbmRDaGVja3BvaW50OjI3OCkgcmVzdG9yZTpzaGFkb3c9MHhjLCBfc3RhdGlj X21heD0weDQwMDAwMDAwLCBfc3RhdGljX21pbj0weDAsIA0KPiBbMjAxMy0xMi0xOSAxMDoxMTo0 NSAyMDI3XSBERUJVRyAoWGVuZENoZWNrcG9pbnQ6MzA1KSBbeGNfcmVzdG9yZV06IC91c3IvbGli L3hlbi9iaW4veGNfcmVzdG9yZSA0IDQgNiA3IDEgMSAxIDANCj4gWzIwMTMtMTItMTkgMTA6MTI6 MTAgMjAyN10gSU5GTyAoWGVuZENoZWNrcG9pbnQ6NDIzKSB4YzogZXJyb3I6IEZhaWxlZCB0byBh bGxvY2F0ZSBtZW1vcnkgZm9yIGJhdGNoLiE6IEludGVybmFsIGVycm9yDQoNCkxvb2tzIGxpa2Ug dGhpcyBpcyB0aGUgY3VscHJpdD8NCg0KSSBsb29rZWQgYXQgdGhlIGNvZGUgaW4gcXVlc3Rpb24g aW4gbGlieGMganVzdCBub3cuIElmIGl0ICphbHdheXMqDQpmYWlscywgbXkgdmVyeSB3aWxkIGd1 ZXNzIHdvdWxkIGJlIHRoZSBtZW1vcnkgc2l6ZSBjYWxjdWxhdGlvbiBpcw0KYnJva2VuIHdoZW4g cmVzdG9yaW5nIEhWTSBkb21haW4gc28gdGhhdCBoeXBlcnZpc29yIGZhaWxzIHRvIGFsbG9jYXRl DQptZW1vcnkgZm9yIGl0Lg0KDQpJdCB3b3VsZCBiZSB3b3J0aCBrbm93aW5nIHdoZXRoZXIgdGhp cyBpcyBhIGxpYnhjIGJ1ZyBvciBYZW5kIGJ1Zy4gQ291bGQNCnlvdSB0cnkgeGw/IElmIHhsIHdv cmtzIHRoZW4gaXQncyBhIFhlbmQgYnVnLCBvdGhlcndpc2UgdGhpcyBpcyBwcm9iYWJseQ0KYSBi dWcgaW4gbGlieGMuDQoNCldlaS4= ------=_001_NextPart705486135640_=---- Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable =EF=BB=BF
Hi Wei Liu,
 
     Thank you for your reply.
     Last week I tested on xen 4.2.3 and Xen 4.1 = and=20 find out that it was the XenAPI C binding problems.
     All works well for both xl and xend too= lstack=20 now.    
 
Best=20 Regards

From: Wei Liu<= /DIV>
Date: 2013-12-19 20:06
To: kevin.zhang@octlink.com
Subject: Re: [Xen-users] HVM migrate failed on both xen 4= .1 and=20 xen 4.2
On Thu, Dec 19, 2013 at 10:20:01AM +0800, kevin.zhang@octlink.com=20 wrote:
> Hi all,
>
>         These days I am=20 testing xen live migration with xen.
> The result is that:
>        PVM migration works we= ll all=20 the time.
>        However, HVM windows v= m=20 migration always failed.  I'm using xen 4.1 and 4.2 with NFS as share= d=20 storage, and both failed with HVM migration.
> We are mainly using xend toolstack.  After searching for th= e=20 error messages, I found lots of people had this problem, and it related to= hvm=20 restore function bug.
> Could anyone help us? Thank you very much!
> Error messages are:
> [2013-12-19 10:11:45 2027] INFO (XendCheckpoint:260) restore hvm= =20 domain 4, apic=3D1, pae=3D1
> [2013-12-19 10:11:45 2027] DEBUG (image:337) Stored a VNC passwo= rd for=20 vfb access
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: boot, val: dc=
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: fda, val:=20 None
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: fdb, val:=20 None
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: soundhw, val:= =20 None
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: localtime, va= l:=20 0
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: serial, val:=20 ['pty']
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: std-vga, val:= =20 0
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: isa, val: 0
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: acpi, val: 1<= /DIV>
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: usb, val: 0
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: usbdevice, va= l:=20 tablet
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: gfx_passthru,= val:=20 None
> [2013-12-19 10:11:45 2027] INFO (image:822) Need to create platf= orm=20 device.[domid:4]
> [2013-12-19 10:11:45 2027] DEBUG (XendCheckpoint:278)=20 restore:shadow=3D0xc, _static_max=3D0x40000000, _static_min=3D0x0,
> [2013-12-19 10:11:45 2027] DEBUG (XendCheckpoint:305) [xc_restor= e]:=20 /usr/lib/xen/bin/xc_restore 4 4 6 7 1 1 1 0
> [2013-12-19 10:12:10 2027] INFO (XendCheckpoint:423) xc: error: = Failed=20 to allocate memory for batch.!: Internal error
 
Looks like this is the culprit?
 
I looked at the code in question in libxc just now. If it *always*
fails, my very wild guess would be the memory size calculation is
broken when restoring HVM domain so that hypervisor fails to allocate=
memory for it.
 
It would be worth knowing whether this is a libxc bug or Xend bug.=20 Could
you try xl? If xl works then it's a Xend bug, otherwise this is=20 probably
a bug in libxc.
 
Wei.
 
------=_001_NextPart705486135640_=------ --===============3652099717482143737== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============3652099717482143737==-- From xen-users-bounces@lists.xen.org Wed Dec 25 02:14:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Wed, 25 Dec 2013 02:14:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvdyU-0002eF-V3; Wed, 25 Dec 2013 02:13:30 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VvdyT-0002eA-IN for xen-users@lists.xen.org; Wed, 25 Dec 2013 02:13:29 +0000 Received: from [85.158.139.211:52012] by server-15.bemta-5.messagelabs.com id 9A/FF-08490-84F3AB25; Wed, 25 Dec 2013 02:13:28 +0000 X-Env-Sender: kevin.zhang@octlink.com X-Msg-Ref: server-3.tower-206.messagelabs.com!1387937605!6322433!1 X-Originating-IP: [222.128.79.249] X-SpamReason: No, hits=0.5 required=7.0 tests=HTML_60_70,HTML_MESSAGE, MIME_BOUND_NEXTPART X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 9177 invoked from network); 25 Dec 2013 02:13:26 -0000 Received: from unknown (HELO mail.octlink.com) (222.128.79.249) by server-3.tower-206.messagelabs.com with SMTP; 25 Dec 2013 02:13:26 -0000 Received: from localhost (localhost [127.0.0.1]) by mail.octlink.com (Postfix) with SMTP id 06A0CE205B for ; Wed, 25 Dec 2013 10:13:23 +0800 (CST) Received: from zhangpei-PC (pfsense.localdomain [192.168.10.253]) by mail.octlink.com (Postfix) with ESMTPA id ADFCCE205A; Wed, 25 Dec 2013 10:13:10 +0800 (CST) Date: Wed, 25 Dec 2013 10:13:07 +0800 From: "kevin.zhang@octlink.com" To: "Wei Liu" References: , <2013121910200013972216@octlink.com>, <20131219120629.GJ25969@zion.uk.xensource.com> X-Priority: 3 X-Has-Attach: no X-Mailer: Foxmail 7, 1, 3, 52[cn] Mime-Version: 1.0 Message-ID: <201312251013049257389@octlink.com> X-DSPAM-Result: Whitelisted X-DSPAM-Processed: Wed Dec 25 10:13:23 2013 X-DSPAM-Confidence: 0.9913 X-DSPAM-Probability: 0.0000 X-DSPAM-Signature: 3,52ba3f437154352567128 X-DSPAM-Factors: 27, Date+2013, 0.00270, !, 0.00366, !, 0.00366, Message-ID*octlink.com>, 0.00639, vm, 0.00784, vm, 0.00784, Dec, 0.00829, Dec, 0.00829, try, 0.00868, try, 0.00868, create, 0.00881, create, 0.00881, 2013+at, 0.01000, 2013+at, 0.01000, vga+val, 0.01000, vga+val, 0.01000, try+xl?, 0.01000, try+xl?, 0.01000, 337)+Stored, 0.01000, 337)+Stored, 0.01000, failed+on, 0.01000, failed+on, 0.01000, 12pt">Best, 0.01000, 260), 0.01000, 260), 0.01000, face=Calibri>, "wei.liu2@citrix.com" Subject: Re: [Xen-users] HVM migrate failed on both xen 4.1 and xen 4.2 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============3652099717482143737==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This is a multi-part message in MIME format. --===============3652099717482143737== Content-Type: multipart/alternative; boundary="----=_001_NextPart705486135640_=----" This is a multi-part message in MIME format. ------=_001_NextPart705486135640_=---- Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 SGkgV2VpIExpdSwNCg0KICAgICBUaGFuayB5b3UgZm9yIHlvdXIgcmVwbHkuDQogICAgIExhc3Qg d2VlayBJIHRlc3RlZCBvbiB4ZW4gNC4yLjMgYW5kIFhlbiA0LjEgYW5kIGZpbmQgb3V0IHRoYXQg aXQgd2FzIHRoZSBYZW5BUEkgQyBiaW5kaW5nIHByb2JsZW1zLg0KICAgICBBbGwgd29ya3Mgd2Vs bCBmb3IgYm90aCB4bCBhbmQgeGVuZCB0b29sc3RhY2sgbm93LiAgICAgDQoNCg0KDQoNCkJlc3Qg UmVnYXJkcw0KRnJvbTogV2VpIExpdQ0KRGF0ZTogMjAxMy0xMi0xOSAyMDowNg0KVG86IGtldmlu LnpoYW5nQG9jdGxpbmsuY29tDQpDQzogeGVuLXVzZXJzOyB3ZWkubGl1MkBjaXRyaXguY29tDQpT dWJqZWN0OiBSZTogW1hlbi11c2Vyc10gSFZNIG1pZ3JhdGUgZmFpbGVkIG9uIGJvdGggeGVuIDQu MSBhbmQgeGVuIDQuMg0KT24gVGh1LCBEZWMgMTksIDIwMTMgYXQgMTA6MjA6MDFBTSArMDgwMCwg a2V2aW4uemhhbmdAb2N0bGluay5jb20gd3JvdGU6DQo+IEhpIGFsbCwNCj4gDQo+ICAgICAgICAg VGhlc2UgZGF5cyBJIGFtIHRlc3RpbmcgeGVuIGxpdmUgbWlncmF0aW9uIHdpdGggeGVuLiANCj4g VGhlIHJlc3VsdCBpcyB0aGF0OiANCj4gICAgICAgIFBWTSBtaWdyYXRpb24gd29ya3Mgd2VsbCBh bGwgdGhlIHRpbWUuDQo+ICAgICAgICBIb3dldmVyLCBIVk0gd2luZG93cyB2bSBtaWdyYXRpb24g YWx3YXlzIGZhaWxlZC4gIEknbSB1c2luZyB4ZW4gNC4xIGFuZCA0LjIgd2l0aCBORlMgYXMgc2hh cmVkIHN0b3JhZ2UsIGFuZCBib3RoIGZhaWxlZCB3aXRoIEhWTSBtaWdyYXRpb24uDQo+IFdlIGFy ZSBtYWlubHkgdXNpbmcgeGVuZCB0b29sc3RhY2suICBBZnRlciBzZWFyY2hpbmcgZm9yIHRoZSBl cnJvciBtZXNzYWdlcywgSSBmb3VuZCBsb3RzIG9mIHBlb3BsZSBoYWQgdGhpcyBwcm9ibGVtLCBh bmQgaXQgcmVsYXRlZCB0byBodm0gcmVzdG9yZSBmdW5jdGlvbiBidWcuDQo+IENvdWxkIGFueW9u ZSBoZWxwIHVzPyBUaGFuayB5b3UgdmVyeSBtdWNoIQ0KPiBFcnJvciBtZXNzYWdlcyBhcmU6DQo+ IFsyMDEzLTEyLTE5IDEwOjExOjQ1IDIwMjddIElORk8gKFhlbmRDaGVja3BvaW50OjI2MCkgcmVz dG9yZSBodm0gZG9tYWluIDQsIGFwaWM9MSwgcGFlPTENCj4gWzIwMTMtMTItMTkgMTA6MTE6NDUg MjAyN10gREVCVUcgKGltYWdlOjMzNykgU3RvcmVkIGEgVk5DIHBhc3N3b3JkIGZvciB2ZmIgYWNj ZXNzDQo+IFsyMDEzLTEyLTE5IDEwOjExOjQ1IDIwMjddIERFQlVHIChpbWFnZTo4OTEpIGFyZ3M6 IGJvb3QsIHZhbDogZGMNCj4gWzIwMTMtMTItMTkgMTA6MTE6NDUgMjAyN10gREVCVUcgKGltYWdl Ojg5MSkgYXJnczogZmRhLCB2YWw6IE5vbmUNCj4gWzIwMTMtMTItMTkgMTA6MTE6NDUgMjAyN10g REVCVUcgKGltYWdlOjg5MSkgYXJnczogZmRiLCB2YWw6IE5vbmUNCj4gWzIwMTMtMTItMTkgMTA6 MTE6NDUgMjAyN10gREVCVUcgKGltYWdlOjg5MSkgYXJnczogc291bmRodywgdmFsOiBOb25lDQo+ IFsyMDEzLTEyLTE5IDEwOjExOjQ1IDIwMjddIERFQlVHIChpbWFnZTo4OTEpIGFyZ3M6IGxvY2Fs dGltZSwgdmFsOiAwDQo+IFsyMDEzLTEyLTE5IDEwOjExOjQ1IDIwMjddIERFQlVHIChpbWFnZTo4 OTEpIGFyZ3M6IHNlcmlhbCwgdmFsOiBbJ3B0eSddDQo+IFsyMDEzLTEyLTE5IDEwOjExOjQ1IDIw MjddIERFQlVHIChpbWFnZTo4OTEpIGFyZ3M6IHN0ZC12Z2EsIHZhbDogMA0KPiBbMjAxMy0xMi0x OSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoaW1hZ2U6ODkxKSBhcmdzOiBpc2EsIHZhbDogMA0KPiBb MjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBERUJVRyAoaW1hZ2U6ODkxKSBhcmdzOiBhY3BpLCB2 YWw6IDENCj4gWzIwMTMtMTItMTkgMTA6MTE6NDUgMjAyN10gREVCVUcgKGltYWdlOjg5MSkgYXJn czogdXNiLCB2YWw6IDANCj4gWzIwMTMtMTItMTkgMTA6MTE6NDUgMjAyN10gREVCVUcgKGltYWdl Ojg5MSkgYXJnczogdXNiZGV2aWNlLCB2YWw6IHRhYmxldA0KPiBbMjAxMy0xMi0xOSAxMDoxMTo0 NSAyMDI3XSBERUJVRyAoaW1hZ2U6ODkxKSBhcmdzOiBnZnhfcGFzc3RocnUsIHZhbDogTm9uZQ0K PiBbMjAxMy0xMi0xOSAxMDoxMTo0NSAyMDI3XSBJTkZPIChpbWFnZTo4MjIpIE5lZWQgdG8gY3Jl YXRlIHBsYXRmb3JtIGRldmljZS5bZG9taWQ6NF0NCj4gWzIwMTMtMTItMTkgMTA6MTE6NDUgMjAy N10gREVCVUcgKFhlbmRDaGVja3BvaW50OjI3OCkgcmVzdG9yZTpzaGFkb3c9MHhjLCBfc3RhdGlj X21heD0weDQwMDAwMDAwLCBfc3RhdGljX21pbj0weDAsIA0KPiBbMjAxMy0xMi0xOSAxMDoxMTo0 NSAyMDI3XSBERUJVRyAoWGVuZENoZWNrcG9pbnQ6MzA1KSBbeGNfcmVzdG9yZV06IC91c3IvbGli L3hlbi9iaW4veGNfcmVzdG9yZSA0IDQgNiA3IDEgMSAxIDANCj4gWzIwMTMtMTItMTkgMTA6MTI6 MTAgMjAyN10gSU5GTyAoWGVuZENoZWNrcG9pbnQ6NDIzKSB4YzogZXJyb3I6IEZhaWxlZCB0byBh bGxvY2F0ZSBtZW1vcnkgZm9yIGJhdGNoLiE6IEludGVybmFsIGVycm9yDQoNCkxvb2tzIGxpa2Ug dGhpcyBpcyB0aGUgY3VscHJpdD8NCg0KSSBsb29rZWQgYXQgdGhlIGNvZGUgaW4gcXVlc3Rpb24g aW4gbGlieGMganVzdCBub3cuIElmIGl0ICphbHdheXMqDQpmYWlscywgbXkgdmVyeSB3aWxkIGd1 ZXNzIHdvdWxkIGJlIHRoZSBtZW1vcnkgc2l6ZSBjYWxjdWxhdGlvbiBpcw0KYnJva2VuIHdoZW4g cmVzdG9yaW5nIEhWTSBkb21haW4gc28gdGhhdCBoeXBlcnZpc29yIGZhaWxzIHRvIGFsbG9jYXRl DQptZW1vcnkgZm9yIGl0Lg0KDQpJdCB3b3VsZCBiZSB3b3J0aCBrbm93aW5nIHdoZXRoZXIgdGhp cyBpcyBhIGxpYnhjIGJ1ZyBvciBYZW5kIGJ1Zy4gQ291bGQNCnlvdSB0cnkgeGw/IElmIHhsIHdv cmtzIHRoZW4gaXQncyBhIFhlbmQgYnVnLCBvdGhlcndpc2UgdGhpcyBpcyBwcm9iYWJseQ0KYSBi dWcgaW4gbGlieGMuDQoNCldlaS4= ------=_001_NextPart705486135640_=---- Content-Type: text/html; charset="utf-8" Content-Transfer-Encoding: quoted-printable =EF=BB=BF
Hi Wei Liu,
 
     Thank you for your reply.
     Last week I tested on xen 4.2.3 and Xen 4.1 = and=20 find out that it was the XenAPI C binding problems.
     All works well for both xl and xend too= lstack=20 now.    
 
Best=20 Regards

From: Wei Liu<= /DIV>
Date: 2013-12-19 20:06
To: kevin.zhang@octlink.com
Subject: Re: [Xen-users] HVM migrate failed on both xen 4= .1 and=20 xen 4.2
On Thu, Dec 19, 2013 at 10:20:01AM +0800, kevin.zhang@octlink.com=20 wrote:
> Hi all,
>
>         These days I am=20 testing xen live migration with xen.
> The result is that:
>        PVM migration works we= ll all=20 the time.
>        However, HVM windows v= m=20 migration always failed.  I'm using xen 4.1 and 4.2 with NFS as share= d=20 storage, and both failed with HVM migration.
> We are mainly using xend toolstack.  After searching for th= e=20 error messages, I found lots of people had this problem, and it related to= hvm=20 restore function bug.
> Could anyone help us? Thank you very much!
> Error messages are:
> [2013-12-19 10:11:45 2027] INFO (XendCheckpoint:260) restore hvm= =20 domain 4, apic=3D1, pae=3D1
> [2013-12-19 10:11:45 2027] DEBUG (image:337) Stored a VNC passwo= rd for=20 vfb access
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: boot, val: dc=
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: fda, val:=20 None
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: fdb, val:=20 None
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: soundhw, val:= =20 None
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: localtime, va= l:=20 0
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: serial, val:=20 ['pty']
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: std-vga, val:= =20 0
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: isa, val: 0
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: acpi, val: 1<= /DIV>
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: usb, val: 0
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: usbdevice, va= l:=20 tablet
> [2013-12-19 10:11:45 2027] DEBUG (image:891) args: gfx_passthru,= val:=20 None
> [2013-12-19 10:11:45 2027] INFO (image:822) Need to create platf= orm=20 device.[domid:4]
> [2013-12-19 10:11:45 2027] DEBUG (XendCheckpoint:278)=20 restore:shadow=3D0xc, _static_max=3D0x40000000, _static_min=3D0x0,
> [2013-12-19 10:11:45 2027] DEBUG (XendCheckpoint:305) [xc_restor= e]:=20 /usr/lib/xen/bin/xc_restore 4 4 6 7 1 1 1 0
> [2013-12-19 10:12:10 2027] INFO (XendCheckpoint:423) xc: error: = Failed=20 to allocate memory for batch.!: Internal error
 
Looks like this is the culprit?
 
I looked at the code in question in libxc just now. If it *always*
fails, my very wild guess would be the memory size calculation is
broken when restoring HVM domain so that hypervisor fails to allocate=
memory for it.
 
It would be worth knowing whether this is a libxc bug or Xend bug.=20 Could
you try xl? If xl works then it's a Xend bug, otherwise this is=20 probably
a bug in libxc.
 
Wei.
 
------=_001_NextPart705486135640_=------ --===============3652099717482143737== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============3652099717482143737==-- From xen-users-bounces@lists.xen.org Thu Dec 26 02:57:45 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 26 Dec 2013 02:57:45 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vw17S-0001ZA-P5; Thu, 26 Dec 2013 02:56:18 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vw17R-0001Z5-E0 for xen-users@lists.xen.org; Thu, 26 Dec 2013 02:56:17 +0000 Received: from [193.109.254.147:41511] by server-5.bemta-14.messagelabs.com id 9D/3F-03510-0DA9BB25; Thu, 26 Dec 2013 02:56:16 +0000 X-Env-Sender: johnnadre@zoho.com X-Msg-Ref: server-13.tower-27.messagelabs.com!1388026575!5199359!1 X-Originating-IP: [72.5.230.95] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNzIuNS4yMzAuOTUgPT4gNjM2NTg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 5872 invoked from network); 26 Dec 2013 02:56:15 -0000 Received: from sender1.zohomail.com (HELO sender1.zohomail.com) (72.5.230.95) by server-13.tower-27.messagelabs.com with SMTP; 26 Dec 2013 02:56:15 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=zapps768; d=zoho.com; h=date:from:to:message-id:subject:mime-version:content-type:user-agent; b=BEF3JKiXFzhEy7WSBIi31nYjJP0UPxMQA1i8GMl2ksCKJ5UqrTUsFe5E7mNHz2GEhsqPWTdOzSW4 eJFuiFPj0eQz2pny2IFXOiUtr+6H34AUPK+7M4dAD1zM/v+fbq2/ Received: from mail.zoho.com by mx.zohomail.com with SMTP id 1388026574557753.5133407265847; Wed, 25 Dec 2013 18:56:14 -0800 (PST) Received: from [84.175.77.40] by mail.zoho.com with HTTP;Wed, 25 Dec 2013 18:56:14 -0800 (PST) Date: Wed, 25 Dec 2013 18:56:14 -0800 From: johnnadre To: Message-ID: <476456808.81135.1388026574503.JavaMail.sas1@[172.29.249.242]> MIME-Version: 1.0 X-Priority: Medium User-Agent: Zoho Mail X-Mailer: Zoho Mail Subject: [Xen-users] PVHVM example for xen 4.3.1 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hello, I'm looking for an example configuration for a PVHVM domU that works with 4.3.1. The one at http://wiki.xen.org/wiki/Xen_Linux_PV_on_HVM_drivers causes 3 warnings and some errors: WARNING: ignoring "kernel" directive for HVM guest. Use "firmware_override" instead if you really want a non-default firmware WARNING: ignoring device_model directive. WARNING: Use "device_model_override" instead if you really want a non-default device_model xc: info: VIRTUAL MEMORY ARRANGEMENT: Loader: 0000000000100000->000000000019ed04 Modules: 0000000000000000->0000000000000000 TOTAL: 0000000000000000->000000000f800000 ENTRY ADDRESS: 0000000000100000 xc: info: PHYSICAL MEMORY ALLOCATION: 4KB PAGES: 0x0000000000000200 2MB PAGES: 0x000000000000007b 1GB PAGES: 0x0000000000000000 libxl: error: libxl_dm.c:1275:device_model_spawn_outcome: domain 2 device model: spawn failed (rc=-3) libxl: error: libxl_create.c:1075:domcreate_devmodel_started: device model did not start: -3 libxl: error: libxl_dm.c:1306:libxl__destroy_device_model: Device Model already exited If I follow the suggestions in the warning messages and specify firmware_override and device_model_override like so: firmware_override = "/usr/lib64/xen/boot/hvmloader" device_model_override = '/usr/lib64/xen/bin/qemu-dm' it only removes some of the warnings but not the errors: WARNING: device model override given without specific DM version same errors as above Does anybody have a config that works or any idea what's wrong with my config? One more noteworthy thing: # cat /var/log/xen/qemu-dm-auth.log /usr/lib64/xen/bin/qemu-dm: invalid option -- '-xen-domid' My config: #kernel = "hvmloader" #kernel = "/usr/lib64/xen/boot/hvmloader" firmware_override = "/usr/lib64/xen/boot/hvmloader" builder = "hvm" #device_model = 'qemu-dm' device_model_override = '/usr/lib64/xen/bin/qemu-dm' name = "auth" memory = 256 vcpus=1 pae=1 acpi=1 apic=1 vif = [ 'mac=00:16:3e:10:20:30, bridge=virbr0, model=e1000' ] disk = [ '/mnt/iso/grml96-full_2013.09.iso,raw,xvda:cdrom,r' ] boot="cd" #root = "/dev/sda1 ro" xen_platform_pci=1 on_poweroff = 'destroy' on_reboot = 'restart' on_crash = 'restart' sdl=0 vnc=1 vncpasswd='' stdvga=0 serial='pty' keymap='en' - John _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 26 02:57:45 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 26 Dec 2013 02:57:45 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vw17S-0001ZA-P5; Thu, 26 Dec 2013 02:56:18 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vw17R-0001Z5-E0 for xen-users@lists.xen.org; Thu, 26 Dec 2013 02:56:17 +0000 Received: from [193.109.254.147:41511] by server-5.bemta-14.messagelabs.com id 9D/3F-03510-0DA9BB25; Thu, 26 Dec 2013 02:56:16 +0000 X-Env-Sender: johnnadre@zoho.com X-Msg-Ref: server-13.tower-27.messagelabs.com!1388026575!5199359!1 X-Originating-IP: [72.5.230.95] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNzIuNS4yMzAuOTUgPT4gNjM2NTg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 5872 invoked from network); 26 Dec 2013 02:56:15 -0000 Received: from sender1.zohomail.com (HELO sender1.zohomail.com) (72.5.230.95) by server-13.tower-27.messagelabs.com with SMTP; 26 Dec 2013 02:56:15 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=zapps768; d=zoho.com; h=date:from:to:message-id:subject:mime-version:content-type:user-agent; b=BEF3JKiXFzhEy7WSBIi31nYjJP0UPxMQA1i8GMl2ksCKJ5UqrTUsFe5E7mNHz2GEhsqPWTdOzSW4 eJFuiFPj0eQz2pny2IFXOiUtr+6H34AUPK+7M4dAD1zM/v+fbq2/ Received: from mail.zoho.com by mx.zohomail.com with SMTP id 1388026574557753.5133407265847; Wed, 25 Dec 2013 18:56:14 -0800 (PST) Received: from [84.175.77.40] by mail.zoho.com with HTTP;Wed, 25 Dec 2013 18:56:14 -0800 (PST) Date: Wed, 25 Dec 2013 18:56:14 -0800 From: johnnadre To: Message-ID: <476456808.81135.1388026574503.JavaMail.sas1@[172.29.249.242]> MIME-Version: 1.0 X-Priority: Medium User-Agent: Zoho Mail X-Mailer: Zoho Mail Subject: [Xen-users] PVHVM example for xen 4.3.1 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hello, I'm looking for an example configuration for a PVHVM domU that works with 4.3.1. The one at http://wiki.xen.org/wiki/Xen_Linux_PV_on_HVM_drivers causes 3 warnings and some errors: WARNING: ignoring "kernel" directive for HVM guest. Use "firmware_override" instead if you really want a non-default firmware WARNING: ignoring device_model directive. WARNING: Use "device_model_override" instead if you really want a non-default device_model xc: info: VIRTUAL MEMORY ARRANGEMENT: Loader: 0000000000100000->000000000019ed04 Modules: 0000000000000000->0000000000000000 TOTAL: 0000000000000000->000000000f800000 ENTRY ADDRESS: 0000000000100000 xc: info: PHYSICAL MEMORY ALLOCATION: 4KB PAGES: 0x0000000000000200 2MB PAGES: 0x000000000000007b 1GB PAGES: 0x0000000000000000 libxl: error: libxl_dm.c:1275:device_model_spawn_outcome: domain 2 device model: spawn failed (rc=-3) libxl: error: libxl_create.c:1075:domcreate_devmodel_started: device model did not start: -3 libxl: error: libxl_dm.c:1306:libxl__destroy_device_model: Device Model already exited If I follow the suggestions in the warning messages and specify firmware_override and device_model_override like so: firmware_override = "/usr/lib64/xen/boot/hvmloader" device_model_override = '/usr/lib64/xen/bin/qemu-dm' it only removes some of the warnings but not the errors: WARNING: device model override given without specific DM version same errors as above Does anybody have a config that works or any idea what's wrong with my config? One more noteworthy thing: # cat /var/log/xen/qemu-dm-auth.log /usr/lib64/xen/bin/qemu-dm: invalid option -- '-xen-domid' My config: #kernel = "hvmloader" #kernel = "/usr/lib64/xen/boot/hvmloader" firmware_override = "/usr/lib64/xen/boot/hvmloader" builder = "hvm" #device_model = 'qemu-dm' device_model_override = '/usr/lib64/xen/bin/qemu-dm' name = "auth" memory = 256 vcpus=1 pae=1 acpi=1 apic=1 vif = [ 'mac=00:16:3e:10:20:30, bridge=virbr0, model=e1000' ] disk = [ '/mnt/iso/grml96-full_2013.09.iso,raw,xvda:cdrom,r' ] boot="cd" #root = "/dev/sda1 ro" xen_platform_pci=1 on_poweroff = 'destroy' on_reboot = 'restart' on_crash = 'restart' sdl=0 vnc=1 vncpasswd='' stdvga=0 serial='pty' keymap='en' - John _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 26 11:54:46 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 26 Dec 2013 11:54:46 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vw9V4-0006zB-3p; Thu, 26 Dec 2013 11:53:14 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vw9V2-0006z6-IB for xen-users@lists.xen.org; Thu, 26 Dec 2013 11:53:12 +0000 Received: from [85.158.139.211:50293] by server-8.bemta-5.messagelabs.com id C9/86-29838-7A81CB25; Thu, 26 Dec 2013 11:53:11 +0000 X-Env-Sender: svpcom@gmail.com X-Msg-Ref: server-6.tower-206.messagelabs.com!1388058790!6677535!1 X-Originating-IP: [209.85.215.45] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 17013 invoked from network); 26 Dec 2013 11:53:10 -0000 Received: from mail-la0-f45.google.com (HELO mail-la0-f45.google.com) (209.85.215.45) by server-6.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 26 Dec 2013 11:53:10 -0000 Received: by mail-la0-f45.google.com with SMTP id eh20so3664535lab.18 for ; Thu, 26 Dec 2013 03:53:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=yeuOZEiGiXnhi95Su7viEsLtJicKDsXJPlEt/YW3TGQ=; b=qtdAusZYEHmn0M1HjaTNwmkl2olYpbIo8PBDR+Gs39N5nFY1IkPOehe3fhSJSbn2CA YiilklWkApP0ThrGl6et6F8s4Dol5IJnGcZSRmxulg96DFfoQ/CKvLteb3ucmZPzTAzp r9ugnFb4kUtJhQHrXgoGf0CvOGUf87wxs1RtUuFHYAgE09Dmr2UzgQEXVTMKVGGnrSUT lpOaK8UZBdrYwxvGpXlEhyzhUopwW3Qm20Tv+k5cewcVJt89czG5+nbmIknTIdPNw+GZ UMjP6d/7DwmZCSZLN3Vgk3O07YxeyuokFdDePjNpsCRFDDxP6VyiGqWCQyKpAsGUOhSr PhtA== X-Received: by 10.112.17.39 with SMTP id l7mr2928058lbd.51.1388058789953; Thu, 26 Dec 2013 03:53:09 -0800 (PST) Received: from [10.3.108.111] ([176.14.233.129]) by mx.google.com with ESMTPSA id bl6sm18544186lbb.5.2013.12.26.03.53.07 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 26 Dec 2013 03:53:08 -0800 (PST) Message-ID: <52BC18A3.4010203@gmail.com> Date: Thu, 26 Dec 2013 15:53:07 +0400 From: Vasily Evseenko User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.0 MIME-Version: 1.0 To: xen-users@lists.xen.org X-Enigmail-Version: 1.6 Subject: [Xen-users] domU crash with kernel BUG at drivers/net/xen-netfront.c:305 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi, I've got domU crash (~ every 1-2 days under high load) with message: ----- [2013-12-26 03:53:18] kernel BUG at drivers/net/xen-netfront.c:305! [2013-12-26 03:53:18] invalid opcode: 0000 [#1] SMP [2013-12-26 03:53:18] Modules linked in: ipt_REJECT iptable_filter xt_set xt_REDIRECT iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat ip_tables ip_set_hash_net ip_set_hash_ip ip_set nfnetlink ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter ip6_table s ipv6 ext3 jbd xen_netfront coretemp hwmon crc32_pclmul crc32c_intel ghash_clmulni_intel microcode pcspkr ext4 jbd2 mbcache aesni_intel ablk_helper c ryptd lrw gf128mul glue_helper aes_x86_64 xen_blkfront dm_mirror dm_region_hash dm_log dm_mod [2013-12-26 03:53:18] CPU: 0 PID: 15126 Comm: python Not tainted 3.10.25-11.x86_64 #1 [2013-12-26 03:53:18] task: ffff8801e5d68ac0 ti: ffff8801e7392000 task.ti: ffff8801e7392000 [2013-12-26 03:53:18] RIP: e030:[] [] xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] [2013-12-26 03:53:18] RSP: e02b:ffff8801f2e03ce0 EFLAGS: 00010282 [2013-12-26 03:53:18] RAX: 00000000000001d4 RBX: ffff8801e5438800 RCX: 0000000000000001 [2013-12-26 03:53:18] RDX: 000000000000002a RSI: 0000000000000000 RDI: 0000000000002200 [2013-12-26 03:53:18] RBP: ffff8801f2e03d40 R08: 0000000000000000 R09: 0000000000001000 [2013-12-26 03:53:18] R10: ffff8801000083c0 R11: dead000000200200 R12: 0000000000000220 [2013-12-26 03:53:18] R13: ffff8801e6eec0c0 R14: 000000000000002a R15: 000000000239642a [2013-12-26 03:53:18] FS: 00007f4cf48d57e0(0000) GS:ffff8801f2e00000(0000) knlGS:0000000000000000 [2013-12-26 03:53:18] CS: e033 DS: 0000 ES: 0000 CR0: 0000000080050033 [2013-12-26 03:53:18] CR2: ffffffffff600400 CR3: 00000001e0db3000 CR4: 0000000000042660 [2013-12-26 03:53:18] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [2013-12-26 03:53:18] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [2013-12-26 03:53:18] Stack: [2013-12-26 03:53:18] ffff8801f2e03df0 02396417e5438000 ffff8801e5439d58 ffff8801e54394f0 [2013-12-26 03:53:18] ffff8801e5438000 002affff00000013 ffff8801f2e03d40 ffff8801f2e03db0 [2013-12-26 03:53:18] 0000000000000010 ffff8800655e6ac0 ffff8801e5438800 ffff8801e511a000 [2013-12-26 03:53:18] Call Trace: [2013-12-26 03:53:18] [2013-12-26 03:53:18] [] xennet_poll+0x2f4/0x630 [xen_netfront] [2013-12-26 03:53:18] [] ? raise_softirq_irqoff+0x9/0x50 [2013-12-26 03:53:18] [] ? dev_kfree_skb_irq+0x5c/0x70 [2013-12-26 03:53:18] [] ? handle_irq_event_percpu+0xc9/0x210 [2013-12-26 03:53:18] [] net_rx_action+0x112/0x290 [2013-12-26 03:53:18] [] ? handle_irq_event+0x4d/0x70 [2013-12-26 03:53:18] [] __do_softirq+0xf7/0x270 [2013-12-26 03:53:18] [] call_softirq+0x1c/0x30 [2013-12-26 03:53:18] [] do_softirq+0x65/0xa0 [2013-12-26 03:53:18] [] irq_exit+0xc5/0xd0 [2013-12-26 03:53:18] [] xen_evtchn_do_upcall+0x35/0x50 [2013-12-26 03:53:18] [] xen_do_hypervisor_callback+0x1e/0x30 [2013-12-26 03:53:18] [2013-12-26 03:53:18] Code: 8b 35 ee f9 bb e1 48 8d bb 08 0d 00 00 48 83 c6 64 e8 2e f2 f0 e0 8b 83 ec 0c 00 00 31 d2 89 c1 d1 e9 39 d1 76 9e e9 5a ff ff ff <0f> 0b eb fe 0f 0b 0f 1f 00 eb fb 66 66 66 66 66 2e 0f 1f 84 00 [2013-12-26 03:53:18] RIP [] xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] [2013-12-26 03:53:18] RSP ------------ dom0 and domU kernels are vanilla 3.10.25 host server has 4 cores x 2 threads with mapping: 4 - dom0, 2 - domU, 2 - domU i've tried xen versions: 4.2.3 and 4.3.1 also i've tried to disable offloaing on domU: ethtool -K eth0 tx off tso off gso off ---- no effects domU's are under high TCP load (a lot of small tcp connections (web server)) sometimes i've got on dom0: --- [2013-12-26 00:16:30] (XEN) grant_table.c:289:d0 Increased maptrack size to 2 frames [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 43646979 [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 43646979 [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 43646979 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 --- _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 26 11:54:46 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 26 Dec 2013 11:54:46 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vw9V4-0006zB-3p; Thu, 26 Dec 2013 11:53:14 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vw9V2-0006z6-IB for xen-users@lists.xen.org; Thu, 26 Dec 2013 11:53:12 +0000 Received: from [85.158.139.211:50293] by server-8.bemta-5.messagelabs.com id C9/86-29838-7A81CB25; Thu, 26 Dec 2013 11:53:11 +0000 X-Env-Sender: svpcom@gmail.com X-Msg-Ref: server-6.tower-206.messagelabs.com!1388058790!6677535!1 X-Originating-IP: [209.85.215.45] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 17013 invoked from network); 26 Dec 2013 11:53:10 -0000 Received: from mail-la0-f45.google.com (HELO mail-la0-f45.google.com) (209.85.215.45) by server-6.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 26 Dec 2013 11:53:10 -0000 Received: by mail-la0-f45.google.com with SMTP id eh20so3664535lab.18 for ; Thu, 26 Dec 2013 03:53:10 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject :content-type:content-transfer-encoding; bh=yeuOZEiGiXnhi95Su7viEsLtJicKDsXJPlEt/YW3TGQ=; b=qtdAusZYEHmn0M1HjaTNwmkl2olYpbIo8PBDR+Gs39N5nFY1IkPOehe3fhSJSbn2CA YiilklWkApP0ThrGl6et6F8s4Dol5IJnGcZSRmxulg96DFfoQ/CKvLteb3ucmZPzTAzp r9ugnFb4kUtJhQHrXgoGf0CvOGUf87wxs1RtUuFHYAgE09Dmr2UzgQEXVTMKVGGnrSUT lpOaK8UZBdrYwxvGpXlEhyzhUopwW3Qm20Tv+k5cewcVJt89czG5+nbmIknTIdPNw+GZ UMjP6d/7DwmZCSZLN3Vgk3O07YxeyuokFdDePjNpsCRFDDxP6VyiGqWCQyKpAsGUOhSr PhtA== X-Received: by 10.112.17.39 with SMTP id l7mr2928058lbd.51.1388058789953; Thu, 26 Dec 2013 03:53:09 -0800 (PST) Received: from [10.3.108.111] ([176.14.233.129]) by mx.google.com with ESMTPSA id bl6sm18544186lbb.5.2013.12.26.03.53.07 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Thu, 26 Dec 2013 03:53:08 -0800 (PST) Message-ID: <52BC18A3.4010203@gmail.com> Date: Thu, 26 Dec 2013 15:53:07 +0400 From: Vasily Evseenko User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.0 MIME-Version: 1.0 To: xen-users@lists.xen.org X-Enigmail-Version: 1.6 Subject: [Xen-users] domU crash with kernel BUG at drivers/net/xen-netfront.c:305 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi, I've got domU crash (~ every 1-2 days under high load) with message: ----- [2013-12-26 03:53:18] kernel BUG at drivers/net/xen-netfront.c:305! [2013-12-26 03:53:18] invalid opcode: 0000 [#1] SMP [2013-12-26 03:53:18] Modules linked in: ipt_REJECT iptable_filter xt_set xt_REDIRECT iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 nf_nat_ipv4 nf_nat ip_tables ip_set_hash_net ip_set_hash_ip ip_set nfnetlink ip6t_REJECT nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter ip6_table s ipv6 ext3 jbd xen_netfront coretemp hwmon crc32_pclmul crc32c_intel ghash_clmulni_intel microcode pcspkr ext4 jbd2 mbcache aesni_intel ablk_helper c ryptd lrw gf128mul glue_helper aes_x86_64 xen_blkfront dm_mirror dm_region_hash dm_log dm_mod [2013-12-26 03:53:18] CPU: 0 PID: 15126 Comm: python Not tainted 3.10.25-11.x86_64 #1 [2013-12-26 03:53:18] task: ffff8801e5d68ac0 ti: ffff8801e7392000 task.ti: ffff8801e7392000 [2013-12-26 03:53:18] RIP: e030:[] [] xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] [2013-12-26 03:53:18] RSP: e02b:ffff8801f2e03ce0 EFLAGS: 00010282 [2013-12-26 03:53:18] RAX: 00000000000001d4 RBX: ffff8801e5438800 RCX: 0000000000000001 [2013-12-26 03:53:18] RDX: 000000000000002a RSI: 0000000000000000 RDI: 0000000000002200 [2013-12-26 03:53:18] RBP: ffff8801f2e03d40 R08: 0000000000000000 R09: 0000000000001000 [2013-12-26 03:53:18] R10: ffff8801000083c0 R11: dead000000200200 R12: 0000000000000220 [2013-12-26 03:53:18] R13: ffff8801e6eec0c0 R14: 000000000000002a R15: 000000000239642a [2013-12-26 03:53:18] FS: 00007f4cf48d57e0(0000) GS:ffff8801f2e00000(0000) knlGS:0000000000000000 [2013-12-26 03:53:18] CS: e033 DS: 0000 ES: 0000 CR0: 0000000080050033 [2013-12-26 03:53:18] CR2: ffffffffff600400 CR3: 00000001e0db3000 CR4: 0000000000042660 [2013-12-26 03:53:18] DR0: 0000000000000000 DR1: 0000000000000000 DR2: 0000000000000000 [2013-12-26 03:53:18] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: 0000000000000400 [2013-12-26 03:53:18] Stack: [2013-12-26 03:53:18] ffff8801f2e03df0 02396417e5438000 ffff8801e5439d58 ffff8801e54394f0 [2013-12-26 03:53:18] ffff8801e5438000 002affff00000013 ffff8801f2e03d40 ffff8801f2e03db0 [2013-12-26 03:53:18] 0000000000000010 ffff8800655e6ac0 ffff8801e5438800 ffff8801e511a000 [2013-12-26 03:53:18] Call Trace: [2013-12-26 03:53:18] [2013-12-26 03:53:18] [] xennet_poll+0x2f4/0x630 [xen_netfront] [2013-12-26 03:53:18] [] ? raise_softirq_irqoff+0x9/0x50 [2013-12-26 03:53:18] [] ? dev_kfree_skb_irq+0x5c/0x70 [2013-12-26 03:53:18] [] ? handle_irq_event_percpu+0xc9/0x210 [2013-12-26 03:53:18] [] net_rx_action+0x112/0x290 [2013-12-26 03:53:18] [] ? handle_irq_event+0x4d/0x70 [2013-12-26 03:53:18] [] __do_softirq+0xf7/0x270 [2013-12-26 03:53:18] [] call_softirq+0x1c/0x30 [2013-12-26 03:53:18] [] do_softirq+0x65/0xa0 [2013-12-26 03:53:18] [] irq_exit+0xc5/0xd0 [2013-12-26 03:53:18] [] xen_evtchn_do_upcall+0x35/0x50 [2013-12-26 03:53:18] [] xen_do_hypervisor_callback+0x1e/0x30 [2013-12-26 03:53:18] [2013-12-26 03:53:18] Code: 8b 35 ee f9 bb e1 48 8d bb 08 0d 00 00 48 83 c6 64 e8 2e f2 f0 e0 8b 83 ec 0c 00 00 31 d2 89 c1 d1 e9 39 d1 76 9e e9 5a ff ff ff <0f> 0b eb fe 0f 0b 0f 1f 00 eb fb 66 66 66 66 66 2e 0f 1f 84 00 [2013-12-26 03:53:18] RIP [] xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] [2013-12-26 03:53:18] RSP ------------ dom0 and domU kernels are vanilla 3.10.25 host server has 4 cores x 2 threads with mapping: 4 - dom0, 2 - domU, 2 - domU i've tried xen versions: 4.2.3 and 4.3.1 also i've tried to disable offloaing on domU: ethtool -K eth0 tx off tso off gso off ---- no effects domU's are under high TCP load (a lot of small tcp connections (web server)) sometimes i've got on dom0: --- [2013-12-26 00:16:30] (XEN) grant_table.c:289:d0 Increased maptrack size to 2 frames [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 43646979 [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 43646979 [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 43646979 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 --- _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 26 15:04:41 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 26 Dec 2013 15:04:41 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwCSu-0003TS-Rb; Thu, 26 Dec 2013 15:03:12 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwCSt-0003TN-LZ for xen-users@lists.xen.org; Thu, 26 Dec 2013 15:03:11 +0000 Received: from [193.109.254.147:6720] by server-7.bemta-14.messagelabs.com id CE/C7-15500-E254CB25; Thu, 26 Dec 2013 15:03:10 +0000 X-Env-Sender: russell.pavlicek.xen@gmail.com X-Msg-Ref: server-16.tower-27.messagelabs.com!1388070184!6081572!1 X-Originating-IP: [209.85.215.48] X-SpamReason: No, hits=0.3 required=7.0 tests=RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11009 invoked from network); 26 Dec 2013 15:03:04 -0000 Received: from mail-la0-f48.google.com (HELO mail-la0-f48.google.com) (209.85.215.48) by server-16.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 26 Dec 2013 15:03:04 -0000 Received: by mail-la0-f48.google.com with SMTP id n7so3694266lam.21 for ; Thu, 26 Dec 2013 07:03:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=av1xfpHntrpLJ5Tb/qy6NxsIH50sYnMa/KzvDIFo2dc=; b=Phw1rCJzD8v9TcE/DjfGFyPdyKpUrnQqXxNU/208ltEeEBRGxrz4lXp+Vo9IMurJY3 j7e89VvLxDrtPHVwFElDN7l0pUzJKBHTv9slhFlKB+jRtZNb7gekg0tktG6fQEDia6H2 7ot3ffjeeKjdXWKaY/G8bOFpXqycUUL7NrPdN9L5Lk/PDMl42oETkXbvWdFRUPOVQfGy xKyZWA2GQAkyw8U4oZJi1WZw2PNUlHYMLnqmqF51KKEM3ejdE8jNYIYhwaFORR2mC5LE 285e/JpZPwr/QNSlGjjOgXcVMnhEjl8fw0W07UDB2aD2Ewco+RWOc7QDSWVJLo+4RLvK sGeA== MIME-Version: 1.0 X-Received: by 10.152.21.74 with SMTP id t10mr384181lae.65.1388070183921; Thu, 26 Dec 2013 07:03:03 -0800 (PST) Received: by 10.112.184.16 with HTTP; Thu, 26 Dec 2013 07:03:03 -0800 (PST) Date: Thu, 26 Dec 2013 10:03:03 -0500 X-Google-Sender-Auth: KJJi2fFD6pnrdyp8-vcy_4DpAWA Message-ID: From: Russ Pavlicek To: "xen-users@lists.xen.org" Subject: [Xen-users] XenProject.org Q&A: High ping/latency on guest X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org XenProject.org user apit submits the following: --- I am running Xen 4.1.5 on Linux Ubuntu 12.04 LTS and ping on guest sometimes is extremely high (see in attachment). When I was using Xen 4.1.2 ping was high on both - host and guest. xm info host : server release : 3.5.0-44-generic version : #67~precise1-Ubuntu SMP Wed Nov 13 16:16:57 UTC 2013 machine : x86_64 nr_cpus : 8 nr_nodes : 1 cores_per_socket : 4 threads_per_core : 1 cpu_mhz : 2992 hw_caps : bfebfbff:20100800:00000000:00000940:000ce3bd:00000000:00000001:00000000 virt_caps : total_memory : 32761 free_memory : 406 free_cpus : 0 xen_major : 4 xen_minor : 1 xen_extra : .5 xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p xen_scheduler : credit xen_pagesize : 4096 platform_params : virt_start=0xffff800000000000 xen_changeset : unavailable xen_commandline : placeholder dom0_mem=1024M cc_compiler : gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5) cc_compile_by : stefan.bader cc_compile_domain : canonical.com cc_compile_date : Tue Dec 17 16:35:34 UTC 2013 xend_config_format : 4 --- The original post and the attachment apit submitted can be found here: http://xenproject.org/questions-and-answers/high-ping-latency-on-guest.html The attachment shows a ping output which averages about 49 ms but shows a blip of 321 ms before returning to 49 ms. Any insights? Please respond to me (so I can crosspost) or visit the website directly. Thanks, Russ _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 26 15:04:41 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 26 Dec 2013 15:04:41 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwCSu-0003TS-Rb; Thu, 26 Dec 2013 15:03:12 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwCSt-0003TN-LZ for xen-users@lists.xen.org; Thu, 26 Dec 2013 15:03:11 +0000 Received: from [193.109.254.147:6720] by server-7.bemta-14.messagelabs.com id CE/C7-15500-E254CB25; Thu, 26 Dec 2013 15:03:10 +0000 X-Env-Sender: russell.pavlicek.xen@gmail.com X-Msg-Ref: server-16.tower-27.messagelabs.com!1388070184!6081572!1 X-Originating-IP: [209.85.215.48] X-SpamReason: No, hits=0.3 required=7.0 tests=RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11009 invoked from network); 26 Dec 2013 15:03:04 -0000 Received: from mail-la0-f48.google.com (HELO mail-la0-f48.google.com) (209.85.215.48) by server-16.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 26 Dec 2013 15:03:04 -0000 Received: by mail-la0-f48.google.com with SMTP id n7so3694266lam.21 for ; Thu, 26 Dec 2013 07:03:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=av1xfpHntrpLJ5Tb/qy6NxsIH50sYnMa/KzvDIFo2dc=; b=Phw1rCJzD8v9TcE/DjfGFyPdyKpUrnQqXxNU/208ltEeEBRGxrz4lXp+Vo9IMurJY3 j7e89VvLxDrtPHVwFElDN7l0pUzJKBHTv9slhFlKB+jRtZNb7gekg0tktG6fQEDia6H2 7ot3ffjeeKjdXWKaY/G8bOFpXqycUUL7NrPdN9L5Lk/PDMl42oETkXbvWdFRUPOVQfGy xKyZWA2GQAkyw8U4oZJi1WZw2PNUlHYMLnqmqF51KKEM3ejdE8jNYIYhwaFORR2mC5LE 285e/JpZPwr/QNSlGjjOgXcVMnhEjl8fw0W07UDB2aD2Ewco+RWOc7QDSWVJLo+4RLvK sGeA== MIME-Version: 1.0 X-Received: by 10.152.21.74 with SMTP id t10mr384181lae.65.1388070183921; Thu, 26 Dec 2013 07:03:03 -0800 (PST) Received: by 10.112.184.16 with HTTP; Thu, 26 Dec 2013 07:03:03 -0800 (PST) Date: Thu, 26 Dec 2013 10:03:03 -0500 X-Google-Sender-Auth: KJJi2fFD6pnrdyp8-vcy_4DpAWA Message-ID: From: Russ Pavlicek To: "xen-users@lists.xen.org" Subject: [Xen-users] XenProject.org Q&A: High ping/latency on guest X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org XenProject.org user apit submits the following: --- I am running Xen 4.1.5 on Linux Ubuntu 12.04 LTS and ping on guest sometimes is extremely high (see in attachment). When I was using Xen 4.1.2 ping was high on both - host and guest. xm info host : server release : 3.5.0-44-generic version : #67~precise1-Ubuntu SMP Wed Nov 13 16:16:57 UTC 2013 machine : x86_64 nr_cpus : 8 nr_nodes : 1 cores_per_socket : 4 threads_per_core : 1 cpu_mhz : 2992 hw_caps : bfebfbff:20100800:00000000:00000940:000ce3bd:00000000:00000001:00000000 virt_caps : total_memory : 32761 free_memory : 406 free_cpus : 0 xen_major : 4 xen_minor : 1 xen_extra : .5 xen_caps : xen-3.0-x86_64 xen-3.0-x86_32p xen_scheduler : credit xen_pagesize : 4096 platform_params : virt_start=0xffff800000000000 xen_changeset : unavailable xen_commandline : placeholder dom0_mem=1024M cc_compiler : gcc version 4.6.3 (Ubuntu/Linaro 4.6.3-1ubuntu5) cc_compile_by : stefan.bader cc_compile_domain : canonical.com cc_compile_date : Tue Dec 17 16:35:34 UTC 2013 xend_config_format : 4 --- The original post and the attachment apit submitted can be found here: http://xenproject.org/questions-and-answers/high-ping-latency-on-guest.html The attachment shows a ping output which averages about 49 ms but shows a blip of 321 ms before returning to 49 ms. Any insights? Please respond to me (so I can crosspost) or visit the website directly. Thanks, Russ _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 26 16:32:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 26 Dec 2013 16:32:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwDqi-0006Bc-6G; Thu, 26 Dec 2013 16:31:52 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwDqg-0006BW-GZ for xen-users@lists.xen.org; Thu, 26 Dec 2013 16:31:50 +0000 Received: from [193.109.254.147:5051] by server-7.bemta-14.messagelabs.com id AD/6B-15500-5F95CB25; Thu, 26 Dec 2013 16:31:49 +0000 X-Env-Sender: highwaystar.ru@gmail.com X-Msg-Ref: server-4.tower-27.messagelabs.com!1388075507!4100992!1 X-Originating-IP: [209.85.128.171] X-SpamReason: No, hits=0.8 required=7.0 tests=BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 18371 invoked from network); 26 Dec 2013 16:31:48 -0000 Received: from mail-ve0-f171.google.com (HELO mail-ve0-f171.google.com) (209.85.128.171) by server-4.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 26 Dec 2013 16:31:48 -0000 Received: by mail-ve0-f171.google.com with SMTP id pa12so4489076veb.16 for ; Thu, 26 Dec 2013 08:31:47 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=NbOpxridSNfdsg8RQmQEnaWyJcMtT/lFYesn8tZ9JuM=; b=VjrrkHRTi1SU1kn/AvvYAKV28j3Qn244XK/SPVizs/sOEPl+7E8/Mm+JtrM/LUe6yA YuVt41Jz85uP9VZWMJQSe9kHmFecNALak9Y4A7O3ihiqw4gHNLw0ZgnAsIGBzI2+Ccef 9GFle7booCh5AhPKlbB0+sVnGFGyuaq0eo0cKn11+ee6FkeTxe5h0WHkVe2jHAcnQUaj Jh6Cy20tE8xu7MVbj7dcEgUoIvSPlHnExc11QibK6E2L9sBlki0mfxWplXh4PsQLW+EK 5QG7UmxZ5yzYRue6kHhA2JUKdkMVoQGNTUnHGtIcR964lzapoi093QHK84S/d4GJHzTl fERQ== MIME-Version: 1.0 X-Received: by 10.220.48.194 with SMTP id s2mr1399154vcf.43.1388075507244; Thu, 26 Dec 2013 08:31:47 -0800 (PST) Received: by 10.52.115.199 with HTTP; Thu, 26 Dec 2013 08:31:47 -0800 (PST) In-Reply-To: <52BC18A3.4010203@gmail.com> References: <52BC18A3.4010203@gmail.com> Date: Fri, 27 Dec 2013 01:31:47 +0900 Message-ID: From: Vitaliy Tomin To: xen-users@lists.xen.org Subject: Re: [Xen-users] domU crash with kernel BUG at drivers/net/xen-netfront.c:305 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This bug was fixed in openSUSE kernel bnc#826374. Patch provided in attachment in Novell bugzilla. https://bugzilla.novell.com/show_bug.cgi?id=826374 On Thu, Dec 26, 2013 at 8:53 PM, Vasily Evseenko wrote: > Hi, > > I've got domU crash (~ every 1-2 days under high load) with message: > > ----- > [2013-12-26 03:53:18] kernel BUG at drivers/net/xen-netfront.c:305! > [2013-12-26 03:53:18] invalid opcode: 0000 [#1] SMP > [2013-12-26 03:53:18] Modules linked in: ipt_REJECT iptable_filter > xt_set xt_REDIRECT iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 > nf_nat_ipv4 nf_nat > ip_tables ip_set_hash_net ip_set_hash_ip ip_set nfnetlink ip6t_REJECT > nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter > ip6_table > s ipv6 ext3 jbd xen_netfront coretemp hwmon crc32_pclmul crc32c_intel > ghash_clmulni_intel microcode pcspkr ext4 jbd2 mbcache aesni_intel > ablk_helper c > ryptd lrw gf128mul glue_helper aes_x86_64 xen_blkfront dm_mirror > dm_region_hash dm_log dm_mod > [2013-12-26 03:53:18] CPU: 0 PID: 15126 Comm: python Not tainted > 3.10.25-11.x86_64 #1 > [2013-12-26 03:53:18] task: ffff8801e5d68ac0 ti: ffff8801e7392000 > task.ti: ffff8801e7392000 > [2013-12-26 03:53:18] RIP: e030:[] > [] xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] > [2013-12-26 03:53:18] RSP: e02b:ffff8801f2e03ce0 EFLAGS: 00010282 > [2013-12-26 03:53:18] RAX: 00000000000001d4 RBX: ffff8801e5438800 RCX: > 0000000000000001 > [2013-12-26 03:53:18] RDX: 000000000000002a RSI: 0000000000000000 RDI: > 0000000000002200 > [2013-12-26 03:53:18] RBP: ffff8801f2e03d40 R08: 0000000000000000 R09: > 0000000000001000 > [2013-12-26 03:53:18] R10: ffff8801000083c0 R11: dead000000200200 R12: > 0000000000000220 > [2013-12-26 03:53:18] R13: ffff8801e6eec0c0 R14: 000000000000002a R15: > 000000000239642a > [2013-12-26 03:53:18] FS: 00007f4cf48d57e0(0000) > GS:ffff8801f2e00000(0000) knlGS:0000000000000000 > [2013-12-26 03:53:18] CS: e033 DS: 0000 ES: 0000 CR0: 0000000080050033 > [2013-12-26 03:53:18] CR2: ffffffffff600400 CR3: 00000001e0db3000 CR4: > 0000000000042660 > [2013-12-26 03:53:18] DR0: 0000000000000000 DR1: 0000000000000000 DR2: > 0000000000000000 > [2013-12-26 03:53:18] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: > 0000000000000400 > [2013-12-26 03:53:18] Stack: > [2013-12-26 03:53:18] ffff8801f2e03df0 02396417e5438000 > ffff8801e5439d58 ffff8801e54394f0 > [2013-12-26 03:53:18] ffff8801e5438000 002affff00000013 > ffff8801f2e03d40 ffff8801f2e03db0 > [2013-12-26 03:53:18] 0000000000000010 ffff8800655e6ac0 > ffff8801e5438800 ffff8801e511a000 > [2013-12-26 03:53:18] Call Trace: > [2013-12-26 03:53:18] > [2013-12-26 03:53:18] [] xennet_poll+0x2f4/0x630 > [xen_netfront] > [2013-12-26 03:53:18] [] ? raise_softirq_irqoff+0x9/0x50 > [2013-12-26 03:53:18] [] ? dev_kfree_skb_irq+0x5c/0x70 > [2013-12-26 03:53:18] [] ? > handle_irq_event_percpu+0xc9/0x210 > [2013-12-26 03:53:18] [] net_rx_action+0x112/0x290 > [2013-12-26 03:53:18] [] ? handle_irq_event+0x4d/0x70 > [2013-12-26 03:53:18] [] __do_softirq+0xf7/0x270 > [2013-12-26 03:53:18] [] call_softirq+0x1c/0x30 > [2013-12-26 03:53:18] [] do_softirq+0x65/0xa0 > [2013-12-26 03:53:18] [] irq_exit+0xc5/0xd0 > [2013-12-26 03:53:18] [] xen_evtchn_do_upcall+0x35/0x50 > [2013-12-26 03:53:18] [] > xen_do_hypervisor_callback+0x1e/0x30 > [2013-12-26 03:53:18] > [2013-12-26 03:53:18] Code: 8b 35 ee f9 bb e1 48 8d bb 08 0d 00 00 48 83 > c6 64 e8 2e f2 f0 e0 8b 83 ec 0c 00 00 31 d2 89 c1 d1 e9 39 d1 76 9e e9 > 5a ff ff ff <0f> 0b eb fe 0f 0b 0f 1f 00 eb fb 66 66 66 66 66 2e 0f 1f > 84 00 > [2013-12-26 03:53:18] RIP [] > xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] > [2013-12-26 03:53:18] RSP > ------------ > > dom0 and domU kernels are vanilla 3.10.25 > host server has 4 cores x 2 threads with mapping: 4 - dom0, 2 - domU, 2 > - domU > i've tried xen versions: 4.2.3 and 4.3.1 > also i've tried to disable offloaing on domU: ethtool -K eth0 tx off > tso off gso off ---- no effects > > domU's are under high TCP load (a lot of small tcp connections (web server)) > sometimes i've got on dom0: > --- > [2013-12-26 00:16:30] (XEN) grant_table.c:289:d0 Increased maptrack size > to 2 frames > [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference > 99221507 > [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference > 43646979 > [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference > 43646979 > [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference > 99221507 > [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference > 43646979 > [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference > 99221507 > [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference > 99221507 > [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference > 99221507 > > --- > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 26 16:32:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 26 Dec 2013 16:32:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwDqi-0006Bc-6G; Thu, 26 Dec 2013 16:31:52 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwDqg-0006BW-GZ for xen-users@lists.xen.org; Thu, 26 Dec 2013 16:31:50 +0000 Received: from [193.109.254.147:5051] by server-7.bemta-14.messagelabs.com id AD/6B-15500-5F95CB25; Thu, 26 Dec 2013 16:31:49 +0000 X-Env-Sender: highwaystar.ru@gmail.com X-Msg-Ref: server-4.tower-27.messagelabs.com!1388075507!4100992!1 X-Originating-IP: [209.85.128.171] X-SpamReason: No, hits=0.8 required=7.0 tests=BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 18371 invoked from network); 26 Dec 2013 16:31:48 -0000 Received: from mail-ve0-f171.google.com (HELO mail-ve0-f171.google.com) (209.85.128.171) by server-4.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 26 Dec 2013 16:31:48 -0000 Received: by mail-ve0-f171.google.com with SMTP id pa12so4489076veb.16 for ; Thu, 26 Dec 2013 08:31:47 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=NbOpxridSNfdsg8RQmQEnaWyJcMtT/lFYesn8tZ9JuM=; b=VjrrkHRTi1SU1kn/AvvYAKV28j3Qn244XK/SPVizs/sOEPl+7E8/Mm+JtrM/LUe6yA YuVt41Jz85uP9VZWMJQSe9kHmFecNALak9Y4A7O3ihiqw4gHNLw0ZgnAsIGBzI2+Ccef 9GFle7booCh5AhPKlbB0+sVnGFGyuaq0eo0cKn11+ee6FkeTxe5h0WHkVe2jHAcnQUaj Jh6Cy20tE8xu7MVbj7dcEgUoIvSPlHnExc11QibK6E2L9sBlki0mfxWplXh4PsQLW+EK 5QG7UmxZ5yzYRue6kHhA2JUKdkMVoQGNTUnHGtIcR964lzapoi093QHK84S/d4GJHzTl fERQ== MIME-Version: 1.0 X-Received: by 10.220.48.194 with SMTP id s2mr1399154vcf.43.1388075507244; Thu, 26 Dec 2013 08:31:47 -0800 (PST) Received: by 10.52.115.199 with HTTP; Thu, 26 Dec 2013 08:31:47 -0800 (PST) In-Reply-To: <52BC18A3.4010203@gmail.com> References: <52BC18A3.4010203@gmail.com> Date: Fri, 27 Dec 2013 01:31:47 +0900 Message-ID: From: Vitaliy Tomin To: xen-users@lists.xen.org Subject: Re: [Xen-users] domU crash with kernel BUG at drivers/net/xen-netfront.c:305 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This bug was fixed in openSUSE kernel bnc#826374. Patch provided in attachment in Novell bugzilla. https://bugzilla.novell.com/show_bug.cgi?id=826374 On Thu, Dec 26, 2013 at 8:53 PM, Vasily Evseenko wrote: > Hi, > > I've got domU crash (~ every 1-2 days under high load) with message: > > ----- > [2013-12-26 03:53:18] kernel BUG at drivers/net/xen-netfront.c:305! > [2013-12-26 03:53:18] invalid opcode: 0000 [#1] SMP > [2013-12-26 03:53:18] Modules linked in: ipt_REJECT iptable_filter > xt_set xt_REDIRECT iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 > nf_nat_ipv4 nf_nat > ip_tables ip_set_hash_net ip_set_hash_ip ip_set nfnetlink ip6t_REJECT > nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter > ip6_table > s ipv6 ext3 jbd xen_netfront coretemp hwmon crc32_pclmul crc32c_intel > ghash_clmulni_intel microcode pcspkr ext4 jbd2 mbcache aesni_intel > ablk_helper c > ryptd lrw gf128mul glue_helper aes_x86_64 xen_blkfront dm_mirror > dm_region_hash dm_log dm_mod > [2013-12-26 03:53:18] CPU: 0 PID: 15126 Comm: python Not tainted > 3.10.25-11.x86_64 #1 > [2013-12-26 03:53:18] task: ffff8801e5d68ac0 ti: ffff8801e7392000 > task.ti: ffff8801e7392000 > [2013-12-26 03:53:18] RIP: e030:[] > [] xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] > [2013-12-26 03:53:18] RSP: e02b:ffff8801f2e03ce0 EFLAGS: 00010282 > [2013-12-26 03:53:18] RAX: 00000000000001d4 RBX: ffff8801e5438800 RCX: > 0000000000000001 > [2013-12-26 03:53:18] RDX: 000000000000002a RSI: 0000000000000000 RDI: > 0000000000002200 > [2013-12-26 03:53:18] RBP: ffff8801f2e03d40 R08: 0000000000000000 R09: > 0000000000001000 > [2013-12-26 03:53:18] R10: ffff8801000083c0 R11: dead000000200200 R12: > 0000000000000220 > [2013-12-26 03:53:18] R13: ffff8801e6eec0c0 R14: 000000000000002a R15: > 000000000239642a > [2013-12-26 03:53:18] FS: 00007f4cf48d57e0(0000) > GS:ffff8801f2e00000(0000) knlGS:0000000000000000 > [2013-12-26 03:53:18] CS: e033 DS: 0000 ES: 0000 CR0: 0000000080050033 > [2013-12-26 03:53:18] CR2: ffffffffff600400 CR3: 00000001e0db3000 CR4: > 0000000000042660 > [2013-12-26 03:53:18] DR0: 0000000000000000 DR1: 0000000000000000 DR2: > 0000000000000000 > [2013-12-26 03:53:18] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: > 0000000000000400 > [2013-12-26 03:53:18] Stack: > [2013-12-26 03:53:18] ffff8801f2e03df0 02396417e5438000 > ffff8801e5439d58 ffff8801e54394f0 > [2013-12-26 03:53:18] ffff8801e5438000 002affff00000013 > ffff8801f2e03d40 ffff8801f2e03db0 > [2013-12-26 03:53:18] 0000000000000010 ffff8800655e6ac0 > ffff8801e5438800 ffff8801e511a000 > [2013-12-26 03:53:18] Call Trace: > [2013-12-26 03:53:18] > [2013-12-26 03:53:18] [] xennet_poll+0x2f4/0x630 > [xen_netfront] > [2013-12-26 03:53:18] [] ? raise_softirq_irqoff+0x9/0x50 > [2013-12-26 03:53:18] [] ? dev_kfree_skb_irq+0x5c/0x70 > [2013-12-26 03:53:18] [] ? > handle_irq_event_percpu+0xc9/0x210 > [2013-12-26 03:53:18] [] net_rx_action+0x112/0x290 > [2013-12-26 03:53:18] [] ? handle_irq_event+0x4d/0x70 > [2013-12-26 03:53:18] [] __do_softirq+0xf7/0x270 > [2013-12-26 03:53:18] [] call_softirq+0x1c/0x30 > [2013-12-26 03:53:18] [] do_softirq+0x65/0xa0 > [2013-12-26 03:53:18] [] irq_exit+0xc5/0xd0 > [2013-12-26 03:53:18] [] xen_evtchn_do_upcall+0x35/0x50 > [2013-12-26 03:53:18] [] > xen_do_hypervisor_callback+0x1e/0x30 > [2013-12-26 03:53:18] > [2013-12-26 03:53:18] Code: 8b 35 ee f9 bb e1 48 8d bb 08 0d 00 00 48 83 > c6 64 e8 2e f2 f0 e0 8b 83 ec 0c 00 00 31 d2 89 c1 d1 e9 39 d1 76 9e e9 > 5a ff ff ff <0f> 0b eb fe 0f 0b 0f 1f 00 eb fb 66 66 66 66 66 2e 0f 1f > 84 00 > [2013-12-26 03:53:18] RIP [] > xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] > [2013-12-26 03:53:18] RSP > ------------ > > dom0 and domU kernels are vanilla 3.10.25 > host server has 4 cores x 2 threads with mapping: 4 - dom0, 2 - domU, 2 > - domU > i've tried xen versions: 4.2.3 and 4.3.1 > also i've tried to disable offloaing on domU: ethtool -K eth0 tx off > tso off gso off ---- no effects > > domU's are under high TCP load (a lot of small tcp connections (web server)) > sometimes i've got on dom0: > --- > [2013-12-26 00:16:30] (XEN) grant_table.c:289:d0 Increased maptrack size > to 2 frames > [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference > 99221507 > [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference > 43646979 > [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference > 43646979 > [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference > 99221507 > [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference > 43646979 > [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference > 99221507 > [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference > 99221507 > [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference > 99221507 > > --- > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 26 17:17:14 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 26 Dec 2013 17:17:14 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwEXv-0007Xi-SG; Thu, 26 Dec 2013 17:16:31 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwEXu-0007Xd-Ko for xen-users@lists.xen.org; Thu, 26 Dec 2013 17:16:30 +0000 Received: from [85.158.137.68:38090] by server-16.bemta-3.messagelabs.com id 43/7B-26128-D646CB25; Thu, 26 Dec 2013 17:16:29 +0000 X-Env-Sender: nix@myproxylists.com X-Msg-Ref: server-8.tower-31.messagelabs.com!1388078188!6039279!1 X-Originating-IP: [62.236.108.236] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 3390 invoked from network); 26 Dec 2013 17:16:28 -0000 Received: from gameframe.net (HELO gameframe.net) (62.236.108.236) by server-8.tower-31.messagelabs.com with SMTP; 26 Dec 2013 17:16:28 -0000 Received: (qmail 12957 invoked by uid 0); 26 Dec 2013 17:15:08 -0000 X-Originating-IP: 127.0.0.1 X-Qmail-Scanner-Diagnostics: from 127.0.0.1 (daemon@127.0.0.1) by gameframe.net (envelope-from , uid 98) with qmail-scanner-2.11 (spamassassin: 3.3.2. Clear:RC:1(127.0.0.1):. Processed in 0.025203 secs); 26 Dec 2013 17:15:08 -0000 Received: from unknown (HELO gameframe.net) (daemon@127.0.0.1) by gameframe.net with SMTP; 26 Dec 2013 17:15:07 -0000 Received: from localhost ([127.0.0.1]) (SquirrelMail authenticated user nix@myproxylists.com) by gameframe.net with HTTP; Thu, 26 Dec 2013 19:15:07 +0200 Message-ID: In-Reply-To: <476456808.81135.1388026574503.JavaMail.sas1@[172.29.249.242]> References: <476456808.81135.1388026574503.JavaMail.sas1@[172.29.249.242]> Date: Thu, 26 Dec 2013 19:15:07 +0200 From: "NiX" To: "johnnadre" User-Agent: SquirrelMail/1.4.22 MIME-Version: 1.0 X-Priority: 3 (Normal) Importance: Normal Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] PVHVM example for xen 4.3.1 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > > Hello, > > > I'm looking for an example configuration for a PVHVM domU that works with > 4.3.1. The one at http://wiki.xen.org/wiki/Xen_Linux_PV_on_HVM_drivers > causes 3 warnings and some errors: > > WARNING: ignoring "kernel" directive for HVM guest. Use > "firmware_override" instead if you really want a non-default firmware > WARNING: ignoring device_model directive. > WARNING: Use "device_model_override" instead if you really want a > non-default device_model > xc: info: VIRTUAL MEMORY ARRANGEMENT: > Loader: 0000000000100000->000000000019ed04 > Modules: 0000000000000000->0000000000000000 > TOTAL: 0000000000000000->000000000f800000 > ENTRY ADDRESS: 0000000000100000 > xc: info: PHYSICAL MEMORY ALLOCATION: > 4KB PAGES: 0x0000000000000200 > 2MB PAGES: 0x000000000000007b > 1GB PAGES: 0x0000000000000000 > libxl: error: libxl_dm.c:1275:device_model_spawn_outcome: domain 2 device > model: spawn failed (rc=-3) > libxl: error: libxl_create.c:1075:domcreate_devmodel_started: device model > did not start: -3 > libxl: error: libxl_dm.c:1306:libxl__destroy_device_model: Device Model > already exited > > If I follow the suggestions in the warning messages and specify > firmware_override and device_model_override like so: > > firmware_override = "/usr/lib64/xen/boot/hvmloader" > device_model_override = '/usr/lib64/xen/bin/qemu-dm' > > > it only removes some of the warnings but not the errors: > > WARNING: device model override given without specific DM version > same errors as above > > > Does anybody have a config that works or any idea what's wrong with my > config? > > One more noteworthy thing: > > # cat /var/log/xen/qemu-dm-auth.log > /usr/lib64/xen/bin/qemu-dm: invalid option -- '-xen-domid' > > > My config: > > #kernel = "hvmloader" > #kernel = "/usr/lib64/xen/boot/hvmloader" > firmware_override = "/usr/lib64/xen/boot/hvmloader" > builder = "hvm" > #device_model = 'qemu-dm' > device_model_override = '/usr/lib64/xen/bin/qemu-dm' > name = "auth" > memory = 256 > vcpus=1 > pae=1 > acpi=1 > apic=1 > vif = [ 'mac=00:16:3e:10:20:30, bridge=virbr0, model=e1000' ] > disk = [ '/mnt/iso/grml96-full_2013.09.iso,raw,xvda:cdrom,r' ] > boot="cd" > #root = "/dev/sda1 ro" > xen_platform_pci=1 > on_poweroff = 'destroy' > on_reboot = 'restart' > on_crash = 'restart' > sdl=0 > vnc=1 > vncpasswd='' > stdvga=0 > serial='pty' > keymap='en' > > > - John > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > My examples are for xl toolstack. ----------------------------------------------- A PV guest that use an external kernel ----------------------------------------------- builder="generic" vcpus=4 memory=4096 name="127.0.0.1" kernel="/home/servers/xen/kernels/vmlinuz-2.6.32.61-INTEL-SMP-grsec" #ramdisk="" extra="root=/dev/xvda1 xencons=tty1 earlyprintk=xen" vif = ["ip=127.0.0.1,mac=xx:xx:xx:xx:xx:xx,bridge=br0,rate=100Mb/s"] disk = [ "raw:/xen/images/127.0.0.1.img,ioemu:xvda,w" ] vfb = [ "type=vnc,vnclisten=127.0.0.1,vncdisplay=14,vncpasswd=password" ] serial="pty" boot = "c" sdl=0 monitor=1 localtime=0 xen_platform_pci=1 stdvga=1 videoram=16 gfx_passthru=0 on_poweroff="destroy" on_reboot="restart" on_crash="restart" ----------------------------------------------- A HVM guest ----------------------------------------------- builder="hvm" vcpus=4 memory=4096 name="127.0.0.1" bootloader="pygrub" vif = ["ip=127.0.0.1,mac=xx:xx:xx:xx:xx:xx,bridge=br0,rate=100Mb/s"] disk = [ "raw:/xen/images/127.0.0.1.img,ioemu:xvda,w" ] vfb = [ "type=vnc,vnclisten=127.0.0.1,vncdisplay=14,vncpasswd=password" ] serial="pty" boot = "c" sdl=0 monitor=1 pae=1 acpi=1 apic=1 localtime=0 xen_platform_pci=1 stdvga=1 videoram=16 gfx_passthru=0 on_poweroff="destroy" on_reboot="restart" on_crash="restart" _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 26 17:17:14 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 26 Dec 2013 17:17:14 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwEXv-0007Xi-SG; Thu, 26 Dec 2013 17:16:31 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwEXu-0007Xd-Ko for xen-users@lists.xen.org; Thu, 26 Dec 2013 17:16:30 +0000 Received: from [85.158.137.68:38090] by server-16.bemta-3.messagelabs.com id 43/7B-26128-D646CB25; Thu, 26 Dec 2013 17:16:29 +0000 X-Env-Sender: nix@myproxylists.com X-Msg-Ref: server-8.tower-31.messagelabs.com!1388078188!6039279!1 X-Originating-IP: [62.236.108.236] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 3390 invoked from network); 26 Dec 2013 17:16:28 -0000 Received: from gameframe.net (HELO gameframe.net) (62.236.108.236) by server-8.tower-31.messagelabs.com with SMTP; 26 Dec 2013 17:16:28 -0000 Received: (qmail 12957 invoked by uid 0); 26 Dec 2013 17:15:08 -0000 X-Originating-IP: 127.0.0.1 X-Qmail-Scanner-Diagnostics: from 127.0.0.1 (daemon@127.0.0.1) by gameframe.net (envelope-from , uid 98) with qmail-scanner-2.11 (spamassassin: 3.3.2. Clear:RC:1(127.0.0.1):. Processed in 0.025203 secs); 26 Dec 2013 17:15:08 -0000 Received: from unknown (HELO gameframe.net) (daemon@127.0.0.1) by gameframe.net with SMTP; 26 Dec 2013 17:15:07 -0000 Received: from localhost ([127.0.0.1]) (SquirrelMail authenticated user nix@myproxylists.com) by gameframe.net with HTTP; Thu, 26 Dec 2013 19:15:07 +0200 Message-ID: In-Reply-To: <476456808.81135.1388026574503.JavaMail.sas1@[172.29.249.242]> References: <476456808.81135.1388026574503.JavaMail.sas1@[172.29.249.242]> Date: Thu, 26 Dec 2013 19:15:07 +0200 From: "NiX" To: "johnnadre" User-Agent: SquirrelMail/1.4.22 MIME-Version: 1.0 X-Priority: 3 (Normal) Importance: Normal Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] PVHVM example for xen 4.3.1 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > > Hello, > > > I'm looking for an example configuration for a PVHVM domU that works with > 4.3.1. The one at http://wiki.xen.org/wiki/Xen_Linux_PV_on_HVM_drivers > causes 3 warnings and some errors: > > WARNING: ignoring "kernel" directive for HVM guest. Use > "firmware_override" instead if you really want a non-default firmware > WARNING: ignoring device_model directive. > WARNING: Use "device_model_override" instead if you really want a > non-default device_model > xc: info: VIRTUAL MEMORY ARRANGEMENT: > Loader: 0000000000100000->000000000019ed04 > Modules: 0000000000000000->0000000000000000 > TOTAL: 0000000000000000->000000000f800000 > ENTRY ADDRESS: 0000000000100000 > xc: info: PHYSICAL MEMORY ALLOCATION: > 4KB PAGES: 0x0000000000000200 > 2MB PAGES: 0x000000000000007b > 1GB PAGES: 0x0000000000000000 > libxl: error: libxl_dm.c:1275:device_model_spawn_outcome: domain 2 device > model: spawn failed (rc=-3) > libxl: error: libxl_create.c:1075:domcreate_devmodel_started: device model > did not start: -3 > libxl: error: libxl_dm.c:1306:libxl__destroy_device_model: Device Model > already exited > > If I follow the suggestions in the warning messages and specify > firmware_override and device_model_override like so: > > firmware_override = "/usr/lib64/xen/boot/hvmloader" > device_model_override = '/usr/lib64/xen/bin/qemu-dm' > > > it only removes some of the warnings but not the errors: > > WARNING: device model override given without specific DM version > same errors as above > > > Does anybody have a config that works or any idea what's wrong with my > config? > > One more noteworthy thing: > > # cat /var/log/xen/qemu-dm-auth.log > /usr/lib64/xen/bin/qemu-dm: invalid option -- '-xen-domid' > > > My config: > > #kernel = "hvmloader" > #kernel = "/usr/lib64/xen/boot/hvmloader" > firmware_override = "/usr/lib64/xen/boot/hvmloader" > builder = "hvm" > #device_model = 'qemu-dm' > device_model_override = '/usr/lib64/xen/bin/qemu-dm' > name = "auth" > memory = 256 > vcpus=1 > pae=1 > acpi=1 > apic=1 > vif = [ 'mac=00:16:3e:10:20:30, bridge=virbr0, model=e1000' ] > disk = [ '/mnt/iso/grml96-full_2013.09.iso,raw,xvda:cdrom,r' ] > boot="cd" > #root = "/dev/sda1 ro" > xen_platform_pci=1 > on_poweroff = 'destroy' > on_reboot = 'restart' > on_crash = 'restart' > sdl=0 > vnc=1 > vncpasswd='' > stdvga=0 > serial='pty' > keymap='en' > > > - John > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > My examples are for xl toolstack. ----------------------------------------------- A PV guest that use an external kernel ----------------------------------------------- builder="generic" vcpus=4 memory=4096 name="127.0.0.1" kernel="/home/servers/xen/kernels/vmlinuz-2.6.32.61-INTEL-SMP-grsec" #ramdisk="" extra="root=/dev/xvda1 xencons=tty1 earlyprintk=xen" vif = ["ip=127.0.0.1,mac=xx:xx:xx:xx:xx:xx,bridge=br0,rate=100Mb/s"] disk = [ "raw:/xen/images/127.0.0.1.img,ioemu:xvda,w" ] vfb = [ "type=vnc,vnclisten=127.0.0.1,vncdisplay=14,vncpasswd=password" ] serial="pty" boot = "c" sdl=0 monitor=1 localtime=0 xen_platform_pci=1 stdvga=1 videoram=16 gfx_passthru=0 on_poweroff="destroy" on_reboot="restart" on_crash="restart" ----------------------------------------------- A HVM guest ----------------------------------------------- builder="hvm" vcpus=4 memory=4096 name="127.0.0.1" bootloader="pygrub" vif = ["ip=127.0.0.1,mac=xx:xx:xx:xx:xx:xx,bridge=br0,rate=100Mb/s"] disk = [ "raw:/xen/images/127.0.0.1.img,ioemu:xvda,w" ] vfb = [ "type=vnc,vnclisten=127.0.0.1,vncdisplay=14,vncpasswd=password" ] serial="pty" boot = "c" sdl=0 monitor=1 pae=1 acpi=1 apic=1 localtime=0 xen_platform_pci=1 stdvga=1 videoram=16 gfx_passthru=0 on_poweroff="destroy" on_reboot="restart" on_crash="restart" _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 26 18:48:51 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 26 Dec 2013 18:48:51 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwFyD-0001bo-SF; Thu, 26 Dec 2013 18:47:45 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwFyC-0001bj-Gp for xen-users@lists.xen.org; Thu, 26 Dec 2013 18:47:44 +0000 Received: from [85.158.143.35:42804] by server-2.bemta-4.messagelabs.com id 7C/96-11386-FC97CB25; Thu, 26 Dec 2013 18:47:43 +0000 X-Env-Sender: svpcom@gmail.com X-Msg-Ref: server-16.tower-21.messagelabs.com!1388083627!8265734!1 X-Originating-IP: [209.85.217.182] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23716 invoked from network); 26 Dec 2013 18:47:07 -0000 Received: from mail-lb0-f182.google.com (HELO mail-lb0-f182.google.com) (209.85.217.182) by server-16.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 26 Dec 2013 18:47:07 -0000 Received: by mail-lb0-f182.google.com with SMTP id l4so3907623lbv.13 for ; Thu, 26 Dec 2013 10:47:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=6CtPtQmLOqHcRkZ0c7IrENGrdessHKfejSZTS4GTi2E=; b=zabqgQmEvcesy4Sxl5CWH0tGxtVIlQIbdBRv3T83dAEN6FyTvQY1yCppb68krzY4QN 9TCx9LkVXjg6FB+jQvi5jKimM5VR+LSnit/4hiJrvctR4wq2V8a2x1U4UPxCAmZz9Lhy /epzRL8e068jVPNUVlRr2LCIeAfuXQe8++UW+YsPUAjhpXnM0oRyMPA9jfVDzDGS4TuO 4N76q3oVENjUgaBrPvWO+gxqeq2zk8cqm3NoMn03T2KP+7w1UKKLIUbPDbO6OAptIWHD NAvONOA/d54I6i8VxKNeoyV4rKn1lclYJlJw5zpWxEAAfmqcR0znq7McRkqABmcBW/Na 8iyw== X-Received: by 10.112.181.232 with SMTP id dz8mr18268168lbc.8.1388083626400; Thu, 26 Dec 2013 10:47:06 -0800 (PST) Received: from hzone3.svpcom.msiu.ru ([176.14.233.129]) by mx.google.com with ESMTPSA id t9sm24692556lat.1.2013.12.26.10.47.04 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Thu, 26 Dec 2013 10:47:05 -0800 (PST) Message-ID: <52BC79A7.6020301@gmail.com> Date: Thu, 26 Dec 2013 22:47:03 +0400 From: Vasily Evseenko User-Agent: Mozilla/5.0 (X11; Linux i686; rv:17.0) Gecko/20130110 Thunderbird/17.0.2 MIME-Version: 1.0 To: xen-users@lists.xen.org References: <52BC18A3.4010203@gmail.com> In-Reply-To: X-Enigmail-Version: 1.5 Subject: Re: [Xen-users] domU crash with kernel BUG at drivers/net/xen-netfront.c:305 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This patch http://bugzillafiles.novell.org/attachment.cgi?id=548747 already exists in 3.10.25. So it seems to be another bug. On 12/26/2013 08:31 PM, Vitaliy Tomin wrote: > This bug was fixed in openSUSE kernel bnc#826374. Patch provided in > attachment in Novell bugzilla. > https://bugzilla.novell.com/show_bug.cgi?id=826374 > > On Thu, Dec 26, 2013 at 8:53 PM, Vasily Evseenko wrote: >> Hi, >> >> I've got domU crash (~ every 1-2 days under high load) with message: >> >> ----- >> [2013-12-26 03:53:18] kernel BUG at drivers/net/xen-netfront.c:305! >> [2013-12-26 03:53:18] invalid opcode: 0000 [#1] SMP >> [2013-12-26 03:53:18] Modules linked in: ipt_REJECT iptable_filter >> xt_set xt_REDIRECT iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 >> nf_nat_ipv4 nf_nat >> ip_tables ip_set_hash_net ip_set_hash_ip ip_set nfnetlink ip6t_REJECT >> nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter >> ip6_table >> s ipv6 ext3 jbd xen_netfront coretemp hwmon crc32_pclmul crc32c_intel >> ghash_clmulni_intel microcode pcspkr ext4 jbd2 mbcache aesni_intel >> ablk_helper c >> ryptd lrw gf128mul glue_helper aes_x86_64 xen_blkfront dm_mirror >> dm_region_hash dm_log dm_mod >> [2013-12-26 03:53:18] CPU: 0 PID: 15126 Comm: python Not tainted >> 3.10.25-11.x86_64 #1 >> [2013-12-26 03:53:18] task: ffff8801e5d68ac0 ti: ffff8801e7392000 >> task.ti: ffff8801e7392000 >> [2013-12-26 03:53:18] RIP: e030:[] >> [] xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] >> [2013-12-26 03:53:18] RSP: e02b:ffff8801f2e03ce0 EFLAGS: 00010282 >> [2013-12-26 03:53:18] RAX: 00000000000001d4 RBX: ffff8801e5438800 RCX: >> 0000000000000001 >> [2013-12-26 03:53:18] RDX: 000000000000002a RSI: 0000000000000000 RDI: >> 0000000000002200 >> [2013-12-26 03:53:18] RBP: ffff8801f2e03d40 R08: 0000000000000000 R09: >> 0000000000001000 >> [2013-12-26 03:53:18] R10: ffff8801000083c0 R11: dead000000200200 R12: >> 0000000000000220 >> [2013-12-26 03:53:18] R13: ffff8801e6eec0c0 R14: 000000000000002a R15: >> 000000000239642a >> [2013-12-26 03:53:18] FS: 00007f4cf48d57e0(0000) >> GS:ffff8801f2e00000(0000) knlGS:0000000000000000 >> [2013-12-26 03:53:18] CS: e033 DS: 0000 ES: 0000 CR0: 0000000080050033 >> [2013-12-26 03:53:18] CR2: ffffffffff600400 CR3: 00000001e0db3000 CR4: >> 0000000000042660 >> [2013-12-26 03:53:18] DR0: 0000000000000000 DR1: 0000000000000000 DR2: >> 0000000000000000 >> [2013-12-26 03:53:18] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: >> 0000000000000400 >> [2013-12-26 03:53:18] Stack: >> [2013-12-26 03:53:18] ffff8801f2e03df0 02396417e5438000 >> ffff8801e5439d58 ffff8801e54394f0 >> [2013-12-26 03:53:18] ffff8801e5438000 002affff00000013 >> ffff8801f2e03d40 ffff8801f2e03db0 >> [2013-12-26 03:53:18] 0000000000000010 ffff8800655e6ac0 >> ffff8801e5438800 ffff8801e511a000 >> [2013-12-26 03:53:18] Call Trace: >> [2013-12-26 03:53:18] >> [2013-12-26 03:53:18] [] xennet_poll+0x2f4/0x630 >> [xen_netfront] >> [2013-12-26 03:53:18] [] ? raise_softirq_irqoff+0x9/0x50 >> [2013-12-26 03:53:18] [] ? dev_kfree_skb_irq+0x5c/0x70 >> [2013-12-26 03:53:18] [] ? >> handle_irq_event_percpu+0xc9/0x210 >> [2013-12-26 03:53:18] [] net_rx_action+0x112/0x290 >> [2013-12-26 03:53:18] [] ? handle_irq_event+0x4d/0x70 >> [2013-12-26 03:53:18] [] __do_softirq+0xf7/0x270 >> [2013-12-26 03:53:18] [] call_softirq+0x1c/0x30 >> [2013-12-26 03:53:18] [] do_softirq+0x65/0xa0 >> [2013-12-26 03:53:18] [] irq_exit+0xc5/0xd0 >> [2013-12-26 03:53:18] [] xen_evtchn_do_upcall+0x35/0x50 >> [2013-12-26 03:53:18] [] >> xen_do_hypervisor_callback+0x1e/0x30 >> [2013-12-26 03:53:18] >> [2013-12-26 03:53:18] Code: 8b 35 ee f9 bb e1 48 8d bb 08 0d 00 00 48 83 >> c6 64 e8 2e f2 f0 e0 8b 83 ec 0c 00 00 31 d2 89 c1 d1 e9 39 d1 76 9e e9 >> 5a ff ff ff <0f> 0b eb fe 0f 0b 0f 1f 00 eb fb 66 66 66 66 66 2e 0f 1f >> 84 00 >> [2013-12-26 03:53:18] RIP [] >> xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] >> [2013-12-26 03:53:18] RSP >> ------------ >> >> dom0 and domU kernels are vanilla 3.10.25 >> host server has 4 cores x 2 threads with mapping: 4 - dom0, 2 - domU, 2 >> - domU >> i've tried xen versions: 4.2.3 and 4.3.1 >> also i've tried to disable offloaing on domU: ethtool -K eth0 tx off >> tso off gso off ---- no effects >> >> domU's are under high TCP load (a lot of small tcp connections (web server)) >> sometimes i've got on dom0: >> --- >> [2013-12-26 00:16:30] (XEN) grant_table.c:289:d0 Increased maptrack size >> to 2 frames >> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >> 99221507 >> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >> 43646979 >> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >> 43646979 >> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >> 99221507 >> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >> 43646979 >> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >> 99221507 >> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >> 99221507 >> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >> 99221507 >> >> --- >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xen.org >> http://lists.xen.org/xen-users > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 26 18:48:51 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 26 Dec 2013 18:48:51 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwFyD-0001bo-SF; Thu, 26 Dec 2013 18:47:45 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwFyC-0001bj-Gp for xen-users@lists.xen.org; Thu, 26 Dec 2013 18:47:44 +0000 Received: from [85.158.143.35:42804] by server-2.bemta-4.messagelabs.com id 7C/96-11386-FC97CB25; Thu, 26 Dec 2013 18:47:43 +0000 X-Env-Sender: svpcom@gmail.com X-Msg-Ref: server-16.tower-21.messagelabs.com!1388083627!8265734!1 X-Originating-IP: [209.85.217.182] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23716 invoked from network); 26 Dec 2013 18:47:07 -0000 Received: from mail-lb0-f182.google.com (HELO mail-lb0-f182.google.com) (209.85.217.182) by server-16.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 26 Dec 2013 18:47:07 -0000 Received: by mail-lb0-f182.google.com with SMTP id l4so3907623lbv.13 for ; Thu, 26 Dec 2013 10:47:06 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=6CtPtQmLOqHcRkZ0c7IrENGrdessHKfejSZTS4GTi2E=; b=zabqgQmEvcesy4Sxl5CWH0tGxtVIlQIbdBRv3T83dAEN6FyTvQY1yCppb68krzY4QN 9TCx9LkVXjg6FB+jQvi5jKimM5VR+LSnit/4hiJrvctR4wq2V8a2x1U4UPxCAmZz9Lhy /epzRL8e068jVPNUVlRr2LCIeAfuXQe8++UW+YsPUAjhpXnM0oRyMPA9jfVDzDGS4TuO 4N76q3oVENjUgaBrPvWO+gxqeq2zk8cqm3NoMn03T2KP+7w1UKKLIUbPDbO6OAptIWHD NAvONOA/d54I6i8VxKNeoyV4rKn1lclYJlJw5zpWxEAAfmqcR0znq7McRkqABmcBW/Na 8iyw== X-Received: by 10.112.181.232 with SMTP id dz8mr18268168lbc.8.1388083626400; Thu, 26 Dec 2013 10:47:06 -0800 (PST) Received: from hzone3.svpcom.msiu.ru ([176.14.233.129]) by mx.google.com with ESMTPSA id t9sm24692556lat.1.2013.12.26.10.47.04 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Thu, 26 Dec 2013 10:47:05 -0800 (PST) Message-ID: <52BC79A7.6020301@gmail.com> Date: Thu, 26 Dec 2013 22:47:03 +0400 From: Vasily Evseenko User-Agent: Mozilla/5.0 (X11; Linux i686; rv:17.0) Gecko/20130110 Thunderbird/17.0.2 MIME-Version: 1.0 To: xen-users@lists.xen.org References: <52BC18A3.4010203@gmail.com> In-Reply-To: X-Enigmail-Version: 1.5 Subject: Re: [Xen-users] domU crash with kernel BUG at drivers/net/xen-netfront.c:305 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org This patch http://bugzillafiles.novell.org/attachment.cgi?id=548747 already exists in 3.10.25. So it seems to be another bug. On 12/26/2013 08:31 PM, Vitaliy Tomin wrote: > This bug was fixed in openSUSE kernel bnc#826374. Patch provided in > attachment in Novell bugzilla. > https://bugzilla.novell.com/show_bug.cgi?id=826374 > > On Thu, Dec 26, 2013 at 8:53 PM, Vasily Evseenko wrote: >> Hi, >> >> I've got domU crash (~ every 1-2 days under high load) with message: >> >> ----- >> [2013-12-26 03:53:18] kernel BUG at drivers/net/xen-netfront.c:305! >> [2013-12-26 03:53:18] invalid opcode: 0000 [#1] SMP >> [2013-12-26 03:53:18] Modules linked in: ipt_REJECT iptable_filter >> xt_set xt_REDIRECT iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 >> nf_nat_ipv4 nf_nat >> ip_tables ip_set_hash_net ip_set_hash_ip ip_set nfnetlink ip6t_REJECT >> nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter >> ip6_table >> s ipv6 ext3 jbd xen_netfront coretemp hwmon crc32_pclmul crc32c_intel >> ghash_clmulni_intel microcode pcspkr ext4 jbd2 mbcache aesni_intel >> ablk_helper c >> ryptd lrw gf128mul glue_helper aes_x86_64 xen_blkfront dm_mirror >> dm_region_hash dm_log dm_mod >> [2013-12-26 03:53:18] CPU: 0 PID: 15126 Comm: python Not tainted >> 3.10.25-11.x86_64 #1 >> [2013-12-26 03:53:18] task: ffff8801e5d68ac0 ti: ffff8801e7392000 >> task.ti: ffff8801e7392000 >> [2013-12-26 03:53:18] RIP: e030:[] >> [] xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] >> [2013-12-26 03:53:18] RSP: e02b:ffff8801f2e03ce0 EFLAGS: 00010282 >> [2013-12-26 03:53:18] RAX: 00000000000001d4 RBX: ffff8801e5438800 RCX: >> 0000000000000001 >> [2013-12-26 03:53:18] RDX: 000000000000002a RSI: 0000000000000000 RDI: >> 0000000000002200 >> [2013-12-26 03:53:18] RBP: ffff8801f2e03d40 R08: 0000000000000000 R09: >> 0000000000001000 >> [2013-12-26 03:53:18] R10: ffff8801000083c0 R11: dead000000200200 R12: >> 0000000000000220 >> [2013-12-26 03:53:18] R13: ffff8801e6eec0c0 R14: 000000000000002a R15: >> 000000000239642a >> [2013-12-26 03:53:18] FS: 00007f4cf48d57e0(0000) >> GS:ffff8801f2e00000(0000) knlGS:0000000000000000 >> [2013-12-26 03:53:18] CS: e033 DS: 0000 ES: 0000 CR0: 0000000080050033 >> [2013-12-26 03:53:18] CR2: ffffffffff600400 CR3: 00000001e0db3000 CR4: >> 0000000000042660 >> [2013-12-26 03:53:18] DR0: 0000000000000000 DR1: 0000000000000000 DR2: >> 0000000000000000 >> [2013-12-26 03:53:18] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: >> 0000000000000400 >> [2013-12-26 03:53:18] Stack: >> [2013-12-26 03:53:18] ffff8801f2e03df0 02396417e5438000 >> ffff8801e5439d58 ffff8801e54394f0 >> [2013-12-26 03:53:18] ffff8801e5438000 002affff00000013 >> ffff8801f2e03d40 ffff8801f2e03db0 >> [2013-12-26 03:53:18] 0000000000000010 ffff8800655e6ac0 >> ffff8801e5438800 ffff8801e511a000 >> [2013-12-26 03:53:18] Call Trace: >> [2013-12-26 03:53:18] >> [2013-12-26 03:53:18] [] xennet_poll+0x2f4/0x630 >> [xen_netfront] >> [2013-12-26 03:53:18] [] ? raise_softirq_irqoff+0x9/0x50 >> [2013-12-26 03:53:18] [] ? dev_kfree_skb_irq+0x5c/0x70 >> [2013-12-26 03:53:18] [] ? >> handle_irq_event_percpu+0xc9/0x210 >> [2013-12-26 03:53:18] [] net_rx_action+0x112/0x290 >> [2013-12-26 03:53:18] [] ? handle_irq_event+0x4d/0x70 >> [2013-12-26 03:53:18] [] __do_softirq+0xf7/0x270 >> [2013-12-26 03:53:18] [] call_softirq+0x1c/0x30 >> [2013-12-26 03:53:18] [] do_softirq+0x65/0xa0 >> [2013-12-26 03:53:18] [] irq_exit+0xc5/0xd0 >> [2013-12-26 03:53:18] [] xen_evtchn_do_upcall+0x35/0x50 >> [2013-12-26 03:53:18] [] >> xen_do_hypervisor_callback+0x1e/0x30 >> [2013-12-26 03:53:18] >> [2013-12-26 03:53:18] Code: 8b 35 ee f9 bb e1 48 8d bb 08 0d 00 00 48 83 >> c6 64 e8 2e f2 f0 e0 8b 83 ec 0c 00 00 31 d2 89 c1 d1 e9 39 d1 76 9e e9 >> 5a ff ff ff <0f> 0b eb fe 0f 0b 0f 1f 00 eb fb 66 66 66 66 66 2e 0f 1f >> 84 00 >> [2013-12-26 03:53:18] RIP [] >> xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] >> [2013-12-26 03:53:18] RSP >> ------------ >> >> dom0 and domU kernels are vanilla 3.10.25 >> host server has 4 cores x 2 threads with mapping: 4 - dom0, 2 - domU, 2 >> - domU >> i've tried xen versions: 4.2.3 and 4.3.1 >> also i've tried to disable offloaing on domU: ethtool -K eth0 tx off >> tso off gso off ---- no effects >> >> domU's are under high TCP load (a lot of small tcp connections (web server)) >> sometimes i've got on dom0: >> --- >> [2013-12-26 00:16:30] (XEN) grant_table.c:289:d0 Increased maptrack size >> to 2 frames >> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >> 99221507 >> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >> 43646979 >> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >> 43646979 >> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >> 99221507 >> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >> 43646979 >> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >> 99221507 >> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >> 99221507 >> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >> 99221507 >> >> --- >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xen.org >> http://lists.xen.org/xen-users > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 26 21:49:34 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 26 Dec 2013 21:49:34 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwIn7-0006ff-CI; Thu, 26 Dec 2013 21:48:29 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwIn5-0006fa-Rz for xen-users@lists.xen.org; Thu, 26 Dec 2013 21:48:27 +0000 Received: from [193.109.254.147:3033] by server-6.bemta-14.messagelabs.com id 31/CA-14958-A24ACB25; Thu, 26 Dec 2013 21:48:26 +0000 X-Env-Sender: johnnadre@zoho.com X-Msg-Ref: server-13.tower-27.messagelabs.com!1388094505!5308928!1 X-Originating-IP: [72.5.230.95] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNzIuNS4yMzAuOTUgPT4gNjM2NTg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11388 invoked from network); 26 Dec 2013 21:48:26 -0000 Received: from sender1.zohomail.com (HELO sender1.zohomail.com) (72.5.230.95) by server-13.tower-27.messagelabs.com with SMTP; 26 Dec 2013 21:48:26 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=zapps768; d=zoho.com; h=date:from:to:cc:message-id:in-reply-to:references:subject:mime-version:content-type:user-agent; b=IvH4KzjTapsm0xYqWVOl+dn2jBYG0kGqd/aTssjOQOs0K7MZNn0r+KlAWFUGgRH+t9MW9z1o6ryk EYTgSpgf8vM1jDjfCAzPhD4ul6qcu4+2lSZTC2DiZXdXlqA9ho09 Received: from mail.zoho.com by mx.zohomail.com with SMTP id 1388094504836790.2465067911888; Thu, 26 Dec 2013 13:48:24 -0800 (PST) Received: from [93.220.123.176] by mail.zoho.com with HTTP;Thu, 26 Dec 2013 13:48:24 -0800 (PST) Date: Thu, 26 Dec 2013 13:48:24 -0800 From: johnnadre To: "NiX" Message-ID: <659792181.66548.1388094504789.JavaMail.sas1@[172.29.249.242]> In-Reply-To: References: <476456808.81135.1388026574503.JavaMail.sas1@[172.29.249.242]> MIME-Version: 1.0 X-Priority: Normal User-Agent: Zoho Mail X-Mailer: Zoho Mail Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] PVHVM example for xen 4.3.1 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hello NiX, ---- On Thu, 26 Dec 2013 09:15:07 -0800 NiX wrote ---- > >My examples are for xl toolstack. thank you for your examples. However, I was looking for a PVHVM example, not PV or HVM alone. Regards, john _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Thu Dec 26 21:49:34 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Thu, 26 Dec 2013 21:49:34 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwIn7-0006ff-CI; Thu, 26 Dec 2013 21:48:29 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwIn5-0006fa-Rz for xen-users@lists.xen.org; Thu, 26 Dec 2013 21:48:27 +0000 Received: from [193.109.254.147:3033] by server-6.bemta-14.messagelabs.com id 31/CA-14958-A24ACB25; Thu, 26 Dec 2013 21:48:26 +0000 X-Env-Sender: johnnadre@zoho.com X-Msg-Ref: server-13.tower-27.messagelabs.com!1388094505!5308928!1 X-Originating-IP: [72.5.230.95] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNzIuNS4yMzAuOTUgPT4gNjM2NTg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 11388 invoked from network); 26 Dec 2013 21:48:26 -0000 Received: from sender1.zohomail.com (HELO sender1.zohomail.com) (72.5.230.95) by server-13.tower-27.messagelabs.com with SMTP; 26 Dec 2013 21:48:26 -0000 DomainKey-Signature: a=rsa-sha1; q=dns; c=nofws; s=zapps768; d=zoho.com; h=date:from:to:cc:message-id:in-reply-to:references:subject:mime-version:content-type:user-agent; b=IvH4KzjTapsm0xYqWVOl+dn2jBYG0kGqd/aTssjOQOs0K7MZNn0r+KlAWFUGgRH+t9MW9z1o6ryk EYTgSpgf8vM1jDjfCAzPhD4ul6qcu4+2lSZTC2DiZXdXlqA9ho09 Received: from mail.zoho.com by mx.zohomail.com with SMTP id 1388094504836790.2465067911888; Thu, 26 Dec 2013 13:48:24 -0800 (PST) Received: from [93.220.123.176] by mail.zoho.com with HTTP;Thu, 26 Dec 2013 13:48:24 -0800 (PST) Date: Thu, 26 Dec 2013 13:48:24 -0800 From: johnnadre To: "NiX" Message-ID: <659792181.66548.1388094504789.JavaMail.sas1@[172.29.249.242]> In-Reply-To: References: <476456808.81135.1388026574503.JavaMail.sas1@[172.29.249.242]> MIME-Version: 1.0 X-Priority: Normal User-Agent: Zoho Mail X-Mailer: Zoho Mail Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] PVHVM example for xen 4.3.1 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hello NiX, ---- On Thu, 26 Dec 2013 09:15:07 -0800 NiX wrote ---- > >My examples are for xl toolstack. thank you for your examples. However, I was looking for a PVHVM example, not PV or HVM alone. Regards, john _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 00:47:48 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 00:47:48 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwLZh-00038B-J4; Fri, 27 Dec 2013 00:46:49 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwLZg-000386-8f for xen-users@lists.xen.org; Fri, 27 Dec 2013 00:46:48 +0000 Received: from [85.158.137.68:2937] by server-12.bemta-3.messagelabs.com id 6B/B0-20055-7FDCCB25; Fri, 27 Dec 2013 00:46:47 +0000 X-Env-Sender: etzion@barnoy.co.il X-Msg-Ref: server-14.tower-31.messagelabs.com!1388105204!6068628!1 X-Originating-IP: [209.85.160.53] X-SpamReason: No, hits=1.2 required=7.0 tests=HTML_10_20,HTML_MESSAGE, RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 9719 invoked from network); 27 Dec 2013 00:46:45 -0000 Received: from mail-pb0-f53.google.com (HELO mail-pb0-f53.google.com) (209.85.160.53) by server-14.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 00:46:45 -0000 Received: by mail-pb0-f53.google.com with SMTP id ma3so8672397pbc.12 for ; Thu, 26 Dec 2013 16:46:43 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to :content-type; bh=IvoMC+hUzQ03papmd8xFIWNTAVg22w/cCmgpCmVISh8=; b=D6rlV56cuVFHzOYl/ClZ3f7x5MCIP14NUtw6wZGlRxuMSLYukg/d8D0z/ukXfikXBx 9qTdPNlwRAQxEHTLCKE4ZB6WmJXqG+10KTOvUXMTFxtfCrnC5xi/IvApJWahxgVMf6OO grUk31VRYVpEAZTsPf1F1a70JgKnpojWgZ3iBfJwG05+sCC76/BBnqrsa8ynaKG6HhvC 3G0k3PJQeonBGnfPpb5Jwh065TalWO/LDYzJMxRIR4woB2SDN0dVPjci4I74Y/BS1bn9 efBlzwFYfwMUOV6dId5TR3KtOBCxm2PL98AsTBsuhFl5gd5vSX8zWgfUnKG/7GzhiWPd KVQQ== X-Gm-Message-State: ALoCoQkR8mDrZjmP/rNmwx7va1A3nvgCkR0JCArbncZ93vtgfwO/e5mK0PmghXbVn1/RWV8NFVy1 MIME-Version: 1.0 X-Received: by 10.66.142.233 with SMTP id rz9mr47613166pab.71.1388105203617; Thu, 26 Dec 2013 16:46:43 -0800 (PST) Received: by 10.66.147.166 with HTTP; Thu, 26 Dec 2013 16:46:43 -0800 (PST) X-Originating-IP: [85.64.44.246] Date: Fri, 27 Dec 2013 02:46:43 +0200 Message-ID: From: Etzion Bar-Noy To: xen-users@lists.xen.org Subject: [Xen-users] Space on XenServer root disk X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6298555832229931921==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6298555832229931921== Content-Type: multipart/alternative; boundary=001a1134480892abfe04ee796d04 --001a1134480892abfe04ee796d04 Content-Type: text/plain; charset=ISO-8859-1 Hi. Following a very long and many installations of XenServer, I have come to an understanding that the size of the root partition is just too smal. While 4GB is enough (barely) to maintain the local thin setup, the disk becomes crowded with more updates (which are not cleaned-up by default) applied, and with various additions (example: network problem which causes the system to fill up the logs, causing disk alerts at 97%). While I can do very little for the already-existing setups (and I am working (low-priority) on some solutions, such log filtering and sending to a modern (graylog2 or LogStash) log cruncher), I can do two things - the first is to state this problem and voice my problems, which are funny on a multi-tenths-of-gigas systems, and the other is to offer a workaroud for all of you who would install their *next* XenServer, and feel that you just need a little more space to begin with. This process (which is not very complex, it's just that I have documented it) has been performed and tested today by me, and is posted here for your viewing pleasure. I can only hope it helps someone out there. http://run.tournament.org.il/xenserver-and-its-damn-too-small-system-disks/ Etzion --001a1134480892abfe04ee796d04 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi.
Following a very long and many inst= allations of XenServer, I have come to an understanding that the size of th= e root partition is just too smal. While 4GB is enough (barely) to maintain= the local thin setup, the disk becomes crowded with more updates (which ar= e not cleaned-up by default) applied, and with various additions (example: = network problem which causes the system to fill up the logs, causing disk a= lerts at 97%). While I can do very little for the already-existing setups (= and I am working (low-priority) on some solutions, such log filtering and s= ending to a modern (graylog2 or LogStash) log cruncher), I can do two thing= s - the first is to state this problem and voice my problems, which are fun= ny on a multi-tenths-of-gigas systems, and the other is to offer a workarou= d for all of you who would install their *next* XenServer, and feel that yo= u just need a little more space to begin with. This process (which is not v= ery complex, it's just that I have documented it) has been performed an= d tested today by me, and is posted here for your viewing pleasure. I can o= nly hope it helps someone out there.
Etzion

--001a1134480892abfe04ee796d04-- --===============6298555832229931921== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6298555832229931921==-- From xen-users-bounces@lists.xen.org Fri Dec 27 00:47:48 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 00:47:48 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwLZh-00038B-J4; Fri, 27 Dec 2013 00:46:49 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwLZg-000386-8f for xen-users@lists.xen.org; Fri, 27 Dec 2013 00:46:48 +0000 Received: from [85.158.137.68:2937] by server-12.bemta-3.messagelabs.com id 6B/B0-20055-7FDCCB25; Fri, 27 Dec 2013 00:46:47 +0000 X-Env-Sender: etzion@barnoy.co.il X-Msg-Ref: server-14.tower-31.messagelabs.com!1388105204!6068628!1 X-Originating-IP: [209.85.160.53] X-SpamReason: No, hits=1.2 required=7.0 tests=HTML_10_20,HTML_MESSAGE, RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 9719 invoked from network); 27 Dec 2013 00:46:45 -0000 Received: from mail-pb0-f53.google.com (HELO mail-pb0-f53.google.com) (209.85.160.53) by server-14.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 00:46:45 -0000 Received: by mail-pb0-f53.google.com with SMTP id ma3so8672397pbc.12 for ; Thu, 26 Dec 2013 16:46:43 -0800 (PST) X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20130820; h=x-gm-message-state:mime-version:date:message-id:subject:from:to :content-type; bh=IvoMC+hUzQ03papmd8xFIWNTAVg22w/cCmgpCmVISh8=; b=D6rlV56cuVFHzOYl/ClZ3f7x5MCIP14NUtw6wZGlRxuMSLYukg/d8D0z/ukXfikXBx 9qTdPNlwRAQxEHTLCKE4ZB6WmJXqG+10KTOvUXMTFxtfCrnC5xi/IvApJWahxgVMf6OO grUk31VRYVpEAZTsPf1F1a70JgKnpojWgZ3iBfJwG05+sCC76/BBnqrsa8ynaKG6HhvC 3G0k3PJQeonBGnfPpb5Jwh065TalWO/LDYzJMxRIR4woB2SDN0dVPjci4I74Y/BS1bn9 efBlzwFYfwMUOV6dId5TR3KtOBCxm2PL98AsTBsuhFl5gd5vSX8zWgfUnKG/7GzhiWPd KVQQ== X-Gm-Message-State: ALoCoQkR8mDrZjmP/rNmwx7va1A3nvgCkR0JCArbncZ93vtgfwO/e5mK0PmghXbVn1/RWV8NFVy1 MIME-Version: 1.0 X-Received: by 10.66.142.233 with SMTP id rz9mr47613166pab.71.1388105203617; Thu, 26 Dec 2013 16:46:43 -0800 (PST) Received: by 10.66.147.166 with HTTP; Thu, 26 Dec 2013 16:46:43 -0800 (PST) X-Originating-IP: [85.64.44.246] Date: Fri, 27 Dec 2013 02:46:43 +0200 Message-ID: From: Etzion Bar-Noy To: xen-users@lists.xen.org Subject: [Xen-users] Space on XenServer root disk X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============6298555832229931921==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============6298555832229931921== Content-Type: multipart/alternative; boundary=001a1134480892abfe04ee796d04 --001a1134480892abfe04ee796d04 Content-Type: text/plain; charset=ISO-8859-1 Hi. Following a very long and many installations of XenServer, I have come to an understanding that the size of the root partition is just too smal. While 4GB is enough (barely) to maintain the local thin setup, the disk becomes crowded with more updates (which are not cleaned-up by default) applied, and with various additions (example: network problem which causes the system to fill up the logs, causing disk alerts at 97%). While I can do very little for the already-existing setups (and I am working (low-priority) on some solutions, such log filtering and sending to a modern (graylog2 or LogStash) log cruncher), I can do two things - the first is to state this problem and voice my problems, which are funny on a multi-tenths-of-gigas systems, and the other is to offer a workaroud for all of you who would install their *next* XenServer, and feel that you just need a little more space to begin with. This process (which is not very complex, it's just that I have documented it) has been performed and tested today by me, and is posted here for your viewing pleasure. I can only hope it helps someone out there. http://run.tournament.org.il/xenserver-and-its-damn-too-small-system-disks/ Etzion --001a1134480892abfe04ee796d04 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi.
Following a very long and many inst= allations of XenServer, I have come to an understanding that the size of th= e root partition is just too smal. While 4GB is enough (barely) to maintain= the local thin setup, the disk becomes crowded with more updates (which ar= e not cleaned-up by default) applied, and with various additions (example: = network problem which causes the system to fill up the logs, causing disk a= lerts at 97%). While I can do very little for the already-existing setups (= and I am working (low-priority) on some solutions, such log filtering and s= ending to a modern (graylog2 or LogStash) log cruncher), I can do two thing= s - the first is to state this problem and voice my problems, which are fun= ny on a multi-tenths-of-gigas systems, and the other is to offer a workarou= d for all of you who would install their *next* XenServer, and feel that yo= u just need a little more space to begin with. This process (which is not v= ery complex, it's just that I have documented it) has been performed an= d tested today by me, and is posted here for your viewing pleasure. I can o= nly hope it helps someone out there.
Etzion

--001a1134480892abfe04ee796d04-- --===============6298555832229931921== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============6298555832229931921==-- From xen-users-bounces@lists.xen.org Fri Dec 27 09:43:26 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 09:43:26 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwTvi-00054G-Ll; Fri, 27 Dec 2013 09:42:06 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwTvh-00054B-8I for xen-users@lists.xensource.com; Fri, 27 Dec 2013 09:42:05 +0000 Received: from [193.109.254.147:13920] by server-11.bemta-14.messagelabs.com id 3F/A3-20576-C6B4DB25; Fri, 27 Dec 2013 09:42:04 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-3.tower-27.messagelabs.com!1388137322!7678188!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 27917 invoked from network); 27 Dec 2013 09:42:03 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-3.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 09:42:03 -0000 X-IronPort-AV: E=Sophos;i="4.95,559,1384300800"; d="scan'208";a="85805507" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 27 Dec 2013 09:41:03 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Fri, 27 Dec 2013 04:41:02 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VwTug-0005yk-Oa; Fri, 27 Dec 2013 09:41:02 +0000 Date: Fri, 27 Dec 2013 09:41:02 +0000 From: Wei Liu To: James Harper Message-ID: <20131227094102.GM25969@zion.uk.xensource.com> References: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> <1387529739347-5720484.post@n5.nabble.com> <6035A0D088A63A46850C3988ED045A4B66CD8E75@BITCOM1.int.sbss.com.au> <52B44371.5040700@tiscali.it> <6035A0D088A63A46850C3988ED045A4B66CD9BB7@BITCOM1.int.sbss.com.au> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <6035A0D088A63A46850C3988ED045A4B66CD9BB7@BITCOM1.int.sbss.com.au> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA2 Cc: wei.liu2@citrix.com, "xen-users@lists.xensource.com" , "fantonifabio@tiscali.it" Subject: Re: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Fri, Dec 20, 2013 at 10:26:46PM +0000, James Harper wrote: > > > > If your problem is only about rbd support there is a bug open on debian > > about it: > > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=689239 > > I not tested it for now but with fast watch on bugtracker seems there > > was a regression with build and the qemu maintainer removed the rbd > > support, if with your tested you saw that regression is solved can be > > useful reply about this. > > > > I just turned off build of qemu-user (failed to link rbd static) and I now have a qemu that should work with rbd. But xen doesn't seem to allow me to select rbd. How should I express a rbd configuration in disk= ? Or do I now need to rebuild xen with rbd support? > A quicker way to avoid fiddling with xl config parser is to use device_model_args in your config file to attach arbitrary arguments to QEMU. Wei. > Thanks > > James > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 09:43:26 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 09:43:26 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwTvi-00054G-Ll; Fri, 27 Dec 2013 09:42:06 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwTvh-00054B-8I for xen-users@lists.xensource.com; Fri, 27 Dec 2013 09:42:05 +0000 Received: from [193.109.254.147:13920] by server-11.bemta-14.messagelabs.com id 3F/A3-20576-C6B4DB25; Fri, 27 Dec 2013 09:42:04 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-3.tower-27.messagelabs.com!1388137322!7678188!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 27917 invoked from network); 27 Dec 2013 09:42:03 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-3.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 09:42:03 -0000 X-IronPort-AV: E=Sophos;i="4.95,559,1384300800"; d="scan'208";a="85805507" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 27 Dec 2013 09:41:03 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Fri, 27 Dec 2013 04:41:02 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VwTug-0005yk-Oa; Fri, 27 Dec 2013 09:41:02 +0000 Date: Fri, 27 Dec 2013 09:41:02 +0000 From: Wei Liu To: James Harper Message-ID: <20131227094102.GM25969@zion.uk.xensource.com> References: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> <1387529739347-5720484.post@n5.nabble.com> <6035A0D088A63A46850C3988ED045A4B66CD8E75@BITCOM1.int.sbss.com.au> <52B44371.5040700@tiscali.it> <6035A0D088A63A46850C3988ED045A4B66CD9BB7@BITCOM1.int.sbss.com.au> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <6035A0D088A63A46850C3988ED045A4B66CD9BB7@BITCOM1.int.sbss.com.au> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA2 Cc: wei.liu2@citrix.com, "xen-users@lists.xensource.com" , "fantonifabio@tiscali.it" Subject: Re: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Fri, Dec 20, 2013 at 10:26:46PM +0000, James Harper wrote: > > > > If your problem is only about rbd support there is a bug open on debian > > about it: > > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=689239 > > I not tested it for now but with fast watch on bugtracker seems there > > was a regression with build and the qemu maintainer removed the rbd > > support, if with your tested you saw that regression is solved can be > > useful reply about this. > > > > I just turned off build of qemu-user (failed to link rbd static) and I now have a qemu that should work with rbd. But xen doesn't seem to allow me to select rbd. How should I express a rbd configuration in disk= ? Or do I now need to rebuild xen with rbd support? > A quicker way to avoid fiddling with xl config parser is to use device_model_args in your config file to attach arbitrary arguments to QEMU. Wei. > Thanks > > James > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 09:52:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 09:52:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwU5w-0005Wb-6y; Fri, 27 Dec 2013 09:52:40 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwU5u-0005WU-Tw for xen-users@lists.xen.org; Fri, 27 Dec 2013 09:52:39 +0000 Received: from [193.109.254.147:38102] by server-3.bemta-14.messagelabs.com id 1B/FE-11000-6ED4DB25; Fri, 27 Dec 2013 09:52:38 +0000 X-Env-Sender: svpcom@gmail.com X-Msg-Ref: server-10.tower-27.messagelabs.com!1388137956!7684456!1 X-Originating-IP: [209.85.215.41] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 13679 invoked from network); 27 Dec 2013 09:52:37 -0000 Received: from mail-la0-f41.google.com (HELO mail-la0-f41.google.com) (209.85.215.41) by server-10.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 09:52:37 -0000 Received: by mail-la0-f41.google.com with SMTP id eo20so4256052lab.0 for ; Fri, 27 Dec 2013 01:52:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=PLNoIZiqsHTxrOEU18tXt+EY2FcbAOYocuuN80+IM6Q=; b=SX9I8z4Isg8YWt8LA/53ei8GA1vNb/0FdWmg5NEqU3f+Ulfmjc0QLGxJr6vGvw9f3v stjVgyJ3BML6s5Z2kwo5QmtDrpwN5g1W8B4kO/Wm2LG+xePRFL/LuHltA0zH3LXbhlD/ 2wbuHFeqYq1eoS7vL7qC+CeoByylvhVJpSEXb663G4kI4pDxnW7wdet1TDubT3FrRLOq L8kQZ3nhlb798Ss6gWCc3VYvuSzcu829OEIESjvaWtB4b4yyDxlktmYGxiBzsdsL6GI4 IzzGHiiCUpAyeho5xNVlAIii64imX9nepQCLWP6BgxZxubVw42fqyozzkX4O2wtbVjCg NNdw== X-Received: by 10.152.2.5 with SMTP id 5mr20505369laq.21.1388137956056; Fri, 27 Dec 2013 01:52:36 -0800 (PST) Received: from hzone3.svpcom.msiu.ru ([176.14.233.129]) by mx.google.com with ESMTPSA id ox6sm20673959lbb.6.2013.12.27.01.52.34 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Fri, 27 Dec 2013 01:52:35 -0800 (PST) Message-ID: <52BD4DE1.4030609@gmail.com> Date: Fri, 27 Dec 2013 13:52:33 +0400 From: Vasily Evseenko User-Agent: Mozilla/5.0 (X11; Linux i686; rv:17.0) Gecko/20130110 Thunderbird/17.0.2 MIME-Version: 1.0 To: xen-users@lists.xen.org References: <52BC18A3.4010203@gmail.com> <52BC79A7.6020301@gmail.com> In-Reply-To: <52BC79A7.6020301@gmail.com> X-Enigmail-Version: 1.5 Subject: Re: [Xen-users] domU crash with kernel BUG at drivers/net/xen-netfront.c:305 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org It seems this domU bug related to following dom0 messages: --- [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 43646979 [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 43646979 [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 43646979 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 ---- What does it mean? Some HW problems or internal kernel structures overflow? On 12/26/2013 10:47 PM, Vasily Evseenko wrote: > This patch > http://bugzillafiles.novell.org/attachment.cgi?id=548747 > already exists in 3.10.25. So it seems to be another bug. > > On 12/26/2013 08:31 PM, Vitaliy Tomin wrote: >> This bug was fixed in openSUSE kernel bnc#826374. Patch provided in >> attachment in Novell bugzilla. >> https://bugzilla.novell.com/show_bug.cgi?id=826374 >> >> On Thu, Dec 26, 2013 at 8:53 PM, Vasily Evseenko wrote: >>> Hi, >>> >>> I've got domU crash (~ every 1-2 days under high load) with message: >>> >>> ----- >>> [2013-12-26 03:53:18] kernel BUG at drivers/net/xen-netfront.c:305! >>> [2013-12-26 03:53:18] invalid opcode: 0000 [#1] SMP >>> [2013-12-26 03:53:18] Modules linked in: ipt_REJECT iptable_filter >>> xt_set xt_REDIRECT iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 >>> nf_nat_ipv4 nf_nat >>> ip_tables ip_set_hash_net ip_set_hash_ip ip_set nfnetlink ip6t_REJECT >>> nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter >>> ip6_table >>> s ipv6 ext3 jbd xen_netfront coretemp hwmon crc32_pclmul crc32c_intel >>> ghash_clmulni_intel microcode pcspkr ext4 jbd2 mbcache aesni_intel >>> ablk_helper c >>> ryptd lrw gf128mul glue_helper aes_x86_64 xen_blkfront dm_mirror >>> dm_region_hash dm_log dm_mod >>> [2013-12-26 03:53:18] CPU: 0 PID: 15126 Comm: python Not tainted >>> 3.10.25-11.x86_64 #1 >>> [2013-12-26 03:53:18] task: ffff8801e5d68ac0 ti: ffff8801e7392000 >>> task.ti: ffff8801e7392000 >>> [2013-12-26 03:53:18] RIP: e030:[] >>> [] xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] >>> [2013-12-26 03:53:18] RSP: e02b:ffff8801f2e03ce0 EFLAGS: 00010282 >>> [2013-12-26 03:53:18] RAX: 00000000000001d4 RBX: ffff8801e5438800 RCX: >>> 0000000000000001 >>> [2013-12-26 03:53:18] RDX: 000000000000002a RSI: 0000000000000000 RDI: >>> 0000000000002200 >>> [2013-12-26 03:53:18] RBP: ffff8801f2e03d40 R08: 0000000000000000 R09: >>> 0000000000001000 >>> [2013-12-26 03:53:18] R10: ffff8801000083c0 R11: dead000000200200 R12: >>> 0000000000000220 >>> [2013-12-26 03:53:18] R13: ffff8801e6eec0c0 R14: 000000000000002a R15: >>> 000000000239642a >>> [2013-12-26 03:53:18] FS: 00007f4cf48d57e0(0000) >>> GS:ffff8801f2e00000(0000) knlGS:0000000000000000 >>> [2013-12-26 03:53:18] CS: e033 DS: 0000 ES: 0000 CR0: 0000000080050033 >>> [2013-12-26 03:53:18] CR2: ffffffffff600400 CR3: 00000001e0db3000 CR4: >>> 0000000000042660 >>> [2013-12-26 03:53:18] DR0: 0000000000000000 DR1: 0000000000000000 DR2: >>> 0000000000000000 >>> [2013-12-26 03:53:18] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: >>> 0000000000000400 >>> [2013-12-26 03:53:18] Stack: >>> [2013-12-26 03:53:18] ffff8801f2e03df0 02396417e5438000 >>> ffff8801e5439d58 ffff8801e54394f0 >>> [2013-12-26 03:53:18] ffff8801e5438000 002affff00000013 >>> ffff8801f2e03d40 ffff8801f2e03db0 >>> [2013-12-26 03:53:18] 0000000000000010 ffff8800655e6ac0 >>> ffff8801e5438800 ffff8801e511a000 >>> [2013-12-26 03:53:18] Call Trace: >>> [2013-12-26 03:53:18] >>> [2013-12-26 03:53:18] [] xennet_poll+0x2f4/0x630 >>> [xen_netfront] >>> [2013-12-26 03:53:18] [] ? raise_softirq_irqoff+0x9/0x50 >>> [2013-12-26 03:53:18] [] ? dev_kfree_skb_irq+0x5c/0x70 >>> [2013-12-26 03:53:18] [] ? >>> handle_irq_event_percpu+0xc9/0x210 >>> [2013-12-26 03:53:18] [] net_rx_action+0x112/0x290 >>> [2013-12-26 03:53:18] [] ? handle_irq_event+0x4d/0x70 >>> [2013-12-26 03:53:18] [] __do_softirq+0xf7/0x270 >>> [2013-12-26 03:53:18] [] call_softirq+0x1c/0x30 >>> [2013-12-26 03:53:18] [] do_softirq+0x65/0xa0 >>> [2013-12-26 03:53:18] [] irq_exit+0xc5/0xd0 >>> [2013-12-26 03:53:18] [] xen_evtchn_do_upcall+0x35/0x50 >>> [2013-12-26 03:53:18] [] >>> xen_do_hypervisor_callback+0x1e/0x30 >>> [2013-12-26 03:53:18] >>> [2013-12-26 03:53:18] Code: 8b 35 ee f9 bb e1 48 8d bb 08 0d 00 00 48 83 >>> c6 64 e8 2e f2 f0 e0 8b 83 ec 0c 00 00 31 d2 89 c1 d1 e9 39 d1 76 9e e9 >>> 5a ff ff ff <0f> 0b eb fe 0f 0b 0f 1f 00 eb fb 66 66 66 66 66 2e 0f 1f >>> 84 00 >>> [2013-12-26 03:53:18] RIP [] >>> xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] >>> [2013-12-26 03:53:18] RSP >>> ------------ >>> >>> dom0 and domU kernels are vanilla 3.10.25 >>> host server has 4 cores x 2 threads with mapping: 4 - dom0, 2 - domU, 2 >>> - domU >>> i've tried xen versions: 4.2.3 and 4.3.1 >>> also i've tried to disable offloaing on domU: ethtool -K eth0 tx off >>> tso off gso off ---- no effects >>> >>> domU's are under high TCP load (a lot of small tcp connections (web server)) >>> sometimes i've got on dom0: >>> --- >>> [2013-12-26 00:16:30] (XEN) grant_table.c:289:d0 Increased maptrack size >>> to 2 frames >>> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 99221507 >>> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 43646979 >>> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 43646979 >>> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 99221507 >>> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 43646979 >>> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 99221507 >>> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 99221507 >>> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 99221507 >>> >>> --- >>> >>> _______________________________________________ >>> Xen-users mailing list >>> Xen-users@lists.xen.org >>> http://lists.xen.org/xen-users >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xen.org >> http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 09:52:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 09:52:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwU5w-0005Wb-6y; Fri, 27 Dec 2013 09:52:40 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwU5u-0005WU-Tw for xen-users@lists.xen.org; Fri, 27 Dec 2013 09:52:39 +0000 Received: from [193.109.254.147:38102] by server-3.bemta-14.messagelabs.com id 1B/FE-11000-6ED4DB25; Fri, 27 Dec 2013 09:52:38 +0000 X-Env-Sender: svpcom@gmail.com X-Msg-Ref: server-10.tower-27.messagelabs.com!1388137956!7684456!1 X-Originating-IP: [209.85.215.41] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 13679 invoked from network); 27 Dec 2013 09:52:37 -0000 Received: from mail-la0-f41.google.com (HELO mail-la0-f41.google.com) (209.85.215.41) by server-10.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 09:52:37 -0000 Received: by mail-la0-f41.google.com with SMTP id eo20so4256052lab.0 for ; Fri, 27 Dec 2013 01:52:36 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=message-id:date:from:user-agent:mime-version:to:subject:references :in-reply-to:content-type:content-transfer-encoding; bh=PLNoIZiqsHTxrOEU18tXt+EY2FcbAOYocuuN80+IM6Q=; b=SX9I8z4Isg8YWt8LA/53ei8GA1vNb/0FdWmg5NEqU3f+Ulfmjc0QLGxJr6vGvw9f3v stjVgyJ3BML6s5Z2kwo5QmtDrpwN5g1W8B4kO/Wm2LG+xePRFL/LuHltA0zH3LXbhlD/ 2wbuHFeqYq1eoS7vL7qC+CeoByylvhVJpSEXb663G4kI4pDxnW7wdet1TDubT3FrRLOq L8kQZ3nhlb798Ss6gWCc3VYvuSzcu829OEIESjvaWtB4b4yyDxlktmYGxiBzsdsL6GI4 IzzGHiiCUpAyeho5xNVlAIii64imX9nepQCLWP6BgxZxubVw42fqyozzkX4O2wtbVjCg NNdw== X-Received: by 10.152.2.5 with SMTP id 5mr20505369laq.21.1388137956056; Fri, 27 Dec 2013 01:52:36 -0800 (PST) Received: from hzone3.svpcom.msiu.ru ([176.14.233.129]) by mx.google.com with ESMTPSA id ox6sm20673959lbb.6.2013.12.27.01.52.34 for (version=TLSv1 cipher=RC4-SHA bits=128/128); Fri, 27 Dec 2013 01:52:35 -0800 (PST) Message-ID: <52BD4DE1.4030609@gmail.com> Date: Fri, 27 Dec 2013 13:52:33 +0400 From: Vasily Evseenko User-Agent: Mozilla/5.0 (X11; Linux i686; rv:17.0) Gecko/20130110 Thunderbird/17.0.2 MIME-Version: 1.0 To: xen-users@lists.xen.org References: <52BC18A3.4010203@gmail.com> <52BC79A7.6020301@gmail.com> In-Reply-To: <52BC79A7.6020301@gmail.com> X-Enigmail-Version: 1.5 Subject: Re: [Xen-users] domU crash with kernel BUG at drivers/net/xen-netfront.c:305 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org It seems this domU bug related to following dom0 messages: --- [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 43646979 [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 43646979 [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 43646979 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference 99221507 ---- What does it mean? Some HW problems or internal kernel structures overflow? On 12/26/2013 10:47 PM, Vasily Evseenko wrote: > This patch > http://bugzillafiles.novell.org/attachment.cgi?id=548747 > already exists in 3.10.25. So it seems to be another bug. > > On 12/26/2013 08:31 PM, Vitaliy Tomin wrote: >> This bug was fixed in openSUSE kernel bnc#826374. Patch provided in >> attachment in Novell bugzilla. >> https://bugzilla.novell.com/show_bug.cgi?id=826374 >> >> On Thu, Dec 26, 2013 at 8:53 PM, Vasily Evseenko wrote: >>> Hi, >>> >>> I've got domU crash (~ every 1-2 days under high load) with message: >>> >>> ----- >>> [2013-12-26 03:53:18] kernel BUG at drivers/net/xen-netfront.c:305! >>> [2013-12-26 03:53:18] invalid opcode: 0000 [#1] SMP >>> [2013-12-26 03:53:18] Modules linked in: ipt_REJECT iptable_filter >>> xt_set xt_REDIRECT iptable_nat nf_conntrack_ipv4 nf_defrag_ipv4 >>> nf_nat_ipv4 nf_nat >>> ip_tables ip_set_hash_net ip_set_hash_ip ip_set nfnetlink ip6t_REJECT >>> nf_conntrack_ipv6 nf_defrag_ipv6 xt_state nf_conntrack ip6table_filter >>> ip6_table >>> s ipv6 ext3 jbd xen_netfront coretemp hwmon crc32_pclmul crc32c_intel >>> ghash_clmulni_intel microcode pcspkr ext4 jbd2 mbcache aesni_intel >>> ablk_helper c >>> ryptd lrw gf128mul glue_helper aes_x86_64 xen_blkfront dm_mirror >>> dm_region_hash dm_log dm_mod >>> [2013-12-26 03:53:18] CPU: 0 PID: 15126 Comm: python Not tainted >>> 3.10.25-11.x86_64 #1 >>> [2013-12-26 03:53:18] task: ffff8801e5d68ac0 ti: ffff8801e7392000 >>> task.ti: ffff8801e7392000 >>> [2013-12-26 03:53:18] RIP: e030:[] >>> [] xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] >>> [2013-12-26 03:53:18] RSP: e02b:ffff8801f2e03ce0 EFLAGS: 00010282 >>> [2013-12-26 03:53:18] RAX: 00000000000001d4 RBX: ffff8801e5438800 RCX: >>> 0000000000000001 >>> [2013-12-26 03:53:18] RDX: 000000000000002a RSI: 0000000000000000 RDI: >>> 0000000000002200 >>> [2013-12-26 03:53:18] RBP: ffff8801f2e03d40 R08: 0000000000000000 R09: >>> 0000000000001000 >>> [2013-12-26 03:53:18] R10: ffff8801000083c0 R11: dead000000200200 R12: >>> 0000000000000220 >>> [2013-12-26 03:53:18] R13: ffff8801e6eec0c0 R14: 000000000000002a R15: >>> 000000000239642a >>> [2013-12-26 03:53:18] FS: 00007f4cf48d57e0(0000) >>> GS:ffff8801f2e00000(0000) knlGS:0000000000000000 >>> [2013-12-26 03:53:18] CS: e033 DS: 0000 ES: 0000 CR0: 0000000080050033 >>> [2013-12-26 03:53:18] CR2: ffffffffff600400 CR3: 00000001e0db3000 CR4: >>> 0000000000042660 >>> [2013-12-26 03:53:18] DR0: 0000000000000000 DR1: 0000000000000000 DR2: >>> 0000000000000000 >>> [2013-12-26 03:53:18] DR3: 0000000000000000 DR6: 00000000ffff0ff0 DR7: >>> 0000000000000400 >>> [2013-12-26 03:53:18] Stack: >>> [2013-12-26 03:53:18] ffff8801f2e03df0 02396417e5438000 >>> ffff8801e5439d58 ffff8801e54394f0 >>> [2013-12-26 03:53:18] ffff8801e5438000 002affff00000013 >>> ffff8801f2e03d40 ffff8801f2e03db0 >>> [2013-12-26 03:53:18] 0000000000000010 ffff8800655e6ac0 >>> ffff8801e5438800 ffff8801e511a000 >>> [2013-12-26 03:53:18] Call Trace: >>> [2013-12-26 03:53:18] >>> [2013-12-26 03:53:18] [] xennet_poll+0x2f4/0x630 >>> [xen_netfront] >>> [2013-12-26 03:53:18] [] ? raise_softirq_irqoff+0x9/0x50 >>> [2013-12-26 03:53:18] [] ? dev_kfree_skb_irq+0x5c/0x70 >>> [2013-12-26 03:53:18] [] ? >>> handle_irq_event_percpu+0xc9/0x210 >>> [2013-12-26 03:53:18] [] net_rx_action+0x112/0x290 >>> [2013-12-26 03:53:18] [] ? handle_irq_event+0x4d/0x70 >>> [2013-12-26 03:53:18] [] __do_softirq+0xf7/0x270 >>> [2013-12-26 03:53:18] [] call_softirq+0x1c/0x30 >>> [2013-12-26 03:53:18] [] do_softirq+0x65/0xa0 >>> [2013-12-26 03:53:18] [] irq_exit+0xc5/0xd0 >>> [2013-12-26 03:53:18] [] xen_evtchn_do_upcall+0x35/0x50 >>> [2013-12-26 03:53:18] [] >>> xen_do_hypervisor_callback+0x1e/0x30 >>> [2013-12-26 03:53:18] >>> [2013-12-26 03:53:18] Code: 8b 35 ee f9 bb e1 48 8d bb 08 0d 00 00 48 83 >>> c6 64 e8 2e f2 f0 e0 8b 83 ec 0c 00 00 31 d2 89 c1 d1 e9 39 d1 76 9e e9 >>> 5a ff ff ff <0f> 0b eb fe 0f 0b 0f 1f 00 eb fb 66 66 66 66 66 2e 0f 1f >>> 84 00 >>> [2013-12-26 03:53:18] RIP [] >>> xennet_alloc_rx_buffers+0x347/0x360 [xen_netfront] >>> [2013-12-26 03:53:18] RSP >>> ------------ >>> >>> dom0 and domU kernels are vanilla 3.10.25 >>> host server has 4 cores x 2 threads with mapping: 4 - dom0, 2 - domU, 2 >>> - domU >>> i've tried xen versions: 4.2.3 and 4.3.1 >>> also i've tried to disable offloaing on domU: ethtool -K eth0 tx off >>> tso off gso off ---- no effects >>> >>> domU's are under high TCP load (a lot of small tcp connections (web server)) >>> sometimes i've got on dom0: >>> --- >>> [2013-12-26 00:16:30] (XEN) grant_table.c:289:d0 Increased maptrack size >>> to 2 frames >>> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 99221507 >>> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 43646979 >>> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 43646979 >>> [2013-12-26 03:53:18] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 99221507 >>> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 43646979 >>> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 99221507 >>> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 99221507 >>> [2013-12-26 06:15:14] (XEN) grant_table.c:1858:d0 Bad grant reference >>> 99221507 >>> >>> --- >>> >>> _______________________________________________ >>> Xen-users mailing list >>> Xen-users@lists.xen.org >>> http://lists.xen.org/xen-users >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xen.org >> http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 10:29:02 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 10:29:02 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUei-0006sL-0P; Fri, 27 Dec 2013 10:28:36 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUeg-0006oo-65 for xen-users@lists.xen.org; Fri, 27 Dec 2013 10:28:34 +0000 Received: from [193.109.254.147:34393] by server-3.bemta-14.messagelabs.com id 6F/FA-11000-1565DB25; Fri, 27 Dec 2013 10:28:33 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-8.tower-27.messagelabs.com!1388140111!7705251!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 20811 invoked from network); 27 Dec 2013 10:28:32 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-8.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 10:28:32 -0000 X-IronPort-AV: E=Sophos;i="4.95,559,1384300800"; d="scan'208";a="88023588" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 27 Dec 2013 10:28:31 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Fri, 27 Dec 2013 05:28:30 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VwUec-0006eS-Fd; Fri, 27 Dec 2013 10:28:30 +0000 Date: Fri, 27 Dec 2013 10:28:30 +0000 From: Wei Liu To: NiX Message-ID: <20131227102830.GN25969@zion.uk.xensource.com> References: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA2 Cc: xen-users@lists.xen.org, wei.liu2@citrix.com Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, Dec 24, 2013 at 05:06:37PM +0200, NiX wrote: > Hi. I am running a XEN VM in PV mode. This VM has four cores enabled. VM > network config is as follows: > > vif = ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] > > Dom0 is dual XEON X5450 with 16GB of RAM. > > I can barely zmap at 10mbps ~ 12k packets/second on this VM > My google-fu tells me that zmap sends out gigantic amount of TCP SYN packets in its default configuration. It is possible the ring size between frontend and backend is the bottleneck. Data copying from frontend to backend might also be a problem. You can probably patch your Dom0 and DomU kernel with multi-page ring support to see if it makes it better. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 10:29:02 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 10:29:02 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUei-0006sL-0P; Fri, 27 Dec 2013 10:28:36 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUeg-0006oo-65 for xen-users@lists.xen.org; Fri, 27 Dec 2013 10:28:34 +0000 Received: from [193.109.254.147:34393] by server-3.bemta-14.messagelabs.com id 6F/FA-11000-1565DB25; Fri, 27 Dec 2013 10:28:33 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-8.tower-27.messagelabs.com!1388140111!7705251!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 20811 invoked from network); 27 Dec 2013 10:28:32 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-8.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 10:28:32 -0000 X-IronPort-AV: E=Sophos;i="4.95,559,1384300800"; d="scan'208";a="88023588" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 27 Dec 2013 10:28:31 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Fri, 27 Dec 2013 05:28:30 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VwUec-0006eS-Fd; Fri, 27 Dec 2013 10:28:30 +0000 Date: Fri, 27 Dec 2013 10:28:30 +0000 From: Wei Liu To: NiX Message-ID: <20131227102830.GN25969@zion.uk.xensource.com> References: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA2 Cc: xen-users@lists.xen.org, wei.liu2@citrix.com Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, Dec 24, 2013 at 05:06:37PM +0200, NiX wrote: > Hi. I am running a XEN VM in PV mode. This VM has four cores enabled. VM > network config is as follows: > > vif = ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] > > Dom0 is dual XEON X5450 with 16GB of RAM. > > I can barely zmap at 10mbps ~ 12k packets/second on this VM > My google-fu tells me that zmap sends out gigantic amount of TCP SYN packets in its default configuration. It is possible the ring size between frontend and backend is the bottleneck. Data copying from frontend to backend might also be a problem. You can probably patch your Dom0 and DomU kernel with multi-page ring support to see if it makes it better. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 10:32:55 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 10:32:55 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUio-00074T-UO; Fri, 27 Dec 2013 10:32:50 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUin-00074I-Ft for xen-users@lists.xensource.com; Fri, 27 Dec 2013 10:32:49 +0000 Received: from [85.158.139.211:51393] by server-8.bemta-5.messagelabs.com id 1D/7F-29838-0575DB25; Fri, 27 Dec 2013 10:32:48 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-9.tower-206.messagelabs.com!1388140364!6807570!1 X-Originating-IP: [203.16.207.99] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 25902 invoked from network); 27 Dec 2013 10:32:47 -0000 Received: from mail.bendigoit.com.au (HELO smtp2.bendigoit.com.au) (203.16.207.99) by server-9.tower-206.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 27 Dec 2013 10:32:47 -0000 Received: from bitcom1.int.sbss.com.au ([2002:cb10:e0fe:201:a5ca:4fd3:14f:ad5d]) by smtp2.bendigoit.com.au with esmtp (Exim 4.80) (envelope-from ) id 1VwUiX-0005vM-VU; Fri, 27 Dec 2013 21:32:33 +1100 Received: from BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d]) by BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d%12]) with mapi id 14.03.0174.001; Fri, 27 Dec 2013 21:32:34 +1100 From: James Harper To: Wei Liu Thread-Topic: [Xen-users] qdisk and debian Thread-Index: Ac79HzNI2OfP7KyvQ8OhxHPB+CkVGf//y7WA//8w9fCAARg8gP/+rpLwgAwVPQD//zlb0A== Date: Fri, 27 Dec 2013 10:32:33 +0000 Message-ID: <6035A0D088A63A46850C3988ED045A4B685664F3@BITCOM1.int.sbss.com.au> References: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> <1387529739347-5720484.post@n5.nabble.com> <6035A0D088A63A46850C3988ED045A4B66CD8E75@BITCOM1.int.sbss.com.au> <52B44371.5040700@tiscali.it> <6035A0D088A63A46850C3988ED045A4B66CD9BB7@BITCOM1.int.sbss.com.au> <20131227094102.GM25969@zion.uk.xensource.com> In-Reply-To: <20131227094102.GM25969@zion.uk.xensource.com> Accept-Language: en-AU, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.16.3.239] x-tm-as-product-ver: SMEX-11.0.0.1191-7.000.1014-20386.006 x-tm-as-result: No--43.770300-0.000000-31 x-tm-as-user-approved-sender: Yes x-tm-as-user-blocked-sender: No MIME-Version: 1.0 X-Really-From-Bendigo-IT: magichashvalue Cc: "xen-users@lists.xensource.com" , "fantonifabio@tiscali.it" Subject: Re: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > > On Fri, Dec 20, 2013 at 10:26:46PM +0000, James Harper wrote: > > > > > > If your problem is only about rbd support there is a bug open on debian > > > about it: > > > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=689239 > > > I not tested it for now but with fast watch on bugtracker seems there > > > was a regression with build and the qemu maintainer removed the rbd > > > support, if with your tested you saw that regression is solved can be > > > useful reply about this. > > > > > > > I just turned off build of qemu-user (failed to link rbd static) and I now have > a qemu that should work with rbd. But xen doesn't seem to allow me to > select rbd. How should I express a rbd configuration in disk= ? Or do I now > need to rebuild xen with rbd support? > > > > A quicker way to avoid fiddling with xl config parser is to use > device_model_args in your config file to attach arbitrary arguments to > QEMU. > Just omitting the format altogether worked for me in the end. James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 10:32:55 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 10:32:55 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUio-00074T-UO; Fri, 27 Dec 2013 10:32:50 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUin-00074I-Ft for xen-users@lists.xensource.com; Fri, 27 Dec 2013 10:32:49 +0000 Received: from [85.158.139.211:51393] by server-8.bemta-5.messagelabs.com id 1D/7F-29838-0575DB25; Fri, 27 Dec 2013 10:32:48 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-9.tower-206.messagelabs.com!1388140364!6807570!1 X-Originating-IP: [203.16.207.99] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 25902 invoked from network); 27 Dec 2013 10:32:47 -0000 Received: from mail.bendigoit.com.au (HELO smtp2.bendigoit.com.au) (203.16.207.99) by server-9.tower-206.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 27 Dec 2013 10:32:47 -0000 Received: from bitcom1.int.sbss.com.au ([2002:cb10:e0fe:201:a5ca:4fd3:14f:ad5d]) by smtp2.bendigoit.com.au with esmtp (Exim 4.80) (envelope-from ) id 1VwUiX-0005vM-VU; Fri, 27 Dec 2013 21:32:33 +1100 Received: from BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d]) by BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d%12]) with mapi id 14.03.0174.001; Fri, 27 Dec 2013 21:32:34 +1100 From: James Harper To: Wei Liu Thread-Topic: [Xen-users] qdisk and debian Thread-Index: Ac79HzNI2OfP7KyvQ8OhxHPB+CkVGf//y7WA//8w9fCAARg8gP/+rpLwgAwVPQD//zlb0A== Date: Fri, 27 Dec 2013 10:32:33 +0000 Message-ID: <6035A0D088A63A46850C3988ED045A4B685664F3@BITCOM1.int.sbss.com.au> References: <6035A0D088A63A46850C3988ED045A4B66CD82D5@BITCOM1.int.sbss.com.au> <1387529739347-5720484.post@n5.nabble.com> <6035A0D088A63A46850C3988ED045A4B66CD8E75@BITCOM1.int.sbss.com.au> <52B44371.5040700@tiscali.it> <6035A0D088A63A46850C3988ED045A4B66CD9BB7@BITCOM1.int.sbss.com.au> <20131227094102.GM25969@zion.uk.xensource.com> In-Reply-To: <20131227094102.GM25969@zion.uk.xensource.com> Accept-Language: en-AU, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.16.3.239] x-tm-as-product-ver: SMEX-11.0.0.1191-7.000.1014-20386.006 x-tm-as-result: No--43.770300-0.000000-31 x-tm-as-user-approved-sender: Yes x-tm-as-user-blocked-sender: No MIME-Version: 1.0 X-Really-From-Bendigo-IT: magichashvalue Cc: "xen-users@lists.xensource.com" , "fantonifabio@tiscali.it" Subject: Re: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > > On Fri, Dec 20, 2013 at 10:26:46PM +0000, James Harper wrote: > > > > > > If your problem is only about rbd support there is a bug open on debian > > > about it: > > > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=689239 > > > I not tested it for now but with fast watch on bugtracker seems there > > > was a regression with build and the qemu maintainer removed the rbd > > > support, if with your tested you saw that regression is solved can be > > > useful reply about this. > > > > > > > I just turned off build of qemu-user (failed to link rbd static) and I now have > a qemu that should work with rbd. But xen doesn't seem to allow me to > select rbd. How should I express a rbd configuration in disk= ? Or do I now > need to rebuild xen with rbd support? > > > > A quicker way to avoid fiddling with xl config parser is to use > device_model_args in your config file to attach arbitrary arguments to > QEMU. > Just omitting the format altogether worked for me in the end. James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 10:33:38 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 10:33:38 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUjX-00078o-Ip; Fri, 27 Dec 2013 10:33:35 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUjW-00078c-8t for xen-users@lists.xen.org; Fri, 27 Dec 2013 10:33:34 +0000 Received: from [85.158.139.211:2393] by server-4.bemta-5.messagelabs.com id 2D/FC-26791-D775DB25; Fri, 27 Dec 2013 10:33:33 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-9.tower-206.messagelabs.com!1388140411!6807695!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 28345 invoked from network); 27 Dec 2013 10:33:32 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-9.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 10:33:32 -0000 X-IronPort-AV: E=Sophos;i="4.95,560,1384300800"; d="scan'208";a="85814412" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 27 Dec 2013 10:33:31 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Fri, 27 Dec 2013 05:33:30 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VwUjS-0006iC-IV; Fri, 27 Dec 2013 10:33:30 +0000 Date: Fri, 27 Dec 2013 10:33:30 +0000 From: Wei Liu To: johnnadre Message-ID: <20131227103330.GO25969@zion.uk.xensource.com> References: <476456808.81135.1388026574503.JavaMail.sas1@[172.29.249.242]> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <476456808.81135.1388026574503.JavaMail.sas1@[172.29.249.242]> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: xen-users@lists.xen.org, wei.liu2@citrix.com Subject: Re: [Xen-users] PVHVM example for xen 4.3.1 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Wed, Dec 25, 2013 at 06:56:14PM -0800, johnnadre wrote: > > Hello, > > > I'm looking for an example configuration for a PVHVM domU that works with 4.3.1. The one at http://wiki.xen.org/wiki/Xen_Linux_PV_on_HVM_drivers causes 3 warnings and some errors: > > WARNING: ignoring "kernel" directive for HVM guest. Use "firmware_override" instead if you really want a non-default firmware You have kernel= option in your config file which is not necessary. > WARNING: ignoring device_model directive. You have device_model= option in your config file which is not necessary. > WARNING: Use "device_model_override" instead if you really want a non-default device_model > xc: info: VIRTUAL MEMORY ARRANGEMENT: > Loader: 0000000000100000->000000000019ed04 > Modules: 0000000000000000->0000000000000000 > TOTAL: 0000000000000000->000000000f800000 > ENTRY ADDRESS: 0000000000100000 > xc: info: PHYSICAL MEMORY ALLOCATION: > 4KB PAGES: 0x0000000000000200 > 2MB PAGES: 0x000000000000007b > 1GB PAGES: 0x0000000000000000 > libxl: error: libxl_dm.c:1275:device_model_spawn_outcome: domain 2 device model: spawn failed (rc=-3) > libxl: error: libxl_create.c:1075:domcreate_devmodel_started: device model did not start: -3 > libxl: error: libxl_dm.c:1306:libxl__destroy_device_model: Device Model already exited > > If I follow the suggestions in the warning messages and specify firmware_override and device_model_override like so: > > firmware_override = "/usr/lib64/xen/boot/hvmloader" > device_model_override = '/usr/lib64/xen/bin/qemu-dm' > You don't need these lines. > > it only removes some of the warnings but not the errors: > > WARNING: device model override given without specific DM version > same errors as above > > > Does anybody have a config that works or any idea what's wrong with my config? > > One more noteworthy thing: > > # cat /var/log/xen/qemu-dm-auth.log > /usr/lib64/xen/bin/qemu-dm: invalid option -- '-xen-domid' > You overrided device_model with qemu-dm, but xl passes -xen-domid which only works for qemu upstream. If you want to use qemu traditional, you should use device_model_version="qemu-xen-traditional" then xl will arrange everything for you. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 10:33:38 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 10:33:38 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUjX-00078o-Ip; Fri, 27 Dec 2013 10:33:35 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUjW-00078c-8t for xen-users@lists.xen.org; Fri, 27 Dec 2013 10:33:34 +0000 Received: from [85.158.139.211:2393] by server-4.bemta-5.messagelabs.com id 2D/FC-26791-D775DB25; Fri, 27 Dec 2013 10:33:33 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-9.tower-206.messagelabs.com!1388140411!6807695!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 28345 invoked from network); 27 Dec 2013 10:33:32 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-9.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 10:33:32 -0000 X-IronPort-AV: E=Sophos;i="4.95,560,1384300800"; d="scan'208";a="85814412" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 27 Dec 2013 10:33:31 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Fri, 27 Dec 2013 05:33:30 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VwUjS-0006iC-IV; Fri, 27 Dec 2013 10:33:30 +0000 Date: Fri, 27 Dec 2013 10:33:30 +0000 From: Wei Liu To: johnnadre Message-ID: <20131227103330.GO25969@zion.uk.xensource.com> References: <476456808.81135.1388026574503.JavaMail.sas1@[172.29.249.242]> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <476456808.81135.1388026574503.JavaMail.sas1@[172.29.249.242]> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: xen-users@lists.xen.org, wei.liu2@citrix.com Subject: Re: [Xen-users] PVHVM example for xen 4.3.1 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Wed, Dec 25, 2013 at 06:56:14PM -0800, johnnadre wrote: > > Hello, > > > I'm looking for an example configuration for a PVHVM domU that works with 4.3.1. The one at http://wiki.xen.org/wiki/Xen_Linux_PV_on_HVM_drivers causes 3 warnings and some errors: > > WARNING: ignoring "kernel" directive for HVM guest. Use "firmware_override" instead if you really want a non-default firmware You have kernel= option in your config file which is not necessary. > WARNING: ignoring device_model directive. You have device_model= option in your config file which is not necessary. > WARNING: Use "device_model_override" instead if you really want a non-default device_model > xc: info: VIRTUAL MEMORY ARRANGEMENT: > Loader: 0000000000100000->000000000019ed04 > Modules: 0000000000000000->0000000000000000 > TOTAL: 0000000000000000->000000000f800000 > ENTRY ADDRESS: 0000000000100000 > xc: info: PHYSICAL MEMORY ALLOCATION: > 4KB PAGES: 0x0000000000000200 > 2MB PAGES: 0x000000000000007b > 1GB PAGES: 0x0000000000000000 > libxl: error: libxl_dm.c:1275:device_model_spawn_outcome: domain 2 device model: spawn failed (rc=-3) > libxl: error: libxl_create.c:1075:domcreate_devmodel_started: device model did not start: -3 > libxl: error: libxl_dm.c:1306:libxl__destroy_device_model: Device Model already exited > > If I follow the suggestions in the warning messages and specify firmware_override and device_model_override like so: > > firmware_override = "/usr/lib64/xen/boot/hvmloader" > device_model_override = '/usr/lib64/xen/bin/qemu-dm' > You don't need these lines. > > it only removes some of the warnings but not the errors: > > WARNING: device model override given without specific DM version > same errors as above > > > Does anybody have a config that works or any idea what's wrong with my config? > > One more noteworthy thing: > > # cat /var/log/xen/qemu-dm-auth.log > /usr/lib64/xen/bin/qemu-dm: invalid option -- '-xen-domid' > You overrided device_model with qemu-dm, but xl passes -xen-domid which only works for qemu upstream. If you want to use qemu traditional, you should use device_model_version="qemu-xen-traditional" then xl will arrange everything for you. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 10:46:17 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 10:46:17 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUv9-0007zm-8h; Fri, 27 Dec 2013 10:45:35 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUv7-0007za-PV for xen-users@lists.xen.org; Fri, 27 Dec 2013 10:45:33 +0000 Received: from [85.158.143.35:9941] by server-2.bemta-4.messagelabs.com id 4A/41-11386-D4A5DB25; Fri, 27 Dec 2013 10:45:33 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-5.tower-21.messagelabs.com!1388141131!8439365!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 17382 invoked from network); 27 Dec 2013 10:45:32 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-5.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 10:45:32 -0000 X-IronPort-AV: E=Sophos;i="4.95,560,1384300800"; d="scan'208";a="85816602" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 27 Dec 2013 10:45:31 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Fri, 27 Dec 2013 05:45:30 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VwUv4-0006rD-BL; Fri, 27 Dec 2013 10:45:30 +0000 Date: Fri, 27 Dec 2013 10:45:30 +0000 From: Wei Liu To: Vasily Evseenko Message-ID: <20131227104530.GP25969@zion.uk.xensource.com> References: <52BC18A3.4010203@gmail.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <52BC18A3.4010203@gmail.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: xen-users@lists.xen.org, wei.liu2@citrix.com Subject: Re: [Xen-users] domU crash with kernel BUG at drivers/net/xen-netfront.c:305 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi, Could you send a bug report to xen-devel@lists.xenproject.org, with logs and steps to reproduce, frontend and backend kernel version etc. Not many developers hang out on xen-users. Thanks Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 10:46:17 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 10:46:17 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUv9-0007zm-8h; Fri, 27 Dec 2013 10:45:35 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwUv7-0007za-PV for xen-users@lists.xen.org; Fri, 27 Dec 2013 10:45:33 +0000 Received: from [85.158.143.35:9941] by server-2.bemta-4.messagelabs.com id 4A/41-11386-D4A5DB25; Fri, 27 Dec 2013 10:45:33 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-5.tower-21.messagelabs.com!1388141131!8439365!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 17382 invoked from network); 27 Dec 2013 10:45:32 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-5.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 10:45:32 -0000 X-IronPort-AV: E=Sophos;i="4.95,560,1384300800"; d="scan'208";a="85816602" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 27 Dec 2013 10:45:31 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Fri, 27 Dec 2013 05:45:30 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VwUv4-0006rD-BL; Fri, 27 Dec 2013 10:45:30 +0000 Date: Fri, 27 Dec 2013 10:45:30 +0000 From: Wei Liu To: Vasily Evseenko Message-ID: <20131227104530.GP25969@zion.uk.xensource.com> References: <52BC18A3.4010203@gmail.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <52BC18A3.4010203@gmail.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: xen-users@lists.xen.org, wei.liu2@citrix.com Subject: Re: [Xen-users] domU crash with kernel BUG at drivers/net/xen-netfront.c:305 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi, Could you send a bug report to xen-devel@lists.xenproject.org, with logs and steps to reproduce, frontend and backend kernel version etc. Not many developers hang out on xen-users. Thanks Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 12:19:49 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 12:19:49 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwWNK-0002tO-5U; Fri, 27 Dec 2013 12:18:46 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwWNJ-0002tJ-7b for xen-users@lists.xen.org; Fri, 27 Dec 2013 12:18:45 +0000 Received: from [85.158.137.68:31632] by server-15.bemta-3.messagelabs.com id 68/02-11556-4207DB25; Fri, 27 Dec 2013 12:18:44 +0000 X-Env-Sender: nix@myproxylists.com X-Msg-Ref: server-16.tower-31.messagelabs.com!1388146723!5402842!1 X-Originating-IP: [62.236.108.236] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 2380 invoked from network); 27 Dec 2013 12:18:43 -0000 Received: from gameframe.net (HELO gameframe.net) (62.236.108.236) by server-16.tower-31.messagelabs.com with SMTP; 27 Dec 2013 12:18:43 -0000 Received: (qmail 7132 invoked by uid 0); 27 Dec 2013 12:17:19 -0000 X-Originating-IP: 127.0.0.1 X-Qmail-Scanner-Diagnostics: from 127.0.0.1 (daemon@127.0.0.1) by gameframe.net (envelope-from , uid 98) with qmail-scanner-2.11 (spamassassin: 3.3.2. Clear:RC:1(127.0.0.1):. Processed in 0.027364 secs); 27 Dec 2013 12:17:19 -0000 Received: from unknown (HELO gameframe.net) (daemon@127.0.0.1) by gameframe.net with SMTP; 27 Dec 2013 12:17:19 -0000 Received: from localhost ([127.0.0.1]) (SquirrelMail authenticated user nix@myproxylists.com) by gameframe.net with HTTP; Fri, 27 Dec 2013 14:17:19 +0200 Message-ID: In-Reply-To: <20131227102830.GN25969@zion.uk.xensource.com> References: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> <20131227102830.GN25969@zion.uk.xensource.com> Date: Fri, 27 Dec 2013 14:17:19 +0200 From: "NiX" To: "Wei Liu" User-Agent: SquirrelMail/1.4.22 MIME-Version: 1.0 X-Priority: 3 (Normal) Importance: Normal Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > On Tue, Dec 24, 2013 at 05:06:37PM +0200, NiX wrote: >> Hi. I am running a XEN VM in PV mode. This VM has four cores enabled. VM >> network config is as follows: >> >> vif = ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] >> >> Dom0 is dual XEON X5450 with 16GB of RAM. >> >> I can barely zmap at 10mbps ~ 12k packets/second on this VM >> > > My google-fu tells me that zmap sends out gigantic amount of TCP SYN > packets in its default configuration. It is possible the ring size > between frontend and backend is the bottleneck. Data copying from > frontend to backend might also be a problem. > > You can probably patch your Dom0 and DomU kernel with multi-page ring > support to see if it makes it better. > > Wei. > I was not able neither to exceed 10k packets/second with a lightweight equivalent software and netback/0 fully utilized one 3GHz core. Of course I had tweaked both host/vm network because the default limits somewhat cannot properly handle 10k or more packets/second due to the default 1k open files limit and so forth Well you know, basic users can manage with 1k packets and/or connections second but I am not a basic user ;) Is there any handy link on how to use multi-page ring feature. I am going to test that. I think this is something to test/compare with another virtualization software's as well. I had tweaks as follows on both host/guest: cat /etc/security/limits.conf root hard nofile 102400 root soft nofile 102400 ulimit -a open files (-n) 102400 cat /etc/sysctl.conf net.ipv4.tcp_moderate_rcvbuf = 0 net.ipv4.tcp_window_scaling = 1 net.ipv4.tcp_timestamps = 0 net.ipv4.tcp_sack = 1 net.ipv4.tcp_fack = 1 net.ipv4.tcp_dsack = 1 net.ipv4.tcp_app_win = 8 net.ipv4.tcp_adv_win_scale = 1 net.ipv4.tcp_frto = 1 net.ipv4.tcp_no_metrics_save = 1 net.ipv4.ip_no_pmtu_disc = 1 net.core.rmem_max = 8388608 net.core.wmem_max = 8388608 net.core.rmem_default = 4129093 net.core.wmem_default = 4129093 net.ipv4.tcp_rmem = 4129093 6566366 8388608 net.ipv4.tcp_wmem = 4129093 6566366 8388608 net.ipv4.tcp_mem = 8388608 8388608 8388608 net.core.netdev_max_backlog = 3000 net.core.optmem_max = 200000 vm.min_free_kbytes = 16384 net.ipv4.tcp_low_latency = 0 net.ipv4.route.flush = 1 net.ipv4.netfilter.ip_conntrack_max = 4194304 # Force gc to clean-up quickly net.ipv4.neigh.default.gc_interval = 3600 # Set ARP cache entry timeout net.ipv4.neigh.default.gc_stale_time = 3600 # Setup DNS threshold for arp net.ipv4.neigh.default.gc_thresh3 = 4096 net.ipv4.neigh.default.gc_thresh2 = 2048 net.ipv4.neigh.default.gc_thresh1 = 1024 _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 12:19:49 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 12:19:49 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwWNK-0002tO-5U; Fri, 27 Dec 2013 12:18:46 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwWNJ-0002tJ-7b for xen-users@lists.xen.org; Fri, 27 Dec 2013 12:18:45 +0000 Received: from [85.158.137.68:31632] by server-15.bemta-3.messagelabs.com id 68/02-11556-4207DB25; Fri, 27 Dec 2013 12:18:44 +0000 X-Env-Sender: nix@myproxylists.com X-Msg-Ref: server-16.tower-31.messagelabs.com!1388146723!5402842!1 X-Originating-IP: [62.236.108.236] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 2380 invoked from network); 27 Dec 2013 12:18:43 -0000 Received: from gameframe.net (HELO gameframe.net) (62.236.108.236) by server-16.tower-31.messagelabs.com with SMTP; 27 Dec 2013 12:18:43 -0000 Received: (qmail 7132 invoked by uid 0); 27 Dec 2013 12:17:19 -0000 X-Originating-IP: 127.0.0.1 X-Qmail-Scanner-Diagnostics: from 127.0.0.1 (daemon@127.0.0.1) by gameframe.net (envelope-from , uid 98) with qmail-scanner-2.11 (spamassassin: 3.3.2. Clear:RC:1(127.0.0.1):. Processed in 0.027364 secs); 27 Dec 2013 12:17:19 -0000 Received: from unknown (HELO gameframe.net) (daemon@127.0.0.1) by gameframe.net with SMTP; 27 Dec 2013 12:17:19 -0000 Received: from localhost ([127.0.0.1]) (SquirrelMail authenticated user nix@myproxylists.com) by gameframe.net with HTTP; Fri, 27 Dec 2013 14:17:19 +0200 Message-ID: In-Reply-To: <20131227102830.GN25969@zion.uk.xensource.com> References: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> <20131227102830.GN25969@zion.uk.xensource.com> Date: Fri, 27 Dec 2013 14:17:19 +0200 From: "NiX" To: "Wei Liu" User-Agent: SquirrelMail/1.4.22 MIME-Version: 1.0 X-Priority: 3 (Normal) Importance: Normal Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > On Tue, Dec 24, 2013 at 05:06:37PM +0200, NiX wrote: >> Hi. I am running a XEN VM in PV mode. This VM has four cores enabled. VM >> network config is as follows: >> >> vif = ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] >> >> Dom0 is dual XEON X5450 with 16GB of RAM. >> >> I can barely zmap at 10mbps ~ 12k packets/second on this VM >> > > My google-fu tells me that zmap sends out gigantic amount of TCP SYN > packets in its default configuration. It is possible the ring size > between frontend and backend is the bottleneck. Data copying from > frontend to backend might also be a problem. > > You can probably patch your Dom0 and DomU kernel with multi-page ring > support to see if it makes it better. > > Wei. > I was not able neither to exceed 10k packets/second with a lightweight equivalent software and netback/0 fully utilized one 3GHz core. Of course I had tweaked both host/vm network because the default limits somewhat cannot properly handle 10k or more packets/second due to the default 1k open files limit and so forth Well you know, basic users can manage with 1k packets and/or connections second but I am not a basic user ;) Is there any handy link on how to use multi-page ring feature. I am going to test that. I think this is something to test/compare with another virtualization software's as well. I had tweaks as follows on both host/guest: cat /etc/security/limits.conf root hard nofile 102400 root soft nofile 102400 ulimit -a open files (-n) 102400 cat /etc/sysctl.conf net.ipv4.tcp_moderate_rcvbuf = 0 net.ipv4.tcp_window_scaling = 1 net.ipv4.tcp_timestamps = 0 net.ipv4.tcp_sack = 1 net.ipv4.tcp_fack = 1 net.ipv4.tcp_dsack = 1 net.ipv4.tcp_app_win = 8 net.ipv4.tcp_adv_win_scale = 1 net.ipv4.tcp_frto = 1 net.ipv4.tcp_no_metrics_save = 1 net.ipv4.ip_no_pmtu_disc = 1 net.core.rmem_max = 8388608 net.core.wmem_max = 8388608 net.core.rmem_default = 4129093 net.core.wmem_default = 4129093 net.ipv4.tcp_rmem = 4129093 6566366 8388608 net.ipv4.tcp_wmem = 4129093 6566366 8388608 net.ipv4.tcp_mem = 8388608 8388608 8388608 net.core.netdev_max_backlog = 3000 net.core.optmem_max = 200000 vm.min_free_kbytes = 16384 net.ipv4.tcp_low_latency = 0 net.ipv4.route.flush = 1 net.ipv4.netfilter.ip_conntrack_max = 4194304 # Force gc to clean-up quickly net.ipv4.neigh.default.gc_interval = 3600 # Set ARP cache entry timeout net.ipv4.neigh.default.gc_stale_time = 3600 # Setup DNS threshold for arp net.ipv4.neigh.default.gc_thresh3 = 4096 net.ipv4.neigh.default.gc_thresh2 = 2048 net.ipv4.neigh.default.gc_thresh1 = 1024 _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 12:39:27 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 12:39:27 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwWgP-0003rj-Dp; Fri, 27 Dec 2013 12:38:29 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwWgO-0003re-El for xen-users@lists.xen.org; Fri, 27 Dec 2013 12:38:28 +0000 Received: from [193.109.254.147:23068] by server-11.bemta-14.messagelabs.com id D1/52-20576-3C47DB25; Fri, 27 Dec 2013 12:38:27 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-13.tower-27.messagelabs.com!1388147905!5401201!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30743 invoked from network); 27 Dec 2013 12:38:27 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-13.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 12:38:27 -0000 X-IronPort-AV: E=Sophos;i="4.95,560,1384300800"; d="scan'208";a="85836542" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 27 Dec 2013 12:38:25 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Fri, 27 Dec 2013 07:38:24 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VwWgK-0008FV-Ir; Fri, 27 Dec 2013 12:38:24 +0000 Date: Fri, 27 Dec 2013 12:38:24 +0000 From: Wei Liu To: NiX Message-ID: <20131227123824.GA23996@zion.uk.xensource.com> References: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> <20131227102830.GN25969@zion.uk.xensource.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: xen-users@lists.xen.org, Wei Liu Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Fri, Dec 27, 2013 at 02:17:19PM +0200, NiX wrote: > > On Tue, Dec 24, 2013 at 05:06:37PM +0200, NiX wrote: > >> Hi. I am running a XEN VM in PV mode. This VM has four cores enabled. VM > >> network config is as follows: > >> > >> vif = ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] > >> > >> Dom0 is dual XEON X5450 with 16GB of RAM. > >> > >> I can barely zmap at 10mbps ~ 12k packets/second on this VM > >> > > > > My google-fu tells me that zmap sends out gigantic amount of TCP SYN > > packets in its default configuration. It is possible the ring size > > between frontend and backend is the bottleneck. Data copying from > > frontend to backend might also be a problem. > > > > You can probably patch your Dom0 and DomU kernel with multi-page ring > > support to see if it makes it better. > > > > Wei. > > > > I was not able neither to exceed 10k packets/second with a lightweight > equivalent software and netback/0 fully utilized one 3GHz core. > Hmm... You're using kthread-based netback. In your use case frontend is likely to create interrupt storm for backend. Do you have breakdown of CPU usage (sy, si etc)? > Of course I had tweaked both host/vm network because the default limits > somewhat cannot properly handle 10k or more packets/second due to the > default 1k open files limit and so forth > > Well you know, basic users can manage with 1k packets and/or connections > second but I am not a basic user ;) Is there any handy link on how to use > multi-page ring feature. I am going to test that. > Oops I missed the CPU load in your previous email. In that case CPU was already fully loaded so multi-page ring might not provide you much benefit. Plus there's no convenient way to test it so I think it doesn't worth your time. Sorry. Just courious, do you have any figures on baremetal performs for zmap? Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 12:39:27 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 12:39:27 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwWgP-0003rj-Dp; Fri, 27 Dec 2013 12:38:29 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwWgO-0003re-El for xen-users@lists.xen.org; Fri, 27 Dec 2013 12:38:28 +0000 Received: from [193.109.254.147:23068] by server-11.bemta-14.messagelabs.com id D1/52-20576-3C47DB25; Fri, 27 Dec 2013 12:38:27 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-13.tower-27.messagelabs.com!1388147905!5401201!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30743 invoked from network); 27 Dec 2013 12:38:27 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-13.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 12:38:27 -0000 X-IronPort-AV: E=Sophos;i="4.95,560,1384300800"; d="scan'208";a="85836542" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 27 Dec 2013 12:38:25 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Fri, 27 Dec 2013 07:38:24 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VwWgK-0008FV-Ir; Fri, 27 Dec 2013 12:38:24 +0000 Date: Fri, 27 Dec 2013 12:38:24 +0000 From: Wei Liu To: NiX Message-ID: <20131227123824.GA23996@zion.uk.xensource.com> References: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> <20131227102830.GN25969@zion.uk.xensource.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: xen-users@lists.xen.org, Wei Liu Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Fri, Dec 27, 2013 at 02:17:19PM +0200, NiX wrote: > > On Tue, Dec 24, 2013 at 05:06:37PM +0200, NiX wrote: > >> Hi. I am running a XEN VM in PV mode. This VM has four cores enabled. VM > >> network config is as follows: > >> > >> vif = ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] > >> > >> Dom0 is dual XEON X5450 with 16GB of RAM. > >> > >> I can barely zmap at 10mbps ~ 12k packets/second on this VM > >> > > > > My google-fu tells me that zmap sends out gigantic amount of TCP SYN > > packets in its default configuration. It is possible the ring size > > between frontend and backend is the bottleneck. Data copying from > > frontend to backend might also be a problem. > > > > You can probably patch your Dom0 and DomU kernel with multi-page ring > > support to see if it makes it better. > > > > Wei. > > > > I was not able neither to exceed 10k packets/second with a lightweight > equivalent software and netback/0 fully utilized one 3GHz core. > Hmm... You're using kthread-based netback. In your use case frontend is likely to create interrupt storm for backend. Do you have breakdown of CPU usage (sy, si etc)? > Of course I had tweaked both host/vm network because the default limits > somewhat cannot properly handle 10k or more packets/second due to the > default 1k open files limit and so forth > > Well you know, basic users can manage with 1k packets and/or connections > second but I am not a basic user ;) Is there any handy link on how to use > multi-page ring feature. I am going to test that. > Oops I missed the CPU load in your previous email. In that case CPU was already fully loaded so multi-page ring might not provide you much benefit. Plus there's no convenient way to test it so I think it doesn't worth your time. Sorry. Just courious, do you have any figures on baremetal performs for zmap? Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 14:15:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 14:15:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYBz-0006jq-UY; Fri, 27 Dec 2013 14:15:11 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYBy-0006jl-F6 for xen-users@lists.xen.org; Fri, 27 Dec 2013 14:15:10 +0000 Received: from [193.109.254.147:47766] by server-11.bemta-14.messagelabs.com id 89/D3-20576-D6B8DB25; Fri, 27 Dec 2013 14:15:09 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-3.tower-27.messagelabs.com!1388153708!7720724!1 X-Originating-IP: [89.106.240.139] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 7235 invoked from network); 27 Dec 2013 14:15:08 -0000 Received: from mailgw1.riffle.be (HELO mailgw1.riffle.be) (89.106.240.139) by server-3.tower-27.messagelabs.com with SMTP; 27 Dec 2013 14:15:08 -0000 Received: from mailgw1.riffle.be (localhost [127.0.0.1]) by mailgw1.riffle.be (Postfix) with SMTP id 20FC88D44B3; Fri, 27 Dec 2013 15:14:32 +0100 (CET) Date: Fri, 27 Dec 2013 15:14:32 +0100 From: Wei Liu To: NiX Message-ID: <52bd8b48.1wyK5eebYBI/IlRe%wei.liu2@citrix.com> User-Agent: Heirloom mailx 12.5 6/20/10 MIME-Version: 1.0 Cc: xen-users@lists.xen.org, wei.liu2@citrix.com Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, Dec 24, 2013 at 05:06:37PM +0200, NiX wrote: > Hi. I am running a XEN VM in PV mode. This VM has four cores enabled. VM > network config is as follows: > > vif = ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] > > Dom0 is dual XEON X5450 with 16GB of RAM. > > I can barely zmap at 10mbps ~ 12k packets/second on this VM > My google-fu tells me that zmap sends out gigantic amount of TCP SYN packets in its default configuration. It is possible the ring size between frontend and backend is the bottleneck. Data copying from frontend to backend might also be a problem. You can probably patch your Dom0 and DomU kernel with multi-page ring support to see if it makes it better. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 14:15:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 14:15:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYCW-0006ls-7J; Fri, 27 Dec 2013 14:15:44 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYCV-0006lK-1X for xen-users@lists.xensource.com; Fri, 27 Dec 2013 14:15:43 +0000 Received: from [85.158.143.35:9292] by server-2.bemta-4.messagelabs.com id C1/08-11386-E8B8DB25; Fri, 27 Dec 2013 14:15:42 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-15.tower-21.messagelabs.com!1388153741!5781120!1 X-Originating-IP: [89.106.240.139] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 4736 invoked from network); 27 Dec 2013 14:15:41 -0000 Received: from mailgw1.riffle.be (HELO mailgw1.riffle.be) (89.106.240.139) by server-15.tower-21.messagelabs.com with SMTP; 27 Dec 2013 14:15:41 -0000 Received: from mailgw1.riffle.be (localhost [127.0.0.1]) by mailgw1.riffle.be (Postfix) with SMTP id 1D1C78D4553; Fri, 27 Dec 2013 15:14:45 +0100 (CET) Date: Fri, 27 Dec 2013 15:14:45 +0100 From: James Harper To: Wei Liu Message-ID: <52bd8b55.pco8FWra5o3WFM2I%james.harper@bendigoit.com.au> User-Agent: Heirloom mailx 12.5 6/20/10 MIME-Version: 1.0 Cc: "xen-users@lists.xensource.com" , "fantonifabio@tiscali.it" Subject: Re: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > > On Fri, Dec 20, 2013 at 10:26:46PM +0000, James Harper wrote: > > > > > > If your problem is only about rbd support there is a bug open on debian > > > about it: > > > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=689239 > > > I not tested it for now but with fast watch on bugtracker seems there > > > was a regression with build and the qemu maintainer removed the rbd > > > support, if with your tested you saw that regression is solved can be > > > useful reply about this. > > > > > > > I just turned off build of qemu-user (failed to link rbd static) and I now have > a qemu that should work with rbd. But xen doesn't seem to allow me to > select rbd. How should I express a rbd configuration in disk= ? Or do I now > need to rebuild xen with rbd support? > > > > A quicker way to avoid fiddling with xl config parser is to use > device_model_args in your config file to attach arbitrary arguments to > QEMU. > Just omitting the format altogether worked for me in the end. James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 14:15:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 14:15:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYBz-0006jq-UY; Fri, 27 Dec 2013 14:15:11 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYBy-0006jl-F6 for xen-users@lists.xen.org; Fri, 27 Dec 2013 14:15:10 +0000 Received: from [193.109.254.147:47766] by server-11.bemta-14.messagelabs.com id 89/D3-20576-D6B8DB25; Fri, 27 Dec 2013 14:15:09 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-3.tower-27.messagelabs.com!1388153708!7720724!1 X-Originating-IP: [89.106.240.139] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 7235 invoked from network); 27 Dec 2013 14:15:08 -0000 Received: from mailgw1.riffle.be (HELO mailgw1.riffle.be) (89.106.240.139) by server-3.tower-27.messagelabs.com with SMTP; 27 Dec 2013 14:15:08 -0000 Received: from mailgw1.riffle.be (localhost [127.0.0.1]) by mailgw1.riffle.be (Postfix) with SMTP id 20FC88D44B3; Fri, 27 Dec 2013 15:14:32 +0100 (CET) Date: Fri, 27 Dec 2013 15:14:32 +0100 From: Wei Liu To: NiX Message-ID: <52bd8b48.1wyK5eebYBI/IlRe%wei.liu2@citrix.com> User-Agent: Heirloom mailx 12.5 6/20/10 MIME-Version: 1.0 Cc: xen-users@lists.xen.org, wei.liu2@citrix.com Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, Dec 24, 2013 at 05:06:37PM +0200, NiX wrote: > Hi. I am running a XEN VM in PV mode. This VM has four cores enabled. VM > network config is as follows: > > vif = ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] > > Dom0 is dual XEON X5450 with 16GB of RAM. > > I can barely zmap at 10mbps ~ 12k packets/second on this VM > My google-fu tells me that zmap sends out gigantic amount of TCP SYN packets in its default configuration. It is possible the ring size between frontend and backend is the bottleneck. Data copying from frontend to backend might also be a problem. You can probably patch your Dom0 and DomU kernel with multi-page ring support to see if it makes it better. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 14:15:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 14:15:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYCU-0006lH-IQ; Fri, 27 Dec 2013 14:15:42 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYCT-0006l6-S9 for xen-users@lists.xen.org; Fri, 27 Dec 2013 14:15:42 +0000 Received: from [85.158.139.211:50597] by server-12.bemta-5.messagelabs.com id D1/CC-30017-D8B8DB25; Fri, 27 Dec 2013 14:15:41 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-13.tower-206.messagelabs.com!1388153740!6838409!1 X-Originating-IP: [89.106.240.139] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 2597 invoked from network); 27 Dec 2013 14:15:40 -0000 Received: from mailgw1.riffle.be (HELO mailgw1.riffle.be) (89.106.240.139) by server-13.tower-206.messagelabs.com with SMTP; 27 Dec 2013 14:15:40 -0000 Received: from mailgw1.riffle.be (localhost [127.0.0.1]) by mailgw1.riffle.be (Postfix) with SMTP id 863F98D45B6; Fri, 27 Dec 2013 15:14:38 +0100 (CET) Date: Fri, 27 Dec 2013 15:14:38 +0100 From: Wei Liu To: johnnadre Message-ID: <52bd8b4e.EI/9Tf6uLNqu38YT%wei.liu2@citrix.com> User-Agent: Heirloom mailx 12.5 6/20/10 MIME-Version: 1.0 Cc: xen-users@lists.xen.org, wei.liu2@citrix.com Subject: Re: [Xen-users] PVHVM example for xen 4.3.1 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Wed, Dec 25, 2013 at 06:56:14PM -0800, johnnadre wrote: > > Hello, > > > I'm looking for an example configuration for a PVHVM domU that works with 4.3.1. The one at http://wiki.xen.org/wiki/Xen_Linux_PV_on_HVM_drivers causes 3 warnings and some errors: > > WARNING: ignoring "kernel" directive for HVM guest. Use "firmware_override" instead if you really want a non-default firmware You have kernel= option in your config file which is not necessary. > WARNING: ignoring device_model directive. You have device_model= option in your config file which is not necessary. > WARNING: Use "device_model_override" instead if you really want a non-default device_model > xc: info: VIRTUAL MEMORY ARRANGEMENT: > Loader: 0000000000100000->000000000019ed04 > Modules: 0000000000000000->0000000000000000 > TOTAL: 0000000000000000->000000000f800000 > ENTRY ADDRESS: 0000000000100000 > xc: info: PHYSICAL MEMORY ALLOCATION: > 4KB PAGES: 0x0000000000000200 > 2MB PAGES: 0x000000000000007b > 1GB PAGES: 0x0000000000000000 > libxl: error: libxl_dm.c:1275:device_model_spawn_outcome: domain 2 device model: spawn failed (rc=-3) > libxl: error: libxl_create.c:1075:domcreate_devmodel_started: device model did not start: -3 > libxl: error: libxl_dm.c:1306:libxl__destroy_device_model: Device Model already exited > > If I follow the suggestions in the warning messages and specify firmware_override and device_model_override like so: > > firmware_override = "/usr/lib64/xen/boot/hvmloader" > device_model_override = '/usr/lib64/xen/bin/qemu-dm' > You don't need these lines. > > it only removes some of the warnings but not the errors: > > WARNING: device model override given without specific DM version > same errors as above > > > Does anybody have a config that works or any idea what's wrong with my config? > > One more noteworthy thing: > > # cat /var/log/xen/qemu-dm-auth.log > /usr/lib64/xen/bin/qemu-dm: invalid option -- '-xen-domid' > You overrided device_model with qemu-dm, but xl passes -xen-domid which only works for qemu upstream. If you want to use qemu traditional, you should use device_model_version="qemu-xen-traditional" then xl will arrange everything for you. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 14:15:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 14:15:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYCU-0006lH-IQ; Fri, 27 Dec 2013 14:15:42 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYCT-0006l6-S9 for xen-users@lists.xen.org; Fri, 27 Dec 2013 14:15:42 +0000 Received: from [85.158.139.211:50597] by server-12.bemta-5.messagelabs.com id D1/CC-30017-D8B8DB25; Fri, 27 Dec 2013 14:15:41 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-13.tower-206.messagelabs.com!1388153740!6838409!1 X-Originating-IP: [89.106.240.139] X-SpamReason: No, hits=0.5 required=7.0 tests=BODY_RANDOM_LONG X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 2597 invoked from network); 27 Dec 2013 14:15:40 -0000 Received: from mailgw1.riffle.be (HELO mailgw1.riffle.be) (89.106.240.139) by server-13.tower-206.messagelabs.com with SMTP; 27 Dec 2013 14:15:40 -0000 Received: from mailgw1.riffle.be (localhost [127.0.0.1]) by mailgw1.riffle.be (Postfix) with SMTP id 863F98D45B6; Fri, 27 Dec 2013 15:14:38 +0100 (CET) Date: Fri, 27 Dec 2013 15:14:38 +0100 From: Wei Liu To: johnnadre Message-ID: <52bd8b4e.EI/9Tf6uLNqu38YT%wei.liu2@citrix.com> User-Agent: Heirloom mailx 12.5 6/20/10 MIME-Version: 1.0 Cc: xen-users@lists.xen.org, wei.liu2@citrix.com Subject: Re: [Xen-users] PVHVM example for xen 4.3.1 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Wed, Dec 25, 2013 at 06:56:14PM -0800, johnnadre wrote: > > Hello, > > > I'm looking for an example configuration for a PVHVM domU that works with 4.3.1. The one at http://wiki.xen.org/wiki/Xen_Linux_PV_on_HVM_drivers causes 3 warnings and some errors: > > WARNING: ignoring "kernel" directive for HVM guest. Use "firmware_override" instead if you really want a non-default firmware You have kernel= option in your config file which is not necessary. > WARNING: ignoring device_model directive. You have device_model= option in your config file which is not necessary. > WARNING: Use "device_model_override" instead if you really want a non-default device_model > xc: info: VIRTUAL MEMORY ARRANGEMENT: > Loader: 0000000000100000->000000000019ed04 > Modules: 0000000000000000->0000000000000000 > TOTAL: 0000000000000000->000000000f800000 > ENTRY ADDRESS: 0000000000100000 > xc: info: PHYSICAL MEMORY ALLOCATION: > 4KB PAGES: 0x0000000000000200 > 2MB PAGES: 0x000000000000007b > 1GB PAGES: 0x0000000000000000 > libxl: error: libxl_dm.c:1275:device_model_spawn_outcome: domain 2 device model: spawn failed (rc=-3) > libxl: error: libxl_create.c:1075:domcreate_devmodel_started: device model did not start: -3 > libxl: error: libxl_dm.c:1306:libxl__destroy_device_model: Device Model already exited > > If I follow the suggestions in the warning messages and specify firmware_override and device_model_override like so: > > firmware_override = "/usr/lib64/xen/boot/hvmloader" > device_model_override = '/usr/lib64/xen/bin/qemu-dm' > You don't need these lines. > > it only removes some of the warnings but not the errors: > > WARNING: device model override given without specific DM version > same errors as above > > > Does anybody have a config that works or any idea what's wrong with my config? > > One more noteworthy thing: > > # cat /var/log/xen/qemu-dm-auth.log > /usr/lib64/xen/bin/qemu-dm: invalid option -- '-xen-domid' > You overrided device_model with qemu-dm, but xl passes -xen-domid which only works for qemu upstream. If you want to use qemu traditional, you should use device_model_version="qemu-xen-traditional" then xl will arrange everything for you. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 14:15:54 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 14:15:54 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYCW-0006ls-7J; Fri, 27 Dec 2013 14:15:44 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYCV-0006lK-1X for xen-users@lists.xensource.com; Fri, 27 Dec 2013 14:15:43 +0000 Received: from [85.158.143.35:9292] by server-2.bemta-4.messagelabs.com id C1/08-11386-E8B8DB25; Fri, 27 Dec 2013 14:15:42 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-15.tower-21.messagelabs.com!1388153741!5781120!1 X-Originating-IP: [89.106.240.139] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 4736 invoked from network); 27 Dec 2013 14:15:41 -0000 Received: from mailgw1.riffle.be (HELO mailgw1.riffle.be) (89.106.240.139) by server-15.tower-21.messagelabs.com with SMTP; 27 Dec 2013 14:15:41 -0000 Received: from mailgw1.riffle.be (localhost [127.0.0.1]) by mailgw1.riffle.be (Postfix) with SMTP id 1D1C78D4553; Fri, 27 Dec 2013 15:14:45 +0100 (CET) Date: Fri, 27 Dec 2013 15:14:45 +0100 From: James Harper To: Wei Liu Message-ID: <52bd8b55.pco8FWra5o3WFM2I%james.harper@bendigoit.com.au> User-Agent: Heirloom mailx 12.5 6/20/10 MIME-Version: 1.0 Cc: "xen-users@lists.xensource.com" , "fantonifabio@tiscali.it" Subject: Re: [Xen-users] qdisk and debian X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > > On Fri, Dec 20, 2013 at 10:26:46PM +0000, James Harper wrote: > > > > > > If your problem is only about rbd support there is a bug open on debian > > > about it: > > > http://bugs.debian.org/cgi-bin/bugreport.cgi?bug=689239 > > > I not tested it for now but with fast watch on bugtracker seems there > > > was a regression with build and the qemu maintainer removed the rbd > > > support, if with your tested you saw that regression is solved can be > > > useful reply about this. > > > > > > > I just turned off build of qemu-user (failed to link rbd static) and I now have > a qemu that should work with rbd. But xen doesn't seem to allow me to > select rbd. How should I express a rbd configuration in disk= ? Or do I now > need to rebuild xen with rbd support? > > > > A quicker way to avoid fiddling with xl config parser is to use > device_model_args in your config file to attach arbitrary arguments to > QEMU. > Just omitting the format altogether worked for me in the end. James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 15:02:18 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 15:02:18 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYv2-0001Bc-Fa; Fri, 27 Dec 2013 15:01:44 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYv0-0001BO-Lh for xen-users@lists.xen.org; Fri, 27 Dec 2013 15:01:43 +0000 Received: from [85.158.143.35:12195] by server-2.bemta-4.messagelabs.com id 5D/EB-11386-5569DB25; Fri, 27 Dec 2013 15:01:41 +0000 X-Env-Sender: nix@myproxylists.com X-Msg-Ref: server-12.tower-21.messagelabs.com!1388156500!8314381!1 X-Originating-IP: [62.236.108.236] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 9060 invoked from network); 27 Dec 2013 15:01:40 -0000 Received: from gameframe.net (HELO gameframe.net) (62.236.108.236) by server-12.tower-21.messagelabs.com with SMTP; 27 Dec 2013 15:01:40 -0000 Received: (qmail 14260 invoked by uid 0); 27 Dec 2013 15:00:16 -0000 X-Originating-IP: 127.0.0.1 X-Qmail-Scanner-Diagnostics: from 127.0.0.1 (daemon@127.0.0.1) by gameframe.net (envelope-from , uid 98) with qmail-scanner-2.11 (spamassassin: 3.3.2. Clear:RC:1(127.0.0.1):. Processed in 0.027252 secs); 27 Dec 2013 15:00:16 -0000 Received: from unknown (HELO gameframe.net) (daemon@127.0.0.1) by gameframe.net with SMTP; 27 Dec 2013 15:00:16 -0000 Received: from localhost ([127.0.0.1]) (SquirrelMail authenticated user nix@myproxylists.com) by gameframe.net with HTTP; Fri, 27 Dec 2013 17:00:16 +0200 Message-ID: <49490a160a437a4234aede8a5dfa1444.squirrel@gameframe.net> In-Reply-To: <20131227123824.GA23996@zion.uk.xensource.com> References: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> <20131227102830.GN25969@zion.uk.xensource.com> <20131227123824.GA23996@zion.uk.xensource.com> Date: Fri, 27 Dec 2013 17:00:16 +0200 From: "NiX" To: "Wei Liu" User-Agent: SquirrelMail/1.4.22 MIME-Version: 1.0 Content-Type: multipart/mixed;boundary="----=_20131227170016_10736" X-Priority: 3 (Normal) Importance: Normal Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org ------=_20131227170016_10736 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit > On Fri, Dec 27, 2013 at 02:17:19PM +0200, NiX wrote: >> > On Tue, Dec 24, 2013 at 05:06:37PM +0200, NiX wrote: >> >> Hi. I am running a XEN VM in PV mode. This VM has four cores enabled. >> VM >> >> network config is as follows: >> >> >> >> vif = ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] >> >> >> >> Dom0 is dual XEON X5450 with 16GB of RAM. >> >> >> >> I can barely zmap at 10mbps ~ 12k packets/second on this VM >> >> >> > >> > My google-fu tells me that zmap sends out gigantic amount of TCP SYN >> > packets in its default configuration. It is possible the ring size >> > between frontend and backend is the bottleneck. Data copying from >> > frontend to backend might also be a problem. >> > >> > You can probably patch your Dom0 and DomU kernel with multi-page ring >> > support to see if it makes it better. >> > >> > Wei. >> > >> >> I was not able neither to exceed 10k packets/second with a lightweight >> equivalent software and netback/0 fully utilized one 3GHz core. >> > > Hmm... You're using kthread-based netback. In your use case frontend is > likely to create interrupt storm for backend. Do you have breakdown of > CPU usage (sy, si etc)? I am using Linux nix 3.2.53-grsec #1 SMP and the server is pretty much idle expect when I attempt to zmap.Load average: 0.09 0.06 0.13 ps aux | grep netback root 1411 2.6 0.0 0 0 ? S Dec09 696:17 [netback/0] root 1412 0.0 0.0 0 0 ? S Dec09 2:44 [netback/1] root 1413 1.1 0.0 0 0 ? S Dec09 312:39 [netback/2] root 1414 0.0 0.0 0 0 ? S Dec09 0:00 [netback/3] root 1415 0.0 0.0 0 0 ? S Dec09 8:22 [netback/4] root 1416 0.0 0.0 0 0 ? S Dec09 2:54 [netback/5] root 1417 0.0 0.0 0 0 ? S Dec09 0:00 [netback/6] root 1418 0.0 0.0 0 0 ? S Dec09 0:00 [netback/7] It seems to only fully utilize netback/0 when I attempt to zmap and takes one 3GHz core ... Maybe there's something to look at in terms of optimizing? > >> Of course I had tweaked both host/vm network because the default limits >> somewhat cannot properly handle 10k or more packets/second due to the >> default 1k open files limit and so forth >> >> Well you know, basic users can manage with 1k packets and/or connections >> second but I am not a basic user ;) Is there any handy link on how to >> use >> multi-page ring feature. I am going to test that. >> > > Oops I missed the CPU load in your previous email. In that case CPU was > already fully loaded so multi-page ring might not provide you much > benefit. Plus there's no convenient way to test it so I think it doesn't > worth your time. Sorry. > > Just courious, do you have any figures on baremetal performs for zmap? > Yes. I zmap using xeon X3220. The network is 1gbps and I use approx. 225Mbps of bandwidth ~ 350k packets/second 18:05 20% (1h12m left); send: 380081546 389 Kp/s (350 Kp/s avg); recv: 84362 38 p/s (77 p/s avg); drops: 32.0 Kp/s (20.9 Kp/s avg); hits: 0.02% So at that rate, it takes about 1 hour and 45 minute to scan 2 billion IP's. Please find attachment for CPU usage. > Wei. > ------=_20131227170016_10736 Content-Type: image/png; name="zmap.png" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="zmap.png" iVBORw0KGgoAAAANSUhEUgAAA0UAAACxCAIAAACEDoFwAAAACXBIWXMAAA7DAAAOwwHHb6hkAAAK T2lDQ1BQaG90b3Nob3AgSUNDIHByb2ZpbGUAAHjanVNnVFPpFj333vRCS4iAlEtvUhUIIFJCi4AU kSYqIQkQSoghodkVUcERRUUEG8igiAOOjoCMFVEsDIoK2AfkIaKOg6OIisr74Xuja9a89+bN/rXX Pues852zzwfACAyWSDNRNYAMqUIeEeCDx8TG4eQuQIEKJHAAEAizZCFz/SMBAPh+PDwrIsAHvgAB eNMLCADATZvAMByH/w/qQplcAYCEAcB0kThLCIAUAEB6jkKmAEBGAYCdmCZTAKAEAGDLY2LjAFAt AGAnf+bTAICd+Jl7AQBblCEVAaCRACATZYhEAGg7AKzPVopFAFgwABRmS8Q5ANgtADBJV2ZIALC3 AMDOEAuyAAgMADBRiIUpAAR7AGDIIyN4AISZABRG8lc88SuuEOcqAAB4mbI8uSQ5RYFbCC1xB1dX Lh4ozkkXKxQ2YQJhmkAuwnmZGTKBNA/g88wAAKCRFRHgg/P9eM4Ors7ONo62Dl8t6r8G/yJiYuP+ 5c+rcEAAAOF0ftH+LC+zGoA7BoBt/qIl7gRoXgugdfeLZrIPQLUAoOnaV/Nw+H48PEWhkLnZ2eXk 5NhKxEJbYcpXff5nwl/AV/1s+X48/Pf14L7iJIEyXYFHBPjgwsz0TKUcz5IJhGLc5o9H/LcL//wd 0yLESWK5WCoU41EScY5EmozzMqUiiUKSKcUl0v9k4t8s+wM+3zUAsGo+AXuRLahdYwP2SycQWHTA 4vcAAPK7b8HUKAgDgGiD4c93/+8//UegJQCAZkmScQAAXkQkLlTKsz/HCAAARKCBKrBBG/TBGCzA BhzBBdzBC/xgNoRCJMTCQhBCCmSAHHJgKayCQiiGzbAdKmAv1EAdNMBRaIaTcA4uwlW4Dj1wD/ph CJ7BKLyBCQRByAgTYSHaiAFiilgjjggXmYX4IcFIBBKLJCDJiBRRIkuRNUgxUopUIFVIHfI9cgI5 h1xGupE7yAAygvyGvEcxlIGyUT3UDLVDuag3GoRGogvQZHQxmo8WoJvQcrQaPYw2oefQq2gP2o8+ Q8cwwOgYBzPEbDAuxsNCsTgsCZNjy7EirAyrxhqwVqwDu4n1Y8+xdwQSgUXACTYEd0IgYR5BSFhM WE7YSKggHCQ0EdoJNwkDhFHCJyKTqEu0JroR+cQYYjIxh1hILCPWEo8TLxB7iEPENyQSiUMyJ7mQ AkmxpFTSEtJG0m5SI+ksqZs0SBojk8naZGuyBzmULCAryIXkneTD5DPkG+Qh8lsKnWJAcaT4U+Io UspqShnlEOU05QZlmDJBVaOaUt2ooVQRNY9aQq2htlKvUYeoEzR1mjnNgxZJS6WtopXTGmgXaPdp r+h0uhHdlR5Ol9BX0svpR+iX6AP0dwwNhhWDx4hnKBmbGAcYZxl3GK+YTKYZ04sZx1QwNzHrmOeZ D5lvVVgqtip8FZHKCpVKlSaVGyovVKmqpqreqgtV81XLVI+pXlN9rkZVM1PjqQnUlqtVqp1Q61Mb U2epO6iHqmeob1Q/pH5Z/YkGWcNMw09DpFGgsV/jvMYgC2MZs3gsIWsNq4Z1gTXEJrHN2Xx2KruY /R27iz2qqaE5QzNKM1ezUvOUZj8H45hx+Jx0TgnnKKeX836K3hTvKeIpG6Y0TLkxZVxrqpaXllir SKtRq0frvTau7aedpr1Fu1n7gQ5Bx0onXCdHZ4/OBZ3nU9lT3acKpxZNPTr1ri6qa6UbobtEd79u p+6Ynr5egJ5Mb6feeb3n+hx9L/1U/W36p/VHDFgGswwkBtsMzhg8xTVxbzwdL8fb8VFDXcNAQ6Vh lWGX4YSRudE8o9VGjUYPjGnGXOMk423GbcajJgYmISZLTepN7ppSTbmmKaY7TDtMx83MzaLN1pk1 mz0x1zLnm+eb15vft2BaeFostqi2uGVJsuRaplnutrxuhVo5WaVYVVpds0atna0l1rutu6cRp7lO k06rntZnw7Dxtsm2qbcZsOXYBtuutm22fWFnYhdnt8Wuw+6TvZN9un2N/T0HDYfZDqsdWh1+c7Ry FDpWOt6azpzuP33F9JbpL2dYzxDP2DPjthPLKcRpnVOb00dnF2e5c4PziIuJS4LLLpc+Lpsbxt3I veRKdPVxXeF60vWdm7Obwu2o26/uNu5p7ofcn8w0nymeWTNz0MPIQ+BR5dE/C5+VMGvfrH5PQ0+B Z7XnIy9jL5FXrdewt6V3qvdh7xc+9j5yn+M+4zw33jLeWV/MN8C3yLfLT8Nvnl+F30N/I/9k/3r/ 0QCngCUBZwOJgUGBWwL7+Hp8Ib+OPzrbZfay2e1BjKC5QRVBj4KtguXBrSFoyOyQrSH355jOkc5p DoVQfujW0Adh5mGLw34MJ4WHhVeGP45wiFga0TGXNXfR3ENz30T6RJZE3ptnMU85ry1KNSo+qi5q PNo3ujS6P8YuZlnM1VidWElsSxw5LiquNm5svt/87fOH4p3iC+N7F5gvyF1weaHOwvSFpxapLhIs OpZATIhOOJTwQRAqqBaMJfITdyWOCnnCHcJnIi/RNtGI2ENcKh5O8kgqTXqS7JG8NXkkxTOlLOW5 hCepkLxMDUzdmzqeFpp2IG0yPTq9MYOSkZBxQqohTZO2Z+pn5mZ2y6xlhbL+xW6Lty8elQfJa7OQ rAVZLQq2QqboVFoo1yoHsmdlV2a/zYnKOZarnivN7cyzytuQN5zvn//tEsIS4ZK2pYZLVy0dWOa9 rGo5sjxxedsK4xUFK4ZWBqw8uIq2Km3VT6vtV5eufr0mek1rgV7ByoLBtQFr6wtVCuWFfevc1+1d T1gvWd+1YfqGnRs+FYmKrhTbF5cVf9go3HjlG4dvyr+Z3JS0qavEuWTPZtJm6ebeLZ5bDpaql+aX Dm4N2dq0Dd9WtO319kXbL5fNKNu7g7ZDuaO/PLi8ZafJzs07P1SkVPRU+lQ27tLdtWHX+G7R7ht7 vPY07NXbW7z3/T7JvttVAVVN1WbVZftJ+7P3P66Jqun4lvttXa1ObXHtxwPSA/0HIw6217nU1R3S PVRSj9Yr60cOxx++/p3vdy0NNg1VjZzG4iNwRHnk6fcJ3/ceDTradox7rOEH0x92HWcdL2pCmvKa RptTmvtbYlu6T8w+0dbq3nr8R9sfD5w0PFl5SvNUyWna6YLTk2fyz4ydlZ19fi753GDborZ752PO 32oPb++6EHTh0kX/i+c7vDvOXPK4dPKy2+UTV7hXmq86X23qdOo8/pPTT8e7nLuarrlca7nuer21 e2b36RueN87d9L158Rb/1tWeOT3dvfN6b/fF9/XfFt1+cif9zsu72Xcn7q28T7xf9EDtQdlD3YfV P1v+3Njv3H9qwHeg89HcR/cGhYPP/pH1jw9DBY+Zj8uGDYbrnjg+OTniP3L96fynQ89kzyaeF/6i /suuFxYvfvjV69fO0ZjRoZfyl5O/bXyl/erA6xmv28bCxh6+yXgzMV70VvvtwXfcdx3vo98PT+R8 IH8o/2j5sfVT0Kf7kxmTk/8EA5jz/GMzLdsAAAAgY0hSTQAAeiUAAICDAAD5/wAAgOkAAHUwAADq YAAAOpgAABdvkl/FRgAAHYpJREFUeNrsnb2SFUeThg8IMCbAgID4bgVToGthPKRbWEfjIx8c3cya a+wlIBlgKKQIueo1FKtQzOnOevOnqqvPeZ7A0LRO/1Z19ltZWZmn//2f/+Yf//jHP/7xj3/8499x /53+CwAAAACOzOlbAAAAADgyp2+//Xb5f05rLAAAAAAwMeg5AAAAAPQcAAAAAKDnAAAAAAA9BwAA AICeQ88BAAAAoOcAAAAAAD0HAAAAAOg5AAAAAPQceg4AAAAAPQcAAAAA6DkAAAAAQM8BAAAAXIWe AwAAAAD0HAAAAAAcSs+FJ2SZ1QWAgNFYNSPNjbYVWj3FP/+9o7FKnrrT1W5d1dalZp5b+PZ73Dsh SXCxei7/lopv71E2AkBvZXNuQwwRppigVd1myMdd7n3wjrrpbj7wjJ3Udzz/2YB73+tFwBpAsZ77 5x1Gz3m/LmxkIxsDG1d/1nxJY6Jkdd9r0HPNXVwj26RzUd+rRM957x3gcvxz5Xpu1ZV9lI2LZ/aH jWxk4+KcMB2g55TR5gx6Th9krh7Enhh13aOi2Hrrua2ncX5Hqxv1e9cnW42zr/pExOtcvWzjl0m3 C6DnrtE/dwKAPqDnmiLD1gqGsGv+KZpxW+hk9Jzo4Ws6UwOPwrgk5b5WxeWWFFM2bl2zfSLEHHoO /xz+OTay8Rr9c/pek/jnjCtXnmTGgG+ZPr0heognW6sVtmDJJekbdTmOnkPP4Z8jfo6NbJxx4zA9 d4j4ueaf59ql1t3Y9MAV6rla8XQlem7JLUMB9Ny16zkA6C1rMutbdQ3XI+9GJz23FSNl+GmS862K 0lWivvQFyF7xZEsiW+J3uqRMwyX9c4CeU21rcu0SkggAvOYiE+GwFTO+bPv/djdWxnzrqkumKd0y 6yG2YhztBnJNnsY+E/q9u1wM4UtqZm/x6rmtJ+lqYkDPAQBcgijkOXi14xFPcQGXVHg7dHv0HAAA ABx19MIYBj0HAAAAAOg5AAAAAJhczyXduayHAICA0Vg1I82NthVaPYUd6T/slqc92mwdw9tGsRJh gZ4QWyXtvSMjAwNfWPScr4PmTbPxtrCRjVUb4ejf7HMbIuYr2TJBW2lKZshXgp7rdJuxxg18+JQy FaI409+Okvx/gJ5Dz7GRnM9s7LLxCvMJo+cWfwky8TfNlHX5D59Rdc3e3ZvoDj0HS1X8XJWeO3S9 LzZSk42N/TYuV1m/tZn8Vh/ViD6hrdxmzZHSYlaFb15SJiVeQMwt0flW/ffNKh2uGVtXnuemxQP0 XOWYD/8cGwdvPMExQc8FvESrLihvyJervESzZmi/khW6cLEvstARGLjNjJhbWvFz6Dn0XE0/wz/H RvxzbDyKf07fazY9t/oWuCSIsbtS8qH8mOUuhhI95420C+s5r29ynn4LB9Nz+VcO/xwbB28kBO2g G4fpuUPEz50qyrrrGlHxvS1y+fllY1q290NThKNrulaUYkl5XeJeQc+h5zqKOfQcG1nfCkmjkZGD toazY7nm13NbzjDdcaXrOTEczY7hS863xnYP+OdO/oKtoq/OpcBcgw0MIHouMvjIHIGWAACvwQnM 4W4F5i9CRPkues6+cX2dwSLPty7CvKToY9OXPiTXQwR2P/mztTWDO0W16rqdZtM3A04wIOg5AIBL E4U8h91bwfhT2SV5xmG3Rk8G9BwAAFy4sEaUAKDnAAAAAAA9BwAAAHDleo71EACwp+XyJB1sHuTf W87/e9/1EMaf0zbKVhudPEVIjY09dge4Uj1nGx39zbfNNBsXcnYARE2QN7uEXW1zmSBfST5fRm8x t7Ry+Om7uw6V3B0APRc3Fug5cuqycbmINL+XIebOfXK61Zpczw0YsQeGkcns0IXJpQHQcykLQr0v al6x8QI2HlHMZdTeDHru3tttSyhji5Kib5HrotrFQ5XayrogS+4OgJ7b9KXhnzvKRoq7QxUXoOeM QrGT6zlXyQFbFCqOwIx/zvai4Z8DmMU/F/bS4Z/DP8dG/HO7iDlDEi1C9c9J/HPlei6j1xXx5C2n m6zGi54D9Nyeeg5fGvFzbFyInxui52xJNHP83AD/XNKeo+cADqPn8qvo0XOsbwUYKeaaReWNIvQT +ufEZCvLkPnWRVjfKv4pjiKSuwOg55YqoUD+OQAYpudE1/WWHtrRWNnXad/mVrhF8zbtRyee3Xh0 ekl7e2NsdwD0HADARek/bmSvMyZlFioNAD0HAICeAwD0HAAAAACg5wAAAABgFj3HeggAGG25PAkX xd2XjbUCGCsAuHw9R30IUpMAzCDvMkNNMSUbLxcAXKae28rShJ4jdTAbSQh8LDF37pMrHL4CAMyr 55KJxan3RWkvNs6wETGn746eA4BL03NiuUP8cztupGA82FyqnnPdIHoOANBz9XoOBxv+OTbin0s6 53TTFKgYhp4DgEvTc8mxPv454ufYuBA/N5meI34OAK5Lz7mMJnqO9a0AA8Scq6h8U8yxvhUA0HNu Dx8tAQB5y6MXlbfloFJUHgDgovQcAMBB9R8AAHoOAAAAANBzAAAAAICeAwAAAEDP+XdrrRRTjmBH Lq/+no2BjQC9zIcnb46xpMDI32ucSH8LVi/p/ERbF8l6CAC4ZD13ntcqfAS0V7+NmRq7AN5BXaD7 2abAGD2uijP7/96TbqvWzFCZ6DkAQM+h52bRc8nCuwCFes74QVOQJTei5wAAPXffJhrTIue/Qc8N 22jPH9H7oZ+8O1dURga4rnqueUlLy9XHiwMA16XnDAu76iVCz433z11qUXaYVsytDjMU5XTesZUA OPuqzitANEek6DkAuHw9tyrvzuvEo+fwz8EFKzmvH6up55Q/vXrOLg6Bfw4A0HObxvT8f6Hnxm8k fg66ijlxozj866Tn9Eqv6DkAQM8x33oMPQcwWMzp06Ax7eVa34qeAwD0nGQNjTAXMaUTgqx2I0An PbcaX7H6ajfj0pqKMGwrjDiQ82EP+ecA4Lr0HAAAAACg5wAAAAAAPQcAAACAnkPPAQAAAFypnksG CBNiDHBdtkZISrf153JWXiK5GoP1EACAnpOMb9K4A8CFiTnbVtjJjMScdqsbqd8KAOg5n/VEzwFA YPjnrQamizn0HACg5+IGdNmok0jJKQD0XDNjsEvPuRLandchPK/fip4DgCvSc4ucOnirkg+WEQA9 pwsyI5+wUlJiq6L0uZ6z8x5jtQDg0vTcufVcLe1lV5KgAQCuWc8FwuliFSZWjdWqXTKOg9UCgKvW c/jnANBzGT1nHA09BwCw1K5vNfxzxM8BIOl04dXUc4ogEy8DPQcA16vnlo1AE31tGimdAK5N0ome NiWBnG2Cto7Z1IjknwOAq9Nz3nE5AAAAAKDnAAAAAGC4ngMAAAAA9BwAAAAAoOcAAAAA0HMAAAAA gJ4DAAAAAPQcAAAAAKDnAAAAANBzAAAAAICeAwAAAAD0HAAAAAB6Dj0HAAAAgJ4DAAAAAPQcAAAA AGT13AkAAAAADgd6DgAAAOAa9dx9L59z49YxV/9sHvPv7fqJhtHjKemPbtgxe9xR+Hka3ab2Aqqe fOaXWze+9R5tNa633f/ZmDlRp/dIvPgenWFHO8OHDADiem7rz/PjJD8kzY3NS5rEztpfwcw173vM HmcPP89+nSHcP719vsfZ7/0v+0T3NJPxkLd+qZyoRLWc36x48T06A3oOANBzqa81eu5e86HnBnzC Y00cvs782UWNldRzncRcPz0Xu8ipJBR6DgDQc5ej504dJryaU3jouQPpOfGM/56jVB5yc/p1l+ff vPhOem5rXvj8vdh6aKszyOcm2pj4BgD0XDZ+roeeO7XChpRL2lHPuQLL8r601S/HAD1Xfkex52l/ GmsvYPWS+sXPGR4yMX4uqedW37ij6LlmD/FerVder464bDV2716MFxw9BwBl/rmues7lkpl/HqSH V8mw78P8cwP8ZGHd0M9dpwSrdXqtTn5HdeBZxYIU9/WPumxCoX8ur+fERScTzkUAAHquWM9NZd28 1znVeghj9K8sbOyn5/IaZYyeC5y3q57T4+eSem7f+Lnj6rkeC27+5uHDh0+ePLm5uXn69OnNzc2T J0+++eabkh8DAHou+CERvy7zzLe6rvPoeq6352D1RJOvb43l6CmXWcaM/F4nmkTPjekMXj2n++ds 0/3o0aNXr169fv369vb27u7up59+uru7e/fu3evXr1++fPno0aPwjwHgkvVcPg9ZMzBu9ZjTzkF4 I36myj+3+rXwBmyNWQ8xYf45vSsm888FfhnzzwWmAnu3/oT558Qnb6xGtxdznHfvref84MGDp0+f vn379uPHj1++fLn3BL58+fLp06e3b98+ffrU+2MAuCg9BwAAc/LgwYPnz5+/e/fu8+fPRrXHz58/ 397evnjx4sWLF+KPnz9//uDBA54wAHoOAAD68uzZs9vb299//71ZwPuPP/74/vvv379/L/749vYW Lx0Aeg4AAPry6NGjN2/e2M62f/P169evX7+KP/78+fObN2+IpQNAzwEAQEdevXr18ePHpRufPn16 +fIlzxlgdj0nBvmecmsXklStA90LO8Fpj3MVPu0ey1O8D8RYorEVXR5uoK0swXp261hnUJpj5FoQ vS8lz64nWM4ksk7uPi0PHz58/fr1+ZqGQr58+fL69euHDx9636NCq2hn2Txc8+FPKfmeTnIx5fbT IaL+redKan7bN4aeG5m1K3/MgN08z2tvd0HvAxGPNiZTRm29L/GbZx+t07ctk74u/3YEZG74vIf+ uD558uTdu3dLZ969e/fkyZPAgy0xAqv/V7Q2M4uS2q9VspbgsM904W2Ob3e91crTf+6v58o/LRej 54blSwscwaXnAhY2UFQ++c5UibnTwPqt4Xsf3Je66rnmvZ9COeeSu0/Fzc3N3d1dbz13d3d3c3PT W8+5NqLnZtNzY84+28WH02TW67mYW0KcYnMVjlRSOnmngE9TVsuZWc9lPt52cc/kAxmWUNrrY+6q 5zKXtFdfqh18e81Uj+d5bmruzciftBCFUy4eYGv3p0+ffvjwobee+/Dhg7jKNfZWxlwJAWtjfzsy H6mTnK5y639lylIbBZe37qV3bMbqo9Nv03jy+u1nIsT0SJvV2/Sata3u3WimLT2nxy2d1rJcBkYb zcrTJ7lGdUZ37qLuj6jnlEIgXgsbLipf+7003jTjmOPj5wJtNLIvlY+8m+0+TM81ncdNA607rgzh eL77zc3Njz/+ON4/VxjKGS6AplibkmDfpO4Uxa6rMI+3Ywd0tiuq+NSKk9GrRBrXrPSuroExYmRn ctrBUZP9XM8p8adet0RVIfB+G8crud7xvP30nLcIWFjNB47m/V6WfPKrWjNWi9YYoZYPPGKtmR/c D1ac4bg9YyRZWMzG2P3x48dj4uceP35c7p8T/UnlJj2pk2wtK56o/L22i8cM+AKK9+56nrpxtt84 +0T6L8XvYI84aUnPhWcfDqrndgm2SA689tVz4icwbyKTeq6royg2vhym53qskk46BvL+4An1XLNg 68kzw1AyGvx7faueT67r+tZTotDcsfSc2Fh5Pad/tg6t5zKu9HAFat2DW9JpwwYwuL7Ve3S9wfJ6 LjPfehKqH44Uc7HH5TpX0lkSeNPyMWTiCz/MvicL1VepkOSqo7ysdzVHrZhLenBr4xq3noOh584D ecvj506n06tXrz59+tQ1/9yrV68KrYfXCChL4HfUczFXghi+Ehv0iuuFTz1XkrlmUfWvWPO5DZtv FS8+YD8d/fOenguk3drStiWD3VOH9RC9nRnK2Nq41B6nK7nUvNs5/0B6ZIBrXpWxMR82FPtlYLbi VBRQuHW65tlL3g5XgHNzd/EhBwbxriVZtarXWx/CxS+//PLdd9+J9SH0nuC1iuXxKq7XMGwutjpD c1lA8zqVjeGo/PyHw3t2XUjYzXFqBfdX5UfUbzNmP9XrvML6EBeTOxSgVgrMc8weJ5rnTe99I8+e PXv//v2ff/5ZK+b++uuvn3/++T//+Q/v0ZW82nCwhrvOel+dFmkDAOyr5x48ePDixYsffvjht99+ K/fP/frrr2/fvqV+K8CM2POtAAAAADA56DkAAACAy9Jzq5OSPTamLjp6nKoLyF+/MfPb41yFR3BN /YiXYe91MldmNE8auH3XrH2mz9uRAM1u49o93xnE3Uve99iJYg9kwGt4pV+XUFsozXH+uk1o50da abrZPB/3cvupm7WV/HP3/uyx8Zr13NYDOf+PwnNlnth5x1JM7arg0/XislFyW5GGPR7jaTtHZabP 67emHLMpBzNPRty95H0XP//NJx+wBj36z5V/a8UXQbeKq/93y0Yd8UGV9EB9906PSzxs4W2Ob3e9 1TL209GU6LkZ9NyAp5R0U4n6Y1XDBfScIfLy70yVmJtKz3WVWa47yvc6RbBmDZ8giJF0++o510b0 3Gx6bszZZ7v4gGGpNGtG/NzJTLO09a1Vfmnb8eYHXv/lsl2NZ6oOMaeeU0TGVvs2lxXrInJpTa/0 G6g1Z3uTrRnTc6syumtnCO9eOPRqjgqWVqGtQj1nrDldzMqStgXzGo35tUvsrYx5Dbaef9jsZD5S RruLH/JmNoaAFTXupbYjbdkoJVjF+9F3fUSUNhLjaoyH7Gr3SrO2peeUT+b5+yMqKvHbpozG9Jff 1p37Grsj6jk70iWm58Q51ubHvuSD543JGxY/F2jcXfRcefyc4pd1OYR0s6u/xYoL2XWdhnCcx4/o ii7NWMWkntt6nnq7Bz49ykhPGTeGr9N+toGRthE8bSvUZisvwuS7S4xWBcYoXdQlTrqYtXM9p8Sf ht0SXV3u5a3Y2/yVa68xek4JW3YFvS3OQD3xO13o0lfWZCTdPF3dHoP1XMkqnKTzuGr06G2IU6se 147u0sn9c6I/qdykJ3WSrWXFE52c9XjCb1DAu9/jA9SURE3vpuifs+M31HUG8iWV9M+4WTtf3xqw rcfVc7tMWCQHXvvqOdFdF1jf6jpavitW6blMa255XA6t54bFyHq9kj3MruErsn+TGW9M6J/Ld9TM p3F3PSc2Vl7P6Z+tQ+u5gMfR1W10LShGbBcalpRZM9ZDeI/eI2S7x3zrIk8BjxFzzf6dP1dVlorY 3OviCcJTtE5sEJ+UsGEzIdrl2Mi7ZI4g2Zc6RS4GbjwZd+x6SvaS561JIm9AjD1ouZj4OZdVbDbW vnou5kpQXivXtJ3+xDqNDQJ6zr7NgJ7Tg/vztlS8+ID9dFynXe9rEQIjtrSt/Tl0PbLa9RA93Ale rRBI0lboWwpfql19KKPnxD5WngFOvHejK2bChmJZ+vRReG1mNTs9TbN7Z568fqJmhHWzh3iTpa2a F9eSrB7Oy0nEXD6QdEz+OVeePHF3fX1eVae1N4aj8quMp352JSBPaY5FDu5P5kfUbzNmP9X36Arr Q5CVAK6wn3Oied70K9FzcJHvO0zbcFda76vTIm0AAPQcAOxgWKjfCgAAAICeAwAAAIBp9FwmsfLS JzJ95aKPXO9ryQVix85VeARlxYx3qYcYAr/ajs2T5kPy7bvL9Pl8AiRX3+6xHkLv3j1eVbtzenPo 5xdzgPJe563igPyd4x8UHSbZzSa5mHL76fhMUL913/YOJEoInCu/xNX4fDaNeKB+6yLXiii/ZfE9 rFoGH1vgHFuSmXkymXrS/YRj+NaSdRIh8Jwz+SCa2Teo3xrefUz+uU5n3zcRYyB5Xj5rm+qfQ8/t pefmzCfczHhuDKaTes4QecvwHH56MuExei7wzg9L0FXS6xZ//jm34UPPTa/nYhlJ0XOT6LkxZ5/t 4nvkxQzqOf3K+qXs06saZ/L9zNYhjli/1ZYjsfqtTT0nvjO1iZR0CzJAz8WyBO9VYKpw6KXkeXIU rs6l+bWzMIaLi3uNxsXkE9bfo2T9VpfZyXykjHYXP+R6hlfdihr3UtuRjATsrmyRykff9RFR2iiQ fLR5m7bxaZZ7Vu3Slp7TK44vRSn7XFUfMvUh5tFzVfnNd9FzdqRLTM+Jc6zixz5pp7wxeV3j55rf gAn1XHn8nPhx0p/JqpIL36buQnbVr2um755k2iGTB1W3ikk9p1Rzco0ElqLZKmXcmC8b1awPERvD iPLRnjR3DVl1MTqsPoRXxjTPa0yLOfScEn867JEdZQo4KZKOpeeUsGWv58k1sSt6eQtd+mJVGe+T DzgvY86PwXquZBVO/pKSfsSYvN4aSYYFRL9Xezb/nOhPKjfp+XpfhpYNv7/iKNr7Bh2ifqtSYUL0 z9nxG8nlaD3qty5yjHhbz2VKuB5Rz+0yYZEceO2r50R3XWB9q+toga7YSc9lWtMomCa2qW6Pdvzg Xaqes31FVX5Er+45qJ6rqou67F2/1WisvJ7TP1uH1nOZlzRcaFv34JZ02irTt6nnkkZtpJ7LzLcu QlHXkWKu2b/z56rKUhGbe108QXiK1okN4pMSNmwmRLvsCvnKDBLK17d2ilzUH6wYt+B99WIP3NBz gUA9e9ByMfFzrqbxtvtgPRdzJSivlat760+s09ggoOfEkvZ6c9QG95dcfMB+Oq7znp7TJ8j1aE1X qOnqg6hdD9HDneDVCoEkbYW+pfClbkXF5fWc2MfKM8CJ9250xVT55FAqFpfrrqozLLl60sknr99R oLS5srt3EO9aklXuvJxHzOUDScfkn3PlyRN319fnBTqt/r7no/KrjKd+diUgT2mOpSi4X3/yzduM 2U/1PbrC+hBHTz4JMNVX/ygnmudNp34rHPc1hGkb7krrfZECHgDQcwBwOYaF+q0AAAAA6DkAAAAA mEbPZRIrL6MqzR+63tewp1R1zOaKhGbF+kXLV6In7xVLsFeF5Nt31ynMtkcT91gPMeEdDdsdXO9R oVUckL9z/IOiwyS72SQXU24/HXmpetdvXTpk4ri8+q3LrPlKvPVbbcGn68VFrhVRfsv6V3/ptgy+ RxP3y1cy1R0N2x285i6TD6KZfYP6reHdx+Sf63T2fRMxBpLnBexnsH7rUYoxXJ6emzOfcDPjuTGY Tuo5Q+Qtw3P46cmEk3quXxMPS9DV9USFeQenrRyDnot9ZdBzs+m5MWef7eIDCeS8Zk3Vc/qVNVP2 BSrb6FnlkvnnprLaM+u5pn005F2sfmtTz4nvTG0iJd2CoOeSN6gnqdpXz9lZGMPFxb1G42LyCevv UbJ+q8vsZD5SRruLH/Kq/IjNPt+jIxkJ2JW0aq6PvusjorRRIPlo8zZFs2a8CKn8c3rF8WUtZV/Y RHpHY4s/H/c8eq4qv/kues6OdInpOXGOVcnKmP/geWPyxsfPTa7nyu9oTv/cea9bWi5kV/26Zvru SaYdMnlQdauY1HNKNSd9RqxwtkoZN+bLRjXrQ3ib2A5fbn7fl2hhG12MDqsP4ZUxzfMa02IOPReI ERY9ect89Vv3soYD4nn76TklbNlb+sI1sSt6eQvdYGJVmXm8WfvquUxZjmEOthLLsGW7m0uIdnGX Tu6fE/1J5SY9X+/L0LKx8YntecoYk0PUb1UqTIj+Obs0lF7/Wrykkv4ZLhS0sr418Jk5rp7bZcIi OfDaV8+J7rrA+lbX0QKjsU56rrA1L0PPJZfQHkjP2b4i+zeZ8caE/rm8nquqi7rsXb/VaKy8ntM/ W4fWcwGPo6vb6FpQjNguNCzhll3s9RB5MddsufDbm5lvXYSiriPFnOspxc5VlaUiNve6eILwzrfb BqiTfVcKfS758sk9V4O6ylpXnSjfe0smYnrsLppyQ89tFe6MPaJLip9zWcVmToB99VzMlaC8Vq5p O/2JdRobBPScmChDbw7bI1473xrO8uGtUevQc/oEuV4VODaesOMQl8R6iEJ3QlgeBZK0FfqWwpe6 FRWX13NiH+uRAU65KqMrJsOGOmVr65HgMFNPeuQd9djdO4h3LcmqGhNOKOYC8ft6UqTacZH+woq7 6+vzxFrvi1wVfuvdtHVP7TKyzNmVgDylOWwhUWKovbcZs5/qe3SF9SHISgBX2M850TxvOvVb4biv IUzbcFda76vTIm0AAPQcAOxgWKjfCgAAAICeAwAAAAD0HAAAAACg5wAAAADQcwAAAABwMP5vAJ0C 3wzZW/wTAAAAAElFTkSuQmCC ------=_20131227170016_10736 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users ------=_20131227170016_10736-- From xen-users-bounces@lists.xen.org Fri Dec 27 15:02:18 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 15:02:18 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYv2-0001Bc-Fa; Fri, 27 Dec 2013 15:01:44 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwYv0-0001BO-Lh for xen-users@lists.xen.org; Fri, 27 Dec 2013 15:01:43 +0000 Received: from [85.158.143.35:12195] by server-2.bemta-4.messagelabs.com id 5D/EB-11386-5569DB25; Fri, 27 Dec 2013 15:01:41 +0000 X-Env-Sender: nix@myproxylists.com X-Msg-Ref: server-12.tower-21.messagelabs.com!1388156500!8314381!1 X-Originating-IP: [62.236.108.236] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 9060 invoked from network); 27 Dec 2013 15:01:40 -0000 Received: from gameframe.net (HELO gameframe.net) (62.236.108.236) by server-12.tower-21.messagelabs.com with SMTP; 27 Dec 2013 15:01:40 -0000 Received: (qmail 14260 invoked by uid 0); 27 Dec 2013 15:00:16 -0000 X-Originating-IP: 127.0.0.1 X-Qmail-Scanner-Diagnostics: from 127.0.0.1 (daemon@127.0.0.1) by gameframe.net (envelope-from , uid 98) with qmail-scanner-2.11 (spamassassin: 3.3.2. Clear:RC:1(127.0.0.1):. Processed in 0.027252 secs); 27 Dec 2013 15:00:16 -0000 Received: from unknown (HELO gameframe.net) (daemon@127.0.0.1) by gameframe.net with SMTP; 27 Dec 2013 15:00:16 -0000 Received: from localhost ([127.0.0.1]) (SquirrelMail authenticated user nix@myproxylists.com) by gameframe.net with HTTP; Fri, 27 Dec 2013 17:00:16 +0200 Message-ID: <49490a160a437a4234aede8a5dfa1444.squirrel@gameframe.net> In-Reply-To: <20131227123824.GA23996@zion.uk.xensource.com> References: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> <20131227102830.GN25969@zion.uk.xensource.com> <20131227123824.GA23996@zion.uk.xensource.com> Date: Fri, 27 Dec 2013 17:00:16 +0200 From: "NiX" To: "Wei Liu" User-Agent: SquirrelMail/1.4.22 MIME-Version: 1.0 Content-Type: multipart/mixed;boundary="----=_20131227170016_10736" X-Priority: 3 (Normal) Importance: Normal Cc: xen-users@lists.xen.org Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org ------=_20131227170016_10736 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit > On Fri, Dec 27, 2013 at 02:17:19PM +0200, NiX wrote: >> > On Tue, Dec 24, 2013 at 05:06:37PM +0200, NiX wrote: >> >> Hi. I am running a XEN VM in PV mode. This VM has four cores enabled. >> VM >> >> network config is as follows: >> >> >> >> vif = ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] >> >> >> >> Dom0 is dual XEON X5450 with 16GB of RAM. >> >> >> >> I can barely zmap at 10mbps ~ 12k packets/second on this VM >> >> >> > >> > My google-fu tells me that zmap sends out gigantic amount of TCP SYN >> > packets in its default configuration. It is possible the ring size >> > between frontend and backend is the bottleneck. Data copying from >> > frontend to backend might also be a problem. >> > >> > You can probably patch your Dom0 and DomU kernel with multi-page ring >> > support to see if it makes it better. >> > >> > Wei. >> > >> >> I was not able neither to exceed 10k packets/second with a lightweight >> equivalent software and netback/0 fully utilized one 3GHz core. >> > > Hmm... You're using kthread-based netback. In your use case frontend is > likely to create interrupt storm for backend. Do you have breakdown of > CPU usage (sy, si etc)? I am using Linux nix 3.2.53-grsec #1 SMP and the server is pretty much idle expect when I attempt to zmap.Load average: 0.09 0.06 0.13 ps aux | grep netback root 1411 2.6 0.0 0 0 ? S Dec09 696:17 [netback/0] root 1412 0.0 0.0 0 0 ? S Dec09 2:44 [netback/1] root 1413 1.1 0.0 0 0 ? S Dec09 312:39 [netback/2] root 1414 0.0 0.0 0 0 ? S Dec09 0:00 [netback/3] root 1415 0.0 0.0 0 0 ? S Dec09 8:22 [netback/4] root 1416 0.0 0.0 0 0 ? S Dec09 2:54 [netback/5] root 1417 0.0 0.0 0 0 ? S Dec09 0:00 [netback/6] root 1418 0.0 0.0 0 0 ? S Dec09 0:00 [netback/7] It seems to only fully utilize netback/0 when I attempt to zmap and takes one 3GHz core ... Maybe there's something to look at in terms of optimizing? > >> Of course I had tweaked both host/vm network because the default limits >> somewhat cannot properly handle 10k or more packets/second due to the >> default 1k open files limit and so forth >> >> Well you know, basic users can manage with 1k packets and/or connections >> second but I am not a basic user ;) Is there any handy link on how to >> use >> multi-page ring feature. I am going to test that. >> > > Oops I missed the CPU load in your previous email. In that case CPU was > already fully loaded so multi-page ring might not provide you much > benefit. Plus there's no convenient way to test it so I think it doesn't > worth your time. Sorry. > > Just courious, do you have any figures on baremetal performs for zmap? > Yes. I zmap using xeon X3220. The network is 1gbps and I use approx. 225Mbps of bandwidth ~ 350k packets/second 18:05 20% (1h12m left); send: 380081546 389 Kp/s (350 Kp/s avg); recv: 84362 38 p/s (77 p/s avg); drops: 32.0 Kp/s (20.9 Kp/s avg); hits: 0.02% So at that rate, it takes about 1 hour and 45 minute to scan 2 billion IP's. Please find attachment for CPU usage. > Wei. > ------=_20131227170016_10736 Content-Type: image/png; name="zmap.png" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="zmap.png" iVBORw0KGgoAAAANSUhEUgAAA0UAAACxCAIAAACEDoFwAAAACXBIWXMAAA7DAAAOwwHHb6hkAAAK T2lDQ1BQaG90b3Nob3AgSUNDIHByb2ZpbGUAAHjanVNnVFPpFj333vRCS4iAlEtvUhUIIFJCi4AU kSYqIQkQSoghodkVUcERRUUEG8igiAOOjoCMFVEsDIoK2AfkIaKOg6OIisr74Xuja9a89+bN/rXX Pues852zzwfACAyWSDNRNYAMqUIeEeCDx8TG4eQuQIEKJHAAEAizZCFz/SMBAPh+PDwrIsAHvgAB eNMLCADATZvAMByH/w/qQplcAYCEAcB0kThLCIAUAEB6jkKmAEBGAYCdmCZTAKAEAGDLY2LjAFAt AGAnf+bTAICd+Jl7AQBblCEVAaCRACATZYhEAGg7AKzPVopFAFgwABRmS8Q5ANgtADBJV2ZIALC3 AMDOEAuyAAgMADBRiIUpAAR7AGDIIyN4AISZABRG8lc88SuuEOcqAAB4mbI8uSQ5RYFbCC1xB1dX Lh4ozkkXKxQ2YQJhmkAuwnmZGTKBNA/g88wAAKCRFRHgg/P9eM4Ors7ONo62Dl8t6r8G/yJiYuP+ 5c+rcEAAAOF0ftH+LC+zGoA7BoBt/qIl7gRoXgugdfeLZrIPQLUAoOnaV/Nw+H48PEWhkLnZ2eXk 5NhKxEJbYcpXff5nwl/AV/1s+X48/Pf14L7iJIEyXYFHBPjgwsz0TKUcz5IJhGLc5o9H/LcL//wd 0yLESWK5WCoU41EScY5EmozzMqUiiUKSKcUl0v9k4t8s+wM+3zUAsGo+AXuRLahdYwP2SycQWHTA 4vcAAPK7b8HUKAgDgGiD4c93/+8//UegJQCAZkmScQAAXkQkLlTKsz/HCAAARKCBKrBBG/TBGCzA BhzBBdzBC/xgNoRCJMTCQhBCCmSAHHJgKayCQiiGzbAdKmAv1EAdNMBRaIaTcA4uwlW4Dj1wD/ph CJ7BKLyBCQRByAgTYSHaiAFiilgjjggXmYX4IcFIBBKLJCDJiBRRIkuRNUgxUopUIFVIHfI9cgI5 h1xGupE7yAAygvyGvEcxlIGyUT3UDLVDuag3GoRGogvQZHQxmo8WoJvQcrQaPYw2oefQq2gP2o8+ Q8cwwOgYBzPEbDAuxsNCsTgsCZNjy7EirAyrxhqwVqwDu4n1Y8+xdwQSgUXACTYEd0IgYR5BSFhM WE7YSKggHCQ0EdoJNwkDhFHCJyKTqEu0JroR+cQYYjIxh1hILCPWEo8TLxB7iEPENyQSiUMyJ7mQ AkmxpFTSEtJG0m5SI+ksqZs0SBojk8naZGuyBzmULCAryIXkneTD5DPkG+Qh8lsKnWJAcaT4U+Io UspqShnlEOU05QZlmDJBVaOaUt2ooVQRNY9aQq2htlKvUYeoEzR1mjnNgxZJS6WtopXTGmgXaPdp r+h0uhHdlR5Ol9BX0svpR+iX6AP0dwwNhhWDx4hnKBmbGAcYZxl3GK+YTKYZ04sZx1QwNzHrmOeZ D5lvVVgqtip8FZHKCpVKlSaVGyovVKmqpqreqgtV81XLVI+pXlN9rkZVM1PjqQnUlqtVqp1Q61Mb U2epO6iHqmeob1Q/pH5Z/YkGWcNMw09DpFGgsV/jvMYgC2MZs3gsIWsNq4Z1gTXEJrHN2Xx2KruY /R27iz2qqaE5QzNKM1ezUvOUZj8H45hx+Jx0TgnnKKeX836K3hTvKeIpG6Y0TLkxZVxrqpaXllir SKtRq0frvTau7aedpr1Fu1n7gQ5Bx0onXCdHZ4/OBZ3nU9lT3acKpxZNPTr1ri6qa6UbobtEd79u p+6Ynr5egJ5Mb6feeb3n+hx9L/1U/W36p/VHDFgGswwkBtsMzhg8xTVxbzwdL8fb8VFDXcNAQ6Vh lWGX4YSRudE8o9VGjUYPjGnGXOMk423GbcajJgYmISZLTepN7ppSTbmmKaY7TDtMx83MzaLN1pk1 mz0x1zLnm+eb15vft2BaeFostqi2uGVJsuRaplnutrxuhVo5WaVYVVpds0atna0l1rutu6cRp7lO k06rntZnw7Dxtsm2qbcZsOXYBtuutm22fWFnYhdnt8Wuw+6TvZN9un2N/T0HDYfZDqsdWh1+c7Ry FDpWOt6azpzuP33F9JbpL2dYzxDP2DPjthPLKcRpnVOb00dnF2e5c4PziIuJS4LLLpc+Lpsbxt3I veRKdPVxXeF60vWdm7Obwu2o26/uNu5p7ofcn8w0nymeWTNz0MPIQ+BR5dE/C5+VMGvfrH5PQ0+B Z7XnIy9jL5FXrdewt6V3qvdh7xc+9j5yn+M+4zw33jLeWV/MN8C3yLfLT8Nvnl+F30N/I/9k/3r/ 0QCngCUBZwOJgUGBWwL7+Hp8Ib+OPzrbZfay2e1BjKC5QRVBj4KtguXBrSFoyOyQrSH355jOkc5p DoVQfujW0Adh5mGLw34MJ4WHhVeGP45wiFga0TGXNXfR3ENz30T6RJZE3ptnMU85ry1KNSo+qi5q PNo3ujS6P8YuZlnM1VidWElsSxw5LiquNm5svt/87fOH4p3iC+N7F5gvyF1weaHOwvSFpxapLhIs OpZATIhOOJTwQRAqqBaMJfITdyWOCnnCHcJnIi/RNtGI2ENcKh5O8kgqTXqS7JG8NXkkxTOlLOW5 hCepkLxMDUzdmzqeFpp2IG0yPTq9MYOSkZBxQqohTZO2Z+pn5mZ2y6xlhbL+xW6Lty8elQfJa7OQ rAVZLQq2QqboVFoo1yoHsmdlV2a/zYnKOZarnivN7cyzytuQN5zvn//tEsIS4ZK2pYZLVy0dWOa9 rGo5sjxxedsK4xUFK4ZWBqw8uIq2Km3VT6vtV5eufr0mek1rgV7ByoLBtQFr6wtVCuWFfevc1+1d T1gvWd+1YfqGnRs+FYmKrhTbF5cVf9go3HjlG4dvyr+Z3JS0qavEuWTPZtJm6ebeLZ5bDpaql+aX Dm4N2dq0Dd9WtO319kXbL5fNKNu7g7ZDuaO/PLi8ZafJzs07P1SkVPRU+lQ27tLdtWHX+G7R7ht7 vPY07NXbW7z3/T7JvttVAVVN1WbVZftJ+7P3P66Jqun4lvttXa1ObXHtxwPSA/0HIw6217nU1R3S PVRSj9Yr60cOxx++/p3vdy0NNg1VjZzG4iNwRHnk6fcJ3/ceDTradox7rOEH0x92HWcdL2pCmvKa RptTmvtbYlu6T8w+0dbq3nr8R9sfD5w0PFl5SvNUyWna6YLTk2fyz4ydlZ19fi753GDborZ752PO 32oPb++6EHTh0kX/i+c7vDvOXPK4dPKy2+UTV7hXmq86X23qdOo8/pPTT8e7nLuarrlca7nuer21 e2b36RueN87d9L158Rb/1tWeOT3dvfN6b/fF9/XfFt1+cif9zsu72Xcn7q28T7xf9EDtQdlD3YfV P1v+3Njv3H9qwHeg89HcR/cGhYPP/pH1jw9DBY+Zj8uGDYbrnjg+OTniP3L96fynQ89kzyaeF/6i /suuFxYvfvjV69fO0ZjRoZfyl5O/bXyl/erA6xmv28bCxh6+yXgzMV70VvvtwXfcdx3vo98PT+R8 IH8o/2j5sfVT0Kf7kxmTk/8EA5jz/GMzLdsAAAAgY0hSTQAAeiUAAICDAAD5/wAAgOkAAHUwAADq YAAAOpgAABdvkl/FRgAAHYpJREFUeNrsnb2SFUeThg8IMCbAgID4bgVToGthPKRbWEfjIx8c3cya a+wlIBlgKKQIueo1FKtQzOnOevOnqqvPeZ7A0LRO/1Z19ltZWZmn//2f/+Yf//jHP/7xj3/8499x /53+CwAAAACOzOlbAAAAADgyp2+//Xb5f05rLAAAAAAwMeg5AAAAAPQcAAAAAKDnAAAAAAA9BwAA AICeQ88BAAAAoOcAAAAAAD0HAAAAAOg5AAAAAPQceg4AAAAAPQcAAAAA6DkAAAAAQM8BAAAAXIWe AwAAAAD0HAAAAAAcSs+FJ2SZ1QWAgNFYNSPNjbYVWj3FP/+9o7FKnrrT1W5d1dalZp5b+PZ73Dsh SXCxei7/lopv71E2AkBvZXNuQwwRppigVd1myMdd7n3wjrrpbj7wjJ3Udzz/2YB73+tFwBpAsZ77 5x1Gz3m/LmxkIxsDG1d/1nxJY6Jkdd9r0HPNXVwj26RzUd+rRM957x3gcvxz5Xpu1ZV9lI2LZ/aH jWxk4+KcMB2g55TR5gx6Th9krh7Enhh13aOi2Hrrua2ncX5Hqxv1e9cnW42zr/pExOtcvWzjl0m3 C6DnrtE/dwKAPqDnmiLD1gqGsGv+KZpxW+hk9Jzo4Ws6UwOPwrgk5b5WxeWWFFM2bl2zfSLEHHoO /xz+OTay8Rr9c/pek/jnjCtXnmTGgG+ZPr0heognW6sVtmDJJekbdTmOnkPP4Z8jfo6NbJxx4zA9 d4j4ueaf59ql1t3Y9MAV6rla8XQlem7JLUMB9Ny16zkA6C1rMutbdQ3XI+9GJz23FSNl+GmS862K 0lWivvQFyF7xZEsiW+J3uqRMwyX9c4CeU21rcu0SkggAvOYiE+GwFTO+bPv/djdWxnzrqkumKd0y 6yG2YhztBnJNnsY+E/q9u1wM4UtqZm/x6rmtJ+lqYkDPAQBcgijkOXi14xFPcQGXVHg7dHv0HAAA ABx19MIYBj0HAAAAAOg5AAAAAJhczyXduayHAICA0Vg1I82NthVaPYUd6T/slqc92mwdw9tGsRJh gZ4QWyXtvSMjAwNfWPScr4PmTbPxtrCRjVUb4ejf7HMbIuYr2TJBW2lKZshXgp7rdJuxxg18+JQy FaI409+Okvx/gJ5Dz7GRnM9s7LLxCvMJo+cWfwky8TfNlHX5D59Rdc3e3ZvoDj0HS1X8XJWeO3S9 LzZSk42N/TYuV1m/tZn8Vh/ViD6hrdxmzZHSYlaFb15SJiVeQMwt0flW/ffNKh2uGVtXnuemxQP0 XOWYD/8cGwdvPMExQc8FvESrLihvyJervESzZmi/khW6cLEvstARGLjNjJhbWvFz6Dn0XE0/wz/H RvxzbDyKf07fazY9t/oWuCSIsbtS8qH8mOUuhhI95420C+s5r29ynn4LB9Nz+VcO/xwbB28kBO2g G4fpuUPEz50qyrrrGlHxvS1y+fllY1q290NThKNrulaUYkl5XeJeQc+h5zqKOfQcG1nfCkmjkZGD toazY7nm13NbzjDdcaXrOTEczY7hS863xnYP+OdO/oKtoq/OpcBcgw0MIHouMvjIHIGWAACvwQnM 4W4F5i9CRPkues6+cX2dwSLPty7CvKToY9OXPiTXQwR2P/mztTWDO0W16rqdZtM3A04wIOg5AIBL E4U8h91bwfhT2SV5xmG3Rk8G9BwAAFy4sEaUAKDnAAAAAAA9BwAAAHDleo71EACwp+XyJB1sHuTf W87/e9/1EMaf0zbKVhudPEVIjY09dge4Uj1nGx39zbfNNBsXcnYARE2QN7uEXW1zmSBfST5fRm8x t7Ry+Om7uw6V3B0APRc3Fug5cuqycbmINL+XIebOfXK61Zpczw0YsQeGkcns0IXJpQHQcykLQr0v al6x8QI2HlHMZdTeDHru3tttSyhji5Kib5HrotrFQ5XayrogS+4OgJ7b9KXhnzvKRoq7QxUXoOeM QrGT6zlXyQFbFCqOwIx/zvai4Z8DmMU/F/bS4Z/DP8dG/HO7iDlDEi1C9c9J/HPlei6j1xXx5C2n m6zGi54D9Nyeeg5fGvFzbFyInxui52xJNHP83AD/XNKeo+cADqPn8qvo0XOsbwUYKeaaReWNIvQT +ufEZCvLkPnWRVjfKv4pjiKSuwOg55YqoUD+OQAYpudE1/WWHtrRWNnXad/mVrhF8zbtRyee3Xh0 ekl7e2NsdwD0HADARek/bmSvMyZlFioNAD0HAICeAwD0HAAAAACg5wAAAABgFj3HeggAGG25PAkX xd2XjbUCGCsAuHw9R30IUpMAzCDvMkNNMSUbLxcAXKae28rShJ4jdTAbSQh8LDF37pMrHL4CAMyr 55KJxan3RWkvNs6wETGn746eA4BL03NiuUP8cztupGA82FyqnnPdIHoOANBz9XoOBxv+OTbin0s6 53TTFKgYhp4DgEvTc8mxPv454ufYuBA/N5meI34OAK5Lz7mMJnqO9a0AA8Scq6h8U8yxvhUA0HNu Dx8tAQB5y6MXlbfloFJUHgDgovQcAMBB9R8AAHoOAAAAANBzAAAAAICeAwAAAEDP+XdrrRRTjmBH Lq/+no2BjQC9zIcnb46xpMDI32ucSH8LVi/p/ERbF8l6CAC4ZD13ntcqfAS0V7+NmRq7AN5BXaD7 2abAGD2uijP7/96TbqvWzFCZ6DkAQM+h52bRc8nCuwCFes74QVOQJTei5wAAPXffJhrTIue/Qc8N 22jPH9H7oZ+8O1dURga4rnqueUlLy9XHiwMA16XnDAu76iVCz433z11qUXaYVsytDjMU5XTesZUA OPuqzitANEek6DkAuHw9tyrvzuvEo+fwz8EFKzmvH6up55Q/vXrOLg6Bfw4A0HObxvT8f6Hnxm8k fg66ijlxozj866Tn9Eqv6DkAQM8x33oMPQcwWMzp06Ax7eVa34qeAwD0nGQNjTAXMaUTgqx2I0An PbcaX7H6ajfj0pqKMGwrjDiQ82EP+ecA4Lr0HAAAAACg5wAAAAAAPQcAAACAnkPPAQAAAFypnksG CBNiDHBdtkZISrf153JWXiK5GoP1EACAnpOMb9K4A8CFiTnbVtjJjMScdqsbqd8KAOg5n/VEzwFA YPjnrQamizn0HACg5+IGdNmok0jJKQD0XDNjsEvPuRLandchPK/fip4DgCvSc4ucOnirkg+WEQA9 pwsyI5+wUlJiq6L0uZ6z8x5jtQDg0vTcufVcLe1lV5KgAQCuWc8FwuliFSZWjdWqXTKOg9UCgKvW c/jnANBzGT1nHA09BwCw1K5vNfxzxM8BIOl04dXUc4ogEy8DPQcA16vnlo1AE31tGimdAK5N0ome NiWBnG2Cto7Z1IjknwOAq9Nz3nE5AAAAAKDnAAAAAGC4ngMAAAAA9BwAAAAAoOcAAAAA0HMAAAAA gJ4DAAAAAPQcAAAAAKDnAAAAANBzAAAAAICeAwAAAAD0HAAAAAB6Dj0HAAAAgJ4DAAAAAPQcAAAA AGT13AkAAAAADgd6DgAAAOAa9dx9L59z49YxV/9sHvPv7fqJhtHjKemPbtgxe9xR+Hka3ab2Aqqe fOaXWze+9R5tNa633f/ZmDlRp/dIvPgenWFHO8OHDADiem7rz/PjJD8kzY3NS5rEztpfwcw173vM HmcPP89+nSHcP719vsfZ7/0v+0T3NJPxkLd+qZyoRLWc36x48T06A3oOANBzqa81eu5e86HnBnzC Y00cvs782UWNldRzncRcPz0Xu8ipJBR6DgDQc5ej504dJryaU3jouQPpOfGM/56jVB5yc/p1l+ff vPhOem5rXvj8vdh6aKszyOcm2pj4BgD0XDZ+roeeO7XChpRL2lHPuQLL8r601S/HAD1Xfkex52l/ GmsvYPWS+sXPGR4yMX4uqedW37ij6LlmD/FerVder464bDV2716MFxw9BwBl/rmues7lkpl/HqSH V8mw78P8cwP8ZGHd0M9dpwSrdXqtTn5HdeBZxYIU9/WPumxCoX8ur+fERScTzkUAAHquWM9NZd28 1znVeghj9K8sbOyn5/IaZYyeC5y3q57T4+eSem7f+Lnj6rkeC27+5uHDh0+ePLm5uXn69OnNzc2T J0+++eabkh8DAHou+CERvy7zzLe6rvPoeq6352D1RJOvb43l6CmXWcaM/F4nmkTPjekMXj2n++ds 0/3o0aNXr169fv369vb27u7up59+uru7e/fu3evXr1++fPno0aPwjwHgkvVcPg9ZMzBu9ZjTzkF4 I36myj+3+rXwBmyNWQ8xYf45vSsm888FfhnzzwWmAnu3/oT558Qnb6xGtxdznHfvref84MGDp0+f vn379uPHj1++fLn3BL58+fLp06e3b98+ffrU+2MAuCg9BwAAc/LgwYPnz5+/e/fu8+fPRrXHz58/ 397evnjx4sWLF+KPnz9//uDBA54wAHoOAAD68uzZs9vb299//71ZwPuPP/74/vvv379/L/749vYW Lx0Aeg4AAPry6NGjN2/e2M62f/P169evX7+KP/78+fObN2+IpQNAzwEAQEdevXr18ePHpRufPn16 +fIlzxlgdj0nBvmecmsXklStA90LO8Fpj3MVPu0ey1O8D8RYorEVXR5uoK0swXp261hnUJpj5FoQ vS8lz64nWM4ksk7uPi0PHz58/fr1+ZqGQr58+fL69euHDx9636NCq2hn2Txc8+FPKfmeTnIx5fbT IaL+redKan7bN4aeG5m1K3/MgN08z2tvd0HvAxGPNiZTRm29L/GbZx+t07ctk74u/3YEZG74vIf+ uD558uTdu3dLZ969e/fkyZPAgy0xAqv/V7Q2M4uS2q9VspbgsM904W2Ob3e91crTf+6v58o/LRej 54blSwscwaXnAhY2UFQ++c5UibnTwPqt4Xsf3Je66rnmvZ9COeeSu0/Fzc3N3d1dbz13d3d3c3PT W8+5NqLnZtNzY84+28WH02TW67mYW0KcYnMVjlRSOnmngE9TVsuZWc9lPt52cc/kAxmWUNrrY+6q 5zKXtFdfqh18e81Uj+d5bmruzciftBCFUy4eYGv3p0+ffvjwobee+/Dhg7jKNfZWxlwJAWtjfzsy H6mTnK5y639lylIbBZe37qV3bMbqo9Nv03jy+u1nIsT0SJvV2/Sata3u3WimLT2nxy2d1rJcBkYb zcrTJ7lGdUZ37qLuj6jnlEIgXgsbLipf+7003jTjmOPj5wJtNLIvlY+8m+0+TM81ncdNA607rgzh eL77zc3Njz/+ON4/VxjKGS6AplibkmDfpO4Uxa6rMI+3Ywd0tiuq+NSKk9GrRBrXrPSuroExYmRn ctrBUZP9XM8p8adet0RVIfB+G8crud7xvP30nLcIWFjNB47m/V6WfPKrWjNWi9YYoZYPPGKtmR/c D1ac4bg9YyRZWMzG2P3x48dj4uceP35c7p8T/UnlJj2pk2wtK56o/L22i8cM+AKK9+56nrpxtt84 +0T6L8XvYI84aUnPhWcfDqrndgm2SA689tVz4icwbyKTeq6royg2vhym53qskk46BvL+4An1XLNg 68kzw1AyGvx7faueT67r+tZTotDcsfSc2Fh5Pad/tg6t5zKu9HAFat2DW9JpwwYwuL7Ve3S9wfJ6 LjPfehKqH44Uc7HH5TpX0lkSeNPyMWTiCz/MvicL1VepkOSqo7ysdzVHrZhLenBr4xq3noOh584D ecvj506n06tXrz59+tQ1/9yrV68KrYfXCChL4HfUczFXghi+Ehv0iuuFTz1XkrlmUfWvWPO5DZtv FS8+YD8d/fOenguk3drStiWD3VOH9RC9nRnK2Nq41B6nK7nUvNs5/0B6ZIBrXpWxMR82FPtlYLbi VBRQuHW65tlL3g5XgHNzd/EhBwbxriVZtarXWx/CxS+//PLdd9+J9SH0nuC1iuXxKq7XMGwutjpD c1lA8zqVjeGo/PyHw3t2XUjYzXFqBfdX5UfUbzNmP9XrvML6EBeTOxSgVgrMc8weJ5rnTe99I8+e PXv//v2ff/5ZK+b++uuvn3/++T//+Q/v0ZW82nCwhrvOel+dFmkDAOyr5x48ePDixYsffvjht99+ K/fP/frrr2/fvqV+K8CM2POtAAAAADA56DkAAACAy9Jzq5OSPTamLjp6nKoLyF+/MfPb41yFR3BN /YiXYe91MldmNE8auH3XrH2mz9uRAM1u49o93xnE3Uve99iJYg9kwGt4pV+XUFsozXH+uk1o50da abrZPB/3cvupm7WV/HP3/uyx8Zr13NYDOf+PwnNlnth5x1JM7arg0/XislFyW5GGPR7jaTtHZabP 67emHLMpBzNPRty95H0XP//NJx+wBj36z5V/a8UXQbeKq/93y0Yd8UGV9EB9906PSzxs4W2Ob3e9 1TL209GU6LkZ9NyAp5R0U4n6Y1XDBfScIfLy70yVmJtKz3WVWa47yvc6RbBmDZ8giJF0++o510b0 3Gx6bszZZ7v4gGGpNGtG/NzJTLO09a1Vfmnb8eYHXv/lsl2NZ6oOMaeeU0TGVvs2lxXrInJpTa/0 G6g1Z3uTrRnTc6syumtnCO9eOPRqjgqWVqGtQj1nrDldzMqStgXzGo35tUvsrYx5Dbaef9jsZD5S RruLH/JmNoaAFTXupbYjbdkoJVjF+9F3fUSUNhLjaoyH7Gr3SrO2peeUT+b5+yMqKvHbpozG9Jff 1p37Grsj6jk70iWm58Q51ubHvuSD543JGxY/F2jcXfRcefyc4pd1OYR0s6u/xYoL2XWdhnCcx4/o ii7NWMWkntt6nnq7Bz49ykhPGTeGr9N+toGRthE8bSvUZisvwuS7S4xWBcYoXdQlTrqYtXM9p8Sf ht0SXV3u5a3Y2/yVa68xek4JW3YFvS3OQD3xO13o0lfWZCTdPF3dHoP1XMkqnKTzuGr06G2IU6se 147u0sn9c6I/qdykJ3WSrWXFE52c9XjCb1DAu9/jA9SURE3vpuifs+M31HUG8iWV9M+4WTtf3xqw rcfVc7tMWCQHXvvqOdFdF1jf6jpavitW6blMa255XA6t54bFyHq9kj3MruErsn+TGW9M6J/Ld9TM p3F3PSc2Vl7P6Z+tQ+u5gMfR1W10LShGbBcalpRZM9ZDeI/eI2S7x3zrIk8BjxFzzf6dP1dVlorY 3OviCcJTtE5sEJ+UsGEzIdrl2Mi7ZI4g2Zc6RS4GbjwZd+x6SvaS561JIm9AjD1ouZj4OZdVbDbW vnou5kpQXivXtJ3+xDqNDQJ6zr7NgJ7Tg/vztlS8+ID9dFynXe9rEQIjtrSt/Tl0PbLa9RA93Ale rRBI0lboWwpfql19KKPnxD5WngFOvHejK2bChmJZ+vRReG1mNTs9TbN7Z568fqJmhHWzh3iTpa2a F9eSrB7Oy0nEXD6QdEz+OVeePHF3fX1eVae1N4aj8quMp352JSBPaY5FDu5P5kfUbzNmP9X36Arr Q5CVAK6wn3Oied70K9FzcJHvO0zbcFda76vTIm0AAPQcAOxgWKjfCgAAAICeAwAAAIBp9FwmsfLS JzJ95aKPXO9ryQVix85VeARlxYx3qYcYAr/ajs2T5kPy7bvL9Pl8AiRX3+6xHkLv3j1eVbtzenPo 5xdzgPJe563igPyd4x8UHSbZzSa5mHL76fhMUL913/YOJEoInCu/xNX4fDaNeKB+6yLXiii/ZfE9 rFoGH1vgHFuSmXkymXrS/YRj+NaSdRIh8Jwz+SCa2Teo3xrefUz+uU5n3zcRYyB5Xj5rm+qfQ8/t pefmzCfczHhuDKaTes4QecvwHH56MuExei7wzg9L0FXS6xZ//jm34UPPTa/nYhlJ0XOT6LkxZ5/t 4nvkxQzqOf3K+qXs06saZ/L9zNYhjli/1ZYjsfqtTT0nvjO1iZR0CzJAz8WyBO9VYKpw6KXkeXIU rs6l+bWzMIaLi3uNxsXkE9bfo2T9VpfZyXykjHYXP+R6hlfdihr3UtuRjATsrmyRykff9RFR2iiQ fLR5m7bxaZZ7Vu3Slp7TK44vRSn7XFUfMvUh5tFzVfnNd9FzdqRLTM+Jc6zixz5pp7wxeV3j55rf gAn1XHn8nPhx0p/JqpIL36buQnbVr2um755k2iGTB1W3ikk9p1Rzco0ElqLZKmXcmC8b1awPERvD iPLRnjR3DVl1MTqsPoRXxjTPa0yLOfScEn867JEdZQo4KZKOpeeUsGWv58k1sSt6eQtd+mJVGe+T DzgvY86PwXquZBVO/pKSfsSYvN4aSYYFRL9Xezb/nOhPKjfp+XpfhpYNv7/iKNr7Bh2ifqtSYUL0 z9nxG8nlaD3qty5yjHhbz2VKuB5Rz+0yYZEceO2r50R3XWB9q+toga7YSc9lWtMomCa2qW6Pdvzg Xaqes31FVX5Er+45qJ6rqou67F2/1WisvJ7TP1uH1nOZlzRcaFv34JZ02irTt6nnkkZtpJ7LzLcu QlHXkWKu2b/z56rKUhGbe108QXiK1okN4pMSNmwmRLvsCvnKDBLK17d2ilzUH6wYt+B99WIP3NBz gUA9e9ByMfFzrqbxtvtgPRdzJSivlat760+s09ggoOfEkvZ6c9QG95dcfMB+Oq7znp7TJ8j1aE1X qOnqg6hdD9HDneDVCoEkbYW+pfClbkXF5fWc2MfKM8CJ9250xVT55FAqFpfrrqozLLl60sknr99R oLS5srt3EO9aklXuvJxHzOUDScfkn3PlyRN319fnBTqt/r7no/KrjKd+diUgT2mOpSi4X3/yzduM 2U/1PbrC+hBHTz4JMNVX/ygnmudNp34rHPc1hGkb7krrfZECHgDQcwBwOYaF+q0AAAAA6DkAAAAA mEbPZRIrL6MqzR+63tewp1R1zOaKhGbF+kXLV6In7xVLsFeF5Nt31ynMtkcT91gPMeEdDdsdXO9R oVUckL9z/IOiwyS72SQXU24/HXmpetdvXTpk4ri8+q3LrPlKvPVbbcGn68VFrhVRfsv6V3/ptgy+ RxP3y1cy1R0N2x285i6TD6KZfYP6reHdx+Sf63T2fRMxBpLnBexnsH7rUYoxXJ6emzOfcDPjuTGY Tuo5Q+Qtw3P46cmEk3quXxMPS9DV9USFeQenrRyDnot9ZdBzs+m5MWef7eIDCeS8Zk3Vc/qVNVP2 BSrb6FnlkvnnprLaM+u5pn005F2sfmtTz4nvTG0iJd2CoOeSN6gnqdpXz9lZGMPFxb1G42LyCevv UbJ+q8vsZD5SRruLH/Kq/IjNPt+jIxkJ2JW0aq6PvusjorRRIPlo8zZFs2a8CKn8c3rF8WUtZV/Y RHpHY4s/H/c8eq4qv/kues6OdInpOXGOVcnKmP/geWPyxsfPTa7nyu9oTv/cea9bWi5kV/26Zvru SaYdMnlQdauY1HNKNSd9RqxwtkoZN+bLRjXrQ3ib2A5fbn7fl2hhG12MDqsP4ZUxzfMa02IOPReI ERY9ect89Vv3soYD4nn76TklbNlb+sI1sSt6eQvdYGJVmXm8WfvquUxZjmEOthLLsGW7m0uIdnGX Tu6fE/1J5SY9X+/L0LKx8YntecoYk0PUb1UqTIj+Obs0lF7/Wrykkv4ZLhS0sr418Jk5rp7bZcIi OfDaV8+J7rrA+lbX0QKjsU56rrA1L0PPJZfQHkjP2b4i+zeZ8caE/rm8nquqi7rsXb/VaKy8ntM/ W4fWcwGPo6vb6FpQjNguNCzhll3s9RB5MddsufDbm5lvXYSiriPFnOspxc5VlaUiNve6eILwzrfb BqiTfVcKfS758sk9V4O6ylpXnSjfe0smYnrsLppyQ89tFe6MPaJLip9zWcVmToB99VzMlaC8Vq5p O/2JdRobBPScmChDbw7bI1473xrO8uGtUevQc/oEuV4VODaesOMQl8R6iEJ3QlgeBZK0FfqWwpe6 FRWX13NiH+uRAU65KqMrJsOGOmVr65HgMFNPeuQd9djdO4h3LcmqGhNOKOYC8ft6UqTacZH+woq7 6+vzxFrvi1wVfuvdtHVP7TKyzNmVgDylOWwhUWKovbcZs5/qe3SF9SHISgBX2M850TxvOvVb4biv IUzbcFda76vTIm0AAPQcAOxgWKjfCgAAAICeAwAAAAD0HAAAAACg5wAAAADQcwAAAABwMP5vAJ0C 3wzZW/wTAAAAAElFTkSuQmCC ------=_20131227170016_10736 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users ------=_20131227170016_10736-- From xen-users-bounces@lists.xen.org Fri Dec 27 15:50:57 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 15:50:57 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwZfr-00035G-Jm; Fri, 27 Dec 2013 15:50:07 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwZfq-00035A-U6 for xen-users@lists.xen.org; Fri, 27 Dec 2013 15:50:07 +0000 Received: from [85.158.143.35:58868] by server-3.bemta-4.messagelabs.com id EE/47-32360-EA1ADB25; Fri, 27 Dec 2013 15:50:06 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-16.tower-21.messagelabs.com!1388159404!8406458!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 21861 invoked from network); 27 Dec 2013 15:50:05 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-16.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 15:50:05 -0000 X-IronPort-AV: E=Sophos;i="4.95,561,1384300800"; d="scan'208";a="85881267" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 27 Dec 2013 15:50:04 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Fri, 27 Dec 2013 10:50:03 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VwZfn-0002Bf-ET; Fri, 27 Dec 2013 15:50:03 +0000 Date: Fri, 27 Dec 2013 15:50:03 +0000 From: Wei Liu To: NiX Message-ID: <20131227155003.GA31278@zion.uk.xensource.com> References: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> <20131227102830.GN25969@zion.uk.xensource.com> <20131227123824.GA23996@zion.uk.xensource.com> <49490a160a437a4234aede8a5dfa1444.squirrel@gameframe.net> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <49490a160a437a4234aede8a5dfa1444.squirrel@gameframe.net> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA2 Cc: xen-users@lists.xen.org, Wei Liu Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Fri, Dec 27, 2013 at 05:00:16PM +0200, NiX wrote: > > On Fri, Dec 27, 2013 at 02:17:19PM +0200, NiX wrote: > >> > On Tue, Dec 24, 2013 at 05:06:37PM +0200, NiX wrote: > >> >> Hi. I am running a XEN VM in PV mode. This VM has four cores enabled. > >> VM > >> >> network config is as follows: > >> >> > >> >> vif = ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] > >> >> > >> >> Dom0 is dual XEON X5450 with 16GB of RAM. > >> >> > >> >> I can barely zmap at 10mbps ~ 12k packets/second on this VM > >> >> > >> > > >> > My google-fu tells me that zmap sends out gigantic amount of TCP SYN > >> > packets in its default configuration. It is possible the ring size > >> > between frontend and backend is the bottleneck. Data copying from > >> > frontend to backend might also be a problem. > >> > > >> > You can probably patch your Dom0 and DomU kernel with multi-page ring > >> > support to see if it makes it better. > >> > > >> > Wei. > >> > > >> > >> I was not able neither to exceed 10k packets/second with a lightweight > >> equivalent software and netback/0 fully utilized one 3GHz core. > >> > > > > Hmm... You're using kthread-based netback. In your use case frontend is > > likely to create interrupt storm for backend. Do you have breakdown of > > CPU usage (sy, si etc)? > > I am using Linux nix 3.2.53-grsec #1 SMP and the server is pretty much > idle expect when I attempt to zmap.Load average: 0.09 0.06 0.13 > > ps aux | grep netback > root 1411 2.6 0.0 0 0 ? S Dec09 696:17 [netback/0] > root 1412 0.0 0.0 0 0 ? S Dec09 2:44 [netback/1] > root 1413 1.1 0.0 0 0 ? S Dec09 312:39 [netback/2] > root 1414 0.0 0.0 0 0 ? S Dec09 0:00 [netback/3] > root 1415 0.0 0.0 0 0 ? S Dec09 8:22 [netback/4] > root 1416 0.0 0.0 0 0 ? S Dec09 2:54 [netback/5] > root 1417 0.0 0.0 0 0 ? S Dec09 0:00 [netback/6] > root 1418 0.0 0.0 0 0 ? S Dec09 0:00 [netback/7] > > It seems to only fully utilize netback/0 when I attempt to zmap and takes > one 3GHz core ... Maybe there's something to look at in terms of > optimizing? > That's expected, because only one netback thread is necessary to serve that VIF. Could you run 'top' then press 1 and copy the summary area in your email? It should look like this: top - 15:49:09 up 27 days, 6:14, 16 users, load average: 5.00, 5.02, 5.08 Tasks: 259 total, 2 running, 257 sleeping, 0 stopped, 0 zombie %Cpu0 : 1.0 us, 1.3 sy, 97.7 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st %Cpu1 : 0.0 us, 0.3 sy, 99.7 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st %Cpu2 : 4.0 us, 53.5 sy, 42.5 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st %Cpu3 : 1.7 us, 40.2 sy, 58.1 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st KiB Mem: 8132308 total, 7385188 used, 747120 free, 160348 buffers KiB Swap: 0 total, 0 used, 0 free, 3283276 cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 3378 colord 20 0 284m 110m 2484 R 98.0 1.4 15502:29 colord-sane 25531 weil 20 0 24788 3268 1436 S 2.0 0.0 165:58.78 htop 22448 weil 20 0 1010m 97m 24m S 0.7 1.2 4:57.67 chrome Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 15:50:57 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 15:50:57 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwZfr-00035G-Jm; Fri, 27 Dec 2013 15:50:07 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwZfq-00035A-U6 for xen-users@lists.xen.org; Fri, 27 Dec 2013 15:50:07 +0000 Received: from [85.158.143.35:58868] by server-3.bemta-4.messagelabs.com id EE/47-32360-EA1ADB25; Fri, 27 Dec 2013 15:50:06 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-16.tower-21.messagelabs.com!1388159404!8406458!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 21861 invoked from network); 27 Dec 2013 15:50:05 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-16.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 15:50:05 -0000 X-IronPort-AV: E=Sophos;i="4.95,561,1384300800"; d="scan'208";a="85881267" Received: from accessns.citrite.net (HELO FTLPEX01CL02.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 27 Dec 2013 15:50:04 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.79) with Microsoft SMTP Server id 14.2.342.4; Fri, 27 Dec 2013 10:50:03 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VwZfn-0002Bf-ET; Fri, 27 Dec 2013 15:50:03 +0000 Date: Fri, 27 Dec 2013 15:50:03 +0000 From: Wei Liu To: NiX Message-ID: <20131227155003.GA31278@zion.uk.xensource.com> References: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> <20131227102830.GN25969@zion.uk.xensource.com> <20131227123824.GA23996@zion.uk.xensource.com> <49490a160a437a4234aede8a5dfa1444.squirrel@gameframe.net> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <49490a160a437a4234aede8a5dfa1444.squirrel@gameframe.net> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA2 Cc: xen-users@lists.xen.org, Wei Liu Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Fri, Dec 27, 2013 at 05:00:16PM +0200, NiX wrote: > > On Fri, Dec 27, 2013 at 02:17:19PM +0200, NiX wrote: > >> > On Tue, Dec 24, 2013 at 05:06:37PM +0200, NiX wrote: > >> >> Hi. I am running a XEN VM in PV mode. This VM has four cores enabled. > >> VM > >> >> network config is as follows: > >> >> > >> >> vif = ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] > >> >> > >> >> Dom0 is dual XEON X5450 with 16GB of RAM. > >> >> > >> >> I can barely zmap at 10mbps ~ 12k packets/second on this VM > >> >> > >> > > >> > My google-fu tells me that zmap sends out gigantic amount of TCP SYN > >> > packets in its default configuration. It is possible the ring size > >> > between frontend and backend is the bottleneck. Data copying from > >> > frontend to backend might also be a problem. > >> > > >> > You can probably patch your Dom0 and DomU kernel with multi-page ring > >> > support to see if it makes it better. > >> > > >> > Wei. > >> > > >> > >> I was not able neither to exceed 10k packets/second with a lightweight > >> equivalent software and netback/0 fully utilized one 3GHz core. > >> > > > > Hmm... You're using kthread-based netback. In your use case frontend is > > likely to create interrupt storm for backend. Do you have breakdown of > > CPU usage (sy, si etc)? > > I am using Linux nix 3.2.53-grsec #1 SMP and the server is pretty much > idle expect when I attempt to zmap.Load average: 0.09 0.06 0.13 > > ps aux | grep netback > root 1411 2.6 0.0 0 0 ? S Dec09 696:17 [netback/0] > root 1412 0.0 0.0 0 0 ? S Dec09 2:44 [netback/1] > root 1413 1.1 0.0 0 0 ? S Dec09 312:39 [netback/2] > root 1414 0.0 0.0 0 0 ? S Dec09 0:00 [netback/3] > root 1415 0.0 0.0 0 0 ? S Dec09 8:22 [netback/4] > root 1416 0.0 0.0 0 0 ? S Dec09 2:54 [netback/5] > root 1417 0.0 0.0 0 0 ? S Dec09 0:00 [netback/6] > root 1418 0.0 0.0 0 0 ? S Dec09 0:00 [netback/7] > > It seems to only fully utilize netback/0 when I attempt to zmap and takes > one 3GHz core ... Maybe there's something to look at in terms of > optimizing? > That's expected, because only one netback thread is necessary to serve that VIF. Could you run 'top' then press 1 and copy the summary area in your email? It should look like this: top - 15:49:09 up 27 days, 6:14, 16 users, load average: 5.00, 5.02, 5.08 Tasks: 259 total, 2 running, 257 sleeping, 0 stopped, 0 zombie %Cpu0 : 1.0 us, 1.3 sy, 97.7 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st %Cpu1 : 0.0 us, 0.3 sy, 99.7 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st %Cpu2 : 4.0 us, 53.5 sy, 42.5 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st %Cpu3 : 1.7 us, 40.2 sy, 58.1 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, 0.0 st KiB Mem: 8132308 total, 7385188 used, 747120 free, 160348 buffers KiB Swap: 0 total, 0 used, 0 free, 3283276 cached PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND 3378 colord 20 0 284m 110m 2484 R 98.0 1.4 15502:29 colord-sane 25531 weil 20 0 24788 3268 1436 S 2.0 0.0 165:58.78 htop 22448 weil 20 0 1010m 97m 24m S 0.7 1.2 4:57.67 chrome Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 19:04:21 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 19:04:21 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vwcgr-0000sV-9l; Fri, 27 Dec 2013 19:03:21 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vwcgo-0000sQ-Sx for xen-users@lists.xen.org; Fri, 27 Dec 2013 19:03:19 +0000 Received: from [85.158.143.35:56629] by server-2.bemta-4.messagelabs.com id 04/87-11386-6FECDB25; Fri, 27 Dec 2013 19:03:18 +0000 X-Env-Sender: ehouby@yahoo.com X-Msg-Ref: server-6.tower-21.messagelabs.com!1388170995!1365942!1 X-Originating-IP: [98.139.212.174] X-SpamReason: No, hits=1.1 required=7.0 tests=BODY_RANDOM_LONG, FORGED_YAHOO_RCVD,ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30220 invoked from network); 27 Dec 2013 19:03:16 -0000 Received: from nm15.bullet.mail.bf1.yahoo.com (HELO nm15.bullet.mail.bf1.yahoo.com) (98.139.212.174) by server-6.tower-21.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 27 Dec 2013 19:03:16 -0000 Received: from [66.196.81.170] by nm15.bullet.mail.bf1.yahoo.com with NNFMP; 27 Dec 2013 19:03:15 -0000 Received: from [68.142.230.65] by tm16.bullet.mail.bf1.yahoo.com with NNFMP; 27 Dec 2013 19:03:15 -0000 Received: from [127.0.0.1] by smtp222.mail.bf1.yahoo.com with NNFMP; 27 Dec 2013 19:03:15 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1388170995; bh=wvOPCF6WryFC7xuxOvAJryU7vAIZ8+61nA6iwBkhGuM=; h=X-Yahoo-Newman-Id:X-Yahoo-Newman-Property:X-YMail-OSG:X-Yahoo-SMTP:X-Rocket-Received:From:To:References:In-Reply-To:Subject:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:X-Mailer:Thread-Index:Content-Language; b=LvlI/X4Kzpgi5gS80OHVfVHNzimO5ndJSymeZZfArCqV8U+HzCzdIPeOATb1jCZjVCLjCb0Bu6D5Ep+jBfuMw7dxtuXVwiZ0y6zTHRVvigEwlhBw1ye5SjceBVohT5fSHRP0eZk4CiOcTix/MBS/VeRouOqivXKiNmtgapNyMOM= X-Yahoo-Newman-Id: 432787.84135.bm@smtp222.mail.bf1.yahoo.com X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: AXwL0_cVM1nop2QNfjLdvQaz8ZXUaN9k1IbeH7PIhZhWRjC w99Id6UooZlk1A9KUOXxWZluLKvZJVEHiTYHavrfShIxu7Kqhm_Q42rXAG72 uWiraGVZFv6Q1j61Kt6CDlu2jvhw9LENXH_qelHnkKUCrkS34v8YwDmd_TLU f5sSLPXpWF0V.XvOyYvXL6Q58TjRwQsufzZUvVAQ04mHTgRqKs8kkwvCR5QJ h2F61D80EGYDIAZq5A.4RFsQuMmCY8ySY1Bt_YemyOzPFewIiYe_XcsdaKQd Kw8ecQvwb2aCM77ECGg6HnTWjI04Dp8To9wMrktdQkOGUJGifaLkiVzx6AxS aglfCeC3.Y2i0IMqdviXj08XOG3UtEZ4ChBqNY66DqG4rHfyB1kqcVnLl5MR Ph42gZHwYxljIieBpPAfk8JQq8o7AhzozbxgFbLrosIONSxW656_ypINC5iL fnW1mLhvWcfhleBddv0c45pWYPyiE8fSqS5gIjBrH_T.4Xm0tKto2qCIb4uR J5Y2DAJD6KaXK9rcGGiDgt5f.QwNkDAojTGBlV5lirV7oEyeudR.Wz8yKMOz pyOAL2LVR7ofrEggVHA8ov91h5PFmupAUji8CxcMMMtb1GnNBApKtMe36CDE HOoHpVsntPw-- X-Yahoo-SMTP: QpZsTh.swBBbiXoX3lukB1DLTA-- X-Rocket-Received: from phobos (ehouby@71.196.207.87 with plain [63.250.193.228]) by smtp222.mail.bf1.yahoo.com with SMTP; 27 Dec 2013 19:03:14 +0000 UTC From: "Eric Houby" To: "'Michaael Mair-Keimberger'" , References: <20131222140821.GB7095@asterix> <00bb01ceff80$cdae1dc0$690a5940$@yahoo.com> <20131224124225.GA3203@asterix> In-Reply-To: <20131224124225.GA3203@asterix> Date: Fri, 27 Dec 2013 12:03:12 -0700 Message-ID: <029101cf0336$4b8098f0$e281cad0$@yahoo.com> MIME-Version: 1.0 X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQGZlYK36b84yUdNG3pyEhhUL/BDQANUR2XfAfcYrjiaqOOa8A== Content-Language: en-us Subject: Re: [Xen-users] vga passthrogh on mainboards with broken ivrs tables X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Michael, Sorry to hear you were not able to get passthrough of your video card working. Could you get IOMMU enabled by using no-amd-iommu-perdev-intremap in the xen command line? > (XEN) AMD-Vi: IOMMU 0 Enabled. > (XEN) AMD-Vi: Enabling global vector map > (XEN) AMD-Vi: Using global interrupt remap table is not recommended > (see XSA-36)! > (XEN) I/O virtualisation enabled Thanks for the heads up on irvrs_ioapic. I will keep an eye out for it in xen 4.4 Thanks, Eric -----Original Message----- From: xen-users-bounces@lists.xen.org [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Michaael Mair-Keimberger Sent: Tuesday, December 24, 2013 5:42 AM To: xen-users@lists.xen.org Subject: Re: [Xen-users] vga passthrogh on mainboards with broken ivrs tables Hi Eric, I still couldn't get it to work. However, since the ivrs_ioapic kernel parameter didn't do anything (i didn't even got any log messages about it) i've dug further into this parameter. Sadly i found out it's not included in xen-4.3.1 and since gentoo doesn't provide git ebuilds for xen i'll gonna wait until next xen will be released. xen-4.4 should be release on 21.01.14 - Thats not that far away and i guess i can wait for it :) If you want to passthrough your graphic card i suggest you to install a older version of xen. Personally i have my own xen-4.2.1 ebuild which don't include XSA-36. That one works perfectly well. If irvs_ioapic won't help with next xen I'll go back too... Regards, Michael On Sun, Dec 22, 2013 at 06:46:29PM -0700, Eric Houby wrote: > Michael, > > I have a GA-990FXA-UD3 H/W ver 1.1 that will boot up Xen 4.3.1 (Fedora > 20) with IOMMU enabled. > > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 > (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x1 handle 0x8 > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 > (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x2 handle 0 > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0 > (XEN) AMD-Vi: IVHD Special: 0000:00:00.1 variety 0x1 handle 0x8 > (XEN) IVHD Error: Conflicting IO-APIC 0x8 entries > (XEN) AMD-Vi: IOMMU 0 Enabled. > (XEN) AMD-Vi: Enabling global vector map > (XEN) AMD-Vi: Using global interrupt remap table is not recommended > (see XSA-36)! > (XEN) I/O virtualisation enabled > (XEN) - Dom0 mode: Relaxed > (XEN) Interrupt remapping enabled > (XEN) ENABLING IO-APIC IRQs > > My xen command line is: > > dom0_mem=2048M,max:2048M dom0_max_vcpus=2 dom0_vcpus_pin loglvl=all > guest_loglvl=all iommu=debug,verbose,no-amd-iommu-perdev-intremap > > PCI passthrough of USB controllers works without issues, but I have > not been able to passthrough a secondary graphics card (HD 5750) > without getting a BSoD on my Win7 HVM. I have had the same 5750 and > VM image working on a GA-890FXA, but have not been able to get the > combination working on the GA-990FXA. If you are able to get IOMMU > enabled, I will be interested to see if you get the graphics card to passthrough. > > Good luck. > > -Eric > > > > > -----Original Message----- > From: xen-users-bounces@lists.xen.org > [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Michaael > Mair-Keimberger > Sent: Sunday, December 22, 2013 7:08 AM > To: xen-users@lists.xen.org > Subject: [Xen-users] vga passthrogh on mainboards with broken ivrs > tables > > Hi Lists, > > I'm having troubles getting vga passthrough working again with latest > xen-4.3.1. > > My system is a bulldozer amd 8core cpu with a gigabyte GA-990FXA-UD5 > motherboard. > The host system uses a amd hd6850 while the guest (windows 7) uses a > amd hd 7970. > > So far everything worked great until xsa-36 [1]. I've haven't updated > xen since this "fix", but yesterday i'll gave it another try. I've > updated to > xen-4.3.1 and tried to fix those broken ivrs tables with the newly > introduced ivrx_ioapic kernel parameter. I'm not sure if this should > help me, but at least it sounds promising. > However i didn't get it to work and i hope someone can give my some > hints how to fix that, otherwise i have to downgrade xen again. > > > grub2 config: > > menuentry 'Gentoo Linux XEN' { > root=hd0,1 > multiboot /boot/xen.gz dom0_mem=8192M,max:8192M iommu=1 > dom0_max_vcpus=4 dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 > module /boot/gentoo-3.12.6 root=/dev/md3 radeon.pcie_gen2=1 > radeon.dpm=1 softlevel=xen xen-pciback.permissive > xen-pciback.hide=(01:00.0)(01:00.1)(00:12.0)(00:12.2) > } > > lspci: > > 00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI > to PCI bridge (external gfx0 port B) (rev 02) > 00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD/ATI] RD990 I/O Memory > Management Unit (IOMMU) > 00:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI > to PCI bridge (PCI express gpp port B) > 00:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI > to PCI bridge (PCI express gpp port H) > 00:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI > to PCI bridge (external gfx1 port A) > 00:0d.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI > to PCI bridge (external gfx1 port B) > 00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] (rev 40) > 00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI0 Controller > 00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB EHCI Controller > 00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI0 Controller > 00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB EHCI Controller > 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 SMBus > Controller (rev 42) > 00:14.1 IDE interface: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 IDE Controller (rev 40) > 00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 > Azalia (Intel HDA) (rev 40) > 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 LPC host controller (rev 40) > 00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 PCI > to PCI Bridge (rev 40) > 00:14.5 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI2 Controller > 00:15.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] > SB700/SB800/SB900 PCI to PCI bridge (PCIE port 0) > 00:15.1 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] > SB700/SB800/SB900 PCI to PCI bridge (PCIE port 1) > 00:15.2 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI > to PCI bridge (PCIE port 2) > 00:15.3 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI > to PCI bridge (PCIE port 3) > 00:16.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI0 Controller > 00:16.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB EHCI Controller > 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h > Processor Function 0 > 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h > Processor Function 1 > 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h > Processor Function 2 > 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h > Processor Function 3 > 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h > Processor Function 4 > 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h > Processor Function 5 > 01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. > [AMD/ATI] Tahiti XT [Radeon HD 7970] > 01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Tahiti XT > HDMI Audio [Radeon HD 7970 Series] > 02:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host > Controller (rev 01) > 03:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA > 6Gb/s Controller (rev 11) > 04:00.0 VGA compatible controller: Advanced Micro Devices, Inc. > [AMD/ATI] Barts PRO [Radeon HD 6850] > 04:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Barts > HDMI Audio [Radeon HD 6800 Series] > 05:0e.0 FireWire (IEEE 1394): VIA Technologies, Inc. VT6306/7/8 [Fire > II(M)] IEEE 1394 OHCI Controller (rev c0) > 06:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. > RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06) > 07:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host > Controller (rev 01) > 08:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA > 6Gb/s Controller (rev 11) > > lspci -t: > > -[0000:00]-+-00.0 > +-00.2 > +-02.0-[01]--+-00.0 > | \-00.1 > +-09.0-[02]----00.0 > +-0a.0-[03]----00.0 > +-0d.0-[04]--+-00.0 > | \-00.1 > +-11.0 > +-12.0 > +-12.2 > +-13.0 > +-13.2 > +-14.0 > +-14.1 > +-14.2 > +-14.3 > +-14.4-[05]----0e.0 > +-14.5 > +-15.0-[06]----00.0 > +-15.1-[07]----00.0 > +-15.2-[08]----00.0 > +-15.3-[09]-- > +-16.0 > +-16.2 > +-18.0 > +-18.1 > +-18.2 > +-18.3 > +-18.4 > \-18.5 > > xl dmesg (shorten): > > (XEN) Xen version 4.3.1 (@xonet.at) (x86_64-pc-linux-gnu-gcc (Gentoo > 4.8.2 p1.0, pie-0.5.8) 4.8.2) debug=n Sat Dec 21 11:55:39 CET 2013 > (XEN) Latest ChangeSet: > (XEN) Bootloader: GRUB 2.02~beta1 > (XEN) Command line: dom0_mem=8192M,max:8192M iommu=1 dom0_max_vcpus=4 > dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 ... > (XEN) IOAPIC[0]: apic_id 8, version 33, address 0xfec00000, GSI 0-23 > (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs > (XEN) Using scheduler: SMP Credit Scheduler (credit) > (XEN) Detected 4026.984 MHz processor. > (XEN) Initing memory sharing. > (XEN) xstate_init: using cntxt_size: 0x3c0 and states: > 0x4000000000000007 > (XEN) IVHD Error: Conflicting IO-APIC 0x8 entries > (XEN) AMD-Vi: Error initialization > (XEN) I/O virtualisation disabled > (XEN) ENABLING IO-APIC IRQs > (XEN) -> Using new ACK method > (XEN) Platform timer is 14.318MHz HPET > (XEN) Allocated console ring of 16 KiB. > (XEN) HVM: ASIDs enabled. > (XEN) SVM: Supported advanced features: > (XEN) - Nested Page Tables (NPT) > (XEN) - Last Branch Record (LBR) Virtualisation > (XEN) - Next-RIP Saved on #VMEXIT > (XEN) - VMCB Clean Bits > (XEN) - DecodeAssists > (XEN) - Pause-Intercept Filter > (XEN) - TSC Rate MSR > (XEN) HVM: SVM enabled > (XEN) HVM: Hardware Assisted Paging (HAP) detected > (XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB > (XEN) spurious 8259A interrupt: IRQ7. > > > I've tried a few other configuration's (like adding the ivrs_ioapic > parameter to the module line in grub or also adding > vfio_iommu_type1.allow_unsafe_interrupts=1 > to the cmdline), but so far i couldn't get it to work. > > Since i'm not completely sure what i actually have to insert at the > kernel parameter i'm glad if someone could give me some insight. > However, since the output of xl dmesg is always the same, even though > with or without the parameter, i might missed some additional parameters. > > If you need any more information, I'll be glad to provide them. > > Thanks in advance. > > Michael > > > > > > > > > [1] > http://lists.xen.org/archives/html/xen-announce/2013-02/msg00002.html > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 19:04:21 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 19:04:21 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vwcgr-0000sV-9l; Fri, 27 Dec 2013 19:03:21 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vwcgo-0000sQ-Sx for xen-users@lists.xen.org; Fri, 27 Dec 2013 19:03:19 +0000 Received: from [85.158.143.35:56629] by server-2.bemta-4.messagelabs.com id 04/87-11386-6FECDB25; Fri, 27 Dec 2013 19:03:18 +0000 X-Env-Sender: ehouby@yahoo.com X-Msg-Ref: server-6.tower-21.messagelabs.com!1388170995!1365942!1 X-Originating-IP: [98.139.212.174] X-SpamReason: No, hits=1.1 required=7.0 tests=BODY_RANDOM_LONG, FORGED_YAHOO_RCVD,ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30220 invoked from network); 27 Dec 2013 19:03:16 -0000 Received: from nm15.bullet.mail.bf1.yahoo.com (HELO nm15.bullet.mail.bf1.yahoo.com) (98.139.212.174) by server-6.tower-21.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 27 Dec 2013 19:03:16 -0000 Received: from [66.196.81.170] by nm15.bullet.mail.bf1.yahoo.com with NNFMP; 27 Dec 2013 19:03:15 -0000 Received: from [68.142.230.65] by tm16.bullet.mail.bf1.yahoo.com with NNFMP; 27 Dec 2013 19:03:15 -0000 Received: from [127.0.0.1] by smtp222.mail.bf1.yahoo.com with NNFMP; 27 Dec 2013 19:03:15 -0000 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=yahoo.com; s=s1024; t=1388170995; bh=wvOPCF6WryFC7xuxOvAJryU7vAIZ8+61nA6iwBkhGuM=; h=X-Yahoo-Newman-Id:X-Yahoo-Newman-Property:X-YMail-OSG:X-Yahoo-SMTP:X-Rocket-Received:From:To:References:In-Reply-To:Subject:Date:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:X-Mailer:Thread-Index:Content-Language; b=LvlI/X4Kzpgi5gS80OHVfVHNzimO5ndJSymeZZfArCqV8U+HzCzdIPeOATb1jCZjVCLjCb0Bu6D5Ep+jBfuMw7dxtuXVwiZ0y6zTHRVvigEwlhBw1ye5SjceBVohT5fSHRP0eZk4CiOcTix/MBS/VeRouOqivXKiNmtgapNyMOM= X-Yahoo-Newman-Id: 432787.84135.bm@smtp222.mail.bf1.yahoo.com X-Yahoo-Newman-Property: ymail-3 X-YMail-OSG: AXwL0_cVM1nop2QNfjLdvQaz8ZXUaN9k1IbeH7PIhZhWRjC w99Id6UooZlk1A9KUOXxWZluLKvZJVEHiTYHavrfShIxu7Kqhm_Q42rXAG72 uWiraGVZFv6Q1j61Kt6CDlu2jvhw9LENXH_qelHnkKUCrkS34v8YwDmd_TLU f5sSLPXpWF0V.XvOyYvXL6Q58TjRwQsufzZUvVAQ04mHTgRqKs8kkwvCR5QJ h2F61D80EGYDIAZq5A.4RFsQuMmCY8ySY1Bt_YemyOzPFewIiYe_XcsdaKQd Kw8ecQvwb2aCM77ECGg6HnTWjI04Dp8To9wMrktdQkOGUJGifaLkiVzx6AxS aglfCeC3.Y2i0IMqdviXj08XOG3UtEZ4ChBqNY66DqG4rHfyB1kqcVnLl5MR Ph42gZHwYxljIieBpPAfk8JQq8o7AhzozbxgFbLrosIONSxW656_ypINC5iL fnW1mLhvWcfhleBddv0c45pWYPyiE8fSqS5gIjBrH_T.4Xm0tKto2qCIb4uR J5Y2DAJD6KaXK9rcGGiDgt5f.QwNkDAojTGBlV5lirV7oEyeudR.Wz8yKMOz pyOAL2LVR7ofrEggVHA8ov91h5PFmupAUji8CxcMMMtb1GnNBApKtMe36CDE HOoHpVsntPw-- X-Yahoo-SMTP: QpZsTh.swBBbiXoX3lukB1DLTA-- X-Rocket-Received: from phobos (ehouby@71.196.207.87 with plain [63.250.193.228]) by smtp222.mail.bf1.yahoo.com with SMTP; 27 Dec 2013 19:03:14 +0000 UTC From: "Eric Houby" To: "'Michaael Mair-Keimberger'" , References: <20131222140821.GB7095@asterix> <00bb01ceff80$cdae1dc0$690a5940$@yahoo.com> <20131224124225.GA3203@asterix> In-Reply-To: <20131224124225.GA3203@asterix> Date: Fri, 27 Dec 2013 12:03:12 -0700 Message-ID: <029101cf0336$4b8098f0$e281cad0$@yahoo.com> MIME-Version: 1.0 X-Mailer: Microsoft Outlook 15.0 Thread-Index: AQGZlYK36b84yUdNG3pyEhhUL/BDQANUR2XfAfcYrjiaqOOa8A== Content-Language: en-us Subject: Re: [Xen-users] vga passthrogh on mainboards with broken ivrs tables X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Michael, Sorry to hear you were not able to get passthrough of your video card working. Could you get IOMMU enabled by using no-amd-iommu-perdev-intremap in the xen command line? > (XEN) AMD-Vi: IOMMU 0 Enabled. > (XEN) AMD-Vi: Enabling global vector map > (XEN) AMD-Vi: Using global interrupt remap table is not recommended > (see XSA-36)! > (XEN) I/O virtualisation enabled Thanks for the heads up on irvrs_ioapic. I will keep an eye out for it in xen 4.4 Thanks, Eric -----Original Message----- From: xen-users-bounces@lists.xen.org [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Michaael Mair-Keimberger Sent: Tuesday, December 24, 2013 5:42 AM To: xen-users@lists.xen.org Subject: Re: [Xen-users] vga passthrogh on mainboards with broken ivrs tables Hi Eric, I still couldn't get it to work. However, since the ivrs_ioapic kernel parameter didn't do anything (i didn't even got any log messages about it) i've dug further into this parameter. Sadly i found out it's not included in xen-4.3.1 and since gentoo doesn't provide git ebuilds for xen i'll gonna wait until next xen will be released. xen-4.4 should be release on 21.01.14 - Thats not that far away and i guess i can wait for it :) If you want to passthrough your graphic card i suggest you to install a older version of xen. Personally i have my own xen-4.2.1 ebuild which don't include XSA-36. That one works perfectly well. If irvs_ioapic won't help with next xen I'll go back too... Regards, Michael On Sun, Dec 22, 2013 at 06:46:29PM -0700, Eric Houby wrote: > Michael, > > I have a GA-990FXA-UD3 H/W ver 1.1 that will boot up Xen 4.3.1 (Fedora > 20) with IOMMU enabled. > > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 > (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x1 handle 0x8 > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0xd7 > (XEN) AMD-Vi: IVHD Special: 0000:00:14.0 variety 0x2 handle 0 > (XEN) AMD-Vi: IVHD Device Entry: type 0x48 id 0 flags 0 > (XEN) AMD-Vi: IVHD Special: 0000:00:00.1 variety 0x1 handle 0x8 > (XEN) IVHD Error: Conflicting IO-APIC 0x8 entries > (XEN) AMD-Vi: IOMMU 0 Enabled. > (XEN) AMD-Vi: Enabling global vector map > (XEN) AMD-Vi: Using global interrupt remap table is not recommended > (see XSA-36)! > (XEN) I/O virtualisation enabled > (XEN) - Dom0 mode: Relaxed > (XEN) Interrupt remapping enabled > (XEN) ENABLING IO-APIC IRQs > > My xen command line is: > > dom0_mem=2048M,max:2048M dom0_max_vcpus=2 dom0_vcpus_pin loglvl=all > guest_loglvl=all iommu=debug,verbose,no-amd-iommu-perdev-intremap > > PCI passthrough of USB controllers works without issues, but I have > not been able to passthrough a secondary graphics card (HD 5750) > without getting a BSoD on my Win7 HVM. I have had the same 5750 and > VM image working on a GA-890FXA, but have not been able to get the > combination working on the GA-990FXA. If you are able to get IOMMU > enabled, I will be interested to see if you get the graphics card to passthrough. > > Good luck. > > -Eric > > > > > -----Original Message----- > From: xen-users-bounces@lists.xen.org > [mailto:xen-users-bounces@lists.xen.org] On Behalf Of Michaael > Mair-Keimberger > Sent: Sunday, December 22, 2013 7:08 AM > To: xen-users@lists.xen.org > Subject: [Xen-users] vga passthrogh on mainboards with broken ivrs > tables > > Hi Lists, > > I'm having troubles getting vga passthrough working again with latest > xen-4.3.1. > > My system is a bulldozer amd 8core cpu with a gigabyte GA-990FXA-UD5 > motherboard. > The host system uses a amd hd6850 while the guest (windows 7) uses a > amd hd 7970. > > So far everything worked great until xsa-36 [1]. I've haven't updated > xen since this "fix", but yesterday i'll gave it another try. I've > updated to > xen-4.3.1 and tried to fix those broken ivrs tables with the newly > introduced ivrx_ioapic kernel parameter. I'm not sure if this should > help me, but at least it sounds promising. > However i didn't get it to work and i hope someone can give my some > hints how to fix that, otherwise i have to downgrade xen again. > > > grub2 config: > > menuentry 'Gentoo Linux XEN' { > root=hd0,1 > multiboot /boot/xen.gz dom0_mem=8192M,max:8192M iommu=1 > dom0_max_vcpus=4 dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 > module /boot/gentoo-3.12.6 root=/dev/md3 radeon.pcie_gen2=1 > radeon.dpm=1 softlevel=xen xen-pciback.permissive > xen-pciback.hide=(01:00.0)(01:00.1)(00:12.0)(00:12.2) > } > > lspci: > > 00:00.0 Host bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI > to PCI bridge (external gfx0 port B) (rev 02) > 00:00.2 IOMMU: Advanced Micro Devices, Inc. [AMD/ATI] RD990 I/O Memory > Management Unit (IOMMU) > 00:02.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI > to PCI bridge (PCI express gpp port B) > 00:09.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI > to PCI bridge (PCI express gpp port H) > 00:0a.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI > to PCI bridge (external gfx1 port A) > 00:0d.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] RD890 PCI > to PCI bridge (external gfx1 port B) > 00:11.0 SATA controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 SATA Controller [AHCI mode] (rev 40) > 00:12.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI0 Controller > 00:12.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB EHCI Controller > 00:13.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI0 Controller > 00:13.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB EHCI Controller > 00:14.0 SMBus: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 SMBus > Controller (rev 42) > 00:14.1 IDE interface: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 IDE Controller (rev 40) > 00:14.2 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 > Azalia (Intel HDA) (rev 40) > 00:14.3 ISA bridge: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 LPC host controller (rev 40) > 00:14.4 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SBx00 PCI > to PCI Bridge (rev 40) > 00:14.5 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI2 Controller > 00:15.0 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] > SB700/SB800/SB900 PCI to PCI bridge (PCIE port 0) > 00:15.1 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] > SB700/SB800/SB900 PCI to PCI bridge (PCIE port 1) > 00:15.2 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI > to PCI bridge (PCIE port 2) > 00:15.3 PCI bridge: Advanced Micro Devices, Inc. [AMD/ATI] SB900 PCI > to PCI bridge (PCIE port 3) > 00:16.0 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB OHCI0 Controller > 00:16.2 USB controller: Advanced Micro Devices, Inc. [AMD/ATI] > SB7x0/SB8x0/SB9x0 USB EHCI Controller > 00:18.0 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h > Processor Function 0 > 00:18.1 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h > Processor Function 1 > 00:18.2 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h > Processor Function 2 > 00:18.3 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h > Processor Function 3 > 00:18.4 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h > Processor Function 4 > 00:18.5 Host bridge: Advanced Micro Devices, Inc. [AMD] Family 15h > Processor Function 5 > 01:00.0 VGA compatible controller: Advanced Micro Devices, Inc. > [AMD/ATI] Tahiti XT [Radeon HD 7970] > 01:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Tahiti XT > HDMI Audio [Radeon HD 7970 Series] > 02:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host > Controller (rev 01) > 03:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA > 6Gb/s Controller (rev 11) > 04:00.0 VGA compatible controller: Advanced Micro Devices, Inc. > [AMD/ATI] Barts PRO [Radeon HD 6850] > 04:00.1 Audio device: Advanced Micro Devices, Inc. [AMD/ATI] Barts > HDMI Audio [Radeon HD 6800 Series] > 05:0e.0 FireWire (IEEE 1394): VIA Technologies, Inc. VT6306/7/8 [Fire > II(M)] IEEE 1394 OHCI Controller (rev c0) > 06:00.0 Ethernet controller: Realtek Semiconductor Co., Ltd. > RTL8111/8168/8411 PCI Express Gigabit Ethernet Controller (rev 06) > 07:00.0 USB controller: Etron Technology, Inc. EJ168 USB 3.0 Host > Controller (rev 01) > 08:00.0 SATA controller: Marvell Technology Group Ltd. 88SE9172 SATA > 6Gb/s Controller (rev 11) > > lspci -t: > > -[0000:00]-+-00.0 > +-00.2 > +-02.0-[01]--+-00.0 > | \-00.1 > +-09.0-[02]----00.0 > +-0a.0-[03]----00.0 > +-0d.0-[04]--+-00.0 > | \-00.1 > +-11.0 > +-12.0 > +-12.2 > +-13.0 > +-13.2 > +-14.0 > +-14.1 > +-14.2 > +-14.3 > +-14.4-[05]----0e.0 > +-14.5 > +-15.0-[06]----00.0 > +-15.1-[07]----00.0 > +-15.2-[08]----00.0 > +-15.3-[09]-- > +-16.0 > +-16.2 > +-18.0 > +-18.1 > +-18.2 > +-18.3 > +-18.4 > \-18.5 > > xl dmesg (shorten): > > (XEN) Xen version 4.3.1 (@xonet.at) (x86_64-pc-linux-gnu-gcc (Gentoo > 4.8.2 p1.0, pie-0.5.8) 4.8.2) debug=n Sat Dec 21 11:55:39 CET 2013 > (XEN) Latest ChangeSet: > (XEN) Bootloader: GRUB 2.02~beta1 > (XEN) Command line: dom0_mem=8192M,max:8192M iommu=1 dom0_max_vcpus=4 > dom0_vcpus_pin ivrs_ioapic[8]=00:14.0 ... > (XEN) IOAPIC[0]: apic_id 8, version 33, address 0xfec00000, GSI 0-23 > (XEN) Enabling APIC mode: Flat. Using 1 I/O APICs > (XEN) Using scheduler: SMP Credit Scheduler (credit) > (XEN) Detected 4026.984 MHz processor. > (XEN) Initing memory sharing. > (XEN) xstate_init: using cntxt_size: 0x3c0 and states: > 0x4000000000000007 > (XEN) IVHD Error: Conflicting IO-APIC 0x8 entries > (XEN) AMD-Vi: Error initialization > (XEN) I/O virtualisation disabled > (XEN) ENABLING IO-APIC IRQs > (XEN) -> Using new ACK method > (XEN) Platform timer is 14.318MHz HPET > (XEN) Allocated console ring of 16 KiB. > (XEN) HVM: ASIDs enabled. > (XEN) SVM: Supported advanced features: > (XEN) - Nested Page Tables (NPT) > (XEN) - Last Branch Record (LBR) Virtualisation > (XEN) - Next-RIP Saved on #VMEXIT > (XEN) - VMCB Clean Bits > (XEN) - DecodeAssists > (XEN) - Pause-Intercept Filter > (XEN) - TSC Rate MSR > (XEN) HVM: SVM enabled > (XEN) HVM: Hardware Assisted Paging (HAP) detected > (XEN) HVM: HAP page sizes: 4kB, 2MB, 1GB > (XEN) spurious 8259A interrupt: IRQ7. > > > I've tried a few other configuration's (like adding the ivrs_ioapic > parameter to the module line in grub or also adding > vfio_iommu_type1.allow_unsafe_interrupts=1 > to the cmdline), but so far i couldn't get it to work. > > Since i'm not completely sure what i actually have to insert at the > kernel parameter i'm glad if someone could give me some insight. > However, since the output of xl dmesg is always the same, even though > with or without the parameter, i might missed some additional parameters. > > If you need any more information, I'll be glad to provide them. > > Thanks in advance. > > Michael > > > > > > > > > [1] > http://lists.xen.org/archives/html/xen-announce/2013-02/msg00002.html > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Fri Dec 27 22:37:07 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 22:37:07 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vwg0n-0006lc-L4; Fri, 27 Dec 2013 22:36:09 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vwg0l-0006lU-Ts for xen-users@lists.xen.org; Fri, 27 Dec 2013 22:36:08 +0000 Received: from [85.158.137.68:45531] by server-7.bemta-3.messagelabs.com id A1/91-27599-7D00EB25; Fri, 27 Dec 2013 22:36:07 +0000 X-Env-Sender: kantras@gmail.com X-Msg-Ref: server-14.tower-31.messagelabs.com!1388183754!6200290!1 X-Originating-IP: [209.85.128.49] X-SpamReason: No, hits=0.9 required=7.0 tests=BODY_RANDOM_LONG, HTML_30_40, HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14, RCVD_BY_IP, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 28804 invoked from network); 27 Dec 2013 22:35:55 -0000 Received: from mail-qe0-f49.google.com (HELO mail-qe0-f49.google.com) (209.85.128.49) by server-14.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 22:35:55 -0000 Received: by mail-qe0-f49.google.com with SMTP id w7so9417160qeb.22 for ; Fri, 27 Dec 2013 14:35:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=l/XW+5NLxqyXFj0q/pFlIm8hDJqkbRZtWTvFSunhwUw=; b=LxW8VgbW3dpahUDqXfRjgPtAwbl1JUrbhSJm75Y1YEG+m9zVBIKqBxBENe9ZNBt/QM Q48B+URnwzTvAFa/agE+hpRaKy0bqCo0a9nOJHXvuZeCTmjmy7TKHnil3OMsH2NJSSqI o2DwIqh+cZgJtmbDpogmZzp3R5dpN4HlFo+noPwtXYYcpaEnQAHdSpWI+FKpsUxLz7ur 6Y1I5Pj3dfP43m1IE92kEheQIGPiN4J5fooZbLQqqAB3RKYY/itJnuKv5PzAvMtkE4r8 WWEWTkYpgE+kA2H/G9oLvMAP9wIB346PLcQi8fjO9U5nrxj+2yIEBqZdTXfAXMJGq063 eMwg== MIME-Version: 1.0 X-Received: by 10.229.71.5 with SMTP id f5mr83336350qcj.18.1388183753746; Fri, 27 Dec 2013 14:35:53 -0800 (PST) Received: by 10.96.152.67 with HTTP; Fri, 27 Dec 2013 14:35:53 -0800 (PST) In-Reply-To: <20131224124225.GA3203@asterix> References: <20131222140821.GB7095@asterix> <00bb01ceff80$cdae1dc0$690a5940$@yahoo.com> <20131224124225.GA3203@asterix> Date: Fri, 27 Dec 2013 16:35:53 -0600 Message-ID: From: David Sutton To: "xen-users@lists.xen.org" Subject: Re: [Xen-users] vga passthrogh on mainboards with broken ivrs tables X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============1365824019949072604==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============1365824019949072604== Content-Type: multipart/alternative; boundary=001a1133bfaa866ea704ee8bb722 --001a1133bfaa866ea704ee8bb722 Content-Type: text/plain; charset=ISO-8859-1 Michael & Eric, On Tue, Dec 24, 2013 at 6:42 AM, Michaael Mair-Keimberger < m.mairkeimberger@gmail.com> wrote: > Hi Eric, > > I still couldn't get it to work. However, since the ivrs_ioapic kernel > parameter didn't do anything (i didn't even got any log messages about > it) i've dug further into this parameter. > Sadly i found out it's not included in xen-4.3.1 and since gentoo > doesn't provide git ebuilds for xen i'll gonna wait until next xen > will be released. xen-4.4 should be release on 21.01.14 - Thats not that > far away and i guess i can wait for it :) > > If you want to passthrough your graphic card i suggest you to install a > older > version of xen. Personally i have my own xen-4.2.1 ebuild which don't > include XSA-36. That one works perfectly well. > If irvs_ioapic won't help with next xen I'll go back too... > > Regards, > > Michael > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > Just wanting to check the basics - have you also make sure you've installed the latest BIOS update for your motherboard? Sometimes these updates contain fixes fror issues such as bad table entries. Regards, David --001a1133bfaa866ea704ee8bb722 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Michael & Eric,
On Tue, Dec 24, 2013 at 6:42 AM, Michaael Mair-= Keimberger <m.mairkeimberger@gmail.com> wrote:
Hi Eric,

I still couldn't get it to work. However, since the ivrs_ioapic kernel<= br> parameter didn't do anything (i didn't even got any log messages ab= out
it) i've dug further into this parameter.
Sadly i found out it's not included in xen-4.3.1 and since gentoo
doesn't provide git ebuilds for xen i'll gonna wait until next xen<= br> will be released. xen-4.4 should be release on 21.01.14 - Thats not that far away and i guess i can wait for it :)

If you want to passthrough your graphic card i suggest you to install a old= er
version of xen. Personally i have my own xen-4.2.1 ebuild which don't include XSA-36. That one works perfectly well.
If irvs_ioapic won't help with next xen I'll go back too...

Regards,

Michael
_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.x= en.org/xen-users

=A0 Ju= st wanting to check the basics - have you also make sure you've install= ed the latest BIOS update for your motherboard? Sometimes these updates con= tain fixes fror issues such as bad table entries.=A0

Regards,

=A0 David

--001a1133bfaa866ea704ee8bb722-- --===============1365824019949072604== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============1365824019949072604==-- From xen-users-bounces@lists.xen.org Fri Dec 27 22:37:07 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Fri, 27 Dec 2013 22:37:07 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vwg0n-0006lc-L4; Fri, 27 Dec 2013 22:36:09 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vwg0l-0006lU-Ts for xen-users@lists.xen.org; Fri, 27 Dec 2013 22:36:08 +0000 Received: from [85.158.137.68:45531] by server-7.bemta-3.messagelabs.com id A1/91-27599-7D00EB25; Fri, 27 Dec 2013 22:36:07 +0000 X-Env-Sender: kantras@gmail.com X-Msg-Ref: server-14.tower-31.messagelabs.com!1388183754!6200290!1 X-Originating-IP: [209.85.128.49] X-SpamReason: No, hits=0.9 required=7.0 tests=BODY_RANDOM_LONG, HTML_30_40, HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14, RCVD_BY_IP, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 28804 invoked from network); 27 Dec 2013 22:35:55 -0000 Received: from mail-qe0-f49.google.com (HELO mail-qe0-f49.google.com) (209.85.128.49) by server-14.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 27 Dec 2013 22:35:55 -0000 Received: by mail-qe0-f49.google.com with SMTP id w7so9417160qeb.22 for ; Fri, 27 Dec 2013 14:35:53 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:in-reply-to:references:date:message-id:subject:from:to :content-type; bh=l/XW+5NLxqyXFj0q/pFlIm8hDJqkbRZtWTvFSunhwUw=; b=LxW8VgbW3dpahUDqXfRjgPtAwbl1JUrbhSJm75Y1YEG+m9zVBIKqBxBENe9ZNBt/QM Q48B+URnwzTvAFa/agE+hpRaKy0bqCo0a9nOJHXvuZeCTmjmy7TKHnil3OMsH2NJSSqI o2DwIqh+cZgJtmbDpogmZzp3R5dpN4HlFo+noPwtXYYcpaEnQAHdSpWI+FKpsUxLz7ur 6Y1I5Pj3dfP43m1IE92kEheQIGPiN4J5fooZbLQqqAB3RKYY/itJnuKv5PzAvMtkE4r8 WWEWTkYpgE+kA2H/G9oLvMAP9wIB346PLcQi8fjO9U5nrxj+2yIEBqZdTXfAXMJGq063 eMwg== MIME-Version: 1.0 X-Received: by 10.229.71.5 with SMTP id f5mr83336350qcj.18.1388183753746; Fri, 27 Dec 2013 14:35:53 -0800 (PST) Received: by 10.96.152.67 with HTTP; Fri, 27 Dec 2013 14:35:53 -0800 (PST) In-Reply-To: <20131224124225.GA3203@asterix> References: <20131222140821.GB7095@asterix> <00bb01ceff80$cdae1dc0$690a5940$@yahoo.com> <20131224124225.GA3203@asterix> Date: Fri, 27 Dec 2013 16:35:53 -0600 Message-ID: From: David Sutton To: "xen-users@lists.xen.org" Subject: Re: [Xen-users] vga passthrogh on mainboards with broken ivrs tables X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============1365824019949072604==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============1365824019949072604== Content-Type: multipart/alternative; boundary=001a1133bfaa866ea704ee8bb722 --001a1133bfaa866ea704ee8bb722 Content-Type: text/plain; charset=ISO-8859-1 Michael & Eric, On Tue, Dec 24, 2013 at 6:42 AM, Michaael Mair-Keimberger < m.mairkeimberger@gmail.com> wrote: > Hi Eric, > > I still couldn't get it to work. However, since the ivrs_ioapic kernel > parameter didn't do anything (i didn't even got any log messages about > it) i've dug further into this parameter. > Sadly i found out it's not included in xen-4.3.1 and since gentoo > doesn't provide git ebuilds for xen i'll gonna wait until next xen > will be released. xen-4.4 should be release on 21.01.14 - Thats not that > far away and i guess i can wait for it :) > > If you want to passthrough your graphic card i suggest you to install a > older > version of xen. Personally i have my own xen-4.2.1 ebuild which don't > include XSA-36. That one works perfectly well. > If irvs_ioapic won't help with next xen I'll go back too... > > Regards, > > Michael > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users > Just wanting to check the basics - have you also make sure you've installed the latest BIOS update for your motherboard? Sometimes these updates contain fixes fror issues such as bad table entries. Regards, David --001a1133bfaa866ea704ee8bb722 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Michael & Eric,
On Tue, Dec 24, 2013 at 6:42 AM, Michaael Mair-= Keimberger <m.mairkeimberger@gmail.com> wrote:
Hi Eric,

I still couldn't get it to work. However, since the ivrs_ioapic kernel<= br> parameter didn't do anything (i didn't even got any log messages ab= out
it) i've dug further into this parameter.
Sadly i found out it's not included in xen-4.3.1 and since gentoo
doesn't provide git ebuilds for xen i'll gonna wait until next xen<= br> will be released. xen-4.4 should be release on 21.01.14 - Thats not that far away and i guess i can wait for it :)

If you want to passthrough your graphic card i suggest you to install a old= er
version of xen. Personally i have my own xen-4.2.1 ebuild which don't include XSA-36. That one works perfectly well.
If irvs_ioapic won't help with next xen I'll go back too...

Regards,

Michael
_______________________________________________
Xen-users mailing list
Xen-users@lists.xen.org
http://lists.x= en.org/xen-users

=A0 Ju= st wanting to check the basics - have you also make sure you've install= ed the latest BIOS update for your motherboard? Sometimes these updates con= tain fixes fror issues such as bad table entries.=A0

Regards,

=A0 David

--001a1133bfaa866ea704ee8bb722-- --===============1365824019949072604== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============1365824019949072604==-- From xen-users-bounces@lists.xen.org Sat Dec 28 15:58:25 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sat, 28 Dec 2013 15:58:25 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwwGQ-000687-Sg; Sat, 28 Dec 2013 15:57:22 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwwGO-00067B-Ck; Sat, 28 Dec 2013 15:57:20 +0000 Received: from [85.158.143.35:64670] by server-1.bemta-4.messagelabs.com id 05/22-02132-FD4FEB25; Sat, 28 Dec 2013 15:57:19 +0000 X-Env-Sender: dario.faggioli@citrix.com X-Msg-Ref: server-8.tower-21.messagelabs.com!1388246237!8588641!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 16121 invoked from network); 28 Dec 2013 15:57:18 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-8.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 28 Dec 2013 15:57:18 -0000 X-IronPort-AV: E=Sophos;i="4.95,566,1384300800"; d="asc'?scan'208";a="88283519" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 28 Dec 2013 15:57:16 +0000 Received: from [127.0.0.1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Sat, 28 Dec 2013 10:57:15 -0500 Message-ID: <1388246226.15148.4.camel@Solace> From: Dario Faggioli To: Date: Sat, 28 Dec 2013 16:57:06 +0100 In-Reply-To: <52B03A2A.807@xen.org> References: <52B03A2A.807@xen.org> X-Mailer: Evolution 3.8.5 (3.8.5-2.fc19) MIME-Version: 1.0 X-DLP: MIA2 Cc: "xen-users@lists.xen.org" , "xen-api@lists.xen.org" , "publicity@lists.xenproject.org" , mirageos-devel@lists.xenproject.org, "xen-devel@lists.xen.org" Subject: Re: [Xen-users] [Publicity] Xen booth at FOSDEM : invitation to community members to help man the booth, show demos, have your hand-outs there, etc. X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============3547149669604414966==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============3547149669604414966== Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-8xfV9F2fs6DyPs8VSOWG" --=-8xfV9F2fs6DyPs8VSOWG Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On mar, 2013-12-17 at 11:48 +0000, Lars Kurth wrote: > Hi all, >=20 > I was just informed by the FOSDEM organizers. I wanted to invite=20 > community members (as well as vendors who do open source stuff and=20 > didn't get a booth) to help man the booth, show demos, have your=20 > hand-outs/swag there, etc. >=20 > If you are interested, please > a) Sign up to=20 > http://lists.xenproject.org/cgi-bin/mailman/listinfo/publicity or send a= =20 > mail to publicity-request@lists.xenproject.org with subscribe in the=20 > subject line, where we will be discussing details > b) respond to this thread on what you may want to >=20 So I was wondering, we did not get that much of a response about this (or perhaps we did, but not in public, in which case, ignore me). I know, holidays are not helping, etc. but, anyway, should we turn this e-mail into a blog post to send out in early January? I'm up for it if we think it's a good thing to do. Regards, Dario --=20 <> (Raistlin Majere) ----------------------------------------------------------------- Dario Faggioli, Ph.D, http://about.me/dario.faggioli Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK) --=-8xfV9F2fs6DyPs8VSOWG Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iEYEABECAAYFAlK+9NIACgkQk4XaBE3IOsSHLACfWQJ40Ipm8LP281mNDnQmzZo9 B0YAnA/J6ZfGyUwu+k/dXvaW3kyqHke/ =L5yw -----END PGP SIGNATURE----- --=-8xfV9F2fs6DyPs8VSOWG-- --===============3547149669604414966== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============3547149669604414966==-- From xen-users-bounces@lists.xen.org Sat Dec 28 15:58:25 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sat, 28 Dec 2013 15:58:25 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwwGQ-000687-Sg; Sat, 28 Dec 2013 15:57:22 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VwwGO-00067B-Ck; Sat, 28 Dec 2013 15:57:20 +0000 Received: from [85.158.143.35:64670] by server-1.bemta-4.messagelabs.com id 05/22-02132-FD4FEB25; Sat, 28 Dec 2013 15:57:19 +0000 X-Env-Sender: dario.faggioli@citrix.com X-Msg-Ref: server-8.tower-21.messagelabs.com!1388246237!8588641!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 16121 invoked from network); 28 Dec 2013 15:57:18 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-8.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 28 Dec 2013 15:57:18 -0000 X-IronPort-AV: E=Sophos;i="4.95,566,1384300800"; d="asc'?scan'208";a="88283519" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 28 Dec 2013 15:57:16 +0000 Received: from [127.0.0.1] (10.80.16.47) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Sat, 28 Dec 2013 10:57:15 -0500 Message-ID: <1388246226.15148.4.camel@Solace> From: Dario Faggioli To: Date: Sat, 28 Dec 2013 16:57:06 +0100 In-Reply-To: <52B03A2A.807@xen.org> References: <52B03A2A.807@xen.org> X-Mailer: Evolution 3.8.5 (3.8.5-2.fc19) MIME-Version: 1.0 X-DLP: MIA2 Cc: "xen-users@lists.xen.org" , "xen-api@lists.xen.org" , "publicity@lists.xenproject.org" , mirageos-devel@lists.xenproject.org, "xen-devel@lists.xen.org" Subject: Re: [Xen-users] [Publicity] Xen booth at FOSDEM : invitation to community members to help man the booth, show demos, have your hand-outs there, etc. X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============3547149669604414966==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============3547149669604414966== Content-Type: multipart/signed; micalg=pgp-sha1; protocol="application/pgp-signature"; boundary="=-8xfV9F2fs6DyPs8VSOWG" --=-8xfV9F2fs6DyPs8VSOWG Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable On mar, 2013-12-17 at 11:48 +0000, Lars Kurth wrote: > Hi all, >=20 > I was just informed by the FOSDEM organizers. I wanted to invite=20 > community members (as well as vendors who do open source stuff and=20 > didn't get a booth) to help man the booth, show demos, have your=20 > hand-outs/swag there, etc. >=20 > If you are interested, please > a) Sign up to=20 > http://lists.xenproject.org/cgi-bin/mailman/listinfo/publicity or send a= =20 > mail to publicity-request@lists.xenproject.org with subscribe in the=20 > subject line, where we will be discussing details > b) respond to this thread on what you may want to >=20 So I was wondering, we did not get that much of a response about this (or perhaps we did, but not in public, in which case, ignore me). I know, holidays are not helping, etc. but, anyway, should we turn this e-mail into a blog post to send out in early January? I'm up for it if we think it's a good thing to do. Regards, Dario --=20 <> (Raistlin Majere) ----------------------------------------------------------------- Dario Faggioli, Ph.D, http://about.me/dario.faggioli Senior Software Engineer, Citrix Systems R&D Ltd., Cambridge (UK) --=-8xfV9F2fs6DyPs8VSOWG Content-Type: application/pgp-signature; name="signature.asc" Content-Description: This is a digitally signed message part Content-Transfer-Encoding: 7bit -----BEGIN PGP SIGNATURE----- Version: GnuPG v1 iEYEABECAAYFAlK+9NIACgkQk4XaBE3IOsSHLACfWQJ40Ipm8LP281mNDnQmzZo9 B0YAnA/J6ZfGyUwu+k/dXvaW3kyqHke/ =L5yw -----END PGP SIGNATURE----- --=-8xfV9F2fs6DyPs8VSOWG-- --===============3547149669604414966== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============3547149669604414966==-- From xen-users-bounces@lists.xen.org Sat Dec 28 18:37:07 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sat, 28 Dec 2013 18:37:07 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vwyjg-0002cp-Co; Sat, 28 Dec 2013 18:35:44 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vwyjd-0002ci-NN for xen-users@lists.xen.org; Sat, 28 Dec 2013 18:35:42 +0000 Received: from [85.158.139.211:32002] by server-12.bemta-5.messagelabs.com id 9E/5B-30017-CF91FB25; Sat, 28 Dec 2013 18:35:40 +0000 X-Env-Sender: nix@myproxylists.com X-Msg-Ref: server-6.tower-206.messagelabs.com!1388255739!6947941!1 X-Originating-IP: [62.236.108.236] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 20132 invoked from network); 28 Dec 2013 18:35:39 -0000 Received: from gameframe.net (HELO gameframe.net) (62.236.108.236) by server-6.tower-206.messagelabs.com with SMTP; 28 Dec 2013 18:35:39 -0000 Received: (qmail 22372 invoked by uid 0); 28 Dec 2013 18:34:10 -0000 X-Originating-IP: 127.0.0.1 X-Qmail-Scanner-Diagnostics: from 127.0.0.1 (daemon@127.0.0.1) by gameframe.net (envelope-from , uid 98) with qmail-scanner-2.11 (spamassassin: 3.3.2. Clear:RC:1(127.0.0.1):. Processed in 0.030516 secs); 28 Dec 2013 18:34:10 -0000 Received: from unknown (HELO gameframe.net) (daemon@127.0.0.1) by gameframe.net with SMTP; 28 Dec 2013 18:34:09 -0000 Received: from localhost ([127.0.0.1]) (SquirrelMail authenticated user nix@myproxylists.com) by gameframe.net with HTTP; Sat, 28 Dec 2013 20:34:09 +0200 Message-ID: <72a46fb800ebf594aef523c17f94eaeb.squirrel@gameframe.net> Date: Sat, 28 Dec 2013 20:34:09 +0200 From: "NiX" To: xen-users@lists.xen.org User-Agent: SquirrelMail/1.4.22 MIME-Version: 1.0 Content-Type: multipart/mixed;boundary="----=_20131228203409_44038" X-Priority: 3 (Normal) Importance: Normal Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org ------=_20131228203409_44038 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit > On Fri, Dec 27, 2013 at 05:00:16PM +0200, NiX wrote: >> > On Fri, Dec 27, 2013 at 02:17:19PM +0200, NiX wrote: >> >> > On Tue, Dec 24, 2013 at 05:06:37PM +0200, NiX wrote: >> >> >> Hi. I am running a XEN VM in PV mode. This VM has four cores >> enabled. >> >> VM >> >> >> network config is as follows: >> >> >> >> >> >> vif = >> ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] >> >> >> >> >> >> Dom0 is dual XEON X5450 with 16GB of RAM. >> >> >> >> >> >> I can barely zmap at 10mbps ~ 12k packets/second on this VM >> >> >> >> >> > >> >> > My google-fu tells me that zmap sends out gigantic amount of TCP >> SYN >> >> > packets in its default configuration. It is possible the ring size >> >> > between frontend and backend is the bottleneck. Data copying from >> >> > frontend to backend might also be a problem. >> >> > >> >> > You can probably patch your Dom0 and DomU kernel with multi-page >> ring >> >> > support to see if it makes it better. >> >> > >> >> > Wei. >> >> > >> >> >> >> I was not able neither to exceed 10k packets/second with a >> lightweight >> >> equivalent software and netback/0 fully utilized one 3GHz core. >> >> >> > >> > Hmm... You're using kthread-based netback. In your use case frontend >> is >> > likely to create interrupt storm for backend. Do you have breakdown of >> > CPU usage (sy, si etc)? >> >> I am using Linux nix 3.2.53-grsec #1 SMP and the server is pretty much >> idle expect when I attempt to zmap.Load average: 0.09 0.06 0.13 >> >> ps aux | grep netback >> root 1411 2.6 0.0 0 0 ? S Dec09 696:17 >> [netback/0] >> root 1412 0.0 0.0 0 0 ? S Dec09 2:44 >> [netback/1] >> root 1413 1.1 0.0 0 0 ? S Dec09 312:39 >> [netback/2] >> root 1414 0.0 0.0 0 0 ? S Dec09 0:00 >> [netback/3] >> root 1415 0.0 0.0 0 0 ? S Dec09 8:22 >> [netback/4] >> root 1416 0.0 0.0 0 0 ? S Dec09 2:54 >> [netback/5] >> root 1417 0.0 0.0 0 0 ? S Dec09 0:00 >> [netback/6] >> root 1418 0.0 0.0 0 0 ? S Dec09 0:00 >> [netback/7] >> >> It seems to only fully utilize netback/0 when I attempt to zmap and >> takes >> one 3GHz core ... Maybe there's something to look at in terms of >> optimizing? >> > > That's expected, because only one netback thread is necessary to serve > that VIF. > > Could you run 'top' then press 1 and copy the summary area in your > email? > > It should look like this: > > top - 15:49:09 up 27 days, 6:14, 16 users, load average: 5.00, 5.02, > 5.08 > Tasks: 259 total, 2 running, 257 sleeping, 0 stopped, 0 zombie > %Cpu0 : 1.0 us, 1.3 sy, 97.7 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, > 0.0 st > %Cpu1 : 0.0 us, 0.3 sy, 99.7 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, > 0.0 st > %Cpu2 : 4.0 us, 53.5 sy, 42.5 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, > 0.0 st > %Cpu3 : 1.7 us, 40.2 sy, 58.1 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, > 0.0 st > KiB Mem: 8132308 total, 7385188 used, 747120 free, 160348 buffers > KiB Swap: 0 total, 0 used, 0 free, 3283276 cached > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > 3378 colord 20 0 284m 110m 2484 R 98.0 1.4 15502:29 colord-sane > 25531 weil 20 0 24788 3268 1436 S 2.0 0.0 165:58.78 htop > 22448 weil 20 0 1010m 97m 24m S 0.7 1.2 4:57.67 chrome > > Wei. > I ran 'zmap -p 80 -B 10M -o results.txt --interface=eth0' and took a screenshot of top. 0:05 0% (1d11h left); send: 74425 14.9 Kp/s (14.8 Kp/s avg); recv: 2196 492 p/s (436 p/s avg); drops: 0 p/s (0 p/s avg); hits: 2.95 10mbps ~ 15k packets/second The server is dual xeon X5450 ------=_20131228203409_44038 Content-Type: image/png; name="top_zmap.png" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="top_zmap.png" iVBORw0KGgoAAAANSUhEUgAAAjsAAAJPCAIAAAAVB4LbAAAAAXNSR0IArs4c6QAAAARnQU1BAACx jwv8YQUAAAAJcEhZcwAADsMAAA7DAcdvqGQAAJaaSURBVHhe7ZprciM5z6xnaWdpZ+fvBzEhNJwE WaziRZTN54cCmbiqesIV7p7//v/hcDgcDt/A6431/w6Hw+Fw2B59Y/3vcDgcDoe9OW+sw+FwOHwH m76x/vvvP40SIg21IrTCkftwLrFKdHngz4NWYClQq4FbxQPxe9PJP9BEhqYdmniTO50MH7iG9GzG XP6lT6CRxgeFMqBWwbzF3V4qvttONLajDOQOgL8VwRvr44fSw6J7SFZA5YN2qSmVtbT3QKtpHckK 7ZUDeZ1e3tt+ElWmqSO/zvCBKxl1+fc+gUvsq9W/I2UhQ/MW1tLYK2W+0mJvttPYTtmw+NkBs9nu jYXt/ga6py4N8++2w8l9ITQHkq+mje0HzD41Jz/ek/uNlfWxDxg+cDGjLv/SJ3B5NhVU6sPK9vaQ u+209G470d5+WXl39TL4jSWHGmol1EqY432Yo/ADKc6loPpN7hg+lVpfqHZZb4LcIagA0j5Bylzg yyj2MgcFAmIyBXMQAO8bcB4Q9uZmWvJC9RtyTOaVnVwOrFxiwBFUJ8zxPswh5NOwAqh1ZSKGGYIy YA4CgWLDHO/DFFQn1PpZhk9vCnCAWj9NgrKVYp96DY0qQ7MC1dfbLZsHoN6e87i9c+9Kmn7HCr+P fHrfxwQqPZooQzXoEhDDBCSFVPhCtSM3vVOKQTjQQwWQ8ul9H5egmjTgBWKYOT6VyoNKmJSqmA/I G8UBqt+EDjCJQPDxEC4HUgFku+kDgWp6KK0D4SKYPiWxl3VQ6estpiGhTzUAZlhG9XWZc6tesgAx TCN3LqGWygSfsri9PeRZe94FVG9G1xsLEoz9hpVp7Yt8pcSXjVSvUeKyVwhb+ud42lMmJfD4FDCZ 8j9SD6hMaB+OSl/ffxhxOZAKTEqQpwjzEYyFxpakBB6fAiSJ1PQPOEgJFqfkD8xH4EGBAQcpweKU /AH8Rqi+vd1Xvrbe3AuoqzLEpyxubw+52y4FlZrL9o+w4nesB1SmtS+yysYWKSM00TaBaiBfU/rm eNpTkJemxF4KuXOLSm/7WFS+7vgJskO4nEYFuTSHUkbJ74TGhrLdDClV5nNKQ3KfHJMSAEjBxw+g 9vZpVtlzQPt2SREwkQUkL7nVfjn87vY1XLyxENPp3pRPkDLDKA3Mfe9QFrI0CpSylbElqAXSPkFK XlAqq7f77GvTey8cwUyLBcT2aXj5qkuoruLLqKUi65VCXgBU3+ey1xekVS/pTaFi+oAQH6i+CTWG 0psSV8yQUiUCk4KPBar0UBekNw0y6zLEavLiUnulxZAUUF3ACvLKUq/3S+0igeoCVpBXeiecQ2ZY 83GCN5YgtwLVzhHMQTAWrDDIhDTUvbqTgC+ozsYK3gwLQtKwF4jts5HU+g8yISto3c+9cARvesxM VQockDshKDNyEw5Qy5mqE2o5yCyVtYBeQ90IrUg1+PSmAEdQnVDLtRBU1g4aDXWvTkJcMUNQJiCG KfgYpCpFrcJw1AiIyRTgCKoTaiXUioYTYRlMQXXVMTRRmBkSVsIUVDvIDMtCMySshCmQNHIfzm7E b6wWNvlKnWfM/hYb/sHTSfUL593/ePKGj7Sdrz5+OPQ0Wh5O5wN83D7kD+5Lt2/F17+xNmfPpyRX GWodDp9A/ytMqHU4lHn+xjocDofDYSXnjXU4HA6H74DfWPr7+Rt1m3nQ0g6dBGmo+yY0Z7NsKRYZ 6v5S6DtCGhWznWdd3wi+qaB6e2afiqchqJ7A1OF/jfh3rMePeN6fzeu/qYSXiIVQCqoj6llPe6Vw q/gZry+WfVkVq1i2Ed9O8BKxAAnUevpAHrRcMmNmD+nBvE6y4BYPWvqZujQ9hucPpJHK5HlLfyuf f2O1tEiN4R3EgpeIAZyQetbTXincKn7G64u5LSR/E/hqwDuIBUig1tMH8qDlu6DHQrKFu/VDmLc0 PYCuB9LIpLF/k9Y3VvrTVNSKTAsEig21Emr9NEv4yjwWvG9BCLJArYRaiZID1EqolSC5gPwGAz4K BG8akPYJUiY2BZICJHwBpqD6nYV5F5sQxgKkEZoGskCtBEkBNUCtyEQAR4ApkBQg4QswBdXvLMzh 2ApAkkAWlBygVsIc71dMQXVCrZ9l+JyBrQAkPUh5ct87COAI5gCYAkkAE6h1cDz5HQtZqiHTZ8NK g2QFqfTFkDk+izgkz5Jjsj5H8AWXxWORdfWNPouY6s30fsUEPhZSYdAOKfj4Lq/RP0cRmkjkjicv 1qiaEiBLpvdLsZAKOZs7k3jt/rnLSw/5JvP6sFI+vV83IUFuSuzlWGg4yRJWQ8WQ+ScCi4VSLNTl QXjyO5bgTcQAjqD6TWjepTIEKeAdxCF5lhyT4RwxPeoWimeAvYLqAnkBOZDtJqikhLydCm4hvaV2 n0IsQJYo1ZCJMk/FTB2Kl5WUkLdTwVhkOO3ykgizlw7kLZOwlEFyIGnhv+EkQ6heowRk/ukD4GWe IjRxeNP0xrqU5uSBJxUGfiOVdqRCtCIjT5Fjsr1SyItnIFsaF+Vl5EC2m6CSEkxKACCfUZlgKQsa yevrEpRM75dioSQlAJCToBUkQ6gmrycH8tWTdZVMSA+ZYc0QZLIfTjKHsqHMP30AvKykDiG331gS Q3pTyE2Lw0qDZAWpDItDPzQ9PouY6k3WKyUmqZEDNYLqPm6Nyiu9kya9pDeFigkqKSFs90gKqK5S qjTfgkuozMtKSoCsmPIJUkZpkWR6JAVUd2PTLAihlEnvIw4r7ROkTM00IL35Ks2koLobm2ZBiTxL DmT+icBioRQLdXkQbv+tIGIyBXMQAO8bcIBaP80cLXKQiTJPyfegRlBdnqlWVInYOyBVKbnTA6YR mssIU2gRENunUTc9PmV434ADcicEZR4yS2UCUjmaTuSOAFNQnVCr0I7AgwLDTATA+wYckDv9YKag uoAWJdRKqOVM1QlzEHhCU0h9ilo/t+ATmDkQzBRUR2iFI/fNQSCQ+SpKmOmBKahOqHVwxG+slfz6 P5g/+18efXGTv+yBdH6d3/eUwsv7v873PpDDQD7/xjr8YuSnjKHWr6P/q+H5ALW+mfBb/I6vdvg4 5411OBwOh+/gvLEOh8Ph8B0Ebyz/+7vFEhhw7tLT2w+2C6rLaN3nTiX0mjfqZmj6J5r7KHrKNzz5 fDscQXUBLXqj7iM62z04RlBdRuvGre5HDxp0fD37DCwlch/Fddor13B5DwoIzU2G31hYbOtJggfH 0cDFyFLstaCEFVjwWegMkp5K6oPYVRaUsAIL7vKsy8BeQXXzSZQlmdOTbSdd8RplQQkrsODj2CUW lLACC0KepW6R9itqXV0FUCOovsOzrjo4RlDdwN164W69UfsdKw+eQe3Pb33UKF2+kaSHUiQ/At1A 0lNJfQo6iaSHUiQXgI3AO4gFkh5KkbxLT69BN5D0UIrkR6AbSHooRdJT8kdhqy0AJHNQANT6KHpK Qq0rbhUbD1pA8d+x/MRwOkz5BN40IEPzLtIFVDdDXSQ9lCLpId9k6lDgdOJHIRYgCc05NBGhFQlz EACSz0jj/80h6aEUSQ98FAgwBZLP8EN8LJD0UIokEWZhCohh9mDTAEkPpUh6qEyjdwtQqw8aRdJD KZIe+CgQYAokn+GH+FggSVjWghIoAGo1dD2mfXJLJWpAyWmn642V13hHqJgPeNYoXb6RpIdSJD3k Q4ZmPzKH0MRPNPfO+pggHzI0O5Ehfg5JD6VIeihVip+RZusQHwskCWQNdQtQgZep+6K9BZpD0kMp kh4q0+gnJf8WrwuaT/Ipkh5KleJnpNl8hqFuhs/6OIdSXla6enhd0zAZZUCtDEqZrLTUid9YpTWe sKbdXIas8xtJeihF0kO+ydQRtwyhfX69Ms/W5TPSkn9zSHooRdJDvpellnZeW99DfCyQ9FCKZA5l 6/IZrwvaTqIUSQ98/wleDQ51O6A5JD2UIukh38tSSyOvleUbSHp8yschpYJ612NK60rU68Nspb7O 83/HEtP7iL0jVMxlyDq/kaSHUiQ95OeSnFG0T26p9DW+2Ps90BySHkqR9JDvZamlndfW9xAfCyQ9 lCKZQ9m6fMbrgraTKEXSA99/+gCUem8hQ/wckh5KkfSQ72WppZHXyvINJD1IEZorkNdctjwjX1Sn pZ5qLutL8BvLBiHwnwalQMr8qAx9Cx7wuPd1R+q1wCDHpAUhPmWV3hS8TCUvVD8in+AdHwskPeSb TB0vvCnAFFTfwRotMMgxaUEIpbwMu16zEqqrUKVJCwzv+FggmUNZL1MrS0H1HazRAoMckxaEWI19 +kCQOJeC6jtYowUGOSYtCKGUl2HXa1ZCdYG8hpy6NEo+oJSXYddrVkL1fcJ2b/pYIOkh36T3S70h xTeWQLFhDgICNQJimIKZz0C7oPom2vyzXa2EWs2LtCiV4dObAhyQO+2gF6iVUCuROwLMEK1IqPUT 71fKWkC7oDqhVkKtQiVBWcjU9A+kQO6EoMxDPiRQK5E7AswcTb9R9+cWfAIzn4F2QXVCrYRahcoc FFBZ6nuBGKZg5jPQLqhOqJVQq1BJUBYyNf0DKZA7IWEZTEPdn75ab0LTgwKQOwJMkDvtoNeT+7kj wAzRioRaCbVunlr8Py8uubupnxkb0xOb+0XmzR94PM0xOWp+zuv0acPBOT7kHF/nHB+y4PgWvumN dZgK/osEah0Oh8NOPH9jHQ6Hw+GwkvPGOhwOh8N3ELyx/F8KWZz+rkiB84Ce3k5wuaC6jNZ97tQc PegcPw1d/KZi5mj6J5q7T08vgUsE1WW0btzqfvSgQcfXs8PBPYLqMlr3bU9eK36iucnwGwuLbT1J 8Ow46XrW2I+ttqCEFVjwcewSC0pYgQUfxy6xoIQVWHCXZ10CbYQEat256rKyJ9tOuuI1yoISVmDB x7FLLChhBRaEPEs9Ix1yfZJgBRbc5VlXBbvEghZuFYO79Ubtd6w8eAwmdM551i5dvpGkh1IkPwLd QNJDKZIfgW4g6aEUydnQOkigVvNJjWUVOtsBnUHSQymSH4FuIOmhFElPyR8O3UDSQymSH4FuIFmi sYx40AKK/47lJ4bTYcon8KZRl7d47Uioboa6SHooRdJDvsnUocDphEaR9FCKJIEsMAcBIPmMNL7p JEqR9MBHgQBTIHkL34vYIBOyxOMamAJimD3YNEDSQymSHirT6N0C1OqDRpH0UIqkBz4KBJgCyX5o IEkPpUgSyAK1rloeQANJhrTXgJLTTtcbK6/xjlCXd3nWLl2+kaSHUiQ95EOGZicyxM8h6aEUSQ/5 kKHZiQzxc0h6KEXSQ6lSfJc09Qcls0JLjUA1XqYB1xMuoTkkPZQi6aEyjX5S8m/xuqD5JJ8i6aFU Ke4n7Xl4kpce8r0stTzjdUHbSQAFQK0MSpmstNSJ31ilNZ6wpt4YzpmNLPV7SXooRdJDvsnUEbc8 gwaS9FCKJJFn6/IZaUnTSZQi6SHfy1LLXV67s1Gh6bksMKisLp/xOsXNIemhFEkPfP8JXg0OdTug OSQ9lCLpId/LUsszXhc0n+RTJIlSttLyANpCskK9MsxW6us8/3csMb2P2DtCXa5Blvq9JD2UIukh P5fkPIZGkfRQimSIr/HF3u+B5pD0UIqkh3wvSy13ee3ORoWm57LAoLK6fMbrFDeHpIdSJD3w/acP QKn3FjLEzyHpoRRJD/lellqe8bqg+SSfIhmS11y23ILmk6zQUkk1l/Ul+I1lgxD4T4NSIGV+VHof kLzL4/Z0yKvXAoMckxaE+JRVelPwMpW8UH0Ha7TAIMekBSGUMpmaXnhTgCmovoM1WmCQY9KCEEp5 GXa9ZiVUXxEW5yY5JOtQpZdpDEtB9R2s0QKDHJMWhFiNffpAkDiXguo7WKMFBjkmLQihlJdh12tW QvUdrNECgxyTFoRQysuw6zUrofoO1miB4R0fCyQ95Jv0fqk3pPjGEig2zEFAoEZATCaAeQvtfNQr aPPPdrUSajUv0qJUhk9vCnBA7twC7YLqhFoJtQqVOVqUUOsn3q+UtYB2QXVCrYRahUqCspCp6R9I gdwJQRlQq2AKaiW8g7gCygx1nY8YpmDmM9AuqE6olVCrUJmDAipLfS8QwxTMfAbaBdUJtRJqFSoJ ykKmpn8gBXLnFmgXVCfUSqhVqMzRokTuCDBB7twC7YLqhFqJ3BFghmhFQq2EWjdPLf6fF5fc3dTP jI3pic39IvPmDzye5pgcNT/ndfq04eAcH3KOr3OOD1lwfAvf9MY6TAX/RQK1DofDYSeev7EOh8Ph cFjJeWMdDofD4TsI3lj+L4UsTn9XpMC5hXYm1FqL7m7YrnUfurNE40koE1RvgB50jm/jwQTsNXIH oJjQ3E8091H0lIZjtK5aWc/O4PIkgDJB9QboQVfPM0dzk+E3FhbbepLg7nGd7f3IRiy1oIQVWLAD OEZQXcBqLPg4dokFJazAgrs866pgl1hQwgosqFAvuGwn0sJ/LSRBaIa0V07FzrCghBVYEPIs9Zh0 ywvVBazGgrs866pgl1jQwq1icLfeqP2OlQfPoPbntz5qlC7fSNJDKZKfAmcAtSKogORHoBtIeihF 8iPQDSQ9lCJ5l7u9tI6kkDsl2iunQmeQ9FCKpKfkzwBnALUiqIDkR6AbSJZoLCMetIDiv2P5ieF0 mPIJvGmQBKF5yWtHQnUz1EXSQymSHvJNpg4FziguZ1IBSQJZYA4CQPIZaXzTSZQi6YGPAgGmQLIf GkjSQymSRJiFKSCG2Yg1WixACiQrXFb6LMWGWn3QKJIeSpH0wEeBAFMgOZDLyVRAkkAWqDXheBpI MqS9BpScdrreWHmNdwSSQu6086xXunwjSQ+lSHrIhwzNUci0+kAqIOkhHzI0O5Ehfg5JD6VIeihV ivtJex6e5GUOZb1MrbXeEHR5NHFn4GWlz5Yq6xMaed3xc5eXHkqR9FCqFA8kLaxNpgKSHvK9LLU8 43VB20kABUCtDEqZrLTUid9YpTWesKbSKDFl10B7SXooRdJDvsnUEbd0cjmZCkgSebYun5GWNJ1E KZIe8r0stTzjdUHzST5FMoeydXmX1+73BB/XaalEgf8Er06Huh3QHJIeSpH0kO9lqaWT1ynVyVRA kihlKy0PoC0kK9Qrw2ylvs7zf8cS0/uIvSOYJH8lstpvJ+mhFEkP+bkkp5/LmVRAMsTX+GLv90Bz SHooRdJDvpellme8Lmg+yadI5lC2Lu/y2v2e4OM6LZUo8J8+AJdDWpAhfg5JD6VIesj3stTSyeuU 6mQqIBmS11y23ILmk6zQUkk1l/Ul+I1lgxD4T4NSIGV+VJrvzR4ez0mH6CUIDHJMWhDiU1bpTcHL VPJC9X3CdjJNWhBCKZOp6YU3BZiC6jtYowUGOSYtCKGUl2HXa1ZC9R2s0QKDHJMWVKACL1M3S0H1 Fb7YxwSlSJZAjf/0gSBxLgXVd7BGCwxyTFoQQikvw67XrITq+4TtZJq0IIRSXoZdr1kJ1XewRgsM 7/hYIOkh36T3S70hxTeWQLFhDgICNQJi7xip8B7a+ahX0Oaf7Wol1GpepEWpDJ/eFOCA3GkHvZ7c hyOovtqlRQm1fuL9SlkLaBdUJ9RKqFWoJCgLmZr+gRTInVugXVCdUCuhVqGS0Io36v7sxScwsw7K gFrlXvjAO4jroIyKU/cLxDAFM5+BdkF1Qq2EWoVKgrKQqekfSIHcaQe9ntyHI6i+2qVFidwRYILc uQXaBdUJtRK5I8AM0YqEWgm1bp5a/D8vLrm7qZ8ZG9MTm/tF5s0feDzNMTlqfs7r9GnDwTk+5Bxf 5xwfsuD4Fr7pjXWYCv6LBGodDofDTjx/Yx0Oh8PhsJLzxjocDofDdxC8sfxfClmc/q5IgdOOtjk0 sRBdXF2tFT/R3EfRU37v8UDrPnG2Ln5TMXM0/RPN3aenl8AlguoyWjdudT960KDj69nh4B5BdRmt +71Pfjj8xsJ6O4Ik6Dyxs/0BshFLLWjhVvE87AwLWrhVPA87w4ISVmDBXZ51CbQREqh156rLyp5s O+mK1ygLSliBBR/HLrGghBVYEPIs9Yx0yPVJghVYcJdnXRXsEgtKWIEFt3jQAmq/Y+VBPz2jnvVK l28kWaKxbDZ0BskSjWWzoTNIeihFcja0DhKo1XxSY1mFznZAZ5D0UIrkR6AbSHooRdJT8odDN5D0 UIrkR6AbSHooRbKFu/VG8d+x/MRwOkz5BN406vIWrx0J1c1QF8mQyxrKmkx9CpxOaBTJkPYaYA4C QPIZafy/OSQ9lCLpgY8CAaZA8ha+F7FBJmSJxzUwBcQwe7BpgKSHUiQ9VKbRuwWo1QeNIumhFEkP fBQIMAWS/dBAkh5KkSSQBWpdtTyABpL0UIokgSwoOe10vbHyGu8IVABU3+dZLy0lmYMCoFYGpSBD sxMZ4ueQzEEBUCuDUpCh2YkM8XNIeihF0kOpUnyXNPUHJbOEViTUKkAFXqbui/YWaA5JD6VIeqhM o5+U/Fu8Lmg+yadIeihVivtJex6e5KWHfC9LLc94XdB8kk+R9JBvslR/SfzGKq3xhDUPGmcj6/xG khUqleSbTB1NwxuhgSQr1CvzbF0+Iy35N4ekh1IkPeR7WWq5y2t3Nio0Qy4rKVuXz3hd4OaQ9FCK pAe+/wSvBoe6HdAckh5KkfSQ72Wp5RmvC5pP8imSRClbaXkAbSHpoRRJIsxW6us8/3csMb2P2DsC SRCa85B1fiPJCpVK8nNJzmNoFMkKLZW+xhd7vweaQ9JDKZIe8r0stdzltTsbFZohl5WUrctnvC5w c0h6KEXSA99/+gCUem8hQ/wckh5KkfSQ72Wp5RmvC5pP8imSIXnNZcstaD5JD6VIhlDNZX0JfmPZ IAT+06AUSJkfleZ7UyDZTk8jei0wvONjgaQnLPOm4GUqeaH6DtZogeEdHwskPeSbTB0vvCnAFFTf wRotMMgxaUEIpbwMu16zEqqvCItz0zs+FkjmUNbL1MpSUH0Ha7TAIMekBSFWY58+ECTOpaD6DtZo gUGOSQtCKOVl2PWalVB9B2u0wCDHpAUhlPIy7HrNSqi+gzVaYJBj0oIQSpn0fqU9p/jGEig2zEFA oEZATKYA5y7aPLRdrUTuCDBDtCLV4NObAhyQO7dAu6A6oVYidwSYIVqRUOsn3q+UtYB2QXVCrYRa hUqCspCp6R9IgdwJQRlQq2AKaiVyR4CZo+k36jofMUzBzGegXVCdUCuhVqEyBwVUlvpeIIYpmPkM tAuqE2ol1CpUEpSFTE3/QArkzi3QLqhOqJVQq1CZo0WJ3BFggty5BdoF1Qm1EmoVKnO0KKFWQq2b pxb/z4tL7m7qZ8bG9MTmfpF58wceT3NMjpqf8zp92nBwjg85x9c5x4csOL6Fb3pjHaaC/yKBWofD 4bATz99Yh8PhcDis5LyxDofD4fAdBG8s/5dCFqe/K1LgPKOz/TG4XFBdRus+dGeIHnSOn4YuflMx czT9E83dp6eXwCWC6jJaN251P3rQoOPr2eHgHkF1hFb8RHMfRU/Z9Xh+Y2GxrScJHh8njY97e7C9 FpSwAgs+jl1iQQkrsODj2CUWlLACC+7yrEugjZBArTtXXVb2ZNtJV7xGWVDCCiz4OHaJBSWswIKQ Z6lnpEOuTyJuFRsPWurYGRa0cKsY3K03ar9j5UEPGNIz6lmvdPlGkh5KkfwIdANJD6VIfgS6gaSH UiRnQ+sggVrNJzWWVehsB3QGSQ+lSH4EuoGkh1IkPSV/OHQDyRKNZbOhM0iWaCwjHrSA4r9j+Ynh dJjyCbxp5D4VtCONQHUz1EXSQymSHvJNpg4FTic0iqSHUiQJZIE5CADJZ6TxTSdRiqQHPgoEmALJ W/hexAaZkCUe18AUEMPswaYBkh5KkfRQmUbvFqBWHzSKpIdSJD3wUSDAFEj2QwNJhrTXALW++XgV CTjtdL2x8hrvCLlJBbd41itdvpGkh1IkPeRDhmYnMsTPIemhFEkP+ZCh2YkM8XNIeihF0kOpUnyX NPUHJbOEViTUKkAFXqbui/YWaA5JD6VIeqhMo5+U/Fu8Lmg+yadIeihVivtJe5pOAigAamVQystK 1wNeR/wc7mUOCoBaGZQyWWmpE7+xSms8Yc2lSQULkI10gJceSpH0kG8ydcQtz6CBJD2UIknk2bp8 RlrSdBKlSHrI97LUcpfX7mxUaIZcVlK2Lp/xusDNIemhFEkPfP8JXg0OdTugOSQ9lCLpId/LUssz Xhe0nUTUK0vZSssDaAvJCvXKMFupr/P837HE9D5i7whmEsiugTaS9FCKpIf8XJLzGBpF0kMpkiG+ xhd7vweaQ9JDKZIe8r0stdzltTsbFZohl5WUrctnvC5wc0h6KEXSA99/+gCUem8hQ/wckh5KkfSQ 72Wp5RmvC9pOIloq85rLllvQfJIVWiqp5rK+BL+xbBAC/2lQCqTMj0rvG7nTzuPedMir1wKDHJMW hPiUVXpT8DKVvFB9B2u0wCDHpAUhlDKZml54U4ApqL6DNVpgkGPSghBKeRl2vWYlVF8RFuemd3ws kMyhrJeplaWg+g7WaIFBjkkLQqzGPn0gSJxLQfUdrNECgxyTFoRQysuw6zUrofoO1miB4R0fCyQ9 5HsZtrwGJVTfwRotMLzjY4Gkh3yT3i/1hhTfWALFhjkICNQIiGEaudNIGvlC9U20+We7Wgm1mhdp USrDpzcFOCB3boF2QXVCrYRahcocLUqo9RPvV8paQLugOqFWQq1CJUFZyNT0D6RA7oSgDKhVMAW1 ErkjwMzR9Bt1nY8YpmDmM9AuqE6olVCrUJmDAipLfS8QwxTMfAbaBdUJtRJqFSoJykKmpn8gBXLn FmgXVCfUSuSOADNEKxK5I8AEuXMLtAuqE2olckeAGaIVCbUSat08tfh/Xlxyd1M/MzamJzb3i8yb P/B4mmNy1Pyc1+nThoNzfMg5vs45PmTB8S180xvrMBX8FwnUOhwOh514/sY6HA6Hw2El5411OBwO h+8geGP5vxSyOP1dkQKnHW1zaGIhurhhtdZ94sgSetA5fhq6+E3FzNH0TzR3n55eApcIqsto3bjV /ehBg46vZ4eDewTVZbTu2568VvxEc5PhNxYW23qS4O5xd+uHIwfgBgtKWIEFH8cusaCEFVjwcewS C0pYgQV3edYl0EZIoNadqy4re7LtpCteoywoYQUWfBy7xIISVmBByLPUM9Ih1ycJVmDBXZ51VbBL LGjhVjG4W2/UfsfKg2d0thvP5kiXbyTpoRTJj0A3kPRQiuRHoBtIeihFcja0DhKo1XxSY1mFznZA Z5D0UIrkR6AbSHooRdJT8odDN5D0UIrkR6AbSJZoLCMetIDiv2P5ieF0mPIJvGlA2idImdto8/12 6iLpoRRJD/kmU4cCpxMaRdJDKZIEssAcBIDkM9L4ppMoRdIDHwUCTIHkLXwvYoNMyBKPa2AKiGH2 YNMASQ+lSHqoTKN3C1CrDxpF0kMpkh74KBBgCiT7oYEkPZQiSSAL1LpqeQANJBnSXgNKTjtdb6y8 xjuCmd738S2eNablP7Z76aEUSQ/5kKHZiQzxc0h6KEXSQz5kaHYiQ/wckh5KkfRQqhTfJU39Qcms 0FIjUI2XacD1hEtoDkkPpUh6qEyjn5T8W7wuaD7Jp0h6KFWK+0l7Hp7kpYd8L0stz3hd0HYSQAFQ K4NSJistdeI3VmmNJ6x50DgbWec3kvRQiqSHfJOpI255Bg0k6aEUSSLP1uUz0pKmkyhF0kO+l6WW u7x2Z6NC03NZYFBZXT7jdYqbQ9JDKZIe+P4TvBoc6nZAc0h6KEXSQ76XpZZnvC5oPsmnSBKlbKXl AbSFZIV6ZZit1Nd5/u9YYnofsXcEkiA05yHr/EaSHkqR9JCfS3IeQ6NIeihFMsTX+GLv90BzSHoo RdJDvpellru8dmejQtNzWWBQWV0+43WKm0PSQymSHvj+0weg1HsLGeLnkPRQiqSHfC9LLc94XdB8 kk+RDMlrLltuQfNJVmippJrL+hL8xrJBCPynQSmQMj8qzfemQLKdnkb0WmCQY9KCEJ+ySm8KXqaS F6rvYI0WGOSYtCCEUiZT0wtvCjAF1XewRgsMckxaEEIpL8Ou16yE6ivC4twkh2QdqvQyjWEpqL6D NVpgkGPSghCrsU8fCBLnUlB9B2u0wCDHpAUhlPIy7HrNSqi+gzVaYJBj0oIQSnkZdr1mJVTfwRot MLzjY4Gkh3yT3i/1hhTfWALFhjkICNQIiMkU4NxFm4e2q5VQq3mRFqUyfHpTgANy5xZoF1Qn1Eqo VajM0aKEWj/xfqWsBbQLqhNqJdQqVBKUhUxN/0AK5E4IyoBaBVNQK+EdxBVQZqjrfMQwBTOfgXZB dUKthFqFyhwUUFnqe4EYpmDmM9AuqE6olVCrUElQFjI1/QMpkDu3QLugOqFWQq1CZY4WJXJHgAly 5xZoF1Qn1ErkjgAzRCsSaiXUunlq8f+8uOTupn5mbExPbO4XmTd/4PE0x+So+Tmv06cNB+f4kHN8 nXN8yILjW/imN9ZhKvgvEqh1OBwOO/H8jXU4HA6Hw0rOG+twOBwO30HwxvJ/KWRx+rsiBc5dtPlD f+Okuxu2a92H7gzRg87x09DFbypmjqZ/orn79PQSuERQXUbrxq3uRw8adHw9OxzcI6guo3Xf9uS1 4ieamwy/sbDY1pMED4570DIQ2Y4DLChhBRZ8HLvEghJWYMHHsUssKGEFFtzlWZdAGyGBWneuuqzs ybaTrniNsqCEFVjwcewSC0pYgQUhz1LPSIdcnyRYgQV3edZVwS6xoIVbxeBuvVH7HSsPntHZbjyb I12+kaSHUiQ/At1A0kMpkh+BbiDpoRTJ2dA6SKBW80mNZRU62wGdQdJDKZIfgW4g6aEUSU/JHw7d QNJDKZIfgW4gWaKxjHjQAor/juUnhtNhyifwpgFJ5jNeOxKqm6Eukh5KkfSQbzJ1KHA6oVEkPZQi SSALzEEASD4jjW86iVIkPfBRIMAUSN7C9yI2yIQs8bgGpoAYZg82DZD0UIqkh8o0ercAtfqgUSQ9 lCLpgY8CAaZAsh8aSNJDKZIEskCtq5YH0ECSIe01oOS00/XGymu8I3hTPkHKPOFZLy0l6aEUSQ/5 kKHZiQzxc0h6KEXSQz5kaHYiQ/wckh5KkfRQqhTfJU39Qcms0FIjUI2XacD1hEtoDkkPpUh6qEyj n5T8W7wuaD7Jp0h6KFWK+0l7Hp7kpYd8L0stz3hd0HYSQAFQK4NSJistdeI3VmmNJ6wpmd738QLy 7V56KEXSQ77J1BG3PIMGkvRQiiSRZ+vyGWlJ00mUIukh38tSy11eu7NRoem5LDCorC6f8TrFzSHp oRRJD3z/CV4NDnU7oDkkPZQi6SHfy1LLM14XNJ/kUySJUrbS8gDaQrJCvTLMVurrPP93LDG9j9g7 QsVchqzzG0l6KEXSQ34uyXkMjSLpoRTJEF/ji73fA80h6aEUSQ/5XpZa7vLanY0KTc9lgUFldfmM 1yluDkkPpUh64PtPH4BS7y1kiJ9D0kMpkh7yvSy1PON1QfNJPkUyJK+5bLkFzSdZoaWSai7rS/Ab ywYh8J8GpUDK/Kg035sCyXZ6GtFrgUGOSQtCfMoqvSl4mUpeqL6DNVpgkGPSghBKmUxNL7wpwBRU 38EaLTDIMWlBCKW8DLtesxKqrwiLc5McknWo0ss0hqWg+g7WaIFBjkkLQqzGPn0gSJxLQfUdrNEC gxyTFoRQysuw6zUrofoO1miBQY5JC0Io5WXY9ZqVUH0Ha7TA8I6PBZIe8k16v9QbUnxjCRQb5iAg UCMgJlOAcxdtHtquVkKt5kValMrw6U0BDsidW6BdUJ1QK6FWoTJHixJq/cT7lbIW0C6oTqiVUKtQ SVAWMjX9AymQOyEoA2oVTEGthHcQV0CZoa7zEcMUzHwG2gXVCbUSahUqc1BAZanvBWKYgpnPQLug OqFWQq1CJUFZyNT0D6RA7twC7YLqhFoJtQqVOVqUyB0BJsidW6BdUJ1QK5E7AswQrUiolVDr5qnF //Pikrub+pmxMT2xuV9k3vyBx9Mck6Pm57xOnzYcnONDzvF1zvEhC45v4ZveWIep4L9IoNbhcDjs xPM31uFwOBwOKzlvrMPhcDh8B8Eby/+lkMXp74oUOO1om0MTC9HFDau17hNHltCDzvHT0MVvKmaO pn+iufv09BK4RFBdRuvGre5HDxp0fD07HNwjqC6jdd/25LXiJ5qbDL+xsNjWkwSdx3W2P0A2YqkF JazAgo9jl1hQwgos+Dh2iQUlrMCCuzzrEmgjJFDrzlWXlT3ZdtIVr1EWlLACCz6OXWJBCSuwIORZ 6hnpkOuTBCuw4C7PuirYJRa0cKsY3K03ar9j5UE/PaOe9UqXbyTpoRTJj0A3kPRQiuRHoBtIeihF cja0DhKo1XxSY1mFznZAZ5D0UIrkR6AbSHooRdJT8odDN5D0UIrkR6AbSJZoLCMetIDiv2P5ieF0 mPIJvGnU5S1eOxKqm6Eukh5KkfSQbzJ1KHA6oVEkPZQiSSALzEEASD4jjW86iVIkPfBRIMAUSN7C 9yI2yIQs8bgGpoAYZg82DZD0UIqkh8o0ercAtfqgUSQ9lCLpgY8CAaZAsh8aSNJDKZIEskCtq5YH 0ECSIe01oOS00/XGymu8I9TlXZ61S5dvJOmhFEkP+ZCh2YkM8XNIeihF0kM+ZGh2IkP8HJIeSpH0 UKoU3yVN/UHJrNBSI1CNl2nA9YRLaA5JD6VIeqhMo5+U/Fu8Lmg+yadIeihVivtJex6e5KWHfC9L Lc94XdB2EkABUCuDUiYrLXXiN1ZpjSesqTSGQxYge+kMLz2UIukh32TqiFueQQNJeihFksizdfmM tKTpJEqR9JDvZanlLq/d2ajQ9FwWGFRWl894neLmkPRQiqQHvv8ErwaHuh3QHJIeSpH0kO9lqeUZ rwuaT/IpkkQpW2l5AG0hWaFeGWYr9XWe/zuWmN5H7B0hL1iP7KUzvPRQiqSH/FyS8xgaRdJDKZIh vsYXe78HmkPSQymSHvK9LLXc5bU7GxWanssCg8rq8hmvU9wckh5KkfTA958+AKXeW8gQP4ekh1Ik PeR7WWp5xuuC5pN8imRIXnPZcguaT7JCSyXVXNaX4DeWDULgPw1KgZT5UVnyH/N4SDrk1WuBQY5J C0J8yiq9KXiZSl6ovoM1WmCQY9KCEEqZTE0vvCnAFFTfwRotMMgxaUEIpbwMu16zEqqvCItzkxyS dajSyzSGpaD6DtZogUGOSQtCrMY+fSBInEtB9R2s0QKDHJMWhFDKy7DrNSuh+g7WaIFBjkkLQijl Zdj1mpVQfQdrtMDwjo8Fkh7yTXq/1BtSfGMJFBvmICBQIyA2E8Fj0sgXqm+izT/b1Uqo1bxIi1IZ Pr0pwAG5cwu0C6oTaiXUKlTmaFFCrZ94v1LWAtoF1Qm1EmoVKgnKQqamfyAFcicEZUCtgimolfAO 4gooM9R1PmKYgpnPQLugOqFWQq1CZQ4KqCz1vUAMUzDzGWgXVCfUSqhVqCQoC5ma/oEUyJ1boF1Q nVAroVahMkeLErkjwAS5cwu0C6oTaiVyR4AZohUJtRJq3Ty1+H9eXHJ3Uz8zNqYnNveLzJs/8Hia Y3LU/JzX6dOGg3N8yDm+zjk+ZMHxLXzTG+swFfwXCdQ6HA6HnXj+xjocDofDYSXnjXU4HA6H76D2 f14Ilb8gSn979A91IyhbL15GuvofuQNQDLyD2IApqE7kjlAxlzFjKWYa6kYPRFCdUCvhHcRE7ofF MGezbJGBb2fkDkCxQFKAA9R6E5oEagTVX4Ie/RSdkvAOYgNmTiUVgmmC6oRaN0f9PmpvLHo6+cOq FHskZVkffxA6gyQgE1KwGL5g0gKDHEigVtTlqaSI9krhVvElry8QfSMLPKEpwBe8RGyQCQnUKs8f zpotBn0vksCbiAVIgaQHKUF1hM/WKzcnfVG+v8WEFCyGL5D0lPwQX2xxaP5Nim+slufS+BwlZVkf 3+VxYw6dQVIgBxKYREqABGq9IRMSqJXVEJUU0V4p3Cq+5PUFsm8E1HoTmgJ84B3EBpmQQK3yiuGs 2WLQ9yIpeAcx8A5iAimgVkQ9+y2EX7PFhAQmkRJIekp+SFh8a8LvJn5j5Q9InNDUKGoxkHr1v4Nk qwO8gwCOgZSgeig0uSTzAEACtd54E7EAaYQmQAqolVArUXKAWgm1EiTHgnVArTehafgsYg98jyYS alVXkG8ydShwBNUJtZyJGOYabC+oS+BNH3vMt6BEnoWT+l7AFFQn1CqYiwm3t5gm8wCQ9MBHgeBN o+SDkmmY432YguqEWl9L8MYqfavcRzFQKwJZK/OfRp6iAiF3hiBjabJ36rGRO0JYKcAHuUPkWXJM 1ucIvuCy+DEyGcMReEqm4R3EgpeIgXcQGzBzKAX5zJTYyzVgqaFuIncEbyL2hAWIc5AFaiW8RBwW VLpWInvz1ZdmPTZg5lAWsXcEMw34guqEWoV2HwiIS5VfSuvvWEJueqfyICgFKZ+ET9nnVF5bE6oT 5HhpsQUA0vAmYsObiAXIEnkBOSbDUWJ61C0Ud4IVQl0CbyIWSHp8CrHgJWKBpId8k6mDUwRMZAHJ 2aQr/m300sce7yMWSAreQRwSZnMzjflByVxMuLfF9NJiCwBJD/mQoekDT26KQ5iPwOMLvp0b/45V dypPhFKQYb1PhQUDkfnhCvIhQ7TiZ41ahflmWnBJXkaOyfZKIS/uRAbSTHIggVqFGhU/sZQFBjkk PeTn0hxKATLDmnm8jnMbvfSxx/s+FiBDtCIjTOVmY9l65Ib8jBYTMkQrCnMA+ZCh6QNPboZlQskX JFXJfgvFN5ZAXy//tpViTzinYoYFQu48RkaF00o+sKwFABKoFY0yx4IWfCVi6jVZr5SYpEYO1Aiq mwm7yIQEahVq8liABGq9IZOkJyzzptBoSpxLQfUEaL5JC3J8yscCSSF3iDCbm+RAhiaQGKieQ7ii 3TQsawEg6aEUYnJMet/ITXIq7aXKL6X2xhIg5dNjKQ/MEMqaTH2KOQgEHwup6oXqPnTWT8xHTY7P IjYazdwxkArRClejOqFWQq2oErF3QKpScqcRNBK5HxaHphBWavSTsLKEVry7yBTgCKoTahXaBTOn gi2GNxEbMD25iUojND1htmQaahVMIXdmEG5pNw2fRWzAzEEKNQJMQfU7ayYCT8k01LpT+aXwG2tn fsHj3pnzeB9zHt1jzqM73OKb3liHw+Fw+MucN9bhcDgcvoPzxjocDofDd9D0f16ESMqjbgEtSqj1 59HH8YkH8qm9U8GXElTPZ+WuqeC5CarLaN1mX5xOgjRyp0I+IXeEijmcx5PnnfRBam8s+sL5968U ey7n/EHkIeA5WFCinvW0Vwq3ivfn9RDbnudAli2aij0xC0r4bL1yJenqF14iFkiCummBQQ4kUKsw cwiPx06657MU31gt39bXVOqnPripwychN/uzSRKVFNFeKdwq3pzX42t+ngNZs2Uq9KxIEpXUp8DB wDuIBZJC7ghmWuAhExKoVWgcwuOxk+75LPEbK/+q4oSmRlGLEaZKvRIb5ngfJlDrp7k/dDNJD1JA rYRaiZID1EqolSD51dC3I+kh32TqUOAIqhNqORMxzO/FvgsgSeQpOKnpBUxBdUKtgjkEP9PHQl0C b/rYIBMSqFVoNJAFajWbCOAIMAXVCbV+luHzlxG8sUrfM/dRDNQqoEUJcxAIPvbAf/WUi0l+BekL /fhGXhJ5ihyTlSHAF1wWfxHyXeireekhH/KZKbGXXwp9C5IepIBaCS8RhwWVrn5kmh8IaaibKDmA JMjLhIqZQ6mwEmZYKZ/eNxMS5KbEXv4aWn/HEnLTO+1Px6/wn0BiDxykAMlvJH0z/soqMvIUOSbD IWJ61C0Ufyn5V/PSQ77J1MEpAiaygOQ3kr7Zv29BkghTuZlm/KBkjsIP9LHgpY9zkDVyE46gOqFW dXjF98BBykOmVRKWMkj+Dm78O1bdaX86qMw/fQAs630ffyn5N/KSyFPkmGyvFPLi70W+C301Lz3k 59IcSgEyw5rv4vWF3bcgSYSp3GwsG4gMt/k+Frz0cQ6yQK37poqfhD6ZkDMqfxnFN5Zw+f0rxZ5w Tv7pA0FiSPsEKfmP3PkK7LtYUMJnEVO9yXqlxCQ1cqBGUP092NkWhPiUVXpTaDQlzqWg+nuwsy0o EWZzkxzI0AQSA9X38e0+FkxaYJADCdS6b6r4CfmQ3nx1ZqbQY0rs5a+h9sYSINN3/4elPDBLaFFC LTccEqSSF4jtMyQVvlD9VejpDcdrnatUnVAroVZUidg7IFUpufNF4HhBdQEtcg/EmwIcQXVCrUK7 YOY3guMF1QXCgpJpqFUwhdxpB72e3PSViA2YxhAzRCsSajkTMZmCOQiA9w04gurk4POXwW+sDak/ 91/5p/IRzpN8zHl0jzmP7nCLr39jHQ6Hw+GP8AVvrMPhcDgchPPGOhwOh8N3cN5Yh8PhcPgOzhvr cDgcDt/BeWMdDofD4Ts4b6zD4XA4fAfnjXU4HA6H7+C8sQ6Hw+HwHZw31uFwOBy+g/PGOhwOh8N3 cN5Yh8PhcPgOzhvrcDgcDt/BeWMdDofD4TvgN9Z/h8PhcDjsyXljHQ6Hw+E7ePzG0oY3d80QyppM fUrugNxE5WfRU95UzHaoBTJN+gdS7VALZJr0D0t5KmY72vYmNIXch3ML7UyYgwBApvw/kCqhRQm1 7uC7LE7DlNwRzEQASBI+izhsl0/CUgbJgaSF/6ibCABkyv8A2U50VkKtyLQAQIYmkJikRgnIVPIP pP4uPW8sjRJe5nPqWSOc2WKCsPKztBx/985K+91RRvvM9sp2wpnhtLCynZZFFTOkvTKE1pEEd80Q qjfpHcTmeCxL8STC+WSmK/gkcwZCM8NFZppvsQV5XApA6FPNn+Pr3ligxQxrFhOe1Hmn1PuWUnwL aqzMbK9sJ5wZTnu8ArTMDLdX9lZSjdiEPPCQCRmaJSzrgzw2x2NZiicRziczXcEnmRNSz5YIu8i0 7eZbbAGZcICZ3rc4NP8o5401lfCkzjtpiG+/O8oTDhTaJaXaCWeG0x6vAC0zw+2VvZXULfyccGZ4 UmjW8TU2xAL7JCxlQbJnEc4n0y6xwD5L1LMlwi4y/Xb5JFkyjTCVB4KP/yJj/x0LkBS8k2eN0hwJ jJIjqH6j7kfRU95UzHasBYGf8GCaQWONXHrUTZBsB6OM3IQD1EqodQftTOQOyE1UltCihFr38b3h nDT+H2YiACRDfA1i+bTAJHgVJRCbic95hPPJtEssMAleRW/UeqNuG2E9mZD2SbJkGmSGEvj4LzLq dyxPnvJOe2NYCfNu6lPMuNM3SkxSo/tYLw0JZbgoNFsIZ7ZMe7wRVPaGqRYetAjhDUSLebm9Xg8Z Dqk3DufBDZD1w+rZEmFXy/a6SVgKmIkYgeDjv8jve2P54OPMuJO6vHw20JD2fAI5Ji8r2wlntkx7 vBGgnYaQeXfF3Xoh3xUOaTHDGiOfH7aHQ8LKeTy4AbJ+WD1bIuxq2T7E9IFANX+O/d9YLSbwZliw nhl3UkvnNI+05xPI8bKSukU4M5zWuTFsvzSpgAjb27F6BP7TCE0QVoZYyk8L28kEYeU8HtwAOeOw lkXzTB8IVPPnGPvGwhCjYpbQooRakanCARNZQPIjhDd03hm2y6cHqbtQL6RhJgLgJaXaCWfKJ2FZ A84ttDNhDgIAGZolJGuo1YxvodgwBwGBGqBWhM9aTC2Q8klYyiA5nHydx0wEADLlf4BsJzoroVZk WgAg+00PUn+Xx2+sw+FwOByWct5Yh8PhcPgO6I11OBwOh8OenDfW4XA4HL6De28s/FqmwpH7uSOE 5q8H39pQ1/mqR6ATP/SQdff87bpmj0Va4dBEM9r2JncAiis0luWgUVBdRuuqlVrxE839PBIxgRSh uQa04Sea+wmlIGfQOb+l3dcgFiB/GTfeWPoYsgehrvNV/6xUa/JzXLDiFnSPyTzox0ZZsBJbasEk bL4Fk7D5FoRQluQlVE8ShCaBGkF1M9ZlQQkrsKAFX4xYgCQqKQKVQK0qpUrzLegnH5U7t2hpt5o8 +GW0vrHw/YFaCbUSJUdQnVBrDgtW3ILugQRqDbqZhpCcDa0jORCaTHIgNJmkh1IkL6F6kkLu5KAG qNUGtZD0UIpkCV+GGMDx5H7uAPMtuCSsJJPkY/I5uXOLy3YrsACQ/B10/a2gSQuM3BFC04MCT+iX TI3eoGwr9LKEWm9TxVNoCMnZ0DqSA6HJJAdCk0l6KEXyEqqvyxCrsaAdaiHpoRTJkLCm0YQD1Ep4 B7EHfo6mHWaiQCDpQcoT+qGTm0Lol0wLKDbMtACQ/B08f2OVYpA7QmgSvgYxgCOoTqjluizYELvN AkDyGTSE5GxoHcmB0GSSA6HJJD1IeTTRjLa9Ufenr1aGz/q4EWoh6aEUyZCwpseEA7z0WcQEUgJJ AY5A0oOUQFKAI5i0wIAjeInYgAnUykwLPN70sUDyd7D1GwuQAwnUcjUWbAWuErxELJB8Bg0hORta R3IgNJnkQGgySQ9SQK07UCNJEJrAp3zcCLWQ9FCKZE6pIPdz55KwJTRDUAnUqrZTCjLEsqgE5JhE kIMyQ92EWm/IrMvfQe8bi0BKIAlCk8hryIEEarkaC/YhP4kcks+gISRnQ+tIDoQmkxwITSbpsZQF t6AukiA0AVKE5hqgepIeSpHMKRXkfu5cEraEZggqgVrVdkpBArUcuU8OJFCrOtNMCwxy6vJ30PXv WEbu544QmkReQw4kUMvVWEDxpyjdYL4F/dgoC1ZiSy2YhM23YBI234IQn/VxI9QCCdQq1KhwlPw6 1mWBQY5JC0pUCihF0uNTPhYggVrVyT4WTOZBCGUhgVqFUYiN3MwdAaagOuGdPDbMtOCX0frGwvf3 aCLhHcSekhkSZmEaFVNQnVDrc+gdP6EU5BB04oe+uO6ev13X7LGICki2gBajYgqqE2q9Cc0W0Cio TqiVUKtQmRPWwPSYiQIPfJA7QsUUVCdyR4ApqHZODhWYRGAgK6hOkAR5GchNc1LHC5MWEPAF1b+L e79jHQ6Hj7Ps59GyRSGd2zvbD3ty3liHw+Fw+A7OG+twOBwO38F5Yx0Oh8PhO1jxxsJfKHs08TfQ 75xQK5E7/cyY2c6y7bstQhlQqw+d5dBEgZaaCu3t7ZW3uDWTitNFL1RHaIUj9+GE1LONYIugej7h Lm+mc9bdM4QP/I419Rnt9gdA95jMg35mzGxn2fbdFlF2xlWNBzxb3d7euaiETGsfSMXtjR50UW9l 1LMtHj/B4tLY/nUgnJNvH7VuDavfWLOfzm5Pn+6BDM1OZsxsZ9n2DRfNuwHU57ffGdLe3rmoBOaE 03KTisOuS0rtlWnPFnnCCf1j6+TzzaHU7EsGsvSNdflcUCCfAKagOqFWZKpIwNkNHEbnDbl2xsx2 lm3fcNG8G4TL4e13hrS3dy6qk08TB6h2NXnQTjgQVKaVuiQ21CqbGr1BAVArETr4BDAF1e9sxTTM oVReuS3r3ljyUIDqAr4AMbVUTB9sSOnIITfPmNnOsu17LpKsodYgLgdSwd0D2ts7F9UJp3kzjBHI J4BZQet+jjLUirCsL6MWyJJpwAckjdz3DmJyKqZBWY0SJHdmu3/HyrPhww1NH2yFXOUPoyNJPmPG zHaWbd9/0cCTWkY9vhO0t3cuqnM5zRdYLEHoX4JKqq+0SwqofpObJUk+CE0h9y8dyNAElZRAcmfO G2s6+Uml43uYMbOdZdv3XzTwpJZRj+8E7e2di+pcTpMCAiaygGSFu+2WCmvELBWUfBCaQu7XHYkh vSl4WUkJJHdmxRvr1tPJs2F7aab3qeYjlG4ID+5kxsx2lm3fbRFlR11VmVPa+Gx1pX3sogrhwNKW 0hkVGabq7Z5wVNgemj7weLMUg1I7QGyfIGVUet+oZ7dl0e9Yr4f3Rq0CYQEagVrlmWrt8cegpzg0 8U6pGMSMme0s277bIpQBtbopjcIWQXUid24RtsMUVCdypxMMNNQtbAfeRA1QK6HWVaXqhFoRlDWZ +hQ4guqEWtkEA2UCSQBT8HGIFaS+F2QiIFLhxeTd+MDfCh4Ohx6W/ZT57I+zzu1f97O4h7/zZc8b 63A4HL6b88Y6HA6Hw2EvzhvrcDgcDt9B6xtLfus01Eqo9TZVOHIfzt9Bv3ZCrUTu9PN4Jho9mniT O0JoXpLGK2oVTEGthspGtDOh1tV2FWVQBtTqQ2c5NFGgpaZCSztqPJoYgZ+G4Z7chwPUqt6jFY6S eWhBn5cj9+EMp+mNRetNXp6FglL7DKYOf0Dpu+dBPwNn0gSR+czQvIRaIEPTB0apspGwvTQzD0JK 7T3cGtJ4Z4ln7c92hcgoPy2cTKbJsDinpaxx1OZM+hb1schSzaxLHr+xLg+ygrB9ElOHPyD87jMe yMCZ4agWs4XO4WFlOy2LKmZIJfWY9pntd4Y8a7+7pQJG+YHhcDLzrpzLmZ7Lgm9h/RexjbR60iW3 31gSQ3ozx2cp9pJACjUCTEF1Qq3IVJGAsxs4jM4bcu2omaU53s9NCRCbU4IKwvrKqJb2Cr5e4rAd JqXCSlBJPcZuADBDKFsvznnQfndFC34mYvkE3jQgyfS8OhMmc9PInRw0CojJFLyDAI7gY4Ek8ep/ Yw4C4H2j5AC1Et5BAKeCFed4n2pKLZ3c/ncsxP4TvIreqOVM1a6xhM+G9RXTBxtSOnLIzUNmShcw iUBoMf1nBSkw1HKYiSBVvYApqE6odQftfA+HaZhDqbzSI1lDrT5oVGUspSqVIXfbpQCoHoQfSPMt hg/M8T5MwztU4GOBZA71QnpT8CYVlCoJSxl3TR8YlXb/iYCAL/jYQI2g+ucEtUbT+sby4Bo6y8dG u2nkWXIgQ9MHWyFX+cPoSJLPGDsT7X6IxRXTf5agrJcS16V9GiTvQvNJapQgWaG9sp3KzMd3gsft dxfVqUxDKrxTPr3v4zp3u6gGUj4Jn7JPHwCShGTr9SZTIY8KHQImfdap14RzWsY+oOuNBQnC+9pN I8+Gi0LTB/uQn1Q6voexM9Eun0TFpM8SlDWZd4WVpfZnWHs+5/GizpNCKjMf3wket99dVKcyDanw ztBswVe2dFE9pDcNn7ICqgwbCamxMl/vfUAOZYXcEWD6zzr1mnBOy9gH3H5j2R3hfZdH5w5x2QIZ mj4QqOYjlG4ID+6kZya15BPCmbTRf5agbKWlpTJsbMR6S0MuCwBl68WN1GeW5LPVlXbvUPbZrhKX i9pNw8tSivwKUgkQ26eRp6zAV0rsJUEpk6nphZn4NEx6v1KZf9YJhxjhnJaxD3jy71iGWgm1rkzV ZcIa9AK1CqagVsOuBegpDk28UyoG0TMTvUAtR9302bDSIwVG7oDchyOoTqh1B+0sDASaeKdUlEEZ UKsbHZdQK6FWZKq4T9gOU1BdPqkHHfcmN+EIqhNqlU9Sq6FdoztYVxqmmINAoBgghhmCMqDWT8xH DYAD1HKm6oQ5CAQf56Smf6gbzRRUJ9QazZO/FTwcDh9k3o8DYtmiGUz8obn2sdC6r/5D6ee8sQ6H w+EG698ZstFQ669y3liHw+Fw+A7OG+twOBwO38G9N1bpd9Lc987rV9mfaOJvoN85oVYid/qZMbOd Zdt3W4QyoNYgLgdiqUcTd2hvbKlEjadkAtXVsVrh0ETbSQLKgFoFczidw1vareb1Td7A+WXceGOV nkLu546nkupn6vAH0D0m86CfGTPbWbZ9t0WUHXiVjLo77cF2a7nsba/0hMXPRhl5e30OZSFDs598 TufklnbUUGXn3j1pfWOFT0TI/VIlKPmjmD3/LnRP+HCG3DxjZjvLtm+4aNINGHtr+INLqKUyob3S E5aZWR9SypbaK9PCyvb2W+RzOidftlsBVXbu3ZOuvxUsPSkhfFiXTxAF8glgCqoTakWmigSc3cBh dN6Qa2fMbGfZ9g0XzbtBaB/+7IzHX7NlXVjjzfo6oPqNdyibF5dAZXu71QOYgupEyREQwxRgCqoT ahVmIhB8bISmUPK/mudvrPpzDB2guoAvQEwtFdMHG1I6csjNM2a2s2z7noska6g1iPaBz1ZTV2VI eyWQAqA6odbbRABHgGmEDjCJAJAs4ctes96oFUEFiL0jmCRfEMebeYEAk1JkVhpzSv63s+6NZdQf 5eUoyND0wVbIVf4wOpLkM2bMbGfZ9v0XjT2pcdrjpe1fs72SCCthyqfP+rgOKqn+sl0KfA3Vk/SE lfJJ+KyHHF/p8SkPsoJqR8kM/d9B1xuL0ESCpKeSEvJsODk0fbAP+Uml43uYMbOdZdv3XzT2pMZp j5e2f832SiKshNk581Z7nm1vDytL9bnf0h6awMw82+L8Mrr+HcuoPzjK1p9pfZQAWZrpfar5CKUb woM7mTGznWXbd1tE2bFXhdPGbrT2fE5pUX1j2NVuGl6WUnlgVNoBmWENCCtL7d63ytCEFFKeTSE3 SzHInd9H6xtLnoVH3TfeQYGRm3BKhAVoBGqVZ6p1tWgNeopDE++UikHMmNnOsu27LUIZUKsbHfdG XeerTo5GT6GBAKagOpE7ISgDat0xBbWaK1W8gSmQNHIfTghlTaY+BQ5Qy5XlpqD6nSVTMAcBKPnC q+cnmvhF3Psd63A4fJxlP4k++yOvc/uv/Hl9OG+sw+FwOHwH5411OBwOh+/gvLEOh8Ph8B30vrH+ e0PSgC+Q/DvgiwO1ErnTz4yZ7SzbvtUi1BjqDqJxYOfq9vb2ykYwEKgVoRWO3IdTQosSat3ZrtFa /N5042fO2IquN1b+BEvP1PzZD323P1S6J38OAw+eMbOdZds3XOQLBl4lo1qmWU1LcU57e+eiHJrT PhaV7e1h5eP2ZdjePPizPH9jhc+uxZz60Hf7Ew2/+4wHMmNmO8u277nIZ0edhDmX06jg7vb29s5F IfWZpRXmN9YLYeXj9mXcvfMvMOWNJZ/AmwZJD1KvzgRMQXVCrchUkYCzGziMzhty7YyZ7Szbvuci nx170uW0W3fmtLd3LmrBz5QYqH7jHcrmxSVQSaO8JKhSo3cXMAeBQLFhjvdhCqrfWfs0SP41et9Y 8gnMtFhA7B2BJNHYHpo+2JDSkUNunjGznWXb91zks2NPupx2686c9vbORZfkA0MHqHaOoNYVvhKN AmKYOZbyNVSfD6ECwyp9gZmQQsqzKZD8a3S9sfyzC58jTEqFlUaeDdtLM/P2HZCr/GF0JMlnzJjZ zrLtey7y2bEnXU67dWdOe3vnogoy6u401FPX5ZDXmnJNPQVUv8lNSP8JXnUOOEiBu+afZdjfCobP 8cETz7Nhe2lm3v5x8pNKx/cwY2Y7y7bvuchnx550Oe3WnTnt7Z2LSjybg65bJ10uqhRYKqwRkwr8 pw+AZb1vJiSomH+WwW+s0sPNgxJ5QTgzNH0gUM1HKN0QHtzJjJntLNu+4SJfMPaqcBqZJp+trrSP XZRTn+Oz4SWhaVTac+oF4Shqgcw/fSBIDGmfICXjSsQU/Fmev7GE9EgVtQqmkDshYQ16gVpXiwTV H0VPcWjinVIxiBkz21m2fatFqDHU7UbHvVHX+aoTuXOLsB2moDqROz1gmkcT0XbVCbUKpqDW21Th IB+yBBWYTK0KHAGxd4RU8gKxfeakqheIYQpm/nG63liHw2E9y35yffZHZOf2zX++n9fPM84b63A4 HFZz3ljPOG+sw+FwOHwH5411OBwOh+/g3hur9Jts7ntHYkITfwP9zgm1ErnTz4yZ7SzbvtsilAG1 BtE4sHN1e3t7ZSMYCNSK0AqHJhIkQ9AF1ErkznA657e05zWzv9SnuPHGkkcQPoXcJ4eyU1m5qwW6 x2Qe9DNjZjvLtu+2iLIDr5JRLdOspqU4p729c1EOzWkf6yslvmykApN50E8+qnN4SzvViGzp+kZa 31j4/vlTyP2Ss4aVu1qge/KHIwy5ecbMdpZt33DRpBsw9nJ4+50h7e2di0LqM0srvI+4VGmEk0Oz n3xO5+TL9vCLdC7dlq6/FTSZPx3vIJZPADMEWZQJMAXVCbUiU0UCzm7gMDpvyLUzZrazbPuGi+bd IFwOb78zpL29c1GIHyJxLgXVb3JHCE2PL3gNTdKbAkmP1QOYgupEyREQwxRgCqoTahVmIhB8bIQF YeUv4PkbqxQDypLUKCKvpPqK6YMNKR055OYZM9tZtn3PRZI11BrE5UAquHtAe3vnohIyByCGCUgK qfCF6je5k4NGAbF9GiQ9rzaXRewdwST5gjjezAsEmJQis9IISvFvYsUbi6g/ystRkKHpg62Qq/xh dCTJZ8yY2c6y7fsvGnvS5bTHd4L29s5FLbTP7DwG9e1Dwkr5JHzWQ46v9PiUB1lBtYNML8P6X0DX G4vQRIKkp5IS8mw4OTR9sA/5SaXje5gxs51l2/dfNPaky2mP7wTt7Z2LWmif2XkM6tuHhJWl+txv aQ9NYGaezYcQmvhFdP07lpH73qFs/TnWRwmQpZnep5qPULohPLiTGTPbWbZ9t0WUHXtVOK208dnq SvvYRXXq20uXgPCe0BTCsaViQFnI0PSBYJWhCSmkPJtCbpbinHr2e2l9Y8n396j7xjsoMHITTomw AI1ArfJMta4WrUFPcWjinVIxiBkz21m2fbdFKANqdaPj3qjrfNWJ3LlF2A5TUJ3InU4wUFD9Rl3n q06o9dMU1K22q34TmgQVmEytChyglivLTUH1O0umYA4CUPKJevZ7ufc71uFw+DjLfhh99qde5/bf +iP7j3PeWIfD4XD4Ds4b63A4HA7fwXljHQ6Hw+E74DfWfxm5D0dQnVArQQ6kRxN/A/3OCbUSudPP jJntLNu+2yKUAbUG0Tiwc3V7e3tlOy0zUePRxJvc8aDFk/twQurZZ4yd6ae9vkzb8PbKfbj4HQvf h75VxawHC1i5qwW6Z+rDmTGznWXbd1tE2YFXyaiWaVbTUpzT3t65KKRx5mW2XkCgmFoqE24Nb2Ts TJuWByXaK7ei9sYqfSXIx+ZUVu5qoeWBDLl5xsx2lm3fcNGkGzD2cnj7nSHt7Z2LQuozvaysQ6pS QFgltVyuGMvAmY3fyMt65c4U31iV7xCmYIYPwj5BysQgizIBpqA6oVZkqkjA2Q0cRucNuXbGzHaW bd9w0bwbhMvh7XeGtLd3LgqpzJQYmMxNwWJvVqiUNabCjRQb5njfm4Biwxzvw/SYSVkvX50JkwgA yZ2J31jpq71Q7aiblIWUT+/7OCevpPqK6YMNKR055OYZM9tZtn3PRZI11BrE5UAquHtAe3vnopD6 TC8lJmmfwMclXiMSqh2haVjWl4Uxzak0VlLGrRqhkhLaK3em6d+xgMT5FyOTCkiC0DTybDgzNH2w FXKVP4yOJPmMGTPbWbZ9/0VjT7qc9vhO0N7euSjk8UxU+vpb91DjZS9qBNUJSP/pA1DyBXGA6oRa DvMREOTXpae9cjda31jhV8rNlgcRmkbjzND0wT7kJ5WO72HGzHaWbd9/0diTLqc9vhO0t3cuCnk8 E5XySSB7iVU2toT1iP2nD0DJF8JUXgYa/br0tFfuBr+xwm8Sfp/SlzQ/D0CpEeTZsL000/tU8xFK N4QHdzJjZjvLtu+2iLJjrwqnlTY+W11pH7sopHE7ZevF4LI9bykRjvJDyDRKvuCdB+1C3cyz5FQq dyb4HUu+gJE7oGQCkgIcoFaBsACNQK3yTLWuFq1BT3Fo4p1SMYgZM9tZtn23RSgDanWj496o63zV idy5RdgOU1CdyJ1+wpkwBdXOEdRykIkyQXXUrsIBP4dSJhHkWUOtrEYgx+Sr7Q0cwcdGaAqplVMw BdWJ3Nmfi78VPBwOu7Hsp8xnf5x1bv+6n8Wz+R0P5LyxDofD4fAdnDfW4XA4HL6D88Y6HA6Hw3fA b6z/MjTxTql4E5og9EvFv5j0hBS1ErnTz+OZaPRo4k2L007a8IKkUTLJh3MXba5uB6qvFmlRQq0R tAxEjUcTd2hsRBlQ6z7Ui2lArTKlsvZeoNbN7QdDH5kj9+EM5+J3LFucB0JoAnEazbHMnn8Xusdk HvQzcCZNEHnptHPZGBbApNSDG/KW0pDG4f0nhdicWwMfbG9cRNkHiwTp8o00hCRh2byLnJy8xT6N yyFfwaRvUR+78nnW3li2Mjylcl+lgMzhzJ5/l5aHMOTmgTPDUd7MnXYuu8ICMyl794b6cE/75Ls3 tEAzG1c8uKR90bOTPGjxjfWZLZUIKJsTtofmt7P+W9jGNc+z+Mby+8JTSvflgRCaOcjKJ4ApqE6o FZkqEnB2A4fReUOuHTWzNCcf6B2JIb0ZUi8Is5WWy3VEZb58Am+20F7ZDs1sWfHsjAeLwLN1QqXR pyQGJhGAurwE9beGSBYgJlPwDgI4go8FksSr/405CID3jZID1Ep4BwGcClac432qKbV0Er+xXgcm TCIAkJemxaFZIi+mlorpgw0pHTnk5iEzpQuYRCD4GORZ/1nCagBMI3eE0BRKfgW0yCcw02IBsX2C lCmiRQm1+qA5l2PT5heqm6GWxgkPFhml3tz3DmXrsg6NNdSK8Fkr9qbgTSooVRKWMu6aPjAq7f4T AQFf8LGBGkH1zwlqjabp37FofaNpcWiWyAvIgQxNH2yFXOUPoyNJPmPsTLT7IfnAPJt35UjWF5Ri o2SG/iXUGA6BmQovKkPaKyvQkHnb7y6SgsuaOnl7y0wqqMsSrzWukrpIesJK+SR8yj59AEgSkq3X m0yFPCp0CJj0WadeE85pGfuA8W8somSWyLPkQIamD/YhP6l0fA9jZ6JdPglkgZeI/WeJyyFEbtbn 16lsN2C2VIa0V1ZYtv3WorvDQ25tNOpdLUPymvYhPiUxpDcNn7ICqgwbCamxMl/vfUAOZYXcEWD6 zzr1mnBOy9gH8BurtDUPhNA02k1PXkAOZGj6QKCaj1C6ITy4k56Z1JJPqDuI/WcJypoMu3KzPvyS cHu7GdJeeQubkw/0Tv/2Z4se0z6TsibzrnCONy8LhLDGkCxAbJ9GnrICXymxlwSlTKamF2bi0zDp /Upl/lknHGKEc1rGPiD4HUs2GWolckcITRD6pWKj1GWoVTAFta4WrUFPcWjinVIxiJ6Z6AVqObyJ GgMOUoKPQ1KTolahKzdT0w800Yy2JdS6Y4ZoUUKtEYQDYQqqR2wPe2EKJA347Wjbm9wRUCmo/rml 5BjqZu0qHLkPpwUrRiMwB4FAMUAMMwRlQK2fmI8aAAeo5UzVCXMQCD7OSU3/UDeaKahOqDWai78V PBwOuzHvxwGxbFFI5/aJPzTXPhZa99k/lI9z3liHw+Fwg/XvDNloqPVXOW+sw+FwOHwH5411OBwO h+9g6Rvrb/5Ki9/lgVqJ3Onn1sy8MmyHKah2tJuN+N7Xyp9oonrSWBq3oAyoNYL2ge2VIe3t7ZXt NM5EGVArkTs5qPGUzMPmrHtjrflvYrf/7Ogek3nQz62ZUkNlJr1PNZ5Xf5YNzUbqvZaq1IylcSNl R53XuF1orwxZtiikcSZl865b7aDektNen1fe3XUoseiNhT+wBX9su/2XQfeEz2HIzbdm5meE7ZUh YcFlV4V6r/nPhj+AFlX2zjjp8fa7xyxbFFKf6WWYqrd7wlSlfjgrd/1u9vpbQRTIJ4ApqE6oFZkq EnB2A4fReUOufTDT14TtpSHmhxNKXS2EveGW2dCiyt4ZJz3efveYZYtCKjMlBqp/Ap+ypWLB6kHF LJHXQMIXYAokBThArcNTtvt3LF+DmLoqpg82pHTkkJsfzPQ1Ybt9gpSJu0LzAXmvOMBkbs6Ahtd3 pVsUtfqgOZWx7ZUhyxaF1GeWVpjfWC9IymcRh2YFKkjdcbuPQe4cnrH1GwuQAxmaPtgKucofRkeS fMaDmZcnyaf3zYQULA7NB1R6kZJPX+PjsdDk9kVDTmrf/vhOsGxRyN2ZUuBrqJ5khbDysr2+zst8 1OXwQyPnjTWd/KTS8T08mOlrwvaSSZTMB1QakaKCx4suebxoyEnt2x/fCZYtCrk1M88+PimsvGyv r/MyH3U5/NDIb35jUc1HKN0QHtzJ3ZlUlreXCozcEUKzEd8bbg/NSdjw+pZJJ1W2lzY+W71sUUjj 9tLGZ+2QoVmhXu9lPqqePbSz6I0lf0gedSPCLLqAWgVTUGuP/yz0FIcm3ikVg2iciTJD3agdDlDL 0W5ekjb8IzfhCKoTak2jcQvKgFojCAfCFFQncucWYTtMQXUid/oJZ8IUSBrwBZIApqD65wS1CmaO VrwxEwGATPl/IAXUqi46XLL0d6zD4dDPsp96n/3x2rn9vBt+JeeNdTgcDofv4LyxDofD4fAdnDfW 4XA4HL6DD/yfF2r9GfRrJ9RK5E4/M2a2s2z7botQBtQaQfvA9sqQ9vb2ynbaZ4aVoRlClZAeTWRU UkR75WPCFQv2bsKKNxY9zakPd7c/udJ3z4N+ZsxsZ9n23RZRdtRVjduF9sqQZYtCOrf3tF+2GKXK 3G+f+ZhwxYK9m3DeWHMJv/uMBzJjZjvLtm+4aMYNj7ffPWbZopD6TC/DVL3d09JeoVSZ++0zHxOu WLB3Ez7w71iVh4uUfAKYguqEWpGpIgFnN3AYnTfk2hkz21m2fcNFM254vP3uMcsWhVRmSgxMIgCQ oRlSaZdPkDIxPmtxalLgCIhhChVTUJ1Q68pEXDF/PavfWJdP1heEfxgV0wcbUjpyyM0zZrazbPue iyRrqNUHzamMba8MWbYopD7TyzBVb/eU2r3vY8JSVJO3iONNi3PTOwJJkFdKXDH/AuveWI2PNa8h BzI0fbAVcpU/jI4k+YwZM9tZtn3/RUNOat/++E6wbFFI5/bOdqLeDlS/uXRMhpVE6MNBClTMv8Ci N1b7A80rwz+b0PTBPuQnlY7vYcbMdpZt33/RkJPatz++EyxbFNK5vbOdaGm/nFMquKwEYXu7+Rf4 wP95UScvDv9sQtMHAtV8hNIN4cGdzJjZzrLtuy2i7KirKttLG5+tXrYopHN7T3upIMen6jENMUm+ EFZ6U+K75l9g0RuL0EREmEUXUKtgCmrt8Ueopzg08U6pGMSMme0s277bIpQBtUYQDoQpqE7kzi3C dpiC6kTu9BPOhCmoTuSOUDEF1YmSA9SKoKyXqfWFSQSg5INX2xu1fg7E5y3z17P6/7w4HA6dLPvx 9Nmfg53b/84P8T/FeWMdDofD4Ts4b6zD4XA4fAfnjXU4HA6H72DdG+u/N6oPE/jsE162fbdFKANq jaB9YHtlSHt7e2U77TPDytAkUOPRxJxvtDPf/t0XvbGWPZdv+QOYcafN/MhDWLZ9t0WUHXVV43ah vTJk2aKQzu3t7Z6861a753FjidLAUYvyrzz8K0xlxRtr5RP5lqc//E4auPg5LNu+4aIZNzzefveY ZYtC6jO9DFP19hJW9qx9NlPP2Py7t7DXGwuV8glgCqoTakWmigScj4NLcJJgpgGnHxo1cHILy7Zv uGjGDY+33z1m2aKQykyJgUkEADI06/ia9nZJIUs15ntgCoj9J3gVJVQnSg7IHQEmMMf7MD1mUjYs 3pN1byz5BDBL+ALE1FIxfbAP/qR5d9LAxc9h2fY9F0nWUKsPmlMZ214ZsmxRSH2ml2Gq3p4jBcAk AkDSg5T/NCqyJTbMDLMC+aGUT+/7WGhMbc6iN5Z/IvWnk2fJgQxNH+xDeNLwO0sPZA3Ltu+/aMhJ 7dsf3wmWLQrp3N7eTtxt9/X1Li9LsSGmx0wEBPmhrNS0tH8FH/hbwfrTybNhe2lm3v5xwpOG31l6 IGtYtn3/RUNOat/++E6wbFFI5/b2duJuu6+/7BIHqE6QFEoFeSWoD4Ss1LS0fwW/+Y1FNZ8iPGPG nTbnI1982fbdFlF21FWV7aWNz1YvWxTSub2xnbJ5V97uQdZ/GnVp5L53JDZJvkbZhFCWasgH9ey2 rHhjCfJQDLUKhAVoBGqVZ6q1zR9D6RIcKagewfCBt1i2fbdFKANqjSAcCFNQncidW4TtMAXVidzp J5wJU1CdyB2hYgqqnSOolcidHF9gcer7B0xBdUKtnxMM1AiIYQowBZIApqA6YQ4CUPKNV2chtS2L 3liHw2EUy37KfPbHWef2jxxPSz/7AH8l5411OBwOw5C3lKHWYRznjXU4HA6H7+C8sQ6Hw+HwHax4 Y+lvyA5NHEbz2ce7bPtui1AG1BpB+8D2ypD29vbKdtpnhpWhGRJWhuYvhr7s1333D/yONfUZfcsf wIw7beZHHsKy7bstouyoqxq3C+2VIcsWhXRuX9Ze4nFjidLAUYv8HIlHjV3G6jfW7Af0LX8Aw++k gYufw7LtGy6accPj7XePWbYopD7TyzBVb/d0tq9k6hl+ePgQ9mfpG+vy6dhDBDAF1Qm1IlNFAs7H wSU4STDTgNMPjRo4uYVl2zdcNOOGx9vvHrNsUUhlpsTAJAIAGZoh/e3IUo35HpgCYv8JXkUJ1YmS A3JHgAnM8T5MT26GZTuz1xtL8DWIqati+mAf/Enz7qSBi5/Dsu17LpKsoVYfNKcytr0yZNmikPpM L8NUvd0zpL2ly8uW2DAzzArkh1I+ve9jgSQIzZ1Z98ZqfDR5WfjcQ9MH+xCeNPzO0gNZw7Lt+y8a clL79sd3gmWLQjq3L25v6fKyFBtiesxEQJAfykoNpYySvy3njTWd8KThd5YeyBqWbd9/0ZCT2rc/ vhMsWxTSuX1xe2OXOEB1gqRQKsgrQX0gZKWGUkbJ35ZFb6z255JXkgMZmj4QqOZThGfMuNPmfOSL L9u+2yLKjrqqsr208dnqZYtCOrfPa/cg6z+NujRy3zsSmyRfo2xCKEs15HsqqT35gjeWIKahVsEU 1NrmT6J0CY4UVI9g+MBbLNu+2yKUAbVGEA6EKahO5M4twnaYgupE7vQTzoQpqE7kjlAxBdWJ3BFC k/AFFqe+f8AUVCfU+jnBQI2AGKYAUyAJYAqqE+YgACUfvNoc6m7P0v/z4nA49LPs58tnf5B1bv/I 8bT0sw/wV3LeWIfD4TAMeUsZah3Gcd5Yh8PhcPgOzhvrcDgcDt/Buv/zwlDrz6BfO6FWInf6mTGz nWXbd1uEMqDWCNoHtleGtLe3V7bTPjOsDM0Kvhi9QK2IerYRbBFUzyfcRebKe4aw4o218hnt9gdQ +u550M+Mme0s277bIsqOuqpxu9BeGbJsUUjn9vZ2IGWlFpKeSqoRP6F0gNG/DoRz6JKwZmfOG2su 4Xef8UBmzGxn2fYNF8244fH2u8csWxRSn+llmKq351BXe/vl5EvCCf1j6+TzvYN49g3DWf3Gkrjy jJBCjQBTUJ1QKzJVJODsBg6j84ZcO2NmO8u2b7hoxg2Pt989ZtmikMpMiYFJBAAyNEvko9rbfYpi Q62yqdEbFAC1EqGDTwBTUP3OVkyjxdmc1f+OhRhmiM+G9RXTBxtSOnLIzTNmtrNs+56LJGuo1QfN qYxtrwxZtiikPtPLMFVv95RGSWyoFWFZX0YtkCXTgA9IGrnvHcTkVEyDJAjNnVn0xvLUn1GeDZ97 aPpgK+QqfxgdSfIZM2a2s2z7/ouGnNS+/fGdYNmikM7tz9otvtUOVL/JzZIkH4SmkPuXDmRognwC KPnbct5Y08lPKh3fw4yZ7Szbvv+iISe1b398J1i2KKRz+612AiaygKTHUmGNmKWCkg9CU8j9uiMx pDcFLylllPxtWf3GunxAeQE5kKHpA4FqPkLphvDgTmbMbGfZ9t0WUXbUVZXtpY3PVi9bFNK5vb3d KLWU6gWfqreHpg883izFoNQOENsnSBmV3icqqT35wL9j1Qlr0AvUKpiCWnv8SegpDk28UyoGMWNm O8u277YIZUCtEYQDYQqqE7lzi7AdpqA6kTv9hDNhCqoTuSNUTEG1w5uoAWpFUNZk6lPgCKoTamUT DJQJJAFMwcchVpD6XpCJwJOq/qHu9nzgbwUPh0MPy36+fPYHWef2L/op3M/f+bLnjXU4HA7fzXlj HQ6Hw+GwF+eNdTgcDofvYNYbK/8tVZy/86vrp/jsQ162fbdFKANqjaB9YHtlSHt7e2U77TPDytAk UOMpmb8e+5r4ygDOVzDljZU/BZPkD2f2/FHMuHPZQw5Ztn23RZQddVXjdqG9MmTZopDO7e3tnrD4 1gTjWVeF0sBRizCHpg3/FvMY/8bKn8jKp/Mtj374nSsfcs6y7RsumnHD4+13j1m2KKQ+08swVW8v EZY19i5g6iU2nLbs8/UvWfG3gu1PByn5BDAF1Qm1IlNFAs7HwSU4STDTgNMPjRo4uYVl2zdcNOOG x9vvHrNsUUhlpsTAJAIAGZp1wprLRilADVWa74EpIPaf4FWUUJ0oOSB3BJjAHO/D9ISmUPI3ZK83 lpA3hu2h6YN98CfNu5MGLn4Oy7bvuUiyhlp90JzK2PbKkGWLQuozvQxT9fYcKQCq3+QOgQL/aVRk S2yYGWYF8kMpn973sUDSKPl7svUbC4TtpZl5+8cJTxp+Z+mBrGHZ9v0XDTmpffvjO8GyRSGd29vb CV/Z0uXXUX1FlmJDTI+ZCAjyQ1mpoRQQM/R35ryxphOeNPzO0gNZw7Lt+y8aclL79sd3gmWLQjq3 t7cTvrKly6+j+rxdHKA6QVIoFeSVoD4QslJDKSF3voIVbyzB5OVjunyykKHpA4FqPkV4xow7bc5H vviy7bstouyoqyrbSxufrV62KKRze2M7ZStdISjzn0ZdGrnvHYlNkq9RNiGUpRryhdz5Fsa/seRZ eNR9+yrKhDXoBWoVTEGthl1rKF2CIwXVIxg+8BbLtu+2CGVArRGEA2EKqhO5c4uwHaagOpE7/YQz YQqqE7kjVExBtXMEtZKpUZWw5TXIAVNQnVCrsAg1AmKYAkyBJIApqE6YgwCUfOHV8xNNbM+s37EO h8Mklv18+ewPss7tHzmeln72Af5KzhvrcDgchiFvKUOtwzjOG+twOBwO38F5Yx0Oh8PhO5j1xqLf iPE7MlDrz6BfO6FWInf6mTGznWXbd1uEMqDWCNoHtleGtLe3V7bTPjOsDE0CNZ7chxNSzzaCLYLq +YS7zEy3KHC+gilvLHoK9ERIjmXq8AeUvnse9DNjZjvLtu+2iLKjrmrcLrRXhixbFNK5vb3dg2Jq qUy4NTzET7C4NLZ/HQjnwKTUqI0LGP/Gyp/Iyqez26MPv/uMBzJjZjvLtm+4aMYNj7ffPWbZopD6 TC/DVL29hJW1tzdOrhBO6B9bJ59vDqVmXzKQRX8r6LlMySeAKahOqBWZKhJwdgOH0XlDrp0xs51l 2zdcNOOGx9vvHrNsUUhlpsTAJAIAGZp1KjWNKYoNtcqmRm9QANRKhA4+AUxB9TtbMY3cASV/Q1a/ sS4fjS9ATC0V0wcbUjpyyM0zZrazbPueiyRrqNUHzamMba8MWbYopD7TyzBVbw8p1dR7LevLqAWy ZBrwAUkj972DmJyKaZA0Sv6erHtjvZ5fw6MJGzVKQIamD7ZCrvKH0ZEknzFjZjvLtu+/aMhJ7dsf 3wmWLQrp3N7eDsICMVsageo3uVmS5IPQFHL/0oEMTZBPEMQM/Z1Z9MZqfy55ZTiqND9v/zj5SaXj e5gxs51l2/dfNOSk9u2P7wTLFoV0bm9vB3nBZQuwsrBezFJByQehKeR+3ZEY0puCl5QScucrWPHG uvVoLp8sZGj6QKCaj1C6ITy4kxkz21m2fbdFlB11VWV7aeOz1csWhXRuf9Bu5E4JX2lxOD80feDx ZikGpXaA2D5Byqj0Psidb2H8Gys9qH/kjoDKkDCLLqBWwRTUqm5Zhp7i0MQ7pWIQM2a2s2z7botQ BtQaQTgQpqA6kTu3CNthCqoTudNPOBOmoDqRO0LFFFQnR6M3KPBoIoNSJlOTAkdQnVArm2CgTCAJ YAo+DrGC1PeCTARGKvmBJrZn1u9Yh8NhEst+vnz2B1nn9i/6KdzP3/my5411OBwO3815Yx0Oh8Ph sBfnjXU4HA6H72DWG8v/lioxoYnDaD77eJdt320RyoBaI2gf2F4Z0t7eXtlO+8ywMjRDwsrQ/MXg y+Jbe5DdnylvrPojmPp0pg4fyIw7beZHHsKy7bstouyoqxq3C+2VIcsWhXRuX9Ze4nFjidLAUYvC OcO/xTzGv7Hw5Wc/9xLf8uiH30kDFz+HZds3XDTjhsfb7x6zbFFIfaaXYare7ulsX8nUM8Lhm3zx Rlb8raBx+WhQIJ8ApqA6oVZkqkjA+Ti4BCcJZhpw+qFRAye3sGz7hotm3PB4+91jli0KqcyUGJhE ACBDM6S/HVmqMd8DU0DsP8GrKKE6UXJA7ggwgTneh+nJzbBsZ9a9sV6PMKG6gC9ATC0V0wf74E+a dycNXPwclm3fc5FkDbX6oDmVse2VIcsWhdRnehmm6u2eIe0tXV62xIaZYVYgP5Ty6X0fCySFVP5C 9Tew9HcsUH9AeZYcyND0wT6EJw2/s/RA1rBs+/6LhpzUvv3xnWDZopDO7YvbW7q8LMWGmB4zERDk h7JSQymint2K88aaTnjS8DtLD2QNy7bvv2jISe3bH98Jli0K6dy+uL2xSxygOkFSKBXklaA+ELJS Qymint2KFW+synPMybNhe2mm96nmU4RnzLjT5nzkiy/bvtsiyo66qrK9tPHZ6mWLQjq3z2v3IOs/ jbo0ct87EpskX6NsQihLNeQLpcr9Gf/Gki/vyU04JcICNAK1yjPVulq0jNIlOFJQPYLhA2+xbPtu i1AG1BpBOBCmoDqRO7cI22EKqhO50084E6agOpE7QsUUVCdyRwhNwhdYnPr+AVNQnVDr5wQDNQJi mAJMgSSAKahOmIMAlHzwanuj1jcw63esw+EwiWU/Yj77s6xz+0eOp6WffYC/kvPGOhwOh2HIW8pQ 6zCO88Y6HA6Hw3dw3liHw+Fw+A5mvbH8b8T4Bdmjib+BfueEWonc6WfGzHaWbd9tEcqAWiNoH9he GdLe3l7ZTvvMsDI0K1gxGj3wcyqpdrBCUD2fcBfMdMgPkN2fKW8segQrH8fKXS3QPSbzoJ8ZM9tZ tn23RZQddVXjdqG9MmTZopDO7e3tQMrutgjtlSX8hMsD+teBcE67uSfj31j48v4RrHwcuz16uid/ OMKQm2fMbGfZ9g0Xzbjh8fa7xyxbFFKf6WWYqrfnUNdlvdFeWSKc0D+2Tj7/I2eMZdHfCuITwAxB FmUCTEF1Qq3IVJGAsxs4jM4bcu2Mme0s277hohk3PN5+95hli0IqMyUGJhEAyNAskY+yIQBmiM9S bKhVNjV6gwKgViJ08AlgCqrf2YpptDibs+7fsVRcPaO8kuorpg82pHTkkJtnzGxn2fY9F0nWUKsP mlMZ214ZsmxRSH2ml2Gq3u4JR0kQ+jmWqtRDlkwDPiBp5L53EJNTMQ2SAmoE1d/AijcWUX9AeZYc yND0wVbIVf4wOpLkM2bMbGfZ9v0XDTmpffvjO8GyRSGd25+1l8rq7UD1m9wsSfJBaAq5f+lAhibI J3jq2a04b6zp5CeVju9hxsx2lm3ff9GQk9q3P74TLFsU0rn9VjuhCUdoAkuVGksFJR+EppD7dUdi SG8KXlKKqGe3Yt2/Yxl3n13YXprpfar5CKUbwoM7mTGznWXbd1tE2VFXVbaXNj5bvWxRSOf29naj 1FKqF3yq3h6aPvB4sxSDUjtAbJ8gZVR6H5CTF2zL+DfW6zk5chNOibAAjUCt8ky1rhatQU9xaOKd UjGIGTPbWbZ9t0UoA2qNIBwIU1CdyJ1bhO0wBdWJ3OknnAlTUJ3IHaFiCqod3kQNUCuCsiZTnwJH UJ1QK5tgoEwgCWAKPg6xgtT3gkwEnlSlqPUNzPod63A4TGLZj5jP/izr3P5dP4g7+Ttf9ryxDofD 4bs5b6zD4XA4HPbivLEOh8Ph8B3MemPlv6WKA1QfJvDZJ7xs+26LUAbUGkH7wPbKkPb29sp22meG laFJoMajCZdS/dvJv+l3ffcpb6z0H8CPp7DsoSxb1MmMO23mRx7Csu27LaLsqKsatwvtlSHLFoV0 bm9v9zzrCumfQJQGjlpEc0SOmryG8W8sfH//FFY+kW95+sPvpIGLn8Oy7RsumnHD4+13j1m2KKQ+ 08swVW8vYWWN9YuZelX4xPZ8DiVW/K1g+xOxJwhgCqoTakWmigScj4NLcJJgpgGnHxo1cHILy7Zv uGjGDY+33z1m2aKQykyJgUkEADI06/ialnoglSimFvM9MAXE/hO8ihKqEyUH5I4AE5jjfZgeb1oc Vm7LujeWfAKYJXwBYmqpmD7YB3/SvDtp4OLnsGz7noska6jVB82pjG2vDFm2KKQ+08swVW/PkQJg MjdDkPWfRkW2xIaZYVYgP5Ty6X0fC6UUlW3OojcWSY0i8iw5kKHpg30ITxp+Z+mBrGHZ9v0XDTmp ffvjO8GyRSGd29vbCWv3LT4mkPKfRkWWYkNMj5kICPJDWalpT23OB/5WsP6A8mzYXpqZt3+c8KTh d5YeyBqWbd9/0ZCT2rc/vhMsWxTSub29nbjb7usvu8QBqhMkhVJBXgnqAyErNXmK0MT2/OY3FtV8 ivCMGXfanI988WXbd1tE2VFXVbaXNj5bvWxRSOf2xnbKQoZmiK+vd5WG5L53JDZJvkbZhFCWasgn 6tndGP/Gku/vyU04JcICNAK1yjPVulq0jNIlOFJQPYLhA2+xbPtui1AG1BpBOBCmoDqRO7cI22EK qhO50084E6agOpE7QsUUVDtHUKtg5visxanpHzAF1Qm1fk4wUCMghinAFEgCmILqhDkIQMkn6tnd mPU71uFwmMSyHzGf/VnWuf0jx9PSzz7AX8l5Yx0Oh8Mw5C1lqHUYx3ljHQ6Hw+E7OG+sw+FwOHwH s95Y9BsxfkcGav0Z9Gsn1ErkTj8zZrazbPtui1AG1BpB+8D2ypD29vbKdm7N9JVo9GiiSl522dg4 uc7rvoTq+YS7cnPlSf1MeWO9/ljcU6AnQnIsU4c/oPTd86CfGTPbWbZ9t0WUHXVV43ahvTJk2aKQ WzOlplL2bELu5FwWXOInWFwa278OhHPIFBmWbcv4Nxa+v38K9ESmPqDdnn743Wc8kBkz21m2fcNF M254vP3uMcsWhdRnhrK0t+R78gn1mUbL8DrhhP6xdfL55EDOPmMsK/5WMHxMIfYEAUxBdUKtyFSR gLMbOIzOG3LtjJntLNu+4aIZNzzefveYZYtCKjMlBqrf5I4QmoTVNM70+AKKDbXKpkZvUADUSoQO PgFMQfU7WzEN71icl+3Mdv+O5QsQU0vF9MGGlI4ccvOMme0s277nIskaavVBcypj2ytDli0Kqc8M V+SmOEB1hM/mlfVewQoqcyBLpgEfkDRy3zuIyamYBmU1+hnvz16/Ywl5Nmwvzczbd0Cu8ofRkSSf MWNmO8u2779oyEnt2x/fCZYtCnkws/1Cj0/lZZd7pQCofpObJUk+CE0h9y8dyNAE7anNOW+s6eQn lY7vYcbMdpZt33/RkJPatz++EyxbFPJgZvuFHkkRmkiQzLGCsPI1rlBQ8kFoCrlfdySG9KbgZZ4i NLE9v/mNRTUfoXRDeHAnM2a2s2z7bosoO+qqyvbSxmerly0Kad8OvEkFdWnkfqnS8AUWUxdkaPrA 481SDErtALF9gpRR6f2cenY3xr+x0oP6R27CKREWoBGoVZ6p1tWiNegpDk28UyoGMWNmO8u277YI ZUCtEYQDYQqqE7lzi7AdpqA6kTv9hDNhCqqdA3ITDlArOtWbqDHUzaCUydSkwBFUJ9TKJhgoE0gC mIKPQ6wg9b0gE0FIPbsbs37HOhwOk1j2I+azP8s6t3/XD+JO/s6XPW+sw+Fw+G7OG+twOBwOh704 b6zD4XA4fAez3lj0W6pIQ63DBD77hJdt320RyoBaI2gf2F4Z0t7eXtlO+8ywMjRDwsrQ/MXgy+Jb e5DdnylvLHoE9DhIjmXq8IHMuNNmfuQhLNu+2yLKjrqqcbvQXhmybFFI5/Zl7SUeN5YoDRy1CHOG n72M8W+s/InQ05n6sL7lT2L4nSsfcs6y7RsumnHD4+13j1m2KKQ+08swVW/3dLavZOoZNnyTL/uA FX8rSLGXBFKoEWAKqhNqRaaKBJyPg0twkmCmAacfGjVwcgvLtm+4aMYNj7ffPWbZopDKTImBSQQA MjRD+tuRpRrzPTAFxP4TvIoSqhMlB+SOABOY432YHjMRpKoXML+C1f+OhRhmiM+G9RXTB/vgT5p3 Jw1c/ByWbd9zkWQNtfqgOZWx7ZUhyxaF1Gd6Gabq7Z4h7S1dXrbEhplhViA/lPLpfR8LlCKp0fYs emN56k8nz5IDGZo+2IfwpOF3lh7IGpZt33/RkJPatz++EyxbFNK5fXF7S5eXpdgQ02MmAoL8UFZq KEXUs1tx3ljTCU8afmfpgaxh2fb9Fw05qX374zvBskUhndsXtzd2iQNUJ0gKpYK8EtQHQlZqKEXU s1ux+o11+WjyAnIgQ9MHAtV8ivCMGXfanI988WXbd1tE2VFXVbaXNj5bvWxRSOf2ee0eZP2nUZdG 7ntHYpPka5RNCGWphnyhVLk/499Y8uU9ZEJWCGvQC9QqmIJaDbvWULoERwqqRzB84C2Wbd9tEcqA WiMIB8IUVCdy5xZhO0xBdSJ3+glnwhRUJ3JHqJiC6kTuCKFJ+AKLU98/YAqqE2r9nGCgRkAMU4Ap kAQwBdUJcxCAkg9ebW/U+gZm/Y51OBwmsexHzGd/lnVu/8jxtPSzD/BXct5Yh8PhMAx5SxlqHcZx 3liHw+Fw+A7OG+twOBwO38Hc//NCrTe58xfAowBqJXKnnxkz21m2fbdFKANqjaB9YHtlSHt7e2U7 7TPDytAkUOPRxJvc8dSzjaS1L1TPJ9wFMx3yA2T3Z/Abi765l+mxTH8uC1bcgu4xmQf9zJjZzrLt uy2i7KirGrcL7ZUhyxaFdG5vbL/M9rS34CdYXBrbvw6Ec2COWrGeRW+sZY9ptz+J8IGEZiczZraz bPuGi2bc8Hj73WOWLQqpz/QyTNXbPZepSoFQz7YQTugfWyefb87s1fOY++9Y9FwuHxMK5BPAFFQn 1IpMFQk4u4HD6Lwh186Y2c6y7RsumnHD4+13j1m2KKQyU2JgEgGADM0QqwcwBYu9mRO2CBIbapVN jd6gAKiVCB18ApiC6ne2YhrmWAGA+RVMfGPlD6Ll0fgaxNRVMX2wIaUjh9w8Y2Y7y7bvuUiyhlp9 0JzK2PbKkGWLQuozvQxT9XaPpHwWce6UsGylBbJkGvABSSP3vYOYnIppVLI+3pwpbyx6HEbLc8lr yIEMTR9shVzlD6MjST5jxsx2lm3ff9GQk9q3P74TLFsU0rm9vZ3I2+u9kgWq3+RmSZIPQlPI/UsH MjRBPsFTz27F+DdW5cu3PJe8hhzI0PTBPuQnlY7vYcbMdpZt33/RkJPatz++EyxbFNK5vb2dsHYC 2RxLhTWpNS4o+SA0hdyvOxJDelPwklJEPbsVc//PC6LlueQ15ECGpg8EqvkIpRvCgzuZMbOdZdt3 W0TZUVdVtpc2Plu9bFFI5/bGdsrWi3PCUeHM0PSBx5ulGJTaAWL7BCmj0vuAnLxgW8a/sYjQhxkS ZtEF1CqYglrVLcvQUxyaeKdUDGLGzHaWbd9tEcqAWiMIB8IUVCdy5xZhO0xBdSJ3+glnwhRUJ3JH qJiCaucIajlC06CsydesN3AE1Qm1yvNRJpAEMAUfh1hB6ntBJgJPqlLU+gYm/p8Xh8NhBst+xHz2 Z1nn9u/6QdzJ3/my5411OBwO3815Yx0Oh8PhsBfnjXU4HA6H72D8G0t+PzXUKpiH4Xz2CS/bvtsi lAG1RtA+sL0ypL29vbKd9plhZWiGUCWkRxO/Gv818a0F1d/A4DcWfXnI0JzEtzz9GXfazI88hGXb d1tE2VFXNW4X2itDli0K6dze2e65nBDyrKvC2PNybM7wy9dw3lifYfidKx9yzrLtGy6accPj7XeP WbYopD7TyzBVb/dcVlZ6FzP1Ehu+z/e9y9x/xwqfS+VhISWfAKagOqFWZKpIwPk4uAQnCWYacPqh UQMnt7Bs+4aLZtzwePvdY5YtCqnMlBiYRAAgQzOkXllpBFKAGqo03wNTQOw/wasooTpRckDuCDCB Od6H6TEzzH4FE99Y9UdWwhcgppaK6YN98CfNu5MGLn4Oy7bvuUiyhlp90JzK2PbKkGWLQuozvQxT 9XZPvbLSCFDgP42KbIkNM8OsQH4o5dP7Phby1Ks6AfMrmPLGCp9CaOaEjRolIEPTB/sQnjT8ztID WcOy7fsvGnJS+/bHd4Jli0I6t3e2g0qXgRr/aVRkKTbE9JiJgCA/lJWaPFXJ7sz4N1b45dufSF5J DmRo+mAfwpOG31l6IGtYtn3/RUNOat/++E6wbFFI5/bOdlDpMlDjP428XRygOkFSKBXklaA+ELJS 09L+Fcz9Py/ArceRF4cPNzR9IFDNpwjPmHGnzfnIF1+2fbdFlB11VWV7aeOz1csWhXRuH9VeB2X+ 06hLI/e9I7FJ8jXKJoSyVEO+UKrcn/FvLKJklgiz6AJqFUxBreqWlZQuwZGC6hEMH3iLZdt3W4Qy oNYIwoEwBdWJ3LlF2A5TUJ3InX7CmTAF1YncESqmoDoROhpV8WUWv2Y5YAqqE2oVFqFGQAxTgCmQ BDAF1QlzEICSD15tb9T6Bib+nxeHw2EGy37EfPZnWef2jxxPSz/7AH8l5411OBwOw5C3lKHWYRzn jXU4HA6H7+C8sQ6Hw+HwHYx/Y+nvwwm1HKH5u8GjAGolcqefGTPbWbZ9t0UoA2qNoH1ge2VIe3t7 ZTvtM8PK0CRQ49GES6mOqGcbwRZB9XzCXd5M57xQ/Q0MfmPRl88lOcOZPf8udI/JPOhnxsx2lm3f bRFlR13VuF1orwxZtiikc3tjeylb7zIayyr4CRZ3XnVJOOdy++ase2Mhnv2YdvtjCB9IaHYyY2Y7 y7ZvuGjGDY+33z1m2aKQ+kwvw1S93ROmKvVEe2WJzgOekc83Z/bqecz9d6z8AdWfFLLyCWAKqhNq RaaKBJzdwGF03pBrZ8xsZ9n2DRfNuOHx9rvHLFsUUpkpMTCJAECGZojVA2+24CspNtQqmxq9QQFQ KxE6+AQwBdXvbMU0zMlT38LEN1b4dC6fVF5MLRXTBxtSOnLIzTNmtrNs+56LJGuo1QfNqYxtrwxZ tiikPtPLMFVv90jKZxHbJ0iZGMv6MmqBLJkGfEDSyH3vICanYhqUxSeA+RVMeWPRUyjFIXkBOZCh 6YOtkKv8YXQkyWfMmNnOsu37LxpyUvv2x3eCZYtCOre3txPW7lt8TKBSUP0mN0uSfBCaQu5fOpCh CfJUJbsz499Y+ZdPD+cHmojIs+RAhqYP9iE/qXR8DzNmtrNs+/6LhpzUvv3xnWDZopDO7e3txN12 S4U1YpYKSj4ITSH3647EkN4UvKykBJI7M/f/vMh5UBA+3ND0gUA1H6F0Q3hwJzNmtrNs+26LKDvq qsr20sZnq5ctCunc3thOWcjQDAlHhe2h6QOPN0sxKLUDxPYJUkal9wE5ecG2jH9jEZp4kztEWJAm KWoVTEGtq0Vr0FMcmninVAxixsx2lm3fbRHKgFojCAfCFFQncucWYTtMQXUid/oJZ8IUVCdyR6iY gmrnCGoVzBzKmkx9ChxBdUKtbIKBMoEkgCn4OMQKUt8LMhF4UpWi1jcw8f+8OBwOM1j2I+azP8s6 t3/XD+JO/s6XPW+sw+Fw+G7OG+twOBwOh704b6zD4XA4fAfj31jy+6mROwD+YTiffbzLtu+2CGVA rRG0D2yvDGlvb69sp31mWBmaIWFlaP5i8GXxrT3I7s/gNxZ9c8iVj+NbHv2MO23mRx7Csu27LaLs qKsatwvtlSHLFoV0bl/WXuJxY4nSwFGLwjnDv8U8zhvrMwy/M3zyy1i2fcNFM254vP3uMcsWhdRn ehmm6u2ezvaVTD0jHL7JF29k7r9j4VnYJ0iZGGRRJsAUVCfUikwVCTgfB5fgJMFMA04/NGrg5BaW bd9w0YwbHm+/e8yyRSGVmRIDkwgAZGiG9LcjSzXme2AKiP0neBUlVCdKDsgdASYwx/swPbkZlu3M xDeWPYvXw3PPxcc5eSXVV0wf7IM/ad6dNHDxc1i2fc9FkjXU6oPmVMa2V4YsWxRSn+llmKq3e4a0 t3R52RIbZoZZgfxQyqf3fSyQBKG5M1PeWK/HVn4Q9WeUZ8mBDE0f7EN40vA7Sw9kDcu2779oyEnt 2x/fCZYtCuncvri9pcvLUmyI6TETAUF+KCs1lAKhuTnj31iXT6FekGfJgQxNH+xDeNLwO0sPZA3L tu+/aMhJ7dsf3wmWLQrp3L64vbFLHKA6QVIoFeSVoD4QslJDKRCamzP3/7wAleeYk2fD9tJM71PN pwjPmHGnzfnIF1+2fbdFlB11VWV7aeOz1csWhXRun9fuQdZ/GnVp5L53JDZJvkbZhFCWasgHobk/ 499YRO7DKREWoBGoVZ6p1tWiZZQuwZGC6hEMH3iLZdt3W4QyoNYIwoEwBdWJ3LlF2A5TUJ3InX7C mTAF1YncESqmoDqRO0JoEr7A4tT3D5iC6oRaPycYqBEQwxRgCiQBTEF1whwEoOSD0Nyfif/nxeFw mMGynzWf/aHWuf0jx9PSzz7AX8l5Yx0Oh8Mw5C1lqHUYx3ljHQ6Hw+E7OG+sw+FwOHwH499Y+vtw IncA/D+CfueEWonc6WfGzHaWbd9tEcqAWiNoH9heGdLe3l7ZTvvMsDI0K1Ax2gXVEfVsI9giqJ5P uAtmOuQHyO7P4DcWffPwQUx9Ors9+tIDyYN+ZsxsZ9n23RZRdtRVjduF9sqQZYtCOre3twMp85Xt XRo9JVxaGtu/DoRz2s09Wf3Gmv1odnv04QMJzU5mzGxn2fYNF8244fH2u8csWxRSn+llmKq351DX Zb3RXlkinNA/tk4+/yNnjGXuv2PRs7h8NCiQTwBTUJ1QKzJVJODsBg6j84ZcO2NmO8u2b7hoxg2P t989ZtmikMpMiYFJBAAyNEvko+r1Hl9JsaFW2dToDQqAWonQwSeAKah+Zyum0eJszsQ31rOn42sQ U1fF9MGGlI4ccvOMme0s277nIskaavVBcypj2ytDli0Kqc/0MkzV2z3hKBsCYIZY1pdRC2TJNOAD kkbuewcxORXTIAlCc2emvLHSs+IH0fhoLhshQ9MHWyFX+cPoSJLPmDGznWXb91805KT27Y/vBMsW hXRuf9ZusQShn4NKQfWb3CxJ8kFoCrl/6UCGJsgnCKG5OePfWKWn0Ph08jJyIEPTB/uQn1Q6vocZ M9tZtn3/RUNOat/++E6wbFFI5/Zb7QRMZAFJj6XCGjFLBSUfhKaQ+3VHYkhvCl5SCoTm5sz9Py+M 9keTV5IDGZo+EKjmI5RuCA/uZMbMdpZt320RZUddVdle2vhs9bJFIZ3b29uNUkupXvCpento+sDj zVIMSu0AsX2ClFHpfSM092f8G4swH8ElYWWapKhVMAW1mjdORU9xaOKdUjGIGTPbWbZ9t0UoA2qN IBwIU1CdyJ1bhO0wBdWJ3OknnAlTUJ3IHaFiCqod3kQNUCuCsiZTnwJHUJ1QK5tgoEwgCWAKPg6x gtT3gkwEntDcn4n/58XhcJjBsp81n/2h1rn9S38iP+PvfNnzxjocDofv5ryxDofD4XDYi/PGOhwO h8N3MP6NJb+fGmoVzD9Oz9NAL1ArkTsrWbZ9t0UoA2qNoH1ge2VIe3t7ZTvtM8PK0AwJK0OTCAsu uzxpyY36Q4nBbyz6U4EMzUl8y38WdueDg0vPs2dmP8u277aIsqOuatwutFeGLFsU0rl9TXuYrbfk 3K0/hJw31gfofCBhe+fMTpZt33DRjBseb797zLJFIfWZXoapertnbDuo1IfcrT+EzP13LPwh0R9V 5U/O6gFMQXVCrchUkYCzJ3Re57VoHzvzLsu2b7hoxg2Pt989ZtmikMpMiYFJBAAyNEMGtltsQwBM QXVCrUQoU9ULmILqhDneh/lnmfjG8g8XzxqoVcAXIKaWiumDnSkdnyMpQhNvzKFUXjmVZdv3XCRZ Q60+aE5lbHtlyLJFIfWZXoapertnVLuvkZikfRp5gSEyz3pHMJlX/lmmvLHkmVYeMUkiz4btpZl5 +4aUjr+FdPlGGkJyNsu2779oyEnt2x/fCZYtCuncvrIdqE6EMlX9AFnBx0IoXw0/8dmDMP6NlT9c cupPv7G9NDNv35DS8e3kLf0ze1i2ff9FQ05q3/74TrBsUUjn9vXtviZsbxkCRHoHsXc8Jf8PMvf/ vABk1p9+ng3bSzO9TzVbER7cSKmlZ2Y/y7bvtoiyo66qbC9tfLZ62aKQzu3z2j0tLZChCUr1wJtG yf/LjH9jEbkPp0RYgEagVnmmWleLPs7jI9Ho0UTHzCEs277bIpQBtUYQDoQpqE7kzi3CdpiC6kTu 9BPOhCmoTuSOUDEF1YncEUKToALI0ERg5I5gJgICNUCtcvEfZOL/eXE4HGaw7OfXZ39Qdm7f/Kf8 eQk947yxDofDYTXnjfWM88Y6HA6Hw3dw3liHw+Fw+A7Gv7Hkt11DrYL5x+l5GugFaiVyZyXLtu+2 CGVArRG0D2yvDGlvb69sp31mWBmaIWFlaB62ZfAbi/7sIUNzEt/yH5/d+eDg0vPsmdnPsu27LaLs qKsatwvtlSHLFoV0bl/W3s7AUYec88b6AJ0PJGzvnNnJsu0bLppxw+Ptd49ZtiikPtPLMFVv93S2 32LUnEPI3H/Hyv/LkNhLAinUCDAF1Qm1IlNFAs6e0Hmd16J97My7LNu+4aIZNzzefveYZYtCKjMl BiYRAMjQDBnSLp8ApqA6UXIExDAFmILqhFqHKya+sfwfA/5UBMQwQ3w2rK+YPtiZ0vE5kiI08cYc SuWVU1m2fc9FkjXU6oPmVMa2V4YsWxRSn+llmKq3e/rbfRaxdwST5AvieBOxdwSShxJT3livP5/y H0D9zybPkgMZmj7YmdLxt5Au30hDSM5m2fb9Fw05qX374zvBskUhnds/3k74rIccX0mpwyXj31iX fwb1gjxLDmRo+mBnSse3k7f0z+xh2fb9Fw05qX374zvBskUhndu3ajdyP2w3RJJzqDD3/7zIeVBA DmRo+kCgmq0ID26k1NIzs59l23dbRNlRV1W2lzY+W71sUUjn9nntnnBUaPpAqFSG5uGS8W8sgnzI CmENeoFaBVNQq2HXZ3l8JBo9muiYOYRl23dbhDKg1gjCgTAF1YncuUXYDlNQncidfsKZMAXVidwR KqagOpE7QmgSVGAytSpwgFquDAHwvgHncMnE//PicDjMYNkPuM/+JO3cfl4Dv5LzxjocDofDd3De WIfD4XD4Ds4b63A4HA7fwYr/80IjB4r/CPqdE2olcqefGTPbWbZ9t0UoA2qNoH1ge2VIe3t7ZTvt M8PK0CRQ49HEm9zZnK87eBRzf8fCY135cHf7g6R7TOZBPzNmtrNs+26LKDvqqsbtQntlyLJFIZ3b 29s9VCzyVvtUGi/Z5+DFTHxj2TNd+XB3+4OkeyBDs5MZM9tZtn3DRTNueLz97jHLFoXUZ3oZpurt JVpGfZBn3+LvMOuN5R+o/TcBYIYgizIBpqA6oVZkqkjA2Q0cRucNuXbGzHaWbd9w0YwbHm+/e8yy RSGVmRIDkwgAZGjWKbXUeytdhjne9yag2Cg5QK2EOd6H+ReY8sbSp/jzjwGx4OOcvJLqK6YPNqR0 5JCbZ8xsZ9n2PRdJ1lCrD5pTGdteGbJsUUh9ppdhqt6eIwXAJALBxyF5F7VAyqf3zYQUfOwxPy8g B1I+ve/j382Kf8ci6g83z5IDGZo+2Aq5yh9GR5J8xoyZ7Szbvv+iISe1b398J1i2KKRze3s7kbe3 9EoNtRAwkQXezAsk9piJwMgdgcyw5ldy3ljTyU8qHd/DjJntLNu+/6IhJ7Vvf3wnWLYopHN7ezth 7QSyJagmrCcTMv/0ASj5Qu4IpfZfz+A3Vvgcbz3cPHtrpvep5iOUbggP7mTGzHaWbd9tEWVHXVXZ Xtr4bPWyRSGd2xvbKVsvDrGCPACQFZMKfKXEJd8+jYr5Fxj/O5Y8O0OtghkSFqARqFWeqdbVojXo KQ5NvFMqBjFjZjvLtu+2CGVArRGEA2EKqhO5c4uwHaagOpE7/YQzYQqqE7kjVExBtXMEtRyhaVDW 5GvWG3MQAPLzLEAMU4ApqHaOYA4CQPIXM/dvBQ+Hw3CW/Xj67M/Bzu1/54f4n+K8sQ6Hw+HwHZw3 1uFwOBy+g/PGOhwOh8N3MPiN9V+GJlxK9Z9Bv3ZCrUTu9DNjZjvLtu+2CGVArRG0D2yvDGlvb69s p31mWBmaIVQJ6dHEaOZN/oPM/R3L/qiW/Znt9h8H3ZM/kIEHz5jZzrLtuy2i7KirGrcL7ZUhyxaF dG7vbPdcTnjMvMl/kIlvrMv/RGaw238cdA9kaHYyY2Y7y7ZvuGjGDY+33z1m2aKQ+kwvw1S93XNZ WentZ+rwv8asN5b/Q2r/A0OlfAKYguqEWpGpIgFnN3AYnTfk2hkz21m2fcNFM254vP3uMcsWhVRm SgxMIgCQoRlSr6w0glK9BIY53r80De8bcA6eKW8sfd4//2zgCDBL+ALE1FIxfbAhpSOH3DxjZjvL tu+5SLKGWn3QnMrY9sqQZYtC6jO9DFP1dk+lUmKguoAV5AGAlE/v101IUDEPnhX/jiWf/tH7OCfP kgMZmj7YCrnKH0ZHknzGjJntLNu+/6IhJ7Vvf3wnWLYopHN7ZztRaQdS4GsgPTCRBXdNBJQ6eBa9 sSBB/c8jz4btpZl5+8fJTyod38OMme0s277/oiEntW9/fCdYtiikc3tnO1FpB1Lga8J6MiHbTUMk OQcw+I2VP3f7NOp/Enn21kzvU81HKN0QHtzJjJntLNu+2yLKjrqqsr208dnqZYtCOrf3tJcKQhrb S6b3zYQUUp5NgeRBGP87Vnr4iloFMyQsQCNQqzxTratFa9BTHJp4p1QMYsbMdpZt320RyoBaIwgH whRUJ3LnFmE7TEF1Inf6CWfCFFQnckeomILqRMkBakVQ1mTqU8xBACDtE6TMC9WuxpsCnINn7t8K Hg6H4Sz7WfbZH5qd289P/F/JeWMdDofD4Ts4b6zD4XA4fAfnjXU4HA6H7+D5G+u/jNyHY+TOXwCP AqiVyJ1+ZsxsZ9n23RahDKg1gvaB7ZUh7e3tle20z6xUtk/Q6CeN7YePM+x3LPyR0x+8lxJTdgYL VtyC7jGZB/3MmNnOsu27LaLsqKsatwvtlSHLFoUM2S5ObuaUykr+YUPGvLHsz5v+4Mlf8J/FghW3 CB9IaHYyY2Y7y7ZvuGjGDY+33z1m2aKQ+kwvL1NUkFMqa2w/bMKAN1blD5tSl/9Z2H89AKagOqFW ZKpIwNkNHEbnDbl2xsx2lm3fcNGMGx5vv3vMskUhlZkSA5MIQO5TQYnLOSWkwDAHAYC0T5AyL1Qn 1CqgRQlzEABI+wQp80J1whzvwxRUJ9T6BnrfWPqNo++cm2EZ4WsQU1fF9MGGlI4ccvOMme0s277n IskaavVBcypj2ytDli0Kqc/0MkxVCkqUWurtlIUsmd43ExKQ9ISVJdP7ZkICk+2V+zP437GAxOEj CE0iryEHMjR9sBVylT+MjiT5jBkz21m2ff9FQ05q3/74TrBsUUjndm9Wej2llst2KaCaULaYdaSY 6kNZMgmfJXzBFzH+jVV5Ci0PKK8hBzI0fbAP+Uml43uYMbOdZdv3XzTkpPbtj+8EyxaFdG6XTwLZ Cr4GLR5NlPFlvt58bwqh2cJr3LuL2iFT/p9vJiRR8oXXlHJ2Q56/seh7Qta/fMujyWtaFpn0PtV8 hNIN4cGdzJjZzrLtuy2i7KirKttLG5+tXrYoZNT2y3YQmkLJB5Q1KQEwE59GxQy5bJfYm5BCSv6o FEq+UKrcn67fseR7GrkDQh9mSJhFF1CrYApqVbcsQ09xaOKdUjGIGTPbWbZ9t0UoA2qNIBwIU1Cd yJ1bhO0wBdWJ3OknnAlTUJ3IHSOsFFQ7B6j7JncIdAG1fgKfsiZfbW/glNCihFrORGyfOalKUatQ jBqg1jcw7G8FD4fDGpb9iPnsz7LO7bOPp/l310k9oYk27tb/Gs4b63A4HJ6ANw1QaxXrN27CeWMd DofD4Ts4b6zD4XA4fAfP31j4XdiT+7kD4P8R9Dsn1ErkTj8zZrazbPtui1AG1BpB+8D2ypD29vbK dtpnhpWhGZJXwgFqRdSzoKWmwmX768SE6js8btyQYb9j4YnQcwkf09Rnt9sfTOmB5EE/M2a2s2z7 bosoO+qqxu1Ce2XIskUhndt72qmlMuFyuOBrWuqJekvncCHvejbn44x5Y9mXp6ew/jHt9scQPpDQ 7GTGzHaWbd9w0YwbHm+/e8yyRSH1mV6GqXq7Z2x7SEtNhXp753Ahn9A/8yMMeGNVvjmlLp8RCuQT wBRUJ9SKTBUJOLuBw+i8IdfOmNnOsu0bLppxw+Ptd49ZtiikMlNiYBIBgAzNkCHt8glgCqp/TjPn ElQKiMkU4Ag+NlADzEEAvMxThlpfQu8bS7909LXJRJmguoAvQEwtFdMHG1I6csjNM2a2s2z7nosk a6jVB82pjG2vDFm2KKQ+08swVW/3lColMOCEUAFickhqlEDWAxNZITQFMw34OUhRgZd5b2Xazgz+ dywgceVxVFJCniUHMjR9sBVylT+MjiT5jBkz21m2ff9FQ05q3/74TrBsUUjn9m3bK6OM0kzCZwkU GHCQAl5SSsidr2D8G+vyQdQLLp8sZGj6YB/yk0rH9zBjZjvLtu+/aMhJ7dsf3wmWLQrp3L5te2WU 0TLTyP2Wdi8vJ3wLz99Y4dMJn0JYWSLPhu2lmd6nmo9QuiE8uJMZM9tZtn23RZQddVVle2njs9XL FoV0bu9pLxXkSMpnEZNDUqMyVA/pTcEk+YJ3JIYMTeBjUM9uS9fvWK9H8iZ3QO7DKREWoBGoVZ6p 1tWiNegpDk28UyoGMWNmO8u277YIZUCtEYQDYQqqE7lzi7AdpqA6kTv9hDNhCqoTuSNUTEF1ouQA tSKQRZkAU1D9znoHpKoiWuTavSnAEXxsoEZAXDIhjVSlqPXT3Jxhfyt4OBzWsOxHzGd/lnVu/64f xIdGzhvrcDgcDt/BeWMdDofD4Ts4b6zD4XA4fAfP31j/ZeR+7gD4f5yeR4FeoFYid1aybPtui1AG 1BpB+8D2ypD29vbKdtpnhpWhWYIq0QvUigizpZY0rPUeoqXx8fDfwbDfsfAc6WmG5lS+5Y/T7nxw MLXkox7M7GfZ9t0WUXbUVY3bhfbKkGWLQjq3t7cLUuPLqIWkJ0zdrW+hpfHx8N/A//73f36L/GQx UmJ+AAAAAElFTkSuQmCC ------=_20131228203409_44038 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users ------=_20131228203409_44038-- From xen-users-bounces@lists.xen.org Sat Dec 28 18:37:07 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Sat, 28 Dec 2013 18:37:07 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vwyjg-0002cp-Co; Sat, 28 Dec 2013 18:35:44 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vwyjd-0002ci-NN for xen-users@lists.xen.org; Sat, 28 Dec 2013 18:35:42 +0000 Received: from [85.158.139.211:32002] by server-12.bemta-5.messagelabs.com id 9E/5B-30017-CF91FB25; Sat, 28 Dec 2013 18:35:40 +0000 X-Env-Sender: nix@myproxylists.com X-Msg-Ref: server-6.tower-206.messagelabs.com!1388255739!6947941!1 X-Originating-IP: [62.236.108.236] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 20132 invoked from network); 28 Dec 2013 18:35:39 -0000 Received: from gameframe.net (HELO gameframe.net) (62.236.108.236) by server-6.tower-206.messagelabs.com with SMTP; 28 Dec 2013 18:35:39 -0000 Received: (qmail 22372 invoked by uid 0); 28 Dec 2013 18:34:10 -0000 X-Originating-IP: 127.0.0.1 X-Qmail-Scanner-Diagnostics: from 127.0.0.1 (daemon@127.0.0.1) by gameframe.net (envelope-from , uid 98) with qmail-scanner-2.11 (spamassassin: 3.3.2. Clear:RC:1(127.0.0.1):. Processed in 0.030516 secs); 28 Dec 2013 18:34:10 -0000 Received: from unknown (HELO gameframe.net) (daemon@127.0.0.1) by gameframe.net with SMTP; 28 Dec 2013 18:34:09 -0000 Received: from localhost ([127.0.0.1]) (SquirrelMail authenticated user nix@myproxylists.com) by gameframe.net with HTTP; Sat, 28 Dec 2013 20:34:09 +0200 Message-ID: <72a46fb800ebf594aef523c17f94eaeb.squirrel@gameframe.net> Date: Sat, 28 Dec 2013 20:34:09 +0200 From: "NiX" To: xen-users@lists.xen.org User-Agent: SquirrelMail/1.4.22 MIME-Version: 1.0 Content-Type: multipart/mixed;boundary="----=_20131228203409_44038" X-Priority: 3 (Normal) Importance: Normal Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org ------=_20131228203409_44038 Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: 8bit > On Fri, Dec 27, 2013 at 05:00:16PM +0200, NiX wrote: >> > On Fri, Dec 27, 2013 at 02:17:19PM +0200, NiX wrote: >> >> > On Tue, Dec 24, 2013 at 05:06:37PM +0200, NiX wrote: >> >> >> Hi. I am running a XEN VM in PV mode. This VM has four cores >> enabled. >> >> VM >> >> >> network config is as follows: >> >> >> >> >> >> vif = >> ["ip=127.0.0.1,mac=XX:XX:XX:XX:XX:XX,bridge=br0,rate=100Mb/s"] >> >> >> >> >> >> Dom0 is dual XEON X5450 with 16GB of RAM. >> >> >> >> >> >> I can barely zmap at 10mbps ~ 12k packets/second on this VM >> >> >> >> >> > >> >> > My google-fu tells me that zmap sends out gigantic amount of TCP >> SYN >> >> > packets in its default configuration. It is possible the ring size >> >> > between frontend and backend is the bottleneck. Data copying from >> >> > frontend to backend might also be a problem. >> >> > >> >> > You can probably patch your Dom0 and DomU kernel with multi-page >> ring >> >> > support to see if it makes it better. >> >> > >> >> > Wei. >> >> > >> >> >> >> I was not able neither to exceed 10k packets/second with a >> lightweight >> >> equivalent software and netback/0 fully utilized one 3GHz core. >> >> >> > >> > Hmm... You're using kthread-based netback. In your use case frontend >> is >> > likely to create interrupt storm for backend. Do you have breakdown of >> > CPU usage (sy, si etc)? >> >> I am using Linux nix 3.2.53-grsec #1 SMP and the server is pretty much >> idle expect when I attempt to zmap.Load average: 0.09 0.06 0.13 >> >> ps aux | grep netback >> root 1411 2.6 0.0 0 0 ? S Dec09 696:17 >> [netback/0] >> root 1412 0.0 0.0 0 0 ? S Dec09 2:44 >> [netback/1] >> root 1413 1.1 0.0 0 0 ? S Dec09 312:39 >> [netback/2] >> root 1414 0.0 0.0 0 0 ? S Dec09 0:00 >> [netback/3] >> root 1415 0.0 0.0 0 0 ? S Dec09 8:22 >> [netback/4] >> root 1416 0.0 0.0 0 0 ? S Dec09 2:54 >> [netback/5] >> root 1417 0.0 0.0 0 0 ? S Dec09 0:00 >> [netback/6] >> root 1418 0.0 0.0 0 0 ? S Dec09 0:00 >> [netback/7] >> >> It seems to only fully utilize netback/0 when I attempt to zmap and >> takes >> one 3GHz core ... Maybe there's something to look at in terms of >> optimizing? >> > > That's expected, because only one netback thread is necessary to serve > that VIF. > > Could you run 'top' then press 1 and copy the summary area in your > email? > > It should look like this: > > top - 15:49:09 up 27 days, 6:14, 16 users, load average: 5.00, 5.02, > 5.08 > Tasks: 259 total, 2 running, 257 sleeping, 0 stopped, 0 zombie > %Cpu0 : 1.0 us, 1.3 sy, 97.7 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, > 0.0 st > %Cpu1 : 0.0 us, 0.3 sy, 99.7 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, > 0.0 st > %Cpu2 : 4.0 us, 53.5 sy, 42.5 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, > 0.0 st > %Cpu3 : 1.7 us, 40.2 sy, 58.1 ni, 0.0 id, 0.0 wa, 0.0 hi, 0.0 si, > 0.0 st > KiB Mem: 8132308 total, 7385188 used, 747120 free, 160348 buffers > KiB Swap: 0 total, 0 used, 0 free, 3283276 cached > > PID USER PR NI VIRT RES SHR S %CPU %MEM TIME+ COMMAND > 3378 colord 20 0 284m 110m 2484 R 98.0 1.4 15502:29 colord-sane > 25531 weil 20 0 24788 3268 1436 S 2.0 0.0 165:58.78 htop > 22448 weil 20 0 1010m 97m 24m S 0.7 1.2 4:57.67 chrome > > Wei. > I ran 'zmap -p 80 -B 10M -o results.txt --interface=eth0' and took a screenshot of top. 0:05 0% (1d11h left); send: 74425 14.9 Kp/s (14.8 Kp/s avg); recv: 2196 492 p/s (436 p/s avg); drops: 0 p/s (0 p/s avg); hits: 2.95 10mbps ~ 15k packets/second The server is dual xeon X5450 ------=_20131228203409_44038 Content-Type: image/png; name="top_zmap.png" Content-Transfer-Encoding: base64 Content-Disposition: attachment; filename="top_zmap.png" iVBORw0KGgoAAAANSUhEUgAAAjsAAAJPCAIAAAAVB4LbAAAAAXNSR0IArs4c6QAAAARnQU1BAACx jwv8YQUAAAAJcEhZcwAADsMAAA7DAcdvqGQAAJaaSURBVHhe7ZprciM5z6xnaWdpZ+fvBzEhNJwE WaziRZTN54cCmbiqesIV7p7//v/hcDgcDt/A6431/w6Hw+Fw2B59Y/3vcDgcDoe9OW+sw+FwOHwH m76x/vvvP40SIg21IrTCkftwLrFKdHngz4NWYClQq4FbxQPxe9PJP9BEhqYdmniTO50MH7iG9GzG XP6lT6CRxgeFMqBWwbzF3V4qvttONLajDOQOgL8VwRvr44fSw6J7SFZA5YN2qSmVtbT3QKtpHckK 7ZUDeZ1e3tt+ElWmqSO/zvCBKxl1+fc+gUvsq9W/I2UhQ/MW1tLYK2W+0mJvttPYTtmw+NkBs9nu jYXt/ga6py4N8++2w8l9ITQHkq+mje0HzD41Jz/ek/uNlfWxDxg+cDGjLv/SJ3B5NhVU6sPK9vaQ u+209G470d5+WXl39TL4jSWHGmol1EqY432Yo/ADKc6loPpN7hg+lVpfqHZZb4LcIagA0j5Bylzg yyj2MgcFAmIyBXMQAO8bcB4Q9uZmWvJC9RtyTOaVnVwOrFxiwBFUJ8zxPswh5NOwAqh1ZSKGGYIy YA4CgWLDHO/DFFQn1PpZhk9vCnCAWj9NgrKVYp96DY0qQ7MC1dfbLZsHoN6e87i9c+9Kmn7HCr+P fHrfxwQqPZooQzXoEhDDBCSFVPhCtSM3vVOKQTjQQwWQ8ul9H5egmjTgBWKYOT6VyoNKmJSqmA/I G8UBqt+EDjCJQPDxEC4HUgFku+kDgWp6KK0D4SKYPiWxl3VQ6estpiGhTzUAZlhG9XWZc6tesgAx TCN3LqGWygSfsri9PeRZe94FVG9G1xsLEoz9hpVp7Yt8pcSXjVSvUeKyVwhb+ud42lMmJfD4FDCZ 8j9SD6hMaB+OSl/ffxhxOZAKTEqQpwjzEYyFxpakBB6fAiSJ1PQPOEgJFqfkD8xH4EGBAQcpweKU /AH8Rqi+vd1Xvrbe3AuoqzLEpyxubw+52y4FlZrL9o+w4nesB1SmtS+yysYWKSM00TaBaiBfU/rm eNpTkJemxF4KuXOLSm/7WFS+7vgJskO4nEYFuTSHUkbJ74TGhrLdDClV5nNKQ3KfHJMSAEjBxw+g 9vZpVtlzQPt2SREwkQUkL7nVfjn87vY1XLyxENPp3pRPkDLDKA3Mfe9QFrI0CpSylbElqAXSPkFK XlAqq7f77GvTey8cwUyLBcT2aXj5qkuoruLLqKUi65VCXgBU3+ey1xekVS/pTaFi+oAQH6i+CTWG 0psSV8yQUiUCk4KPBar0UBekNw0y6zLEavLiUnulxZAUUF3ACvLKUq/3S+0igeoCVpBXeiecQ2ZY 83GCN5YgtwLVzhHMQTAWrDDIhDTUvbqTgC+ozsYK3gwLQtKwF4jts5HU+g8yISto3c+9cARvesxM VQockDshKDNyEw5Qy5mqE2o5yCyVtYBeQ90IrUg1+PSmAEdQnVDLtRBU1g4aDXWvTkJcMUNQJiCG KfgYpCpFrcJw1AiIyRTgCKoTaiXUioYTYRlMQXXVMTRRmBkSVsIUVDvIDMtCMySshCmQNHIfzm7E b6wWNvlKnWfM/hYb/sHTSfUL593/ePKGj7Sdrz5+OPQ0Wh5O5wN83D7kD+5Lt2/F17+xNmfPpyRX GWodDp9A/ytMqHU4lHn+xjocDofDYSXnjXU4HA6H74DfWPr7+Rt1m3nQ0g6dBGmo+yY0Z7NsKRYZ 6v5S6DtCGhWznWdd3wi+qaB6e2afiqchqJ7A1OF/jfh3rMePeN6fzeu/qYSXiIVQCqoj6llPe6Vw q/gZry+WfVkVq1i2Ed9O8BKxAAnUevpAHrRcMmNmD+nBvE6y4BYPWvqZujQ9hucPpJHK5HlLfyuf f2O1tEiN4R3EgpeIAZyQetbTXincKn7G64u5LSR/E/hqwDuIBUig1tMH8qDlu6DHQrKFu/VDmLc0 PYCuB9LIpLF/k9Y3VvrTVNSKTAsEig21Emr9NEv4yjwWvG9BCLJArYRaiZID1EqolSC5gPwGAz4K BG8akPYJUiY2BZICJHwBpqD6nYV5F5sQxgKkEZoGskCtBEkBNUCtyEQAR4ApkBQg4QswBdXvLMzh 2ApAkkAWlBygVsIc71dMQXVCrZ9l+JyBrQAkPUh5ct87COAI5gCYAkkAE6h1cDz5HQtZqiHTZ8NK g2QFqfTFkDk+izgkz5Jjsj5H8AWXxWORdfWNPouY6s30fsUEPhZSYdAOKfj4Lq/RP0cRmkjkjicv 1qiaEiBLpvdLsZAKOZs7k3jt/rnLSw/5JvP6sFI+vV83IUFuSuzlWGg4yRJWQ8WQ+ScCi4VSLNTl QXjyO5bgTcQAjqD6TWjepTIEKeAdxCF5lhyT4RwxPeoWimeAvYLqAnkBOZDtJqikhLydCm4hvaV2 n0IsQJYo1ZCJMk/FTB2Kl5WUkLdTwVhkOO3ykgizlw7kLZOwlEFyIGnhv+EkQ6heowRk/ukD4GWe IjRxeNP0xrqU5uSBJxUGfiOVdqRCtCIjT5Fjsr1SyItnIFsaF+Vl5EC2m6CSEkxKACCfUZlgKQsa yevrEpRM75dioSQlAJCToBUkQ6gmrycH8tWTdZVMSA+ZYc0QZLIfTjKHsqHMP30AvKykDiG331gS Q3pTyE2Lw0qDZAWpDItDPzQ9PouY6k3WKyUmqZEDNYLqPm6Nyiu9kya9pDeFigkqKSFs90gKqK5S qjTfgkuozMtKSoCsmPIJUkZpkWR6JAVUd2PTLAihlEnvIw4r7ROkTM00IL35Ks2koLobm2ZBiTxL DmT+icBioRQLdXkQbv+tIGIyBXMQAO8bcIBaP80cLXKQiTJPyfegRlBdnqlWVInYOyBVKbnTA6YR mssIU2gRENunUTc9PmV434ADcicEZR4yS2UCUjmaTuSOAFNQnVCr0I7AgwLDTATA+wYckDv9YKag uoAWJdRKqOVM1QlzEHhCU0h9ilo/t+ATmDkQzBRUR2iFI/fNQSCQ+SpKmOmBKahOqHVwxG+slfz6 P5g/+18efXGTv+yBdH6d3/eUwsv7v873PpDDQD7/xjr8YuSnjKHWr6P/q+H5ALW+mfBb/I6vdvg4 5411OBwOh+/gvLEOh8Ph8B0Ebyz/+7vFEhhw7tLT2w+2C6rLaN3nTiX0mjfqZmj6J5r7KHrKNzz5 fDscQXUBLXqj7iM62z04RlBdRuvGre5HDxp0fD37DCwlch/Fddor13B5DwoIzU2G31hYbOtJggfH 0cDFyFLstaCEFVjwWegMkp5K6oPYVRaUsAIL7vKsy8BeQXXzSZQlmdOTbSdd8RplQQkrsODj2CUW lLACC0KepW6R9itqXV0FUCOovsOzrjo4RlDdwN164W69UfsdKw+eQe3Pb33UKF2+kaSHUiQ/At1A 0lNJfQo6iaSHUiQXgI3AO4gFkh5KkbxLT69BN5D0UIrkR6AbSHooRdJT8kdhqy0AJHNQANT6KHpK Qq0rbhUbD1pA8d+x/MRwOkz5BN40IEPzLtIFVDdDXSQ9lCLpId9k6lDgdOJHIRYgCc05NBGhFQlz EACSz0jj/80h6aEUSQ98FAgwBZLP8EN8LJD0UIokEWZhCohh9mDTAEkPpUh6qEyjdwtQqw8aRdJD KZIe+CgQYAokn+GH+FggSVjWghIoAGo1dD2mfXJLJWpAyWmn642V13hHqJgPeNYoXb6RpIdSJD3k Q4ZmPzKH0MRPNPfO+pggHzI0O5Ehfg5JD6VIeihVip+RZusQHwskCWQNdQtQgZep+6K9BZpD0kMp kh4q0+gnJf8WrwuaT/Ipkh5KleJnpNl8hqFuhs/6OIdSXla6enhd0zAZZUCtDEqZrLTUid9YpTWe sKbdXIas8xtJeihF0kO+ydQRtwyhfX69Ms/W5TPSkn9zSHooRdJDvpellnZeW99DfCyQ9FCKZA5l 6/IZrwvaTqIUSQ98/wleDQ51O6A5JD2UIukh38tSSyOvleUbSHp8yschpYJ612NK60rU68Nspb7O 83/HEtP7iL0jVMxlyDq/kaSHUiQ95OeSnFG0T26p9DW+2Ps90BySHkqR9JDvZamlndfW9xAfCyQ9 lCKZQ9m6fMbrgraTKEXSA99/+gCUem8hQ/wckh5KkfSQ72WppZHXyvINJD1IEZorkNdctjwjX1Sn pZ5qLutL8BvLBiHwnwalQMr8qAx9Cx7wuPd1R+q1wCDHpAUhPmWV3hS8TCUvVD8in+AdHwskPeSb TB0vvCnAFFTfwRotMMgxaUEIpbwMu16zEqqrUKVJCwzv+FggmUNZL1MrS0H1HazRAoMckxaEWI19 +kCQOJeC6jtYowUGOSYtCKGUl2HXa1ZCdYG8hpy6NEo+oJSXYddrVkL1fcJ2b/pYIOkh36T3S70h xTeWQLFhDgICNQJimIKZz0C7oPom2vyzXa2EWs2LtCiV4dObAhyQO+2gF6iVUCuROwLMEK1IqPUT 71fKWkC7oDqhVkKtQiVBWcjU9A+kQO6EoMxDPiRQK5E7AswcTb9R9+cWfAIzn4F2QXVCrYRahcoc FFBZ6nuBGKZg5jPQLqhOqJVQq1BJUBYyNf0DKZA7IWEZTEPdn75ab0LTgwKQOwJMkDvtoNeT+7kj wAzRioRaCbVunlr8Py8uubupnxkb0xOb+0XmzR94PM0xOWp+zuv0acPBOT7kHF/nHB+y4PgWvumN dZgK/osEah0Oh8NOPH9jHQ6Hw+GwkvPGOhwOh8N3ELyx/F8KWZz+rkiB84Ce3k5wuaC6jNZ97tQc PegcPw1d/KZi5mj6J5q7T08vgUsE1WW0btzqfvSgQcfXs8PBPYLqMlr3bU9eK36iucnwGwuLbT1J 8Ow46XrW2I+ttqCEFVjwcewSC0pYgQUfxy6xoIQVWHCXZ10CbYQEat256rKyJ9tOuuI1yoISVmDB x7FLLChhBRaEPEs9Ix1yfZJgBRbc5VlXBbvEghZuFYO79Ubtd6w8eAwmdM551i5dvpGkh1IkPwLd QNJDKZIfgW4g6aEUydnQOkigVvNJjWUVOtsBnUHSQymSH4FuIOmhFElPyR8O3UDSQymSH4FuIFmi sYx40AKK/47lJ4bTYcon8KZRl7d47Uioboa6SHooRdJDvsnUocDphEaR9FCKJIEsMAcBIPmMNL7p JEqR9MBHgQBTIHkL34vYIBOyxOMamAJimD3YNEDSQymSHirT6N0C1OqDRpH0UIqkBz4KBJgCyX5o IEkPpUgSyAK1rloeQANJhrTXgJLTTtcbK6/xjlCXd3nWLl2+kaSHUiQ95EOGZicyxM8h6aEUSQ/5 kKHZiQzxc0h6KEXSQ6lSfJc09Qcls0JLjUA1XqYB1xMuoTkkPZQi6aEyjX5S8m/xuqD5JJ8i6aFU Ke4n7Xl4kpce8r0stTzjdUHbSQAFQK0MSpmstNSJ31ilNZ6wpt4YzpmNLPV7SXooRdJDvsnUEbc8 gwaS9FCKJJFn6/IZaUnTSZQi6SHfy1LLXV67s1Gh6bksMKisLp/xOsXNIemhFEkPfP8JXg0OdTug OSQ9lCLpId/LUsszXhc0n+RTJIlSttLyANpCskK9MsxW6us8/3csMb2P2DtCXa5Blvq9JD2UIukh P5fkPIZGkfRQimSIr/HF3u+B5pD0UIqkh3wvSy13ee3ORoWm57LAoLK6fMbrFDeHpIdSJD3w/acP QKn3FjLEzyHpoRRJD/lellqe8bqg+SSfIhmS11y23ILmk6zQUkk1l/Ul+I1lgxD4T4NSIGV+VHof kLzL4/Z0yKvXAoMckxaE+JRVelPwMpW8UH0Ha7TAIMekBSGUMpmaXnhTgCmovoM1WmCQY9KCEEp5 GXa9ZiVUXxEW5yY5JOtQpZdpDEtB9R2s0QKDHJMWhFiNffpAkDiXguo7WKMFBjkmLQihlJdh12tW QvUdrNECgxyTFoRQysuw6zUrofoO1miB4R0fCyQ95Jv0fqk3pPjGEig2zEFAoEZATCaAeQvtfNQr aPPPdrUSajUv0qJUhk9vCnBA7twC7YLqhFoJtQqVOVqUUOsn3q+UtYB2QXVCrYRahUqCspCp6R9I gdwJQRlQq2AKaiW8g7gCygx1nY8YpmDmM9AuqE6olVCrUJmDAipLfS8QwxTMfAbaBdUJtRJqFSoJ ykKmpn8gBXLnFmgXVCfUSqhVqMzRokTuCDBB7twC7YLqhFqJ3BFghmhFQq2EWjdPLf6fF5fc3dTP jI3pic39IvPmDzye5pgcNT/ndfq04eAcH3KOr3OOD1lwfAvf9MY6TAX/RQK1DofDYSeev7EOh8Ph cFjJeWMdDofD4TsI3lj+L4UsTn9XpMC5hXYm1FqL7m7YrnUfurNE40koE1RvgB50jm/jwQTsNXIH oJjQ3E8091H0lIZjtK5aWc/O4PIkgDJB9QboQVfPM0dzk+E3FhbbepLg7nGd7f3IRiy1oIQVWLAD OEZQXcBqLPg4dokFJazAgrs866pgl1hQwgosqFAvuGwn0sJ/LSRBaIa0V07FzrCghBVYEPIs9Zh0 ywvVBazGgrs866pgl1jQwq1icLfeqP2OlQfPoPbntz5qlC7fSNJDKZKfAmcAtSKogORHoBtIeihF 8iPQDSQ9lCJ5l7u9tI6kkDsl2iunQmeQ9FCKpKfkzwBnALUiqIDkR6AbSJZoLCMetIDiv2P5ieF0 mPIJvGmQBKF5yWtHQnUz1EXSQymSHvJNpg4FziguZ1IBSQJZYA4CQPIZaXzTSZQi6YGPAgGmQLIf GkjSQymSRJiFKSCG2Yg1WixACiQrXFb6LMWGWn3QKJIeSpH0wEeBAFMgOZDLyVRAkkAWqDXheBpI MqS9BpScdrreWHmNdwSSQu6086xXunwjSQ+lSHrIhwzNUci0+kAqIOkhHzI0O5Ehfg5JD6VIeihV ivtJex6e5GUOZb1MrbXeEHR5NHFn4GWlz5Yq6xMaed3xc5eXHkqR9FCqFA8kLaxNpgKSHvK9LLU8 43VB20kABUCtDEqZrLTUid9YpTWesKbSKDFl10B7SXooRdJDvsnUEbd0cjmZCkgSebYun5GWNJ1E KZIe8r0stTzjdUHzST5FMoeydXmX1+73BB/XaalEgf8Er06Huh3QHJIeSpH0kO9lqaWT1ynVyVRA kihlKy0PoC0kK9Qrw2ylvs7zf8cS0/uIvSOYJH8lstpvJ+mhFEkP+bkkp5/LmVRAMsTX+GLv90Bz SHooRdJDvpellme8Lmg+yadI5lC2Lu/y2v2e4OM6LZUo8J8+AJdDWpAhfg5JD6VIesj3stTSyeuU 6mQqIBmS11y23ILmk6zQUkk1l/Ul+I1lgxD4T4NSIGV+VJrvzR4ez0mH6CUIDHJMWhDiU1bpTcHL VPJC9X3CdjJNWhBCKZOp6YU3BZiC6jtYowUGOSYtCKGUl2HXa1ZC9R2s0QKDHJMWVKACL1M3S0H1 Fb7YxwSlSJZAjf/0gSBxLgXVd7BGCwxyTFoQQikvw67XrITq+4TtZJq0IIRSXoZdr1kJ1XewRgsM 7/hYIOkh36T3S70hxTeWQLFhDgICNQJi7xip8B7a+ahX0Oaf7Wol1GpepEWpDJ/eFOCA3GkHvZ7c hyOovtqlRQm1fuL9SlkLaBdUJ9RKqFWoJCgLmZr+gRTInVugXVCdUCuhVqGS0Io36v7sxScwsw7K gFrlXvjAO4jroIyKU/cLxDAFM5+BdkF1Qq2EWoVKgrKQqekfSIHcaQe9ntyHI6i+2qVFidwRYILc uQXaBdUJtRK5I8AM0YqEWgm1bp5a/D8vLrm7qZ8ZG9MTm/tF5s0feDzNMTlqfs7r9GnDwTk+5Bxf 5xwfsuD4Fr7pjXWYCv6LBGodDofDTjx/Yx0Oh8PhsJLzxjocDofDdxC8sfxfClmc/q5IgdOOtjk0 sRBdXF2tFT/R3EfRU37v8UDrPnG2Ln5TMXM0/RPN3aenl8AlguoyWjdudT960KDj69nh4B5BdRmt +71Pfjj8xsJ6O4Ik6Dyxs/0BshFLLWjhVvE87AwLWrhVPA87w4ISVmDBXZ51CbQREqh156rLyp5s O+mK1ygLSliBBR/HLrGghBVYEPIs9Yx0yPVJghVYcJdnXRXsEgtKWIEFt3jQAmq/Y+VBPz2jnvVK l28kWaKxbDZ0BskSjWWzoTNIeihFcja0DhKo1XxSY1mFznZAZ5D0UIrkR6AbSHooRdJT8odDN5D0 UIrkR6AbSHooRbKFu/VG8d+x/MRwOkz5BN406vIWrx0J1c1QF8mQyxrKmkx9CpxOaBTJkPYaYA4C QPIZafy/OSQ9lCLpgY8CAaZA8ha+F7FBJmSJxzUwBcQwe7BpgKSHUiQ9VKbRuwWo1QeNIumhFEkP fBQIMAWS/dBAkh5KkSSQBWpdtTyABpL0UIokgSwoOe10vbHyGu8IVABU3+dZLy0lmYMCoFYGpSBD sxMZ4ueQzEEBUCuDUpCh2YkM8XNIeihF0kOpUnyXNPUHJbOEViTUKkAFXqbui/YWaA5JD6VIeqhM o5+U/Fu8Lmg+yadIeihVivtJex6e5KWHfC9LLc94XdB8kk+R9JBvslR/SfzGKq3xhDUPGmcj6/xG khUqleSbTB1NwxuhgSQr1CvzbF0+Iy35N4ekh1IkPeR7WWq5y2t3Nio0Qy4rKVuXz3hd4OaQ9FCK pAe+/wSvBoe6HdAckh5KkfSQ72Wp5RmvC5pP8imSRClbaXkAbSHpoRRJIsxW6us8/3csMb2P2DsC SRCa85B1fiPJCpVK8nNJzmNoFMkKLZW+xhd7vweaQ9JDKZIe8r0stdzltTsbFZohl5WUrctnvC5w c0h6KEXSA99/+gCUem8hQ/wckh5KkfSQ72Wp5RmvC5pP8imSIXnNZcstaD5JD6VIhlDNZX0JfmPZ IAT+06AUSJkfleZ7UyDZTk8jei0wvONjgaQnLPOm4GUqeaH6DtZogeEdHwskPeSbTB0vvCnAFFTf wRotMMgxaUEIpbwMu16zEqqvCItz0zs+FkjmUNbL1MpSUH0Ha7TAIMekBSFWY58+ECTOpaD6DtZo gUGOSQtCKOVl2PWalVB9B2u0wCDHpAUhlPIy7HrNSqi+gzVaYJBj0oIQSpn0fqU9p/jGEig2zEFA oEZATKYA5y7aPLRdrUTuCDBDtCLV4NObAhyQO7dAu6A6oVYidwSYIVqRUOsn3q+UtYB2QXVCrYRa hUqCspCp6R9IgdwJQRlQq2AKaiVyR4CZo+k36jofMUzBzGegXVCdUCuhVqEyBwVUlvpeIIYpmPkM tAuqE2ol1CpUEpSFTE3/QArkzi3QLqhOqJVQq1CZo0WJ3BFggty5BdoF1Qm1EmoVKnO0KKFWQq2b pxb/z4tL7m7qZ8bG9MTmfpF58wceT3NMjpqf8zp92nBwjg85x9c5x4csOL6Fb3pjHaaC/yKBWofD 4bATz99Yh8PhcDis5LyxDofD4fAdBG8s/5dCFqe/K1LgPKOz/TG4XFBdRus+dGeIHnSOn4YuflMx czT9E83dp6eXwCWC6jJaN251P3rQoOPr2eHgHkF1hFb8RHMfRU/Z9Xh+Y2GxrScJHh8njY97e7C9 FpSwAgs+jl1iQQkrsODj2CUWlLACC+7yrEugjZBArTtXXVb2ZNtJV7xGWVDCCiz4OHaJBSWswIKQ Z6lnpEOuTyJuFRsPWurYGRa0cKsY3K03ar9j5UEPGNIz6lmvdPlGkh5KkfwIdANJD6VIfgS6gaSH UiRnQ+sggVrNJzWWVehsB3QGSQ+lSH4EuoGkh1IkPSV/OHQDyRKNZbOhM0iWaCwjHrSA4r9j+Ynh dJjyCbxp5D4VtCONQHUz1EXSQymSHvJNpg4FTic0iqSHUiQJZIE5CADJZ6TxTSdRiqQHPgoEmALJ W/hexAaZkCUe18AUEMPswaYBkh5KkfRQmUbvFqBWHzSKpIdSJD3wUSDAFEj2QwNJhrTXALW++XgV CTjtdL2x8hrvCLlJBbd41itdvpGkh1IkPeRDhmYnMsTPIemhFEkP+ZCh2YkM8XNIeihF0kOpUnyX NPUHJbOEViTUKkAFXqbui/YWaA5JD6VIeqhMo5+U/Fu8Lmg+yadIeihVivtJe5pOAigAamVQystK 1wNeR/wc7mUOCoBaGZQyWWmpE7+xSms8Yc2lSQULkI10gJceSpH0kG8ydcQtz6CBJD2UIknk2bp8 RlrSdBKlSHrI97LUcpfX7mxUaIZcVlK2Lp/xusDNIemhFEkPfP8JXg0OdTugOSQ9lCLpId/LUssz Xhe0nUTUK0vZSssDaAvJCvXKMFupr/P837HE9D5i7whmEsiugTaS9FCKpIf8XJLzGBpF0kMpkiG+ xhd7vweaQ9JDKZIe8r0stdzltTsbFZohl5WUrctnvC5wc0h6KEXSA99/+gCUem8hQ/wckh5KkfSQ 72Wp5RmvC9pOIloq85rLllvQfJIVWiqp5rK+BL+xbBAC/2lQCqTMj0rvG7nTzuPedMir1wKDHJMW hPiUVXpT8DKVvFB9B2u0wCDHpAUhlDKZml54U4ApqL6DNVpgkGPSghBKeRl2vWYlVF8RFuemd3ws kMyhrJeplaWg+g7WaIFBjkkLQqzGPn0gSJxLQfUdrNECgxyTFoRQysuw6zUrofoO1miB4R0fCyQ9 5HsZtrwGJVTfwRotMLzjY4Gkh3yT3i/1hhTfWALFhjkICNQIiGEaudNIGvlC9U20+We7Wgm1mhdp USrDpzcFOCB3boF2QXVCrYRahcocLUqo9RPvV8paQLugOqFWQq1CJUFZyNT0D6RA7oSgDKhVMAW1 ErkjwMzR9Bt1nY8YpmDmM9AuqE6olVCrUJmDAipLfS8QwxTMfAbaBdUJtRJqFSoJykKmpn8gBXLn FmgXVCfUSuSOADNEKxK5I8AEuXMLtAuqE2olckeAGaIVCbUSat08tfh/Xlxyd1M/MzamJzb3i8yb P/B4mmNy1Pyc1+nThoNzfMg5vs45PmTB8S180xvrMBX8FwnUOhwOh514/sY6HA6Hw2El5411OBwO h+8geGP5vxSyOP1dkQKnHW1zaGIhurhhtdZ94sgSetA5fhq6+E3FzNH0TzR3n55eApcIqsto3bjV /ehBg46vZ4eDewTVZbTu2568VvxEc5PhNxYW23qS4O5xd+uHIwfgBgtKWIEFH8cusaCEFVjwcewS C0pYgQV3edYl0EZIoNadqy4re7LtpCteoywoYQUWfBy7xIISVmBByLPUM9Ih1ycJVmDBXZ51VbBL LGjhVjG4W2/UfsfKg2d0thvP5kiXbyTpoRTJj0A3kPRQiuRHoBtIeihFcja0DhKo1XxSY1mFznZA Z5D0UIrkR6AbSHooRdJT8odDN5D0UIrkR6AbSJZoLCMetIDiv2P5ieF0mPIJvGlA2idImdto8/12 6iLpoRRJD/kmU4cCpxMaRdJDKZIEssAcBIDkM9L4ppMoRdIDHwUCTIHkLXwvYoNMyBKPa2AKiGH2 YNMASQ+lSHqoTKN3C1CrDxpF0kMpkh74KBBgCiT7oYEkPZQiSSAL1LpqeQANJBnSXgNKTjtdb6y8 xjuCmd738S2eNablP7Z76aEUSQ/5kKHZiQzxc0h6KEXSQz5kaHYiQ/wckh5KkfRQqhTfJU39Qcms 0FIjUI2XacD1hEtoDkkPpUh6qEyjn5T8W7wuaD7Jp0h6KFWK+0l7Hp7kpYd8L0stz3hd0HYSQAFQ K4NSJistdeI3VmmNJ6x50DgbWec3kvRQiqSHfJOpI255Bg0k6aEUSSLP1uUz0pKmkyhF0kO+l6WW u7x2Z6NC03NZYFBZXT7jdYqbQ9JDKZIe+P4TvBoc6nZAc0h6KEXSQ76XpZZnvC5oPsmnSBKlbKXl AbSFZIV6ZZit1Nd5/u9YYnofsXcEkiA05yHr/EaSHkqR9JCfS3IeQ6NIeihFMsTX+GLv90BzSHoo RdJDvpellru8dmejQtNzWWBQWV0+43WKm0PSQymSHvj+0weg1HsLGeLnkPRQiqSHfC9LLc94XdB8 kk+RDMlrLltuQfNJVmippJrL+hL8xrJBCPynQSmQMj8qzfemQLKdnkb0WmCQY9KCEJ+ySm8KXqaS F6rvYI0WGOSYtCCEUiZT0wtvCjAF1XewRgsMckxaEEIpL8Ou16yE6ivC4twkh2QdqvQyjWEpqL6D NVpgkGPSghCrsU8fCBLnUlB9B2u0wCDHpAUhlPIy7HrNSqi+gzVaYJBj0oIQSnkZdr1mJVTfwRot MLzjY4Gkh3yT3i/1hhTfWALFhjkICNQIiMkU4NxFm4e2q5VQq3mRFqUyfHpTgANy5xZoF1Qn1Eqo VajM0aKEWj/xfqWsBbQLqhNqJdQqVBKUhUxN/0AK5E4IyoBaBVNQK+EdxBVQZqjrfMQwBTOfgXZB dUKthFqFyhwUUFnqe4EYpmDmM9AuqE6olVCrUElQFjI1/QMpkDu3QLugOqFWQq1CZY4WJXJHgAly 5xZoF1Qn1ErkjgAzRCsSaiXUunlq8f+8uOTupn5mbExPbO4XmTd/4PE0x+So+Tmv06cNB+f4kHN8 nXN8yILjW/imN9ZhKvgvEqh1OBwOO/H8jXU4HA6Hw0rOG+twOBwO30HwxvJ/KWRx+rsiBc5dtPlD f+Okuxu2a92H7gzRg87x09DFbypmjqZ/orn79PQSuERQXUbrxq3uRw8adHw9OxzcI6guo3Xf9uS1 4ieamwy/sbDY1pMED4570DIQ2Y4DLChhBRZ8HLvEghJWYMHHsUssKGEFFtzlWZdAGyGBWneuuqzs ybaTrniNsqCEFVjwcewSC0pYgQUhz1LPSIdcnyRYgQV3edZVwS6xoIVbxeBuvVH7HSsPntHZbjyb I12+kaSHUiQ/At1A0kMpkh+BbiDpoRTJ2dA6SKBW80mNZRU62wGdQdJDKZIfgW4g6aEUSU/JHw7d QNJDKZIfgW4gWaKxjHjQAor/juUnhtNhyifwpgFJ5jNeOxKqm6Eukh5KkfSQbzJ1KHA6oVEkPZQi SSALzEEASD4jjW86iVIkPfBRIMAUSN7C9yI2yIQs8bgGpoAYZg82DZD0UIqkh8o0ercAtfqgUSQ9 lCLpgY8CAaZAsh8aSNJDKZIEskCtq5YH0ECSIe01oOS00/XGymu8I3hTPkHKPOFZLy0l6aEUSQ/5 kKHZiQzxc0h6KEXSQz5kaHYiQ/wckh5KkfRQqhTfJU39Qcms0FIjUI2XacD1hEtoDkkPpUh6qEyj n5T8W7wuaD7Jp0h6KFWK+0l7Hp7kpYd8L0stz3hd0HYSQAFQK4NSJistdeI3VmmNJ6wpmd738QLy 7V56KEXSQ77J1BG3PIMGkvRQiiSRZ+vyGWlJ00mUIukh38tSy11eu7NRoem5LDCorC6f8TrFzSHp oRRJD3z/CV4NDnU7oDkkPZQi6SHfy1LLM14XNJ/kUySJUrbS8gDaQrJCvTLMVurrPP93LDG9j9g7 QsVchqzzG0l6KEXSQ34uyXkMjSLpoRTJEF/ji73fA80h6aEUSQ/5XpZa7vLanY0KTc9lgUFldfmM 1yluDkkPpUh64PtPH4BS7y1kiJ9D0kMpkh7yvSy1PON1QfNJPkUyJK+5bLkFzSdZoaWSai7rS/Ab ywYh8J8GpUDK/Kg035sCyXZ6GtFrgUGOSQtCfMoqvSl4mUpeqL6DNVpgkGPSghBKmUxNL7wpwBRU 38EaLTDIMWlBCKW8DLtesxKqrwiLc5McknWo0ss0hqWg+g7WaIFBjkkLQqzGPn0gSJxLQfUdrNEC gxyTFoRQysuw6zUrofoO1miBQY5JC0Io5WXY9ZqVUH0Ha7TA8I6PBZIe8k16v9QbUnxjCRQb5iAg UCMgJlOAcxdtHtquVkKt5kValMrw6U0BDsidW6BdUJ1QK6FWoTJHixJq/cT7lbIW0C6oTqiVUKtQ SVAWMjX9AymQOyEoA2oVTEGthHcQV0CZoa7zEcMUzHwG2gXVCbUSahUqc1BAZanvBWKYgpnPQLug OqFWQq1CJUFZyNT0D6RA7twC7YLqhFoJtQqVOVqUyB0BJsidW6BdUJ1QK5E7AswQrUiolVDr5qnF //Pikrub+pmxMT2xuV9k3vyBx9Mck6Pm57xOnzYcnONDzvF1zvEhC45v4ZveWIep4L9IoNbhcDjs xPM31uFwOBwOKzlvrMPhcDh8B8Eby/+lkMXp74oUOO1om0MTC9HFDau17hNHltCDzvHT0MVvKmaO pn+iufv09BK4RFBdRuvGre5HDxp0fD07HNwjqC6jdd/25LXiJ5qbDL+xsNjWkwSdx3W2P0A2YqkF JazAgo9jl1hQwgos+Dh2iQUlrMCCuzzrEmgjJFDrzlWXlT3ZdtIVr1EWlLACCz6OXWJBCSuwIORZ 6hnpkOuTBCuw4C7PuirYJRa0cKsY3K03ar9j5UE/PaOe9UqXbyTpoRTJj0A3kPRQiuRHoBtIeihF cja0DhKo1XxSY1mFznZAZ5D0UIrkR6AbSHooRdJT8odDN5D0UIrkR6AbSJZoLCMetIDiv2P5ieF0 mPIJvGnU5S1eOxKqm6Eukh5KkfSQbzJ1KHA6oVEkPZQiSSALzEEASD4jjW86iVIkPfBRIMAUSN7C 9yI2yIQs8bgGpoAYZg82DZD0UIqkh8o0ercAtfqgUSQ9lCLpgY8CAaZAsh8aSNJDKZIEskCtq5YH 0ECSIe01oOS00/XGymu8I9TlXZ61S5dvJOmhFEkP+ZCh2YkM8XNIeihF0kM+ZGh2IkP8HJIeSpH0 UKoU3yVN/UHJrNBSI1CNl2nA9YRLaA5JD6VIeqhMo5+U/Fu8Lmg+yadIeihVivtJex6e5KWHfC9L Lc94XdB2EkABUCuDUiYrLXXiN1ZpjSesqTSGQxYge+kMLz2UIukh32TqiFueQQNJeihFksizdfmM tKTpJEqR9JDvZanlLq/d2ajQ9FwWGFRWl894neLmkPRQiqQHvv8ErwaHuh3QHJIeSpH0kO9lqeUZ rwuaT/IpkkQpW2l5AG0hWaFeGWYr9XWe/zuWmN5H7B0hL1iP7KUzvPRQiqSH/FyS8xgaRdJDKZIh vsYXe78HmkPSQymSHvK9LLXc5bU7GxWanssCg8rq8hmvU9wckh5KkfTA958+AKXeW8gQP4ekh1Ik PeR7WWp5xuuC5pN8imRIXnPZcguaT7JCSyXVXNaX4DeWDULgPw1KgZT5UVnyH/N4SDrk1WuBQY5J C0J8yiq9KXiZSl6ovoM1WmCQY9KCEEqZTE0vvCnAFFTfwRotMMgxaUEIpbwMu16zEqqvCItzkxyS dajSyzSGpaD6DtZogUGOSQtCrMY+fSBInEtB9R2s0QKDHJMWhFDKy7DrNSuh+g7WaIFBjkkLQijl Zdj1mpVQfQdrtMDwjo8Fkh7yTXq/1BtSfGMJFBvmICBQIyA2E8Fj0sgXqm+izT/b1Uqo1bxIi1IZ Pr0pwAG5cwu0C6oTaiXUKlTmaFFCrZ94v1LWAtoF1Qm1EmoVKgnKQqamfyAFcicEZUCtgimolfAO 4gooM9R1PmKYgpnPQLugOqFWQq1CZQ4KqCz1vUAMUzDzGWgXVCfUSqhVqCQoC5ma/oEUyJ1boF1Q nVAroVahMkeLErkjwAS5cwu0C6oTaiVyR4AZohUJtRJq3Ty1+H9eXHJ3Uz8zNqYnNveLzJs/8Hia Y3LU/JzX6dOGg3N8yDm+zjk+ZMHxLXzTG+swFfwXCdQ6HA6HnXj+xjocDofDYSXnjXU4HA6H76D2 f14Ilb8gSn979A91IyhbL15GuvofuQNQDLyD2IApqE7kjlAxlzFjKWYa6kYPRFCdUCvhHcRE7ofF MGezbJGBb2fkDkCxQFKAA9R6E5oEagTVX4Ie/RSdkvAOYgNmTiUVgmmC6oRaN0f9PmpvLHo6+cOq FHskZVkffxA6gyQgE1KwGL5g0gKDHEigVtTlqaSI9krhVvElry8QfSMLPKEpwBe8RGyQCQnUKs8f zpotBn0vksCbiAVIgaQHKUF1hM/WKzcnfVG+v8WEFCyGL5D0lPwQX2xxaP5Nim+slufS+BwlZVkf 3+VxYw6dQVIgBxKYREqABGq9IRMSqJXVEJUU0V4p3Cq+5PUFsm8E1HoTmgJ84B3EBpmQQK3yiuGs 2WLQ9yIpeAcx8A5iAimgVkQ9+y2EX7PFhAQmkRJIekp+SFh8a8LvJn5j5Q9InNDUKGoxkHr1v4Nk qwO8gwCOgZSgeig0uSTzAEACtd54E7EAaYQmQAqolVArUXKAWgm1EiTHgnVArTehafgsYg98jyYS alVXkG8ydShwBNUJtZyJGOYabC+oS+BNH3vMt6BEnoWT+l7AFFQn1CqYiwm3t5gm8wCQ9MBHgeBN o+SDkmmY432YguqEWl9L8MYqfavcRzFQKwJZK/OfRp6iAiF3hiBjabJ36rGRO0JYKcAHuUPkWXJM 1ucIvuCy+DEyGcMReEqm4R3EgpeIgXcQGzBzKAX5zJTYyzVgqaFuIncEbyL2hAWIc5AFaiW8RBwW VLpWInvz1ZdmPTZg5lAWsXcEMw34guqEWoV2HwiIS5VfSuvvWEJueqfyICgFKZ+ET9nnVF5bE6oT 5HhpsQUA0vAmYsObiAXIEnkBOSbDUWJ61C0Ud4IVQl0CbyIWSHp8CrHgJWKBpId8k6mDUwRMZAHJ 2aQr/m300sce7yMWSAreQRwSZnMzjflByVxMuLfF9NJiCwBJD/mQoekDT26KQ5iPwOMLvp0b/45V dypPhFKQYb1PhQUDkfnhCvIhQ7TiZ41ahflmWnBJXkaOyfZKIS/uRAbSTHIggVqFGhU/sZQFBjkk PeTn0hxKATLDmnm8jnMbvfSxx/s+FiBDtCIjTOVmY9l65Ib8jBYTMkQrCnMA+ZCh6QNPboZlQskX JFXJfgvFN5ZAXy//tpViTzinYoYFQu48RkaF00o+sKwFABKoFY0yx4IWfCVi6jVZr5SYpEYO1Aiq mwm7yIQEahVq8liABGq9IZOkJyzzptBoSpxLQfUEaL5JC3J8yscCSSF3iDCbm+RAhiaQGKieQ7ii 3TQsawEg6aEUYnJMet/ITXIq7aXKL6X2xhIg5dNjKQ/MEMqaTH2KOQgEHwup6oXqPnTWT8xHTY7P IjYazdwxkArRClejOqFWQq2oErF3QKpScqcRNBK5HxaHphBWavSTsLKEVry7yBTgCKoTahXaBTOn gi2GNxEbMD25iUojND1htmQaahVMIXdmEG5pNw2fRWzAzEEKNQJMQfU7ayYCT8k01LpT+aXwG2tn fsHj3pnzeB9zHt1jzqM73OKb3liHw+Fw+MucN9bhcDgcvoPzxjocDofDd9D0f16ESMqjbgEtSqj1 59HH8YkH8qm9U8GXElTPZ+WuqeC5CarLaN1mX5xOgjRyp0I+IXeEijmcx5PnnfRBam8s+sL5968U ey7n/EHkIeA5WFCinvW0Vwq3ivfn9RDbnudAli2aij0xC0r4bL1yJenqF14iFkiCummBQQ4kUKsw cwiPx06657MU31gt39bXVOqnPripwychN/uzSRKVFNFeKdwq3pzX42t+ngNZs2Uq9KxIEpXUp8DB wDuIBZJC7ghmWuAhExKoVWgcwuOxk+75LPEbK/+q4oSmRlGLEaZKvRIb5ngfJlDrp7k/dDNJD1JA rYRaiZID1EqolSD51dC3I+kh32TqUOAIqhNqORMxzO/FvgsgSeQpOKnpBUxBdUKtgjkEP9PHQl0C b/rYIBMSqFVoNJAFajWbCOAIMAXVCbV+luHzlxG8sUrfM/dRDNQqoEUJcxAIPvbAf/WUi0l+BekL /fhGXhJ5ihyTlSHAF1wWfxHyXeireekhH/KZKbGXXwp9C5IepIBaCS8RhwWVrn5kmh8IaaibKDmA JMjLhIqZQ6mwEmZYKZ/eNxMS5KbEXv4aWn/HEnLTO+1Px6/wn0BiDxykAMlvJH0z/soqMvIUOSbD IWJ61C0Ufyn5V/PSQ77J1MEpAiaygOQ3kr7Zv29BkghTuZlm/KBkjsIP9LHgpY9zkDVyE46gOqFW dXjF98BBykOmVRKWMkj+Dm78O1bdaX86qMw/fQAs630ffyn5N/KSyFPkmGyvFPLi70W+C301Lz3k 59IcSgEyw5rv4vWF3bcgSYSp3GwsG4gMt/k+Frz0cQ6yQK37poqfhD6ZkDMqfxnFN5Zw+f0rxZ5w Tv7pA0FiSPsEKfmP3PkK7LtYUMJnEVO9yXqlxCQ1cqBGUP092NkWhPiUVXpTaDQlzqWg+nuwsy0o EWZzkxzI0AQSA9X38e0+FkxaYJADCdS6b6r4CfmQ3nx1ZqbQY0rs5a+h9sYSINN3/4elPDBLaFFC LTccEqSSF4jtMyQVvlD9VejpDcdrnatUnVAroVZUidg7IFUpufNF4HhBdQEtcg/EmwIcQXVCrUK7 YOY3guMF1QXCgpJpqFUwhdxpB72e3PSViA2YxhAzRCsSajkTMZmCOQiA9w04gurk4POXwW+sDak/ 91/5p/IRzpN8zHl0jzmP7nCLr39jHQ6Hw+GP8AVvrMPhcDgchPPGOhwOh8N3cN5Yh8PhcPgOzhvr cDgcDt/BeWMdDofD4Ts4b6zD4XA4fAfnjXU4HA6H7+C8sQ6Hw+HwHZw31uFwOBy+g/PGOhwOh8N3 cN5Yh8PhcPgOzhvrcDgcDt/BeWMdDofD4TvgN9Z/h8PhcDjsyXljHQ6Hw+E7ePzG0oY3d80QyppM fUrugNxE5WfRU95UzHaoBTJN+gdS7VALZJr0D0t5KmY72vYmNIXch3ML7UyYgwBApvw/kCqhRQm1 7uC7LE7DlNwRzEQASBI+izhsl0/CUgbJgaSF/6ibCABkyv8A2U50VkKtyLQAQIYmkJikRgnIVPIP pP4uPW8sjRJe5nPqWSOc2WKCsPKztBx/985K+91RRvvM9sp2wpnhtLCynZZFFTOkvTKE1pEEd80Q qjfpHcTmeCxL8STC+WSmK/gkcwZCM8NFZppvsQV5XApA6FPNn+Pr3ligxQxrFhOe1Hmn1PuWUnwL aqzMbK9sJ5wZTnu8ArTMDLdX9lZSjdiEPPCQCRmaJSzrgzw2x2NZiicRziczXcEnmRNSz5YIu8i0 7eZbbAGZcICZ3rc4NP8o5401lfCkzjtpiG+/O8oTDhTaJaXaCWeG0x6vAC0zw+2VvZXULfyccGZ4 UmjW8TU2xAL7JCxlQbJnEc4n0y6xwD5L1LMlwi4y/Xb5JFkyjTCVB4KP/yJj/x0LkBS8k2eN0hwJ jJIjqH6j7kfRU95UzHasBYGf8GCaQWONXHrUTZBsB6OM3IQD1EqodQftTOQOyE1UltCihFr38b3h nDT+H2YiACRDfA1i+bTAJHgVJRCbic95hPPJtEssMAleRW/UeqNuG2E9mZD2SbJkGmSGEvj4LzLq dyxPnvJOe2NYCfNu6lPMuNM3SkxSo/tYLw0JZbgoNFsIZ7ZMe7wRVPaGqRYetAjhDUSLebm9Xg8Z Dqk3DufBDZD1w+rZEmFXy/a6SVgKmIkYgeDjv8jve2P54OPMuJO6vHw20JD2fAI5Ji8r2wlntkx7 vBGgnYaQeXfF3Xoh3xUOaTHDGiOfH7aHQ8LKeTy4AbJ+WD1bIuxq2T7E9IFANX+O/d9YLSbwZliw nhl3UkvnNI+05xPI8bKSukU4M5zWuTFsvzSpgAjb27F6BP7TCE0QVoZYyk8L28kEYeU8HtwAOeOw lkXzTB8IVPPnGPvGwhCjYpbQooRakanCARNZQPIjhDd03hm2y6cHqbtQL6RhJgLgJaXaCWfKJ2FZ A84ttDNhDgIAGZolJGuo1YxvodgwBwGBGqBWhM9aTC2Q8klYyiA5nHydx0wEADLlf4BsJzoroVZk WgAg+00PUn+Xx2+sw+FwOByWct5Yh8PhcPgO6I11OBwOh8OenDfW4XA4HL6De28s/FqmwpH7uSOE 5q8H39pQ1/mqR6ATP/SQdff87bpmj0Va4dBEM9r2JncAiis0luWgUVBdRuuqlVrxE839PBIxgRSh uQa04Sea+wmlIGfQOb+l3dcgFiB/GTfeWPoYsgehrvNV/6xUa/JzXLDiFnSPyTzox0ZZsBJbasEk bL4Fk7D5FoRQluQlVE8ShCaBGkF1M9ZlQQkrsKAFX4xYgCQqKQKVQK0qpUrzLegnH5U7t2hpt5o8 +GW0vrHw/YFaCbUSJUdQnVBrDgtW3ILugQRqDbqZhpCcDa0jORCaTHIgNJmkh1IkL6F6kkLu5KAG qNUGtZD0UIpkCV+GGMDx5H7uAPMtuCSsJJPkY/I5uXOLy3YrsACQ/B10/a2gSQuM3BFC04MCT+iX TI3eoGwr9LKEWm9TxVNoCMnZ0DqSA6HJJAdCk0l6KEXyEqqvyxCrsaAdaiHpoRTJkLCm0YQD1Ep4 B7EHfo6mHWaiQCDpQcoT+qGTm0Lol0wLKDbMtACQ/B08f2OVYpA7QmgSvgYxgCOoTqjluizYELvN AkDyGTSE5GxoHcmB0GSSA6HJJD1IeTTRjLa9Ufenr1aGz/q4EWoh6aEUyZCwpseEA7z0WcQEUgJJ AY5A0oOUQFKAI5i0wIAjeInYgAnUykwLPN70sUDyd7D1GwuQAwnUcjUWbAWuErxELJB8Bg0hORta R3IgNJnkQGgySQ9SQK07UCNJEJrAp3zcCLWQ9FCKZE6pIPdz55KwJTRDUAnUqrZTCjLEsqgE5JhE kIMyQ92EWm/IrMvfQe8bi0BKIAlCk8hryIEEarkaC/YhP4kcks+gISRnQ+tIDoQmkxwITSbpsZQF t6AukiA0AVKE5hqgepIeSpHMKRXkfu5cEraEZggqgVrVdkpBArUcuU8OJFCrOtNMCwxy6vJ30PXv WEbu544QmkReQw4kUMvVWEDxpyjdYL4F/dgoC1ZiSy2YhM23YBI234IQn/VxI9QCCdQq1KhwlPw6 1mWBQY5JC0pUCihF0uNTPhYggVrVyT4WTOZBCGUhgVqFUYiN3MwdAaagOuGdPDbMtOCX0frGwvf3 aCLhHcSekhkSZmEaFVNQnVDrc+gdP6EU5BB04oe+uO6ev13X7LGICki2gBajYgqqE2q9Cc0W0Cio TqiVUKtQmRPWwPSYiQIPfJA7QsUUVCdyR4ApqHZODhWYRGAgK6hOkAR5GchNc1LHC5MWEPAF1b+L e79jHQ6Hj7Ps59GyRSGd2zvbD3ty3liHw+Fw+A7OG+twOBwO38F5Yx0Oh8PhO1jxxsJfKHs08TfQ 75xQK5E7/cyY2c6y7bstQhlQqw+d5dBEgZaaCu3t7ZW3uDWTitNFL1RHaIUj9+GE1LONYIugej7h Lm+mc9bdM4QP/I419Rnt9gdA95jMg35mzGxn2fbdFlF2xlWNBzxb3d7euaiETGsfSMXtjR50UW9l 1LMtHj/B4tLY/nUgnJNvH7VuDavfWLOfzm5Pn+6BDM1OZsxsZ9n2DRfNuwHU57ffGdLe3rmoBOaE 03KTisOuS0rtlWnPFnnCCf1j6+TzzaHU7EsGsvSNdflcUCCfAKagOqFWZKpIwNkNHEbnDbl2xsx2 lm3fcNG8G4TL4e13hrS3dy6qk08TB6h2NXnQTjgQVKaVuiQ21CqbGr1BAVArETr4BDAF1e9sxTTM oVReuS3r3ljyUIDqAr4AMbVUTB9sSOnIITfPmNnOsu17LpKsodYgLgdSwd0D2ts7F9UJp3kzjBHI J4BZQet+jjLUirCsL6MWyJJpwAckjdz3DmJyKqZBWY0SJHdmu3/HyrPhww1NH2yFXOUPoyNJPmPG zHaWbd9/0cCTWkY9vhO0t3cuqnM5zRdYLEHoX4JKqq+0SwqofpObJUk+CE0h9y8dyNAElZRAcmfO G2s6+Uml43uYMbOdZdv3XzTwpJZRj+8E7e2di+pcTpMCAiaygGSFu+2WCmvELBWUfBCaQu7XHYkh vSl4WUkJJHdmxRvr1tPJs2F7aab3qeYjlG4ID+5kxsx2lm3fbRFlR11VmVPa+Gx1pX3sogrhwNKW 0hkVGabq7Z5wVNgemj7weLMUg1I7QGyfIGVUet+oZ7dl0e9Yr4f3Rq0CYQEagVrlmWrt8cegpzg0 8U6pGMSMme0s277bIpQBtbopjcIWQXUid24RtsMUVCdypxMMNNQtbAfeRA1QK6HWVaXqhFoRlDWZ +hQ4guqEWtkEA2UCSQBT8HGIFaS+F2QiIFLhxeTd+MDfCh4Ohx6W/ZT57I+zzu1f97O4h7/zZc8b 63A4HL6b88Y6HA6Hw2EvzhvrcDgcDt9B6xtLfus01Eqo9TZVOHIfzt9Bv3ZCrUTu9PN4Jho9mniT O0JoXpLGK2oVTEGthspGtDOh1tV2FWVQBtTqQ2c5NFGgpaZCSztqPJoYgZ+G4Z7chwPUqt6jFY6S eWhBn5cj9+EMp+mNRetNXp6FglL7DKYOf0Dpu+dBPwNn0gSR+czQvIRaIEPTB0apspGwvTQzD0JK 7T3cGtJ4Z4ln7c92hcgoPy2cTKbJsDinpaxx1OZM+hb1schSzaxLHr+xLg+ygrB9ElOHPyD87jMe yMCZ4agWs4XO4WFlOy2LKmZIJfWY9pntd4Y8a7+7pQJG+YHhcDLzrpzLmZ7Lgm9h/RexjbR60iW3 31gSQ3ozx2cp9pJACjUCTEF1Qq3IVJGAsxs4jM4bcu2omaU53s9NCRCbU4IKwvrKqJb2Cr5e4rAd JqXCSlBJPcZuADBDKFsvznnQfndFC34mYvkE3jQgyfS8OhMmc9PInRw0CojJFLyDAI7gY4Ek8ep/ Yw4C4H2j5AC1Et5BAKeCFed4n2pKLZ3c/ncsxP4TvIreqOVM1a6xhM+G9RXTBxtSOnLIzUNmShcw iUBoMf1nBSkw1HKYiSBVvYApqE6odQftfA+HaZhDqbzSI1lDrT5oVGUspSqVIXfbpQCoHoQfSPMt hg/M8T5MwztU4GOBZA71QnpT8CYVlCoJSxl3TR8YlXb/iYCAL/jYQI2g+ucEtUbT+sby4Bo6y8dG u2nkWXIgQ9MHWyFX+cPoSJLPGDsT7X6IxRXTf5agrJcS16V9GiTvQvNJapQgWaG9sp3KzMd3gsft dxfVqUxDKrxTPr3v4zp3u6gGUj4Jn7JPHwCShGTr9SZTIY8KHQImfdap14RzWsY+oOuNBQnC+9pN I8+Gi0LTB/uQn1Q6voexM9Eun0TFpM8SlDWZd4WVpfZnWHs+5/GizpNCKjMf3wket99dVKcyDanw ztBswVe2dFE9pDcNn7ICqgwbCamxMl/vfUAOZYXcEWD6zzr1mnBOy9gH3H5j2R3hfZdH5w5x2QIZ mj4QqOYjlG4ID+6kZya15BPCmbTRf5agbKWlpTJsbMR6S0MuCwBl68WN1GeW5LPVlXbvUPbZrhKX i9pNw8tSivwKUgkQ26eRp6zAV0rsJUEpk6nphZn4NEx6v1KZf9YJhxjhnJaxD3jy71iGWgm1rkzV ZcIa9AK1CqagVsOuBegpDk28UyoG0TMTvUAtR9302bDSIwVG7oDchyOoTqh1B+0sDASaeKdUlEEZ UKsbHZdQK6FWZKq4T9gOU1BdPqkHHfcmN+EIqhNqlU9Sq6FdoztYVxqmmINAoBgghhmCMqDWT8xH DYAD1HKm6oQ5CAQf56Smf6gbzRRUJ9QazZO/FTwcDh9k3o8DYtmiGUz8obn2sdC6r/5D6ee8sQ6H w+EG698ZstFQ669y3liHw+Fw+A7OG+twOBwO38G9N1bpd9Lc987rV9mfaOJvoN85oVYid/qZMbOd Zdt3W4QyoNYgLgdiqUcTd2hvbKlEjadkAtXVsVrh0ETbSQLKgFoFczidw1vareb1Td7A+WXceGOV nkLu546nkupn6vAH0D0m86CfGTPbWbZ9t0WUHXiVjLo77cF2a7nsba/0hMXPRhl5e30OZSFDs598 TufklnbUUGXn3j1pfWOFT0TI/VIlKPmjmD3/LnRP+HCG3DxjZjvLtm+4aNINGHtr+INLqKUyob3S E5aZWR9SypbaK9PCyvb2W+RzOidftlsBVXbu3ZOuvxUsPSkhfFiXTxAF8glgCqoTakWmigSc3cBh dN6Qa2fMbGfZ9g0XzbtBaB/+7IzHX7NlXVjjzfo6oPqNdyibF5dAZXu71QOYgupEyREQwxRgCqoT ahVmIhB8bISmUPK/mudvrPpzDB2guoAvQEwtFdMHG1I6csjNM2a2s2z7noska6g1iPaBz1ZTV2VI eyWQAqA6odbbRABHgGmEDjCJAJAs4ctes96oFUEFiL0jmCRfEMebeYEAk1JkVhpzSv63s+6NZdQf 5eUoyND0wVbIVf4wOpLkM2bMbGfZ9v0XjT2pcdrjpe1fs72SCCthyqfP+rgOKqn+sl0KfA3Vk/SE lfJJ+KyHHF/p8SkPsoJqR8kM/d9B1xuL0ESCpKeSEvJsODk0fbAP+Uml43uYMbOdZdv3XzT2pMZp j5e2f832SiKshNk581Z7nm1vDytL9bnf0h6awMw82+L8Mrr+HcuoPzjK1p9pfZQAWZrpfar5CKUb woM7mTGznWXbd1tE2bFXhdPGbrT2fE5pUX1j2NVuGl6WUnlgVNoBmWENCCtL7d63ytCEFFKeTSE3 SzHInd9H6xtLnoVH3TfeQYGRm3BKhAVoBGqVZ6p1tWgNeopDE++UikHMmNnOsu27LUIZUKsbHfdG XeerTo5GT6GBAKagOpE7ISgDat0xBbWaK1W8gSmQNHIfTghlTaY+BQ5Qy5XlpqD6nSVTMAcBKPnC q+cnmvhF3Psd63A4fJxlP4k++yOvc/uv/Hl9OG+sw+FwOHwH5411OBwOh+/gvLEOh8Ph8B30vrH+ e0PSgC+Q/DvgiwO1ErnTz4yZ7SzbvtUi1BjqDqJxYOfq9vb2ykYwEKgVoRWO3IdTQosSat3ZrtFa /N5042fO2IquN1b+BEvP1PzZD323P1S6J38OAw+eMbOdZds3XOQLBl4lo1qmWU1LcU57e+eiHJrT PhaV7e1h5eP2ZdjePPizPH9jhc+uxZz60Hf7Ew2/+4wHMmNmO8u277nIZ0edhDmX06jg7vb29s5F IfWZpRXmN9YLYeXj9mXcvfMvMOWNJZ/AmwZJD1KvzgRMQXVCrchUkYCzGziMzhty7YyZ7Szbvuci nx170uW0W3fmtLd3LmrBz5QYqH7jHcrmxSVQSaO8JKhSo3cXMAeBQLFhjvdhCqrfWfs0SP41et9Y 8gnMtFhA7B2BJNHYHpo+2JDSkUNunjGznWXb91zks2NPupx2686c9vbORZfkA0MHqHaOoNYVvhKN AmKYOZbyNVSfD6ECwyp9gZmQQsqzKZD8a3S9sfyzC58jTEqFlUaeDdtLM/P2HZCr/GF0JMlnzJjZ zrLtey7y2bEnXU67dWdOe3vnogoy6u401FPX5ZDXmnJNPQVUv8lNSP8JXnUOOEiBu+afZdjfCobP 8cETz7Nhe2lm3v5x8pNKx/cwY2Y7y7bvuchnx550Oe3WnTnt7Z2LSjybg65bJ10uqhRYKqwRkwr8 pw+AZb1vJiSomH+WwW+s0sPNgxJ5QTgzNH0gUM1HKN0QHtzJjJntLNu+4SJfMPaqcBqZJp+trrSP XZRTn+Oz4SWhaVTac+oF4Shqgcw/fSBIDGmfICXjSsQU/Fmev7GE9EgVtQqmkDshYQ16gVpXiwTV H0VPcWjinVIxiBkz21m2fatFqDHU7UbHvVHX+aoTuXOLsB2moDqROz1gmkcT0XbVCbUKpqDW21Th IB+yBBWYTK0KHAGxd4RU8gKxfeakqheIYQpm/nG63liHw2E9y35yffZHZOf2zX++n9fPM84b63A4 HFZz3ljPOG+sw+FwOHwH5411OBwOh+/g3hur9Jts7ntHYkITfwP9zgm1ErnTz4yZ7SzbvtsilAG1 BtE4sHN1e3t7ZSMYCNSK0AqHJhIkQ9AF1ErkznA657e05zWzv9SnuPHGkkcQPoXcJ4eyU1m5qwW6 x2Qe9DNjZjvLtu+2iLIDr5JRLdOspqU4p729c1EOzWkf6yslvmykApN50E8+qnN4SzvViGzp+kZa 31j4/vlTyP2Ss4aVu1qge/KHIwy5ecbMdpZt33DRpBsw9nJ4+50h7e2di0LqM0srvI+4VGmEk0Oz n3xO5+TL9vCLdC7dlq6/FTSZPx3vIJZPADMEWZQJMAXVCbUiU0UCzm7gMDpvyLUzZrazbPuGi+bd IFwOb78zpL29c1GIHyJxLgXVb3JHCE2PL3gNTdKbAkmP1QOYgupEyREQwxRgCqoTahVmIhB8bIQF YeUv4PkbqxQDypLUKCKvpPqK6YMNKR055OYZM9tZtn3PRZI11BrE5UAquHtAe3vnohIyByCGCUgK qfCF6je5k4NGAbF9GiQ9rzaXRewdwST5gjjezAsEmJQis9IISvFvYsUbi6g/ystRkKHpg62Qq/xh dCTJZ8yY2c6y7fsvGnvS5bTHd4L29s5FLbTP7DwG9e1Dwkr5JHzWQ46v9PiUB1lBtYNML8P6X0DX G4vQRIKkp5IS8mw4OTR9sA/5SaXje5gxs51l2/dfNPaky2mP7wTt7Z2LWmif2XkM6tuHhJWl+txv aQ9NYGaezYcQmvhFdP07lpH73qFs/TnWRwmQpZnep5qPULohPLiTGTPbWbZ9t0WUHXtVOK208dnq SvvYRXXq20uXgPCe0BTCsaViQFnI0PSBYJWhCSmkPJtCbpbinHr2e2l9Y8n396j7xjsoMHITTomw AI1ArfJMta4WrUFPcWjinVIxiBkz21m2fbdFKANqdaPj3qjrfNWJ3LlF2A5TUJ3InU4wUFD9Rl3n q06o9dMU1K22q34TmgQVmEytChyglivLTUH1O0umYA4CUPKJevZ7ufc71uFw+DjLfhh99qde5/bf +iP7j3PeWIfD4XD4Ds4b63A4HA7fwXljHQ6Hw+E74DfWfxm5D0dQnVArQQ6kRxN/A/3OCbUSudPP jJntLNu+2yKUAbUG0Tiwc3V7e3tlOy0zUePRxJvc8aDFk/twQurZZ4yd6ae9vkzb8PbKfbj4HQvf h75VxawHC1i5qwW6Z+rDmTGznWXbd1tE2YFXyaiWaVbTUpzT3t65KKRx5mW2XkCgmFoqE24Nb2Ts TJuWByXaK7ei9sYqfSXIx+ZUVu5qoeWBDLl5xsx2lm3fcNGkGzD2cnj7nSHt7Z2LQuozvaysQ6pS QFgltVyuGMvAmY3fyMt65c4U31iV7xCmYIYPwj5BysQgizIBpqA6oVZkqkjA2Q0cRucNuXbGzHaW bd9w0bwbhMvh7XeGtLd3LgqpzJQYmMxNwWJvVqiUNabCjRQb5njfm4Biwxzvw/SYSVkvX50JkwgA yZ2J31jpq71Q7aiblIWUT+/7OCevpPqK6YMNKR055OYZM9tZtn3PRZI11BrE5UAquHtAe3vnopD6 TC8lJmmfwMclXiMSqh2haVjWl4Uxzak0VlLGrRqhkhLaK3em6d+xgMT5FyOTCkiC0DTybDgzNH2w FXKVP4yOJPmMGTPbWbZ9/0VjT7qc9vhO0N7euSjk8UxU+vpb91DjZS9qBNUJSP/pA1DyBXGA6oRa DvMREOTXpae9cjda31jhV8rNlgcRmkbjzND0wT7kJ5WO72HGzHaWbd9/0diTLqc9vhO0t3cuCnk8 E5XySSB7iVU2toT1iP2nD0DJF8JUXgYa/br0tFfuBr+xwm8Sfp/SlzQ/D0CpEeTZsL000/tU8xFK N4QHdzJjZjvLtu+2iLJjrwqnlTY+W11pH7sopHE7ZevF4LI9bykRjvJDyDRKvuCdB+1C3cyz5FQq dyb4HUu+gJE7oGQCkgIcoFaBsACNQK3yTLWuFq1BT3Fo4p1SMYgZM9tZtn23RSgDanWj496o63zV idy5RdgOU1CdyJ1+wpkwBdXOEdRykIkyQXXUrsIBP4dSJhHkWUOtrEYgx+Sr7Q0cwcdGaAqplVMw BdWJ3Nmfi78VPBwOu7Hsp8xnf5x1bv+6n8Wz+R0P5LyxDofD4fAdnDfW4XA4HL6D88Y6HA6Hw3fA b6z/MjTxTql4E5og9EvFv5j0hBS1ErnTz+OZaPRo4k2L007a8IKkUTLJh3MXba5uB6qvFmlRQq0R tAxEjUcTd2hsRBlQ6z7Ui2lArTKlsvZeoNbN7QdDH5kj9+EM5+J3LFucB0JoAnEazbHMnn8Xusdk HvQzcCZNEHnptHPZGBbApNSDG/KW0pDG4f0nhdicWwMfbG9cRNkHiwTp8o00hCRh2byLnJy8xT6N yyFfwaRvUR+78nnW3li2Mjylcl+lgMzhzJ5/l5aHMOTmgTPDUd7MnXYuu8ICMyl794b6cE/75Ls3 tEAzG1c8uKR90bOTPGjxjfWZLZUIKJsTtofmt7P+W9jGNc+z+Mby+8JTSvflgRCaOcjKJ4ApqE6o FZkqEnB2A4fReUOuHTWzNCcf6B2JIb0ZUi8Is5WWy3VEZb58Am+20F7ZDs1sWfHsjAeLwLN1QqXR pyQGJhGAurwE9beGSBYgJlPwDgI4go8FksSr/405CID3jZID1Ep4BwGcClac432qKbV0Er+xXgcm TCIAkJemxaFZIi+mlorpgw0pHTnk5iEzpQuYRCD4GORZ/1nCagBMI3eE0BRKfgW0yCcw02IBsX2C lCmiRQm1+qA5l2PT5heqm6GWxgkPFhml3tz3DmXrsg6NNdSK8Fkr9qbgTSooVRKWMu6aPjAq7f4T AQFf8LGBGkH1zwlqjabp37FofaNpcWiWyAvIgQxNH2yFXOUPoyNJPmPsTLT7IfnAPJt35UjWF5Ri o2SG/iXUGA6BmQovKkPaKyvQkHnb7y6SgsuaOnl7y0wqqMsSrzWukrpIesJK+SR8yj59AEgSkq3X m0yFPCp0CJj0WadeE85pGfuA8W8somSWyLPkQIamD/YhP6l0fA9jZ6JdPglkgZeI/WeJyyFEbtbn 16lsN2C2VIa0V1ZYtv3WorvDQ25tNOpdLUPymvYhPiUxpDcNn7ICqgwbCamxMl/vfUAOZYXcEWD6 zzr1mnBOy9gH8BurtDUPhNA02k1PXkAOZGj6QKCaj1C6ITy4k56Z1JJPqDuI/WcJypoMu3KzPvyS cHu7GdJeeQubkw/0Tv/2Z4se0z6TsibzrnCONy8LhLDGkCxAbJ9GnrICXymxlwSlTKamF2bi0zDp /Upl/lknHGKEc1rGPiD4HUs2GWolckcITRD6pWKj1GWoVTAFta4WrUFPcWjinVIxiJ6Z6AVqObyJ GgMOUoKPQ1KTolahKzdT0w800Yy2JdS6Y4ZoUUKtEYQDYQqqR2wPe2EKJA347Wjbm9wRUCmo/rml 5BjqZu0qHLkPpwUrRiMwB4FAMUAMMwRlQK2fmI8aAAeo5UzVCXMQCD7OSU3/UDeaKahOqDWai78V PBwOuzHvxwGxbFFI5/aJPzTXPhZa99k/lI9z3liHw+Fwg/XvDNloqPVXOW+sw+FwOHwH5411OBwO h+9g6Rvrb/5Ki9/lgVqJ3Onn1sy8MmyHKah2tJuN+N7Xyp9oonrSWBq3oAyoNYL2ge2VIe3t7ZXt NM5EGVArkTs5qPGUzMPmrHtjrflvYrf/7Ogek3nQz62ZUkNlJr1PNZ5Xf5YNzUbqvZaq1IylcSNl R53XuF1orwxZtiikcSZl865b7aDektNen1fe3XUoseiNhT+wBX9su/2XQfeEz2HIzbdm5meE7ZUh YcFlV4V6r/nPhj+AFlX2zjjp8fa7xyxbFFKf6WWYqrd7wlSlfjgrd/1u9vpbQRTIJ4ApqE6oFZkq EnB2A4fReUOufTDT14TtpSHmhxNKXS2EveGW2dCiyt4ZJz3efveYZYtCKjMlBqp/Ap+ypWLB6kHF LJHXQMIXYAokBThArcNTtvt3LF+DmLoqpg82pHTkkJsfzPQ1Ybt9gpSJu0LzAXmvOMBkbs6Ahtd3 pVsUtfqgOZWx7ZUhyxaF1GeWVpjfWC9IymcRh2YFKkjdcbuPQe4cnrH1GwuQAxmaPtgKucofRkeS fMaDmZcnyaf3zYQULA7NB1R6kZJPX+PjsdDk9kVDTmrf/vhOsGxRyN2ZUuBrqJ5khbDysr2+zst8 1OXwQyPnjTWd/KTS8T08mOlrwvaSSZTMB1QakaKCx4suebxoyEnt2x/fCZYtCrk1M88+PimsvGyv r/MyH3U5/NDIb35jUc1HKN0QHtzJ3ZlUlreXCozcEUKzEd8bbg/NSdjw+pZJJ1W2lzY+W71sUUjj 9tLGZ+2QoVmhXu9lPqqePbSz6I0lf0gedSPCLLqAWgVTUGuP/yz0FIcm3ikVg2iciTJD3agdDlDL 0W5ekjb8IzfhCKoTak2jcQvKgFojCAfCFFQncucWYTtMQXUid/oJZ8IUSBrwBZIApqD65wS1CmaO VrwxEwGATPl/IAXUqi46XLL0d6zD4dDPsp96n/3x2rn9vBt+JeeNdTgcDofv4LyxDofD4fAdnDfW 4XA4HL6DD/yfF2r9GfRrJ9RK5E4/M2a2s2z7botQBtQaQfvA9sqQ9vb2ynbaZ4aVoRlClZAeTWRU UkR75WPCFQv2bsKKNxY9zakPd7c/udJ3z4N+ZsxsZ9n23RZRdtRVjduF9sqQZYtCOrf3tF+2GKXK 3G+f+ZhwxYK9m3DeWHMJv/uMBzJjZjvLtm+4aMYNj7ffPWbZopD6TC/DVL3d09JeoVSZ++0zHxOu WLB3Ez7w71iVh4uUfAKYguqEWpGpIgFnN3AYnTfk2hkz21m2fcNFM254vP3uMcsWhVRmSgxMIgCQ oRlSaZdPkDIxPmtxalLgCIhhChVTUJ1Q68pEXDF/PavfWJdP1heEfxgV0wcbUjpyyM0zZrazbPue iyRrqNUHzamMba8MWbYopD7TyzBVb/eU2r3vY8JSVJO3iONNi3PTOwJJkFdKXDH/AuveWI2PNa8h BzI0fbAVcpU/jI4k+YwZM9tZtn3/RUNOat/++E6wbFFI5/bOdqLeDlS/uXRMhpVE6MNBClTMv8Ci N1b7A80rwz+b0PTBPuQnlY7vYcbMdpZt33/RkJPatz++EyxbFNK5vbOdaGm/nFMquKwEYXu7+Rf4 wP95UScvDv9sQtMHAtV8hNIN4cGdzJjZzrLtuy2i7KirKttLG5+tXrYopHN7T3upIMen6jENMUm+ EFZ6U+K75l9g0RuL0EREmEUXUKtgCmrt8Ueopzg08U6pGMSMme0s277bIpQBtUYQDoQpqE7kzi3C dpiC6kTu9BPOhCmoTuSOUDEF1YmSA9SKoKyXqfWFSQSg5INX2xu1fg7E5y3z17P6/7w4HA6dLPvx 9Nmfg53b/84P8T/FeWMdDofD4Ts4b6zD4XA4fAfnjXU4HA6H72DdG+u/N6oPE/jsE162fbdFKANq jaB9YHtlSHt7e2U77TPDytAkUOPRxJxvtDPf/t0XvbGWPZdv+QOYcafN/MhDWLZ9t0WUHXVV43ah vTJk2aKQzu3t7Z6861a753FjidLAUYvyrzz8K0xlxRtr5RP5lqc//E4auPg5LNu+4aIZNzzefveY ZYtC6jO9DFP19hJW9qx9NlPP2Py7t7DXGwuV8glgCqoTakWmigScj4NLcJJgpgGnHxo1cHILy7Zv uGjGDY+33z1m2aKQykyJgUkEADI06/ia9nZJIUs15ntgCoj9J3gVJVQnSg7IHQEmMMf7MD1mUjYs 3pN1byz5BDBL+ALE1FIxfbAP/qR5d9LAxc9h2fY9F0nWUKsPmlMZ214ZsmxRSH2ml2Gq3p4jBcAk AkDSg5T/NCqyJTbMDLMC+aGUT+/7WGhMbc6iN5Z/IvWnk2fJgQxNH+xDeNLwO0sPZA3Ltu+/aMhJ 7dsf3wmWLQrp3N7eTtxt9/X1Li9LsSGmx0wEBPmhrNS0tH8FH/hbwfrTybNhe2lm3v5xwpOG31l6 IGtYtn3/RUNOat/++E6wbFFI5/b2duJuu6+/7BIHqE6QFEoFeSWoD4Ss1LS0fwW/+Y1FNZ8iPGPG nTbnI1982fbdFlF21FWV7aWNz1YvWxTSub2xnbJ5V97uQdZ/GnVp5L53JDZJvkbZhFCWasgH9ey2 rHhjCfJQDLUKhAVoBGqVZ6q1zR9D6RIcKagewfCBt1i2fbdFKANqjSAcCFNQncidW4TtMAXVidzp J5wJU1CdyB2hYgqqnSOolcidHF9gcer7B0xBdUKtnxMM1AiIYQowBZIApqA6YQ4CUPKNV2chtS2L 3liHw2EUy37KfPbHWef2jxxPSz/7AH8l5411OBwOw5C3lKHWYRznjXU4HA6H7+C8sQ6Hw+HwHax4 Y+lvyA5NHEbz2ce7bPtui1AG1BpB+8D2ypD29vbKdtpnhpWhGRJWhuYvhr7s1333D/yONfUZfcsf wIw7beZHHsKy7bstouyoqxq3C+2VIcsWhXRuX9Ze4nFjidLAUYv8HIlHjV3G6jfW7Af0LX8Aw++k gYufw7LtGy6accPj7XePWbYopD7TyzBVb/d0tq9k6hl+ePgQ9mfpG+vy6dhDBDAF1Qm1IlNFAs7H wSU4STDTgNMPjRo4uYVl2zdcNOOGx9vvHrNsUUhlpsTAJAIAGZoh/e3IUo35HpgCYv8JXkUJ1YmS A3JHgAnM8T5MT26GZTuz1xtL8DWIqati+mAf/Enz7qSBi5/Dsu17LpKsoVYfNKcytr0yZNmikPpM L8NUvd0zpL2ly8uW2DAzzArkh1I+ve9jgSQIzZ1Z98ZqfDR5WfjcQ9MH+xCeNPzO0gNZw7Lt+y8a clL79sd3gmWLQjq3L25v6fKyFBtiesxEQJAfykoNpYySvy3njTWd8KThd5YeyBqWbd9/0ZCT2rc/ vhMsWxTSuX1xe2OXOEB1gqRQKsgrQX0gZKWGUkbJ35ZFb6z255JXkgMZmj4QqOZThGfMuNPmfOSL L9u+2yLKjrqqsr208dnqZYtCOrfPa/cg6z+NujRy3zsSmyRfo2xCKEs15HsqqT35gjeWIKahVsEU 1NrmT6J0CY4UVI9g+MBbLNu+2yKUAbVGEA6EKahO5M4twnaYgupE7vQTzoQpqE7kjlAxBdWJ3BFC k/AFFqe+f8AUVCfU+jnBQI2AGKYAUyAJYAqqE+YgACUfvNoc6m7P0v/z4nA49LPs58tnf5B1bv/I 8bT0sw/wV3LeWIfD4TAMeUsZah3Gcd5Yh8PhcPgOzhvrcDgcDt/Buv/zwlDrz6BfO6FWInf6mTGz nWXbd1uEMqDWCNoHtleGtLe3V7bTPjOsDM0Kvhi9QK2IerYRbBFUzyfcRebKe4aw4o218hnt9gdQ +u550M+Mme0s277bIsqOuqpxu9BeGbJsUUjn9vZ2IGWlFpKeSqoRP6F0gNG/DoRz6JKwZmfOG2su 4Xef8UBmzGxn2fYNF8244fH2u8csWxRSn+llmKq351BXe/vl5EvCCf1j6+TzvYN49g3DWf3Gkrjy jJBCjQBTUJ1QKzJVJODsBg6j84ZcO2NmO8u2b7hoxg2Pt989ZtmikMpMiYFJBAAyNEvko9rbfYpi Q62yqdEbFAC1EqGDTwBTUP3OVkyjxdmc1f+OhRhmiM+G9RXTBxtSOnLIzTNmtrNs+56LJGuo1QfN qYxtrwxZtiikPtPLMFVv95RGSWyoFWFZX0YtkCXTgA9IGrnvHcTkVEyDJAjNnVn0xvLUn1GeDZ97 aPpgK+QqfxgdSfIZM2a2s2z7/ouGnNS+/fGdYNmikM7tz9otvtUOVL/JzZIkH4SmkPuXDmRognwC KPnbct5Y08lPKh3fw4yZ7Szbvv+iISe1b398J1i2KKRz+612AiaygKTHUmGNmKWCkg9CU8j9uiMx pDcFLylllPxtWf3GunxAeQE5kKHpA4FqPkLphvDgTmbMbGfZ9t0WUXbUVZXtpY3PVi9bFNK5vb3d KLWU6gWfqreHpg883izFoNQOENsnSBmV3icqqT35wL9j1Qlr0AvUKpiCWnv8SegpDk28UyoGMWNm O8u277YIZUCtEYQDYQqqE7lzi7AdpqA6kTv9hDNhCqoTuSNUTEG1w5uoAWpFUNZk6lPgCKoTamUT DJQJJAFMwcchVpD6XpCJwJOq/qHu9nzgbwUPh0MPy36+fPYHWef2L/op3M/f+bLnjXU4HA7fzXlj HQ6Hw+GwF+eNdTgcDofvYNYbK/8tVZy/86vrp/jsQ162fbdFKANqjaB9YHtlSHt7e2U77TPDytAk UOMpmb8e+5r4ygDOVzDljZU/BZPkD2f2/FHMuHPZQw5Ztn23RZQddVXjdqG9MmTZopDO7e3tnrD4 1gTjWVeF0sBRizCHpg3/FvMY/8bKn8jKp/Mtj374nSsfcs6y7RsumnHD4+13j1m2KKQ+08swVW8v EZY19i5g6iU2nLbs8/UvWfG3gu1PByn5BDAF1Qm1IlNFAs7HwSU4STDTgNMPjRo4uYVl2zdcNOOG x9vvHrNsUUhlpsTAJAIAGZp1wprLRilADVWa74EpIPaf4FWUUJ0oOSB3BJjAHO/D9ISmUPI3ZK83 lpA3hu2h6YN98CfNu5MGLn4Oy7bvuUiyhlp90JzK2PbKkGWLQuozvQxT9fYcKQCq3+QOgQL/aVRk S2yYGWYF8kMpn973sUDSKPl7svUbC4TtpZl5+8cJTxp+Z+mBrGHZ9v0XDTmpffvjO8GyRSGd29vb CV/Z0uXXUX1FlmJDTI+ZCAjyQ1mpoRQQM/R35ryxphOeNPzO0gNZw7Lt+y8aclL79sd3gmWLQjq3 t7cTvrKly6+j+rxdHKA6QVIoFeSVoD4QslJDKSF3voIVbyzB5OVjunyykKHpA4FqPkV4xow7bc5H vviy7bstouyoqyrbSxufrV62KKRze2M7ZStdISjzn0ZdGrnvHYlNkq9RNiGUpRryhdz5Fsa/seRZ eNR9+yrKhDXoBWoVTEGthl1rKF2CIwXVIxg+8BbLtu+2CGVArRGEA2EKqhO5c4uwHaagOpE7/YQz YQqqE7kjVExBtXMEtZKpUZWw5TXIAVNQnVCrsAg1AmKYAkyBJIApqE6YgwCUfOHV8xNNbM+s37EO h8Mklv18+ewPss7tHzmeln72Af5KzhvrcDgchiFvKUOtwzjOG+twOBwO38F5Yx0Oh8PhO5j1xqLf iPE7MlDrz6BfO6FWInf6mTGznWXbd1uEMqDWCNoHtleGtLe3V7bTPjOsDE0CNZ7chxNSzzaCLYLq +YS7zEy3KHC+gilvLHoK9ERIjmXq8AeUvnse9DNjZjvLtu+2iLKjrmrcLrRXhixbFNK5vb3dg2Jq qUy4NTzET7C4NLZ/HQjnwKTUqI0LGP/Gyp/Iyqez26MPv/uMBzJjZjvLtm+4aMYNj7ffPWbZopD6 TC/DVL29hJW1tzdOrhBO6B9bJ59vDqVmXzKQRX8r6LlMySeAKahOqBWZKhJwdgOH0XlDrp0xs51l 2zdcNOOGx9vvHrNsUUhlpsTAJAIAGZp1KjWNKYoNtcqmRm9QANRKhA4+AUxB9TtbMY3cASV/Q1a/ sS4fjS9ATC0V0wcbUjpyyM0zZrazbPueiyRrqNUHzamMba8MWbYopD7TyzBVbw8p1dR7LevLqAWy ZBrwAUkj972DmJyKaZA0Sv6erHtjvZ5fw6MJGzVKQIamD7ZCrvKH0ZEknzFjZjvLtu+/aMhJ7dsf 3wmWLQrp3N7eDsICMVsageo3uVmS5IPQFHL/0oEMTZBPEMQM/Z1Z9MZqfy55ZTiqND9v/zj5SaXj e5gxs51l2/dfNOSk9u2P7wTLFoV0bm9vB3nBZQuwsrBezFJByQehKeR+3ZEY0puCl5QScucrWPHG uvVoLp8sZGj6QKCaj1C6ITy4kxkz21m2fbdFlB11VWV7aeOz1csWhXRuf9Bu5E4JX2lxOD80feDx ZikGpXaA2D5Byqj0Psidb2H8Gys9qH/kjoDKkDCLLqBWwRTUqm5Zhp7i0MQ7pWIQM2a2s2z7botQ BtQaQTgQpqA6kTu3CNthCqoTudNPOBOmoDqRO0LFFFQnR6M3KPBoIoNSJlOTAkdQnVArm2CgTCAJ YAo+DrGC1PeCTARGKvmBJrZn1u9Yh8NhEst+vnz2B1nn9i/6KdzP3/my5411OBwO3815Yx0Oh8Ph sBfnjXU4HA6H72DWG8v/lioxoYnDaD77eJdt320RyoBaI2gf2F4Z0t7eXtlO+8ywMjRDwsrQ/MXg y+Jbe5DdnylvrPojmPp0pg4fyIw7beZHHsKy7bstouyoqxq3C+2VIcsWhXRuX9Ze4nFjidLAUYvC OcO/xTzGv7Hw5Wc/9xLf8uiH30kDFz+HZds3XDTjhsfb7x6zbFFIfaaXYare7ulsX8nUM8Lhm3zx Rlb8raBx+WhQIJ8ApqA6oVZkqkjA+Ti4BCcJZhpw+qFRAye3sGz7hotm3PB4+91jli0KqcyUGJhE ACBDM6S/HVmqMd8DU0DsP8GrKKE6UXJA7ggwgTneh+nJzbBsZ9a9sV6PMKG6gC9ATC0V0wf74E+a dycNXPwclm3fc5FkDbX6oDmVse2VIcsWhdRnehmm6u2eIe0tXV62xIaZYVYgP5Ty6X0fCySFVP5C 9Tew9HcsUH9AeZYcyND0wT6EJw2/s/RA1rBs+/6LhpzUvv3xnWDZopDO7YvbW7q8LMWGmB4zERDk h7JSQymint2K88aaTnjS8DtLD2QNy7bvv2jISe3bH98Jli0K6dy+uL2xSxygOkFSKBXklaA+ELJS Qymint2KFW+synPMybNhe2mm96nmU4RnzLjT5nzkiy/bvtsiyo66qrK9tPHZ6mWLQjq3z2v3IOs/ jbo0ct87EpskX6NsQihLNeQLpcr9Gf/Gki/vyU04JcICNAK1yjPVulq0jNIlOFJQPYLhA2+xbPtu i1AG1BpBOBCmoDqRO7cI22EKqhO50084E6agOpE7QsUUVCdyRwhNwhdYnPr+AVNQnVDr5wQDNQJi mAJMgSSAKahOmIMAlHzwanuj1jcw63esw+EwiWU/Yj77s6xz+0eOp6WffYC/kvPGOhwOh2HIW8pQ 6zCO88Y6HA6Hw3dw3liHw+Fw+A5mvbH8b8T4Bdmjib+BfueEWonc6WfGzHaWbd9tEcqAWiNoH9he GdLe3l7ZTvvMsDI0K1gxGj3wcyqpdrBCUD2fcBfMdMgPkN2fKW8segQrH8fKXS3QPSbzoJ8ZM9tZ tn23RZQddVXjdqG9MmTZopDO7e3tQMrutgjtlSX8hMsD+teBcE67uSfj31j48v4RrHwcuz16uid/ OMKQm2fMbGfZ9g0Xzbjh8fa7xyxbFFKf6WWYqrfnUNdlvdFeWSKc0D+2Tj7/I2eMZdHfCuITwAxB FmUCTEF1Qq3IVJGAsxs4jM4bcu2Mme0s277hohk3PN5+95hli0IqMyUGJhEAyNAskY+yIQBmiM9S bKhVNjV6gwKgViJ08AlgCqrf2YpptDibs+7fsVRcPaO8kuorpg82pHTkkJtnzGxn2fY9F0nWUKsP mlMZ214ZsmxRSH2ml2Gq3u4JR0kQ+jmWqtRDlkwDPiBp5L53EJNTMQ2SAmoE1d/AijcWUX9AeZYc yND0wVbIVf4wOpLkM2bMbGfZ9v0XDTmpffvjO8GyRSGd25+1l8rq7UD1m9wsSfJBaAq5f+lAhibI J3jq2a04b6zp5CeVju9hxsx2lm3ff9GQk9q3P74TLFsU0rn9VjuhCUdoAkuVGksFJR+EppD7dUdi SG8KXlKKqGe3Yt2/Yxl3n13YXprpfar5CKUbwoM7mTGznWXbd1tE2VFXVbaXNj5bvWxRSOf29naj 1FKqF3yq3h6aPvB4sxSDUjtAbJ8gZVR6H5CTF2zL+DfW6zk5chNOibAAjUCt8ky1rhatQU9xaOKd UjGIGTPbWbZ9t0UoA2qNIBwIU1CdyJ1bhO0wBdWJ3OknnAlTUJ3IHaFiCqod3kQNUCuCsiZTnwJH UJ1QK5tgoEwgCWAKPg6xgtT3gkwEnlSlqPUNzPod63A4TGLZj5jP/izr3P5dP4g7+Ttf9ryxDofD 4bs5b6zD4XA4HPbivLEOh8Ph8B3MemPlv6WKA1QfJvDZJ7xs+26LUAbUGkH7wPbKkPb29sp22meG laFJoMajCZdS/dvJv+l3ffcpb6z0H8CPp7DsoSxb1MmMO23mRx7Csu27LaLsqKsatwvtlSHLFoV0 bm9v9zzrCumfQJQGjlpEc0SOmryG8W8sfH//FFY+kW95+sPvpIGLn8Oy7RsumnHD4+13j1m2KKQ+ 08swVW8vYWWN9YuZelX4xPZ8DiVW/K1g+xOxJwhgCqoTakWmigScj4NLcJJgpgGnHxo1cHILy7Zv uGjGDY+33z1m2aKQykyJgUkEADI06/ialnoglSimFvM9MAXE/hO8ihKqEyUH5I4AE5jjfZgeb1oc Vm7LujeWfAKYJXwBYmqpmD7YB3/SvDtp4OLnsGz7noska6jVB82pjG2vDFm2KKQ+08swVW/PkQJg MjdDkPWfRkW2xIaZYVYgP5Ty6X0fC6UUlW3OojcWSY0i8iw5kKHpg30ITxp+Z+mBrGHZ9v0XDTmp ffvjO8GyRSGd29vbCWv3LT4mkPKfRkWWYkNMj5kICPJDWalpT23OB/5WsP6A8mzYXpqZt3+c8KTh d5YeyBqWbd9/0ZCT2rc/vhMsWxTSub29nbjb7usvu8QBqhMkhVJBXgnqAyErNXmK0MT2/OY3FtV8 ivCMGXfanI988WXbd1tE2VFXVbaXNj5bvWxRSOf2xnbKQoZmiK+vd5WG5L53JDZJvkbZhFCWasgn 6tndGP/Gku/vyU04JcICNAK1yjPVulq0jNIlOFJQPYLhA2+xbPtui1AG1BpBOBCmoDqRO7cI22EK qhO50084E6agOpE7QsUUVDtHUKtg5visxanpHzAF1Qm1fk4wUCMghinAFEgCmILqhDkIQMkn6tnd mPU71uFwmMSyHzGf/VnWuf0jx9PSzz7AX8l5Yx0Oh8Mw5C1lqHUYx3ljHQ6Hw+E7OG+sw+FwOHwH s95Y9BsxfkcGav0Z9Gsn1ErkTj8zZrazbPtui1AG1BpB+8D2ypD29vbKdm7N9JVo9GiiSl522dg4 uc7rvoTq+YS7cnPlSf1MeWO9/ljcU6AnQnIsU4c/oPTd86CfGTPbWbZ9t0WUHXVV43ahvTJk2aKQ WzOlplL2bELu5FwWXOInWFwa278OhHPIFBmWbcv4Nxa+v38K9ESmPqDdnn743Wc8kBkz21m2fcNF M254vP3uMcsWhdRnhrK0t+R78gn1mUbL8DrhhP6xdfL55EDOPmMsK/5WMHxMIfYEAUxBdUKtyFSR gLMbOIzOG3LtjJntLNu+4aIZNzzefveYZYtCKjMlBqrf5I4QmoTVNM70+AKKDbXKpkZvUADUSoQO PgFMQfU7WzEN71icl+3Mdv+O5QsQU0vF9MGGlI4ccvOMme0s277nIskaavVBcypj2ytDli0Kqc8M V+SmOEB1hM/mlfVewQoqcyBLpgEfkDRy3zuIyamYBmU1+hnvz16/Ywl5Nmwvzczbd0Cu8ofRkSSf MWNmO8u2779oyEnt2x/fCZYtCnkws/1Cj0/lZZd7pQCofpObJUk+CE0h9y8dyNAE7anNOW+s6eQn lY7vYcbMdpZt33/RkJPatz++EyxbFPJgZvuFHkkRmkiQzLGCsPI1rlBQ8kFoCrlfdySG9KbgZZ4i NLE9v/mNRTUfoXRDeHAnM2a2s2z7bosoO+qqyvbSxmerly0Kad8OvEkFdWnkfqnS8AUWUxdkaPrA 481SDErtALF9gpRR6f2cenY3xr+x0oP6R27CKREWoBGoVZ6p1tWiNegpDk28UyoGMWNmO8u277YI ZUCtEYQDYQqqE7lzi7AdpqA6kTv9hDNhCqqdA3ITDlArOtWbqDHUzaCUydSkwBFUJ9TKJhgoE0gC mIKPQ6wg9b0gE0FIPbsbs37HOhwOk1j2I+azP8s6t3/XD+JO/s6XPW+sw+Fw+G7OG+twOBwOh704 b6zD4XA4fAez3lj0W6pIQ63DBD77hJdt320RyoBaI2gf2F4Z0t7eXtlO+8ywMjRDwsrQ/MXgy+Jb e5DdnylvLHoE9DhIjmXq8IHMuNNmfuQhLNu+2yLKjrqqcbvQXhmybFFI5/Zl7SUeN5YoDRy1CHOG n72M8W+s/InQ05n6sL7lT2L4nSsfcs6y7RsumnHD4+13j1m2KKQ+08swVW/3dLavZOoZNnyTL/uA FX8rSLGXBFKoEWAKqhNqRaaKBJyPg0twkmCmAacfGjVwcgvLtm+4aMYNj7ffPWbZopDKTImBSQQA MjRD+tuRpRrzPTAFxP4TvIoSqhMlB+SOABOY432YHjMRpKoXML+C1f+OhRhmiM+G9RXTB/vgT5p3 Jw1c/ByWbd9zkWQNtfqgOZWx7ZUhyxaF1Gd6Gabq7Z4h7S1dXrbEhplhViA/lPLpfR8LlCKp0fYs emN56k8nz5IDGZo+2IfwpOF3lh7IGpZt33/RkJPatz++EyxbFNK5fXF7S5eXpdgQ02MmAoL8UFZq KEXUs1tx3ljTCU8afmfpgaxh2fb9Fw05qX374zvBskUhndsXtzd2iQNUJ0gKpYK8EtQHQlZqKEXU s1ux+o11+WjyAnIgQ9MHAtV8ivCMGXfanI988WXbd1tE2VFXVbaXNj5bvWxRSOf2ee0eZP2nUZdG 7ntHYpPka5RNCGWphnyhVLk/499Y8uU9ZEJWCGvQC9QqmIJaDbvWULoERwqqRzB84C2Wbd9tEcqA WiMIB8IUVCdy5xZhO0xBdSJ3+glnwhRUJ3JHqJiC6kTuCKFJ+AKLU98/YAqqE2r9nGCgRkAMU4Ap kAQwBdUJcxCAkg9ebW/U+gZm/Y51OBwmsexHzGd/lnVu/8jxtPSzD/BXct5Yh8PhMAx5SxlqHcZx 3liHw+Fw+A7OG+twOBwO38Hc//NCrTe58xfAowBqJXKnnxkz21m2fbdFKANqjaB9YHtlSHt7e2U7 7TPDytAkUOPRxJvc8dSzjaS1L1TPJ9wFMx3yA2T3Z/Abi765l+mxTH8uC1bcgu4xmQf9zJjZzrLt uy2i7KirGrcL7ZUhyxaFdG5vbL/M9rS34CdYXBrbvw6Ec2COWrGeRW+sZY9ptz+J8IGEZiczZraz bPuGi2bc8Hj73WOWLQqpz/QyTNXbPZepSoFQz7YQTugfWyefb87s1fOY++9Y9FwuHxMK5BPAFFQn 1IpMFQk4u4HD6Lwh186Y2c6y7RsumnHD4+13j1m2KKQyU2JgEgGADM0QqwcwBYu9mRO2CBIbapVN jd6gAKiVCB18ApiC6ne2YhrmWAGA+RVMfGPlD6Ll0fgaxNRVMX2wIaUjh9w8Y2Y7y7bvuUiyhlp9 0JzK2PbKkGWLQuozvQxT9XaPpHwWce6UsGylBbJkGvABSSP3vYOYnIppVLI+3pwpbyx6HEbLc8lr yIEMTR9shVzlD6MjST5jxsx2lm3ff9GQk9q3P74TLFsU0rm9vZ3I2+u9kgWq3+RmSZIPQlPI/UsH MjRBPsFTz27F+DdW5cu3PJe8hhzI0PTBPuQnlY7vYcbMdpZt33/RkJPatz++EyxbFNK5vb2dsHYC 2RxLhTWpNS4o+SA0hdyvOxJDelPwklJEPbsVc//PC6LlueQ15ECGpg8EqvkIpRvCgzuZMbOdZdt3 W0TZUVdVtpc2Plu9bFFI5/bGdsrWi3PCUeHM0PSBx5ulGJTaAWL7BCmj0vuAnLxgW8a/sYjQhxkS ZtEF1CqYglrVLcvQUxyaeKdUDGLGzHaWbd9tEcqAWiMIB8IUVCdy5xZhO0xBdSJ3+glnwhRUJ3JH qJiCaucIajlC06CsydesN3AE1Qm1yvNRJpAEMAUfh1hB6ntBJgJPqlLU+gYm/p8Xh8NhBst+xHz2 Z1nn9u/6QdzJ3/my5411OBwO3815Yx0Oh8PhsBfnjXU4HA6H72D8G0t+PzXUKpiH4Xz2CS/bvtsi lAG1RtA+sL0ypL29vbKd9plhZWiGUCWkRxO/Gv818a0F1d/A4DcWfXnI0JzEtzz9GXfazI88hGXb d1tE2VFXNW4X2itDli0K6dze2e65nBDyrKvC2PNybM7wy9dw3lifYfidKx9yzrLtGy6accPj7XeP WbYopD7TyzBVb/dcVlZ6FzP1Ehu+z/e9y9x/xwqfS+VhISWfAKagOqFWZKpIwPk4uAQnCWYacPqh UQMnt7Bs+4aLZtzwePvdY5YtCqnMlBiYRAAgQzOkXllpBFKAGqo03wNTQOw/wasooTpRckDuCDCB Od6H6TEzzH4FE99Y9UdWwhcgppaK6YN98CfNu5MGLn4Oy7bvuUiyhlp90JzK2PbKkGWLQuozvQxT 9XZPvbLSCFDgP42KbIkNM8OsQH4o5dP7Phby1Ks6AfMrmPLGCp9CaOaEjRolIEPTB/sQnjT8ztID WcOy7fsvGnJS+/bHd4Jli0I6t3e2g0qXgRr/aVRkKTbE9JiJgCA/lJWaPFXJ7sz4N1b45dufSF5J DmRo+mAfwpOG31l6IGtYtn3/RUNOat/++E6wbFFI5/bOdlDpMlDjP428XRygOkFSKBXklaA+ELJS 09L+Fcz9Py/ArceRF4cPNzR9IFDNpwjPmHGnzfnIF1+2fbdFlB11VWV7aeOz1csWhXRuH9VeB2X+ 06hLI/e9I7FJ8jXKJoSyVEO+UKrcn/FvLKJklgiz6AJqFUxBreqWlZQuwZGC6hEMH3iLZdt3W4Qy oNYIwoEwBdWJ3LlF2A5TUJ3InX7CmTAF1YncESqmoDoROhpV8WUWv2Y5YAqqE2oVFqFGQAxTgCmQ BDAF1QlzEICSD15tb9T6Bib+nxeHw2EGy37EfPZnWef2jxxPSz/7AH8l5411OBwOw5C3lKHWYRzn jXU4HA6H7+C8sQ6Hw+HwHYx/Y+nvwwm1HKH5u8GjAGolcqefGTPbWbZ9t0UoA2qNoH1ge2VIe3t7 ZTvtM8PK0CRQ49GES6mOqGcbwRZB9XzCXd5M57xQ/Q0MfmPRl88lOcOZPf8udI/JPOhnxsx2lm3f bRFlR13VuF1orwxZtiikc3tjeylb7zIayyr4CRZ3XnVJOOdy++ase2Mhnv2YdvtjCB9IaHYyY2Y7 y7ZvuGjGDY+33z1m2aKQ+kwvw1S93ROmKvVEe2WJzgOekc83Z/bqecz9d6z8AdWfFLLyCWAKqhNq RaaKBJzdwGF03pBrZ8xsZ9n2DRfNuOHx9rvHLFsUUpkpMTCJAECGZojVA2+24CspNtQqmxq9QQFQ KxE6+AQwBdXvbMU0zMlT38LEN1b4dC6fVF5MLRXTBxtSOnLIzTNmtrNs+56LJGuo1QfNqYxtrwxZ tiikPtPLMFVv90jKZxHbJ0iZGMv6MmqBLJkGfEDSyH3vICanYhqUxSeA+RVMeWPRUyjFIXkBOZCh 6YOtkKv8YXQkyWfMmNnOsu37LxpyUvv2x3eCZYtCOre3txPW7lt8TKBSUP0mN0uSfBCaQu5fOpCh CfJUJbsz499Y+ZdPD+cHmojIs+RAhqYP9iE/qXR8DzNmtrNs+/6LhpzUvv3xnWDZopDO7e3txN12 S4U1YpYKSj4ITSH3647EkN4UvKykBJI7M/f/vMh5UBA+3ND0gUA1H6F0Q3hwJzNmtrNs+26LKDvq qsr20sZnq5ctCunc3thOWcjQDAlHhe2h6QOPN0sxKLUDxPYJUkal9wE5ecG2jH9jEZp4kztEWJAm KWoVTEGtq0Vr0FMcmninVAxixsx2lm3fbRHKgFojCAfCFFQncucWYTtMQXUid/oJZ8IUVCdyR6iY gmrnCGoVzBzKmkx9ChxBdUKtbIKBMoEkgCn4OMQKUt8LMhF4UpWi1jcw8f+8OBwOM1j2I+azP8s6 t3/XD+JO/s6XPW+sw+Fw+G7OG+twOBwOh704b6zD4XA4fAfj31jy+6mROwD+YTiffbzLtu+2CGVA rRG0D2yvDGlvb69sp31mWBmaIWFlaP5i8GXxrT3I7s/gNxZ9c8iVj+NbHv2MO23mRx7Csu27LaLs qKsatwvtlSHLFoV0bl/WXuJxY4nSwFGLwjnDv8U8zhvrMwy/M3zyy1i2fcNFM254vP3uMcsWhdRn ehmm6u2ezvaVTD0jHL7JF29k7r9j4VnYJ0iZGGRRJsAUVCfUikwVCTgfB5fgJMFMA04/NGrg5BaW bd9w0YwbHm+/e8yyRSGVmRIDkwgAZGiG9LcjSzXme2AKiP0neBUlVCdKDsgdASYwx/swPbkZlu3M xDeWPYvXw3PPxcc5eSXVV0wf7IM/ad6dNHDxc1i2fc9FkjXU6oPmVMa2V4YsWxRSn+llmKq3e4a0 t3R52RIbZoZZgfxQyqf3fSyQBKG5M1PeWK/HVn4Q9WeUZ8mBDE0f7EN40vA7Sw9kDcu2779oyEnt 2x/fCZYtCuncvri9pcvLUmyI6TETAUF+KCs1lAKhuTnj31iXT6FekGfJgQxNH+xDeNLwO0sPZA3L tu+/aMhJ7dsf3wmWLQrp3L64vbFLHKA6QVIoFeSVoD4QslJDKRCamzP3/7wAleeYk2fD9tJM71PN pwjPmHGnzfnIF1+2fbdFlB11VWV7aeOz1csWhXRun9fuQdZ/GnVp5L53JDZJvkbZhFCWasgHobk/ 499YRO7DKREWoBGoVZ6p1tWiZZQuwZGC6hEMH3iLZdt3W4QyoNYIwoEwBdWJ3LlF2A5TUJ3InX7C mTAF1YncESqmoDqRO0JoEr7A4tT3D5iC6oRaPycYqBEQwxRgCiQBTEF1whwEoOSD0Nyfif/nxeFw mMGynzWf/aHWuf0jx9PSzz7AX8l5Yx0Oh8Mw5C1lqHUYx3ljHQ6Hw+E7OG+sw+FwOHwH499Y+vtw IncA/D+CfueEWonc6WfGzHaWbd9tEcqAWiNoH9heGdLe3l7ZTvvMsDI0K1Ax2gXVEfVsI9giqJ5P uAtmOuQHyO7P4DcWffPwQUx9Ors9+tIDyYN+ZsxsZ9n23RZRdtRVjduF9sqQZYtCOre3twMp85Xt XRo9JVxaGtu/DoRz2s09Wf3Gmv1odnv04QMJzU5mzGxn2fYNF8244fH2u8csWxRSn+llmKq351DX Zb3RXlkinNA/tk4+/yNnjGXuv2PRs7h8NCiQTwBTUJ1QKzJVJODsBg6j84ZcO2NmO8u2b7hoxg2P t989ZtmikMpMiYFJBAAyNEvko+r1Hl9JsaFW2dToDQqAWonQwSeAKah+Zyum0eJszsQ31rOn42sQ U1fF9MGGlI4ccvOMme0s277nIskaavVBcypj2ytDli0Kqc/0MkzV2z3hKBsCYIZY1pdRC2TJNOAD kkbuewcxORXTIAlCc2emvLHSs+IH0fhoLhshQ9MHWyFX+cPoSJLPmDGznWXb91805KT27Y/vBMsW hXRuf9ZusQShn4NKQfWb3CxJ8kFoCrl/6UCGJsgnCKG5OePfWKWn0Ph08jJyIEPTB/uQn1Q6vocZ M9tZtn3/RUNOat/++E6wbFFI5/Zb7QRMZAFJj6XCGjFLBSUfhKaQ+3VHYkhvCl5SCoTm5sz9Py+M 9keTV5IDGZo+EKjmI5RuCA/uZMbMdpZt320RZUddVdle2vhs9bJFIZ3b29uNUkupXvCpento+sDj zVIMSu0AsX2ClFHpfSM092f8G4swH8ElYWWapKhVMAW1mjdORU9xaOKdUjGIGTPbWbZ9t0UoA2qN IBwIU1CdyJ1bhO0wBdWJ3OknnAlTUJ3IHaFiCqod3kQNUCuCsiZTnwJHUJ1QK5tgoEwgCWAKPg6x gtT3gkwEntDcn4n/58XhcJjBsp81n/2h1rn9S38iP+PvfNnzxjocDofv5ryxDofD4XDYi/PGOhwO h8N3MP6NJb+fGmoVzD9Oz9NAL1ArkTsrWbZ9t0UoA2qNoH1ge2VIe3t7ZTvtM8PK0AwJK0OTCAsu uzxpyY36Q4nBbyz6U4EMzUl8y38WdueDg0vPs2dmP8u277aIsqOuatwutFeGLFsU0rl9TXuYrbfk 3K0/hJw31gfofCBhe+fMTpZt33DRjBseb797zLJFIfWZXoapertnbDuo1IfcrT+EzP13LPwh0R9V 5U/O6gFMQXVCrchUkYCzJ3Re57VoHzvzLsu2b7hoxg2Pt989ZtmikMpMiYFJBAAyNEMGtltsQwBM QXVCrUQoU9ULmILqhDneh/lnmfjG8g8XzxqoVcAXIKaWiumDnSkdnyMpQhNvzKFUXjmVZdv3XCRZ Q60+aE5lbHtlyLJFIfWZXoapertnVLuvkZikfRp5gSEyz3pHMJlX/lmmvLHkmVYeMUkiz4btpZl5 +4aUjr+FdPlGGkJyNsu2779oyEnt2x/fCZYtCuncvrIdqE6EMlX9AFnBx0IoXw0/8dmDMP6NlT9c cupPv7G9NDNv35DS8e3kLf0ze1i2ff9FQ05q3/74TrBsUUjn9vXtviZsbxkCRHoHsXc8Jf8PMvf/ vABk1p9+ng3bSzO9TzVbER7cSKmlZ2Y/y7bvtoiyo66qbC9tfLZ62aKQzu3z2j0tLZChCUr1wJtG yf/LjH9jEbkPp0RYgEagVnmmWleLPs7jI9Ho0UTHzCEs277bIpQBtUYQDoQpqE7kzi3CdpiC6kTu 9BPOhCmoTuSOUDEF1YncEUKToALI0ERg5I5gJgICNUCtcvEfZOL/eXE4HGaw7OfXZ39Qdm7f/Kf8 eQk947yxDofDYTXnjfWM88Y6HA6Hw3dw3liHw+Fw+A7Gv7Hkt11DrYL5x+l5GugFaiVyZyXLtu+2 CGVArRG0D2yvDGlvb69sp31mWBmaIWFlaB62ZfAbi/7sIUNzEt/yH5/d+eDg0vPsmdnPsu27LaLs qKsatwvtlSHLFoV0bl/W3s7AUYec88b6AJ0PJGzvnNnJsu0bLppxw+Ptd49ZtiikPtPLMFVv93S2 32LUnEPI3H/Hyv/LkNhLAinUCDAF1Qm1IlNFAs6e0Hmd16J97My7LNu+4aIZNzzefveYZYtCKjMl BiYRAMjQDBnSLp8ApqA6UXIExDAFmILqhFqHKya+sfwfA/5UBMQwQ3w2rK+YPtiZ0vE5kiI08cYc SuWVU1m2fc9FkjXU6oPmVMa2V4YsWxRSn+llmKq3e/rbfRaxdwST5AvieBOxdwSShxJT3livP5/y H0D9zybPkgMZmj7YmdLxt5Au30hDSM5m2fb9Fw05qX374zvBskUhnds/3k74rIccX0mpwyXj31iX fwb1gjxLDmRo+mBnSse3k7f0z+xh2fb9Fw05qX374zvBskUhndu3ajdyP2w3RJJzqDD3/7zIeVBA DmRo+kCgmq0ID26k1NIzs59l23dbRNlRV1W2lzY+W71sUUjn9nntnnBUaPpAqFSG5uGS8W8sgnzI CmENeoFaBVNQq2HXZ3l8JBo9muiYOYRl23dbhDKg1gjCgTAF1YncuUXYDlNQncidfsKZMAXVidwR KqagOpE7QmgSVGAytSpwgFquDAHwvgHncMnE//PicDjMYNkPuM/+JO3cfl4Dv5LzxjocDofDd3De WIfD4XD4Ds4b63A4HA7fwYr/80IjB4r/CPqdE2olcqefGTPbWbZ9t0UoA2qNoH1ge2VIe3t7ZTvt M8PK0CRQ49HEm9zZnK87eBRzf8fCY135cHf7g6R7TOZBPzNmtrNs+26LKDvqqsbtQntlyLJFIZ3b 29s9VCzyVvtUGi/Z5+DFTHxj2TNd+XB3+4OkeyBDs5MZM9tZtn3DRTNueLz97jHLFoXUZ3oZpurt JVpGfZBn3+LvMOuN5R+o/TcBYIYgizIBpqA6oVZkqkjA2Q0cRucNuXbGzHaWbd9w0YwbHm+/e8yy RSGVmRIDkwgAZGjWKbXUeytdhjne9yag2Cg5QK2EOd6H+ReY8sbSp/jzjwGx4OOcvJLqK6YPNqR0 5JCbZ8xsZ9n2PRdJ1lCrD5pTGdteGbJsUUh9ppdhqt6eIwXAJALBxyF5F7VAyqf3zYQUfOwxPy8g B1I+ve/j382Kf8ci6g83z5IDGZo+2Aq5yh9GR5J8xoyZ7Szbvv+iISe1b398J1i2KKRze3s7kbe3 9EoNtRAwkQXezAsk9piJwMgdgcyw5ldy3ljTyU8qHd/DjJntLNu+/6IhJ7Vvf3wnWLYopHN7ezth 7QSyJagmrCcTMv/0ASj5Qu4IpfZfz+A3Vvgcbz3cPHtrpvep5iOUbggP7mTGzHaWbd9tEWVHXVXZ Xtr4bPWyRSGd2xvbKVsvDrGCPACQFZMKfKXEJd8+jYr5Fxj/O5Y8O0OtghkSFqARqFWeqdbVojXo KQ5NvFMqBjFjZjvLtu+2CGVArRGEA2EKqhO5c4uwHaagOpE7/YQzYQqqE7kjVExBtXMEtRyhaVDW 5GvWG3MQAPLzLEAMU4ApqHaOYA4CQPIXM/dvBQ+Hw3CW/Xj67M/Bzu1/54f4n+K8sQ6Hw+HwHZw3 1uFwOBy+g/PGOhwOh8N3MPiN9V+GJlxK9Z9Bv3ZCrUTu9DNjZjvLtu+2CGVArRG0D2yvDGlvb69s p31mWBmaIVQJ6dHEaOZN/oPM/R3L/qiW/Znt9h8H3ZM/kIEHz5jZzrLtuy2i7KirGrcL7ZUhyxaF dG7vbPdcTnjMvMl/kIlvrMv/RGaw238cdA9kaHYyY2Y7y7ZvuGjGDY+33z1m2aKQ+kwvw1S93XNZ WentZ+rwv8asN5b/Q2r/A0OlfAKYguqEWpGpIgFnN3AYnTfk2hkz21m2fcNFM254vP3uMcsWhVRm SgxMIgCQoRlSr6w0glK9BIY53r80De8bcA6eKW8sfd4//2zgCDBL+ALE1FIxfbAhpSOH3DxjZjvL tu+5SLKGWn3QnMrY9sqQZYtC6jO9DFP1dk+lUmKguoAV5AGAlE/v101IUDEPnhX/jiWf/tH7OCfP kgMZmj7YCrnKH0ZHknzGjJntLNu+/6IhJ7Vvf3wnWLYopHN7ZztRaQdS4GsgPTCRBXdNBJQ6eBa9 sSBB/c8jz4btpZl5+8fJTyod38OMme0s277/oiEntW9/fCdYtiikc3tnO1FpB1Lga8J6MiHbTUMk OQcw+I2VP3f7NOp/Enn21kzvU81HKN0QHtzJjJntLNu+2yLKjrqqsr208dnqZYtCOrf3tJcKQhrb S6b3zYQUUp5NgeRBGP87Vnr4iloFMyQsQCNQqzxTratFa9BTHJp4p1QMYsbMdpZt320RyoBaIwgH whRUJ3LnFmE7TEF1Inf6CWfCFFQnckeomILqRMkBakVQ1mTqU8xBACDtE6TMC9WuxpsCnINn7t8K Hg6H4Sz7WfbZH5qd289P/F/JeWMdDofD4Ts4b6zD4XA4fAfnjXU4HA6H7+D5G+u/jNyHY+TOXwCP AqiVyJ1+ZsxsZ9n23RahDKg1gvaB7ZUh7e3tle20z6xUtk/Q6CeN7YePM+x3LPyR0x+8lxJTdgYL VtyC7jGZB/3MmNnOsu27LaLsqKsatwvtlSHLFoUM2S5ObuaUykr+YUPGvLHsz5v+4Mlf8J/FghW3 CB9IaHYyY2Y7y7ZvuGjGDY+33z1m2aKQ+kwvL1NUkFMqa2w/bMKAN1blD5tSl/9Z2H89AKagOqFW ZKpIwNkNHEbnDbl2xsx2lm3fcNGMGx5vv3vMskUhlZkSA5MIQO5TQYnLOSWkwDAHAYC0T5AyL1Qn 1CqgRQlzEABI+wQp80J1whzvwxRUJ9T6BnrfWPqNo++cm2EZ4WsQU1fF9MGGlI4ccvOMme0s277n IskaavVBcypj2ytDli0Kqc/0MkxVCkqUWurtlIUsmd43ExKQ9ISVJdP7ZkICk+2V+zP437GAxOEj CE0iryEHMjR9sBVylT+MjiT5jBkz21m2ff9FQ05q3/74TrBsUUjndm9Wej2llst2KaCaULaYdaSY 6kNZMgmfJXzBFzH+jVV5Ci0PKK8hBzI0fbAP+Uml43uYMbOdZdv3XzTkpPbtj+8EyxaFdG6XTwLZ Cr4GLR5NlPFlvt58bwqh2cJr3LuL2iFT/p9vJiRR8oXXlHJ2Q56/seh7Qta/fMujyWtaFpn0PtV8 hNIN4cGdzJjZzrLtuy2i7KirKttLG5+tXrYoZNT2y3YQmkLJB5Q1KQEwE59GxQy5bJfYm5BCSv6o FEq+UKrcn67fseR7GrkDQh9mSJhFF1CrYApqVbcsQ09xaOKdUjGIGTPbWbZ9t0UoA2qNIBwIU1Cd yJ1bhO0wBdWJ3OknnAlTUJ3IHSOsFFQ7B6j7JncIdAG1fgKfsiZfbW/glNCihFrORGyfOalKUatQ jBqg1jcw7G8FD4fDGpb9iPnsz7LO7bOPp/l310k9oYk27tb/Gs4b63A4HJ6ANw1QaxXrN27CeWMd DofD4Ts4b6zD4XA4fAfP31j4XdiT+7kD4P8R9Dsn1ErkTj8zZrazbPtui1AG1BpB+8D2ypD29vbK dtpnhpWhGZJXwgFqRdSzoKWmwmX768SE6js8btyQYb9j4YnQcwkf09Rnt9sfTOmB5EE/M2a2s2z7 bosoO+qqxu1Ce2XIskUhndt72qmlMuFyuOBrWuqJekvncCHvejbn44x5Y9mXp6ew/jHt9scQPpDQ 7GTGzHaWbd9w0YwbHm+/e8yyRSH1mV6GqXq7Z2x7SEtNhXp753Ahn9A/8yMMeGNVvjmlLp8RCuQT wBRUJ9SKTBUJOLuBw+i8IdfOmNnOsu0bLppxw+Ptd49ZtiikMlNiYBIBgAzNkCHt8glgCqp/TjPn ElQKiMkU4Ag+NlADzEEAvMxThlpfQu8bS7909LXJRJmguoAvQEwtFdMHG1I6csjNM2a2s2z7nosk a6jVB82pjG2vDFm2KKQ+08swVW/3lColMOCEUAFickhqlEDWAxNZITQFMw34OUhRgZd5b2Xazgz+ dywgceVxVFJCniUHMjR9sBVylT+MjiT5jBkz21m2ff9FQ05q3/74TrBsUUjn9m3bK6OM0kzCZwkU GHCQAl5SSsidr2D8G+vyQdQLLp8sZGj6YB/yk0rH9zBjZjvLtu+/aMhJ7dsf3wmWLQrp3L5te2WU 0TLTyP2Wdi8vJ3wLz99Y4dMJn0JYWSLPhu2lmd6nmo9QuiE8uJMZM9tZtn23RZQddVVle2njs9XL FoV0bu9pLxXkSMpnEZNDUqMyVA/pTcEk+YJ3JIYMTeBjUM9uS9fvWK9H8iZ3QO7DKREWoBGoVZ6p 1tWiNegpDk28UyoGMWNmO8u277YIZUCtEYQDYQqqE7lzi7AdpqA6kTv9hDNhCqoTuSNUTEF1ouQA tSKQRZkAU1D9znoHpKoiWuTavSnAEXxsoEZAXDIhjVSlqPXT3Jxhfyt4OBzWsOxHzGd/lnVu/64f xIdGzhvrcDgcDt/BeWMdDofD4Ts4b6zD4XA4fAfP31j/ZeR+7gD4f5yeR4FeoFYid1aybPtui1AG 1BpB+8D2ypD29vbKdtpnhpWhWYIq0QvUigizpZY0rPUeoqXx8fDfwbDfsfAc6WmG5lS+5Y/T7nxw MLXkox7M7GfZ9t0WUXbUVY3bhfbKkGWLQjq3t7cLUuPLqIWkJ0zdrW+hpfHx8N/A//73f36L/GQx UmJ+AAAAAElFTkSuQmCC ------=_20131228203409_44038 Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users ------=_20131228203409_44038-- From xen-users-bounces@lists.xen.org Mon Dec 30 10:34:33 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 30 Dec 2013 10:34:33 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxa9y-00085f-0f; Mon, 30 Dec 2013 10:33:22 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxa9w-00085a-JU for xen-users@lists.xen.org; Mon, 30 Dec 2013 10:33:20 +0000 Received: from [193.109.254.147:6368] by server-2.bemta-14.messagelabs.com id 3C/07-00361-FEB41C25; Mon, 30 Dec 2013 10:33:19 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-6.tower-27.messagelabs.com!1388399598!8045593!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 774 invoked from network); 30 Dec 2013 10:33:19 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-6.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 30 Dec 2013 10:33:19 -0000 X-IronPort-AV: E=Sophos;i="4.95,573,1384300800"; d="scan'208";a="88510435" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 30 Dec 2013 10:33:17 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Mon, 30 Dec 2013 05:33:16 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1Vxa9s-0001n0-VV; Mon, 30 Dec 2013 10:33:16 +0000 Date: Mon, 30 Dec 2013 10:33:16 +0000 From: Wei Liu To: NiX Message-ID: <20131230103316.GA9143@zion.uk.xensource.com> References: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> <20131227102830.GN25969@zion.uk.xensource.com> <20131227123824.GA23996@zion.uk.xensource.com> <49490a160a437a4234aede8a5dfa1444.squirrel@gameframe.net> <20131227155003.GA31278@zion.uk.xensource.com> <0521f17c514aa7dcd5af09cbfcc22961.squirrel@gameframe.net> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <0521f17c514aa7dcd5af09cbfcc22961.squirrel@gameframe.net> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: xen-users@lists.xen.org, Wei Liu Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Adding back xen-users@ On Sat, Dec 28, 2013 at 07:34:55PM +0200, NiX wrote: [...] > > I ran 'zmap -p 80 -B 10M -o results.txt --interface=eth0' and took a > screenshot of top. > Is it not the '-B' option limits total bandwidth? In that case it is normal to see it can only use up to 10Mb/s? So the snapshot shows that CPU0 is runing at 78% serving software interrupt while 10% idle. Looks like that backend spends too much serving interrupt handler and not actually doing any work. Could you try the following tree: git://git.kernel.org/pub/scm/linux/kernel/git/davem/net.git Which has the latest stable netback / netfront code. In that tree: 1. netback NAPI to mitigate intrrupt (backend only) 2. a new feature call split event channel can be used to avoid some interrupt overhead. (you would need to use frontend / backend that support this feature) P.S. don't use this tree in production. ;-) Wei. > 0:05 0% (1d11h left); send: 74425 14.9 Kp/s (14.8 Kp/s avg); recv: 2196 > 492 p/s (436 p/s avg); drops: 0 p/s (0 p/s avg); hits: 2.95 > > 10mbps ~ 15k packets/second > > The server is dual xeon X5450 _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 30 10:34:33 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 30 Dec 2013 10:34:33 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxa9y-00085f-0f; Mon, 30 Dec 2013 10:33:22 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxa9w-00085a-JU for xen-users@lists.xen.org; Mon, 30 Dec 2013 10:33:20 +0000 Received: from [193.109.254.147:6368] by server-2.bemta-14.messagelabs.com id 3C/07-00361-FEB41C25; Mon, 30 Dec 2013 10:33:19 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-6.tower-27.messagelabs.com!1388399598!8045593!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 774 invoked from network); 30 Dec 2013 10:33:19 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-6.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 30 Dec 2013 10:33:19 -0000 X-IronPort-AV: E=Sophos;i="4.95,573,1384300800"; d="scan'208";a="88510435" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 30 Dec 2013 10:33:17 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Mon, 30 Dec 2013 05:33:16 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1Vxa9s-0001n0-VV; Mon, 30 Dec 2013 10:33:16 +0000 Date: Mon, 30 Dec 2013 10:33:16 +0000 From: Wei Liu To: NiX Message-ID: <20131230103316.GA9143@zion.uk.xensource.com> References: <1f458dd848347b2d623a54dd75f50b6d.squirrel@gameframe.net> <20131227102830.GN25969@zion.uk.xensource.com> <20131227123824.GA23996@zion.uk.xensource.com> <49490a160a437a4234aede8a5dfa1444.squirrel@gameframe.net> <20131227155003.GA31278@zion.uk.xensource.com> <0521f17c514aa7dcd5af09cbfcc22961.squirrel@gameframe.net> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <0521f17c514aa7dcd5af09cbfcc22961.squirrel@gameframe.net> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: xen-users@lists.xen.org, Wei Liu Subject: Re: [Xen-users] XEN 4.3.1 network performance issue X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Adding back xen-users@ On Sat, Dec 28, 2013 at 07:34:55PM +0200, NiX wrote: [...] > > I ran 'zmap -p 80 -B 10M -o results.txt --interface=eth0' and took a > screenshot of top. > Is it not the '-B' option limits total bandwidth? In that case it is normal to see it can only use up to 10Mb/s? So the snapshot shows that CPU0 is runing at 78% serving software interrupt while 10% idle. Looks like that backend spends too much serving interrupt handler and not actually doing any work. Could you try the following tree: git://git.kernel.org/pub/scm/linux/kernel/git/davem/net.git Which has the latest stable netback / netfront code. In that tree: 1. netback NAPI to mitigate intrrupt (backend only) 2. a new feature call split event channel can be used to avoid some interrupt overhead. (you would need to use frontend / backend that support this feature) P.S. don't use this tree in production. ;-) Wei. > 0:05 0% (1d11h left); send: 74425 14.9 Kp/s (14.8 Kp/s avg); recv: 2196 > 492 p/s (436 p/s avg); drops: 0 p/s (0 p/s avg); hits: 2.95 > > 10mbps ~ 15k packets/second > > The server is dual xeon X5450 _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 30 20:37:49 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 30 Dec 2013 20:37:49 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxjZh-00034R-IQ; Mon, 30 Dec 2013 20:36:33 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxSHG-0001RG-Sq for xen-users@lists.xen.org; Mon, 30 Dec 2013 02:08:23 +0000 Received: from [193.109.254.147:58081] by server-13.bemta-14.messagelabs.com id BF/B4-19374-695D0C25; Mon, 30 Dec 2013 02:08:22 +0000 X-Env-Sender: raghu.nallamothu@gmail.com X-Msg-Ref: server-5.tower-27.messagelabs.com!1388369300!7971691!1 X-Originating-IP: [209.85.219.45] X-SpamReason: No, hits=1.2 required=7.0 tests=HTML_20_30,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 17525 invoked from network); 30 Dec 2013 02:08:21 -0000 Received: from mail-oa0-f45.google.com (HELO mail-oa0-f45.google.com) (209.85.219.45) by server-5.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 30 Dec 2013 02:08:21 -0000 Received: by mail-oa0-f45.google.com with SMTP id o6so11556273oag.18 for ; Sun, 29 Dec 2013 18:08:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=8/gWh5NcOXi1X/m+Y2HjZK1OPaHqSUsg7g+ObuGhhF0=; b=Wt+ePOe2GPm4ieNxH/29Mx+6pkWSoAVG4zyoq14qi4M+ShlF7KYsOOU1mykq49YXPC rD5k2dwjjZcZKRSFlysGXJ1dAi3jMgo8Kv3M9oJ0C/CDh0eBQTLVdmgQRxoQcHH3yMIt NlNB1HiOjS3G2zuqZV+wz/zPHc+u9PMARhnGAEo5j8lVbP5IC5EkCrSgdycrsWqZ7sZ4 I7gVWBasum9YlHM4wVcw24RKGvakAHGyM6poGCmUjOK7G2k3oVXSkZ8ax/tQCRiPyIs4 gg+oA2nmjhCi7lXUqNSen1wZwHb9kcIE1+h5cdPdvuSl6EXAw0LGp/6FRMqkNFEXYsCb crCA== MIME-Version: 1.0 X-Received: by 10.60.68.83 with SMTP id u19mr154928oet.74.1388369299582; Sun, 29 Dec 2013 18:08:19 -0800 (PST) Received: by 10.60.98.168 with HTTP; Sun, 29 Dec 2013 18:08:19 -0800 (PST) Date: Sun, 29 Dec 2013 18:08:19 -0800 Message-ID: From: Raghu Nallamothu To: xen-users@lists.xen.org X-Mailman-Approved-At: Mon, 30 Dec 2013 20:36:32 +0000 Subject: [Xen-users] virtualization overhead in xen X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============9072594924836103662==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============9072594924836103662== Content-Type: multipart/alternative; boundary=001a11330af2eb35bc04eeb6ea18 --001a11330af2eb35bc04eeb6ea18 Content-Type: text/plain; charset=ISO-8859-1 Hi All., Is there a way to calculate xen virtualization over head? I have a node which has 8183 MB of ram, I have reserved 4096 MB of RAM for dom-0. Once I rebooted the node and ran xm info command, I am just seeing 3975 MB of free memory available to for guests instead of 4087 MB of RAM. Is there a way to calculate this overhead Thanks for you help., Regards Raghu --001a11330af2eb35bc04eeb6ea18 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi All.,=A0
=A0 =A0 =A0Is there a way to calculate xen= virtualization over head? I have a node which has 8183 MB of ram, I have r= eserved 4096 MB of RAM for dom-0. Once I rebooted the node and ran xm info = command, =A0I am just seeing 3975 MB of free memory available to for guests= instead of 4087 MB of RAM. Is there a way to calculate this overhead
Thanks for you help.,


Regards<= /div>
Raghu
--001a11330af2eb35bc04eeb6ea18-- --===============9072594924836103662== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============9072594924836103662==-- From xen-users-bounces@lists.xen.org Mon Dec 30 20:37:49 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 30 Dec 2013 20:37:49 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxjZh-00034R-IQ; Mon, 30 Dec 2013 20:36:33 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxSHG-0001RG-Sq for xen-users@lists.xen.org; Mon, 30 Dec 2013 02:08:23 +0000 Received: from [193.109.254.147:58081] by server-13.bemta-14.messagelabs.com id BF/B4-19374-695D0C25; Mon, 30 Dec 2013 02:08:22 +0000 X-Env-Sender: raghu.nallamothu@gmail.com X-Msg-Ref: server-5.tower-27.messagelabs.com!1388369300!7971691!1 X-Originating-IP: [209.85.219.45] X-SpamReason: No, hits=1.2 required=7.0 tests=HTML_20_30,HTML_MESSAGE, ML_RADAR_SPEW_LINKS_14,RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 17525 invoked from network); 30 Dec 2013 02:08:21 -0000 Received: from mail-oa0-f45.google.com (HELO mail-oa0-f45.google.com) (209.85.219.45) by server-5.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 30 Dec 2013 02:08:21 -0000 Received: by mail-oa0-f45.google.com with SMTP id o6so11556273oag.18 for ; Sun, 29 Dec 2013 18:08:19 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:date:message-id:subject:from:to:content-type; bh=8/gWh5NcOXi1X/m+Y2HjZK1OPaHqSUsg7g+ObuGhhF0=; b=Wt+ePOe2GPm4ieNxH/29Mx+6pkWSoAVG4zyoq14qi4M+ShlF7KYsOOU1mykq49YXPC rD5k2dwjjZcZKRSFlysGXJ1dAi3jMgo8Kv3M9oJ0C/CDh0eBQTLVdmgQRxoQcHH3yMIt NlNB1HiOjS3G2zuqZV+wz/zPHc+u9PMARhnGAEo5j8lVbP5IC5EkCrSgdycrsWqZ7sZ4 I7gVWBasum9YlHM4wVcw24RKGvakAHGyM6poGCmUjOK7G2k3oVXSkZ8ax/tQCRiPyIs4 gg+oA2nmjhCi7lXUqNSen1wZwHb9kcIE1+h5cdPdvuSl6EXAw0LGp/6FRMqkNFEXYsCb crCA== MIME-Version: 1.0 X-Received: by 10.60.68.83 with SMTP id u19mr154928oet.74.1388369299582; Sun, 29 Dec 2013 18:08:19 -0800 (PST) Received: by 10.60.98.168 with HTTP; Sun, 29 Dec 2013 18:08:19 -0800 (PST) Date: Sun, 29 Dec 2013 18:08:19 -0800 Message-ID: From: Raghu Nallamothu To: xen-users@lists.xen.org X-Mailman-Approved-At: Mon, 30 Dec 2013 20:36:32 +0000 Subject: [Xen-users] virtualization overhead in xen X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============9072594924836103662==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============9072594924836103662== Content-Type: multipart/alternative; boundary=001a11330af2eb35bc04eeb6ea18 --001a11330af2eb35bc04eeb6ea18 Content-Type: text/plain; charset=ISO-8859-1 Hi All., Is there a way to calculate xen virtualization over head? I have a node which has 8183 MB of ram, I have reserved 4096 MB of RAM for dom-0. Once I rebooted the node and ran xm info command, I am just seeing 3975 MB of free memory available to for guests instead of 4087 MB of RAM. Is there a way to calculate this overhead Thanks for you help., Regards Raghu --001a11330af2eb35bc04eeb6ea18 Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi All.,=A0
=A0 =A0 =A0Is there a way to calculate xen= virtualization over head? I have a node which has 8183 MB of ram, I have r= eserved 4096 MB of RAM for dom-0. Once I rebooted the node and ran xm info = command, =A0I am just seeing 3975 MB of free memory available to for guests= instead of 4087 MB of RAM. Is there a way to calculate this overhead
Thanks for you help.,


Regards<= /div>
Raghu
--001a11330af2eb35bc04eeb6ea18-- --===============9072594924836103662== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============9072594924836103662==-- From xen-users-bounces@lists.xen.org Mon Dec 30 21:34:59 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 30 Dec 2013 21:34:59 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxkTj-000594-EK; Mon, 30 Dec 2013 21:34:27 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxkTh-00058z-7X for xen-users@lists.xensource.com; Mon, 30 Dec 2013 21:34:25 +0000 Received: from [85.158.137.68:57010] by server-12.bemta-3.messagelabs.com id 70/60-20055-0E6E1C25; Mon, 30 Dec 2013 21:34:24 +0000 X-Env-Sender: subforos@gmail.com X-Msg-Ref: server-7.tower-31.messagelabs.com!1388439261!6610178!1 X-Originating-IP: [209.85.192.181] X-SpamReason: No, hits=0.3 required=7.0 tests=ML_RADAR_SPEW_LINKS_14, RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 28010 invoked from network); 30 Dec 2013 21:34:23 -0000 Received: from mail-pd0-f181.google.com (HELO mail-pd0-f181.google.com) (209.85.192.181) by server-7.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 30 Dec 2013 21:34:23 -0000 Received: by mail-pd0-f181.google.com with SMTP id p10so11722337pdj.12 for ; Mon, 30 Dec 2013 13:34:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=PqFBiWH0inoMnUFLtPWj3iKAk+0cSrRqHzEX4au2lqw=; b=H9oahuXC9r2AENylMw30KBOEvKMBNYuFHiGOXpFxbHtflBzChIwL5pWYxiP9oE/eg7 9BXSu/ZTLbOiOx4WojTOV/YOwQiCzSOXvycy2EWE75jY0bi+31lmJ/XrVN+FBP2puFX2 O5I4jor9CoH8Oen3cAk2p+3oh034OVN6i+knJG1ofzLMGoKEnDiRLdHSAxxqEoMOQnjY dLVS+xMNZATswQ2iWaOtIpc/IBnOnESD0U4AHqaoVR7F7KBXUt29PBRGbWJPzwDGFcHs GZEDLnx0O+VhiavbYoQvGAcomnBcgnDGKN+OesaEdxPYD/reW16Iuzy6YsN3bUkj0yfH Q3mw== X-Received: by 10.66.26.106 with SMTP id k10mr72431401pag.136.1388439261391; Mon, 30 Dec 2013 13:34:21 -0800 (PST) MIME-Version: 1.0 Received: by 10.68.220.225 with HTTP; Mon, 30 Dec 2013 13:33:51 -0800 (PST) From: Flako Date: Mon, 30 Dec 2013 19:33:51 -0200 Message-ID: To: "xen-users@lists.xensource.com" Subject: [Xen-users] "BSOD STOP : 0x000000F4" installing gplpv_Vista2008x32_0.11.0.372 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hello I try to install in windows7 Pro gplpv_Vista2008x32_0.11.0.372.msi in SLES 11 SP2 (kernel 3.0.13-0.27-xen/xen-libs-4.1.2 ) When I install GPLPV generates a BSOD 'STOP : 0x000000F4 ' or domU freezes. Apparently the BSOD is associated to a disk freeze/latency and coresponds with compartments of domU (sometimes you can move windows , but when you open a file domU freezes) I'm not finding a layer of error code that allows me to keep looking on the internet. The steps I follow to install are: 1. Sign domU 2 . bcdedit / set testsigning on 3 . reboot 4 install gplpv_Vista2008x32_0.11.0.372.msi my domu.cfg is : name = "windows7" maxmem = 2036 memory = 2036 vcpus = 2 builder = "hvm" kernel = "/usr/lib/xen/boot/hvmloader" acpi = 1 apic = 1 viridian = 0 localtime = 1 hpet = 0 on_poweroff = "destroy" on_reboot = "restart" on_crash = "destroy" device_model = "/usr/lib/xen/bin/qemu-dm" usb = 1 usbdevice = "tablet" vfb = [ "type=vnc,vncunused=1,keymap=es" ] disk = [ "tap:qcow2:/mnt/util/xen-images/windows7/disco1.qcow,hda,w" parallel = "none" serial = "pty" I missing something in this step ? Or is something wrong in the settings ? Thanks, and excuse the English . the log gplpv_Vista2008x32_0.11.0.372.msi log file of the execution https://drive.google.com/file/d/0B8rkUchOnWAKU3JTYVk4NG9ta00/edit?usp=sharing 1 - StartW7.tar.gz log dom0 and domU at startup before installing GPLPV https://drive.google.com/file/d/0B8rkUchOnWAKeFFiRURScThHVXM/edit?usp=sharing 2 -Crash - StartAfterInsrall.tar.gz : log the domU after the failed installation of GPLPV, contains the BSOD and startup domU https://drive.google.com/file/d/0B8rkUchOnWAKQ1RFakREQmxnOEU/edit?usp=sharing _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 30 21:34:59 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 30 Dec 2013 21:34:59 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxkTj-000594-EK; Mon, 30 Dec 2013 21:34:27 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxkTh-00058z-7X for xen-users@lists.xensource.com; Mon, 30 Dec 2013 21:34:25 +0000 Received: from [85.158.137.68:57010] by server-12.bemta-3.messagelabs.com id 70/60-20055-0E6E1C25; Mon, 30 Dec 2013 21:34:24 +0000 X-Env-Sender: subforos@gmail.com X-Msg-Ref: server-7.tower-31.messagelabs.com!1388439261!6610178!1 X-Originating-IP: [209.85.192.181] X-SpamReason: No, hits=0.3 required=7.0 tests=ML_RADAR_SPEW_LINKS_14, RCVD_BY_IP,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 28010 invoked from network); 30 Dec 2013 21:34:23 -0000 Received: from mail-pd0-f181.google.com (HELO mail-pd0-f181.google.com) (209.85.192.181) by server-7.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 30 Dec 2013 21:34:23 -0000 Received: by mail-pd0-f181.google.com with SMTP id p10so11722337pdj.12 for ; Mon, 30 Dec 2013 13:34:21 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:from:date:message-id:subject:to:content-type; bh=PqFBiWH0inoMnUFLtPWj3iKAk+0cSrRqHzEX4au2lqw=; b=H9oahuXC9r2AENylMw30KBOEvKMBNYuFHiGOXpFxbHtflBzChIwL5pWYxiP9oE/eg7 9BXSu/ZTLbOiOx4WojTOV/YOwQiCzSOXvycy2EWE75jY0bi+31lmJ/XrVN+FBP2puFX2 O5I4jor9CoH8Oen3cAk2p+3oh034OVN6i+knJG1ofzLMGoKEnDiRLdHSAxxqEoMOQnjY dLVS+xMNZATswQ2iWaOtIpc/IBnOnESD0U4AHqaoVR7F7KBXUt29PBRGbWJPzwDGFcHs GZEDLnx0O+VhiavbYoQvGAcomnBcgnDGKN+OesaEdxPYD/reW16Iuzy6YsN3bUkj0yfH Q3mw== X-Received: by 10.66.26.106 with SMTP id k10mr72431401pag.136.1388439261391; Mon, 30 Dec 2013 13:34:21 -0800 (PST) MIME-Version: 1.0 Received: by 10.68.220.225 with HTTP; Mon, 30 Dec 2013 13:33:51 -0800 (PST) From: Flako Date: Mon, 30 Dec 2013 19:33:51 -0200 Message-ID: To: "xen-users@lists.xensource.com" Subject: [Xen-users] "BSOD STOP : 0x000000F4" installing gplpv_Vista2008x32_0.11.0.372 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hello I try to install in windows7 Pro gplpv_Vista2008x32_0.11.0.372.msi in SLES 11 SP2 (kernel 3.0.13-0.27-xen/xen-libs-4.1.2 ) When I install GPLPV generates a BSOD 'STOP : 0x000000F4 ' or domU freezes. Apparently the BSOD is associated to a disk freeze/latency and coresponds with compartments of domU (sometimes you can move windows , but when you open a file domU freezes) I'm not finding a layer of error code that allows me to keep looking on the internet. The steps I follow to install are: 1. Sign domU 2 . bcdedit / set testsigning on 3 . reboot 4 install gplpv_Vista2008x32_0.11.0.372.msi my domu.cfg is : name = "windows7" maxmem = 2036 memory = 2036 vcpus = 2 builder = "hvm" kernel = "/usr/lib/xen/boot/hvmloader" acpi = 1 apic = 1 viridian = 0 localtime = 1 hpet = 0 on_poweroff = "destroy" on_reboot = "restart" on_crash = "destroy" device_model = "/usr/lib/xen/bin/qemu-dm" usb = 1 usbdevice = "tablet" vfb = [ "type=vnc,vncunused=1,keymap=es" ] disk = [ "tap:qcow2:/mnt/util/xen-images/windows7/disco1.qcow,hda,w" parallel = "none" serial = "pty" I missing something in this step ? Or is something wrong in the settings ? Thanks, and excuse the English . the log gplpv_Vista2008x32_0.11.0.372.msi log file of the execution https://drive.google.com/file/d/0B8rkUchOnWAKU3JTYVk4NG9ta00/edit?usp=sharing 1 - StartW7.tar.gz log dom0 and domU at startup before installing GPLPV https://drive.google.com/file/d/0B8rkUchOnWAKeFFiRURScThHVXM/edit?usp=sharing 2 -Crash - StartAfterInsrall.tar.gz : log the domU after the failed installation of GPLPV, contains the BSOD and startup domU https://drive.google.com/file/d/0B8rkUchOnWAKQ1RFakREQmxnOEU/edit?usp=sharing _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 30 23:02:40 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 30 Dec 2013 23:02:40 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxlqG-000886-QX; Mon, 30 Dec 2013 23:01:48 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxlqE-000881-I4 for xen-users@lists.xensource.com; Mon, 30 Dec 2013 23:01:46 +0000 Received: from [193.109.254.147:8194] by server-4.bemta-14.messagelabs.com id 41/91-03916-95BF1C25; Mon, 30 Dec 2013 23:01:45 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-5.tower-27.messagelabs.com!1388444502!8122802!1 X-Originating-IP: [203.16.224.4] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 4300 invoked from network); 30 Dec 2013 23:01:45 -0000 Received: from smtp1.bendigoit.com.au (HELO smtp1.bendigoit.com.au) (203.16.224.4) by server-5.tower-27.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 30 Dec 2013 23:01:45 -0000 Received: from smtp2.bendigoit.com.au ([203.16.207.99] helo=BITCOM1.int.sbss.com.au) by smtp1.bendigoit.com.au with esmtp (Exim 4.80) (envelope-from ) id 1Vxlqm-0006Dl-CB; Tue, 31 Dec 2013 10:02:20 +1100 Received: from BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d]) by BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d%12]) with mapi id 14.03.0174.001; Tue, 31 Dec 2013 10:01:37 +1100 From: James Harper To: Flako , "xen-users@lists.xensource.com" Thread-Topic: [Xen-users] "BSOD STOP : 0x000000F4" installing gplpv_Vista2008x32_0.11.0.372 Thread-Index: AQHPBahTyHieiWoCX02yv7x3d7KpYpptWg9Q Date: Mon, 30 Dec 2013 23:01:36 +0000 Message-ID: <6035A0D088A63A46850C3988ED045A4B6856D43F@BITCOM1.int.sbss.com.au> References: In-Reply-To: Accept-Language: en-AU, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.16.3.241] x-tm-as-product-ver: SMEX-11.0.0.1191-7.000.1014-20396.002 x-tm-as-result: No--34.334100-0.000000-31 x-tm-as-user-approved-sender: Yes x-tm-as-user-blocked-sender: No MIME-Version: 1.0 X-Really-From-Bendigo-IT: magichashvalue Subject: Re: [Xen-users] "BSOD STOP : 0x000000F4" installing gplpv_Vista2008x32_0.11.0.372 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > Hello > I try to install in windows7 Pro gplpv_Vista2008x32_0.11.0.372.msi in > SLES 11 SP2 (kernel 3.0.13-0.27-xen/xen-libs-4.1.2 ) > When I install GPLPV generates a BSOD 'STOP : 0x000000F4 ' or domU > freezes. > Apparently the BSOD is associated to a disk freeze/latency and > coresponds with compartments of domU (sometimes you can move > windows , > but when you open a file domU freezes) > You'll need to use the debug version for anything useful to be in those logs. Please try the latest version from http://www.ejbdigital.com.au/GPLPV - no need for enabling testsigning. If you can get a crash with the debug version, send me the logs and I'll take a look. James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Mon Dec 30 23:02:40 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Mon, 30 Dec 2013 23:02:40 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxlqG-000886-QX; Mon, 30 Dec 2013 23:01:48 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxlqE-000881-I4 for xen-users@lists.xensource.com; Mon, 30 Dec 2013 23:01:46 +0000 Received: from [193.109.254.147:8194] by server-4.bemta-14.messagelabs.com id 41/91-03916-95BF1C25; Mon, 30 Dec 2013 23:01:45 +0000 X-Env-Sender: james.harper@bendigoit.com.au X-Msg-Ref: server-5.tower-27.messagelabs.com!1388444502!8122802!1 X-Originating-IP: [203.16.224.4] X-SpamReason: No, hits=0.0 required=7.0 tests= X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 4300 invoked from network); 30 Dec 2013 23:01:45 -0000 Received: from smtp1.bendigoit.com.au (HELO smtp1.bendigoit.com.au) (203.16.224.4) by server-5.tower-27.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 30 Dec 2013 23:01:45 -0000 Received: from smtp2.bendigoit.com.au ([203.16.207.99] helo=BITCOM1.int.sbss.com.au) by smtp1.bendigoit.com.au with esmtp (Exim 4.80) (envelope-from ) id 1Vxlqm-0006Dl-CB; Tue, 31 Dec 2013 10:02:20 +1100 Received: from BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d]) by BITCOM1.int.sbss.com.au ([fe80::a5ca:4fd3:14f:ad5d%12]) with mapi id 14.03.0174.001; Tue, 31 Dec 2013 10:01:37 +1100 From: James Harper To: Flako , "xen-users@lists.xensource.com" Thread-Topic: [Xen-users] "BSOD STOP : 0x000000F4" installing gplpv_Vista2008x32_0.11.0.372 Thread-Index: AQHPBahTyHieiWoCX02yv7x3d7KpYpptWg9Q Date: Mon, 30 Dec 2013 23:01:36 +0000 Message-ID: <6035A0D088A63A46850C3988ED045A4B6856D43F@BITCOM1.int.sbss.com.au> References: In-Reply-To: Accept-Language: en-AU, en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: x-originating-ip: [172.16.3.241] x-tm-as-product-ver: SMEX-11.0.0.1191-7.000.1014-20396.002 x-tm-as-result: No--34.334100-0.000000-31 x-tm-as-user-approved-sender: Yes x-tm-as-user-blocked-sender: No MIME-Version: 1.0 X-Really-From-Bendigo-IT: magichashvalue Subject: Re: [Xen-users] "BSOD STOP : 0x000000F4" installing gplpv_Vista2008x32_0.11.0.372 X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org > Hello > I try to install in windows7 Pro gplpv_Vista2008x32_0.11.0.372.msi in > SLES 11 SP2 (kernel 3.0.13-0.27-xen/xen-libs-4.1.2 ) > When I install GPLPV generates a BSOD 'STOP : 0x000000F4 ' or domU > freezes. > Apparently the BSOD is associated to a disk freeze/latency and > coresponds with compartments of domU (sometimes you can move > windows , > but when you open a file domU freezes) > You'll need to use the debug version for anything useful to be in those logs. Please try the latest version from http://www.ejbdigital.com.au/GPLPV - no need for enabling testsigning. If you can get a crash with the debug version, send me the logs and I'll take a look. James _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 01:22:08 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 01:22:08 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxo16-0008TC-Pw; Tue, 31 Dec 2013 01:21:08 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxo15-0008T4-Qi for xen-users@lists.xen.org; Tue, 31 Dec 2013 01:21:08 +0000 Received: from [85.158.137.68:11689] by server-14.bemta-3.messagelabs.com id 2C/E7-06105-30C12C25; Tue, 31 Dec 2013 01:21:07 +0000 X-Env-Sender: bitcog@gmail.com X-Msg-Ref: server-6.tower-31.messagelabs.com!1388452865!6573280!1 X-Originating-IP: [209.85.128.43] X-SpamReason: No, hits=1.2 required=7.0 tests=HTML_10_20,HTML_MESSAGE, RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 19248 invoked from network); 31 Dec 2013 01:21:06 -0000 Received: from mail-qe0-f43.google.com (HELO mail-qe0-f43.google.com) (209.85.128.43) by server-6.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 01:21:06 -0000 Received: by mail-qe0-f43.google.com with SMTP id jy17so11998193qeb.2 for ; Mon, 30 Dec 2013 17:21:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=mohELX8A/VbBh06H3HzTLzBhQ93zDnBlc/aszUrzKMw=; b=ydgPOUENXGkjr6qGkl6vUeYcwExVx9sz506JyuMyoGrr//StkvvacgmQCNb6bRQPGD N+PZmGKmqrzwCcspHDVxwmyL8m89P7VbFaFRzBzn/fs5VLQYH6JyvtvhShjvBiFsaWPD efQnpmUW6YnpUbiPH41LlKCXxpRDZkaxNiOwqoELJQB+cOjoXAA30CYBMW4J/siAaJq5 0WxvrwVv05soD9R0oqp6yhTgGaVncfWlrXpqf6dnIs0Ro0pGm/rSG/eoks3ARTA4FMkJ ilrUnQhDune9I15vdalNet0pcEz42lNeqjCskYPPCFTs36OHm9aKkJvPJq/2CQ8mOGHa 0WlA== MIME-Version: 1.0 X-Received: by 10.229.13.133 with SMTP id c5mr112414137qca.22.1388452864750; Mon, 30 Dec 2013 17:21:04 -0800 (PST) Received: by 10.224.188.146 with HTTP; Mon, 30 Dec 2013 17:21:04 -0800 (PST) Date: Tue, 31 Dec 2013 12:21:04 +1100 X-Google-Sender-Auth: qrsFE9t0kGi-HviLZxUOx9XSqgA Message-ID: From: Douglas Turner To: xen-users@lists.xen.org Subject: [Xen-users] Mouse pointer offset in PV DomU X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============8078878308222874244==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============8078878308222874244== Content-Type: multipart/alternative; boundary=001a11330e60ca8af304eeca5fcf --001a11330e60ca8af304eeca5fcf Content-Type: text/plain; charset=ISO-8859-1 Hi, I'm using the vfb of my PV DomU via VNC using this line in my xmdomain.cfg file: vfb = [ 'type=vnc,vncdisplay=1,vnclisten=192.168.1.117' ] This all works fine and gives me a displays size of 800x600. When I increase the resolution using this line in my xmdomain.cfg file, the pointer in the DomU becomes offset away from the top-left corner of the display: extra = 'xen-fbfront.video=8,928,696' At the top-left corner of the display, the DomU pointer lines up witht the Dom0 pointer. The further I move from the top-left corner, the more the DomU pointer becomes offset. I've seen problems like this discussed back in 2006/2007, but haven't seen anything recently. The details of my setup are: Dom0: distribution: debian wheezy kenel: 3.2.0-4-amd64 xen version: 4.1.4-3+deb7u1 DomU: distribution: debian wheezy kenel: 3.2.0-4-amd64 created using: xen-tools Regards, Douglas --001a11330e60ca8af304eeca5fcf Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi,

I'm using the vfb of my PV DomU via VNC usi= ng this line in my
xmdomain.cfg file:

=A0=A0=A0 vfb =3D [ 'ty= pe=3Dvnc,vncdisplay=3D1,vnclisten=3D192.168.1.117' ]

This all wo= rks fine and gives me a displays size of 800x600. When
I increase the resolution using this line in my xmdomain.cfg file,
the p= ointer in the DomU becomes offset away from the top-left
corner of the d= isplay:

=A0=A0=A0 extra =3D 'xen-fbfront.video=3D8,928,696'<= br>
At the top-left corner of the display, the DomU pointer lines up
witht t= he Dom0 pointer.=A0 The further I move from the top-left
corner, the mor= e the DomU pointer becomes offset.

I've seen problems like this = discussed back in 2006/2007, but
haven't seen anything recently.

The details of my setup are:
=
Dom0:
=A0=A0 distribution: debian wheezy
=A0=A0 kenel: 3.2.0-4-am= d64
=A0=A0 xen version: 4.1.4-3+deb7u1

DomU:
=A0=A0 distributi= on: debian wheezy
=A0=A0 kenel: 3.2.0-4-amd64
=A0=A0 created using: xen-tools

Regar= ds,

Douglas


--001a11330e60ca8af304eeca5fcf-- --===============8078878308222874244== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============8078878308222874244==-- From xen-users-bounces@lists.xen.org Tue Dec 31 01:22:08 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 01:22:08 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxo16-0008TC-Pw; Tue, 31 Dec 2013 01:21:08 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxo15-0008T4-Qi for xen-users@lists.xen.org; Tue, 31 Dec 2013 01:21:08 +0000 Received: from [85.158.137.68:11689] by server-14.bemta-3.messagelabs.com id 2C/E7-06105-30C12C25; Tue, 31 Dec 2013 01:21:07 +0000 X-Env-Sender: bitcog@gmail.com X-Msg-Ref: server-6.tower-31.messagelabs.com!1388452865!6573280!1 X-Originating-IP: [209.85.128.43] X-SpamReason: No, hits=1.2 required=7.0 tests=HTML_10_20,HTML_MESSAGE, RCVD_BY_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 19248 invoked from network); 31 Dec 2013 01:21:06 -0000 Received: from mail-qe0-f43.google.com (HELO mail-qe0-f43.google.com) (209.85.128.43) by server-6.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 01:21:06 -0000 Received: by mail-qe0-f43.google.com with SMTP id jy17so11998193qeb.2 for ; Mon, 30 Dec 2013 17:21:04 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=mime-version:sender:date:message-id:subject:from:to:content-type; bh=mohELX8A/VbBh06H3HzTLzBhQ93zDnBlc/aszUrzKMw=; b=ydgPOUENXGkjr6qGkl6vUeYcwExVx9sz506JyuMyoGrr//StkvvacgmQCNb6bRQPGD N+PZmGKmqrzwCcspHDVxwmyL8m89P7VbFaFRzBzn/fs5VLQYH6JyvtvhShjvBiFsaWPD efQnpmUW6YnpUbiPH41LlKCXxpRDZkaxNiOwqoELJQB+cOjoXAA30CYBMW4J/siAaJq5 0WxvrwVv05soD9R0oqp6yhTgGaVncfWlrXpqf6dnIs0Ro0pGm/rSG/eoks3ARTA4FMkJ ilrUnQhDune9I15vdalNet0pcEz42lNeqjCskYPPCFTs36OHm9aKkJvPJq/2CQ8mOGHa 0WlA== MIME-Version: 1.0 X-Received: by 10.229.13.133 with SMTP id c5mr112414137qca.22.1388452864750; Mon, 30 Dec 2013 17:21:04 -0800 (PST) Received: by 10.224.188.146 with HTTP; Mon, 30 Dec 2013 17:21:04 -0800 (PST) Date: Tue, 31 Dec 2013 12:21:04 +1100 X-Google-Sender-Auth: qrsFE9t0kGi-HviLZxUOx9XSqgA Message-ID: From: Douglas Turner To: xen-users@lists.xen.org Subject: [Xen-users] Mouse pointer offset in PV DomU X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============8078878308222874244==" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org --===============8078878308222874244== Content-Type: multipart/alternative; boundary=001a11330e60ca8af304eeca5fcf --001a11330e60ca8af304eeca5fcf Content-Type: text/plain; charset=ISO-8859-1 Hi, I'm using the vfb of my PV DomU via VNC using this line in my xmdomain.cfg file: vfb = [ 'type=vnc,vncdisplay=1,vnclisten=192.168.1.117' ] This all works fine and gives me a displays size of 800x600. When I increase the resolution using this line in my xmdomain.cfg file, the pointer in the DomU becomes offset away from the top-left corner of the display: extra = 'xen-fbfront.video=8,928,696' At the top-left corner of the display, the DomU pointer lines up witht the Dom0 pointer. The further I move from the top-left corner, the more the DomU pointer becomes offset. I've seen problems like this discussed back in 2006/2007, but haven't seen anything recently. The details of my setup are: Dom0: distribution: debian wheezy kenel: 3.2.0-4-amd64 xen version: 4.1.4-3+deb7u1 DomU: distribution: debian wheezy kenel: 3.2.0-4-amd64 created using: xen-tools Regards, Douglas --001a11330e60ca8af304eeca5fcf Content-Type: text/html; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable
Hi,

I'm using the vfb of my PV DomU via VNC usi= ng this line in my
xmdomain.cfg file:

=A0=A0=A0 vfb =3D [ 'ty= pe=3Dvnc,vncdisplay=3D1,vnclisten=3D192.168.1.117' ]

This all wo= rks fine and gives me a displays size of 800x600. When
I increase the resolution using this line in my xmdomain.cfg file,
the p= ointer in the DomU becomes offset away from the top-left
corner of the d= isplay:

=A0=A0=A0 extra =3D 'xen-fbfront.video=3D8,928,696'<= br>
At the top-left corner of the display, the DomU pointer lines up
witht t= he Dom0 pointer.=A0 The further I move from the top-left
corner, the mor= e the DomU pointer becomes offset.

I've seen problems like this = discussed back in 2006/2007, but
haven't seen anything recently.

The details of my setup are:
=
Dom0:
=A0=A0 distribution: debian wheezy
=A0=A0 kenel: 3.2.0-4-am= d64
=A0=A0 xen version: 4.1.4-3+deb7u1

DomU:
=A0=A0 distributi= on: debian wheezy
=A0=A0 kenel: 3.2.0-4-amd64
=A0=A0 created using: xen-tools

Regar= ds,

Douglas


--001a11330e60ca8af304eeca5fcf-- --===============8078878308222874244== Content-Type: text/plain; charset="us-ascii" MIME-Version: 1.0 Content-Transfer-Encoding: 7bit Content-Disposition: inline _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users --===============8078878308222874244==-- From xen-users-bounces@lists.xen.org Tue Dec 31 02:33:11 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 02:33:11 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxp80-0002ke-5s; Tue, 31 Dec 2013 02:32:20 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxp7y-0002kZ-3h for xen-users@lists.xen.org; Tue, 31 Dec 2013 02:32:18 +0000 Received: from [85.158.139.211:58373] by server-16.bemta-5.messagelabs.com id F8/B4-11843-1BC22C25; Tue, 31 Dec 2013 02:32:17 +0000 X-Env-Sender: darren.s.shepherd@gmail.com X-Msg-Ref: server-5.tower-206.messagelabs.com!1388457134!7181946!1 X-Originating-IP: [209.85.192.173] X-SpamReason: No, hits=0.2 required=7.0 tests=MIME_QP_LONG_LINE, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 4630 invoked from network); 31 Dec 2013 02:32:16 -0000 Received: from mail-pd0-f173.google.com (HELO mail-pd0-f173.google.com) (209.85.192.173) by server-5.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 02:32:16 -0000 Received: by mail-pd0-f173.google.com with SMTP id p10so11895975pdj.4 for ; Mon, 30 Dec 2013 18:32:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:from:content-type:message-id:date:to :content-transfer-encoding:mime-version; bh=0bUPQPt9NT3OfnHD1lD3kV/EJTkZVfNZcdgAYmDZVj4=; b=yPgppibbF6gZlV/xeUDTb73InW/fA4heb1Do/Ei5oHO+xsMdyBJyCSYZCFGL1zsvnQ u+xRbwN+7Yw+cbUghRtEetTMRmEmzI2YzcRsocB50MPDO0OsSi1Ztp6Sz2E+2AS7zaDN 540dDh8zvQKEqXnoUcY/LiaUmVnvqmSTsquFoNx4NXl+I8A2xhhoX2Q2tZQF8eWTKV3H 0DnjdpSH6A6H0uVR4JF+tQbtTo23KH6Sw5D+uWIo37692VnhsYpokG+uvsxIwx0UN9ug 7Tm1AKZMfV9VLwEcS6M4L4A615zKIUpLtjzT+/IyJscOmHMP1m6NPmpEuNx/2Oz+XKQg 3/JA== X-Received: by 10.66.249.134 with SMTP id yu6mr71826509pac.37.1388457134363; Mon, 30 Dec 2013 18:32:14 -0800 (PST) Received: from [192.168.0.3] (ip70-171-196-127.tc.ph.cox.net. [70.171.196.127]) by mx.google.com with ESMTPSA id e6sm84628185pbg.4.2013.12.30.18.32.12 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 30 Dec 2013 18:32:13 -0800 (PST) From: Darren Shepherd X-Mailer: iPhone Mail (11B554a) Message-Id: <888F5FC9-F149-47A2-923D-A5A85104C634@gmail.com> Date: Mon, 30 Dec 2013 19:32:11 -0700 To: xen-users@lists.xen.org Mime-Version: 1.0 (1.0) Subject: [Xen-users] What's the easiest route for ARM X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org I really want to get xen running on arm and was curious what would be the best device to use to get running. Ideally I'm looking for the same hardware the majority of the recent arm development has been done on. I was looking at getting an arndale board or the new octo. It seems like its a four week wait to get one, so I wanted to first make sure that that is a good board for xen or maybe there's a better route. Anybody have experience in getting xen running on arm? I'm fine with patching and compiling things, but I'm not really capable of having to do real arm hacking. Darren _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 02:33:11 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 02:33:11 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxp80-0002ke-5s; Tue, 31 Dec 2013 02:32:20 +0000 Received: from mail6.bemta5.messagelabs.com ([195.245.231.135]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxp7y-0002kZ-3h for xen-users@lists.xen.org; Tue, 31 Dec 2013 02:32:18 +0000 Received: from [85.158.139.211:58373] by server-16.bemta-5.messagelabs.com id F8/B4-11843-1BC22C25; Tue, 31 Dec 2013 02:32:17 +0000 X-Env-Sender: darren.s.shepherd@gmail.com X-Msg-Ref: server-5.tower-206.messagelabs.com!1388457134!7181946!1 X-Originating-IP: [209.85.192.173] X-SpamReason: No, hits=0.2 required=7.0 tests=MIME_QP_LONG_LINE, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 4630 invoked from network); 31 Dec 2013 02:32:16 -0000 Received: from mail-pd0-f173.google.com (HELO mail-pd0-f173.google.com) (209.85.192.173) by server-5.tower-206.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 02:32:16 -0000 Received: by mail-pd0-f173.google.com with SMTP id p10so11895975pdj.4 for ; Mon, 30 Dec 2013 18:32:14 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=subject:from:content-type:message-id:date:to :content-transfer-encoding:mime-version; bh=0bUPQPt9NT3OfnHD1lD3kV/EJTkZVfNZcdgAYmDZVj4=; b=yPgppibbF6gZlV/xeUDTb73InW/fA4heb1Do/Ei5oHO+xsMdyBJyCSYZCFGL1zsvnQ u+xRbwN+7Yw+cbUghRtEetTMRmEmzI2YzcRsocB50MPDO0OsSi1Ztp6Sz2E+2AS7zaDN 540dDh8zvQKEqXnoUcY/LiaUmVnvqmSTsquFoNx4NXl+I8A2xhhoX2Q2tZQF8eWTKV3H 0DnjdpSH6A6H0uVR4JF+tQbtTo23KH6Sw5D+uWIo37692VnhsYpokG+uvsxIwx0UN9ug 7Tm1AKZMfV9VLwEcS6M4L4A615zKIUpLtjzT+/IyJscOmHMP1m6NPmpEuNx/2Oz+XKQg 3/JA== X-Received: by 10.66.249.134 with SMTP id yu6mr71826509pac.37.1388457134363; Mon, 30 Dec 2013 18:32:14 -0800 (PST) Received: from [192.168.0.3] (ip70-171-196-127.tc.ph.cox.net. [70.171.196.127]) by mx.google.com with ESMTPSA id e6sm84628185pbg.4.2013.12.30.18.32.12 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Mon, 30 Dec 2013 18:32:13 -0800 (PST) From: Darren Shepherd X-Mailer: iPhone Mail (11B554a) Message-Id: <888F5FC9-F149-47A2-923D-A5A85104C634@gmail.com> Date: Mon, 30 Dec 2013 19:32:11 -0700 To: xen-users@lists.xen.org Mime-Version: 1.0 (1.0) Subject: [Xen-users] What's the easiest route for ARM X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org I really want to get xen running on arm and was curious what would be the best device to use to get running. Ideally I'm looking for the same hardware the majority of the recent arm development has been done on. I was looking at getting an arndale board or the new octo. It seems like its a four week wait to get one, so I wanted to first make sure that that is a good board for xen or maybe there's a better route. Anybody have experience in getting xen running on arm? I'm fine with patching and compiling things, but I'm not really capable of having to do real arm hacking. Darren _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 10:26:28 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 10:26:28 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxwVj-0001dR-GB; Tue, 31 Dec 2013 10:25:19 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxwVh-0001dM-Tn for xen-users@lists.xen.org; Tue, 31 Dec 2013 10:25:18 +0000 Received: from [85.158.143.35:41719] by server-1.bemta-4.messagelabs.com id 6C/E1-02132-D8B92C25; Tue, 31 Dec 2013 10:25:17 +0000 X-Env-Sender: mlg-hessigheim@gmx.de X-Msg-Ref: server-15.tower-21.messagelabs.com!1388485516!6267451!1 X-Originating-IP: [212.227.17.21] X-SpamReason: No, hits=0.5 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjIxID0+IDI1Mjg0\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjIxID0+IDI1Mjg0\n,BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 4745 invoked from network); 31 Dec 2013 10:25:16 -0000 Received: from mout.gmx.net (HELO mout.gmx.net) (212.227.17.21) by server-15.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 31 Dec 2013 10:25:16 -0000 Received: from [192.168.2.101] ([91.89.92.96]) by mail.gmx.com (mrgmx102) with ESMTPSA (Nemesis) id 0MUm1o-1VwvOy0IsW-00YDGS for ; Tue, 31 Dec 2013 11:25:16 +0100 Message-ID: <52C29B8B.3010709@gmx.de> Date: Tue, 31 Dec 2013 11:25:15 +0100 From: Martin Lang User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: "xen-users@lists.xen.org" X-Provags-ID: V03:K0:c/rOUWbPwCbvJy7Iq6EpFDOzU2aNhhYqe6zUSpeK3NYlHF9yr0M fqqTYs0paiuMIaskX0cuCdYuW5ShuM4aPtqccNHyW/6pOJJANNL44RBIAUuF14LzwEpOKRx 5qAP+mg3HH7SgMKH1oKF3942wEqrCCqfCb6aNoGQs3CsPATblKNt0ee7qI9hF9qIOU1ETlS 6Q+rAQ206+87m0Zoyy/IQ== Subject: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi all, I have a problem with my Dom0 crashing. Stack trace is below. At startup everything is o.k. The crash happens whenever I have some network traffic. Any help is highly appreciated. Martin Dec 30 19:44:15 xenix kernel: [ 601.008080] ------------[ cut here ]------------ Dec 30 19:44:15 xenix kernel: [ 601.008118] WARNING: CPU: 0 PID: 0 at /build/linux-tAcKXn/linux-3.11.10/net/sched/sch_generic.c:260 dev_watchdog+0x1ca/0x1e0() Dec 30 19:44:15 xenix kernel: [ 601.008124] NETDEV WATCHDOG: eth1 (8139too): transmit queue 0 timed out Dec 30 19:44:15 xenix kernel: [ 601.008128] Modules linked in: xt_physdev iptable_filter ip_tables x_tables xen_netback xen_blkback xen_gntdev xen_evtchn xenfs xen_privcmd bridge stp llc loop arc4 ath9k ath9k_common ath9k_hw snd_wavefront snd_cs4236 ath snd_opl3_lib microcode mac80211 snd_hwdep snd_wss_lib snd_intel8x0 snd_ac97_codec snd_mpu401 evdev cfg80211 pcspkr snd_pcm rfkill snd_mpu401_uart psmouse serio_raw snd_page_alloc snd_timer ac97_bus snd_rawmidi snd_seq_device snd soundcore ns558 gameport parport_pc parport mperf i2c_sis96x i2c_sis630 processor thermal_sys button i2c_core shpchp ext4 crc16 mbcache jbd2 dm_mod sg sd_mod sr_mod crc_t10dif cdrom ata_generic pata_sis 8139too libata 8139cp e100 scsi_mod mii floppy ohci_pci ohci_hcd ehci_hcd usbcore usb_common Dec 30 19:44:15 xenix kernel: [ 601.008250] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.11-2-686-pae #1 Debian 3.11.10-1 Dec 30 19:44:15 xenix kernel: [ 601.008255] Hardware name: ECS K7S5A /K7S5A , BIOS 07.00T Dec 30 19:44:15 xenix kernel: [ 601.008261] 00000009 c13e5bc3 e800bf1c c1049d8e c14f3de8 e800bf34 00000000 c14f3e24 Dec 30 19:44:15 xenix kernel: [ 601.008272] 00000104 c1334c9a c1334c9a 00000000 e8318800 000005dc 000125f4 c1049de3 Dec 30 19:44:15 xenix kernel: [ 601.008281] 00000009 e800bf1c c14f3de8 e800bf34 c1334c9a c14f3e24 00000104 c14f3de8 Dec 30 19:44:15 xenix kernel: [ 601.008291] Call Trace: Dec 30 19:44:15 xenix kernel: [ 601.008309] [] ? dump_stack+0x3e/0x4e Dec 30 19:44:15 xenix kernel: [ 601.008326] [] ? warn_slowpath_common+0x7e/0xa0 Dec 30 19:44:15 xenix kernel: [ 601.008334] [] ? dev_watchdog+0x1ca/0x1e0 Dec 30 19:44:15 xenix kernel: [ 601.008341] [] ? dev_watchdog+0x1ca/0x1e0 Dec 30 19:44:15 xenix kernel: [ 601.008349] [] ? warn_slowpath_fmt+0x33/0x40 Dec 30 19:44:15 xenix kernel: [ 601.008356] [] ? dev_watchdog+0x1ca/0x1e0 Dec 30 19:44:15 xenix kernel: [ 601.008371] [] ? dev_graft_qdisc+0x60/0x60 Dec 30 19:44:15 xenix kernel: [ 601.008385] [] ? call_timer_fn+0x28/0xd0 Dec 30 19:44:15 xenix kernel: [ 601.008396] [] ? __wake_up+0x30/0x50 Dec 30 19:44:15 xenix kernel: [ 601.008403] [] ? dev_graft_qdisc+0x60/0x60 Dec 30 19:44:15 xenix kernel: [ 601.008412] [] ? run_timer_softirq+0x157/0x220 Dec 30 19:44:15 xenix kernel: [ 601.008420] [] ? __do_softirq+0xbe/0x1e0 Dec 30 19:44:15 xenix kernel: [ 601.008428] [] ? send_remote_softirq+0x40/0x40 Dec 30 19:44:15 xenix kernel: [ 601.008432] [] ? irq_exit+0x85/0x90 Dec 30 19:44:15 xenix kernel: [ 601.008451] [] ? xen_evtchn_do_upcall+0x1d/0x30 Dec 30 19:44:15 xenix kernel: [ 601.008461] [] ? xen_do_upcall+0x7/0xc Dec 30 19:44:15 xenix kernel: [ 601.008471] [] ? xen_hypercall_sched_op+0x7/0x20 Dec 30 19:44:15 xenix kernel: [ 601.008483] [] ? xen_safe_halt+0xf/0x20 Dec 30 19:44:15 xenix kernel: [ 601.008493] [] ? default_idle+0x18/0xa0 Dec 30 19:44:15 xenix kernel: [ 601.008500] [] ? arch_cpu_idle+0x16/0x20 Dec 30 19:44:15 xenix kernel: [ 601.008511] [] ? cpu_startup_entry+0x146/0x200 Dec 30 19:44:15 xenix kernel: [ 601.008520] [] ? start_kernel+0x38c/0x391 Dec 30 19:44:15 xenix kernel: [ 601.008527] [] ? repair_env_string+0x4d/0x4d Dec 30 19:44:15 xenix kernel: [ 601.008536] [] ? xen_start_kernel+0x663/0x66e Dec 30 19:44:15 xenix kernel: [ 601.008543] ---[ end trace 2e9d0e06d1993fae ]--- _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 10:26:28 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 10:26:28 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxwVj-0001dR-GB; Tue, 31 Dec 2013 10:25:19 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxwVh-0001dM-Tn for xen-users@lists.xen.org; Tue, 31 Dec 2013 10:25:18 +0000 Received: from [85.158.143.35:41719] by server-1.bemta-4.messagelabs.com id 6C/E1-02132-D8B92C25; Tue, 31 Dec 2013 10:25:17 +0000 X-Env-Sender: mlg-hessigheim@gmx.de X-Msg-Ref: server-15.tower-21.messagelabs.com!1388485516!6267451!1 X-Originating-IP: [212.227.17.21] X-SpamReason: No, hits=0.5 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjIxID0+IDI1Mjg0\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjIxID0+IDI1Mjg0\n,BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 4745 invoked from network); 31 Dec 2013 10:25:16 -0000 Received: from mout.gmx.net (HELO mout.gmx.net) (212.227.17.21) by server-15.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 31 Dec 2013 10:25:16 -0000 Received: from [192.168.2.101] ([91.89.92.96]) by mail.gmx.com (mrgmx102) with ESMTPSA (Nemesis) id 0MUm1o-1VwvOy0IsW-00YDGS for ; Tue, 31 Dec 2013 11:25:16 +0100 Message-ID: <52C29B8B.3010709@gmx.de> Date: Tue, 31 Dec 2013 11:25:15 +0100 From: Martin Lang User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: "xen-users@lists.xen.org" X-Provags-ID: V03:K0:c/rOUWbPwCbvJy7Iq6EpFDOzU2aNhhYqe6zUSpeK3NYlHF9yr0M fqqTYs0paiuMIaskX0cuCdYuW5ShuM4aPtqccNHyW/6pOJJANNL44RBIAUuF14LzwEpOKRx 5qAP+mg3HH7SgMKH1oKF3942wEqrCCqfCb6aNoGQs3CsPATblKNt0ee7qI9hF9qIOU1ETlS 6Q+rAQ206+87m0Zoyy/IQ== Subject: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Hi all, I have a problem with my Dom0 crashing. Stack trace is below. At startup everything is o.k. The crash happens whenever I have some network traffic. Any help is highly appreciated. Martin Dec 30 19:44:15 xenix kernel: [ 601.008080] ------------[ cut here ]------------ Dec 30 19:44:15 xenix kernel: [ 601.008118] WARNING: CPU: 0 PID: 0 at /build/linux-tAcKXn/linux-3.11.10/net/sched/sch_generic.c:260 dev_watchdog+0x1ca/0x1e0() Dec 30 19:44:15 xenix kernel: [ 601.008124] NETDEV WATCHDOG: eth1 (8139too): transmit queue 0 timed out Dec 30 19:44:15 xenix kernel: [ 601.008128] Modules linked in: xt_physdev iptable_filter ip_tables x_tables xen_netback xen_blkback xen_gntdev xen_evtchn xenfs xen_privcmd bridge stp llc loop arc4 ath9k ath9k_common ath9k_hw snd_wavefront snd_cs4236 ath snd_opl3_lib microcode mac80211 snd_hwdep snd_wss_lib snd_intel8x0 snd_ac97_codec snd_mpu401 evdev cfg80211 pcspkr snd_pcm rfkill snd_mpu401_uart psmouse serio_raw snd_page_alloc snd_timer ac97_bus snd_rawmidi snd_seq_device snd soundcore ns558 gameport parport_pc parport mperf i2c_sis96x i2c_sis630 processor thermal_sys button i2c_core shpchp ext4 crc16 mbcache jbd2 dm_mod sg sd_mod sr_mod crc_t10dif cdrom ata_generic pata_sis 8139too libata 8139cp e100 scsi_mod mii floppy ohci_pci ohci_hcd ehci_hcd usbcore usb_common Dec 30 19:44:15 xenix kernel: [ 601.008250] CPU: 0 PID: 0 Comm: swapper/0 Not tainted 3.11-2-686-pae #1 Debian 3.11.10-1 Dec 30 19:44:15 xenix kernel: [ 601.008255] Hardware name: ECS K7S5A /K7S5A , BIOS 07.00T Dec 30 19:44:15 xenix kernel: [ 601.008261] 00000009 c13e5bc3 e800bf1c c1049d8e c14f3de8 e800bf34 00000000 c14f3e24 Dec 30 19:44:15 xenix kernel: [ 601.008272] 00000104 c1334c9a c1334c9a 00000000 e8318800 000005dc 000125f4 c1049de3 Dec 30 19:44:15 xenix kernel: [ 601.008281] 00000009 e800bf1c c14f3de8 e800bf34 c1334c9a c14f3e24 00000104 c14f3de8 Dec 30 19:44:15 xenix kernel: [ 601.008291] Call Trace: Dec 30 19:44:15 xenix kernel: [ 601.008309] [] ? dump_stack+0x3e/0x4e Dec 30 19:44:15 xenix kernel: [ 601.008326] [] ? warn_slowpath_common+0x7e/0xa0 Dec 30 19:44:15 xenix kernel: [ 601.008334] [] ? dev_watchdog+0x1ca/0x1e0 Dec 30 19:44:15 xenix kernel: [ 601.008341] [] ? dev_watchdog+0x1ca/0x1e0 Dec 30 19:44:15 xenix kernel: [ 601.008349] [] ? warn_slowpath_fmt+0x33/0x40 Dec 30 19:44:15 xenix kernel: [ 601.008356] [] ? dev_watchdog+0x1ca/0x1e0 Dec 30 19:44:15 xenix kernel: [ 601.008371] [] ? dev_graft_qdisc+0x60/0x60 Dec 30 19:44:15 xenix kernel: [ 601.008385] [] ? call_timer_fn+0x28/0xd0 Dec 30 19:44:15 xenix kernel: [ 601.008396] [] ? __wake_up+0x30/0x50 Dec 30 19:44:15 xenix kernel: [ 601.008403] [] ? dev_graft_qdisc+0x60/0x60 Dec 30 19:44:15 xenix kernel: [ 601.008412] [] ? run_timer_softirq+0x157/0x220 Dec 30 19:44:15 xenix kernel: [ 601.008420] [] ? __do_softirq+0xbe/0x1e0 Dec 30 19:44:15 xenix kernel: [ 601.008428] [] ? send_remote_softirq+0x40/0x40 Dec 30 19:44:15 xenix kernel: [ 601.008432] [] ? irq_exit+0x85/0x90 Dec 30 19:44:15 xenix kernel: [ 601.008451] [] ? xen_evtchn_do_upcall+0x1d/0x30 Dec 30 19:44:15 xenix kernel: [ 601.008461] [] ? xen_do_upcall+0x7/0xc Dec 30 19:44:15 xenix kernel: [ 601.008471] [] ? xen_hypercall_sched_op+0x7/0x20 Dec 30 19:44:15 xenix kernel: [ 601.008483] [] ? xen_safe_halt+0xf/0x20 Dec 30 19:44:15 xenix kernel: [ 601.008493] [] ? default_idle+0x18/0xa0 Dec 30 19:44:15 xenix kernel: [ 601.008500] [] ? arch_cpu_idle+0x16/0x20 Dec 30 19:44:15 xenix kernel: [ 601.008511] [] ? cpu_startup_entry+0x146/0x200 Dec 30 19:44:15 xenix kernel: [ 601.008520] [] ? start_kernel+0x38c/0x391 Dec 30 19:44:15 xenix kernel: [ 601.008527] [] ? repair_env_string+0x4d/0x4d Dec 30 19:44:15 xenix kernel: [ 601.008536] [] ? xen_start_kernel+0x663/0x66e Dec 30 19:44:15 xenix kernel: [ 601.008543] ---[ end trace 2e9d0e06d1993fae ]--- _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 11:04:13 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 11:04:13 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxx6y-0003Bb-Se; Tue, 31 Dec 2013 11:03:48 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxx6x-0003BW-Hc for xen-users@lists.xen.org; Tue, 31 Dec 2013 11:03:47 +0000 Received: from [85.158.137.68:35361] by server-14.bemta-3.messagelabs.com id 9C/EE-06105-294A2C25; Tue, 31 Dec 2013 11:03:46 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-6.tower-31.messagelabs.com!1388487824!6627912!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 22412 invoked from network); 31 Dec 2013 11:03:45 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-6.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 11:03:45 -0000 X-IronPort-AV: E=Sophos;i="4.95,580,1384300800"; d="scan'208";a="88807695" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 31 Dec 2013 11:03:43 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Tue, 31 Dec 2013 06:03:42 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1Vxx6s-0004K0-J4; Tue, 31 Dec 2013 11:03:42 +0000 Date: Tue, 31 Dec 2013 11:03:42 +0000 From: Wei Liu To: Martin Lang Message-ID: <20131231110342.GB19696@zion.uk.xensource.com> References: <52C29B8B.3010709@gmx.de> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <52C29B8B.3010709@gmx.de> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: "xen-users@lists.xen.org" , wei.liu2@citrix.com Subject: Re: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, Dec 31, 2013 at 11:25:15AM +0100, Martin Lang wrote: > Hi all, > > I have a problem with my Dom0 crashing. Stack trace is below. At > startup everything is o.k. The crash happens whenever I have some > network traffic. > Any help is highly appreciated. > Your network queue times out which triggers the watchdog. I don't think your machine crashed. It just doesn't have network. Do you see the same thing when you use this kernel on baremetal? AFAICT the driver in question is not Xen related. Wei. > Martin > > Dec 30 19:44:15 xenix kernel: [ 601.008080] ------------[ cut here > ]------------ > Dec 30 19:44:15 xenix kernel: [ 601.008118] WARNING: CPU: 0 PID: 0 > at /build/linux-tAcKXn/linux-3.11.10/net/sched/sch_generic.c:260 > dev_watchdog+0x1ca/0x1e0() > Dec 30 19:44:15 xenix kernel: [ 601.008124] NETDEV WATCHDOG: eth1 > (8139too): transmit queue 0 timed out > Dec 30 19:44:15 xenix kernel: [ 601.008128] Modules linked in: > xt_physdev iptable_filter ip_tables x_tables xen_netback xen_blkback > xen_gntdev xen_evtchn xenfs xen_privcmd bridge stp llc loop arc4 > ath9k ath9k_common ath9k_hw snd_wavefront snd_cs4236 ath > snd_opl3_lib microcode mac80211 snd_hwdep snd_wss_lib snd_intel8x0 > snd_ac97_codec snd_mpu401 evdev cfg80211 pcspkr snd_pcm rfkill > snd_mpu401_uart psmouse serio_raw snd_page_alloc snd_timer ac97_bus > snd_rawmidi snd_seq_device snd soundcore ns558 gameport parport_pc > parport mperf i2c_sis96x i2c_sis630 processor thermal_sys button > i2c_core shpchp ext4 crc16 mbcache jbd2 dm_mod sg sd_mod sr_mod > crc_t10dif cdrom ata_generic pata_sis 8139too libata 8139cp e100 > scsi_mod mii floppy ohci_pci ohci_hcd ehci_hcd usbcore usb_common > Dec 30 19:44:15 xenix kernel: [ 601.008250] CPU: 0 PID: 0 Comm: > swapper/0 Not tainted 3.11-2-686-pae #1 Debian 3.11.10-1 > Dec 30 19:44:15 xenix kernel: [ 601.008255] Hardware name: ECS > K7S5A /K7S5A , BIOS 07.00T > Dec 30 19:44:15 xenix kernel: [ 601.008261] 00000009 c13e5bc3 > e800bf1c c1049d8e c14f3de8 e800bf34 00000000 c14f3e24 > Dec 30 19:44:15 xenix kernel: [ 601.008272] 00000104 c1334c9a > c1334c9a 00000000 e8318800 000005dc 000125f4 c1049de3 > Dec 30 19:44:15 xenix kernel: [ 601.008281] 00000009 e800bf1c > c14f3de8 e800bf34 c1334c9a c14f3e24 00000104 c14f3de8 > Dec 30 19:44:15 xenix kernel: [ 601.008291] Call Trace: > Dec 30 19:44:15 xenix kernel: [ 601.008309] [] ? > dump_stack+0x3e/0x4e > Dec 30 19:44:15 xenix kernel: [ 601.008326] [] ? > warn_slowpath_common+0x7e/0xa0 > Dec 30 19:44:15 xenix kernel: [ 601.008334] [] ? > dev_watchdog+0x1ca/0x1e0 > Dec 30 19:44:15 xenix kernel: [ 601.008341] [] ? > dev_watchdog+0x1ca/0x1e0 > Dec 30 19:44:15 xenix kernel: [ 601.008349] [] ? > warn_slowpath_fmt+0x33/0x40 > Dec 30 19:44:15 xenix kernel: [ 601.008356] [] ? > dev_watchdog+0x1ca/0x1e0 > Dec 30 19:44:15 xenix kernel: [ 601.008371] [] ? > dev_graft_qdisc+0x60/0x60 > Dec 30 19:44:15 xenix kernel: [ 601.008385] [] ? > call_timer_fn+0x28/0xd0 > Dec 30 19:44:15 xenix kernel: [ 601.008396] [] ? > __wake_up+0x30/0x50 > Dec 30 19:44:15 xenix kernel: [ 601.008403] [] ? > dev_graft_qdisc+0x60/0x60 > Dec 30 19:44:15 xenix kernel: [ 601.008412] [] ? > run_timer_softirq+0x157/0x220 > Dec 30 19:44:15 xenix kernel: [ 601.008420] [] ? > __do_softirq+0xbe/0x1e0 > Dec 30 19:44:15 xenix kernel: [ 601.008428] [] ? > send_remote_softirq+0x40/0x40 > Dec 30 19:44:15 xenix kernel: [ 601.008432] [] ? > irq_exit+0x85/0x90 > Dec 30 19:44:15 xenix kernel: [ 601.008451] [] ? > xen_evtchn_do_upcall+0x1d/0x30 > Dec 30 19:44:15 xenix kernel: [ 601.008461] [] ? > xen_do_upcall+0x7/0xc > Dec 30 19:44:15 xenix kernel: [ 601.008471] [] ? > xen_hypercall_sched_op+0x7/0x20 > Dec 30 19:44:15 xenix kernel: [ 601.008483] [] ? > xen_safe_halt+0xf/0x20 > Dec 30 19:44:15 xenix kernel: [ 601.008493] [] ? > default_idle+0x18/0xa0 > Dec 30 19:44:15 xenix kernel: [ 601.008500] [] ? > arch_cpu_idle+0x16/0x20 > Dec 30 19:44:15 xenix kernel: [ 601.008511] [] ? > cpu_startup_entry+0x146/0x200 > Dec 30 19:44:15 xenix kernel: [ 601.008520] [] ? > start_kernel+0x38c/0x391 > Dec 30 19:44:15 xenix kernel: [ 601.008527] [] ? > repair_env_string+0x4d/0x4d > Dec 30 19:44:15 xenix kernel: [ 601.008536] [] ? > xen_start_kernel+0x663/0x66e > Dec 30 19:44:15 xenix kernel: [ 601.008543] ---[ end trace > 2e9d0e06d1993fae ]--- > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 11:04:13 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 11:04:13 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxx6y-0003Bb-Se; Tue, 31 Dec 2013 11:03:48 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxx6x-0003BW-Hc for xen-users@lists.xen.org; Tue, 31 Dec 2013 11:03:47 +0000 Received: from [85.158.137.68:35361] by server-14.bemta-3.messagelabs.com id 9C/EE-06105-294A2C25; Tue, 31 Dec 2013 11:03:46 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-6.tower-31.messagelabs.com!1388487824!6627912!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 22412 invoked from network); 31 Dec 2013 11:03:45 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-6.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 11:03:45 -0000 X-IronPort-AV: E=Sophos;i="4.95,580,1384300800"; d="scan'208";a="88807695" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 31 Dec 2013 11:03:43 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Tue, 31 Dec 2013 06:03:42 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1Vxx6s-0004K0-J4; Tue, 31 Dec 2013 11:03:42 +0000 Date: Tue, 31 Dec 2013 11:03:42 +0000 From: Wei Liu To: Martin Lang Message-ID: <20131231110342.GB19696@zion.uk.xensource.com> References: <52C29B8B.3010709@gmx.de> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <52C29B8B.3010709@gmx.de> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: "xen-users@lists.xen.org" , wei.liu2@citrix.com Subject: Re: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, Dec 31, 2013 at 11:25:15AM +0100, Martin Lang wrote: > Hi all, > > I have a problem with my Dom0 crashing. Stack trace is below. At > startup everything is o.k. The crash happens whenever I have some > network traffic. > Any help is highly appreciated. > Your network queue times out which triggers the watchdog. I don't think your machine crashed. It just doesn't have network. Do you see the same thing when you use this kernel on baremetal? AFAICT the driver in question is not Xen related. Wei. > Martin > > Dec 30 19:44:15 xenix kernel: [ 601.008080] ------------[ cut here > ]------------ > Dec 30 19:44:15 xenix kernel: [ 601.008118] WARNING: CPU: 0 PID: 0 > at /build/linux-tAcKXn/linux-3.11.10/net/sched/sch_generic.c:260 > dev_watchdog+0x1ca/0x1e0() > Dec 30 19:44:15 xenix kernel: [ 601.008124] NETDEV WATCHDOG: eth1 > (8139too): transmit queue 0 timed out > Dec 30 19:44:15 xenix kernel: [ 601.008128] Modules linked in: > xt_physdev iptable_filter ip_tables x_tables xen_netback xen_blkback > xen_gntdev xen_evtchn xenfs xen_privcmd bridge stp llc loop arc4 > ath9k ath9k_common ath9k_hw snd_wavefront snd_cs4236 ath > snd_opl3_lib microcode mac80211 snd_hwdep snd_wss_lib snd_intel8x0 > snd_ac97_codec snd_mpu401 evdev cfg80211 pcspkr snd_pcm rfkill > snd_mpu401_uart psmouse serio_raw snd_page_alloc snd_timer ac97_bus > snd_rawmidi snd_seq_device snd soundcore ns558 gameport parport_pc > parport mperf i2c_sis96x i2c_sis630 processor thermal_sys button > i2c_core shpchp ext4 crc16 mbcache jbd2 dm_mod sg sd_mod sr_mod > crc_t10dif cdrom ata_generic pata_sis 8139too libata 8139cp e100 > scsi_mod mii floppy ohci_pci ohci_hcd ehci_hcd usbcore usb_common > Dec 30 19:44:15 xenix kernel: [ 601.008250] CPU: 0 PID: 0 Comm: > swapper/0 Not tainted 3.11-2-686-pae #1 Debian 3.11.10-1 > Dec 30 19:44:15 xenix kernel: [ 601.008255] Hardware name: ECS > K7S5A /K7S5A , BIOS 07.00T > Dec 30 19:44:15 xenix kernel: [ 601.008261] 00000009 c13e5bc3 > e800bf1c c1049d8e c14f3de8 e800bf34 00000000 c14f3e24 > Dec 30 19:44:15 xenix kernel: [ 601.008272] 00000104 c1334c9a > c1334c9a 00000000 e8318800 000005dc 000125f4 c1049de3 > Dec 30 19:44:15 xenix kernel: [ 601.008281] 00000009 e800bf1c > c14f3de8 e800bf34 c1334c9a c14f3e24 00000104 c14f3de8 > Dec 30 19:44:15 xenix kernel: [ 601.008291] Call Trace: > Dec 30 19:44:15 xenix kernel: [ 601.008309] [] ? > dump_stack+0x3e/0x4e > Dec 30 19:44:15 xenix kernel: [ 601.008326] [] ? > warn_slowpath_common+0x7e/0xa0 > Dec 30 19:44:15 xenix kernel: [ 601.008334] [] ? > dev_watchdog+0x1ca/0x1e0 > Dec 30 19:44:15 xenix kernel: [ 601.008341] [] ? > dev_watchdog+0x1ca/0x1e0 > Dec 30 19:44:15 xenix kernel: [ 601.008349] [] ? > warn_slowpath_fmt+0x33/0x40 > Dec 30 19:44:15 xenix kernel: [ 601.008356] [] ? > dev_watchdog+0x1ca/0x1e0 > Dec 30 19:44:15 xenix kernel: [ 601.008371] [] ? > dev_graft_qdisc+0x60/0x60 > Dec 30 19:44:15 xenix kernel: [ 601.008385] [] ? > call_timer_fn+0x28/0xd0 > Dec 30 19:44:15 xenix kernel: [ 601.008396] [] ? > __wake_up+0x30/0x50 > Dec 30 19:44:15 xenix kernel: [ 601.008403] [] ? > dev_graft_qdisc+0x60/0x60 > Dec 30 19:44:15 xenix kernel: [ 601.008412] [] ? > run_timer_softirq+0x157/0x220 > Dec 30 19:44:15 xenix kernel: [ 601.008420] [] ? > __do_softirq+0xbe/0x1e0 > Dec 30 19:44:15 xenix kernel: [ 601.008428] [] ? > send_remote_softirq+0x40/0x40 > Dec 30 19:44:15 xenix kernel: [ 601.008432] [] ? > irq_exit+0x85/0x90 > Dec 30 19:44:15 xenix kernel: [ 601.008451] [] ? > xen_evtchn_do_upcall+0x1d/0x30 > Dec 30 19:44:15 xenix kernel: [ 601.008461] [] ? > xen_do_upcall+0x7/0xc > Dec 30 19:44:15 xenix kernel: [ 601.008471] [] ? > xen_hypercall_sched_op+0x7/0x20 > Dec 30 19:44:15 xenix kernel: [ 601.008483] [] ? > xen_safe_halt+0xf/0x20 > Dec 30 19:44:15 xenix kernel: [ 601.008493] [] ? > default_idle+0x18/0xa0 > Dec 30 19:44:15 xenix kernel: [ 601.008500] [] ? > arch_cpu_idle+0x16/0x20 > Dec 30 19:44:15 xenix kernel: [ 601.008511] [] ? > cpu_startup_entry+0x146/0x200 > Dec 30 19:44:15 xenix kernel: [ 601.008520] [] ? > start_kernel+0x38c/0x391 > Dec 30 19:44:15 xenix kernel: [ 601.008527] [] ? > repair_env_string+0x4d/0x4d > Dec 30 19:44:15 xenix kernel: [ 601.008536] [] ? > xen_start_kernel+0x663/0x66e > Dec 30 19:44:15 xenix kernel: [ 601.008543] ---[ end trace > 2e9d0e06d1993fae ]--- > > > _______________________________________________ > Xen-users mailing list > Xen-users@lists.xen.org > http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 11:07:31 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 11:07:31 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxAU-0003LG-Qn; Tue, 31 Dec 2013 11:07:26 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxAT-0003L8-Bd; Tue, 31 Dec 2013 11:07:25 +0000 Received: from [85.158.143.35:17659] by server-1.bemta-4.messagelabs.com id 34/03-02132-C65A2C25; Tue, 31 Dec 2013 11:07:24 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-2.tower-21.messagelabs.com!1388488042!8872368!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 13966 invoked from network); 31 Dec 2013 11:07:23 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-2.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 11:07:23 -0000 X-IronPort-AV: E=Sophos;i="4.95,580,1384300800"; d="scan'208";a="86606833" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 31 Dec 2013 11:07:22 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Tue, 31 Dec 2013 06:07:21 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VxxAP-0004Me-R3; Tue, 31 Dec 2013 11:07:21 +0000 Date: Tue, 31 Dec 2013 11:07:21 +0000 From: Wei Liu To: Liang Yan Message-ID: <20131231110721.GC19696@zion.uk.xensource.com> References: MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: xen-users@lists.xen.org, wei.liu2@citrix.com Subject: Re: [Xen-users] [Xen-devel] xen 4.2.1 could not access to a ubuntu qcow image X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Move Xen-devel to BCC, add Xen-users to CC. This post should belong to Xen-users. On Tue, Dec 24, 2013 at 06:40:59AM -0500, Liang Yan wrote: > Dom0 ubuntu 12.04 > domu 12.04 > xen 4.2.1 > > hvm works well for base img, > but could not access to a qcow img based on base img. > > > log: > > Unknown PV product 3 loaded in guest > PV driver build 1 > region type 0 at [f3000000,f3020000). > squash iomem [f3000000, f3020000). > region type 1 at [c100,c140). > > > cfg: > > disk = [ 'tap:qcow:/var/station1/vmdisk-station1.qcow,ioemu:sda1,w' ] > > the disk type of domu is xvda, I could not only get this type for creating > a unbunt hvm. > Maybe have a look at various xl config file examples in /etc/xen? The syntax you used looks out-dated to me. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 11:07:31 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 11:07:31 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxAU-0003LG-Qn; Tue, 31 Dec 2013 11:07:26 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxAT-0003L8-Bd; Tue, 31 Dec 2013 11:07:25 +0000 Received: from [85.158.143.35:17659] by server-1.bemta-4.messagelabs.com id 34/03-02132-C65A2C25; Tue, 31 Dec 2013 11:07:24 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-2.tower-21.messagelabs.com!1388488042!8872368!1 X-Originating-IP: [66.165.176.63] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni42MyA9PiAzMDYwNDg=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 13966 invoked from network); 31 Dec 2013 11:07:23 -0000 Received: from smtp02.citrix.com (HELO SMTP02.CITRIX.COM) (66.165.176.63) by server-2.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 11:07:23 -0000 X-IronPort-AV: E=Sophos;i="4.95,580,1384300800"; d="scan'208";a="86606833" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO02.CITRIX.COM with ESMTP; 31 Dec 2013 11:07:22 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Tue, 31 Dec 2013 06:07:21 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VxxAP-0004Me-R3; Tue, 31 Dec 2013 11:07:21 +0000 Date: Tue, 31 Dec 2013 11:07:21 +0000 From: Wei Liu To: Liang Yan Message-ID: <20131231110721.GC19696@zion.uk.xensource.com> References: MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: xen-users@lists.xen.org, wei.liu2@citrix.com Subject: Re: [Xen-users] [Xen-devel] xen 4.2.1 could not access to a ubuntu qcow image X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Move Xen-devel to BCC, add Xen-users to CC. This post should belong to Xen-users. On Tue, Dec 24, 2013 at 06:40:59AM -0500, Liang Yan wrote: > Dom0 ubuntu 12.04 > domu 12.04 > xen 4.2.1 > > hvm works well for base img, > but could not access to a qcow img based on base img. > > > log: > > Unknown PV product 3 loaded in guest > PV driver build 1 > region type 0 at [f3000000,f3020000). > squash iomem [f3000000, f3020000). > region type 1 at [c100,c140). > > > cfg: > > disk = [ 'tap:qcow:/var/station1/vmdisk-station1.qcow,ioemu:sda1,w' ] > > the disk type of domu is xvda, I could not only get this type for creating > a unbunt hvm. > Maybe have a look at various xl config file examples in /etc/xen? The syntax you used looks out-dated to me. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 11:12:35 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 11:12:35 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxFG-0003wC-VM; Tue, 31 Dec 2013 11:12:22 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxFF-0003w6-Vv for xen-users@lists.xen.org; Tue, 31 Dec 2013 11:12:22 +0000 Received: from [85.158.143.35:47314] by server-3.bemta-4.messagelabs.com id 1E/BB-32360-596A2C25; Tue, 31 Dec 2013 11:12:21 +0000 X-Env-Sender: mlg-hessigheim@gmx.de X-Msg-Ref: server-3.tower-21.messagelabs.com!1388488340!8914136!1 X-Originating-IP: [212.227.17.20] X-SpamReason: No, hits=0.5 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjIwID0+IDI4MDcx\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjIwID0+IDI4MDcx\n,BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 29055 invoked from network); 31 Dec 2013 11:12:20 -0000 Received: from mout.gmx.net (HELO mout.gmx.net) (212.227.17.20) by server-3.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 31 Dec 2013 11:12:20 -0000 Received: from [192.168.2.101] ([91.89.92.96]) by mail.gmx.com (mrgmx002) with ESMTPSA (Nemesis) id 0MGBdv-1WBxLP09fb-00FAdm for ; Tue, 31 Dec 2013 12:12:20 +0100 Message-ID: <52C2A693.8070309@gmx.de> Date: Tue, 31 Dec 2013 12:12:19 +0100 From: Martin Lang User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Wei Liu References: <52C29B8B.3010709@gmx.de> <20131231110342.GB19696@zion.uk.xensource.com> In-Reply-To: <20131231110342.GB19696@zion.uk.xensource.com> X-Provags-ID: V03:K0:UgMiDBCNXPGu3KmuxixSv7O70udvzcF3IOcCMZ5vTygSbEZtKsS DY+oO+6MfTnhW6fPz5hY8GsqLNNM6nKx3kHTrv9B8lWx++/syYLJ4g4Rq/ykQYN+pQPJQcg l8+sBvehWlNsS7w4fWnWaUHYU565qy/hnKWG9wj23wlOi+4ryI+rEzpRkmFmzbojFx2Z8Wo 4EnRlfZ8aBKyrDpAixooQ== Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org No I have not seen this when I run the kernel without xen. I am not sure if it has something to do with an IPFire firewall that I try to run in a domU. When this specific domU is not started everything seems to be more stable. On 31.12.2013 12:03, Wei Liu wrote: > On Tue, Dec 31, 2013 at 11:25:15AM +0100, Martin Lang wrote: >> Hi all, >> >> I have a problem with my Dom0 crashing. Stack trace is below. At >> startup everything is o.k. The crash happens whenever I have some >> network traffic. >> Any help is highly appreciated. >> > Your network queue times out which triggers the watchdog. I don't think > your machine crashed. It just doesn't have network. > > Do you see the same thing when you use this kernel on baremetal? AFAICT > the driver in question is not Xen related. > > Wei. > >> Martin >> >> Dec 30 19:44:15 xenix kernel: [ 601.008080] ------------[ cut here >> ]------------ >> Dec 30 19:44:15 xenix kernel: [ 601.008118] WARNING: CPU: 0 PID: 0 >> at /build/linux-tAcKXn/linux-3.11.10/net/sched/sch_generic.c:260 >> dev_watchdog+0x1ca/0x1e0() >> Dec 30 19:44:15 xenix kernel: [ 601.008124] NETDEV WATCHDOG: eth1 >> (8139too): transmit queue 0 timed out >> Dec 30 19:44:15 xenix kernel: [ 601.008128] Modules linked in: >> xt_physdev iptable_filter ip_tables x_tables xen_netback xen_blkback >> xen_gntdev xen_evtchn xenfs xen_privcmd bridge stp llc loop arc4 >> ath9k ath9k_common ath9k_hw snd_wavefront snd_cs4236 ath >> snd_opl3_lib microcode mac80211 snd_hwdep snd_wss_lib snd_intel8x0 >> snd_ac97_codec snd_mpu401 evdev cfg80211 pcspkr snd_pcm rfkill >> snd_mpu401_uart psmouse serio_raw snd_page_alloc snd_timer ac97_bus >> snd_rawmidi snd_seq_device snd soundcore ns558 gameport parport_pc >> parport mperf i2c_sis96x i2c_sis630 processor thermal_sys button >> i2c_core shpchp ext4 crc16 mbcache jbd2 dm_mod sg sd_mod sr_mod >> crc_t10dif cdrom ata_generic pata_sis 8139too libata 8139cp e100 >> scsi_mod mii floppy ohci_pci ohci_hcd ehci_hcd usbcore usb_common >> Dec 30 19:44:15 xenix kernel: [ 601.008250] CPU: 0 PID: 0 Comm: >> swapper/0 Not tainted 3.11-2-686-pae #1 Debian 3.11.10-1 >> Dec 30 19:44:15 xenix kernel: [ 601.008255] Hardware name: ECS >> K7S5A /K7S5A , BIOS 07.00T >> Dec 30 19:44:15 xenix kernel: [ 601.008261] 00000009 c13e5bc3 >> e800bf1c c1049d8e c14f3de8 e800bf34 00000000 c14f3e24 >> Dec 30 19:44:15 xenix kernel: [ 601.008272] 00000104 c1334c9a >> c1334c9a 00000000 e8318800 000005dc 000125f4 c1049de3 >> Dec 30 19:44:15 xenix kernel: [ 601.008281] 00000009 e800bf1c >> c14f3de8 e800bf34 c1334c9a c14f3e24 00000104 c14f3de8 >> Dec 30 19:44:15 xenix kernel: [ 601.008291] Call Trace: >> Dec 30 19:44:15 xenix kernel: [ 601.008309] [] ? >> dump_stack+0x3e/0x4e >> Dec 30 19:44:15 xenix kernel: [ 601.008326] [] ? >> warn_slowpath_common+0x7e/0xa0 >> Dec 30 19:44:15 xenix kernel: [ 601.008334] [] ? >> dev_watchdog+0x1ca/0x1e0 >> Dec 30 19:44:15 xenix kernel: [ 601.008341] [] ? >> dev_watchdog+0x1ca/0x1e0 >> Dec 30 19:44:15 xenix kernel: [ 601.008349] [] ? >> warn_slowpath_fmt+0x33/0x40 >> Dec 30 19:44:15 xenix kernel: [ 601.008356] [] ? >> dev_watchdog+0x1ca/0x1e0 >> Dec 30 19:44:15 xenix kernel: [ 601.008371] [] ? >> dev_graft_qdisc+0x60/0x60 >> Dec 30 19:44:15 xenix kernel: [ 601.008385] [] ? >> call_timer_fn+0x28/0xd0 >> Dec 30 19:44:15 xenix kernel: [ 601.008396] [] ? >> __wake_up+0x30/0x50 >> Dec 30 19:44:15 xenix kernel: [ 601.008403] [] ? >> dev_graft_qdisc+0x60/0x60 >> Dec 30 19:44:15 xenix kernel: [ 601.008412] [] ? >> run_timer_softirq+0x157/0x220 >> Dec 30 19:44:15 xenix kernel: [ 601.008420] [] ? >> __do_softirq+0xbe/0x1e0 >> Dec 30 19:44:15 xenix kernel: [ 601.008428] [] ? >> send_remote_softirq+0x40/0x40 >> Dec 30 19:44:15 xenix kernel: [ 601.008432] [] ? >> irq_exit+0x85/0x90 >> Dec 30 19:44:15 xenix kernel: [ 601.008451] [] ? >> xen_evtchn_do_upcall+0x1d/0x30 >> Dec 30 19:44:15 xenix kernel: [ 601.008461] [] ? >> xen_do_upcall+0x7/0xc >> Dec 30 19:44:15 xenix kernel: [ 601.008471] [] ? >> xen_hypercall_sched_op+0x7/0x20 >> Dec 30 19:44:15 xenix kernel: [ 601.008483] [] ? >> xen_safe_halt+0xf/0x20 >> Dec 30 19:44:15 xenix kernel: [ 601.008493] [] ? >> default_idle+0x18/0xa0 >> Dec 30 19:44:15 xenix kernel: [ 601.008500] [] ? >> arch_cpu_idle+0x16/0x20 >> Dec 30 19:44:15 xenix kernel: [ 601.008511] [] ? >> cpu_startup_entry+0x146/0x200 >> Dec 30 19:44:15 xenix kernel: [ 601.008520] [] ? >> start_kernel+0x38c/0x391 >> Dec 30 19:44:15 xenix kernel: [ 601.008527] [] ? >> repair_env_string+0x4d/0x4d >> Dec 30 19:44:15 xenix kernel: [ 601.008536] [] ? >> xen_start_kernel+0x663/0x66e >> Dec 30 19:44:15 xenix kernel: [ 601.008543] ---[ end trace >> 2e9d0e06d1993fae ]--- >> >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xen.org >> http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 11:12:35 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 11:12:35 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxFG-0003wC-VM; Tue, 31 Dec 2013 11:12:22 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxFF-0003w6-Vv for xen-users@lists.xen.org; Tue, 31 Dec 2013 11:12:22 +0000 Received: from [85.158.143.35:47314] by server-3.bemta-4.messagelabs.com id 1E/BB-32360-596A2C25; Tue, 31 Dec 2013 11:12:21 +0000 X-Env-Sender: mlg-hessigheim@gmx.de X-Msg-Ref: server-3.tower-21.messagelabs.com!1388488340!8914136!1 X-Originating-IP: [212.227.17.20] X-SpamReason: No, hits=0.5 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjIwID0+IDI4MDcx\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE3LjIwID0+IDI4MDcx\n,BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 29055 invoked from network); 31 Dec 2013 11:12:20 -0000 Received: from mout.gmx.net (HELO mout.gmx.net) (212.227.17.20) by server-3.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 31 Dec 2013 11:12:20 -0000 Received: from [192.168.2.101] ([91.89.92.96]) by mail.gmx.com (mrgmx002) with ESMTPSA (Nemesis) id 0MGBdv-1WBxLP09fb-00FAdm for ; Tue, 31 Dec 2013 12:12:20 +0100 Message-ID: <52C2A693.8070309@gmx.de> Date: Tue, 31 Dec 2013 12:12:19 +0100 From: Martin Lang User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Wei Liu References: <52C29B8B.3010709@gmx.de> <20131231110342.GB19696@zion.uk.xensource.com> In-Reply-To: <20131231110342.GB19696@zion.uk.xensource.com> X-Provags-ID: V03:K0:UgMiDBCNXPGu3KmuxixSv7O70udvzcF3IOcCMZ5vTygSbEZtKsS DY+oO+6MfTnhW6fPz5hY8GsqLNNM6nKx3kHTrv9B8lWx++/syYLJ4g4Rq/ykQYN+pQPJQcg l8+sBvehWlNsS7w4fWnWaUHYU565qy/hnKWG9wj23wlOi+4ryI+rEzpRkmFmzbojFx2Z8Wo 4EnRlfZ8aBKyrDpAixooQ== Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org No I have not seen this when I run the kernel without xen. I am not sure if it has something to do with an IPFire firewall that I try to run in a domU. When this specific domU is not started everything seems to be more stable. On 31.12.2013 12:03, Wei Liu wrote: > On Tue, Dec 31, 2013 at 11:25:15AM +0100, Martin Lang wrote: >> Hi all, >> >> I have a problem with my Dom0 crashing. Stack trace is below. At >> startup everything is o.k. The crash happens whenever I have some >> network traffic. >> Any help is highly appreciated. >> > Your network queue times out which triggers the watchdog. I don't think > your machine crashed. It just doesn't have network. > > Do you see the same thing when you use this kernel on baremetal? AFAICT > the driver in question is not Xen related. > > Wei. > >> Martin >> >> Dec 30 19:44:15 xenix kernel: [ 601.008080] ------------[ cut here >> ]------------ >> Dec 30 19:44:15 xenix kernel: [ 601.008118] WARNING: CPU: 0 PID: 0 >> at /build/linux-tAcKXn/linux-3.11.10/net/sched/sch_generic.c:260 >> dev_watchdog+0x1ca/0x1e0() >> Dec 30 19:44:15 xenix kernel: [ 601.008124] NETDEV WATCHDOG: eth1 >> (8139too): transmit queue 0 timed out >> Dec 30 19:44:15 xenix kernel: [ 601.008128] Modules linked in: >> xt_physdev iptable_filter ip_tables x_tables xen_netback xen_blkback >> xen_gntdev xen_evtchn xenfs xen_privcmd bridge stp llc loop arc4 >> ath9k ath9k_common ath9k_hw snd_wavefront snd_cs4236 ath >> snd_opl3_lib microcode mac80211 snd_hwdep snd_wss_lib snd_intel8x0 >> snd_ac97_codec snd_mpu401 evdev cfg80211 pcspkr snd_pcm rfkill >> snd_mpu401_uart psmouse serio_raw snd_page_alloc snd_timer ac97_bus >> snd_rawmidi snd_seq_device snd soundcore ns558 gameport parport_pc >> parport mperf i2c_sis96x i2c_sis630 processor thermal_sys button >> i2c_core shpchp ext4 crc16 mbcache jbd2 dm_mod sg sd_mod sr_mod >> crc_t10dif cdrom ata_generic pata_sis 8139too libata 8139cp e100 >> scsi_mod mii floppy ohci_pci ohci_hcd ehci_hcd usbcore usb_common >> Dec 30 19:44:15 xenix kernel: [ 601.008250] CPU: 0 PID: 0 Comm: >> swapper/0 Not tainted 3.11-2-686-pae #1 Debian 3.11.10-1 >> Dec 30 19:44:15 xenix kernel: [ 601.008255] Hardware name: ECS >> K7S5A /K7S5A , BIOS 07.00T >> Dec 30 19:44:15 xenix kernel: [ 601.008261] 00000009 c13e5bc3 >> e800bf1c c1049d8e c14f3de8 e800bf34 00000000 c14f3e24 >> Dec 30 19:44:15 xenix kernel: [ 601.008272] 00000104 c1334c9a >> c1334c9a 00000000 e8318800 000005dc 000125f4 c1049de3 >> Dec 30 19:44:15 xenix kernel: [ 601.008281] 00000009 e800bf1c >> c14f3de8 e800bf34 c1334c9a c14f3e24 00000104 c14f3de8 >> Dec 30 19:44:15 xenix kernel: [ 601.008291] Call Trace: >> Dec 30 19:44:15 xenix kernel: [ 601.008309] [] ? >> dump_stack+0x3e/0x4e >> Dec 30 19:44:15 xenix kernel: [ 601.008326] [] ? >> warn_slowpath_common+0x7e/0xa0 >> Dec 30 19:44:15 xenix kernel: [ 601.008334] [] ? >> dev_watchdog+0x1ca/0x1e0 >> Dec 30 19:44:15 xenix kernel: [ 601.008341] [] ? >> dev_watchdog+0x1ca/0x1e0 >> Dec 30 19:44:15 xenix kernel: [ 601.008349] [] ? >> warn_slowpath_fmt+0x33/0x40 >> Dec 30 19:44:15 xenix kernel: [ 601.008356] [] ? >> dev_watchdog+0x1ca/0x1e0 >> Dec 30 19:44:15 xenix kernel: [ 601.008371] [] ? >> dev_graft_qdisc+0x60/0x60 >> Dec 30 19:44:15 xenix kernel: [ 601.008385] [] ? >> call_timer_fn+0x28/0xd0 >> Dec 30 19:44:15 xenix kernel: [ 601.008396] [] ? >> __wake_up+0x30/0x50 >> Dec 30 19:44:15 xenix kernel: [ 601.008403] [] ? >> dev_graft_qdisc+0x60/0x60 >> Dec 30 19:44:15 xenix kernel: [ 601.008412] [] ? >> run_timer_softirq+0x157/0x220 >> Dec 30 19:44:15 xenix kernel: [ 601.008420] [] ? >> __do_softirq+0xbe/0x1e0 >> Dec 30 19:44:15 xenix kernel: [ 601.008428] [] ? >> send_remote_softirq+0x40/0x40 >> Dec 30 19:44:15 xenix kernel: [ 601.008432] [] ? >> irq_exit+0x85/0x90 >> Dec 30 19:44:15 xenix kernel: [ 601.008451] [] ? >> xen_evtchn_do_upcall+0x1d/0x30 >> Dec 30 19:44:15 xenix kernel: [ 601.008461] [] ? >> xen_do_upcall+0x7/0xc >> Dec 30 19:44:15 xenix kernel: [ 601.008471] [] ? >> xen_hypercall_sched_op+0x7/0x20 >> Dec 30 19:44:15 xenix kernel: [ 601.008483] [] ? >> xen_safe_halt+0xf/0x20 >> Dec 30 19:44:15 xenix kernel: [ 601.008493] [] ? >> default_idle+0x18/0xa0 >> Dec 30 19:44:15 xenix kernel: [ 601.008500] [] ? >> arch_cpu_idle+0x16/0x20 >> Dec 30 19:44:15 xenix kernel: [ 601.008511] [] ? >> cpu_startup_entry+0x146/0x200 >> Dec 30 19:44:15 xenix kernel: [ 601.008520] [] ? >> start_kernel+0x38c/0x391 >> Dec 30 19:44:15 xenix kernel: [ 601.008527] [] ? >> repair_env_string+0x4d/0x4d >> Dec 30 19:44:15 xenix kernel: [ 601.008536] [] ? >> xen_start_kernel+0x663/0x66e >> Dec 30 19:44:15 xenix kernel: [ 601.008543] ---[ end trace >> 2e9d0e06d1993fae ]--- >> >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@lists.xen.org >> http://lists.xen.org/xen-users _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 11:20:10 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 11:20:10 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxMQ-0004Zi-8a; Tue, 31 Dec 2013 11:19:46 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxMO-0004ZW-Kb for xen-users@lists.xen.org; Tue, 31 Dec 2013 11:19:44 +0000 Received: from [85.158.143.35:27914] by server-2.bemta-4.messagelabs.com id AA/4F-11386-F48A2C25; Tue, 31 Dec 2013 11:19:43 +0000 X-Env-Sender: mlg-hessigheim@gmx.de X-Msg-Ref: server-7.tower-21.messagelabs.com!1388488782!8876774!1 X-Originating-IP: [212.227.15.15] X-SpamReason: No, hits=0.5 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE1LjE1ID0+IDI0NzM3\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE1LjE1ID0+IDI0NzM3\n,BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 1528 invoked from network); 31 Dec 2013 11:19:43 -0000 Received: from mout.gmx.net (HELO mout.gmx.net) (212.227.15.15) by server-7.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 31 Dec 2013 11:19:43 -0000 Received: from [192.168.2.101] ([91.89.92.96]) by mail.gmx.com (mrgmx003) with ESMTPSA (Nemesis) id 0M4WNA-1VEntS1u04-00yg6Y for ; Tue, 31 Dec 2013 12:19:42 +0100 Message-ID: <52C2A84D.2040007@gmx.de> Date: Tue, 31 Dec 2013 12:19:41 +0100 From: Martin Lang User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Wei Liu References: <52C29B8B.3010709@gmx.de> <20131231110342.GB19696@zion.uk.xensource.com> <52C2A693.8070309@gmx.de> In-Reply-To: <52C2A693.8070309@gmx.de> X-Provags-ID: V03:K0:JqwhQc3SnLhAbmBauMMlKfwlbXnf7tjT8epjqwUAdDzfHSne3bk 3dOqX4pM/SHqfxw+zPoFiFmu0TSTpw0/I8S3+8y1krI22hEID3xFI9YHJCfYdGWrc5CnQ8X +sEtW5oZrPZzFL65E0qsJYBDgsuIGl6QVqOpNMsujBpm5j4Ae2dA8BttrU9OFtaL13AVFYW Y4tArzpRoKEm1F2mgEsfA== Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org I tried now a different kernel for dom0 (3.2.0-4-686-pae from debian wheezy) with the same effect. After some network traffic the networking hangs. Is there anything I can do to provide more information? On 31.12.2013 12:12, Martin Lang wrote: > No I have not seen this when I run the kernel without xen. I am not > sure if it has something to do with an IPFire firewall that I try to > run in a domU. When this specific domU is not started everything seems > to be more stable. > > > On 31.12.2013 12:03, Wei Liu wrote: >> On Tue, Dec 31, 2013 at 11:25:15AM +0100, Martin Lang wrote: >>> Hi all, >>> >>> I have a problem with my Dom0 crashing. Stack trace is below. At >>> startup everything is o.k. The crash happens whenever I have some >>> network traffic. >>> Any help is highly appreciated. >>> >> Your network queue times out which triggers the watchdog. I don't think >> your machine crashed. It just doesn't have network. >> >> Do you see the same thing when you use this kernel on baremetal? AFAICT >> the driver in question is not Xen related. >> >> Wei. >> >>> Martin >>> >>> Dec 30 19:44:15 xenix kernel: [ 601.008080] ------------[ cut here >>> ]------------ >>> Dec 30 19:44:15 xenix kernel: [ 601.008118] WARNING: CPU: 0 PID: 0 >>> at /build/linux-tAcKXn/linux-3.11.10/net/sched/sch_generic.c:260 >>> dev_watchdog+0x1ca/0x1e0() >>> Dec 30 19:44:15 xenix kernel: [ 601.008124] NETDEV WATCHDOG: eth1 >>> (8139too): transmit queue 0 timed out >>> Dec 30 19:44:15 xenix kernel: [ 601.008128] Modules linked in: >>> xt_physdev iptable_filter ip_tables x_tables xen_netback xen_blkback >>> xen_gntdev xen_evtchn xenfs xen_privcmd bridge stp llc loop arc4 >>> ath9k ath9k_common ath9k_hw snd_wavefront snd_cs4236 ath >>> snd_opl3_lib microcode mac80211 snd_hwdep snd_wss_lib snd_intel8x0 >>> snd_ac97_codec snd_mpu401 evdev cfg80211 pcspkr snd_pcm rfkill >>> snd_mpu401_uart psmouse serio_raw snd_page_alloc snd_timer ac97_bus >>> snd_rawmidi snd_seq_device snd soundcore ns558 gameport parport_pc >>> parport mperf i2c_sis96x i2c_sis630 processor thermal_sys button >>> i2c_core shpchp ext4 crc16 mbcache jbd2 dm_mod sg sd_mod sr_mod >>> crc_t10dif cdrom ata_generic pata_sis 8139too libata 8139cp e100 >>> scsi_mod mii floppy ohci_pci ohci_hcd ehci_hcd usbcore usb_common >>> Dec 30 19:44:15 xenix kernel: [ 601.008250] CPU: 0 PID: 0 Comm: >>> swapper/0 Not tainted 3.11-2-686-pae #1 Debian 3.11.10-1 >>> Dec 30 19:44:15 xenix kernel: [ 601.008255] Hardware name: ECS >>> K7S5A /K7S5A , BIOS 07.00T >>> Dec 30 19:44:15 xenix kernel: [ 601.008261] 00000009 c13e5bc3 >>> e800bf1c c1049d8e c14f3de8 e800bf34 00000000 c14f3e24 >>> Dec 30 19:44:15 xenix kernel: [ 601.008272] 00000104 c1334c9a >>> c1334c9a 00000000 e8318800 000005dc 000125f4 c1049de3 >>> Dec 30 19:44:15 xenix kernel: [ 601.008281] 00000009 e800bf1c >>> c14f3de8 e800bf34 c1334c9a c14f3e24 00000104 c14f3de8 >>> Dec 30 19:44:15 xenix kernel: [ 601.008291] Call Trace: >>> Dec 30 19:44:15 xenix kernel: [ 601.008309] [] ? >>> dump_stack+0x3e/0x4e >>> Dec 30 19:44:15 xenix kernel: [ 601.008326] [] ? >>> warn_slowpath_common+0x7e/0xa0 >>> Dec 30 19:44:15 xenix kernel: [ 601.008334] [] ? >>> dev_watchdog+0x1ca/0x1e0 >>> Dec 30 19:44:15 xenix kernel: [ 601.008341] [] ? >>> dev_watchdog+0x1ca/0x1e0 >>> Dec 30 19:44:15 xenix kernel: [ 601.008349] [] ? >>> warn_slowpath_fmt+0x33/0x40 >>> Dec 30 19:44:15 xenix kernel: [ 601.008356] [] ? >>> dev_watchdog+0x1ca/0x1e0 >>> Dec 30 19:44:15 xenix kernel: [ 601.008371] [] ? >>> dev_graft_qdisc+0x60/0x60 >>> Dec 30 19:44:15 xenix kernel: [ 601.008385] [] ? >>> call_timer_fn+0x28/0xd0 >>> Dec 30 19:44:15 xenix kernel: [ 601.008396] [] ? >>> __wake_up+0x30/0x50 >>> Dec 30 19:44:15 xenix kernel: [ 601.008403] [] ? >>> dev_graft_qdisc+0x60/0x60 >>> Dec 30 19:44:15 xenix kernel: [ 601.008412] [] ? >>> run_timer_softirq+0x157/0x220 >>> Dec 30 19:44:15 xenix kernel: [ 601.008420] [] ? >>> __do_softirq+0xbe/0x1e0 >>> Dec 30 19:44:15 xenix kernel: [ 601.008428] [] ? >>> send_remote_softirq+0x40/0x40 >>> Dec 30 19:44:15 xenix kernel: [ 601.008432] [] ? >>> irq_exit+0x85/0x90 >>> Dec 30 19:44:15 xenix kernel: [ 601.008451] [] ? >>> xen_evtchn_do_upcall+0x1d/0x30 >>> Dec 30 19:44:15 xenix kernel: [ 601.008461] [] ? >>> xen_do_upcall+0x7/0xc >>> Dec 30 19:44:15 xenix kernel: [ 601.008471] [] ? >>> xen_hypercall_sched_op+0x7/0x20 >>> Dec 30 19:44:15 xenix kernel: [ 601.008483] [] ? >>> xen_safe_halt+0xf/0x20 >>> Dec 30 19:44:15 xenix kernel: [ 601.008493] [] ? >>> default_idle+0x18/0xa0 >>> Dec 30 19:44:15 xenix kernel: [ 601.008500] [] ? >>> arch_cpu_idle+0x16/0x20 >>> Dec 30 19:44:15 xenix kernel: [ 601.008511] [] ? >>> cpu_startup_entry+0x146/0x200 >>> Dec 30 19:44:15 xenix kernel: [ 601.008520] [] ? >>> start_kernel+0x38c/0x391 >>> Dec 30 19:44:15 xenix kernel: [ 601.008527] [] ? >>> repair_env_string+0x4d/0x4d >>> Dec 30 19:44:15 xenix kernel: [ 601.008536] [] ? >>> xen_start_kernel+0x663/0x66e >>> Dec 30 19:44:15 xenix kernel: [ 601.008543] ---[ end trace >>> 2e9d0e06d1993fae ]--- >>> >>> >>> _______________________________________________ >>> Xen-users mailing list >>> Xen-users@lists.xen.org >>> http://lists.xen.org/xen-users > _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 11:20:10 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 11:20:10 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxMQ-0004Zi-8a; Tue, 31 Dec 2013 11:19:46 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxMO-0004ZW-Kb for xen-users@lists.xen.org; Tue, 31 Dec 2013 11:19:44 +0000 Received: from [85.158.143.35:27914] by server-2.bemta-4.messagelabs.com id AA/4F-11386-F48A2C25; Tue, 31 Dec 2013 11:19:43 +0000 X-Env-Sender: mlg-hessigheim@gmx.de X-Msg-Ref: server-7.tower-21.messagelabs.com!1388488782!8876774!1 X-Originating-IP: [212.227.15.15] X-SpamReason: No, hits=0.5 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE1LjE1ID0+IDI0NzM3\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE1LjE1ID0+IDI0NzM3\n,BODY_RANDOM_LONG, ML_RADAR_SPEW_LINKS_14,spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 1528 invoked from network); 31 Dec 2013 11:19:43 -0000 Received: from mout.gmx.net (HELO mout.gmx.net) (212.227.15.15) by server-7.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 31 Dec 2013 11:19:43 -0000 Received: from [192.168.2.101] ([91.89.92.96]) by mail.gmx.com (mrgmx003) with ESMTPSA (Nemesis) id 0M4WNA-1VEntS1u04-00yg6Y for ; Tue, 31 Dec 2013 12:19:42 +0100 Message-ID: <52C2A84D.2040007@gmx.de> Date: Tue, 31 Dec 2013 12:19:41 +0100 From: Martin Lang User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Wei Liu References: <52C29B8B.3010709@gmx.de> <20131231110342.GB19696@zion.uk.xensource.com> <52C2A693.8070309@gmx.de> In-Reply-To: <52C2A693.8070309@gmx.de> X-Provags-ID: V03:K0:JqwhQc3SnLhAbmBauMMlKfwlbXnf7tjT8epjqwUAdDzfHSne3bk 3dOqX4pM/SHqfxw+zPoFiFmu0TSTpw0/I8S3+8y1krI22hEID3xFI9YHJCfYdGWrc5CnQ8X +sEtW5oZrPZzFL65E0qsJYBDgsuIGl6QVqOpNMsujBpm5j4Ae2dA8BttrU9OFtaL13AVFYW Y4tArzpRoKEm1F2mgEsfA== Cc: "xen-users@lists.xen.org" Subject: Re: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org I tried now a different kernel for dom0 (3.2.0-4-686-pae from debian wheezy) with the same effect. After some network traffic the networking hangs. Is there anything I can do to provide more information? On 31.12.2013 12:12, Martin Lang wrote: > No I have not seen this when I run the kernel without xen. I am not > sure if it has something to do with an IPFire firewall that I try to > run in a domU. When this specific domU is not started everything seems > to be more stable. > > > On 31.12.2013 12:03, Wei Liu wrote: >> On Tue, Dec 31, 2013 at 11:25:15AM +0100, Martin Lang wrote: >>> Hi all, >>> >>> I have a problem with my Dom0 crashing. Stack trace is below. At >>> startup everything is o.k. The crash happens whenever I have some >>> network traffic. >>> Any help is highly appreciated. >>> >> Your network queue times out which triggers the watchdog. I don't think >> your machine crashed. It just doesn't have network. >> >> Do you see the same thing when you use this kernel on baremetal? AFAICT >> the driver in question is not Xen related. >> >> Wei. >> >>> Martin >>> >>> Dec 30 19:44:15 xenix kernel: [ 601.008080] ------------[ cut here >>> ]------------ >>> Dec 30 19:44:15 xenix kernel: [ 601.008118] WARNING: CPU: 0 PID: 0 >>> at /build/linux-tAcKXn/linux-3.11.10/net/sched/sch_generic.c:260 >>> dev_watchdog+0x1ca/0x1e0() >>> Dec 30 19:44:15 xenix kernel: [ 601.008124] NETDEV WATCHDOG: eth1 >>> (8139too): transmit queue 0 timed out >>> Dec 30 19:44:15 xenix kernel: [ 601.008128] Modules linked in: >>> xt_physdev iptable_filter ip_tables x_tables xen_netback xen_blkback >>> xen_gntdev xen_evtchn xenfs xen_privcmd bridge stp llc loop arc4 >>> ath9k ath9k_common ath9k_hw snd_wavefront snd_cs4236 ath >>> snd_opl3_lib microcode mac80211 snd_hwdep snd_wss_lib snd_intel8x0 >>> snd_ac97_codec snd_mpu401 evdev cfg80211 pcspkr snd_pcm rfkill >>> snd_mpu401_uart psmouse serio_raw snd_page_alloc snd_timer ac97_bus >>> snd_rawmidi snd_seq_device snd soundcore ns558 gameport parport_pc >>> parport mperf i2c_sis96x i2c_sis630 processor thermal_sys button >>> i2c_core shpchp ext4 crc16 mbcache jbd2 dm_mod sg sd_mod sr_mod >>> crc_t10dif cdrom ata_generic pata_sis 8139too libata 8139cp e100 >>> scsi_mod mii floppy ohci_pci ohci_hcd ehci_hcd usbcore usb_common >>> Dec 30 19:44:15 xenix kernel: [ 601.008250] CPU: 0 PID: 0 Comm: >>> swapper/0 Not tainted 3.11-2-686-pae #1 Debian 3.11.10-1 >>> Dec 30 19:44:15 xenix kernel: [ 601.008255] Hardware name: ECS >>> K7S5A /K7S5A , BIOS 07.00T >>> Dec 30 19:44:15 xenix kernel: [ 601.008261] 00000009 c13e5bc3 >>> e800bf1c c1049d8e c14f3de8 e800bf34 00000000 c14f3e24 >>> Dec 30 19:44:15 xenix kernel: [ 601.008272] 00000104 c1334c9a >>> c1334c9a 00000000 e8318800 000005dc 000125f4 c1049de3 >>> Dec 30 19:44:15 xenix kernel: [ 601.008281] 00000009 e800bf1c >>> c14f3de8 e800bf34 c1334c9a c14f3e24 00000104 c14f3de8 >>> Dec 30 19:44:15 xenix kernel: [ 601.008291] Call Trace: >>> Dec 30 19:44:15 xenix kernel: [ 601.008309] [] ? >>> dump_stack+0x3e/0x4e >>> Dec 30 19:44:15 xenix kernel: [ 601.008326] [] ? >>> warn_slowpath_common+0x7e/0xa0 >>> Dec 30 19:44:15 xenix kernel: [ 601.008334] [] ? >>> dev_watchdog+0x1ca/0x1e0 >>> Dec 30 19:44:15 xenix kernel: [ 601.008341] [] ? >>> dev_watchdog+0x1ca/0x1e0 >>> Dec 30 19:44:15 xenix kernel: [ 601.008349] [] ? >>> warn_slowpath_fmt+0x33/0x40 >>> Dec 30 19:44:15 xenix kernel: [ 601.008356] [] ? >>> dev_watchdog+0x1ca/0x1e0 >>> Dec 30 19:44:15 xenix kernel: [ 601.008371] [] ? >>> dev_graft_qdisc+0x60/0x60 >>> Dec 30 19:44:15 xenix kernel: [ 601.008385] [] ? >>> call_timer_fn+0x28/0xd0 >>> Dec 30 19:44:15 xenix kernel: [ 601.008396] [] ? >>> __wake_up+0x30/0x50 >>> Dec 30 19:44:15 xenix kernel: [ 601.008403] [] ? >>> dev_graft_qdisc+0x60/0x60 >>> Dec 30 19:44:15 xenix kernel: [ 601.008412] [] ? >>> run_timer_softirq+0x157/0x220 >>> Dec 30 19:44:15 xenix kernel: [ 601.008420] [] ? >>> __do_softirq+0xbe/0x1e0 >>> Dec 30 19:44:15 xenix kernel: [ 601.008428] [] ? >>> send_remote_softirq+0x40/0x40 >>> Dec 30 19:44:15 xenix kernel: [ 601.008432] [] ? >>> irq_exit+0x85/0x90 >>> Dec 30 19:44:15 xenix kernel: [ 601.008451] [] ? >>> xen_evtchn_do_upcall+0x1d/0x30 >>> Dec 30 19:44:15 xenix kernel: [ 601.008461] [] ? >>> xen_do_upcall+0x7/0xc >>> Dec 30 19:44:15 xenix kernel: [ 601.008471] [] ? >>> xen_hypercall_sched_op+0x7/0x20 >>> Dec 30 19:44:15 xenix kernel: [ 601.008483] [] ? >>> xen_safe_halt+0xf/0x20 >>> Dec 30 19:44:15 xenix kernel: [ 601.008493] [] ? >>> default_idle+0x18/0xa0 >>> Dec 30 19:44:15 xenix kernel: [ 601.008500] [] ? >>> arch_cpu_idle+0x16/0x20 >>> Dec 30 19:44:15 xenix kernel: [ 601.008511] [] ? >>> cpu_startup_entry+0x146/0x200 >>> Dec 30 19:44:15 xenix kernel: [ 601.008520] [] ? >>> start_kernel+0x38c/0x391 >>> Dec 30 19:44:15 xenix kernel: [ 601.008527] [] ? >>> repair_env_string+0x4d/0x4d >>> Dec 30 19:44:15 xenix kernel: [ 601.008536] [] ? >>> xen_start_kernel+0x663/0x66e >>> Dec 30 19:44:15 xenix kernel: [ 601.008543] ---[ end trace >>> 2e9d0e06d1993fae ]--- >>> >>> >>> _______________________________________________ >>> Xen-users mailing list >>> Xen-users@lists.xen.org >>> http://lists.xen.org/xen-users > _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 11:23:30 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 11:23:30 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxPy-0004nE-6r; Tue, 31 Dec 2013 11:23:26 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxPw-0004n3-J0 for xen-users@lists.xen.org; Tue, 31 Dec 2013 11:23:24 +0000 Received: from [85.158.137.68:10425] by server-4.bemta-3.messagelabs.com id F2/37-10414-B29A2C25; Tue, 31 Dec 2013 11:23:23 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-14.tower-31.messagelabs.com!1388489001!6597447!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30949 invoked from network); 31 Dec 2013 11:23:23 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-14.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 11:23:23 -0000 X-IronPort-AV: E=Sophos;i="4.95,580,1384300800"; d="scan'208";a="88810596" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 31 Dec 2013 11:23:21 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Tue, 31 Dec 2013 06:23:20 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VxxPs-0004ZJ-Hp; Tue, 31 Dec 2013 11:23:20 +0000 Date: Tue, 31 Dec 2013 11:23:20 +0000 From: Wei Liu To: Martin Lang Message-ID: <20131231112320.GD19696@zion.uk.xensource.com> References: <52C29B8B.3010709@gmx.de> <20131231110342.GB19696@zion.uk.xensource.com> <52C2A693.8070309@gmx.de> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <52C2A693.8070309@gmx.de> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: "xen-users@lists.xen.org" , Wei Liu Subject: Re: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, Dec 31, 2013 at 12:12:19PM +0100, Martin Lang wrote: > No I have not seen this when I run the kernel without xen. I am not > sure if it has something to do with an IPFire firewall that I try to > run in a domU. When this specific domU is not started everything > seems to be more stable. > That could be the culprit. The only thing I can get from the stacktrace is that NIC's transmit queue timed out, nothing Xen specific. If you run Dom0 only, and it can survive heavy workload then I think your Dom0 is fine. Then you can try to figure out what's wrong with your DomU. I've never played with firewall in DomU so I don't have much to say here. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 11:23:30 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 11:23:30 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxPy-0004nE-6r; Tue, 31 Dec 2013 11:23:26 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxPw-0004n3-J0 for xen-users@lists.xen.org; Tue, 31 Dec 2013 11:23:24 +0000 Received: from [85.158.137.68:10425] by server-4.bemta-3.messagelabs.com id F2/37-10414-B29A2C25; Tue, 31 Dec 2013 11:23:23 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-14.tower-31.messagelabs.com!1388489001!6597447!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 30949 invoked from network); 31 Dec 2013 11:23:23 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-14.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 11:23:23 -0000 X-IronPort-AV: E=Sophos;i="4.95,580,1384300800"; d="scan'208";a="88810596" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 31 Dec 2013 11:23:21 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Tue, 31 Dec 2013 06:23:20 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VxxPs-0004ZJ-Hp; Tue, 31 Dec 2013 11:23:20 +0000 Date: Tue, 31 Dec 2013 11:23:20 +0000 From: Wei Liu To: Martin Lang Message-ID: <20131231112320.GD19696@zion.uk.xensource.com> References: <52C29B8B.3010709@gmx.de> <20131231110342.GB19696@zion.uk.xensource.com> <52C2A693.8070309@gmx.de> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <52C2A693.8070309@gmx.de> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: "xen-users@lists.xen.org" , Wei Liu Subject: Re: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, Dec 31, 2013 at 12:12:19PM +0100, Martin Lang wrote: > No I have not seen this when I run the kernel without xen. I am not > sure if it has something to do with an IPFire firewall that I try to > run in a domU. When this specific domU is not started everything > seems to be more stable. > That could be the culprit. The only thing I can get from the stacktrace is that NIC's transmit queue timed out, nothing Xen specific. If you run Dom0 only, and it can survive heavy workload then I think your Dom0 is fine. Then you can try to figure out what's wrong with your DomU. I've never played with firewall in DomU so I don't have much to say here. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 11:33:10 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 11:33:10 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxYo-0005VI-GM; Tue, 31 Dec 2013 11:32:34 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxYn-0005VC-MB for xen-users@lists.xen.org; Tue, 31 Dec 2013 11:32:33 +0000 Received: from [85.158.137.68:50185] by server-2.bemta-3.messagelabs.com id B3/A1-17329-05BA2C25; Tue, 31 Dec 2013 11:32:32 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-2.tower-31.messagelabs.com!1388489550!6634878!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 24775 invoked from network); 31 Dec 2013 11:32:32 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-2.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 11:32:32 -0000 X-IronPort-AV: E=Sophos;i="4.95,580,1384300800"; d="scan'208";a="88811749" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 31 Dec 2013 11:32:15 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Tue, 31 Dec 2013 06:32:15 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VxxYV-0004gv-3L; Tue, 31 Dec 2013 11:32:15 +0000 Date: Tue, 31 Dec 2013 11:32:15 +0000 From: Wei Liu To: Martin Lang Message-ID: <20131231113215.GE19696@zion.uk.xensource.com> References: <52C29B8B.3010709@gmx.de> <20131231110342.GB19696@zion.uk.xensource.com> <52C2A693.8070309@gmx.de> <52C2A84D.2040007@gmx.de> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <52C2A84D.2040007@gmx.de> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: "xen-users@lists.xen.org" , Wei Liu Subject: Re: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, Dec 31, 2013 at 12:19:41PM +0100, Martin Lang wrote: > I tried now a different kernel for dom0 (3.2.0-4-686-pae from debian > wheezy) with the same effect. After some network traffic the > networking hangs. Is there anything I can do to provide more > information? > Did it hang with the same stacktrace? I mean, transmit queue timed out. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 11:33:10 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 11:33:10 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxYo-0005VI-GM; Tue, 31 Dec 2013 11:32:34 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1VxxYn-0005VC-MB for xen-users@lists.xen.org; Tue, 31 Dec 2013 11:32:33 +0000 Received: from [85.158.137.68:50185] by server-2.bemta-3.messagelabs.com id B3/A1-17329-05BA2C25; Tue, 31 Dec 2013 11:32:32 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-2.tower-31.messagelabs.com!1388489550!6634878!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 24775 invoked from network); 31 Dec 2013 11:32:32 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-2.tower-31.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 11:32:32 -0000 X-IronPort-AV: E=Sophos;i="4.95,580,1384300800"; d="scan'208";a="88811749" Received: from accessns.citrite.net (HELO FTLPEX01CL01.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 31 Dec 2013 11:32:15 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.78) with Microsoft SMTP Server id 14.2.342.4; Tue, 31 Dec 2013 06:32:15 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1VxxYV-0004gv-3L; Tue, 31 Dec 2013 11:32:15 +0000 Date: Tue, 31 Dec 2013 11:32:15 +0000 From: Wei Liu To: Martin Lang Message-ID: <20131231113215.GE19696@zion.uk.xensource.com> References: <52C29B8B.3010709@gmx.de> <20131231110342.GB19696@zion.uk.xensource.com> <52C2A693.8070309@gmx.de> <52C2A84D.2040007@gmx.de> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <52C2A84D.2040007@gmx.de> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: "xen-users@lists.xen.org" , Wei Liu Subject: Re: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, Dec 31, 2013 at 12:19:41PM +0100, Martin Lang wrote: > I tried now a different kernel for dom0 (3.2.0-4-686-pae from debian > wheezy) with the same effect. After some network traffic the > networking hangs. Is there anything I can do to provide more > information? > Did it hang with the same stacktrace? I mean, transmit queue timed out. Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 13:59:06 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 13:59:06 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxzpb-000261-TH; Tue, 31 Dec 2013 13:58:03 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxzpa-00025U-E7; Tue, 31 Dec 2013 13:58:02 +0000 Received: from [85.158.143.35:28606] by server-1.bemta-4.messagelabs.com id 93/59-02132-96DC2C25; Tue, 31 Dec 2013 13:58:01 +0000 X-Env-Sender: lars.kurth.xen@gmail.com X-Msg-Ref: server-9.tower-21.messagelabs.com!1388498280!8940091!1 X-Originating-IP: [74.125.82.53] X-SpamReason: No, hits=0.2 required=7.0 tests=RCVD_ILLEGAL_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 5093 invoked from network); 31 Dec 2013 13:58:00 -0000 Received: from mail-wg0-f53.google.com (HELO mail-wg0-f53.google.com) (74.125.82.53) by server-9.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 13:58:00 -0000 Received: by mail-wg0-f53.google.com with SMTP id k14so11243166wgh.32 for ; Tue, 31 Dec 2013 05:58:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:reply-to:user-agent:mime-version:to:cc :subject:references:in-reply-to:content-type :content-transfer-encoding; bh=GpQCyMwnMLJJa4Shm/9xymBhGt/ljc1Zu30CZy8IbGY=; b=wDdSVO9ZNPhxi5aoxtHyP5etq/R//FyauAmyhBjF07vGMxRwG/7gtu96cOGZkuLUs+ f3DwWq9gkw02SnTpEHQgqio5UvODHG+LeehI9AJrotsLlnvIAiSH3Xm5MrRtHl5UEgyC 6/7wgNJEAQN63k/cINSEVu28kUMBYv6qnOtmZnsQh5DGevcjbVGpaoLLwLRAm5e299xN /QBCzO1GhHPrFYbEvzusNRw/ZZk1FM4ggcfqPqgosEF4i/1oMqUVxWMQMbiZ7TP/yJrK RO8g+FPThV++LULFeUKGM9XldBT3wu6koRbAmFLPOd1RCzYb8vyhuR/05SgZo8BHlRPE foXw== X-Received: by 10.180.103.68 with SMTP id fu4mr48063573wib.19.1388498280545; Tue, 31 Dec 2013 05:58:00 -0800 (PST) Received: from [172.16.26.11] ([2.122.219.75]) by mx.google.com with ESMTPSA id gd5sm30079311wic.0.2013.12.31.05.57.59 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 31 Dec 2013 05:57:59 -0800 (PST) Message-ID: <52C2CD67.6050603@xen.org> Date: Tue, 31 Dec 2013 13:57:59 +0000 From: Lars Kurth User-Agent: Mozilla/5.0 (Windows NT 6.1; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Dario Faggioli References: <52B03A2A.807@xen.org> <1388246226.15148.4.camel@Solace> In-Reply-To: <1388246226.15148.4.camel@Solace> Cc: "xen-users@lists.xen.org" , "xen-api@lists.xen.org" , "publicity@lists.xenproject.org" , mirageos-devel@lists.xenproject.org, "xen-devel@lists.xen.org" Subject: Re: [Xen-users] [Publicity] Xen booth at FOSDEM : invitation to community members to help man the booth, show demos, have your hand-outs there, etc. X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list Reply-To: lars.kurth@xen.org List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On 28/12/2013 15:57, Dario Faggioli wrote: > So I was wondering, we did not get that much of a response about this > (or perhaps we did, but not in public, in which case, ignore me). > > I know, holidays are not helping, etc. but, anyway, should we turn this > e-mail into a blog post to send out in early January? I'm up for it if > we think it's a good thing to do. It is probably the holidays: I know that Cloudious Systems (the makers of OSv) are interested showing OSv running on top of Xen and so do the XO guys. A blog post could be a good idea (tying it up with the DevRoom program, which has not yet been published). Another approach would be to reach out pro-actively to people we want to do demos (e.g. Samsung, people/projects with RT schedulers, ...). Unfortunuately I will struggle to do this given that I am in China. Regards Lars _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 13:59:06 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 13:59:06 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxzpb-000261-TH; Tue, 31 Dec 2013 13:58:03 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vxzpa-00025U-E7; Tue, 31 Dec 2013 13:58:02 +0000 Received: from [85.158.143.35:28606] by server-1.bemta-4.messagelabs.com id 93/59-02132-96DC2C25; Tue, 31 Dec 2013 13:58:01 +0000 X-Env-Sender: lars.kurth.xen@gmail.com X-Msg-Ref: server-9.tower-21.messagelabs.com!1388498280!8940091!1 X-Originating-IP: [74.125.82.53] X-SpamReason: No, hits=0.2 required=7.0 tests=RCVD_ILLEGAL_IP X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 5093 invoked from network); 31 Dec 2013 13:58:00 -0000 Received: from mail-wg0-f53.google.com (HELO mail-wg0-f53.google.com) (74.125.82.53) by server-9.tower-21.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 13:58:00 -0000 Received: by mail-wg0-f53.google.com with SMTP id k14so11243166wgh.32 for ; Tue, 31 Dec 2013 05:58:00 -0800 (PST) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20120113; h=sender:message-id:date:from:reply-to:user-agent:mime-version:to:cc :subject:references:in-reply-to:content-type :content-transfer-encoding; bh=GpQCyMwnMLJJa4Shm/9xymBhGt/ljc1Zu30CZy8IbGY=; b=wDdSVO9ZNPhxi5aoxtHyP5etq/R//FyauAmyhBjF07vGMxRwG/7gtu96cOGZkuLUs+ f3DwWq9gkw02SnTpEHQgqio5UvODHG+LeehI9AJrotsLlnvIAiSH3Xm5MrRtHl5UEgyC 6/7wgNJEAQN63k/cINSEVu28kUMBYv6qnOtmZnsQh5DGevcjbVGpaoLLwLRAm5e299xN /QBCzO1GhHPrFYbEvzusNRw/ZZk1FM4ggcfqPqgosEF4i/1oMqUVxWMQMbiZ7TP/yJrK RO8g+FPThV++LULFeUKGM9XldBT3wu6koRbAmFLPOd1RCzYb8vyhuR/05SgZo8BHlRPE foXw== X-Received: by 10.180.103.68 with SMTP id fu4mr48063573wib.19.1388498280545; Tue, 31 Dec 2013 05:58:00 -0800 (PST) Received: from [172.16.26.11] ([2.122.219.75]) by mx.google.com with ESMTPSA id gd5sm30079311wic.0.2013.12.31.05.57.59 for (version=TLSv1 cipher=ECDHE-RSA-RC4-SHA bits=128/128); Tue, 31 Dec 2013 05:57:59 -0800 (PST) Message-ID: <52C2CD67.6050603@xen.org> Date: Tue, 31 Dec 2013 13:57:59 +0000 From: Lars Kurth User-Agent: Mozilla/5.0 (Windows NT 6.1; rv:24.0) Gecko/20100101 Thunderbird/24.2.0 MIME-Version: 1.0 To: Dario Faggioli References: <52B03A2A.807@xen.org> <1388246226.15148.4.camel@Solace> In-Reply-To: <1388246226.15148.4.camel@Solace> Cc: "xen-users@lists.xen.org" , "xen-api@lists.xen.org" , "publicity@lists.xenproject.org" , mirageos-devel@lists.xenproject.org, "xen-devel@lists.xen.org" Subject: Re: [Xen-users] [Publicity] Xen booth at FOSDEM : invitation to community members to help man the booth, show demos, have your hand-outs there, etc. X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list Reply-To: lars.kurth@xen.org List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Transfer-Encoding: 7bit Content-Type: text/plain; charset="us-ascii"; Format="flowed" Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On 28/12/2013 15:57, Dario Faggioli wrote: > So I was wondering, we did not get that much of a response about this > (or perhaps we did, but not in public, in which case, ignore me). > > I know, holidays are not helping, etc. but, anyway, should we turn this > e-mail into a blog post to send out in early January? I'm up for it if > we think it's a good thing to do. It is probably the holidays: I know that Cloudious Systems (the makers of OSv) are interested showing OSv running on top of Xen and so do the XO guys. A blog post could be a good idea (tying it up with the DevRoom program, which has not yet been published). Another approach would be to reach out pro-actively to people we want to do demos (e.g. Samsung, people/projects with RT schedulers, ...). Unfortunuately I will struggle to do this given that I am in China. Regards Lars _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 15:34:50 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 15:34:50 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vy1KL-0006hR-TS; Tue, 31 Dec 2013 15:33:53 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vy1KK-0006h9-Fy; Tue, 31 Dec 2013 15:33:52 +0000 Received: from [85.158.137.68:38514] by server-12.bemta-3.messagelabs.com id D1/6C-20055-FD3E2C25; Tue, 31 Dec 2013 15:33:51 +0000 X-Env-Sender: konrad.wilk@oracle.com X-Msg-Ref: server-4.tower-31.messagelabs.com!1388504017!6652167!1 X-Originating-IP: [156.151.31.81] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogMTU2LjE1MS4zMS44MSA9PiAyODgzMzk=\n, ML_RADAR_SPEW_LINKS_8, spamassassin: , async_handler: YXN5bmNfZGVsYXk6IDcwNTA1NzQgKHRpbWVvdXQp\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 17105 invoked from network); 31 Dec 2013 15:33:38 -0000 Received: from userp1040.oracle.com (HELO userp1040.oracle.com) (156.151.31.81) by server-4.tower-31.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 31 Dec 2013 15:33:38 -0000 Received: from acsinet22.oracle.com (acsinet22.oracle.com [141.146.126.238]) by userp1040.oracle.com (Sentrion-MTA-4.3.1/Sentrion-MTA-4.3.1) with ESMTP id rBVFXXkA009936 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Tue, 31 Dec 2013 15:33:34 GMT Received: from userz7021.oracle.com (userz7021.oracle.com [156.151.31.85]) by acsinet22.oracle.com (8.14.4+Sun/8.14.4) with ESMTP id rBVFXWsd018933 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 31 Dec 2013 15:33:32 GMT Received: from abhmp0004.oracle.com (abhmp0004.oracle.com [141.146.116.10]) by userz7021.oracle.com (8.14.4+Sun/8.14.4) with ESMTP id rBVFXV3U013599; Tue, 31 Dec 2013 15:33:31 GMT Received: from phenom.dumpdata.com (/50.195.21.189) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Tue, 31 Dec 2013 07:33:31 -0800 Received: by phenom.dumpdata.com (Postfix, from userid 1000) id 3DA251BF850; Tue, 31 Dec 2013 10:33:30 -0500 (EST) Date: Tue, 31 Dec 2013 10:33:30 -0500 From: Konrad Rzeszutek Wilk To: Russell Pavlicek , andres@lagarcavilla.org, tim@xen.org Message-ID: <20131231153330.GC20357@phenom.dumpdata.com> References: <55E78A57290FB64FA0D3CF672F9F3DA211C793@SJCPEX01CL03.citrite.net> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <55E78A57290FB64FA0D3CF672F9F3DA211C793@SJCPEX01CL03.citrite.net> User-Agent: Mutt/1.5.21 (2010-09-15) X-Source-IP: acsinet22.oracle.com [141.146.126.238] Cc: "xen-users@lists.xen.org" , "xen-devel@lists.xen.org" Subject: Re: [Xen-users] [Xen-devel] Serious issues with xenpaging X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Mon, Dec 23, 2013 at 06:34:55PM +0000, Russell Pavlicek wrote: > On Twitter, Florian Heigl sent a out a few messages about issues with xenpaging: > > --- > 19-Dec: Anyone successfully use #xen #xenpaging? docs are at SLES manual, rest is mostly this: http://www.gossamer-threads.com/lists/xen/devel/255798 dead feature or usable? > > 22-Dec: @lars_kurth @RCPavlicek Hey guys, I wrote down as much as I could https://piratenpad.de/p/Ik3lOBLniq1L5TEM (since I'm on holiday and not constant online) > > 22-Dec: Yay, tested #xen Xenpaging (memory overcommit) > [x] largely untested > [x] docs outdated > [x] syntax+logic changed > [x] broken > --- > > [I've taken the liberty of removing the colorful expletive from the final post] > > Is Florian's assessment correct, or is there somewhere we can point him for help? I'm on vacation this week, but if someone replies to me, I will try to forward the information appropriately. The Maintainers file implies otherwise. Let me CC the maintainers. > > Thanks, > > Russ Pavlicek > Xen Project Evangelist, Citrix Systems > Home Office: +1-301-829-5327 > Mobile: +1-240-397-0199 > UK VoIP: +44 1223 852 894 > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xen.org > http://lists.xen.org/xen-devel _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 15:34:50 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 15:34:50 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vy1KL-0006hR-TS; Tue, 31 Dec 2013 15:33:53 +0000 Received: from mail6.bemta3.messagelabs.com ([195.245.230.39]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vy1KK-0006h9-Fy; Tue, 31 Dec 2013 15:33:52 +0000 Received: from [85.158.137.68:38514] by server-12.bemta-3.messagelabs.com id D1/6C-20055-FD3E2C25; Tue, 31 Dec 2013 15:33:51 +0000 X-Env-Sender: konrad.wilk@oracle.com X-Msg-Ref: server-4.tower-31.messagelabs.com!1388504017!6652167!1 X-Originating-IP: [156.151.31.81] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogMTU2LjE1MS4zMS44MSA9PiAyODgzMzk=\n, ML_RADAR_SPEW_LINKS_8, spamassassin: , async_handler: YXN5bmNfZGVsYXk6IDcwNTA1NzQgKHRpbWVvdXQp\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 17105 invoked from network); 31 Dec 2013 15:33:38 -0000 Received: from userp1040.oracle.com (HELO userp1040.oracle.com) (156.151.31.81) by server-4.tower-31.messagelabs.com with DHE-RSA-AES256-SHA encrypted SMTP; 31 Dec 2013 15:33:38 -0000 Received: from acsinet22.oracle.com (acsinet22.oracle.com [141.146.126.238]) by userp1040.oracle.com (Sentrion-MTA-4.3.1/Sentrion-MTA-4.3.1) with ESMTP id rBVFXXkA009936 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=OK); Tue, 31 Dec 2013 15:33:34 GMT Received: from userz7021.oracle.com (userz7021.oracle.com [156.151.31.85]) by acsinet22.oracle.com (8.14.4+Sun/8.14.4) with ESMTP id rBVFXWsd018933 (version=TLSv1/SSLv3 cipher=DHE-RSA-AES256-SHA bits=256 verify=NO); Tue, 31 Dec 2013 15:33:32 GMT Received: from abhmp0004.oracle.com (abhmp0004.oracle.com [141.146.116.10]) by userz7021.oracle.com (8.14.4+Sun/8.14.4) with ESMTP id rBVFXV3U013599; Tue, 31 Dec 2013 15:33:31 GMT Received: from phenom.dumpdata.com (/50.195.21.189) by default (Oracle Beehive Gateway v4.0) with ESMTP ; Tue, 31 Dec 2013 07:33:31 -0800 Received: by phenom.dumpdata.com (Postfix, from userid 1000) id 3DA251BF850; Tue, 31 Dec 2013 10:33:30 -0500 (EST) Date: Tue, 31 Dec 2013 10:33:30 -0500 From: Konrad Rzeszutek Wilk To: Russell Pavlicek , andres@lagarcavilla.org, tim@xen.org Message-ID: <20131231153330.GC20357@phenom.dumpdata.com> References: <55E78A57290FB64FA0D3CF672F9F3DA211C793@SJCPEX01CL03.citrite.net> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <55E78A57290FB64FA0D3CF672F9F3DA211C793@SJCPEX01CL03.citrite.net> User-Agent: Mutt/1.5.21 (2010-09-15) X-Source-IP: acsinet22.oracle.com [141.146.126.238] Cc: "xen-users@lists.xen.org" , "xen-devel@lists.xen.org" Subject: Re: [Xen-users] [Xen-devel] Serious issues with xenpaging X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Mon, Dec 23, 2013 at 06:34:55PM +0000, Russell Pavlicek wrote: > On Twitter, Florian Heigl sent a out a few messages about issues with xenpaging: > > --- > 19-Dec: Anyone successfully use #xen #xenpaging? docs are at SLES manual, rest is mostly this: http://www.gossamer-threads.com/lists/xen/devel/255798 dead feature or usable? > > 22-Dec: @lars_kurth @RCPavlicek Hey guys, I wrote down as much as I could https://piratenpad.de/p/Ik3lOBLniq1L5TEM (since I'm on holiday and not constant online) > > 22-Dec: Yay, tested #xen Xenpaging (memory overcommit) > [x] largely untested > [x] docs outdated > [x] syntax+logic changed > [x] broken > --- > > [I've taken the liberty of removing the colorful expletive from the final post] > > Is Florian's assessment correct, or is there somewhere we can point him for help? I'm on vacation this week, but if someone replies to me, I will try to forward the information appropriately. The Maintainers file implies otherwise. Let me CC the maintainers. > > Thanks, > > Russ Pavlicek > Xen Project Evangelist, Citrix Systems > Home Office: +1-301-829-5327 > Mobile: +1-240-397-0199 > UK VoIP: +44 1223 852 894 > _______________________________________________ > Xen-devel mailing list > Xen-devel@lists.xen.org > http://lists.xen.org/xen-devel _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 16:54:42 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 16:54:42 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vy2ZY-0001pD-1C; Tue, 31 Dec 2013 16:53:40 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vy2ZW-0001p8-Jy for xen-users@lists.xen.org; Tue, 31 Dec 2013 16:53:38 +0000 Received: from [85.158.143.35:13669] by server-1.bemta-4.messagelabs.com id 25/CE-02132-196F2C25; Tue, 31 Dec 2013 16:53:37 +0000 X-Env-Sender: mlg-hessigheim@gmx.de X-Msg-Ref: server-2.tower-21.messagelabs.com!1388508816!8915861!1 X-Originating-IP: [212.227.15.15] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE1LjE1ID0+IDI0NzM3\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE1LjE1ID0+IDI0NzM3\n,ML_RADAR_SPEW_LINKS_14, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23542 invoked from network); 31 Dec 2013 16:53:37 -0000 Received: from mout.gmx.net (HELO mout.gmx.net) (212.227.15.15) by server-2.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 31 Dec 2013 16:53:37 -0000 Received: from [192.168.2.100] ([91.89.92.96]) by mail.gmx.com (mrgmx102) with ESMTPSA (Nemesis) id 0LinyL-1VSHj31O97-00cwLV for ; Tue, 31 Dec 2013 17:53:36 +0100 Date: Tue, 31 Dec 2013 17:53:28 +0100 From: Martin Lang To: Wei Liu MIME-Version: 1.0 Message-ID: <0MeMOx-1VnmeN1vpf-00QCr9@mail.gmx.com> X-Provags-ID: V03:K0:8oeVxUSYfNFmUH7sRVn249MdkDQJ0ZUKi4dkuulU7WtWBQcUAvY uS+o0MG61sjwhlQsGS5qUGelZJcn2JvMFLuX8Ex5PxkmBI1x1ercFshNUlVYuwmv47iP2T/ Y9+IqUvBUg0UaLKRhg9cD1XawlqpvcPIXLfkD5G2Nav3+FcGe9qyP3hGC5EeIFWTwGD+X3l uKXxOGqHe/ri3r/bQeqww== Cc: "xen-users@lists.xen.org " Subject: Re: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Yes same stack trace Am 31.12.2013 12:32 schrieb Wei Liu : > > On Tue, Dec 31, 2013 at 12:19:41PM +0100, Martin Lang wrote: > > I tried now a different kernel for dom0 (3.2.0-4-686-pae from debian > > wheezy) with the same effect. After some network traffic the > > networking hangs. Is there anything I can do to provide more > > information? > > > > Did it hang with the same stacktrace? I mean, transmit queue timed out. > > Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 16:54:42 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 16:54:42 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vy2ZY-0001pD-1C; Tue, 31 Dec 2013 16:53:40 +0000 Received: from mail6.bemta4.messagelabs.com ([85.158.143.247]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vy2ZW-0001p8-Jy for xen-users@lists.xen.org; Tue, 31 Dec 2013 16:53:38 +0000 Received: from [85.158.143.35:13669] by server-1.bemta-4.messagelabs.com id 25/CE-02132-196F2C25; Tue, 31 Dec 2013 16:53:37 +0000 X-Env-Sender: mlg-hessigheim@gmx.de X-Msg-Ref: server-2.tower-21.messagelabs.com!1388508816!8915861!1 X-Originating-IP: [212.227.15.15] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE1LjE1ID0+IDI0NzM3\n,sa_preprocessor: QmFkIElQOiAyMTIuMjI3LjE1LjE1ID0+IDI0NzM3\n,ML_RADAR_SPEW_LINKS_14, spamassassin: X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23542 invoked from network); 31 Dec 2013 16:53:37 -0000 Received: from mout.gmx.net (HELO mout.gmx.net) (212.227.15.15) by server-2.tower-21.messagelabs.com with DHE-RSA-AES128-SHA encrypted SMTP; 31 Dec 2013 16:53:37 -0000 Received: from [192.168.2.100] ([91.89.92.96]) by mail.gmx.com (mrgmx102) with ESMTPSA (Nemesis) id 0LinyL-1VSHj31O97-00cwLV for ; Tue, 31 Dec 2013 17:53:36 +0100 Date: Tue, 31 Dec 2013 17:53:28 +0100 From: Martin Lang To: Wei Liu MIME-Version: 1.0 Message-ID: <0MeMOx-1VnmeN1vpf-00QCr9@mail.gmx.com> X-Provags-ID: V03:K0:8oeVxUSYfNFmUH7sRVn249MdkDQJ0ZUKi4dkuulU7WtWBQcUAvY uS+o0MG61sjwhlQsGS5qUGelZJcn2JvMFLuX8Ex5PxkmBI1x1ercFshNUlVYuwmv47iP2T/ Y9+IqUvBUg0UaLKRhg9cD1XawlqpvcPIXLfkD5G2Nav3+FcGe9qyP3hGC5EeIFWTwGD+X3l uKXxOGqHe/ri3r/bQeqww== Cc: "xen-users@lists.xen.org " Subject: Re: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org Yes same stack trace Am 31.12.2013 12:32 schrieb Wei Liu : > > On Tue, Dec 31, 2013 at 12:19:41PM +0100, Martin Lang wrote: > > I tried now a different kernel for dom0 (3.2.0-4-686-pae from debian > > wheezy) with the same effect. After some network traffic the > > networking hangs. Is there anything I can do to provide more > > information? > > > > Did it hang with the same stacktrace? I mean, transmit queue timed out. > > Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 17:02:02 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 17:02:02 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vy2hS-0002Mz-7D; Tue, 31 Dec 2013 17:01:50 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vy2hQ-0002Ms-PL for xen-users@lists.xen.org; Tue, 31 Dec 2013 17:01:48 +0000 Received: from [193.109.254.147:6828] by server-9.bemta-14.messagelabs.com id 37/4F-13957-B78F2C25; Tue, 31 Dec 2013 17:01:47 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-5.tower-27.messagelabs.com!1388509305!8230768!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23292 invoked from network); 31 Dec 2013 17:01:46 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-5.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 17:01:46 -0000 X-IronPort-AV: E=Sophos;i="4.95,581,1384300800"; d="scan'208";a="88890249" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 31 Dec 2013 17:01:44 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Tue, 31 Dec 2013 12:01:43 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1Vy2hM-0000f8-5N; Tue, 31 Dec 2013 17:01:44 +0000 Date: Tue, 31 Dec 2013 17:01:44 +0000 From: Wei Liu To: Martin Lang Message-ID: <20131231170144.GG19696@zion.uk.xensource.com> References: <0MeMOx-1VnmeN1vpf-00QCr9@mail.gmx.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <0MeMOx-1VnmeN1vpf-00QCr9@mail.gmx.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: "xen-users@lists.xen.org " , Wei Liu Subject: Re: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, Dec 31, 2013 at 05:53:28PM +0100, Martin Lang wrote: > Yes same stack trace Do you see any other warning / error from Dom0 kernel / hypervisor before the stacktrace (try to increase kernel log level to 10)? To get the hypervisor log you might need to increase verbosity of hypervisor log and use serial console. Wei. > > Am 31.12.2013 12:32 schrieb Wei Liu : > > > > On Tue, Dec 31, 2013 at 12:19:41PM +0100, Martin Lang wrote: > > > I tried now a different kernel for dom0 (3.2.0-4-686-pae from debian > > > wheezy) with the same effect. After some network traffic the > > > networking hangs. Is there anything I can do to provide more > > > information? > > > > > > > Did it hang with the same stacktrace? I mean, transmit queue timed out. > > > > Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users From xen-users-bounces@lists.xen.org Tue Dec 31 17:02:02 2013 Return-path: Envelope-to: archives@lists.xen.org Delivery-date: Tue, 31 Dec 2013 17:02:02 +0000 Received: from localhost ([127.0.0.1] helo=lists.xen.org) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vy2hS-0002Mz-7D; Tue, 31 Dec 2013 17:01:50 +0000 Received: from mail6.bemta14.messagelabs.com ([193.109.254.103]) by lists.xen.org with esmtp (Exim 4.72) (envelope-from ) id 1Vy2hQ-0002Ms-PL for xen-users@lists.xen.org; Tue, 31 Dec 2013 17:01:48 +0000 Received: from [193.109.254.147:6828] by server-9.bemta-14.messagelabs.com id 37/4F-13957-B78F2C25; Tue, 31 Dec 2013 17:01:47 +0000 X-Env-Sender: wei.liu2@citrix.com X-Msg-Ref: server-5.tower-27.messagelabs.com!1388509305!8230768!1 X-Originating-IP: [66.165.176.89] X-SpamReason: No, hits=0.0 required=7.0 tests=sa_preprocessor: VHJ1c3RlZCBJUDogNjYuMTY1LjE3Ni44OSA9PiAyMDMwMDc=\n X-StarScan-Received: X-StarScan-Version: 6.9.16; banners=-,-,- X-VirusChecked: Checked Received: (qmail 23292 invoked from network); 31 Dec 2013 17:01:46 -0000 Received: from smtp.citrix.com (HELO SMTP.CITRIX.COM) (66.165.176.89) by server-5.tower-27.messagelabs.com with RC4-SHA encrypted SMTP; 31 Dec 2013 17:01:46 -0000 X-IronPort-AV: E=Sophos;i="4.95,581,1384300800"; d="scan'208";a="88890249" Received: from accessns.citrite.net (HELO FTLPEX01CL03.citrite.net) ([10.9.154.239]) by FTLPIPO01.CITRIX.COM with ESMTP; 31 Dec 2013 17:01:44 +0000 Received: from ukmail1.uk.xensource.com (10.80.16.128) by smtprelay.citrix.com (10.13.107.80) with Microsoft SMTP Server id 14.2.342.4; Tue, 31 Dec 2013 12:01:43 -0500 Received: from zion.uk.xensource.com ([10.80.2.73]) by ukmail1.uk.xensource.com with esmtp (Exim 4.69) (envelope-from ) id 1Vy2hM-0000f8-5N; Tue, 31 Dec 2013 17:01:44 +0000 Date: Tue, 31 Dec 2013 17:01:44 +0000 From: Wei Liu To: Martin Lang Message-ID: <20131231170144.GG19696@zion.uk.xensource.com> References: <0MeMOx-1VnmeN1vpf-00QCr9@mail.gmx.com> MIME-Version: 1.0 Content-Disposition: inline In-Reply-To: <0MeMOx-1VnmeN1vpf-00QCr9@mail.gmx.com> User-Agent: Mutt/1.5.21 (2010-09-15) X-DLP: MIA1 Cc: "xen-users@lists.xen.org " , Wei Liu Subject: Re: [Xen-users] Dom0 crashes with network traffic X-BeenThere: xen-users@lists.xen.org X-Mailman-Version: 2.1.13 Precedence: list List-Id: Xen user discussion List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit Sender: xen-users-bounces@lists.xen.org Errors-To: xen-users-bounces@lists.xen.org On Tue, Dec 31, 2013 at 05:53:28PM +0100, Martin Lang wrote: > Yes same stack trace Do you see any other warning / error from Dom0 kernel / hypervisor before the stacktrace (try to increase kernel log level to 10)? To get the hypervisor log you might need to increase verbosity of hypervisor log and use serial console. Wei. > > Am 31.12.2013 12:32 schrieb Wei Liu : > > > > On Tue, Dec 31, 2013 at 12:19:41PM +0100, Martin Lang wrote: > > > I tried now a different kernel for dom0 (3.2.0-4-686-pae from debian > > > wheezy) with the same effect. After some network traffic the > > > networking hangs. Is there anything I can do to provide more > > > information? > > > > > > > Did it hang with the same stacktrace? I mean, transmit queue timed out. > > > > Wei. _______________________________________________ Xen-users mailing list Xen-users@lists.xen.org http://lists.xen.org/xen-users