From mirageos-devel-bounces@lists.xenproject.org Tue Jul 03 10:03:33 2018 Return-path: Envelope-to: archives@lists.xenproject.org Delivery-date: Tue, 03 Jul 2018 10:03:33 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1faI9W-0000kc-5a; Tue, 03 Jul 2018 10:03:18 +0000 Received: from us1-rack-dfw2.inumbo.com ([104.130.134.6]) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1fTPJM-0008Lw-Rt for mirageos-devel@lists.xenproject.org; Thu, 14 Jun 2018 10:17:00 +0000 X-Inumbo-ID: ba4af015-6fbb-11e8-9728-bc764e045a96 Received: from foss.arm.com (unknown [217.140.101.70]) by us1-rack-dfw2.inumbo.com (Halon) with ESMTP id ba4af015-6fbb-11e8-9728-bc764e045a96; Thu, 14 Jun 2018 12:14:31 +0200 (CEST) Received: from usa-sjc-imap-foss1.foss.arm.com (unknown [10.72.51.249]) by usa-sjc-mx-foss1.foss.arm.com (Postfix) with ESMTP id E0ABB1529; Thu, 14 Jun 2018 03:16:58 -0700 (PDT) Received: from [10.1.206.53] (e108454-lin.cambridge.arm.com [10.1.206.53]) by usa-sjc-imap-foss1.foss.arm.com (Postfix) with ESMTPSA id 298B13F59D; Thu, 14 Jun 2018 03:16:57 -0700 (PDT) To: Stefano Stabellini , committers@xenproject.org, xen-devel@lists.xenproject.org, xen-api@lists.xenproject.org, mirageos-devel@lists.xenproject.org, minios-devel@lists.xenproject.org References: From: Julien Grall Message-ID: <06fff543-fb92-ba91-73d6-977d1eac6aa6@arm.com> Date: Thu, 14 Jun 2018 11:16:55 +0100 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:52.0) Gecko/20100101 Thunderbird/52.7.0 MIME-Version: 1.0 In-Reply-To: Content-Language: en-US X-Mailman-Approved-At: Tue, 03 Jul 2018 10:03:16 +0000 Subject: Re: [MirageOS-devel] [RFC v2] ViryaOS: proposal for a new Xen Project sub-project X-BeenThere: mirageos-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Developer list for MirageOS List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Cc: George.Dunlap@eu.citrix.com, lars.kurth@citrix.com, rajiv.ranganath@atihita.com, wei.liu2@citrix.com Content-Transfer-Encoding: base64 Content-Type: text/plain; charset="utf-8"; Format="flowed" Errors-To: mirageos-devel-bounces@lists.xenproject.org Sender: "MirageOS-devel" CgpPbiAyMy8wNS8xOCAxOToxOSwgU3RlZmFubyBTdGFiZWxsaW5pIHdyb3RlOgo+IEhpIGFsbCwK CkhpIFN0ZWZhbm8sCgo+IAo+IEZvbGxvd2luZyB1cCBmcm9tIHByZXZpb3VzIGNvbnZlcnNhdGlv bnMgd2l0aCB0aGUgY29tbWl0dGVycywgSSBhbQo+IGFwcGVuZGluZyBhIHByb3Bvc2FsIGZvciBh IG5ldyBYZW4gUHJvamVjdCBzdWItcHJvamVjdCBhaW1lZCBhdCBlbWJlZGRlZAo+IGFuZCBJb1Qu Cj4gCj4gU3BvbnNvcnMgYXJlIHZlcnkgd2VsY29tZSEgOi0pCgpJIGFtIGhhcHB5IHRvIHNwb25z b3IgdGhlIHByb2plY3QgOikuCgpDaGVlcnMsCgotLSAKSnVsaWVuIEdyYWxsCgpfX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpNaXJhZ2VPUy1kZXZlbCBtYWls aW5nIGxpc3QKTWlyYWdlT1MtZGV2ZWxAbGlzdHMueGVucHJvamVjdC5vcmcKaHR0cHM6Ly9saXN0 cy54ZW5wcm9qZWN0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL21pcmFnZW9zLWRldmVsCg== From mirageos-devel-bounces@lists.xenproject.org Wed Jul 11 10:38:16 2018 Return-path: Envelope-to: archives@lists.xenproject.org Delivery-date: Wed, 11 Jul 2018 10:38:16 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1fdCVX-0003PO-QB; Wed, 11 Jul 2018 10:38:03 +0000 Received: from all-amaz-eas1.inumbo.com ([34.197.232.57]) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1fdCVW-0003PI-6q for mirageos-devel@lists.xenproject.org; Wed, 11 Jul 2018 10:38:02 +0000 X-Inumbo-ID: 7e3af5ff-84f6-11e8-a6a9-d7ebe60f679a Received: from mail.mehnert.org (unknown [213.73.89.200]) by us1-amaz-eas1.inumbo.com (Halon) with ESMTPS id 7e3af5ff-84f6-11e8-a6a9-d7ebe60f679a; Wed, 11 Jul 2018 10:38:05 +0000 (UTC) Received: from [192.168.42.44] (i5E86D6F4.versanet.de [94.134.214.244]) (using TLSv1 with cipher DHE-RSA-AES128-SHA (128/128 bits)) (Client CN "hannes@mehnert.org", Issuer "mehnert root CA" (not verified)) by mail.mehnert.org (Postfix) with ESMTPS id 51509453 for ; Wed, 11 Jul 2018 12:37:59 +0200 (CEST) From: Hannes Mehnert To: mirageos-devel@lists.xenproject.org References: <7d99734d-4316-01ec-fb6a-f2a7629964bf@mehnert.org> Openpgp: id=11B5464249B5BD858FFF6328BC896588DF7C28EE Message-ID: <872110a7-fcd0-971b-a796-97cde4d46a8d@mehnert.org> Date: Wed, 11 Jul 2018 12:37:52 +0200 User-Agent: Mozilla/5.0 (X11; FreeBSD amd64; rv:52.0) Gecko/20100101 Thunderbird/52.8.0 MIME-Version: 1.0 In-Reply-To: <7d99734d-4316-01ec-fb6a-f2a7629964bf@mehnert.org> Content-Language: en-US Subject: [MirageOS-devel] MirageOS biweekly (fortnightly) catchup - Wednesday, 11th July (today!) at 16.00 BST X-BeenThere: mirageos-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Developer list for MirageOS List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: text/plain; charset="utf-8" Content-Transfer-Encoding: base64 Errors-To: mirageos-devel-bounces@lists.xenproject.org Sender: "MirageOS-devel" RGVhciBoYWNrZXJzLAoKd2UnbGwgaGF2ZSBvbmUgb2Ygb3VyIHJlZ3VsYXJseS1zY2hlZHVsZWQg Yml3ZWVrbHkgSVJDIGNhdGNodXBzIGF0IDE2LjAwCkJTVCB0b2RheS4gIFdlIG1lZXQgaW4gI21p cmFnZSBvbiBpcmMuZnJlZW5vZGUubmV0LgoKUGxlYXNlIGFkZCBpdGVtcyB0byB0aGUgYWdlbmRh IGF0Cmh0dHBzOi8vZ2l0aHViLmNvbS9taXJhZ2UvbWlyYWdlLXd3dy93aWtpL0NhbGwtQWdlbmRh IzExLWp1bHktMjAxOCAtCmlkZWFsbHkgd2l0aCB5b3VyIG5pY2sgYWxvbmdzaWRlIHNvIHdlIGtu b3cgd2hvIGhhcyBhIHF1ZXN0aW9uIG9yCnN0YXRlbWVudCBhYm91dCB0aGF0IGl0ZW0uCgpZb3Ug Y2FuIHNlZSB0aGUgSVJDIGxvZ3MgZm9yIHRoZSBwcmV2aW91cyBjYXRjaHVwIG9uIDJuZCBNYXkg YXQKaHR0cHM6Ly9pcmNsb2cud2hpdGVxdWFyay5vcmcvbWlyYWdlLzIwMTgtMDYtMjcgKHRoYW5r cywgd2hpdGVxdWFyayEpLgoKU2VlIHlvdSBzb29uIQoKaGFubmVzCgpfX19fX19fX19fX19fX19f X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwpNaXJhZ2VPUy1kZXZlbCBtYWlsaW5nIGxp c3QKTWlyYWdlT1MtZGV2ZWxAbGlzdHMueGVucHJvamVjdC5vcmcKaHR0cHM6Ly9saXN0cy54ZW5w cm9qZWN0Lm9yZy9tYWlsbWFuL2xpc3RpbmZvL21pcmFnZW9zLWRldmVsCg== From mirageos-devel-bounces@lists.xenproject.org Tue Jul 31 08:10:43 2018 Return-path: Envelope-to: archives@lists.xenproject.org Delivery-date: Tue, 31 Jul 2018 08:10:43 +0000 Received: from localhost ([127.0.0.1] helo=lists.xenproject.org) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1fkPjj-0001ww-Fx; Tue, 31 Jul 2018 08:10:31 +0000 Received: from us1-rack-dfw2.inumbo.com ([104.130.134.6]) by lists.xenproject.org with esmtp (Exim 4.89) (envelope-from ) id 1fkCtP-0000V9-VA for mirageos-devel@lists.xenproject.org; Mon, 30 Jul 2018 18:27:40 +0000 X-Inumbo-ID: 24121491-9426-11e8-a8a5-bc764e045a96 Received: from mail-oi0-x242.google.com (unknown [2607:f8b0:4003:c06::242]) by us1-rack-dfw2.inumbo.com (Halon) with ESMTPS id 24121491-9426-11e8-a8a5-bc764e045a96; Mon, 30 Jul 2018 20:26:57 +0200 (CEST) Received: by mail-oi0-x242.google.com with SMTP id s198-v6so23074474oih.11 for ; Mon, 30 Jul 2018 11:27:38 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:from:date:message-id:subject:to; bh=+diIHQMjAlaadYQKpOw7D91VZT9K4rcaFkskkCYn2Gw=; b=vQbGW+YPoEX1cs3Vib92oPVIp6flsYqqoxm1gzeI/vXVFv94jMmk/fHyKznqL77CJm X5sbufkDsUiTPOGYJy3dZpnnZj8wRDwKukRhD/cIYFuJwoHapi5bNhxsIN0h4cVwyVUR TB29vhi8nh5N/LwHUM1FopZrDg+CwzEUB6uUTntnb0u013R1qaOt81YTfexnVguwiQEU El4OhiQ3YTSGlRCvkPAff5qKuI2TxbzrXzFQY82OqjnbZT13HXH3z9vafpeM7xGneKY5 JZkganP0zTyMKgZdrBeDV3ZkbDOUB9gIJnreBwMRCcDnfe+XvroYbATpLKbtmPd/yWl9 +5wA== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:from:date:message-id:subject:to; bh=+diIHQMjAlaadYQKpOw7D91VZT9K4rcaFkskkCYn2Gw=; b=PeLw08bhTxNceqqwHCbWq4jyqJsBYcbAxfjDDrqa2NkdOrth8XaZbs5lfOt/pcqLyj 34nMGfkTYANV4ZemPG3WDgg0Uc/tjV6s/V2Ts4+VE6cA5yV+1JxNjNNSxLrPchw41w/Z vVN9w6cXSA4sLavSNXliw8kRyLJ0rioGhwaT0TQiDvNbImo/WvRxQTOvWL3uZef3RgWd vk89uhnsU0u+/ECSewRDbtMEjbYqyip6GozZwIkhasS5Ovl6/JFXW1fkyJQzuAWSy8oq HtB9uRn4AmJiTrcK6F+aUJ15H02iYt4cnKEKbK7jTOkxM10lsTgClUaN5On3lc0AskS2 D2ow== X-Gm-Message-State: AOUpUlE7MDKk6Xyl2YKuA+Ezletsj9nQHB5aiTyJtuHUxwulBYhZop+8 IL0fNDIwLz27Aekhf484xN/Q/SnICL1NSaPsGoyvNfKm+I4= X-Google-Smtp-Source: AAOMgpc4kZ7pbaIs4AccwJC10OycUtVkOgyjZSIWEM9AGJ9I2KPMDRbWfWA1yJNYI4PnX349vDwx60oGsTE6N/cpbgs= X-Received: by 2002:aca:5a45:: with SMTP id o66-v6mr17888717oib.155.1532975257959; Mon, 30 Jul 2018 11:27:37 -0700 (PDT) MIME-Version: 1.0 Received: by 2002:a4a:ca0c:0:0:0:0:0 with HTTP; Mon, 30 Jul 2018 11:27:37 -0700 (PDT) From: =?UTF-8?Q?Urist_Est=C3=AFkor?= Date: Mon, 30 Jul 2018 14:27:37 -0400 Message-ID: To: mirageos-devel@lists.xenproject.org X-Mailman-Approved-At: Tue, 31 Jul 2018 08:10:30 +0000 Subject: [MirageOS-devel] Network issues on Xen X-BeenThere: mirageos-devel@lists.xenproject.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: Developer list for MirageOS List-Unsubscribe: , List-Post: List-Help: List-Subscribe: , Content-Type: multipart/mixed; boundary="===============1962161407064785569==" Errors-To: mirageos-devel-bounces@lists.xenproject.org Sender: "MirageOS-devel" --===============1962161407064785569== Content-Type: multipart/alternative; boundary="000000000000b3450f05723b9d07" --000000000000b3450f05723b9d07 Content-Type: text/plain; charset="UTF-8" Content-Transfer-Encoding: quoted-printable Hello, I'm trying to run the MirageOS examples in mirage-skeleton and mirage-www on a Xen setup on Ubuntu 16.04, but I'm having problems getting networking to work. I posted a Github issue a while ago but haven't gotten any replies after about three weeks, so I wonder if anyone on this list could lend me a bit of help =E2=80=94 so far, I haven't been able to f= ind much current information online about running Mirage on Xen. As far as I can tell, this is an issue with Mirage itself, as other unikernels running on the same Xen host are able to use the network properly. Unfortunately, Mirage gives very little relevant debugging output, and I am unable to get it to produce any more; running "mirage configure --logs *:debug =E2=80=A6" doesn't have any effect. I'm hoping so= meone here can at least help me get additional information out of Mirage so I can diagnose what's going on. I'll try to describe all the information I've gathered so far below. My OS/software versions are as follows. OS: Ubuntu 18.04 LTS Kernel: Linux 4.15.0-23-generic #25-Ubuntu SMP x86_64 Xen version: 4.9.2 amd64 Mirage version: 3.1.0 Mirage-skeleton commit: b3d91b8 Mirage-www commit: 1236376 My network configuration in /etc/network/interfaces is as follows. Mirage's generated .xl files are correctly set to use "br0" as the Xen network bridge. I've confirmed that the bridge interface itself works correctly, as Rumprun unikernels using the same interface are able to connect to the network, get a DHCP lease, etc. auto lo iface lo inet loopback auto enp0s25 iface enp0s25 inet dhcp auto dummy0 iface dummy0 inet manual up ip link add dummy0 type dummy down ip link delete dummy0 auto br0 iface br0 inet static bridge_ports dummy0 address 192.168.1.2 broadcast 192.168.1.255 gateway 192.168.1.1 netmask 255.255.255.0 bridge_stp off When I start a Xen guest (e.g. mirage-www or mirage-skeleton/device-usage/network) that was configured to use DHCP, I see no DHCP traffic of any kind on the network bridge. The console of the Mirage unkernel only shows the following: # Configured with: # mirage configure -t xen --dhcp true MirageOS booting... Initialising timer interface Initialising console ... done. Attempt to open(/dev/urandom)! Unsupported function getpid called in Mini-OS kernel Unsupported function getppid called in Mini-OS kernel 2018-07-06 17:12:11 -00:00: INF [net-xen:frontend] connect 0 2018-07-06 17:12:11 -00:00: INF [net-xen:frontend] create: id=3D0 domid=3D0 2018-07-06 17:12:11 -00:00: INF [net-xen:frontend] sg:true gso_tcpv4:true rx_copy:true rx_flip:false smart_poll:false Attempt to open(/dev/urandom)! Unsupported function getpid called in Mini-OS kernel Unsupported function getppid called in Mini-OS kernel When I instead assign a static IP (within the bridge's IP range, of course), it gets a little farther, but I am unable to connect to the port 80, which should be open on the guest in both the mirage-www and device-usage/network examples. # Configured with: # mirage configure -t xen --ipv4=3D192.168.1.4/24 # Bridge has IP 192.168.1.2, netmask 255.255.255.0 MirageOS booting... Initialising timer interface Initialising console ... done. Attempt to open(/dev/urandom)! Unsupported function getpid called in Mini-OS kernel Unsupported function getppid called in Mini-OS kernel 2018-07-06 19:31:15 -00:00: INF [net-xen:frontend] connect 0 2018-07-06 19:31:15 -00:00: INF [net-xen:frontend] create: id=3D0 domid=3D0 2018-07-06 19:31:15 -00:00: INF [net-xen:frontend] sg:true gso_tcpv4:true rx_copy:true rx_flip:false smart_poll:false 2018-07-06 19:31:15 -00:00: INF [net-xen:frontend] MAC: 00:16:3e:4b:17:a6 2018-07-06 19:31:15 -00:00: INF [ethif] Connected Ethernet interface 00:16:3e:4b:17:a6 2018-07-06 19:31:15 -00:00: INF [arpv4] Connected arpv4 interface 00:16:3e:4b:17:a6 2018-07-06 19:31:15 -00:00: INF [udp] UDP interface connected on 192.168.1.= 4 2018-07-06 19:31:15 -00:00: INF [tcpip-stack-direct] stack assembled: mac=3D00:16:3e:4b:17:a6,ip=3D192.168.1.4 --000000000000b3450f05723b9d07 Content-Type: text/html; charset="UTF-8" Content-Transfer-Encoding: quoted-printable
Hello,

I'm trying to run= the MirageOS examples in mirage-skeleton and mirage-www on a Xen setup on Ubuntu 16.04, but I'm having proble= ms getting networking to work. I posted a Github issue=C2=A0a while ago but haven't go= tten any replies after about three weeks, so I wonder if anyone on this lis= t could lend me a bit of help =E2=80=94 so far, I haven't been able to = find much current information online about running Mirage on Xen.
=

As far as I can tell, this is an issue with Mirage itse= lf, as other unikernels running on the same Xen host are able to use the ne= twork properly. Unfortunately, Mirage gives very little relevant debugging = output, and I am unable to get it to produce any more; running "mirage= configure --logs *:debug =E2=80=A6" doesn't have any effect.=C2= =A0 I'm hoping someone here can at least help me get additional informa= tion out of Mirage so I can diagnose what's going on. I'll try to d= escribe all the information I've gathered so far below.

<= /div>
My OS/software versions are as follows.
=
OS: Ubuntu 18.04 LTS
Kernel: Linux 4.15.0-23-generic #25-Ubuntu SMP x86_64
Xen version: 4.9.2 amd64
Mirage version: 3.1.0
Mirage-skeleton commit: b3d91b8
Mirage-www commit: 1236376

My network configuration in /etc/network/interfaces is as follo= ws. Mirage's generated .xl files are correctly set to use "br0&quo= t; as the Xen network bridge. I've confirmed that the bridge interface = itself works correctly, as Rumprun unikernels using the same interface are = able to connect to the network, get a DHCP lease, etc.

= 
auto lo
iface lo inet loopback

auto enp0s25
iface enp0s25 inet dhcp

auto dummy0
iface dummy0 inet manual
    up ip link add dummy0 type dummy
    down ip link delete dummy0

auto br0
iface br0 inet static
    bridge_ports dummy0
    address 192.168.1.2
    broadcast 192.168.1.255
    gateway 192.168.1.1
    netmask 255.255.255.0
    bridge_stp off

When I start a Xen gue= st (e.g. mirage-www or mirage-skeleton/device-usage/network) that was confi= gured to use DHCP,=C2=A0I see no DHCP traffic of any kind on the network bridge. The c= onsole of the Mirage unkernel only shows the following:

# Configured with:
#    mirage configure -t xen --dhcp true

MirageOS booting...
Initialising timer interface
Initialising console ... done.
Attempt to open(/dev/urandom)!
Unsupported function getpid called in Mini-OS kernel
Unsupported function getppid called in Mini-OS kernel
2018-07-06 17:12:11 -00:00: INF [net-xen:frontend] connect 0
2018-07-06 17:12:11 -00:00: INF [net-xen:frontend] create: id=3D0 domid=3D0
2018-07-06 17:12:11 -00:00: INF [net-xen:frontend]  sg:true gso_tcpv4:true =
rx_copy:true rx_flip:false smart_poll:false
Attempt to open(/dev/urandom)!
Unsupported function getpid called in Mini-OS kernel
Unsupported function getppid called in Mini-OS kernel

When I instead assign a static IP= (within the bridge's IP range, of course), it gets a little farther, b= ut I am unable to connect to the port 80, which should be open on the guest= in both the mirage-www and device-usage/network examples.

# Configured with:
#    mirage configure -t xen --ipv4=3D192=
.168.1.4/24
# Bridge has IP 192.168.1.2, netmask 255.255.255.0

MirageOS booting...
Initialising timer interface
Initialising console ... done.
Attempt to open(/dev/urandom)!
Unsupported function getpid called in Mini-OS kernel
Unsupported function getppid called in Mini-OS kernel
2018-07-06 19:31:15 -00:00: INF [net-xen:frontend] connect 0
2018-07-06 19:31:15 -00:00: INF [net-xen:frontend] create: id=3D0 domid=3D0
2018-07-06 19:31:15 -00:00: INF [net-xen:frontend]  sg:true gso_tcpv4:true =
rx_copy:true rx_flip:false smart_poll:false
2018-07-06 19:31:15 -00:00: INF [net-xen:frontend] MAC: 00:16:3e:4b:17:a6
2018-07-06 19:31:15 -00:00: INF [ethif] Connected Ethernet interface 00:16:=
3e:4b:17:a6
2018-07-06 19:31:15 -00:00: INF [arpv4] Connected arpv4 interface 00:16:3e:=
4b:17:a6
2018-07-06 19:31:15 -00:00: INF [udp] UDP interface connected on 192.168.1.=
4
2018-07-06 19:31:15 -00:00: INF [tcpip-stack-direct] stack assembled: mac=
=3D00:16:3e:4b:17:a6,ip=3D192.168.1.4
--000000000000b3450f05723b9d07-- --===============1962161407064785569== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: inline X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KTWlyYWdlT1Mt ZGV2ZWwgbWFpbGluZyBsaXN0Ck1pcmFnZU9TLWRldmVsQGxpc3RzLnhlbnByb2plY3Qub3JnCmh0 dHBzOi8vbGlzdHMueGVucHJvamVjdC5vcmcvbWFpbG1hbi9saXN0aW5mby9taXJhZ2Vvcy1kZXZl bAo= --===============1962161407064785569==--