From minios-devel-bounces@lists.xenproject.org Tue Jun 01 10:17:05 2021
Return-path: <minios-devel-bounces@lists.xenproject.org>
Envelope-to: archives@lists.xenproject.org
Delivery-date: Tue, 01 Jun 2021 10:17:05 +0000
Received: from list by lists.xenproject.org with outflank-mailman.134776.250689 (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lo1SJ-0007rr-Ow; Tue, 01 Jun 2021 10:17:03 +0000
X-Outflank-Mailman: Message body and most headers restored to incoming version
Received: by outflank-mailman (output) from mailman id 134776.250689; Tue, 01 Jun 2021 10:17:03 +0000
Received: from localhost ([127.0.0.1] helo=lists.xenproject.org)
	by lists.xenproject.org with esmtp (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lo1SJ-0007rk-Lp; Tue, 01 Jun 2021 10:17:03 +0000
Received: by outflank-mailman (input) for mailman id 134776;
 Tue, 01 Jun 2021 10:17:02 +0000
Received: from us1-rack-iad1.inumbo.com ([172.99.69.81])
 by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from
 <SRS0=LHF7=K3=gmail.com=cezar.craciunoiu@srs-us1.protection.inumbo.net>)
 id 1lo1SI-0007re-Av
 for minios-devel@lists.xen.org; Tue, 01 Jun 2021 10:17:02 +0000
Received: from mail-ej1-x632.google.com (unknown [2a00:1450:4864:20::632])
 by us1-rack-iad1.inumbo.com (Halon) with ESMTPS
 id 6c19c4c4-4348-4320-a13c-824b6ad00769;
 Tue, 01 Jun 2021 10:17:01 +0000 (UTC)
Received: by mail-ej1-x632.google.com with SMTP id ce15so1597276ejb.4
 for <minios-devel@lists.xen.org>; Tue, 01 Jun 2021 03:17:01 -0700 (PDT)
Received: from [192.168.0.3] ([86.120.179.90])
 by smtp.gmail.com with ESMTPSA id s2sm8370641edu.89.2021.06.01.03.16.59
 for <minios-devel@lists.xen.org>
 (version=TLS1_2 cipher=ECDHE-ECDSA-AES128-GCM-SHA256 bits=128/128);
 Tue, 01 Jun 2021 03:16:59 -0700 (PDT)
X-BeenThere: minios-devel@lists.xenproject.org
List-Id: Mini-os development list <minios-devel.lists.xenproject.org>
List-Unsubscribe: <https://lists.xenproject.org/mailman/options/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=unsubscribe>
List-Post: <mailto:minios-devel@lists.xenproject.org>
List-Help: <mailto:minios-devel-request@lists.xenproject.org?subject=help>
List-Subscribe: <https://lists.xenproject.org/mailman/listinfo/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=subscribe>
Errors-To: minios-devel-bounces@lists.xenproject.org
Precedence: list
Sender: "Minios-devel" <minios-devel-bounces@lists.xenproject.org>
X-Inumbo-ID: 6c19c4c4-4348-4320-a13c-824b6ad00769
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20161025;
        h=mime-version:date:message-id:subject:from:to:cc:in-reply-to
         :references:user-agent;
        bh=uDP9AJDCkhpBarsUH+dHV8qpftW+6dagUeOYpobizUs=;
        b=nFIUcNgSMngBGcVUyfIyrcek+RSG2f3IxXyXe20BkRrgCJdfj1sGis+Ymb7/yLf3V4
         wef633WrQiGJyN9FM2ujvpy0+jNhCDQiZTtFIreOVHXJnPFwIEHW9axlk8vqkjrDBYht
         Ws1/TPHNEWDOe8FtqHqc4uPIpW6byP92wo3g9QZR+XBNMjxDv/Xe5YiLPawj06PJdsL5
         lKWV/UWF+1rPQUv/n8/MN6tpSrqP8i+zikTObUYrn5HTCV85FTCerZFH4cBO1TBDBLM/
         nTpULrAqLVmgYV+tbQnp812UfYK4YhlHnZdD8uDSiaLl/1Mb8jFUMthZ2WyhZSqcmGAY
         EXxQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20161025;
        h=x-gm-message-state:mime-version:date:message-id:subject:from:to:cc
         :in-reply-to:references:user-agent;
        bh=uDP9AJDCkhpBarsUH+dHV8qpftW+6dagUeOYpobizUs=;
        b=RDzxiRgDbNXCi8FwkY05KOtKf4XLaaeKPLBpKfzmIpu8H3u3hUsPHRRX/pIdbgjVqO
         9yaL1UkwKDfwrXK0g6q0qp/BxFjNS87zdgf7dfR/JVPZGlw0F8kMNmzb0lAdLa3L4VqY
         LPo7Ce4XU4VmU1dLDe00Fogcv8vr2bKVM3fiJqqyQ6a/aYaGtdgM2xapCZbeZQWiCrDM
         usuahNrHSWesQ+sQ3QR1XPOXYFuKOWEukh1I9SZP+FpXUsh4H8cECEuCZCyayUdgcbxO
         CYzdZlWpna4YcR7GJZQOXXKRQcR2l14hkxqqeRTdedwAKL9Yg/qRngZ/SbdnqAJDHcix
         geTw==
X-Gm-Message-State: AOAM530kOJfXfZJmd1yxJfWouxoFHxuLdMFI9efiVQMBHm0f7bMUNZg+
	hZTlt94GCbNUCoiAsZlgjsNVasdG3Eqk2w==
X-Google-Smtp-Source: ABdhPJwG0NXCM6QFFGg5Rbz34wRyGyM52UurT527MSTw7Fkz9dk70D8Yz6LJThL12XKtO8aKLR9aYw==
X-Received: by 2002:a17:906:d797:: with SMTP id pj23mr7927575ejb.367.1622542620079;
        Tue, 01 Jun 2021 03:17:00 -0700 (PDT)
Content-Type: multipart/alternative;
 boundary="----=_NextPart_14124763.922875454785"
MIME-Version: 1.0
Date: Tue, 01 Jun 2021 13:16:27 +0300
Message-ID: <Mailbird-bc4db20a-fa86-46d4-9db0-22645078dd39@gmail.com>
Subject: Re: [UNIKRAFT/BALLOON v2 0/7] Memory Ballooning Cover Letter
From: "Cezar Craciunoiu" <cezar.craciunoiu@gmail.com>
To: "" <minios-devel@lists.xen.org>
Cc: "Simon Kuenzer" <simon.kuenzer@neclab.eu>,
 "Sharan Santhanam" <sharan.santhanam@neclab.eu>,
 "Felipe Huici" <felipe.huici@neclab.eu>
In-Reply-To: <cover.1598621743.git.cezar.craciunoiu@gmail.com>
References: <cover.1598621743.git.cezar.craciunoiu@gmail.com>
User-Agent: Mailbird/2.9.31.0
X-Mailbird-ID: Mailbird-bc4db20a-fa86-46d4-9db0-22645078dd39@gmail.com

------=_NextPart_14124763.922875454785
Content-Type: text/plain;
 charset="utf-8"
Content-Transfer-Encoding: quoted-printable

Hello,

This patch series has now been moved to Github[1] and will be resolved ther=
e.
Any further discussions will be held there.

[1]:=C2=A0https://github.com/unikraft/unikraft/pull/219

Cezar

On 2020-08-28 17:45:26, CezarCraciunoiu <cezar.craciunoiu@gmail.com> wrote:
From: Cezar Craciunoiu

Hello to whoever is reading this.

This is my version of the memory ballooning patch two people added around
one year ago. This patch structures the code that they worked on and
separates it in different files, based on the content. This, along with
the additions brought to the Makefile and Config files, fixed one of their
issues mentioned in the cover letter: working with the Unikraft
build system.

Also, more than a couple of bugs were fixed, along with coding style fixes,
to ensure that the reviewing process takes as little time as possible.

Lastly, and maybe the most important part, the KVM Memory Balloon works in
any circumstances, handling malloc/free calls with
no noticeable slowdowns. Xen should also work, but the way the interaction
with it is done, made testing the balloon for it pretty hard.

Unfortunately, right now, the Linuxu implementation does not exist,
but it does not hinder the normal execution of applications.
The code could be revisited when a stable version of mmap/munmap is
released (if I understood correctly, right now it is just a "trick"
to fool Go).

Thank you very much for the chance to work on this patch.
I will stay in touch with the reviewer until the patch is brought to a
stable/usable state.

Yours sincerely,

Cezar Craciunoiu
University Politehnica of Bucharest

Cezar Craciunoiu (7):
plat/balloon: Declared balloon interaction functions
plat/drivers/include/balloon: Declared KVM driver inflate/deflate
functions
plat/drivers/balloon: KVM Virtio balloon driver implementation
plat/kvm/balloon: KVM balloon driver calls implementation
plat/linuxu/balloon: Linuxu balloon stubs
plat/xen/balloon: Xen balloon hypervisor calls implementation
lib/ukallocbbuddy: Balloon API calls insertion

include/uk/plat/balloon.h | 64 +++++
lib/ukallocbbuddy/Config.uk | 2 +
lib/ukallocbbuddy/bbuddy.c | 137 ++++++++-
plat/drivers/balloon/balloon_drv.c | 371 +++++++++++++++++++++++++
plat/drivers/include/balloon/balloon.h | 46 +++
plat/kvm/Config.uk | 10 +
plat/kvm/Makefile.uk | 11 +
plat/kvm/balloon.c | 107 +++++++
plat/linuxu/Makefile.uk | 2 +
plat/linuxu/balloon.c | 61 ++++
plat/xen/Makefile.uk | 1 +
plat/xen/balloon.c | 135 +++++++++
12 files changed, 945 insertions(+), 2 deletions(-)
create mode 100644 include/uk/plat/balloon.h
create mode 100644 plat/drivers/balloon/balloon_drv.c
create mode 100644 plat/drivers/include/balloon/balloon.h
create mode 100644 plat/kvm/balloon.c
create mode 100644 plat/linuxu/balloon.c
create mode 100644 plat/xen/balloon.c

--
2.20.1


------=_NextPart_14124763.922875454785
Content-Type: text/html;
 charset="utf-8"
Content-Transfer-Encoding: quoted-printable

<div id=3D"__MailbirdStyleContent" style=3D"font-size: 10pt;font-family: Ar=
ial;color: #000000;text-align: left" dir=3D"ltr">=0A                       =
                 =0A                                        =0A            =
                                =0A                                        =
=0A                                        =0A                             =
           Hello,<div><br></div><div>This patch series has now been moved t=
o Github[1] and will be resolved there.</div><div>Any further discussions w=
ill be held there.</div><div><br></div><div>[1]:&nbsp;https://github.com/un=
ikraft/unikraft/pull/219</div><div><br></div><div>Cezar<br><div class=3D"mb=
_sig"></div><blockquote class=3D"history_container" type=3D"cite" style=3D"=
border-left-style:solid;border-width:1px; margin-top:20px; margin-left:0px;=
padding-left:10px;">=0A                        <p style=3D"color: #AAAAAA; =
margin-top: 10px;">On 2020-08-28 17:45:26, CezarCraciunoiu &lt;cezar.craciu=
noiu@gmail.com&gt; wrote:</p><div style=3D"font-family:Arial,Helvetica,sans=
-serif">From: Cezar Craciunoiu <cezar.craciunoiu@gmail.com>=0A<br>=0A<br>He=
llo to whoever is reading this.=0A<br>=0A<br>This is my version of the memo=
ry ballooning patch two people added around=0A<br>one year ago. This patch =
structures the code that they worked on and=0A<br>separates it in different=
 files, based on the content. This, along with=0A<br>the additions brought =
to the Makefile and Config files, fixed one of their=0A<br>issues mentioned=
 in the cover letter: working with the Unikraft=0A<br>build system.=0A<br>=
=0A<br>Also, more than a couple of bugs were fixed, along with coding style=
 fixes,=0A<br>to ensure that the reviewing process takes as little time as =
possible.=0A<br>=0A<br>Lastly, and maybe the most important part, the KVM M=
emory Balloon works in=0A<br>any circumstances, handling malloc/free calls =
with=0A<br>no noticeable slowdowns. Xen should also work, but the way the i=
nteraction=0A<br>with it is done, made testing the balloon for it pretty ha=
rd.=0A<br>=0A<br>Unfortunately, right now, the Linuxu implementation does n=
ot exist,=0A<br>but it does not hinder the normal execution of applications=
.=0A<br>The code could be revisited when a stable version of mmap/munmap is=
=0A<br>released (if I understood correctly, right now it is just a "trick"=
=0A<br>to fool Go).=0A<br>=0A<br>Thank you very much for the chance to work=
 on this patch.=0A<br>I will stay in touch with the reviewer until the patc=
h is brought to a=0A<br>stable/usable state.=0A<br>=0A<br>Yours sincerely,=
=0A<br>=0A<br>Cezar Craciunoiu=0A<br>University Politehnica of Bucharest=0A=
<br>=0A<br>Cezar Craciunoiu (7):=0A<br>  plat/balloon: Declared balloon int=
eraction functions=0A<br>  plat/drivers/include/balloon: Declared KVM drive=
r inflate/deflate=0A<br>    functions=0A<br>  plat/drivers/balloon: KVM Vir=
tio balloon driver implementation=0A<br>  plat/kvm/balloon: KVM balloon dri=
ver calls implementation=0A<br>  plat/linuxu/balloon: Linuxu balloon stubs=
=0A<br>  plat/xen/balloon: Xen balloon hypervisor calls implementation=0A<b=
r>  lib/ukallocbbuddy: Balloon API calls insertion=0A<br>=0A<br> include/uk=
/plat/balloon.h              |  64 +++++=0A<br> lib/ukallocbbuddy/Config.uk=
            |   2 +=0A<br> lib/ukallocbbuddy/bbuddy.c             | 137 +++=
+++++-=0A<br> plat/drivers/balloon/balloon_drv.c     | 371 ++++++++++++++++=
+++++++++=0A<br> plat/drivers/include/balloon/balloon.h |  46 +++=0A<br> pl=
at/kvm/Config.uk                     |  10 +=0A<br> plat/kvm/Makefile.uk   =
                |  11 +=0A<br> plat/kvm/balloon.c                     | 107=
 +++++++=0A<br> plat/linuxu/Makefile.uk                |   2 +=0A<br> plat/=
linuxu/balloon.c                  |  61 ++++=0A<br> plat/xen/Makefile.uk   =
                |   1 +=0A<br> plat/xen/balloon.c                     | 135=
 +++++++++=0A<br> 12 files changed, 945 insertions(+), 2 deletions(-)=0A<br=
> create mode 100644 include/uk/plat/balloon.h=0A<br> create mode 100644 pl=
at/drivers/balloon/balloon_drv.c=0A<br> create mode 100644 plat/drivers/inc=
lude/balloon/balloon.h=0A<br> create mode 100644 plat/kvm/balloon.c=0A<br> =
create mode 100644 plat/linuxu/balloon.c=0A<br> create mode 100644 plat/xen=
/balloon.c=0A<br>=0A<br>-- =0A<br>2.20.1=0A<br>=0A<br></cezar.craciunoiu@gm=
ail.com></div></blockquote>=0A                                        =0A  =
                                      </div></div><img class=3D"mailbird" w=
idth=3D"1" height=3D"1" style=3D"border:0; width:1; height:1;" src=3D"https=
://tracking.getmailbird.com/OpenTrackingPixel/?messageId=3DMailbird-bc4db20=
a-fa86-46d4-9db0-22645078dd39@gmail.com&senderHash=3D428129F4185574465E427F=
F361B7A682A725F0E09E2FF4560B6E3FC22B0B586D&recipientHash=3D91AE0C4B8384A044=
BF33A9B47FFCFC6BE23C7E4379AC07CED68375A5DFECF100&internalId=3D2c859fd4-d369=
-4dbd-9e84-53065d7b6619">

------=_NextPart_14124763.922875454785--


From minios-devel-bounces@lists.xenproject.org Thu Jun 03 09:25:52 2021
Return-path: <minios-devel-bounces@lists.xenproject.org>
Envelope-to: archives@lists.xenproject.org
Delivery-date: Thu, 03 Jun 2021 09:25:52 +0000
Received: from list by lists.xenproject.org with outflank-mailman.136392.252900 (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lojbq-0003hZ-Fm; Thu, 03 Jun 2021 09:25:50 +0000
X-Outflank-Mailman: Message body and most headers restored to incoming version
Received: by outflank-mailman (output) from mailman id 136392.252900; Thu, 03 Jun 2021 09:25:50 +0000
Received: from localhost ([127.0.0.1] helo=lists.xenproject.org)
	by lists.xenproject.org with esmtp (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lojbq-0003hS-Cy; Thu, 03 Jun 2021 09:25:50 +0000
Received: by outflank-mailman (input) for mailman id 136392;
 Thu, 03 Jun 2021 09:25:49 +0000
Received: from us1-rack-iad1.inumbo.com ([172.99.69.81])
 by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from
 <SRS0=0n7N=K5=citrix.com=george.dunlap@srs-us1.protection.inumbo.net>)
 id 1lojbp-0003cH-KJ
 for minios-devel@lists.xenproject.org; Thu, 03 Jun 2021 09:25:49 +0000
Received: from esa2.hc3370-68.iphmx.com (unknown [216.71.145.153])
 by us1-rack-iad1.inumbo.com (Halon) with ESMTPS
 id afd7fc08-d0be-4a12-9ad8-55f6e3b0a37e;
 Thu, 03 Jun 2021 09:25:41 +0000 (UTC)
X-BeenThere: minios-devel@lists.xenproject.org
List-Id: Mini-os development list <minios-devel.lists.xenproject.org>
List-Unsubscribe: <https://lists.xenproject.org/mailman/options/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=unsubscribe>
List-Post: <mailto:minios-devel@lists.xenproject.org>
List-Help: <mailto:minios-devel-request@lists.xenproject.org?subject=help>
List-Subscribe: <https://lists.xenproject.org/mailman/listinfo/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=subscribe>
Errors-To: minios-devel-bounces@lists.xenproject.org
Precedence: list
Sender: "Minios-devel" <minios-devel-bounces@lists.xenproject.org>
X-Inumbo-ID: afd7fc08-d0be-4a12-9ad8-55f6e3b0a37e
DKIM-Signature: v=1; a=rsa-sha256; c=simple/simple;
  d=citrix.com; s=securemail; t=1622712341;
  h=from:to:cc:subject:date:message-id:references:
   in-reply-to:content-id:content-transfer-encoding:
   mime-version;
  bh=ibLxiJAf3JbflKs8vFhUpEMe/AiZ6ZljuAOVlpAU2VY=;
  b=GFux4EgTjCH2ShaKauuuufTCUt5LMbhOs6zdtJzMl6hqPOwcGF34Kwef
   boGnHjc9fSKlJzhL4ptTcG0BO3bFqMeK+u5YT7ZJASuqUPc71GaJ+t9m9
   nsyvV4gj74OpahnGrnbuj/0QjtaLL6VBLaLRUzEawvN91bnqpDErP06Cv
   s=;
Authentication-Results: esa2.hc3370-68.iphmx.com; dkim=pass (signature verified) header.i=@citrix.onmicrosoft.com
IronPort-SDR: GtVY7412JXvt86fip79PdwyPyuxFZrwgGirKaI4u/MW9xOqyheAVIJ9z7ocLlFHdMzaygoojGq
 Fyc07ozRXyeaYZgL+ted4JVcPCPM6s+OiKeQDyaO6gfkGDjee07PkrOYmPuoo/rFDjqk4JhVw3
 2M/pQ2DGbYo5iqY95x2sNnbfOJs7ZXlHScWc/IQRld5mMLMc9W4wGlqrQKcpq9vb6dWSgZpvEE
 Pbdj5krGyoMJIzZdgAIO9yEM0r7LiOYFOzqYt9lKOa7s9bguOJW5KM1NNtrafXzPv7OY1L72Is
 5pk=
X-SBRS: 5.1
X-MesageID: 45225508
X-Ironport-Server: esa2.hc3370-68.iphmx.com
X-Remote-IP: 162.221.158.21
X-Policy: $RELAYED
IronPort-HdrOrdr: A9a23:GZ4ctquHVem7dV8UTtL7c+nK7skDstV00zEX/kB9WHVpm6yj+v
 xG/c5rsCMc7Qx6ZJhOo7+90cW7L080lqQFg7X5X43DYOCOggLBQL2KhbGI/9SKIVycygcy78
 Zdm6gVMqyLMbB55/yKnTVRxbwbsaW6GKPDv5ag8590JzsaD52Jd21Ce36m+ksdfnggObMJUK
 Cyy+BgvDSadXEefq2AdwI4t7iqnaysqHr+CyR2fiIa1A==
X-IronPort-AV: E=Sophos;i="5.83,244,1616472000"; 
   d="scan'208";a="45225508"
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;
 b=iY4a6sXE6AXi8kx32HVgW5KvbX71HXy9M6qYvt099WNTLRjYfS1gNNG9XOiA14BzyUOvXF4NmqPL03oCHl0OjXJ/tbj3yOrX1uZNtTbD/XT0bcS1FQO7md5o9kMnhEWejRhdgos9RMuvgbYHsju//ME6BT+ArdEfp9phX0jG6QUadz2hNirH/9WdAK539IXa1YfooK24SxygBGg1Pwptae8Du/Bq/H4s8szPDZrYAE4wZjAfalxJLHVWp0C4k9gwTdO33+cjKX4yilTn8zfKzimxcrOg5dIaWzI9CxdEgyXYTmBJl6CXOS7nD/Bs7fh2SixtXX77z/fJ8BM+J0qf4w==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;
 s=arcselector9901;
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
 bh=ibLxiJAf3JbflKs8vFhUpEMe/AiZ6ZljuAOVlpAU2VY=;
 b=iCDuBlADMAUDg+cDVPwfRfdzmIpwSQ6CKJQFt9u1VQ3nzdbaeLvyrUb19HzPJDLLv9aDLVWu3JUHQpWEHBqTIWwqCVJ+AwizcYy/0SuvcfckYPSRDLBocTSQi83q0IIgR900Z94S4wZHiB5iQlUX0hOz4wtKaccH6fdtSUJFeFRHxhSd4x1Sf+q2bwz8sixjPNfH/+qgenG+06QrbBh0FrpWT9z6dw1iV3XCtcsBKb2NKkMV+zjSPyiJ5f1BeLPjPwrAsEfjvpxnPTXzUhbvzWM9vpmP8Hn0LSBgn+oqkI2PFFxWIsva34+UM0t5NKzvNgTqHQCpUKHbj2cc+F9Lfw==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass
 smtp.mailfrom=citrix.com; dmarc=pass action=none header.from=citrix.com;
 dkim=pass header.d=citrix.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
 d=citrix.onmicrosoft.com; s=selector2-citrix-onmicrosoft-com;
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
 bh=ibLxiJAf3JbflKs8vFhUpEMe/AiZ6ZljuAOVlpAU2VY=;
 b=AZ+NVr6OkThV+QrY34yKDagSy1jx/Ln2LPL10FpKxfXfwHzUkAJ2qToCbrOp35izUsZ0+lKWne+XuMDjU2BP+a2ok1knC6UF3OVpr6pF3hR2Lv5gL+gHPX/I46U/ChTPaqjKrMo11/tQ/cpcPnjTpTyVaxGk07kj/p/HIkgRCJc=
From: George Dunlap <George.Dunlap@citrix.com>
To: Anil Madhavapeddy <anil@recoil.org>
CC: "mirageos-devel@lists.xenproject.org"
	<mirageos-devel@lists.xenproject.org>, "minios-devel@lists.xenproject.org"
	<minios-devel@lists.xenproject.org>
Subject: Re: Proposal: Move IRC networks to oftc.net
Thread-Topic: Proposal: Move IRC networks to oftc.net
Thread-Index: AQHXUjIIo7bvW1FIwkCL4l8dXnIXtqr2MNiAgAvflQA=
Date: Thu, 3 Jun 2021 09:25:37 +0000
Message-ID: <E0232311-28BC-4103-918E-3FAE93D8C7C6@citrix.com>
References: <B408BB9D-ECE5-465C-AE92-E59247491245@citrix.com>
 <FAEFA0A8-D9B6-42D9-9F37-0ACB5CBF5CDE@recoil.org>
In-Reply-To: <FAEFA0A8-D9B6-42D9-9F37-0ACB5CBF5CDE@recoil.org>
Accept-Language: en-US
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-mailer: Apple Mail (2.3654.60.0.2.21)
x-ms-publictraffictype: Email
x-ms-office365-filtering-correlation-id: 06f2b9aa-b026-49be-e09b-08d926718c77
x-ms-traffictypediagnostic: PH0PR03MB6431:
x-microsoft-antispam-prvs: <PH0PR03MB6431014895C73DC68B22408E993C9@PH0PR03MB6431.namprd03.prod.outlook.com>
x-ms-oob-tlc-oobclassifiers: OLM:8882;
x-ms-exchange-senderadcheck: 1
x-microsoft-antispam: BCL:0;
x-microsoft-antispam-message-info: tLLgZk9jnQ6o9pAlUcoNk84xeksevM1l1AIq18OU/j3J6zJGsDjwzw5HqZ7HX3KLV7Z8yQ4XGgGxXVaeQjpHhWF9i4TFZxwQZ0bKSKOqqJ7dWgTNlc9yRePeYtEfyke7aCwJps956vGeQq4znTfHDzQFZfGerfhhpPoqa5lVDWWNvgjxQXUeU35UlHXlLDftLUjYbvSr1wiQu9QDMBmpv3SX83tGw5HF/edUGssL5DhxG6/XZ8Bmb5s0dbaCvN1sfJb7HcJoLWpqw5sBmS3+1huSgtfIHJ6AgcYMxf7aD7PUUBCcYwOPU5nBneoeQ3VhjEnKFx5BaCwlJwa6TlDAhKZC3RVExPfWt9kBqJwkwlAChs/Iihe5pd4HjTTVwFoftMmVwX+YbDD9OYKpofH8Qdt5Tmot05Cahr2AqGeL7Y0+Os8CNAs1JJuqhidM++q0sEwxfmh7aX4t1sPxZb7c45Wy6Q556WeSRH0cAk7rmlkxyfcS+KUqw+RZb3eUcB3Eqhj5FalxphpcdEsbjYUI/uLYnu8UA+waHFP8p4Fp8kVY7j8nVLAlOvKkXEV2tIIJg16dqCNzRgLD5KIbx6AXEcmbHPsWwkyu+kg8UlpWcpu8SsIynwuRDsxWFa4LhMgmB5v8p9z4sPOhScUijE79AUpKCOkZXqJP/GgpFJZO9irJiE6JOKw99R2O5w67uqxiO7dUwhRTnnSH1G4ghGyLj9A7yhxAoIRXQcIVVPPI/V1D/Z8FRrJIIm218AYBOmPf9rxyOIkZdTa4DSLfflkpTw==
x-forefront-antispam-report: CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:PH0PR03MB5669.namprd03.prod.outlook.com;PTR:;CAT:NONE;SFS:(4636009)(396003)(136003)(346002)(376002)(39860400002)(366004)(6512007)(316002)(66946007)(53546011)(6916009)(4326008)(54906003)(8676002)(64756008)(66446008)(122000001)(71200400001)(66556008)(38100700002)(33656002)(5660300002)(2616005)(66476007)(186003)(478600001)(966005)(91956017)(76116006)(8936002)(83380400001)(2906002)(86362001)(6486002)(6506007)(36756003)(26005)(45980500001);DIR:OUT;SFP:1101;
x-ms-exchange-antispam-messagedata: =?utf-8?B?SzJzR0RSNklySzFxbmNLMVZYcEdvRjYxT0E3QkpEQVJUUE5jZ2o3Mlk0M2Vn?=
 =?utf-8?B?VW9tenViSnBoamhSUUUrZ3I0Tm0xV0paSVZhNHROVk8zemtNNGFsMXpzQjI2?=
 =?utf-8?B?RmNhdnBMSE4wY0JmYnloRGhEUWpBcWhJcU5JbXJGdFdLd2t0NzJBVDdSMzJH?=
 =?utf-8?B?NVlBWDRiZmVUcUFCWS9uQ2xqZjZPZ0wyNWJtc2t6aHhacnlDTW1Fam9tdjRm?=
 =?utf-8?B?YnB5UjMzZlhCbGlQSTB2NElnS0NldXM1NHg4Z1FJeFY0WGJwWGg3SCtTa2Vr?=
 =?utf-8?B?VVJLZ08ra2F4NnNmOTk2KytJVzBNMXRadW9zbHY0TTNaUDh3TnhjR0NFZXRX?=
 =?utf-8?B?K1N3d0lzSlhJWnFUTjN5bmxveXVIM3BsdEY4bzhvOGx5OEpoOXY4T1JyZTdx?=
 =?utf-8?B?RTRQVDNNYldGS0ZWbzdOZ3JYN0x0NDZVMTM2UU05bFg1QzZOUGhHT0wySmdP?=
 =?utf-8?B?bTRNZnNzbldkSGxYV2Y2dnpkajhubm9GdmhqTXdxMzVPZitaNmRweUxoYm5p?=
 =?utf-8?B?M2NHNFdSMDVOSCtvc05hRG43eFdTcHNvOXdyWkFzRm40RFFSYlNOUE9CUG9w?=
 =?utf-8?B?S1JTUUF3UUw2REw3aGNPRk9HdUlhM3RuL1pTQWc0TVhmQ1gxWUdXZk5CRGpM?=
 =?utf-8?B?SFgyWFVzR1E0dTFudXR5OXZybmwwVHJSZGl2WStjNU9CaDBXd3hZbWpSSnJR?=
 =?utf-8?B?cisvMDdEODNlT1VaeFdQd0l5WW1CS2xjMjB0cUV0Zkl5aWZ2OWVlMEdmZ1Fx?=
 =?utf-8?B?UjQ5VnpOOHZXVWUzVWxVRUpDRThBRE5tWkwzVUd4cTFteUhDMWh1a0c2TWJ0?=
 =?utf-8?B?SUtOYTVibWtQUUhyWGprOWNQUUZLalBMcUtKMWZ0N0lrUGozWTR0dkt1Tk9t?=
 =?utf-8?B?MVhRYTdCZ0paNklrTndHK05tSnhmWnJQRE5NVzJIL291M3FIeFBoZCtXZEFp?=
 =?utf-8?B?bUswMUxjUnNVWTU5bXV5bWhiUWovMGhKTjV0SndhemNqdzlEazJ0Yy81c25G?=
 =?utf-8?B?WkRmbjBNVnViWnBiS1JnOW9sTGV4NDFvZmI3TVFVLytGaTdIdUQ3S1l4OUdn?=
 =?utf-8?B?QkdjRit5Q3JyVTB0dHk0VFdLVUtLOUFiZ25iTHU4eUpRbUYveHJ1RzJtVFAw?=
 =?utf-8?B?ZFZ3SmpTYmV2cUVMVDZhUVdYaVJ3SExxcTkrQUppU29ZYnVmSzduaGNJVE1F?=
 =?utf-8?B?UjlPQ01OMnFxNXF4TTYyVkw3b3NNaEJxdlBCOC9ONVlBNWF5WG5vUUEvTkdF?=
 =?utf-8?B?c0RsMXQ0aHJMZkIwbWhNYW1Ca2tIZ0Z4SzNzU2UvdzQwSGNzdzcxTTdXazVD?=
 =?utf-8?B?c09wRmRpSTBoSjNaUmQ3MEVhMUprNE9pQUptcndQRnc3ZmJJdVp4Yjl0SlVh?=
 =?utf-8?B?d1Fmd2tkRjB6RDhPL0s2RjlORWpIUCtWMzNNV21xVGtJaHRUaWtMYUd4WUVh?=
 =?utf-8?B?eDZRdVhyMzlPd1hPb2lKNFhKbEVFWDh6VGtxdGphUXIwN3hLaTRQQlEzTDlq?=
 =?utf-8?B?cjlUb3Y3ejlHd0pic25Relg5eHM3K2Q2a1ljcGx0ZGlyTnVxRjQ4UWxRR3ZS?=
 =?utf-8?B?d1g0Y0pQalFaV2VLWDA1anY1ZU5QcW9JSkdWQ3laQkpHK1htWXZZTk54UFZO?=
 =?utf-8?B?bDEyWGFnM1RRM2MrNDc0TFcvUmdXY0w1L3lvTzJ0R0Mvekg5SkYwd0xzOVNZ?=
 =?utf-8?B?YmNmcFJwQ3RvMm9CM1BJQlJ4d2krZXVGNXVwL1ZNK1JBN3BmV0ZuVjhpTEVh?=
 =?utf-8?B?SU90VUZHMW9nL1V4SGt1dU1lWEdRRjRVZkRiN2Q4Vi9STVl4SkJZejVYVG90?=
 =?utf-8?B?cjEraDZWOExmMWZnWUFmdz09?=
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="utf-8"
Content-ID: <D8D07D77744CE3438CCF58FFAB641699@namprd03.prod.outlook.com>
Content-Transfer-Encoding: base64
MIME-Version: 1.0
X-MS-Exchange-CrossTenant-AuthAs: Internal
X-MS-Exchange-CrossTenant-AuthSource: PH0PR03MB5669.namprd03.prod.outlook.com
X-MS-Exchange-CrossTenant-Network-Message-Id: 06f2b9aa-b026-49be-e09b-08d926718c77
X-MS-Exchange-CrossTenant-originalarrivaltime: 03 Jun 2021 09:25:37.8257
 (UTC)
X-MS-Exchange-CrossTenant-fromentityheader: Hosted
X-MS-Exchange-CrossTenant-id: 335836de-42ef-43a2-b145-348c2ee9ca5b
X-MS-Exchange-CrossTenant-mailboxtype: HOSTED
X-MS-Exchange-CrossTenant-userprincipalname: TunH+DQVatTOt0GtvvMwX93PbkQAdtTLxDUXmX/7Zm5pGPrhLAan08q2Su1yGT+TTTU4HhBPkIM0zZKyk3a/5nSPSrhFWem4MD2UiAds+hI=
X-MS-Exchange-Transport-CrossTenantHeadersStamped: PH0PR03MB6431
X-OriginatorOrg: citrix.com

VGhhbmtzIGFsbCDigJQgSeKAmXZlIHVwZGF0ZWQgdGhlIHdlYnNpdGU7IGxldCBtZSBrbm93IGlm
IGVpdGhlciBvZiB5b3Ugd2FudCBhbnl0aGluZyBjaGFuZ2VkLg0KDQogLUdlb3JnZQ0KDQo+IE9u
IE1heSAyNiwgMjAyMSwgYXQgOTowNiBQTSwgQW5pbCBNYWRoYXZhcGVkZHkgPGFuaWxAcmVjb2ls
Lm9yZz4gd3JvdGU6DQo+IA0KPiBIaSBHZW9yZ2UsDQo+IA0KPiBUbyBmb2xsb3cgdXAgb24gSGFu
bmVzJyBwcmV2aW91cyBtYWlsIHdoaWNoIGludGVyc2VjdGVkIHdpdGggeW91cnMsICNtaXJhZ2Ug
aXMgb2ZmIHRvIGxpYmVyYToNCj4gDQo+PiB3ZSdyZSBub3cgb24gbGliZXJhLmNoYXQgaW4gI21p
cmFnZSAtLSB0aGUgd2Vic2l0ZSAobWlyYWdlb3Mub3JnKSBoYXMNCj4+IGFscmVhZHkgYmVlbiB1
cGRhdGVkIHdpdGggdGhlIG5ldyBsb2NhdGlvbi4NCj4+IA0KPiANCj4gcmVnYXJkcywNCj4gQW5p
bA0KPiANCj4gDQo+PiBPbiAyNiBNYXkgMjAyMSwgYXQgMTQ6MjEsIEdlb3JnZSBEdW5sYXAgPGdl
b3JnZS5kdW5sYXBAY2l0cml4LmNvbT4gd3JvdGU6DQo+PiANCj4+IFRoaXMgbWVzc2FnZSBpcyBi
ZWNhdXNlIGJvdGggTWlyYWdlT1MgYW5kIFVuaWtyYWZ0IGFyZSBsaXN0ZWQgYXMgaGF2aW5nIElS
QyBjaGFubmVscyBvbiBmcmVlbm9kZS5uZXQgKHNlZSBodHRwczovL3hlbnByb2plY3Qub3JnL2hl
bHAvaXJjLyApLg0KPj4gDQo+PiBUaGVyZSdzIGJlZW4gYSBzaXR1YXRpb24gZGV2ZWxvcGluZyBv
biBmcmVlbm9kZSBmb3Igc29tZSB0aW1lIHRoYXQgY2FtZSB0byBhIGhlYWQgbGFzdCB3ZWVrLiBT
aW5jZSB0aGF0IHRpbWUsIHRoZSBuZXcgb3BlcmF0b3JzIG9mIGZyZWVub2RlIGhhdmUgYmVndW4g
c2VpemluZyBjb250cm9sIG9mIGFueSBjaGFubmVsIHdob3NlIHRvcGljIG1lbnRpb25zIG1vdmlu
ZyB0byBhIG5ldyBzZXJ2ZXIuIEZ1cnRoZXJtb3JlLCB0aGV5IGhhdmUgYmVlbiB1c2luZyB0aGUg
bnVtYmVyIG9mIHBlb3BsZSBsb2dnZWQgaW50byBmcmVlbm9kZSBhcyBldmlkZW5jZSB0aGF0IHRo
ZSBjb21tdW5pdHkgc3VwcG9ydHMgdGhlaXIgYWN0aW9ucy4NCj4+IA0KPj4gSW4gcmVzcG9uc2Ug
dG8gdGhpcywgdGhlIG1haW4gaHlwZXJ2aXNvciBwcm9qZWN0IGhhcyBkZWNpZGVkIHRvIG1vdmUg
dG8gb2Z0Yy5uZXQgZWZmZWN0aXZlIGltbWVkaWF0ZWx5LCBhbmQgYSBudW1iZXIgb2YgdXMgaGF2
ZSBkZWxldGVkIG91ciBmcmVlbm9kZSBhY2NvdW50cyAoIGh0dHBzOi8vbGlzdHMueGVucHJvamVj
dC5vcmcvYXJjaGl2ZXMvaHRtbC94ZW4tZGV2ZWwvMjAyMS0wNS9tc2cwMTA1Ny5odG1sICkuDQo+
PiANCj4+IElmIHlvdSdyZSBzdGlsbCB1c2luZyB0aGUgSVJDIGNoYW5uZWwgbGlzdGVkIGluIHRo
YXQgcGFnZSwgcGxlYXNlIGNvbnNpZGVyIGZvbGxvd2luZyBzdWl0LiBJZiB5b3UncmUgbm90IHVz
aW5nIHRoZSBJUkMgY2hhbm5lbCwgbGV0IG1lIGtub3cgc28gSSBjYW4gZGVsZXRlIHJlZmVyZW5j
ZXMgdG8gaXQuDQo+PiANCj4+IFRoYW5rcywNCj4+IC1HZW9yZ2UgRHVubGFwDQo+IA0KDQo=


From minios-devel-bounces@lists.xenproject.org Thu Jun 03 09:46:10 2021
Return-path: <minios-devel-bounces@lists.xenproject.org>
Envelope-to: archives@lists.xenproject.org
Delivery-date: Thu, 03 Jun 2021 09:46:10 +0000
Received: from list by lists.xenproject.org with outflank-mailman.136413.252929 (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lojvV-0006pb-Kf; Thu, 03 Jun 2021 09:46:09 +0000
X-Outflank-Mailman: Message body and most headers restored to incoming version
Received: by outflank-mailman (output) from mailman id 136413.252929; Thu, 03 Jun 2021 09:46:09 +0000
Received: from localhost ([127.0.0.1] helo=lists.xenproject.org)
	by lists.xenproject.org with esmtp (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lojvV-0006pU-Hm; Thu, 03 Jun 2021 09:46:09 +0000
Received: by outflank-mailman (input) for mailman id 136413;
 Thu, 03 Jun 2021 09:46:09 +0000
Received: from us1-rack-iad1.inumbo.com ([172.99.69.81])
 by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from
 <SRS0=cGDW=K5=gmail.com=virtanrazvan@srs-us1.protection.inumbo.net>)
 id 1lojvV-0006pO-0D
 for minios-devel@lists.xen.org; Thu, 03 Jun 2021 09:46:09 +0000
Received: from mail-ed1-x533.google.com (unknown [2a00:1450:4864:20::533])
 by us1-rack-iad1.inumbo.com (Halon) with ESMTPS
 id 50cfd199-cbdb-450d-b9c9-44c5792db032;
 Thu, 03 Jun 2021 09:46:08 +0000 (UTC)
Received: by mail-ed1-x533.google.com with SMTP id g18so4357918edq.8
 for <minios-devel@lists.xen.org>; Thu, 03 Jun 2021 02:46:08 -0700 (PDT)
Received: from razvan-Lenovo-Legion-Y530-15ICH.local
 ([2a02:2f08:c301:f000:a4c3:e3a3:c71e:f8d8])
 by smtp.gmail.com with ESMTPSA id i2sm1412686edc.96.2021.06.03.02.46.06
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Thu, 03 Jun 2021 02:46:07 -0700 (PDT)
X-BeenThere: minios-devel@lists.xenproject.org
List-Id: Mini-os development list <minios-devel.lists.xenproject.org>
List-Unsubscribe: <https://lists.xenproject.org/mailman/options/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=unsubscribe>
List-Post: <mailto:minios-devel@lists.xenproject.org>
List-Help: <mailto:minios-devel-request@lists.xenproject.org?subject=help>
List-Subscribe: <https://lists.xenproject.org/mailman/listinfo/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=subscribe>
Errors-To: minios-devel-bounces@lists.xenproject.org
Precedence: list
Sender: "Minios-devel" <minios-devel-bounces@lists.xenproject.org>
X-Inumbo-ID: 50cfd199-cbdb-450d-b9c9-44c5792db032
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20161025;
        h=from:to:cc:subject:date:message-id:in-reply-to:references;
        bh=gCw12sAReTx6A8ctszagnqwPMTjGQ4NaPNnTqLaoqio=;
        b=mt9NO3qilnv+qFVea0Nfc9vQ2flAi9dF8JEvENDLocpASsJuBCEXAUvvDLkw0mUfu+
         kvtZt2t949/B5o5ObAV2CtLGSGIpuA3cKMOfvaeqp5zxRCtRk5WbGW+7KnXvRIZ9lZ2s
         OG3wMM5A/EbR7G4SwXLsmh5XOIowrGSBlbuhe7pusoQaq9D0d1iO/jqPT5VBOv3TOKOy
         Bf7okCI4eQoP8LdHk15uyVMbzMmRjqABj5VLeS3VNOxrFc2/R3p4/b8isMZPMMoVI+9k
         ownKQcLeNJnNggoTnrAixUvfvdh6mKT+ZilTxrn96JzlAgdrLxZSNZPi7fD8mnt1kXrw
         mBtA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20161025;
        h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to
         :references;
        bh=gCw12sAReTx6A8ctszagnqwPMTjGQ4NaPNnTqLaoqio=;
        b=E+LOg075X5PA0ltFdUjMp3zEw5+UhlO9+vUyG/0xNVleNEC92DwJ1pMuMMxPLr10hH
         JuLwnIaVrkHW/de5EzwJfu+jLvDoPNWNbIvL1fWTEVGdxLR+c8nWyh+xU+IZS7iObuP1
         eIcOg0qCnkutpnzTULh/vB1ew9hc117YslTxmoiroGAkhfc7D8R2fJf3ZdIjwthsoMCC
         Q2LZ1TxB9wOgmCoTAkrjNSArts0i6jPBnGlq62nOQbGybWgB0KlFbLzfDR00iLRak0a8
         w9cgwxRt06FiZ6z4xFk4HWr5HKW7SYQoVgWEXnDpELj61LNmuIK11+1S1p7VQaPqMaNd
         3ZPQ==
X-Gm-Message-State: AOAM5320qzLSn2svZgeRV9E4kmEi5BuOEghfaSDcWNrFCELIBzLrshy/
	LfBhvcZ34jcZim+vD32yggaPImSOjz66oA==
X-Google-Smtp-Source: ABdhPJyxdhytdZ7oDu2SkOxvAk6ZLbX4pXZoNKDNGDU7R1lEz/YByYT1qL9ZN2fhSP2oepXW/P0fkw==
X-Received: by 2002:a05:6402:4cf:: with SMTP id n15mr44532355edw.162.1622713567192;
        Thu, 03 Jun 2021 02:46:07 -0700 (PDT)
From: Razvan Virtan <virtanrazvan@gmail.com>
X-Google-Original-From: Razvan Virtan <razvanvirtan@gmail.com>
To: justin.he@arm.com
Cc: minios-devel@lists.xen.org
Subject: Re: [RFCv4,00/35] Impelment virtio_mmio and pci ecam controller for arm64 kvm plat
Date: Thu,  3 Jun 2021 12:46:05 +0300
Message-Id: <20210603094605.9159-1-razvanvirtan@gmail.com>
X-Mailer: git-send-email 2.17.1
In-Reply-To: <20201223073857.118076-1-justin.he@arm.com>
References: <20201223073857.118076-1-justin.he@arm.com>

Hi, Justin.
Since the final version of this series is in a github PR, I will provide my
approval there and mark the patches as superseded on Patchwork.

Reviewed-by: Razvan Virtan <virtanrazvan@gmail.com>


From minios-devel-bounces@lists.xenproject.org Thu Jun 03 11:47:51 2021
Return-path: <minios-devel-bounces@lists.xenproject.org>
Envelope-to: archives@lists.xenproject.org
Delivery-date: Thu, 03 Jun 2021 11:47:51 +0000
Received: from list by lists.xenproject.org with outflank-mailman.136418.252936 (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lolpE-0000EH-EZ; Thu, 03 Jun 2021 11:47:48 +0000
X-Outflank-Mailman: Message body and most headers restored to incoming version
Received: by outflank-mailman (output) from mailman id 136418.252936; Thu, 03 Jun 2021 11:47:48 +0000
Received: from localhost ([127.0.0.1] helo=lists.xenproject.org)
	by lists.xenproject.org with esmtp (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lolpE-0000EA-Be; Thu, 03 Jun 2021 11:47:48 +0000
Received: by outflank-mailman (input) for mailman id 136418;
 Thu, 03 Jun 2021 11:47:47 +0000
Received: from all-amaz-eas1.inumbo.com ([34.197.232.57]
 helo=us1-amaz-eas2.inumbo.com)
 by lists.xenproject.org with esmtp (Exim 4.92)
 (envelope-from <SRS0=GA4y=K5=arm.com=justin.he@srs-us1.protection.inumbo.net>)
 id 1lolpD-0000E4-Gc
 for minios-devel@lists.xen.org; Thu, 03 Jun 2021 11:47:47 +0000
Received: from EUR03-VE1-obe.outbound.protection.outlook.com (unknown
 [40.107.5.58]) by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS
 id 108291b3-a4ff-4856-9e7c-935d7f035fea;
 Thu, 03 Jun 2021 11:47:45 +0000 (UTC)
Received: from AM6P191CA0017.EURP191.PROD.OUTLOOK.COM (2603:10a6:209:8b::30)
 by AM0PR08MB3186.eurprd08.prod.outlook.com (2603:10a6:208:5d::27) with
 Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4173.21; Thu, 3 Jun
 2021 11:47:43 +0000
Received: from VE1EUR03FT063.eop-EUR03.prod.protection.outlook.com
 (2603:10a6:209:8b:cafe::d4) by AM6P191CA0017.outlook.office365.com
 (2603:10a6:209:8b::30) with Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4195.20 via Frontend
 Transport; Thu, 3 Jun 2021 11:47:43 +0000
Received: from 64aa7808-outbound-1.mta.getcheckrecipient.com (63.35.35.123) by
 VE1EUR03FT063.mail.protection.outlook.com (10.152.18.236) with
 Microsoft SMTP
 Server (version=TLS1_2, cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id
 15.20.4195.21 via Frontend Transport; Thu, 3 Jun 2021 11:47:43 +0000
Received: ("Tessian outbound f02dc08cb398:v93");
 Thu, 03 Jun 2021 11:47:43 +0000
Received: from 48b83817e35b.1
 by 64aa7808-outbound-1.mta.getcheckrecipient.com id
 57618FAA-59BC-4D87-8783-E12841A70E4C.1; 
 Thu, 03 Jun 2021 11:47:37 +0000
Received: from EUR03-VE1-obe.outbound.protection.outlook.com
 by 64aa7808-outbound-1.mta.getcheckrecipient.com with ESMTPS id 48b83817e35b.1
 (version=TLSv1.2 cipher=ECDHE-RSA-AES256-GCM-SHA384);
 Thu, 03 Jun 2021 11:47:37 +0000
Received: from AM6PR08MB4376.eurprd08.prod.outlook.com (2603:10a6:20b:bb::21)
 by AM6PR08MB4005.eurprd08.prod.outlook.com (2603:10a6:20b:a4::27)
 with Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_256_GCM_SHA384) id 15.20.4195.24; Thu, 3 Jun
 2021 11:47:33 +0000
Received: from AM6PR08MB4376.eurprd08.prod.outlook.com
 ([fe80::18c4:33fd:d055:fe60]) by AM6PR08MB4376.eurprd08.prod.outlook.com
 ([fe80::18c4:33fd:d055:fe60%3]) with mapi id 15.20.4173.030; Thu, 3 Jun 2021
 11:47:33 +0000
X-BeenThere: minios-devel@lists.xenproject.org
List-Id: Mini-os development list <minios-devel.lists.xenproject.org>
List-Unsubscribe: <https://lists.xenproject.org/mailman/options/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=unsubscribe>
List-Post: <mailto:minios-devel@lists.xenproject.org>
List-Help: <mailto:minios-devel-request@lists.xenproject.org?subject=help>
List-Subscribe: <https://lists.xenproject.org/mailman/listinfo/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=subscribe>
Errors-To: minios-devel-bounces@lists.xenproject.org
Precedence: list
Sender: "Minios-devel" <minios-devel-bounces@lists.xenproject.org>
X-Inumbo-ID: 108291b3-a4ff-4856-9e7c-935d7f035fea
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com;
 s=selector2-armh-onmicrosoft-com;
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
 bh=xL1uX7lMmE7Kb+7g77bsBk83c2d9jgMUb6UNzhWC1D4=;
 b=XUvpKyOYcNsei1lYb1smX7Lxl1enUGg4stMPOuIDxVkuY64HxyaXfRDD7jqitxJiRJSArwhHQdgYwMHUqC0DRLhRmV94okN2L35YoQRZzEr5QpVyXcsdzKKCnT9yLO3IQRTsIJFM3Fan/YzOWoSbzknWbHQQ8pVePE2ssmVOunw=
X-MS-Exchange-Authentication-Results: spf=pass (sender IP is 63.35.35.123)
 smtp.mailfrom=arm.com; lists.xen.org; dkim=pass (signature was verified)
 header.d=armh.onmicrosoft.com;lists.xen.org; dmarc=pass action=none
 header.from=arm.com;
Received-SPF: Pass (protection.outlook.com: domain of arm.com designates
 63.35.35.123 as permitted sender) receiver=protection.outlook.com;
 client-ip=63.35.35.123; helo=64aa7808-outbound-1.mta.getcheckrecipient.com;
X-CR-MTA-TID: 64aa7808
ARC-Seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none;
 b=DEU62pOBfL28ES9QExi1yGKbHahShnsRD407YXXellrZHgGD20lWd2RHGv/WXdPRMZSASQP51EFK7aWz5DBM+Lzq1g7YmG/19q+3QC07twbUtt4tHQQUsYAQuwcXBjDobBPpiGRCsrx79dPNrw5TWQJkT46uPftP4E0m/I6Aaq0d9HmwCEfWKbAWYy/WTBiFrxzxLa8jCtHRFRLcEXFAdYeZ8hE50dfpM8qOcJCiF8pDZmITi7XsjvjnzxjmUqVjMshFI1YujxXtGWJHa6NvR6ejIYHUC0zEbV+e7YEO0nQrJDMpyry1fpZF/XYIaBg4ojLgaRaUEca3wT7/D2SN4g==
ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com;
 s=arcselector9901;
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
 bh=xL1uX7lMmE7Kb+7g77bsBk83c2d9jgMUb6UNzhWC1D4=;
 b=Vcnt5i3JwrU6DsEk2qvqzkkVHL8DzssKu5kq+DPcAubcSK7a+S8vLoYt5aorNgrDTwHFh11uR88E+KtYaPq45+IHSvX5iPWDNIKo2CUI86yprMZrDQz6uT/uPGQwkYxsetpSnd4fNJSP+loCDZJHgSkTjLCMwRA+v+lC6Q6Qng+/KXDDqQ/5Sz4SnbUZjdCkjMrW+QGO9/YRGaOgSJYjou2UyhMT85/4PkpJ8Ls1ZZQRQH6zd1G21WY59g40oFZ8aMZCMHZV62fhYXoz9ov/WIx45muTGkmwUQ8XneIWlSdGpgb+swMgtsmhpZFEnc49givNdWSMMDy/UiPtfSoebg==
ARC-Authentication-Results: i=1; mx.microsoft.com 1; spf=pass
 smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass
 header.d=arm.com; arc=none
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=armh.onmicrosoft.com;
 s=selector2-armh-onmicrosoft-com;
 h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-SenderADCheck;
 bh=xL1uX7lMmE7Kb+7g77bsBk83c2d9jgMUb6UNzhWC1D4=;
 b=XUvpKyOYcNsei1lYb1smX7Lxl1enUGg4stMPOuIDxVkuY64HxyaXfRDD7jqitxJiRJSArwhHQdgYwMHUqC0DRLhRmV94okN2L35YoQRZzEr5QpVyXcsdzKKCnT9yLO3IQRTsIJFM3Fan/YzOWoSbzknWbHQQ8pVePE2ssmVOunw=
From: Justin He <Justin.He@arm.com>
To: Razvan Virtan <virtanrazvan@gmail.com>
CC: "minios-devel@lists.xen.org" <minios-devel@lists.xen.org>
Subject: RE: [RFCv4,00/35] Impelment virtio_mmio and pci ecam controller for
 arm64 kvm plat
Thread-Topic: [RFCv4,00/35] Impelment virtio_mmio and pci ecam controller for
 arm64 kvm plat
Thread-Index: AQHXWF1KZURifnLzbk6arptAOsf5TqsCK5vQ
Date: Thu, 3 Jun 2021 11:47:32 +0000
Message-ID:
 <AM6PR08MB4376950015D6550A30F2897AF73C9@AM6PR08MB4376.eurprd08.prod.outlook.com>
References: <20201223073857.118076-1-justin.he@arm.com>
 <20210603094605.9159-1-razvanvirtan@gmail.com>
In-Reply-To: <20210603094605.9159-1-razvanvirtan@gmail.com>
Accept-Language: en-US, zh-CN
Content-Language: en-US
X-MS-Has-Attach:
X-MS-TNEF-Correlator:
x-ts-tracking-id: 2B23D75EB5E7E74D938F1B46F6D7F479.0
x-checkrecipientchecked: true
Authentication-Results-Original: gmail.com; dkim=none (message not signed)
 header.d=none;gmail.com; dmarc=none action=none header.from=arm.com;
x-originating-ip: [223.166.32.224]
x-ms-publictraffictype: Email
X-MS-Office365-Filtering-Correlation-Id: 18cdf543-5878-481a-a5c7-08d926856624
x-ms-traffictypediagnostic: AM6PR08MB4005:|AM0PR08MB3186:
X-Microsoft-Antispam-PRVS:
	<AM0PR08MB31860DE29B661A2CCEC5BADAF73C9@AM0PR08MB3186.eurprd08.prod.outlook.com>
x-checkrecipientrouted: true
nodisclaimer: true
x-ms-oob-tlc-oobclassifiers: OLM:7691;OLM:10000;
X-MS-Exchange-SenderADCheck: 1
X-Microsoft-Antispam-Untrusted: BCL:0;
X-Microsoft-Antispam-Message-Info-Original:
 6uqelth8BKCS6kMLTrcwzJojtlsWrN6FzEoKRuijSjThUuoBDPSMz1YMSo2vD8F71V+kPC6SHPYDKiNf3wf62gz1l4sTykcJdWj0UQrLYnZXi0lrRuVnQoLClMtl3AN83+2gIRiVOMFZWiswLAKFuzmQIYHQlvudiZrxgm7mxHk5TmEAe5S4zu+Tt8Dkt1nNBTA98kyIUaemIK++pK3L4I6fyQfqPCp1yXUeDrV6H8eWVnqiPI04+qbnrVRQ6XFeqXk3+FEKo5M8f/ogo9NRJ4xZvQoe2OPJped7ub3e7TR6yHXa5QffSiU1Kb4MOaE1Dc4ZI1OMfnR8R2F23iwF7zWoWyBOt7Ypo53chiv3dRtVkDz7tQIcdXsTun2KzSria/pwgaUELQnkqfEYfNxHs0M1b6CPtMwsRe+m1gbTvI6j3Bg+3dykUoxiQDYmcHjeka3588vrkkV+HxSE858hO2MKDFXJXVOA91K+j9ECcHdkw+emNoHVBD65AhuAxgzFEnYRcZtNTNeinYfXqyeTQM0qscEXqPzKFiHKe2g2n7gWJAppIqXJQw5fiRy+lwnS6ATbV+2Hw+09pNNXQK8PrgX2jggyjnoz1WvtSL4kGcU=
X-Forefront-Antispam-Report-Untrusted:
 CIP:255.255.255.255;CTRY:;LANG:en;SCL:1;SRV:;IPV:NLI;SFV:NSPM;H:AM6PR08MB4376.eurprd08.prod.outlook.com;PTR:;CAT:NONE;SFS:(4636009)(376002)(366004)(346002)(39850400004)(136003)(396003)(2906002)(8936002)(5660300002)(9686003)(55016002)(316002)(4744005)(26005)(6506007)(53546011)(52536014)(4326008)(66446008)(64756008)(66476007)(66946007)(76116006)(66556008)(71200400001)(83380400001)(86362001)(186003)(7696005)(6916009)(8676002)(33656002)(122000001)(38100700002)(478600001);DIR:OUT;SFP:1101;
x-ms-exchange-antispam-messagedata:
 =?us-ascii?Q?V8In5ESbKeampYi8Z+kKsGyI2N5ho7S5NRvyLSw9xeExTneV0L1Lwee7nN02?=
 =?us-ascii?Q?7GCkrExP1tb+h6BVcJE+4N0bIbgMs68h3xrnstN/VCHbvPHj81MhXgvE0gWB?=
 =?us-ascii?Q?zyUCJrNAxxoKBXvcIRb+Ol+kjHcmrRI6lS0PuXutegGQHgz5FXYzWpYvb6v2?=
 =?us-ascii?Q?OV1+X1T3SfGSjM0RQdNQEZgiEYjuu60tloiAOxmIl4m1sysAHANdGJnFCqRJ?=
 =?us-ascii?Q?QWi9dwYOjpxIsv+TEXCJFaB1K7aRzAo6nOyI1RJb8JZqJwpypu/kKnOWdmdu?=
 =?us-ascii?Q?vf6KleTK36r9U1LVtKz21FsBsKW6rlgJ7h9rljoUpX5tngO49jPqg4piKD6l?=
 =?us-ascii?Q?SeC9MWRTnMyba6sTooJhSl8M+j/SGhVZQ8P5RDscNdeMLe1K+eCIRQoI176v?=
 =?us-ascii?Q?s8X+a7/Kcb+d1s3L3uJbxkIrcgw4hha0rZL+f713awGnzPC6rpveqg0LM0Jm?=
 =?us-ascii?Q?eJnT/BjjeF7ZVXNDfb+ESqGM9F899zeOUhK7/TO7ERUZGSQdudOewQWHslMJ?=
 =?us-ascii?Q?FMUTUtNrrGTusdM6vyrYMq7CbrAOeIC/XCYJey3HSQ55w1ezma9vZ2k/OkyG?=
 =?us-ascii?Q?OE0lPa2+bcYhGfWqouj7DaIp0LF1TbZ1ouxFgtmxEVCPMktMX/Bt6ehZNtX/?=
 =?us-ascii?Q?oDirOqolBRjhvoWccVrXVsW01aBZRpslzciieiFuZ+zXBKMPou/9fzHo953E?=
 =?us-ascii?Q?obeJdINF5aBUV5sORCSsuu1u8nEFaWFRz83YL6KgjuQORO3Ym1In6Jj3w+zk?=
 =?us-ascii?Q?m4YcOnW0PVUX2Cczw8TTntOGScanpWaa41W8szbJm3DoeNaWYOAXk+91p6zO?=
 =?us-ascii?Q?zpm78dVTxKVJnQ1bjgX8hMRTj6v6DTI2KSO9AQ/WINFU3lrtgrZEWiPh/1Ya?=
 =?us-ascii?Q?GIKyiugdtXz0vrEu5pxFndbG3Febfd1Dd8H7zUHRwC+6rL/iofRsFPIOZZbu?=
 =?us-ascii?Q?x6Ha6IrBCH37BBBFwiQLVIUssaveW5T6MmE+PYJjJaUVGNe4bWr52bww9DLo?=
 =?us-ascii?Q?8LRoySy+A4nJKqp3oGM2IAF+O0EylouTm3+lIO7NSDoDYFaqzKSWtMZhU5a8?=
 =?us-ascii?Q?8/GNVsEld3JrjGt1rZBxuQTg2Vu/lEyvA2rt4Ux5EdQAUdxvYwRmhB3mI12b?=
 =?us-ascii?Q?BCRAp9QWrs/PoMid4pDdlNxGteQ+BqkcClvVD8ZqG5ECnRb5rtu0zuL/4/bg?=
 =?us-ascii?Q?Z358IzMj+2TBSkhHGkpif1jlk3UOEh7anRW+5tgOKBGQwJDAg/ap7m1Eew8J?=
 =?us-ascii?Q?eDWntPBkJIfSOxdQQAGAev+56C9kIHOHczqTT8JZc3oDBJndnNNWOj8SDXOQ?=
 =?us-ascii?Q?XEOaQFzfW4ry6GDJ9cboRArB?=
x-ms-exchange-transport-forked: True
Content-Type: text/plain; charset="us-ascii"
Content-Transfer-Encoding: quoted-printable
MIME-Version: 1.0
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM6PR08MB4005
Original-Authentication-Results: gmail.com; dkim=none (message not signed)
 header.d=none;gmail.com; dmarc=none action=none header.from=arm.com;
X-EOPAttributedMessage: 0
X-MS-Exchange-Transport-CrossTenantHeadersStripped:
 VE1EUR03FT063.eop-EUR03.prod.protection.outlook.com
X-MS-Office365-Filtering-Correlation-Id-Prvs:
	852fa993-4f09-487f-7d4c-08d926855fdf
X-Microsoft-Antispam: BCL:0;
X-Microsoft-Antispam-Message-Info:
	PotRevz3OfY7cLTHVDTDbbW/U3yl83YSCAQXCivMtityzV+CzS71dycLNcdhVWso7iFatcA0w10Jfd+HmBl1AIk4OmBUp5TJDO59GI1+ltP0lcQC2VMoiUz7NQB5gkzG2CHa6qe5CQfMc2T1YJzNkAzXX6Wku1D7TALjWPyPddecMVGFXTTUYDCRd6erpcaUJkCC8rqPCaF5xRl8J2Pk2oxPIuLcGKeKM9TZM4uwp2qKx6DYrXPAsM/Q5TgVjKj5eXUznh0rteWoWaE1r17WuId6Jp0tDkhJHDIisksUR2g0sZVY/TlJavIRitNRqzpX+pPUmmXn76O675LFZx7a3I9FNJudxkqTb0yVyRJQFOfofzN6yT2jOLHgcSCTvGLfPzxdnRA8w12/ZwRCzFIe/us4e2PvAL78SGzoIRcoBIjKuhmp6eMeJB+eDygeSIt7aux5g8tKsEbyA5mtdk4IPdUkW4F160EaLnlX6yaOjY6bBbhJOqCy6M+rnwt6Nm2AzcdTKO6UV5/zaJuVvl/E974piUFGe3SCT7dIWIQuWqFXbPe9Qcb8oWVYoORq1pazqBiXNwzCzNDOcrutvtIQiIErQPe552JhtUu/SFDihzGe3bGTEPuLT36y4WhZYZhiw+z91YwOshYaN+bpHlCBgV8mtSKEz1EJL2EY9Qzwf5M=
X-Forefront-Antispam-Report:
	CIP:63.35.35.123;CTRY:IE;LANG:en;SCL:1;SRV:;IPV:CAL;SFV:NSPM;H:64aa7808-outbound-1.mta.getcheckrecipient.com;PTR:ec2-63-35-35-123.eu-west-1.compute.amazonaws.com;CAT:NONE;SFS:(4636009)(376002)(39850400004)(346002)(136003)(396003)(46966006)(36840700001)(478600001)(83380400001)(8936002)(5660300002)(336012)(70206006)(186003)(2906002)(7696005)(47076005)(36860700001)(86362001)(82310400003)(4744005)(70586007)(356005)(53546011)(52536014)(55016002)(9686003)(316002)(82740400003)(81166007)(6506007)(4326008)(33656002)(8676002)(6862004)(26005);DIR:OUT;SFP:1101;
X-OriginatorOrg: arm.com
X-MS-Exchange-CrossTenant-OriginalArrivalTime: 03 Jun 2021 11:47:43.4510
 (UTC)
X-MS-Exchange-CrossTenant-Network-Message-Id: 18cdf543-5878-481a-a5c7-08d926856624
X-MS-Exchange-CrossTenant-Id: f34e5979-57d9-4aaa-ad4d-b122a662184d
X-MS-Exchange-CrossTenant-OriginalAttributedTenantConnectingIp: TenantId=f34e5979-57d9-4aaa-ad4d-b122a662184d;Ip=[63.35.35.123];Helo=[64aa7808-outbound-1.mta.getcheckrecipient.com]
X-MS-Exchange-CrossTenant-AuthSource:
	VE1EUR03FT063.eop-EUR03.prod.protection.outlook.com
X-MS-Exchange-CrossTenant-AuthAs: Anonymous
X-MS-Exchange-CrossTenant-FromEntityHeader: HybridOnPrem
X-MS-Exchange-Transport-CrossTenantHeadersStamped: AM0PR08MB3186

Hi Razvan
Thanks for your review!

--
Cheers,
Justin (Jia He)



> -----Original Message-----
> From: Razvan Virtan <virtanrazvan@gmail.com>
> Sent: Thursday, June 3, 2021 5:46 PM
> To: Justin He <Justin.He@arm.com>
> Cc: minios-devel@lists.xen.org
> Subject: Re: [RFCv4,00/35] Impelment virtio_mmio and pci ecam controller
> for arm64 kvm plat
>
> Hi, Justin.
> Since the final version of this series is in a github PR, I will provide
> my
> approval there and mark the patches as superseded on Patchwork.
>
> Reviewed-by: Razvan Virtan <virtanrazvan@gmail.com>
IMPORTANT NOTICE: The contents of this email and any attachments are confid=
ential and may also be privileged. If you are not the intended recipient, p=
lease notify the sender immediately and do not disclose the contents to any=
 other person, use it for any purpose, or store or copy the information in =
any medium. Thank you.


From minios-devel-bounces@lists.xenproject.org Wed Jun 09 18:32:53 2021
Return-path: <minios-devel-bounces@lists.xenproject.org>
Envelope-to: archives@lists.xenproject.org
Delivery-date: Wed, 09 Jun 2021 18:32:53 +0000
Received: from list by lists.xenproject.org with outflank-mailman.139524.257964 (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lr30T-0005ZX-7w; Wed, 09 Jun 2021 18:32:49 +0000
X-Outflank-Mailman: Message body and most headers restored to incoming version
Received: by outflank-mailman (output) from mailman id 139524.257964; Wed, 09 Jun 2021 18:32:49 +0000
Received: from localhost ([127.0.0.1] helo=lists.xenproject.org)
	by lists.xenproject.org with esmtp (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lr30T-0005ZQ-4x; Wed, 09 Jun 2021 18:32:49 +0000
Received: by outflank-mailman (input) for mailman id 139524;
 Wed, 09 Jun 2021 18:32:47 +0000
Received: from us1-rack-iad1.inumbo.com ([172.99.69.81])
 by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from
 <SRS0=OTlz=LD=gmail.com=virtanrazvan@srs-us1.protection.inumbo.net>)
 id 1lr30R-0005ZK-Hk
 for minios-devel@lists.xen.org; Wed, 09 Jun 2021 18:32:47 +0000
Received: from mail-ej1-x630.google.com (unknown [2a00:1450:4864:20::630])
 by us1-rack-iad1.inumbo.com (Halon) with ESMTPS
 id 7217c403-b884-4600-9202-641b59a6e4cc;
 Wed, 09 Jun 2021 18:32:46 +0000 (UTC)
Received: by mail-ej1-x630.google.com with SMTP id g8so39934460ejx.1
 for <minios-devel@lists.xen.org>; Wed, 09 Jun 2021 11:32:46 -0700 (PDT)
Received: from razvan-Lenovo-Legion-Y530-15ICH.local
 ([2a02:2f08:c301:fb00:fcf6:59a8:3202:66cd])
 by smtp.gmail.com with ESMTPSA id bd3sm222836edb.34.2021.06.09.11.32.44
 (version=TLS1_3 cipher=TLS_AES_256_GCM_SHA384 bits=256/256);
 Wed, 09 Jun 2021 11:32:45 -0700 (PDT)
X-BeenThere: minios-devel@lists.xenproject.org
List-Id: Mini-os development list <minios-devel.lists.xenproject.org>
List-Unsubscribe: <https://lists.xenproject.org/mailman/options/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=unsubscribe>
List-Post: <mailto:minios-devel@lists.xenproject.org>
List-Help: <mailto:minios-devel-request@lists.xenproject.org?subject=help>
List-Subscribe: <https://lists.xenproject.org/mailman/listinfo/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=subscribe>
Errors-To: minios-devel-bounces@lists.xenproject.org
Precedence: list
Sender: "Minios-devel" <minios-devel-bounces@lists.xenproject.org>
X-Inumbo-ID: 7217c403-b884-4600-9202-641b59a6e4cc
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20161025;
        h=from:to:cc:subject:date:message-id:in-reply-to:references;
        bh=s5IN4d7Ntik+AhjssSUtb6dourXr4MzqmpGR6DenCaE=;
        b=qRIpHx3srMdQTtmwADVMxshrRJ80p7wS55OivUT+EQTtG/xmW6gs3ko6GBaS8HvsZk
         CYwq8rMgvvrJ/YBOcMUlibWk6/SGQiUdyo3XAoKN8UYQ5K7f+BQfDZcFbtRWIAa/v01w
         qV2VqmDh0XFhROEaQBo7kprT2gABBU8Sy1NFVIFkZ3PNYBSf16jYeOggDD8APfSmRg/v
         2uHb6VUEKbBN99Kyl187LYp4LMEinKYO42yFSFMxWPx2YsOh1lp4347O2rDx73GVN0yT
         QYO9eC/Ngj7G5xuLFS5mWeRU+3MaFUkfCcQQyap3l3YFzR8xXiAqXoayBOqVUHJMFyIl
         3+mw==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20161025;
        h=x-gm-message-state:from:to:cc:subject:date:message-id:in-reply-to
         :references;
        bh=s5IN4d7Ntik+AhjssSUtb6dourXr4MzqmpGR6DenCaE=;
        b=tNAjIf9UjQIG3bkUTguvlg0p7Wrqt5jQcTsZuaN5xjz1KGar6DnwrNLiVM/Afr+EyR
         DoGfwfQ36GyqnSgAvbTuHKkxnpL1mpnp5W/5YTWnQJxnjcji5eHLBhPyi2FCKz6k2Okl
         5q5SKwHSn1WNpazSZiNpA4cfYu2DCRWDkCZV04v5x8xL6/Xe26xJ7SPPw/fKM9YrE71a
         C6Gz3L441YxwVJ7tnvVKXzHeE4WVpXhjsFneQmQUcdL32lxdVEFXdEJrc6vAsWzL3FDN
         dskLXK87FtUvi3NZ33ImJ+a+AkjqC2SmJSrUrK9L1hgg+cM1GtOnTF1MfrDaSBDguva4
         xXCA==
X-Gm-Message-State: AOAM533r+e8vc30t1DXH9Qx+hbM2CFSht/UbCn3QgB7ykkNpz2YyJ5G1
	wzU6F7zJS6QMb045keuP8oI=
X-Google-Smtp-Source: ABdhPJwpLvLkGnC3/Dg2x14GnAOZ+ZoroUkEYmesy+nzNODstBbmbTiZU/Yol7qHJx3VTGXUgt39qw==
X-Received: by 2002:a17:906:e2d6:: with SMTP id gr22mr1142604ejb.514.1623263565441;
        Wed, 09 Jun 2021 11:32:45 -0700 (PDT)
From: Razvan Virtan <virtanrazvan@gmail.com>
X-Google-Original-From: Razvan Virtan <razvanvirtan@gmail.com>
To: justin.he@arm.com
Cc: minios-devel@lists.xen.org
Subject: Re: [Minios-devel,RFC,1/5] build: Add build tool to translate symbol to assembly codes
Date: Wed,  9 Jun 2021 21:32:42 +0300
Message-Id: <20210609183242.1592-1-razvanvirtan@gmail.com>
X-Mailer: git-send-email 2.17.1
In-Reply-To: <20191101064315.8744-2-justin.he@arm.com>
References: <20191101064315.8744-2-justin.he@arm.com>

Hi, Justin.
Since this series was moved on github, I will mark this patch and the following ones
as `Superseded` on Patchwork and we will continue the discussion on the github PR.

Reviewed-by: Razvan Virtan <virtanrazvan@gmail.com>


From minios-devel-bounces@lists.xenproject.org Fri Jun 11 08:01:38 2021
Return-path: <minios-devel-bounces@lists.xenproject.org>
Envelope-to: archives@lists.xenproject.org
Delivery-date: Fri, 11 Jun 2021 08:01:38 +0000
Received: from list by lists.xenproject.org with outflank-mailman.138919.259219 (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lrc6i-0002du-Hr; Fri, 11 Jun 2021 08:01:36 +0000
X-Outflank-Mailman: Message body and most headers restored to incoming version
Received: by outflank-mailman (output) from mailman id 138919.259219; Fri, 11 Jun 2021 08:01:36 +0000
Received: from localhost ([127.0.0.1] helo=lists.xenproject.org)
	by lists.xenproject.org with esmtp (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lrc6i-0002dn-EU; Fri, 11 Jun 2021 08:01:36 +0000
Received: by outflank-mailman (input) for mailman id 138919;
 Tue, 08 Jun 2021 18:44:15 +0000
Received: from us1-rack-iad1.inumbo.com ([172.99.69.81])
 by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from
 <SRS0=vz6+=LC=gmail.com=christopher.w.clark@srs-us1.protection.inumbo.net>)
 id 1lqghz-0001rE-BU
 for minios-devel@lists.xenproject.org; Tue, 08 Jun 2021 18:44:15 +0000
Received: from mail-oi1-x22b.google.com (unknown [2607:f8b0:4864:20::22b])
 by us1-rack-iad1.inumbo.com (Halon) with ESMTPS
 id 31d3982a-8049-49bd-93b8-a0f0bc821cac;
 Tue, 08 Jun 2021 18:44:06 +0000 (UTC)
Received: by mail-oi1-x22b.google.com with SMTP id a26so1829720oie.11;
 Tue, 08 Jun 2021 11:44:06 -0700 (PDT)
X-BeenThere: minios-devel@lists.xenproject.org
List-Id: Mini-os development list <minios-devel.lists.xenproject.org>
List-Unsubscribe: <https://lists.xenproject.org/mailman/options/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=unsubscribe>
List-Post: <mailto:minios-devel@lists.xenproject.org>
List-Help: <mailto:minios-devel-request@lists.xenproject.org?subject=help>
List-Subscribe: <https://lists.xenproject.org/mailman/listinfo/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=subscribe>
Errors-To: minios-devel-bounces@lists.xenproject.org
Precedence: list
Sender: "Minios-devel" <minios-devel-bounces@lists.xenproject.org>
X-Inumbo-ID: 31d3982a-8049-49bd-93b8-a0f0bc821cac
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20161025;
        h=mime-version:from:date:message-id:subject:to:cc;
        bh=yMYHVO+ERtPmmmBOaX2eo+ZhIMxbzVu0YuG005cvwe8=;
        b=liOxfv1Wfeu3baNbBGqOD8Rcbq/Wz6hk3ewjAlBKfw85uynOXPtby3tHnInul6rlVn
         ZkRe1YByIAU2JtiISG96lPzOfZIKYevFFxJK9EtZexagTW91ULGFpI4eBBrv3Pf+MVRg
         HyEaODXMDLIUcgUZQFq6E3plHbQyL3UucKxf1OpBeqwqZbpu07T1U5+asBdyD5MhRU3l
         o096+D0z2yDNAXSC3g3pzP8UXkDKa8CYM2ckTdo1owuxQ26yAafs+Z8tvuWs8AbsPsW1
         O4DfLbdkUNNqD57nuQ/pFrSEdw8tVGZ+3guZFjuON9MpwLZG/bqMORhZ+tusu9Y3uiRR
         6FgQ==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20161025;
        h=x-gm-message-state:mime-version:from:date:message-id:subject:to:cc;
        bh=yMYHVO+ERtPmmmBOaX2eo+ZhIMxbzVu0YuG005cvwe8=;
        b=SXooLDoOCq2d5yBKU5/0siSEy/NchYBjSR0kJPDTVpNtAPWV3MdG9hcPQXY1/n3Iyz
         CzAYm1/QvsOwqZ7paYimyc7hv6urhJ+SEpsF2iv6livbA9WNhVkwFK/VEr1w0GklCH3Q
         ygxrfA1ksTJ4B/sggL1fSTwFQCoxq0+ae/sv18N/YjB2VQL01BwQAXnfu64DaDOH3YRY
         i0laptbASWTEdWOT8E5YQ/DOMSHsDbWKUIa8yD5rnmI7qu8M6oM/MRXPIb9o/jgXffoV
         gGIU+sut841TTyXt6pgPLpZpxFbol6dslb3wyizResqKOcUt1m6pJFeBJu9u1XzRfHs1
         E/tQ==
X-Gm-Message-State: AOAM530LeIQV5cdazkWnoThcF4CgrlI64qxSOphvjWoZ+W8BdYjZ8Sip
	hkcGN1JMkvP1ueIuQLgiQRU6qnrvcut/bxWL/U9ZXqwrcpibrQ==
X-Google-Smtp-Source: ABdhPJz9pbTtyhnyt9qsUHIxlUmnIvP+pQ89TpXICMW5WfNiJ10uPlkJEPb4KYWioy9tcgEWchfpc4LhajaEyCnsuB0=
X-Received: by 2002:aca:4554:: with SMTP id s81mr3807985oia.152.1623177845386;
 Tue, 08 Jun 2021 11:44:05 -0700 (PDT)
MIME-Version: 1.0
From: Christopher Clark <christopher.w.clark@gmail.com>
Date: Tue, 8 Jun 2021 11:43:52 -0700
Message-ID: <CACMJ4Ga47G1UZSiy=Ud=audqDr93+5vF8s-tPtoBiN69ZK=v-Q@mail.gmail.com>
Subject: Xen Summit Design Session notes: Hyperlaunch
To: xen-devel <xen-devel@lists.xenproject.org>
Cc: Daniel Smith <dpsmith@apertussolutions.com>, Andrew Cooper <andrew.cooper3@citrix.com>, 
	Stefano Stabellini <stefano.stabellini@xilinx.com>, Julien Grall <jgrall@amazon.com>, 
	Julien Grall <Julien.grall.oss@gmail.com>, Ian Jackson <iwj@xenproject.org>, Wei Liu <wl@xen.org>, 
	George Dunlap <george.dunlap@citrix.com>, Jan Beulich <jbeulich@suse.com>, 
	Rich Persaud <persaur@gmail.com>, Bertrand Marquis <Bertrand.Marquis@arm.com>, 
	=?UTF-8?Q?Roger_Pau_Monn=C3=A9?= <roger.pau@citrix.com>, 
	luca.fancellu@arm.com, paul@xen.org, Adam Schwalm <adam.schwalm@starlab.io>, 
	Scott Davis <scott.davis@starlab.io>, Christopher Clark <christopher.clark@starlab.io>, 
	quinnr@ainfosec.com, openxt <openxt@googlegroups.com>, 
	dgdegra <dgdegra@tycho.nsa.gov>, Artem Mygaiev <artem_mygaiev@epam.com>, 
	Bruce Ashfield <bruce.ashfield@gmail.com>, demi@invisiblethingslab.com, dfaggioli@suse.com, 
	mengxu@cis.upenn.edu, josh.whitehead@dornerworks.com, 
	Stewart Hildebrand <stewart.hildebrand@dornerworks.com>, Juergen Gross <jgross@suse.com>, 
	trenchboot-devel@googlegroups.com, system-dt@lists.openampproject.org, 
	minios-devel@lists.xenproject.org
Content-Type: text/plain; charset="UTF-8"

Design Session - Hyperlaunch
--------------------
Wednesday 26th May, at the Xen Design and Developer Summit 2021
Session Hosts: Christopher Clark & Daniel Smith

tl;dr:
- use cases for Hyperlaunch include supporting bare metal apps
    - latency is a critical requirement for workloads
        - determines success/failure of the system
        - scheduling is hard; Xen has options, including RTDS
- Zephyr in dom0 being explored in the Arm embedded community
- XSM Roles work is to support flexible deployment structure
- System Device Tree is important for Hyperlaunch to integrate
    - migration from dom0less to be supported
    - Lopper tool translates SDT to traditional Device Trees for domains
- Boot Domain could run Lopper
    - could be done as a unikraft unikernel
- US/EU Supply Chain SBOM need aligns with Hyperlaunch + Trenchboot
    - options for funding to accelerate the work:
        - PCI passthrough, Recovery Domain, XSM framework improvements
- Design docs for Hyperlaunch available [patch posted to merge to Xen tree]
https://lists.xenproject.org/archives/html/xen-devel/2021-05/pdfq6mIMNPNoM.pdf
https://lists.xenproject.org/archives/html/xen-devel/2021-05/pdfQlbS0F4suy.pdf

Slides from the Hyperlaunch Keynote:
https://static.sched.com/hosted_files/xen2021/d7/Hyperlaunch%20-%20Keynote_%20Xen%20Summit%202021%20-%20Clark%2C%20Smith.pdf
Video: https://www.youtube.com/watch?v=Xwtq2Q0ylj0&list=PLYyw7IQjL-zGcRPN6EjiTuFVGo4A6KCNf&index=21

Slides from the XSM Roles presentation:
https://static.sched.com/hosted_files/xen2021/75/Tuesday_A%20new%20Role%20model%20XSM-.pdf
Video: https://www.youtube.com/watch?v=j1fDn8ZbyVE&list=PLYyw7IQjL-zGcRPN6EjiTuFVGo4A6KCNf&index=6

Hyperlaunch at the Xen Project wiki:
https://wiki.xenproject.org/wiki/Hyperlaunch

--------------------
Open Discussion:
- floor open for audience requirements, use cases for Hyperlaunch

Stefano:
    - use case: fast unikernel boot (on embedded known as "bare metal
      applications")
        - boot to up as quickly as possible

    - difference between unikernels and bare metal applications:
        - a bare metal application is a tiny driver for a hardware block
        - ie. a hardware block in programmable logic so no existing driver

    - a bare metal application: typically just a driver that executes as the
      "unikernel"
        - usually only a few of them

    - latency is the biggest concern for bare metal apps
        - hypervisor scheduling: a concern
        - priority reason: _must_ respond to hardware action in a very limited
          amount of time
        - ie. Latency more important than anything else
            - losing latency is software failure: disaster happens
        - consequence: Adding a scheduler makes it a lot harder
            - not doing any scheduling is typically easier
            - also need to do cache partitioning, and more

    - a bare metal app doesn't need any PV drivers since it doesn't
      communicate with any other software, just the hardware block.
        - access to mmio + an interrupt or two sufficient

Christopher:
    - use of unikernels aligns with what is wanted for the boot domain:
        - ie. use short, single-purpose domains for platform services to
          avoid turning the boot domain into another dom0 by continuing to
          add functionality
        - eg. Qubes OS Mirage firewall VM, or something similar from unikraft

Daniel:
    - design: the hypervisor finishes the system, waits for boot domain to exit
          and complete the launch
        - enters 'finalization phase', finishes bringing everything up:
          eg. unpausing other domains not unpaused by boot domain
        - boot domain wiped from memory

--- topic: Scheduling

Christopher:
    - For small, single-purpose domains: have a need to schedule these

Stefano:
    - Illustrative example: 2 domains: dom0 Linux, domU bare metal app
    - no scheduling, to make sure deadlines not broken
    - made domU pause dom0 during critical execution:
        - Interesting inversion of priority.

Point is that domU is the most critical thing on the entire system.
ie. if domU meets deadlines and dom0 not present, system still functional.

Christopher:
    - related: Connor's talk at this Summit re: moving scheduling out of
      Xen into dom0;
https://xen2021.sched.com/event/jAEs/the-root-vm-a-new-xen-domain-species-connor-davis-ais
    - also the Bromium architecture, and Daniel's HAT architecture
https://xen2020.sched.com/event/baXt/design-session-talk-reliable-platform-security-xen-and-the-fidelis-platform-for-hardened-access-terminals-hat
        - has concept of protection domains
    - interested in DomU running the fundamental workload but not being
      Control Domain, doesn't have those permissions

For this use case -- domU pauses dom0 for domU to meet its deadlines --
permission model must have been changed.

Stefano:
    - adhoc provision of two hypercalls so domU could pause/unpause dom0
    - not easy to make generic:
        - not just vcpu, must pause _everything_ except self
    - 5 lines of code for a hack, 10 months to do it properly, upstream, etc!

    - Critical section: an interrupt occurs, must act within a very limited
      amount of time; else the whole thing fails

    - Critical section is way smaller than a slot of the scheduler

    - Make sure everything else is paused, to get the full bandwidth of not just
      the CPU, but also DDR, no interrupts. Don't screw up those 15 microseconds

George:
    - how long does it take to pause all the other VMs on the system?
    - eg: a foreach domain, foreach vcpu, and just pause them, but:
      involves sending interrupts, waiting for the thing to finish, etc

Stefano:
    - I knew which event started the critical section, so I made that event the
      trigger for pausing dom0.


[via chat:] Demi Marie: What if we had a hard real-time scheduler like
seL4 does?
[via chat:] Artem: RTDS? NULL?
[via chat:] Andy: yup - those
[via chat:] Julien: https://wiki.xenproject.org/wiki/RTDS-Based-Scheduler
[via chat:] Artem: also ARINC653
[via chat:] Scott: sounds like he wants the hypervisor to disable interrupt
virtualization and sit in a tight loop running a single guest on certain cores
[via chat:] Artem: core pooling?
[via chat:] Demi Marie: IIRC seL4 can do this with the mixed-criticality
scheduling work
[via chat:] Artem: RTDS can do that but AFAIK it cannot reschedule slack

Daniel:
    - you need a scheduler that is aware of these critical interrupts that
when they occur, it means that that domain has to have exclusivity over the
system and can take care of ensuring that you get scheduling exclusivity over
the system.

Stefano: responding to Demi, re: "seL4 can do this with the mixed-criticality
scheduling work"
    - Yes, other domains in the past used this technique

George: you don't actually need to pause the other domains;
    - you just need to make sure that the other CPUs stop doing stuff.

Stefano: what I did: slept in Xen, not even pause the CPU: busy-looping Xen

George: in a sense is correct; similar to core scheduling, sibling cores switch
to not doing anything

Daniel: yes, lots of academic papers on these problems, eg. implemented in seL4
and other kernels.
XSM Roles: was done to help more advanced Hyperlaunch scenarios'
    - (I don't like this idea but:) you could build a role-based scheduler

Christopher: ARINC653 scheduler mentioned - Artem, have you experience with it?

Artem: no, sticking with RTDS. Also used it with full preemption for Xen.
- Really interested in RTDS.
    - want to explore using slack time for domains with best effort priorities
    - RTDS seems like the best option for future development.

Our scenarios, on Arm:
- distinguish between: hardware-controlling domain, hardware domains,
  and controlling domain:
- using dom0 as a controlling domain, able to recreate domains if needed

- using device tree and don't have ACPI: split hardware between domains
    - each domain can talk directly to some piece of hardware
        - ie. they all are, in a sense, hardware domains
    - each can be independently restarted to deal with faulty hardware drivers
        - eg. we can restart the GPU from dom0

- dom0 path to safety certifications: working on Zephyr as a dom0
    - event channels working
    - an early draft implementation

- aims:
    - a small RTOS acting as a starter in dom0
    - don't put other domain kernels in dom0 - instead: a bootloader
        - dom0 starts a domain, gives a generic bootloader, common for all other
          domains, and then other domains have their own filesystems
        - guest domain's know which kernel to use, so dom0 becomes very small
          and very generic, and not depending on other domain's kernels, etc.
        - ie. dom0 is purely for control functions

--- topic: how does Hyperlaunch help?

Stefano:
    - domU should not be started from dom0
        - two domains, no PV drivers at all
        - a clear use case for dom0less
    - more detailed XSM policies allows dom0 to not be fully privileged
    - XSM policy can allows one domU to stop the other domU


--- topic: request to review the design doc

Daniel:
    - we want to make sure that we're good on this idea of the boot domain
    - that we understand how these handoffs are going
    - the roles work, the subtask to get that integrated in so that we can do
      these disaggregated boots.

New definitions for Roles within the Xen system:
    - get away from concepts of 'is_control_domain' and 'is_hardware_domain'
    - talk about what Role we're asking a domain to do and function as
    - want a common language for roles
     (eg. avoid (possibly unaware) misconceptions of current differences in
     views on what a Control Domain is and what a Hardware Domain is)

Review the design doc, give us some feedback; will be adding a design doc for
the Roles work as well -- have a draft form of it and just want to flush it out
further, and hopefully we can get all of that adopted.


--- topic: Question from Julien: is the plan to completely remove dom0less
or keep the two together?

Christopher: integrate, so no boundary between the two
    - Everything with dom0less should continue to work

Daniel: yes
    - dom0less constructing domains from the hypervisor will continue,
      become common code, used by both Arm and x86.
    - biggest difference: migration from dom0less to hyperlaunch trees;
      not sure what that migration period will be.
        - much broader Device Tree definition
        - trying to ensure aligned with System Device Tree
            - (dom0less today has own specific Device Tree configuration)
        - for some period of time, the parser for the dom0less Device Tree is
          going to have to coexist with the Hyperlaunch one


--- topic: System Device Tree and Lopper

Stefano:
System Device Tree:
    - very similar to Hyperlaunch and dom0less
    - defines 'domains': VMs for Xen, or could be bare metal things
      running on a coprocessor
    - next few months: finish cleaning up the definition of domains in
      System Device Tree, and cover VMs properly

Align Hyperlaunch with the System Device Tree domains.
- already need migration from dom0less to System Device Tree
- don't want to do two migrations

System Device Tree comes with a tool called 'Lopper':
    [ https://github.com/devicetree-org/lopper ]

Lopper takes a single System Device Tree and generates multiple
traditional Device Trees, one for each domain in the System Device Tree.
    - Device Tree for VMs can be very different from the one on the host
    - Device Tree for bare metal domains can be much closer

Lopper supports python plugins
- eg. a Lopper plugin to convert the System Device Tree format into dom0less
  format, so works with current Xen parsing
- changing the Xen parsing eventually would be better


Daniel:
- with Hyperlaunch: could boot with the System Device Tree, and pass it
  into the Boot Domain, where Lopper runs, and Lopper can generate domain device
  trees for guest domains to start

Stefano: would be very cool!
- System Device Tree (and Lopper, in python) so far always used at build time

Daniel: the unikraft project has its micropython unikernel
- for embedding scripts as a unikernel
- eg. a unikraft unikernel python domain with Lopper and Boot Domain logic
    - takes System Device Tree used to construct all the domains, and does
      the Device Tree generation
- from a security standpoint: nice: hypervisor's not generating Device Trees
    - all at runtime in a clean, safe architecture

Christopher: interesting for CI looping as well

--- topic: Scope, Funding, Alignment of work

Rich: Q: You said that you were managing the scope, because it could become
quite big: Could you talk about:
    - Some of the things that you have left out of scope?
    - Areas where funding would help?
    - Areas where other contributors would help?
    - How Trenchboot is connected to this or just launch integrity in general?

"In both the US and the EU, there is a top-down effort for supply chain
security, powered by ransomware and bitcoin, so " [ money is available ]
" to get more integrity in the software stack, and they're
pushing 'Secure Bill Of Materials (SBOM)', which we saw at the Yocto event.
So if you have a Secure Bill Of Materials, and your Hyperlaunch system with
Trenchboot can prove that the thing running matches the manifests, people might
want to pay money for that, and help drive your roadmap."

Daniel: Yes.

Trenchboot: Correct, the whole idea of this spawned out of the same thoughts
that created Trenchboot [ https://trenchboot.org/ ]

- proposed back in May/June 2018, driven by:
  how do we want to use Trenchboot in a Xen launch system where we had the
  security properties that we're seeking, but without blowing up, in terms of
  size and code and responsibility, into the hypervisor
    - ref: talk at Trenchboot Developer Forum
        - [ https://www.youtube.com/watch?v=qWMRcfQdc6c ]

- standard pattern following with Trenchboot: launch into a kernel that then
  launches into an integrity measurement system, a security engine
    - ie. for Xen: we do a DRTM launch into Xen, that starts a Boot Domain,
      our security engine that runs in a restricted environment that's protected
      to take measurements of the system that provides you attestable
      information, attestable evidence, to what's in your system, to the degree
      that's possible.
    - at the same time, not everybody wanted to have a capability specifically
      focussed on that, so there had already been discussions about a bootstrap
      domain, that we linked to when Daniel De Graaf did the original Hardware
      Domain - he posted an example Boot Domain capability,
        - so building all of this as the foundation

Rich: are there things you have wanted to do but have postponed or are there
tasks where you need external people to help, or external funding sources that
would allow those features to be addressed?

Christopher:
    - PCI passthrough is the big one
        - really important
        - highly complementary to Hyperlaunch to passthrough PCI devices
          right from start of all of initial VMs
        - but complex

    - the Recovery Domain
        - mentioned in the Design Document
        - ability to have a VM built, configured, and when failure is
          detected during host boot - eg. malfunction of a critical VM -
          can put rescue logic in there to enable recovery

Daniel:
    - For the Roles work, done the minimum Hyperlaunch needed
    - but could definitely go much further
        - get the XSM Framework cleaned up
        - get Flask in much better position
        - more advanced Roles
        - reevaluating all the XSM hooks in terms of Roles and everything
        - getting all of the security framework in a better state.

--------------------
The recording for this Design Session is available at:
https://www.youtube.com/watch?v=j75orDMXO2M&list=PLYyw7IQjL-zGcRPN6EjiTuFVGo4A6KCNf&index=13


From minios-devel-bounces@lists.xenproject.org Fri Jun 11 08:01:38 2021
Return-path: <minios-devel-bounces@lists.xenproject.org>
Envelope-to: archives@lists.xenproject.org
Delivery-date: Fri, 11 Jun 2021 08:01:38 +0000
Received: from list by lists.xenproject.org with outflank-mailman.140176.259224 (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lrc6i-0002eG-Lw; Fri, 11 Jun 2021 08:01:36 +0000
X-Outflank-Mailman: Message body and most headers restored to incoming version
Received: by outflank-mailman (output) from mailman id 140176.259224; Fri, 11 Jun 2021 08:01:36 +0000
Received: from localhost ([127.0.0.1] helo=lists.xenproject.org)
	by lists.xenproject.org with esmtp (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lrc6i-0002dz-GR; Fri, 11 Jun 2021 08:01:36 +0000
Received: by outflank-mailman (input) for mailman id 140176;
 Fri, 11 Jun 2021 05:38:14 +0000
Received: from us1-rack-iad1.inumbo.com ([172.99.69.81])
 by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from
 <SRS0=kCr6=LF=kunnamon.io=daniel.brodsky@srs-us1.protection.inumbo.net>)
 id 1lrZry-0006WP-N6
 for minios-devel@lists.xenproject.org; Fri, 11 Jun 2021 05:38:14 +0000
Received: from mail-qt1-x832.google.com (unknown [2607:f8b0:4864:20::832])
 by us1-rack-iad1.inumbo.com (Halon) with ESMTPS
 id a7d6bda2-0af4-4127-a066-40313a4bebb3;
 Fri, 11 Jun 2021 05:38:14 +0000 (UTC)
Received: by mail-qt1-x832.google.com with SMTP id g12so1778989qtb.2
 for <minios-devel@lists.xenproject.org>; Thu, 10 Jun 2021 22:38:13 -0700 (PDT)
X-BeenThere: minios-devel@lists.xenproject.org
List-Id: Mini-os development list <minios-devel.lists.xenproject.org>
List-Unsubscribe: <https://lists.xenproject.org/mailman/options/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=unsubscribe>
List-Post: <mailto:minios-devel@lists.xenproject.org>
List-Help: <mailto:minios-devel-request@lists.xenproject.org?subject=help>
List-Subscribe: <https://lists.xenproject.org/mailman/listinfo/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=subscribe>
Errors-To: minios-devel-bounces@lists.xenproject.org
Precedence: list
Sender: "Minios-devel" <minios-devel-bounces@lists.xenproject.org>
X-Inumbo-ID: a7d6bda2-0af4-4127-a066-40313a4bebb3
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=kunnamon-io.20150623.gappssmtp.com; s=20150623;
        h=mime-version:from:date:message-id:subject:to;
        bh=1ldD3kTondTzGww6H9ulhck9J0U0CnlJSESLrw282QQ=;
        b=MHmXvOgCROlus05FNI8ES0/ihDUGxqJyU9ctMa8x0juwSNdQfkLE7fFZ4hL+EztnYF
         9df7cxS0w8npOKpURyImX327gf4A5qmoxoKrmU9iq8HM0jlP+chV9O2/5eGJ4SPF/zeZ
         /zEJ2SxBX6LU3IQGFRsVTE4Walu2enUWNrbZ+eKQTygQ56JVIVCoQIK0allNXGpLljMN
         mH+RzTvHrs+G+WySWp/Mo6o/p9Xj/H2KxOapN4e4O2wc0EetQ09uw8mZgSiLqI6YsHtX
         Ne07/xUjs+svuBWkcHUyvKAUjiNle2ZPNQD5CsAWjXmsM2AO1HWiwuA2+GA0H3BlN7ya
         MA9Q==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20161025;
        h=x-gm-message-state:mime-version:from:date:message-id:subject:to;
        bh=1ldD3kTondTzGww6H9ulhck9J0U0CnlJSESLrw282QQ=;
        b=mqbhjU8Ye3YPCjuXCQRYNaq5zTVIL6TM59Tc7dkXhJNakEkQaz+CE2pdHisnbbquCs
         XBPPuZz7zO57TUqrT7JowLI1NkrZmLPdmqJGb9MPrMLVYJUPZ/UGpbt1BeN2Nb7UWKY2
         bOg0Dnzz3gwXlylCkCEs9bpijJc0OsDAKh3by9+YzuCTIh+j9Xl8mpqHl3Ao9RBdeYkw
         En4k4T56jU1ldHt9d8TIqlziL+F4/Cyj+rSYRIh8Rx3dnZ5GmlL4c6ecxM67+6chXXls
         c8yQZn5F3+ud8KAY1ceJpUQBdtAK3A1RbK1W4URp4Y43r9ePTldPqcPOuJDhL3Of3gi1
         iJmQ==
X-Gm-Message-State: AOAM531h3Tyk7W1ild5c6bvYL+G0wmuHjQ8zyF9tZsaRwGZBaZ9WRmqW
	22ydlK2KeEQMZ4X4a5Q1MxQpI0/K0ExA5ldGGs1OSuh5T7E=
X-Google-Smtp-Source: ABdhPJz/Ye8ZZY9KpeS2jM6NzZi1EhsHJG5tUoajRfPKy9kn0lgaeHDXM1tmIdQVC1yipZ5R1lksY8vHo0BIvmKL/GU=
X-Received: by 2002:ac8:424a:: with SMTP id r10mr2297278qtm.147.1623389893697;
 Thu, 10 Jun 2021 22:38:13 -0700 (PDT)
MIME-Version: 1.0
From: Daniel Brodsky <daniel.brodsky@kunnamon.io>
Date: Thu, 10 Jun 2021 22:38:03 -0700
Message-ID: <CABvdTWHAvNUUiA7UFO4ZQw5ipbYTkt9oyaY-_+x3kdD7+Qx7mA@mail.gmail.com>
Subject: mattermost invite
To: minios-devel@lists.xenproject.org
Content-Type: multipart/alternative; boundary="000000000000f2353605c476e953"

--000000000000f2353605c476e953
Content-Type: text/plain; charset="UTF-8"

Hi there!

I'm currently working on porting an app into a unikernel using unikraft and
have some questions about the state of certain features and areas of
improvement in the project. I saw on the mailing list that you don't use
IRC and have a Mattermost server instead, so I was hoping I could get an
invite. ;)

Cheers
Daniel

--000000000000f2353605c476e953
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr"><div>Hi there!</div><div><br></div><div>I&#39;m currently =
working on porting an app into a unikernel using unikraft and have some que=
stions about the state of certain features and areas of improvement in the =
project. I saw on the mailing list that you don&#39;t use IRC and have a Ma=
ttermost server instead, so I was hoping I could get an invite. ;)<br></div=
><div><br></div><div>Cheers</div><div>Daniel<br></div></div>

--000000000000f2353605c476e953--


From minios-devel-bounces@lists.xenproject.org Fri Jun 11 08:10:40 2021
Return-path: <minios-devel-bounces@lists.xenproject.org>
Envelope-to: archives@lists.xenproject.org
Delivery-date: Fri, 11 Jun 2021 08:10:40 +0000
Received: from list by lists.xenproject.org with outflank-mailman.140283.259230 (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lrcFS-0003f3-CE; Fri, 11 Jun 2021 08:10:38 +0000
X-Outflank-Mailman: Message body and most headers restored to incoming version
Received: by outflank-mailman (output) from mailman id 140283.259230; Fri, 11 Jun 2021 08:10:38 +0000
Received: from localhost ([127.0.0.1] helo=lists.xenproject.org)
	by lists.xenproject.org with esmtp (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1lrcFS-0003ew-8Q; Fri, 11 Jun 2021 08:10:38 +0000
Received: by outflank-mailman (input) for mailman id 140283;
 Fri, 11 Jun 2021 08:10:37 +0000
Received: from us1-rack-iad1.inumbo.com ([172.99.69.81])
 by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from
 <SRS0=a7se=LF=gmail.com=felipehuici@srs-us1.protection.inumbo.net>)
 id 1lrcFR-0003eq-0w
 for minios-devel@lists.xenproject.org; Fri, 11 Jun 2021 08:10:37 +0000
Received: from mail-ua1-x92f.google.com (unknown [2607:f8b0:4864:20::92f])
 by us1-rack-iad1.inumbo.com (Halon) with ESMTPS
 id 7cef966f-1c15-4502-b0c1-d78a0e34e163;
 Fri, 11 Jun 2021 08:10:36 +0000 (UTC)
Received: by mail-ua1-x92f.google.com with SMTP id d13so2282003uav.5
 for <minios-devel@lists.xenproject.org>; Fri, 11 Jun 2021 01:10:36 -0700 (PDT)
X-BeenThere: minios-devel@lists.xenproject.org
List-Id: Mini-os development list <minios-devel.lists.xenproject.org>
List-Unsubscribe: <https://lists.xenproject.org/mailman/options/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=unsubscribe>
List-Post: <mailto:minios-devel@lists.xenproject.org>
List-Help: <mailto:minios-devel-request@lists.xenproject.org?subject=help>
List-Subscribe: <https://lists.xenproject.org/mailman/listinfo/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=subscribe>
Errors-To: minios-devel-bounces@lists.xenproject.org
Precedence: list
Sender: "Minios-devel" <minios-devel-bounces@lists.xenproject.org>
X-Inumbo-ID: 7cef966f-1c15-4502-b0c1-d78a0e34e163
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20161025;
        h=mime-version:references:in-reply-to:from:date:message-id:subject:to
         :cc;
        bh=JQoauMyVLA4RL9iPGrECWC6I4nndlJHLKeCF98p+xtE=;
        b=vGqY/wDXWx6bgEL0YNLvgbUrXd8Kad0xwWG0GvXTaFj9DzQw9u4+EzYDzAIepZ8j6j
         6pcYlQyZqbNjphjhWR54kGZXtgaTQ7rUaWgJcnhVB+devNgWbRpXJNH28R9KsglMgRoL
         72/3mfpxgxToc6zOc2X0nB4bRnPr6x+KEXEq2N+8Sc/iSDMYn9Dc7NiEb1qTMvH0Q/q5
         qAJrdZA6+OGuFVIgYt32aEaujF+Jb6Uvozd/u0Y7rgmi/3P2suf0rQ9cV4+w/bCaNHNR
         ejJ066mFMzCudEjr4UMG1e4bxKjjhiaygS6qnzsPMb7oRYwREnoPs0dk52vEqd9/KwQ2
         rRBg==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20161025;
        h=x-gm-message-state:mime-version:references:in-reply-to:from:date
         :message-id:subject:to:cc;
        bh=JQoauMyVLA4RL9iPGrECWC6I4nndlJHLKeCF98p+xtE=;
        b=RCT8ZYqVbv73sm9HM4PRTBJ0EeS32yxtXzvvt5EVB9U0SWNUJ5itVeGW2aXCSrOo7+
         lsQmnZOhbrsxz3gtom/4ftPo+/wACuz7bKCdstVLAwAFcPSBmGSr5MLDj/99Mpig3UYT
         0gUTbxTv3j8GIkvEXqV4MpxL6hZ5YkOSN4U3UdiQb2XqJ31+wCzFo0okuKMocRXzgp2I
         /wvcltbkk9I/VBs172GSzgjwJcRLA5JNefLTjufi4cG9bmj8XdwELfo1F6K9WLfOZFBw
         WibwWedJ5yB5zL+4NhHdN4MyWwuORowHkA5Lq2ocOVrIECu6XbeG1HbiE6rY4mDtwBQc
         ZcVQ==
X-Gm-Message-State: AOAM531iqKddgZ04Udr1JpWIlpVAvodePwLJwJ5x9vCsbV+Ukkg/3XRO
	oOJxj3ZWoRiWQggafGdPlGKnMT2vqU6IsBL3nSI=
X-Google-Smtp-Source: ABdhPJyrM0qkn8ttlLLLEfELL9CB8uW6iEbmuzXXk/a0o7HLzHt9nuyqyxNal6j1j/RIJpOv8dYnj7MdsQhl6jSsNZU=
X-Received: by 2002:ab0:64c2:: with SMTP id j2mr1825169uaq.64.1623399035872;
 Fri, 11 Jun 2021 01:10:35 -0700 (PDT)
MIME-Version: 1.0
References: <CABvdTWHAvNUUiA7UFO4ZQw5ipbYTkt9oyaY-_+x3kdD7+Qx7mA@mail.gmail.com>
In-Reply-To: <CABvdTWHAvNUUiA7UFO4ZQw5ipbYTkt9oyaY-_+x3kdD7+Qx7mA@mail.gmail.com>
From: felipehuici <felipehuici@gmail.com>
Date: Fri, 11 Jun 2021 10:10:24 +0200
Message-ID: <CAEX4t-NZNq6CMMVJFtjotFuzmKj1HiFxWyKE6aUUfSdCytEcuA@mail.gmail.com>
Subject: Re: mattermost invite
To: Daniel Brodsky <daniel.brodsky@kunnamon.io>
Cc: minios-devel@lists.xenproject.org
Content-Type: multipart/alternative; boundary="000000000000dcab3905c4790a86"

--000000000000dcab3905c4790a86
Content-Type: text/plain; charset="UTF-8"

Hi Daniel, of course, I sent it just now, you should get an email. Welcome
on board!

-- Felipe

On Fri, Jun 11, 2021 at 10:01 AM Daniel Brodsky <daniel.brodsky@kunnamon.io>
wrote:

> Hi there!
>
> I'm currently working on porting an app into a unikernel using unikraft
> and have some questions about the state of certain features and areas of
> improvement in the project. I saw on the mailing list that you don't use
> IRC and have a Mattermost server instead, so I was hoping I could get an
> invite. ;)
>
> Cheers
> Daniel
>

--000000000000dcab3905c4790a86
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi Daniel, of course, I sent it just now, you should get a=
n email. Welcome on board!<div><br></div><div>-- Felipe</div></div><br><div=
 class=3D"gmail_quote"><div dir=3D"ltr" class=3D"gmail_attr">On Fri, Jun 11=
, 2021 at 10:01 AM Daniel Brodsky &lt;<a href=3D"mailto:daniel.brodsky@kunn=
amon.io">daniel.brodsky@kunnamon.io</a>&gt; wrote:<br></div><blockquote cla=
ss=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;border-left:1px solid =
rgb(204,204,204);padding-left:1ex"><div dir=3D"ltr"><div>Hi there!</div><di=
v><br></div><div>I&#39;m currently working on porting an app into a unikern=
el using unikraft and have some questions about the state of certain featur=
es and areas of improvement in the project. I saw on the mailing list that =
you don&#39;t use IRC and have a Mattermost server instead, so I was hoping=
 I could get an invite. ;)<br></div><div><br></div><div>Cheers</div><div>Da=
niel<br></div></div>
</blockquote></div>

--000000000000dcab3905c4790a86--


From minios-devel-bounces@lists.xenproject.org Wed Jun 16 12:49:25 2021
Return-path: <minios-devel-bounces@lists.xenproject.org>
Envelope-to: archives@lists.xenproject.org
Delivery-date: Wed, 16 Jun 2021 12:49:25 +0000
Received: from list by lists.xenproject.org with outflank-mailman.142930.263558 (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1ltUyv-0005go-Og; Wed, 16 Jun 2021 12:49:21 +0000
X-Outflank-Mailman: Message body and most headers restored to incoming version
Received: by outflank-mailman (output) from mailman id 142930.263558; Wed, 16 Jun 2021 12:49:21 +0000
Received: from localhost ([127.0.0.1] helo=lists.xenproject.org)
	by lists.xenproject.org with esmtp (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1ltUyv-0005gh-LX; Wed, 16 Jun 2021 12:49:21 +0000
Received: by outflank-mailman (input) for mailman id 142930;
 Wed, 16 Jun 2021 12:49:20 +0000
Received: from all-amaz-eas1.inumbo.com ([34.197.232.57]
 helo=us1-amaz-eas2.inumbo.com)
 by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from
 <SRS0=WxN3=LK=neclab.eu=simon.kuenzer@srs-us1.protection.inumbo.net>)
 id 1ltUyu-0005gb-FY
 for minios-devel@lists.xen.org; Wed, 16 Jun 2021 12:49:20 +0000
Received: from mailer2.neclab.eu (unknown [195.37.70.41])
 by us1-amaz-eas2.inumbo.com (Halon) with ESMTPS
 id ec42f3b6-8183-4600-be1b-cd3fdcd05ac3;
 Wed, 16 Jun 2021 12:49:17 +0000 (UTC)
Received: from localhost (localhost [127.0.0.1])
 by mailer2.neclab.eu (Postfix) with ESMTP id D3C50F2013;
 Wed, 16 Jun 2021 14:49:16 +0200 (CEST)
Received: from mailer2.neclab.eu ([127.0.0.1])
 by localhost (atlas-b.office.hd [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id AgXMW_4m4x7p; Wed, 16 Jun 2021 14:49:16 +0200 (CEST)
Received: from titania.office.hd (titania.office.hd [192.168.24.89])
 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
 (No client certificate requested)
 by mailer2.neclab.eu (Postfix) with ESMTPS id 8CCF2F2011
 for <minios-devel@lists.xen.org>; Wed, 16 Jun 2021 14:49:14 +0200 (CEST)
Received: from [10.7.2.12] (192.168.24.96) by titania.office.hd
 (192.168.24.89) with Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2242.10; Wed, 16 Jun
 2021 14:49:13 +0200
X-BeenThere: minios-devel@lists.xenproject.org
List-Id: Mini-os development list <minios-devel.lists.xenproject.org>
List-Unsubscribe: <https://lists.xenproject.org/mailman/options/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=unsubscribe>
List-Post: <mailto:minios-devel@lists.xenproject.org>
List-Help: <mailto:minios-devel-request@lists.xenproject.org?subject=help>
List-Subscribe: <https://lists.xenproject.org/mailman/listinfo/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=subscribe>
Errors-To: minios-devel-bounces@lists.xenproject.org
Precedence: list
Sender: "Minios-devel" <minios-devel-bounces@lists.xenproject.org>
X-Inumbo-ID: ec42f3b6-8183-4600-be1b-cd3fdcd05ac3
X-Virus-Scanned: Amavisd on Debian GNU/Linux (atlas-b.office.hd)
X-ENC: Last-Hop-TLS-encrypted
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=neclab.eu;
	s=mailer2-20210408; t=1623847756;
	bh=8++qGj+BJUpj0GkhpfE35mSKMW3PtuH9xMx4XspxHn4=;
	h=Subject:To:CC:References:From:Date:In-Reply-To:From;
	b=tkCm6EGBE9g1PegbKMP8je4lUv6ilnXLWEu+I5/eRfl8laJ+2KRnLGv5TVBgWTBjO
	 cS1o97j2HUeRSo108AiExUEgoBUthqOVr6zg7cl1ZEoIjNpBnRRw85BO7L6BdJqgiS
	 S6WjdC+tGEeUIUKeaJP8nQVaCYWXlI6T/e2Nw9gQjydLLPBVliuNDmGXMHo5m2cqqv
	 H4VsTeuwogg9XJXiCnSZPMVW5YzJaaD6P3vQYsLNi6k4sVupoY4mTtLPmAJ9jVR8dW
	 MHd/3CHfFzHXxiIy+/dd+AqPM+0EU8289U1daMhy/CwGPrQoWQ9Ohj6HOs3GUe5elE
	 vrPqKU4ToMW0Q==
X-ENC: Last-Hop-TLS-encrypted
Subject: Re: [UNIKRAFT PATCH 00/18] Allocator statistics
To: <minios-devel@lists.xen.org>
CC: Felipe Huici <felipe.huici@neclab.eu>, Sharan Santhanam
	<sharan.santhanam@neclab.eu>
References: <20201120154612.27579-1-simon.kuenzer@neclab.eu>
From: Simon Kuenzer <simon.kuenzer@neclab.eu>
Message-ID: <298c614b-f458-2984-c6c8-44f2d4291b22@neclab.eu>
Date: Wed, 16 Jun 2021 14:49:12 +0200
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0)
 Gecko/20100101 Thunderbird/78.11.0
MIME-Version: 1.0
In-Reply-To: <20201120154612.27579-1-simon.kuenzer@neclab.eu>
Content-Type: text/plain; charset="utf-8"; format=flowed
Content-Language: en-US
Content-Transfer-Encoding: 7bit
X-Originating-IP: [192.168.24.96]
X-ClientProxiedBy: oberon.office.hd (192.168.24.90) To titania.office.hd
 (192.168.24.89)

Hi Cezar,

thanks a lot for your review. I agree with your suggestions and put a 
new version of the series on GitHub:
https://github.com/unikraft/unikraft/pull/229

I will mark this series "superseded" on patchwork.


Thanks,

Simon

On 20.11.20 16:45, Simon Kuenzer wrote:
> This patch series introduces allocator statistics. With minimal
> instrumentation, allocators can report counters on allocation
> and freeing events that happened.
> For example, the following could be queried per allocator:
> 
>   last_alloc_size:         230 B /* size of the last allocation */
>   max_alloc_size:         4096 B /* biggest satisfied allocation size */
>   min_alloc_size:           12 B /* smallest satisfied allocation size */
>   tot_nb_allocs:            75   /* total number of satisfied allocations */
>   tot_nb_frees:             22   /* total number of satisfied free operations */
>   cur_nb_allocs:            53   /* current number of active allocations */
>   max_nb_allocs:            53   /* maximum number of active allocations */
>   max_mem_use:          218023 B /* maximum amount of memory that was in use */
>   cur_mem_use:          217088 B /* current amount of memory that is in use */
>   nb_enomem:                 0   /* number of times failing allocation requests */
> 
> Note: The meaning of `CONFIG_IFSTAT` changes with this patch series.
> The configuration option originally raised wrong expectations while it
> it just provided an API to query the amount of available memory from
> an allocator. `CONFIG_IFSTAT` is now enabling these detailed allocator
> statistics.
> 
> Note: Since this patch series changes some details on the internal ukalloc
> API (`<uk/alloc_impl.h>`), external memory allocators (like TLSF, mimalloc)
> need to be adopted as well. For retrieving statistics from them, they also
> need to be instrumented to count alloc and free events.
> 
> The first four commits are doing minor corrections of the API headers.
> Afterwards, the statistics API is introduced. Additionally, the last
> commits introduce a one consolidated global allocator statistics, as
> well as a per library allocator statistics. `lib/nolibc` had to
> instrumented in order to support per-library statistics properly.
> Similar to `nolibc`, `newlib` and `musl` need to be instrumented, too to
> properly support per-library statistics for libc allocation interfaces:
> malloc(), calloc(), free(), etc.
> 
> Simon Kuenzer (18):
>    lib/ukalloc: Correct BSD license header
>    lib/ukalloc: Move ifpages comment
>    lib/ukalloc: `extern C {` at the beginning of <uk/alloc.h>
>    lib/ukalloc: Move `uk_zalloc()` after `uk_calloc()`
>    lib/ukalloc: Introduce `uk_alloc_maxalloc()` and make
>      `uk_alloc_availmem()` available
>    lib/ukalloc: Introduce `uk_alloc_pavail()`, `uk_alloc_pmaxalloc()`
>    lib/ukalloc: Wrappers for "fee memory" interfaces
>    lib/ukalloc: Iterator helper for allocators
>    lib/ukalloc: Introduce `uk_alloc_availmem_total(),
>      `uk_alloc_pavail_total()`
>    lib/ukalloc: Allocator statistics
>    lib/ukalloc: Global statistics
>    lib/ukallocbbuddy: Instrumentation for statistics
>    lib/ukallocregion: Internal functions as `static`
>    lib/ukallocregion: Instrumentation for statistics
>    lib/ukalloc: Per-library allocation statistics
>    lib/ukalloc: Iterator for per-library statistics
>    lib/ukalloc: Use Unikraft internal types
>    lib/nolibc: Enable per-library allocator statistics
> 
>   lib/nolibc/Makefile.uk                   |   1 -
>   lib/nolibc/include/stdlib.h              |  39 ++-
>   lib/ukalloc/Config.uk                    |  29 ++-
>   lib/ukalloc/Makefile.uk                  |   5 +
>   lib/ukalloc/alloc.c                      | 225 ++++++++++------
>   lib/ukalloc/exportsyms.uk                |   9 +
>   lib/ukalloc/include/uk/alloc.h           | 174 +++++++++----
>   lib/ukalloc/include/uk/alloc_impl.h      | 179 +++++++++++--
>   lib/ukalloc/libstats.c                   | 311 +++++++++++++++++++++++
>   lib/ukalloc/libstats.ld                  |   9 +
>   lib/ukalloc/libstats.localsyms.uk        |   2 +
>   lib/{nolibc/malloc.c => ukalloc/stats.c} |  56 ++--
>   lib/ukallocbbuddy/bbuddy.c               |  50 +++-
>   lib/ukallocregion/region.c               |  54 +++-
>   plat/common/include/pci/pci_bus.h        |   2 +
>   plat/common/memory.c                     |   2 +
>   plat/xen/gnttab.c                        |   1 +
>   plat/xen/memory.c                        |   2 +
>   plat/xen/x86/gnttab.c                    |   1 +
>   19 files changed, 952 insertions(+), 199 deletions(-)
>   create mode 100644 lib/ukalloc/libstats.c
>   create mode 100644 lib/ukalloc/libstats.ld
>   create mode 100644 lib/ukalloc/libstats.localsyms.uk
>   rename lib/{nolibc/malloc.c => ukalloc/stats.c} (62%)
> 


From minios-devel-bounces@lists.xenproject.org Wed Jun 16 12:51:42 2021
Return-path: <minios-devel-bounces@lists.xenproject.org>
Envelope-to: archives@lists.xenproject.org
Delivery-date: Wed, 16 Jun 2021 12:51:42 +0000
Received: from list by lists.xenproject.org with outflank-mailman.142935.263589 (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1ltV1C-00079w-0j; Wed, 16 Jun 2021 12:51:42 +0000
X-Outflank-Mailman: Message body and most headers restored to incoming version
Received: by outflank-mailman (output) from mailman id 142935.263589; Wed, 16 Jun 2021 12:51:41 +0000
Received: from localhost ([127.0.0.1] helo=lists.xenproject.org)
	by lists.xenproject.org with esmtp (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1ltV1B-00079G-QQ; Wed, 16 Jun 2021 12:51:41 +0000
Received: by outflank-mailman (input) for mailman id 142935;
 Wed, 16 Jun 2021 12:51:40 +0000
Received: from us1-rack-iad1.inumbo.com ([172.99.69.81])
 by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from
 <SRS0=WxN3=LK=neclab.eu=simon.kuenzer@srs-us1.protection.inumbo.net>)
 id 1ltV1A-0006lZ-3f
 for minios-devel@lists.xen.org; Wed, 16 Jun 2021 12:51:40 +0000
Received: from mailer1.neclab.eu (unknown [195.37.70.40])
 by us1-rack-iad1.inumbo.com (Halon) with ESMTPS
 id ddf843bf-a32d-4cbd-94d2-2cbb5f0202c3;
 Wed, 16 Jun 2021 12:51:38 +0000 (UTC)
Received: from localhost (localhost [127.0.0.1])
 by mailer1.neclab.eu (Postfix) with ESMTP id 03A32103B06;
 Wed, 16 Jun 2021 14:51:37 +0200 (CEST)
Received: from mailer1.neclab.eu ([127.0.0.1])
 by localhost (atlas-a.office.hd [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id uqYUnizjynvh; Wed, 16 Jun 2021 14:51:36 +0200 (CEST)
Received: from titania.office.hd (titania.office.hd [192.168.24.89])
 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
 (No client certificate requested)
 by mailer1.neclab.eu (Postfix) with ESMTPS id B65F3FF894;
 Wed, 16 Jun 2021 14:51:36 +0200 (CEST)
Received: from [10.7.2.12] (192.168.24.96) by titania.office.hd
 (192.168.24.89) with Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2242.10; Wed, 16 Jun
 2021 14:51:36 +0200
X-BeenThere: minios-devel@lists.xenproject.org
List-Id: Mini-os development list <minios-devel.lists.xenproject.org>
List-Unsubscribe: <https://lists.xenproject.org/mailman/options/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=unsubscribe>
List-Post: <mailto:minios-devel@lists.xenproject.org>
List-Help: <mailto:minios-devel-request@lists.xenproject.org?subject=help>
List-Subscribe: <https://lists.xenproject.org/mailman/listinfo/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=subscribe>
Errors-To: minios-devel-bounces@lists.xenproject.org
Precedence: list
Sender: "Minios-devel" <minios-devel-bounces@lists.xenproject.org>
X-Inumbo-ID: ddf843bf-a32d-4cbd-94d2-2cbb5f0202c3
X-Virus-Scanned: Amavisd on Debian GNU/Linux (atlas-a.office.hd)
X-ENC: Last-Hop-TLS-encrypted
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=neclab.eu;
	s=mailer1-20210408; t=1623847896;
	bh=kUoyCsS+FAmrt4dWXzpuOx0GjF6rG/QZLZF7iVbOutY=;
	h=Subject:To:References:From:Date:In-Reply-To:From;
	b=i+AARmqPKAejoFil+NVSFrfUM+DGd54r78105l5hU+to5NUX/Hz1dM2sWxaG3L7D2
	 OFqMu3G/3bU4XRZ4FDvew3liub9dlMDnW+jmUwjj1potiuXc+PLyJc7m7wEvV98dv6
	 zj8TnneZN6uOclPpl79yTR75vFeEtkVAkmYewQDkV0gAs1pgtaVh16b9Ufwmiaz39X
	 AxHLepy1flLcCMBwQqlW6zCrihbT1HaDt/RYyS66lykOGP28RxAiS6znETAkI3mrnB
	 RpNeJR/2UJOvxt9wBnyntxHPmyiWTd+YqlLX6b6n8cIKzFZ1SatMnSMyeq1cXIHkyX
	 q4waZ1j89BAFg==
X-ENC: Last-Hop-TLS-encrypted
Subject: Re: [UNIKRAFT PATCH v2 0/2] lib/ukallocpool: Instrumentation for
 statistics
To: <minios-devel@lists.xen.org>, <razvan.deaconescu@cs.pub.ro>
References: <20201222125632.29415-1-simon.kuenzer@neclab.eu>
From: Simon Kuenzer <simon.kuenzer@neclab.eu>
Message-ID: <34ef1e19-1a9a-b099-feb7-885634b37547@neclab.eu>
Date: Wed, 16 Jun 2021 14:51:35 +0200
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0)
 Gecko/20100101 Thunderbird/78.11.0
MIME-Version: 1.0
In-Reply-To: <20201222125632.29415-1-simon.kuenzer@neclab.eu>
Content-Type: text/plain; charset="utf-8"; format=flowed
Content-Language: en-US
Content-Transfer-Encoding: 7bit
X-Originating-IP: [192.168.24.96]
X-ClientProxiedBy: titania.office.hd (192.168.24.89) To titania.office.hd
 (192.168.24.89)

Hi Cezar,

thanks a lot for your review. I integrated this series to the following 
GitHub series: https://github.com/unikraft/unikraft/pull/229

I will mark this series "superseded" on patchwork.


Thanks,

Simon

On 22.12.20 13:56, Simon Kuenzer wrote:
> Adopts lib/ukallocpool introduced with series 1606
> ( https://patchwork.unikraft.org/project/unikraft/list/?series=1606 )
> to the lib/ukalloc API changes that are introduced with series 1574
> ( https://patchwork.unikraft.org/project/unikraft/list/?series=1574 ).
> 
> Changes since v1:
>   - Adopt to changes of `ukallocpool` series (1597->1606)
> 
> Simon Kuenzer (2):
>    lib/ukallocpool: Always provide `uk_alloc_availmem()`,
>      `uk_alloc_maxalloc()`
>    lib/ukallocpool: Instrumentation for statistics
> 
>   lib/ukallocpool/pool.c | 50 +++++++++++++++++++++++++++++++++++-------
>   1 file changed, 42 insertions(+), 8 deletions(-)
> 


From minios-devel-bounces@lists.xenproject.org Wed Jun 16 13:11:19 2021
Return-path: <minios-devel-bounces@lists.xenproject.org>
Envelope-to: archives@lists.xenproject.org
Delivery-date: Wed, 16 Jun 2021 13:11:19 +0000
Received: from list by lists.xenproject.org with outflank-mailman.143138.264007 (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1ltVK8-0007ti-Rm; Wed, 16 Jun 2021 13:11:16 +0000
X-Outflank-Mailman: Message body and most headers restored to incoming version
Received: by outflank-mailman (output) from mailman id 143138.264007; Wed, 16 Jun 2021 13:11:16 +0000
Received: from localhost ([127.0.0.1] helo=lists.xenproject.org)
	by lists.xenproject.org with esmtp (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1ltVK8-0007ta-OW; Wed, 16 Jun 2021 13:11:16 +0000
Received: by outflank-mailman (input) for mailman id 143138;
 Wed, 16 Jun 2021 13:11:15 +0000
Received: from us1-rack-iad1.inumbo.com ([172.99.69.81])
 by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from
 <SRS0=WxN3=LK=neclab.eu=simon.kuenzer@srs-us1.protection.inumbo.net>)
 id 1ltVK7-0007tE-DY
 for minios-devel@lists.xen.org; Wed, 16 Jun 2021 13:11:15 +0000
Received: from mailer2.neclab.eu (unknown [195.37.70.41])
 by us1-rack-iad1.inumbo.com (Halon) with ESMTPS
 id f2ac32e3-e1b8-439f-8812-0853c21720bd;
 Wed, 16 Jun 2021 13:11:13 +0000 (UTC)
Received: from localhost (localhost [127.0.0.1])
 by mailer2.neclab.eu (Postfix) with ESMTP id 49C51F2013;
 Wed, 16 Jun 2021 15:11:12 +0200 (CEST)
Received: from mailer2.neclab.eu ([127.0.0.1])
 by localhost (atlas-b.office.hd [127.0.0.1]) (amavisd-new, port 10024)
 with ESMTP id lTl0s6ALDzLL; Wed, 16 Jun 2021 15:11:12 +0200 (CEST)
Received: from titania.office.hd (titania.office.hd [192.168.24.89])
 (using TLSv1.2 with cipher ECDHE-RSA-AES128-GCM-SHA256 (128/128 bits))
 (No client certificate requested)
 by mailer2.neclab.eu (Postfix) with ESMTPS id F3CE8F2011;
 Wed, 16 Jun 2021 15:11:07 +0200 (CEST)
Received: from [10.7.0.54] (192.168.24.96) by titania.office.hd
 (192.168.24.89) with Microsoft SMTP Server (version=TLS1_2,
 cipher=TLS_ECDHE_RSA_WITH_AES_128_GCM_SHA256) id 15.1.2242.10; Wed, 16 Jun
 2021 15:10:53 +0200
X-BeenThere: minios-devel@lists.xenproject.org
List-Id: Mini-os development list <minios-devel.lists.xenproject.org>
List-Unsubscribe: <https://lists.xenproject.org/mailman/options/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=unsubscribe>
List-Post: <mailto:minios-devel@lists.xenproject.org>
List-Help: <mailto:minios-devel-request@lists.xenproject.org?subject=help>
List-Subscribe: <https://lists.xenproject.org/mailman/listinfo/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=subscribe>
Errors-To: minios-devel-bounces@lists.xenproject.org
Precedence: list
Sender: "Minios-devel" <minios-devel-bounces@lists.xenproject.org>
X-Inumbo-ID: f2ac32e3-e1b8-439f-8812-0853c21720bd
X-Virus-Scanned: Amavisd on Debian GNU/Linux (atlas-b.office.hd)
X-ENC: Last-Hop-TLS-encrypted
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/simple; d=neclab.eu;
	s=mailer2-20210408; t=1623849072;
	bh=77v8hYp65PLeOdIsUW7bPoiWQ/0otffqtaKEhrAIwhM=;
	h=Subject:To:References:From:Date:In-Reply-To:From;
	b=JP//RVVbJM5LlQs4wqKksLNPxX4aw4B0OfbCIcBAn9Bm8WxN1Rr1IEHbFO5KcSgRQ
	 PPuk9MNM4hqNwCzI1jwSrF5ySuEXC0hYja17txSkAcGLHruJJOHsSE9u7nISc8hrFz
	 MZHkgb+pTcdy55i0S8WGMBiwmhHwVQSaUQ/idr9kVWs4VFxI7vRGmKLVzVXCDJ/WWE
	 cGEFGOp/EVWrWsrKdkrZU2bF5pgs/ZnorKylKE1ssexk6f39hfMw3AQBJ3VIjVf93G
	 0ceOvMhYfqFoiGgJ3Yz4H9Wq6ogDQI9KpM7Vj0zLdt3GxFiIo4UU4wQ/UxUsOO/8ks
	 iCC71oH4kDKhw==
X-ENC: Last-Hop-TLS-encrypted
Subject: Re: [[UNIKRAFT] 4/4] lib/ukmpi: Provide isr-safe routines
To: cristian-vijelie <cristianvijelie@gmail.com>, <minios-devel@lists.xen.org>
References: <20210128113449.22457-1-cristianvijelie@gmail.com>
 <20210128113449.22457-5-cristianvijelie@gmail.com>
From: Simon Kuenzer <simon.kuenzer@neclab.eu>
Message-ID: <a721f488-08d1-6c9e-94d2-fe61fc3ad0a4@neclab.eu>
Date: Wed, 16 Jun 2021 15:10:52 +0200
User-Agent: Mozilla/5.0 (Macintosh; Intel Mac OS X 10.15; rv:78.0)
 Gecko/20100101 Thunderbird/78.11.0
MIME-Version: 1.0
In-Reply-To: <20210128113449.22457-5-cristianvijelie@gmail.com>
Content-Type: text/plain; charset="utf-8"; format=flowed
Content-Language: en-US
Content-Transfer-Encoding: 7bit
X-Originating-IP: [192.168.24.96]
X-ClientProxiedBy: oberon.office.hd (192.168.24.90) To titania.office.hd
 (192.168.24.89)

Hey Cristian,

I miss an implementation of uk_mbox_post_try_isr() and 
uk_mbox_recv_try_isr() with this commit. Can you provide those too?
Please send a new version as GitHub PR to
  https://github.com/unikraft/unikraft

Thanks,

Simon

On 28.01.21 12:34, cristian-vijelie wrote:
> This patch provides isr-safe mbox routines, derived from ukmpi
> library.
> 
> Signed-off-by: cristian-vijelie <cristianvijelie@gmail.com>
> ---
>   lib/ukmpi/include/uk/isr/mbox.h | 8 ++++++++
>   1 file changed, 8 insertions(+)
>   create mode 100644 lib/ukmpi/include/uk/isr/mbox.h
> 
> diff --git a/lib/ukmpi/include/uk/isr/mbox.h b/lib/ukmpi/include/uk/isr/mbox.h
> new file mode 100644
> index 0000000..78e738c
> --- /dev/null
> +++ b/lib/ukmpi/include/uk/isr/mbox.h
> @@ -0,0 +1,8 @@
> +#include <uk/mbox.h>
> +
> +#if CONFIG_LIBUKMPI_MBOX
> +
> +int uk_mbox_post_try_isr(struct uk_mbox *m, void *msg);
> +int uk_mbox_recv_try_isr(struct uk_mbox *m, void **msg);
> +
> +#endif /* CONFIG_LIBUKMPI_MBOX */
> 


From minios-devel-bounces@lists.xenproject.org Wed Jun 16 15:43:56 2021
Return-path: <minios-devel-bounces@lists.xenproject.org>
Envelope-to: archives@lists.xenproject.org
Delivery-date: Wed, 16 Jun 2021 15:43:56 +0000
Received: from list by lists.xenproject.org with outflank-mailman.143453.264399 (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1ltXhr-0001Fh-4A; Wed, 16 Jun 2021 15:43:55 +0000
X-Outflank-Mailman: Message body and most headers restored to incoming version
Received: by outflank-mailman (output) from mailman id 143453.264399; Wed, 16 Jun 2021 15:43:55 +0000
Received: from localhost ([127.0.0.1] helo=lists.xenproject.org)
	by lists.xenproject.org with esmtp (Exim 4.92)
	(envelope-from <minios-devel-bounces@lists.xenproject.org>)
	id 1ltXhr-0001Fa-10; Wed, 16 Jun 2021 15:43:55 +0000
Received: by outflank-mailman (input) for mailman id 143453;
 Wed, 16 Jun 2021 15:43:53 +0000
Received: from us1-rack-iad1.inumbo.com ([172.99.69.81])
 by lists.xenproject.org with esmtp (Exim 4.92) (envelope-from
 <SRS0=aHQP=LK=gmail.com=gabi.mocanu98@srs-us1.protection.inumbo.net>)
 id 1ltXhp-0001FS-Nn
 for minios-devel@lists.xen.org; Wed, 16 Jun 2021 15:43:53 +0000
Received: from mail-qk1-x733.google.com (unknown [2607:f8b0:4864:20::733])
 by us1-rack-iad1.inumbo.com (Halon) with ESMTPS
 id 5daca0ee-0cb8-4690-ae4a-cd5600f83e8b;
 Wed, 16 Jun 2021 15:43:53 +0000 (UTC)
Received: by mail-qk1-x733.google.com with SMTP id c18so3054840qkc.11
 for <minios-devel@lists.xen.org>; Wed, 16 Jun 2021 08:43:52 -0700 (PDT)
X-BeenThere: minios-devel@lists.xenproject.org
List-Id: Mini-os development list <minios-devel.lists.xenproject.org>
List-Unsubscribe: <https://lists.xenproject.org/mailman/options/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=unsubscribe>
List-Post: <mailto:minios-devel@lists.xenproject.org>
List-Help: <mailto:minios-devel-request@lists.xenproject.org?subject=help>
List-Subscribe: <https://lists.xenproject.org/mailman/listinfo/minios-devel>, 
 <mailto:minios-devel-request@lists.xenproject.org?subject=subscribe>
Errors-To: minios-devel-bounces@lists.xenproject.org
Precedence: list
Sender: "Minios-devel" <minios-devel-bounces@lists.xenproject.org>
X-Inumbo-ID: 5daca0ee-0cb8-4690-ae4a-cd5600f83e8b
DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=gmail.com; s=20161025;
        h=mime-version:references:in-reply-to:from:date:message-id:subject:to
         :cc;
        bh=aTS+2FV/c4ccq2hLCXEoBTUWOF5wgr/1DRjHzOGIZ10=;
        b=jQbNTzIKbyfKA3me+H2KuU3Ig7OiX5LzVQwZuPqG8rgr68VZAFt7RFNvmP/bV+eZSP
         THG8H3biygoIq3wamMbPsMUhmdfPRDTaOEqLHFD+d1/YE3jZUdQLBEw7UxD1JTRbXPFq
         7nZ6fuLeEnK1YxtMtyVQDB8Adren7tcBSPwapYdpl+qT8ts4LCQr+eI2+ryYAkGBkmeE
         CV0gZjl0zyJstDVHsO9ytZgM1nFmU2XXFPXG1fTlpD5ESRur1GxE+2V2ELSid7YcnCgf
         HDFoIJb/HPyICXttNBna8Y5I6bUtZxS9uxVFZi9jpAEJkQLMMHPRGUaCXQ/r4or8oOmY
         dxiA==
X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed;
        d=1e100.net; s=20161025;
        h=x-gm-message-state:mime-version:references:in-reply-to:from:date
         :message-id:subject:to:cc;
        bh=aTS+2FV/c4ccq2hLCXEoBTUWOF5wgr/1DRjHzOGIZ10=;
        b=ncgyYQ62MWi58aA6mBTJpJf59yI/B7qr8pmeXQrJm58aen8wKCDk35jpLuExlvPGRs
         a3KOUSizIiSVGhApV5t9bx8mTzkjonu5Bi2Usb2xOjhllj6zErrn5tGzp6MZmovoihCU
         xH2ufOJD3rtW2+aCSuhq3dEgHLzLQJsdqw4Un2ULj08F+U8Is72UyQPPWAtgbHq8+3gf
         qsi4ibYgWLVG+8mhz1d43GFQy+qhGY1XtlHY1YvyvBi+o1iWBENMWGINrOVgDVbzXtAq
         5XCnEiL4XLB6uwLUV87ytvNI0vFpl2GaVjgtF88da5mvIamfJtXif8+KQ75Ud4yoL4Os
         FHuw==
X-Gm-Message-State: AOAM5303ZjcUbyKb+NNk4H7J78CPajmR0h+p4h98t9cWWWAH/UOH0YdO
	ECnh3xrw+pfoEqV6R02Tv3WajLGsv19/E2VMbNk=
X-Google-Smtp-Source: ABdhPJzOcBNoHfcMLdpgprGSvVsZTTwcl59/kdh0haNlN4eftP0ygDgQbQoVrbC4XKje2S9g5Z5mqfcIEUdTW7w7urk=
X-Received: by 2002:a37:3c2:: with SMTP id 185mr708368qkd.140.1623858232631;
 Wed, 16 Jun 2021 08:43:52 -0700 (PDT)
MIME-Version: 1.0
References: <20201001124325.11042-1-simon.kuenzer@neclab.eu> <20210430094031.58999-1-gabi.mocanu98@gmail.com>
In-Reply-To: <20210430094031.58999-1-gabi.mocanu98@gmail.com>
From: Gabriel Mocanu <gabi.mocanu98@gmail.com>
Date: Wed, 16 Jun 2021 18:43:41 +0300
Message-ID: <CAFQtcQN1DpGtrKSK3BnSW6rx6mDo4ZBvZ2PG2FMma1-HZbeU2g@mail.gmail.com>
Subject: Re: [UNIKRAFT PATCH] plat/xen: x86: Detect initrd entry from start_info
To: Simon Kuenzer <simon.kuenzer@neclab.eu>
Cc: minios-devel@lists.xen.org
Content-Type: multipart/alternative; boundary="0000000000001f257c05c4e3f597"

--0000000000001f257c05c4e3f597
Content-Type: text/plain; charset="UTF-8"

Hi,

I think I forgot to mention Reviewed-By in the previous mail.
Everything seems fine to me.

Reviewed-by: Mocanu Gabriel<gabi.mocanu98@gmail.com>

On Fri, 30 Apr 2021 at 12:40, Mocanu Gabriel <gabi.mocanu98@gmail.com>
wrote:

>
> Hi Simon,
>
> I tested and everything seems fine to me. I also inspected that memory
> area and
> everything was good.
>
> Thanks,
> Mocanu Gabriel
>

--0000000000001f257c05c4e3f597
Content-Type: text/html; charset="UTF-8"
Content-Transfer-Encoding: quoted-printable

<div dir=3D"ltr">Hi,<br><br>I think I forgot to mention Reviewed-By in the =
previous mail.<br>Everything seems fine to me.<br><br>Reviewed-by: Mocanu G=
abriel&lt;<a href=3D"mailto:gabi.mocanu98@gmail.com">gabi.mocanu98@gmail.co=
m</a>&gt;<br></div><br><div class=3D"gmail_quote"><div dir=3D"ltr" class=3D=
"gmail_attr">On Fri, 30 Apr 2021 at 12:40, Mocanu Gabriel &lt;<a href=3D"ma=
ilto:gabi.mocanu98@gmail.com">gabi.mocanu98@gmail.com</a>&gt; wrote:<br></d=
iv><blockquote class=3D"gmail_quote" style=3D"margin:0px 0px 0px 0.8ex;bord=
er-left:1px solid rgb(204,204,204);padding-left:1ex"><br>
Hi Simon,<br>
<br>
I tested and everything seems fine to me. I also inspected that memory area=
 and<br>
everything was good.<br>
<br>
Thanks,<br>
Mocanu Gabriel<br>
</blockquote></div>

--0000000000001f257c05c4e3f597--


