[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [PATCH v3 0/4] Yocto Gitlab CI


  • To: Michal Orzel <michal.orzel@xxxxxxx>
  • From: Bertrand Marquis <Bertrand.Marquis@xxxxxxx>
  • Date: Mon, 31 Oct 2022 15:00:01 +0000
  • Accept-language: en-GB, en-US
  • Arc-authentication-results: i=2; mx.microsoft.com 1; spf=pass (sender ip is 63.35.35.123) smtp.rcpttodomain=lists.xenproject.org smtp.mailfrom=arm.com; dmarc=pass (p=none sp=none pct=100) action=none header.from=arm.com; dkim=pass (signature was verified) header.d=armh.onmicrosoft.com; arc=pass (0 oda=1 ltdi=1 spf=[1,1,smtp.mailfrom=arm.com] dkim=[1,1,header.d=arm.com] dmarc=[1,1,header.from=arm.com])
  • Arc-authentication-results: i=1; mx.microsoft.com 1; spf=pass smtp.mailfrom=arm.com; dmarc=pass action=none header.from=arm.com; dkim=pass header.d=arm.com; arc=none
  • Arc-message-signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=PcIwLfFsTcCfDGttnp6HWQYe3p86ho45mqY8hci0/2k=; b=DXURZA3+h0n4DDYwzI//Ea/a8aWIjMer36cbY2JF4szV8wYCz4Tp2Ppx/CtEhxTbaHu7FIF6xxCU7mAHCyXwNBLXgAELF3+y4UW9MSxf2nlm9mubUV3zNxEMBUIBscB+V0+YS3XuWNM20mrf3XSgcCrenX7AcNgG3m9BZ9Ga69QHWj3teqoZ9gDekZnTDk2fddFwgNWMMVrBjrRg61EfxYodXRYEdIrMVgn4EI3aTY/2zEYYPgZKote1UD0i8/xgDbtnhXUG860Nhj45i1iXndX1j2NmLTgARI0GLIzmJvjixHL0fTM7Tl6ltZKGh9pZXajCaUy+OlGLJSg6IddUZA==
  • Arc-message-signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=microsoft.com; s=arcselector9901; h=From:Date:Subject:Message-ID:Content-Type:MIME-Version:X-MS-Exchange-AntiSpam-MessageData-ChunkCount:X-MS-Exchange-AntiSpam-MessageData-0:X-MS-Exchange-AntiSpam-MessageData-1; bh=PcIwLfFsTcCfDGttnp6HWQYe3p86ho45mqY8hci0/2k=; b=JO3xdXO3a/8owKK8VevqE/z3hoXo9dxaeF4YsSS2317XSLkNojnRy4BtH2r3DBk/x4tEcLU724Ch/2SMFqC9fsWIfEESX8l1JKHloTbYm+7xkKS/F/yfG34F78aYhHdTBO2jKh5rEj/cCtF9YcgfK14JkVuWtLalStWoudhpE3s+4Oj3bGEoYhH7LzO+JUFAwobSASga+Dba60/+vi3MGq2m6/RQ8fVCxGKpj0EN2+SeCck3/5fvTwb4FbVXIg/YdUsZ0CuySLu5U9WNm96y/7XX11rGcACeN3zvfFRJRJ26HwUKZ43ELYK+pJ9nM3JKD5C0FG8Q8AmL2AZce/FGng==
  • Arc-seal: i=2; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=pass; b=kba6PY6IzRvlptX5K/yv0iHY4ETQMry/mR0QInrR2jDK3oSncfiAhOXMRxrtjMIsC5vOTuRF9HKQHB23V2n4QTRgb42pqe8wKuiS0pr2ewJuNQp+QQBsAtQCwXw44RVa5liLDuipHxwxRgIMabsY9Fps39MGIDt/cIeQ4kETFNxmYT5c+gjk5SNs53p/82SKNW+9VOeJQPVmpgRr+ZqXQoKhF/4CPfOTPusqD5h2AITKHcJp9i/0hAIQ0VIdC5PzBDYYtnPTlBazhgQfECg0WERLcteYTxl9h4NoDj3A7wV5p7NZiqjCNwW84sVfi1VvAgpQm/5o+jWQBppt4AwoDw==
  • Arc-seal: i=1; a=rsa-sha256; s=arcselector9901; d=microsoft.com; cv=none; b=NLVE5KownaD7hnUFvqM9v1TrhInkLhSgHq8U6U5sXpr0qnPT4DywJMlRnvG/SIAlg+DcIHDKKAfOlBm6K+1/XFFwr9hqkBOGWIl7N0kd+2T2KNI/MEhzSIxdzvZdWkmNMlIpGSU7koYwo450gsgO3hAETHxLtH9NviLuXZtBFfn1CuJ1MwnKVSWKYKzi82skskDj7Lb6TAUuFAfqAS4v6W80eZXYIOTsUjIdvowxbRsH/I94A0uaqSqGqBJr4sk84St8iA++Ii5PKH+IWlWwdBYD5oRVMqvHR3uMq7js66saLDTXZ3Ds/dXg0JRgn9nHpk2J+cxQWngPsSIgEJwiHQ==
  • Authentication-results-original: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=arm.com;
  • Cc: "xen-devel@xxxxxxxxxxxxxxxxxxxx" <xen-devel@xxxxxxxxxxxxxxxxxxxx>, Doug Goldstein <cardoe@xxxxxxxxxx>, Stefano Stabellini <sstabellini@xxxxxxxxxx>
  • Delivery-date: Mon, 31 Oct 2022 15:00:21 +0000
  • List-id: Xen developer discussion <xen-devel.lists.xenproject.org>
  • Nodisclaimer: true
  • Original-authentication-results: dkim=none (message not signed) header.d=none;dmarc=none action=none header.from=arm.com;
  • Thread-index: AQHY7TFh2hDh7VPqHUGkPo4tUdJZza4okuGAgAAFoQA=
  • Thread-topic: [PATCH v3 0/4] Yocto Gitlab CI

Hi Michal,

> On 31 Oct 2022, at 14:39, Michal Orzel <michal.orzel@xxxxxxx> wrote:
> 
> Hi Bertrand,
> 
> On 31/10/2022 15:00, Bertrand Marquis wrote:
>> 
>> 
>> This patch series is a first attempt to check if we could use Yocto in
>> gitlab ci to build and run xen on qemu for arm, arm64 and x86.
>> 
>> The first patch is creating a container with all elements required to
>> build Yocto, a checkout of the yocto layers required and an helper
>> script to build and run xen on qemu with yocto.
>> 
>> The second patch is creating containers with a first build of yocto done
>> so that susbsequent build with those containers would only rebuild what
>> was changed and take the rest from the cache.
>> 
>> The third patch is adding a way to easily clean locally created
>> containers.
>> 
>> This is is mainly for discussion and sharing as there are still some
>> issues/problem to solve:
>> - building the qemu* containers can take several hours depending on the
>>  network bandwith and computing power of the machine where those are
>>  created
> This is not really an issue as the build of the containers occurs on the local
> machines before pushing them to registry. Also, building the containers
> will only be required for new Yocto releases.
> 
>> - produced containers containing the cache have a size between 8 and
>>  12GB depending on the architecture. We might need to store the build
>>  cache somewhere else to reduce the size. If we choose to have one
>>  single image, the needed size is around 20GB and we need up to 40GB
>>  during the build, which is why I splitted them.
>> - during the build and run, we use a bit more then 20GB of disk which is
>>  over the allowed size in gitlab
> As we could see during v2 testing, we do not have any space restrictions
> on the Xen GitLab and I think we already decided to have the Yocto
> integrated into our CI.

Right, I should have modified this chapter to be coherent with your latest 
tests.
Sorry for that.

> 
> I will do some testing and get back to you with results + review.

Thanks

Cheers
Bertrand

> 
> ~Michal




 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.