From Dave.Scott@eu.citrix.com Wed Jul 04 08:19:29 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SmJs1-0004Ig-3Z (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 04 Jul 2012 08:19:29 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -2.4 from SpamAssassin-3.3.2-1356619 * -2.3 RCVD_IN_DNSWL_MED RBL: Sender listed at http://www.dnswl.org/, * medium trust * [62.200.22.115 listed in list.dnswl.dnsbl.ja.net] * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from smtp.ctxuk.citrix.com ([62.200.22.115]:16743 helo=SMTP.EU.CITRIX.COM) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1SmJs0-0003sh-r2 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 04 Jul 2012 08:19:28 +0100 X-IronPort-AV: E=Sophos;i="4.77,520,1336348800"; d="scan'208";a="13358066" Received: from lonpmailmx02.citrite.net ([10.30.203.163]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/RC4-MD5; 04 Jul 2012 07:19:27 +0000 Received: from LONPMAILBOX01.citrite.net ([10.30.224.160]) by LONPMAILMX02.citrite.net ([10.30.203.163]) with mapi; Wed, 4 Jul 2012 08:19:27 +0100 From: Dave Scott To: "'cl-mirage@lists.cam.ac.uk'" Date: Wed, 4 Jul 2012 08:19:26 +0100 Subject: 64-bit bootloaders Thread-Topic: 64-bit bootloaders Thread-Index: Ac1ZtVgglrpKdDLVSMSTDcFDW2fklQ== Message-ID: <81A73678E76EA642801C8F2E4823AD21DAA0D8F363@LONPMAILBOX01.citrite.net> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jul 2012 07:19:29 -0000 X-Keywords: X-UID: 304 Status: O Content-Length: 304 Lines: 13 Hi, I came across this project: http://www.returninfinity.com/pure64.html It's a 64-bit OS bootloader with minimal backwards compat stuff under a BSD= license. Perhaps we could glue it onto mirage to complement the xen PV sup= port. It would be fun to write an IDE driver in ocaml :-) Cheers, Dave From anil@recoil.org Wed Jul 04 19:03:43 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SmTvT-0007Lp-Ju (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 04 Jul 2012 19:03:43 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1356619 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:39774 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1SmTvS-0000pG-ZF (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 04 Jul 2012 19:03:43 +0100 Received: (qmail 11318 invoked by uid 634); 4 Jul 2012 18:03:42 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 04 Jul 2012 19:03:41 +0100 Subject: Re: 64-bit bootloaders Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <81A73678E76EA642801C8F2E4823AD21DAA0D8F363@LONPMAILBOX01.citrite.net> Date: Wed, 4 Jul 2012 19:03:41 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <68C47CE9-A551-4661-8771-7D2F44362869@recoil.org> References: <81A73678E76EA642801C8F2E4823AD21DAA0D8F363@LONPMAILBOX01.citrite.net> To: Dave Scott X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: "'cl-mirage@lists.cam.ac.uk'" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jul 2012 18:03:43 -0000 X-Keywords: X-UID: 305 Status: O Content-Length: 1117 Lines: 36 Have you tried it? I just downloaded it via the Github repo at = https://github.com/ReturnInfinity/BareMetal-OS It appears to use NASM instead of GAS, but I'm not sure which version to = try. Compiling under Debian/wheezy/amd64 gives all sorts of interesting = compilation errors: $ nasm fat16.asm -o fat16.sys fat16.asm:170: error: impossible combination of address sizes fat16.asm:170: error: invalid effective address fat16.asm:177: error: impossible combination of address sizes fat16.asm:177: error: invalid effective address I'll take a look later, but wondering if you have a working build = environment before I dig deeper. It looks like its intended to be built = on Windows, judging from the lack of Makefiles. -anil On 4 Jul 2012, at 08:19, Dave Scott wrote: > Hi, >=20 > I came across this project: >=20 > http://www.returninfinity.com/pure64.html >=20 > It's a 64-bit OS bootloader with minimal backwards compat stuff under = a BSD license. Perhaps we could glue it onto mirage to complement the = xen PV support. It would be fun to write an IDE driver in ocaml :-) >=20 > Cheers, > Dave >=20 From Dave.Scott@eu.citrix.com Wed Jul 04 20:06:17 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SmUu1-0000IG-Ie (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 04 Jul 2012 20:06:17 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -2.4 from SpamAssassin-3.3.2-1356619 * -2.3 RCVD_IN_DNSWL_MED RBL: Sender listed at http://www.dnswl.org/, * medium trust * [62.200.22.115 listed in list.dnswl.dnsbl.ja.net] * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from smtp.ctxuk.citrix.com ([62.200.22.115]:5960 helo=SMTP.EU.CITRIX.COM) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1SmUu0-0003W9-X4 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 04 Jul 2012 20:06:17 +0100 X-IronPort-AV: E=Sophos;i="4.77,524,1336348800"; d="scan'208";a="13371771" Received: from lonpmailmx02.citrite.net ([10.30.203.163]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/RC4-MD5; 04 Jul 2012 19:05:45 +0000 Received: from LONPMAILBOX01.citrite.net ([10.30.224.160]) by LONPMAILMX02.citrite.net ([10.30.203.163]) with mapi; Wed, 4 Jul 2012 20:05:45 +0100 From: Dave Scott To: Anil Madhavapeddy Date: Wed, 4 Jul 2012 20:05:42 +0100 Subject: Re: 64-bit bootloaders Thread-Topic: 64-bit bootloaders Thread-Index: Ac1aGAOQguiyeIx4R9mjn053FQCthA== Message-ID: <6676A06B-E868-4825-8F16-00F426825129@eu.citrix.com> References: <81A73678E76EA642801C8F2E4823AD21DAA0D8F363@LONPMAILBOX01.citrite.net> <68C47CE9-A551-4661-8771-7D2F44362869@recoil.org> In-Reply-To: <68C47CE9-A551-4661-8771-7D2F44362869@recoil.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "cl-mirage@lists.cam.ac.uk" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jul 2012 19:06:17 -0000 X-Keywords: X-UID: 306 Status: O Content-Length: 1374 Lines: 44 Not yet-- you're already ahead of me! I'll maybe try an older environment s= ince you're trying wheezy. --=20 Dave Scottt On Jul 4, 2012, at 7:03 PM, "Anil Madhavapeddy" wrote: > Have you tried it? I just downloaded it via the Github repo at https://g= ithub.com/ReturnInfinity/BareMetal-OS >=20 > It appears to use NASM instead of GAS, but I'm not sure which version to = try. Compiling under Debian/wheezy/amd64 gives all sorts of interesting co= mpilation errors: >=20 > $ nasm fat16.asm -o fat16.sys > fat16.asm:170: error: impossible combination of address sizes > fat16.asm:170: error: invalid effective address > fat16.asm:177: error: impossible combination of address sizes > fat16.asm:177: error: invalid effective address >=20 > I'll take a look later, but wondering if you have a working build environ= ment before I dig deeper. It looks like its intended to be built on Window= s, judging from the lack of Makefiles. >=20 > -anil >=20 > On 4 Jul 2012, at 08:19, Dave Scott wrote: >=20 >> Hi, >>=20 >> I came across this project: >>=20 >> http://www.returninfinity.com/pure64.html >>=20 >> It's a 64-bit OS bootloader with minimal backwards compat stuff under a = BSD license. Perhaps we could glue it onto mirage to complement the xen PV = support. It would be fun to write an IDE driver in ocaml :-) >>=20 >> Cheers, >> Dave >>=20 >=20 From anil@recoil.org Wed Jul 04 20:47:20 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SmVXk-0000ak-9O (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 04 Jul 2012 20:47:20 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1356619 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:19319 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1SmVXj-0001FI-YC (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 04 Jul 2012 20:47:20 +0100 Received: (qmail 6269 invoked by uid 634); 4 Jul 2012 19:47:19 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 04 Jul 2012 20:47:19 +0100 Subject: Re: 64-bit bootloaders Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <6676A06B-E868-4825-8F16-00F426825129@eu.citrix.com> Date: Wed, 4 Jul 2012 20:47:19 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <21DB758A-8A42-422F-AEDD-F126174A6FD3@recoil.org> References: <81A73678E76EA642801C8F2E4823AD21DAA0D8F363@LONPMAILBOX01.citrite.net> <68C47CE9-A551-4661-8771-7D2F44362869@recoil.org> <6676A06B-E868-4825-8F16-00F426825129@eu.citrix.com> To: Dave Scott X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: "cl-mirage@lists.cam.ac.uk" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jul 2012 19:47:20 -0000 X-Keywords: X-UID: 307 Status: O Content-Length: 1637 Lines: 58 It works fine if you do: $ cd BareMetal-OS/os $ nasm kernel64.asm -o kernel64.sys The files are all included and not intended to be separately compiled. -anil On 4 Jul 2012, at 20:05, Dave Scott wrote: > Not yet-- you're already ahead of me! I'll maybe try an older = environment since you're trying wheezy. >=20 > --=20 > Dave Scottt >=20 > On Jul 4, 2012, at 7:03 PM, "Anil Madhavapeddy" = wrote: >=20 >> Have you tried it? I just downloaded it via the Github repo at = https://github.com/ReturnInfinity/BareMetal-OS >>=20 >> It appears to use NASM instead of GAS, but I'm not sure which version = to try. Compiling under Debian/wheezy/amd64 gives all sorts of = interesting compilation errors: >>=20 >> $ nasm fat16.asm -o fat16.sys >> fat16.asm:170: error: impossible combination of address sizes >> fat16.asm:170: error: invalid effective address >> fat16.asm:177: error: impossible combination of address sizes >> fat16.asm:177: error: invalid effective address >>=20 >> I'll take a look later, but wondering if you have a working build = environment before I dig deeper. It looks like its intended to be built = on Windows, judging from the lack of Makefiles. >>=20 >> -anil >>=20 >> On 4 Jul 2012, at 08:19, Dave Scott wrote: >>=20 >>> Hi, >>>=20 >>> I came across this project: >>>=20 >>> http://www.returninfinity.com/pure64.html >>>=20 >>> It's a 64-bit OS bootloader with minimal backwards compat stuff = under a BSD license. Perhaps we could glue it onto mirage to complement = the xen PV support. It would be fun to write an IDE driver in ocaml :-) >>>=20 >>> Cheers, >>> Dave >>>=20 >>=20 >=20 From Dave.Scott@eu.citrix.com Wed Jul 04 20:51:22 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SmVbe-0000eC-NG (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 04 Jul 2012 20:51:22 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -2.4 from SpamAssassin-3.3.2-1356619 * -2.3 RCVD_IN_DNSWL_MED RBL: Sender listed at http://www.dnswl.org/, * medium trust * [62.200.22.115 listed in list.dnswl.dnsbl.ja.net] * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from smtp.ctxuk.citrix.com ([62.200.22.115]:5461 helo=SMTP.EU.CITRIX.COM) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SmVbd-000333-SM (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 04 Jul 2012 20:51:22 +0100 X-IronPort-AV: E=Sophos;i="4.77,524,1336348800"; d="scan'208";a="13371955" Received: from lonpmailmx02.citrite.net ([10.30.203.163]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/RC4-MD5; 04 Jul 2012 19:51:11 +0000 Received: from LONPMAILBOX01.citrite.net ([10.30.224.160]) by LONPMAILMX02.citrite.net ([10.30.203.163]) with mapi; Wed, 4 Jul 2012 20:51:11 +0100 From: Dave Scott To: 'Anil Madhavapeddy' Date: Wed, 4 Jul 2012 20:51:10 +0100 Subject: RE: 64-bit bootloaders Thread-Topic: 64-bit bootloaders Thread-Index: Ac1aHdPW7yjChbs2T5WgQ/WynR85GQAABPwg Message-ID: <81A73678E76EA642801C8F2E4823AD21DAA0D8F369@LONPMAILBOX01.citrite.net> References: <81A73678E76EA642801C8F2E4823AD21DAA0D8F363@LONPMAILBOX01.citrite.net> <68C47CE9-A551-4661-8771-7D2F44362869@recoil.org> <6676A06B-E868-4825-8F16-00F426825129@eu.citrix.com> <21DB758A-8A42-422F-AEDD-F126174A6FD3@recoil.org> In-Reply-To: <21DB758A-8A42-422F-AEDD-F126174A6FD3@recoil.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "cl-mirage@lists.cam.ac.uk" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jul 2012 19:51:22 -0000 X-Keywords: X-UID: 308 Status: O Content-Length: 2240 Lines: 85 Ah yeah that worked for me once I upgraded my nasm :) I made a 128MiB disk with a single partition and tried to format it with mt= ools using $ mformat -B boot16.bin -f 1440 a: (after editing my /etc/mtools.conf) And then $ mcopy kernel64.sys a: ... And then the boot hangs under xen -- do you have something like virtualbox = handy? Cheers, Dave > -----Original Message----- > From: Anil Madhavapeddy [mailto:anil@recoil.org] > Sent: 04 July 2012 20:47 > To: Dave Scott > Cc: cl-mirage@lists.cam.ac.uk > Subject: Re: 64-bit bootloaders >=20 > It works fine if you do: >=20 > $ cd BareMetal-OS/os > $ nasm kernel64.asm -o kernel64.sys >=20 > The files are all included and not intended to be separately compiled. >=20 > -anil >=20 > On 4 Jul 2012, at 20:05, Dave Scott wrote: >=20 > > Not yet-- you're already ahead of me! I'll maybe try an older > environment since you're trying wheezy. > > > > -- > > Dave Scottt > > > > On Jul 4, 2012, at 7:03 PM, "Anil Madhavapeddy" > wrote: > > > >> Have you tried it? I just downloaded it via the Github repo at > https://github.com/ReturnInfinity/BareMetal-OS > >> > >> It appears to use NASM instead of GAS, but I'm not sure which > version to try. Compiling under Debian/wheezy/amd64 gives all sorts of > interesting compilation errors: > >> > >> $ nasm fat16.asm -o fat16.sys > >> fat16.asm:170: error: impossible combination of address sizes > >> fat16.asm:170: error: invalid effective address > >> fat16.asm:177: error: impossible combination of address sizes > >> fat16.asm:177: error: invalid effective address > >> > >> I'll take a look later, but wondering if you have a working build > environment before I dig deeper. It looks like its intended to be > built on Windows, judging from the lack of Makefiles. > >> > >> -anil > >> > >> On 4 Jul 2012, at 08:19, Dave Scott wrote: > >> > >>> Hi, > >>> > >>> I came across this project: > >>> > >>> http://www.returninfinity.com/pure64.html > >>> > >>> It's a 64-bit OS bootloader with minimal backwards compat stuff > under a BSD license. Perhaps we could glue it onto mirage to complement > the xen PV support. It would be fun to write an IDE driver in ocaml :-) > >>> > >>> Cheers, > >>> Dave > >>> > >> > > From anil@recoil.org Wed Jul 04 20:57:31 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SmVhb-0000jp-L6 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 04 Jul 2012 20:57:31 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1356619 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:42041 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1SmVha-0004MQ-Yj (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 04 Jul 2012 20:57:31 +0100 Received: (qmail 24548 invoked by uid 634); 4 Jul 2012 19:57:30 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 04 Jul 2012 20:57:29 +0100 Subject: Re: 64-bit bootloaders Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <81A73678E76EA642801C8F2E4823AD21DAA0D8F369@LONPMAILBOX01.citrite.net> Date: Wed, 4 Jul 2012 20:57:29 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <81A73678E76EA642801C8F2E4823AD21DAA0D8F363@LONPMAILBOX01.citrite.net> <68C47CE9-A551-4661-8771-7D2F44362869@recoil.org> <6676A06B-E868-4825-8F16-00F426825129@eu.citrix.com> <21DB758A-8A42-422F-AEDD-F126174A6FD3@recoil.org> <81A73678E76EA642801C8F2E4823AD21DAA0D8F369@LONPMAILBOX01.citrite.net> To: Dave Scott X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: "cl-mirage@lists.cam.ac.uk" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jul 2012 19:57:31 -0000 X-Keywords: X-UID: 309 Status: O Content-Length: 3014 Lines: 111 It's supposed to hang; I think you just booted a bare kernel with no = actual application. See the programs/ directory for apps. = http://www.returninfinity.com/docs/BareMetal%20OS%20-%20Application%20Exam= ples.html That should output to the serial console. My Xen machine seems to be = down due to some recent flooding in our machine room, so I'll have to = try it tomorrow from the Lab. It actually looks pretty straightforward to bootstrap hypercalls from = this (just writing to the special MSR to get the hypercall page), and = then be in our normal OS.Xen module... -anil On 4 Jul 2012, at 20:51, Dave Scott wrote: > Ah yeah that worked for me once I upgraded my nasm :) >=20 > I made a 128MiB disk with a single partition and tried to format it = with mtools using >=20 > $ mformat -B boot16.bin -f 1440 a: > (after editing my /etc/mtools.conf) >=20 > And then >=20 > $ mcopy kernel64.sys a: >=20 > ... >=20 > And then the boot hangs under xen -- do you have something like = virtualbox handy? >=20 >=20 > Cheers, > Dave >> -----Original Message----- >> From: Anil Madhavapeddy [mailto:anil@recoil.org] >> Sent: 04 July 2012 20:47 >> To: Dave Scott >> Cc: cl-mirage@lists.cam.ac.uk >> Subject: Re: 64-bit bootloaders >>=20 >> It works fine if you do: >>=20 >> $ cd BareMetal-OS/os >> $ nasm kernel64.asm -o kernel64.sys >>=20 >> The files are all included and not intended to be separately = compiled. >>=20 >> -anil >>=20 >> On 4 Jul 2012, at 20:05, Dave Scott wrote: >>=20 >>> Not yet-- you're already ahead of me! I'll maybe try an older >> environment since you're trying wheezy. >>>=20 >>> -- >>> Dave Scottt >>>=20 >>> On Jul 4, 2012, at 7:03 PM, "Anil Madhavapeddy" >> wrote: >>>=20 >>>> Have you tried it? I just downloaded it via the Github repo at >> https://github.com/ReturnInfinity/BareMetal-OS >>>>=20 >>>> It appears to use NASM instead of GAS, but I'm not sure which >> version to try. Compiling under Debian/wheezy/amd64 gives all sorts = of >> interesting compilation errors: >>>>=20 >>>> $ nasm fat16.asm -o fat16.sys >>>> fat16.asm:170: error: impossible combination of address sizes >>>> fat16.asm:170: error: invalid effective address >>>> fat16.asm:177: error: impossible combination of address sizes >>>> fat16.asm:177: error: invalid effective address >>>>=20 >>>> I'll take a look later, but wondering if you have a working build >> environment before I dig deeper. It looks like its intended to be >> built on Windows, judging from the lack of Makefiles. >>>>=20 >>>> -anil >>>>=20 >>>> On 4 Jul 2012, at 08:19, Dave Scott wrote: >>>>=20 >>>>> Hi, >>>>>=20 >>>>> I came across this project: >>>>>=20 >>>>> http://www.returninfinity.com/pure64.html >>>>>=20 >>>>> It's a 64-bit OS bootloader with minimal backwards compat stuff >> under a BSD license. Perhaps we could glue it onto mirage to = complement >> the xen PV support. It would be fun to write an IDE driver in ocaml = :-) >>>>>=20 >>>>> Cheers, >>>>> Dave >>>>>=20 >>>>=20 >>>=20 >=20 >=20 From anil@recoil.org Wed Jul 04 23:00:59 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SmXd5-0001s1-N7 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 04 Jul 2012 23:00:59 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1356619 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:9144 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1SmXd4-00046P-YH (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 04 Jul 2012 23:00:59 +0100 Received: (qmail 7357 invoked by uid 634); 4 Jul 2012 22:00:58 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 04 Jul 2012 23:00:57 +0100 Subject: Re: ocaml-dns. done. Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Wed, 4 Jul 2012 23:00:58 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <75606A3C-36AE-4166-A1A1-84FC892DD73D@recoil.org> References: To: Richard Mortier X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 04 Jul 2012 22:00:59 -0000 X-Keywords: X-UID: 310 Status: O Content-Length: 2369 Lines: 64 Superb; I've done a merge of all your repositories, and forked = appropriately working versions to http://github.com/mirage/ $ cd ocaml-dns $ ./_build/client/odig.native recoil.org INFO: query: dead Query:0 a:c:r:rn 0 > = INFO: response:dead Response:0 na:c:r:ra 0 > = [A (89.16.177.154)]> sa:8.8.8.8/53 recoil.org -> 89.16.177.154 Yay, and it's all building away through the OPAM package manager = automatically now, including the website. Thanks for all your help with = testing out the instructions I sent earlier in the week --- Thomas is = making one last bugfix to OPAM to let us pin packages, and it should be = good for general use. So tomorrow I should have the website swapped over to the new world = order once I update the wiki pages and instructions... -anil On 28 Jun 2012, at 00:35, Richard Mortier wrote: > i *think* i've now completed the port of ocaml-dns to use cstruct = rather than bitstring. it appears to return correct results for all = supported RRs, and to apply label compression correctly.=20 >=20 > i'll try and run some perf tests tomorrow (modulo horizon research = conference) or friday, but if anyone else wants to give it a go before = then, it's in the use-cstruct branch at = >=20 > once it's perf tested (and probably bug fixed...) i guess the next = step is to merge with master, and then do anything necessary to get it = going with v3-mirage... >=20 > --=20 > Cheers, >=20 > R. >=20 >=20 >=20 >=20 > This message and any attachment are intended solely for the addressee = and may contain confidential information. If you have received this = message in error, please send it back to me, and immediately delete it. = Please do not use, copy or disclose the information contained in this = message or in any attachment. Any views or opinions expressed by the = author of this email do not necessarily reflect the views of the = University of Nottingham. >=20 > This message has been checked for viruses but the contents of an = attachment > may still contain software viruses which could damage your computer = system: > you are advised to perform your own checks. Email communications with = the > University of Nottingham may be monitored as permitted by UK = legislation. From Richard.Mortier@nottingham.ac.uk Thu Jul 05 08:31:54 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SmgXa-0000jU-Mj (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 05 Jul 2012 08:31:54 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1357175 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:53030 helo=thb-mta-19.emailfiltering.com) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1SmgXU-0006T8-rj (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 05 Jul 2012 08:31:54 +0100 Received: from smtp4.nottingham.ac.uk ([128.243.220.65]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2488091038 ;b1e93d8cc87f9d7c; Thu, 05 Jul 2012 08:31:28 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp4.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1SmgXA-0006Vo-BA for cl-mirage@lists.cam.ac.uk; Thu, 05 Jul 2012 08:31:28 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Thu, 5 Jul 2012 08:31:12 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Thu, 5 Jul 2012 08:31:13 +0100 Subject: Re: ocaml-dns. done. Thread-Topic: ocaml-dns. done. Thread-Index: Ac1agCcptf62vTefSsuyqUqol7kVew== Message-ID: References: <75606A3C-36AE-4166-A1A1-84FC892DD73D@recoil.org> In-Reply-To: <75606A3C-36AE-4166-A1A1-84FC892DD73D@recoil.org> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jul 2012 07:31:54 -0000 X-Keywords: X-UID: 311 Status: O Content-Length: 1617 Lines: 42 On 4 Jul 2012, at 23:00, Anil Madhavapeddy wrote: > Superb; I've done a merge of all your repositories, and forked appropriat= ely working versions to http://github.com/mirage/ cool; i'll mark mine as deprecated then. > Yay, and it's all building away through the OPAM package manager automati= cally now, including the website. Thanks for all your help with testing out= the instructions I sent earlier in the week --- Thomas is making one last = bugfix to OPAM to let us pin packages, and it should be good for general us= e. >=20 > So tomorrow I should have the website swapped over to the new world order= once I update the wiki pages and instructions... sweet- ping me when opam is good to go, and i'll do an end-to-end test :) (travelling today though, so maybe not until this evening.) --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From Dave.Scott@eu.citrix.com Thu Jul 05 22:08:19 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SmtHf-00033t-O6 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 05 Jul 2012 22:08:19 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -2.4 from SpamAssassin-3.3.2-1357175 * -2.3 RCVD_IN_DNSWL_MED RBL: Sender listed at http://www.dnswl.org/, * medium trust * [62.200.22.115 listed in list.dnswl.dnsbl.ja.net] * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from smtp.ctxuk.citrix.com ([62.200.22.115]:57653 helo=SMTP.EU.CITRIX.COM) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SmtHe-0004rr-Rp (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 05 Jul 2012 22:08:19 +0100 X-IronPort-AV: E=Sophos;i="4.77,532,1336348800"; d="scan'208";a="13392338" Received: from lonpmailmx02.citrite.net ([10.30.203.163]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/RC4-MD5; 05 Jul 2012 21:08:00 +0000 Received: from LONPMAILBOX01.citrite.net ([10.30.224.160]) by LONPMAILMX02.citrite.net ([10.30.203.163]) with mapi; Thu, 5 Jul 2012 22:08:00 +0100 From: Dave Scott To: 'Anil Madhavapeddy' Date: Thu, 5 Jul 2012 22:07:59 +0100 Subject: RE: 64-bit bootloaders Thread-Topic: 64-bit bootloaders Thread-Index: Ac1aHz8faXzB/igsR8ylvdEOfR7+SwA0f68w Message-ID: <81A73678E76EA642801C8F2E4823AD21DAA0D8F372@LONPMAILBOX01.citrite.net> References: <81A73678E76EA642801C8F2E4823AD21DAA0D8F363@LONPMAILBOX01.citrite.net> <68C47CE9-A551-4661-8771-7D2F44362869@recoil.org> <6676A06B-E868-4825-8F16-00F426825129@eu.citrix.com> <21DB758A-8A42-422F-AEDD-F126174A6FD3@recoil.org> <81A73678E76EA642801C8F2E4823AD21DAA0D8F369@LONPMAILBOX01.citrite.net> In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "cl-mirage@lists.cam.ac.uk" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jul 2012 21:08:19 -0000 X-Keywords: X-UID: 312 Status: O Content-Length: 3922 Lines: 134 Hi, I downloaded the pre-prepared disk image and this worked just fine. I think= my misunderstanding was that boot16b.bin (bootsector on bootable partition= ) loads pure64.sys from the FAT16 fs and then this reads pure64.cfg which t= ells it to load kernel64.sys, switch to 64-bit and jump. Anyway, the easy way to hack on this is just to replace kernel64.sys on the= pre-prepared disk and reboot. I replaced it with the (obviously inappropri= ate) .text section of a PV kernel and it GP faulted somewhere, helpfully du= mping register contents. Now I've just got to learn some asm :-) Cheers, Dave > -----Original Message----- > From: Anil Madhavapeddy [mailto:anil@recoil.org] > Sent: 04 July 2012 20:57 > To: Dave Scott > Cc: cl-mirage@lists.cam.ac.uk > Subject: Re: 64-bit bootloaders >=20 > It's supposed to hang; I think you just booted a bare kernel with no > actual application. >=20 > See the programs/ directory for apps. > http://www.returninfinity.com/docs/BareMetal%20OS%20- > %20Application%20Examples.html >=20 > That should output to the serial console. My Xen machine seems to be > down due to some recent flooding in our machine room, so I'll have to > try it tomorrow from the Lab. >=20 > It actually looks pretty straightforward to bootstrap hypercalls from > this (just writing to the special MSR to get the hypercall page), and > then be in our normal OS.Xen module... >=20 > -anil >=20 > On 4 Jul 2012, at 20:51, Dave Scott wrote: >=20 > > Ah yeah that worked for me once I upgraded my nasm :) > > > > I made a 128MiB disk with a single partition and tried to format it > with mtools using > > > > $ mformat -B boot16.bin -f 1440 a: > > (after editing my /etc/mtools.conf) > > > > And then > > > > $ mcopy kernel64.sys a: > > > > ... > > > > And then the boot hangs under xen -- do you have something like > virtualbox handy? > > > > > > Cheers, > > Dave > >> -----Original Message----- > >> From: Anil Madhavapeddy [mailto:anil@recoil.org] > >> Sent: 04 July 2012 20:47 > >> To: Dave Scott > >> Cc: cl-mirage@lists.cam.ac.uk > >> Subject: Re: 64-bit bootloaders > >> > >> It works fine if you do: > >> > >> $ cd BareMetal-OS/os > >> $ nasm kernel64.asm -o kernel64.sys > >> > >> The files are all included and not intended to be separately > compiled. > >> > >> -anil > >> > >> On 4 Jul 2012, at 20:05, Dave Scott wrote: > >> > >>> Not yet-- you're already ahead of me! I'll maybe try an older > >> environment since you're trying wheezy. > >>> > >>> -- > >>> Dave Scottt > >>> > >>> On Jul 4, 2012, at 7:03 PM, "Anil Madhavapeddy" > >> wrote: > >>> > >>>> Have you tried it? I just downloaded it via the Github repo at > >> https://github.com/ReturnInfinity/BareMetal-OS > >>>> > >>>> It appears to use NASM instead of GAS, but I'm not sure which > >> version to try. Compiling under Debian/wheezy/amd64 gives all sorts > of > >> interesting compilation errors: > >>>> > >>>> $ nasm fat16.asm -o fat16.sys > >>>> fat16.asm:170: error: impossible combination of address sizes > >>>> fat16.asm:170: error: invalid effective address > >>>> fat16.asm:177: error: impossible combination of address sizes > >>>> fat16.asm:177: error: invalid effective address > >>>> > >>>> I'll take a look later, but wondering if you have a working build > >> environment before I dig deeper. It looks like its intended to be > >> built on Windows, judging from the lack of Makefiles. > >>>> > >>>> -anil > >>>> > >>>> On 4 Jul 2012, at 08:19, Dave Scott wrote: > >>>> > >>>>> Hi, > >>>>> > >>>>> I came across this project: > >>>>> > >>>>> http://www.returninfinity.com/pure64.html > >>>>> > >>>>> It's a 64-bit OS bootloader with minimal backwards compat stuff > >> under a BSD license. Perhaps we could glue it onto mirage to > complement > >> the xen PV support. It would be fun to write an IDE driver in > ocaml :-) > >>>>> > >>>>> Cheers, > >>>>> Dave > >>>>> > >>>> > >>> > > > > From pgj@caesar.elte.hu Thu Jul 05 23:11:51 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SmuH9-0003Ww-Ds (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 05 Jul 2012 23:11:51 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1357175 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [157.181.151.9 listed in list.dnswl.dnsbl.ja.net] * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mx2.mail.elte.hu ([157.181.151.9]:47262) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1SmuH8-0007vs-YG (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 05 Jul 2012 23:11:51 +0100 Received: from login01.caesar.elte.hu ([157.181.151.130]) by mx2.mail.elte.hu with esmtp (Exim) id 1SmuH6-0002As-2i from for ; Fri, 06 Jul 2012 00:11:49 +0200 Received: (Authenticated sender: pgj) by login01.caesar.elte.hu with local (Exim 4.72) (envelope-from ) id 1SmuH5-0001RO-QV for cl-mirage@lists.cam.ac.uk; Fri, 06 Jul 2012 00:11:47 +0200 Date: Fri, 6 Jul 2012 00:11:47 +0200 From: PALI Gabor Janos To: cl-mirage@lists.cam.ac.uk Subject: Porting Mirage to FreeBSD Message-ID: <20120705221147.GA31658@caesar.elte.hu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.20 (2009-06-14) Sender: Pali Gabor Janos X-ELTE-SpamScore: -2.0 X-ELTE-SpamLevel: X-ELTE-SpamCheck: no X-ELTE-SpamVersion: ELTE 2.0 X-ELTE-SpamCheck-Details: score=-2.0 required=5.9 tests=BAYES_00 autolearn=no SpamAssassin version=3.3.1 -2.0 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 05 Jul 2012 22:11:51 -0000 X-Keywords: X-UID: 313 Status: O Content-Length: 1126 Lines: 26 Hi there, My name is Gabor Pali and I have just arrived to Cambridge to spend the upcoming months on bringing Mirage and FreeBSD a little bit closer to each other. So you may expect some questions from me during this time :-) I am an assistant lecturer at Eotvos Lorand University, Department of Programming Languages and Compilers, Faculty of Informatics of Budapest, Hungary, and I am about to complete my doctorate studies (hopefully this year). I do research and teach functional programming, mainly Haskell, but I have some experience in F# as well -- my doctorate research is about developing operating systems in functional programming languages, which is quite a good match for Mirage, I think. I have been also contributing to the FreeBSD Project for a long time, where I maintain the FreeBSD port of the Glasgow Haskell Compiler together with hundreds of Haskell Cabal packages, but I am interested in systems programming and have worked as a game engine programmer before. I really appreciate the opportunity of joining you, and I am hoping to make Mirage work inside the FreeBSD kernel soon. Cheers, Gabor From avsm@dark.recoil.org Fri Jul 06 11:51:38 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sn68Q-0003jD-Al (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 11:51:38 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1357494 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:31293 helo=dark.recoil.org) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with smtp id 1Sn68M-0007Vd-r6 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 11:51:38 +0100 Received: (qmail 21749 invoked by uid 10000); 6 Jul 2012 10:51:34 -0000 Date: Fri, 6 Jul 2012 11:51:34 +0100 From: Anil Madhavapeddy To: PALI Gabor Janos Subject: Re: Porting Mirage to FreeBSD Message-ID: <20120706105133.GA14575@dark.recoil.org> References: <20120705221147.GA31658@caesar.elte.hu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20120705221147.GA31658@caesar.elte.hu> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Jul 2012 10:51:38 -0000 X-Keywords: X-UID: 314 Status: O Content-Length: 4033 Lines: 88 Welcome to Cambridge, Gabor! Robert Watson, Balraj Singh, Gabor and I had an initial meeting yesterday to chat about FreeBSD/Mirage integration. The big problem any clean-slate effort such as Mirage faces is how to evaluate it against existing solutions. So far, we've been doing rather coarse analysis of a Xen microkernel appliance versus a virtual guest that is running an equivalent userspace application such as BIND or lighttpd. What Gabor is now going to look at is to port the Mirage platform library to be compatible with the FreeBSD kernel interface, so that we can swap (and eventually, run in parallel) the OCaml network stack alongside the industrial-strength FreeBSD stack. This will let us evaluate the application/kernel/hypervisor divide in a significantly more fine-grained fashion. For example, you could imagine hosting the Mirage website directly as a kernel module running on native FreeBSD, or writing a "socket server" to serve up POSIX system calls via the Mirage network stack, and hence do interoperability testing using existing, (mostly) well-understood userspace applications. There are a few steps to getting this going: 1) Firstly, we want to simply get a cut-down OCaml runtime printing to the serial console. This should be fairly mechanical: the asmrun/ directory in the distribution needs to compile against FreeBSD libkern. The output of an OCaml application can be obtained as an object file very easily: $ echo 'let _ = Printf.printf "hello freebsd world\n"' > foo.ml $ ocamlopt -output-obj -o foo.o foo.ml $ nm foo.o Most of the symbols are present in the runtime from asmrun/, and some are debugger stubs and so forth. 2) Second stage will be to add Io_page bindings. These are OCaml byte-buffers that are reference counted and guaranteed to be page-aligned (or rather, suitable for I/O transmission). They should be a very close match to the mbuf API, and permit zero-copy manipulation of pages within the kernel. 3) Next, we need to figure out the best way to activate the event system as a kernel module --- Mirage could run as a kernel thread, protected by a lock against multiple CPUs, or be woken up via a dispatch thread. Either one has different latency/throughput tradeoffs, and it'll be interesting to investigate this on a variety of machines. 4) Finally, the syscall server will actually expose a user-space API from Mirage. This will probably be something of a stretch goal, but we should be able to get basic, non-restartable system calls up and running. This will also probably involve quite a bit of improvement of the TCP stack, which Balraj and I can help with. If anyone has any comments, feel free to pipe up on the list! -anil On Fri, Jul 06, 2012 at 12:11:47AM +0200, PALI Gabor Janos wrote: > Hi there, > > My name is Gabor Pali and I have just arrived to Cambridge to spend the > upcoming months on bringing Mirage and FreeBSD a little bit closer to > each other. So you may expect some questions from me during this time > :-) > > I am an assistant lecturer at Eotvos Lorand University, Department of > Programming Languages and Compilers, Faculty of Informatics of Budapest, > Hungary, and I am about to complete my doctorate studies (hopefully this > year). I do research and teach functional programming, mainly Haskell, > but I have some experience in F# as well -- my doctorate research is > about developing operating systems in functional programming languages, > which is quite a good match for Mirage, I think. > > I have been also contributing to the FreeBSD Project for a long time, > where I maintain the FreeBSD port of the Glasgow Haskell Compiler > together with hundreds of Haskell Cabal packages, but I am interested in > systems programming and have worked as a game engine programmer before. > > I really appreciate the opportunity of joining you, and I am hoping to > make Mirage work inside the FreeBSD kernel soon. > > Cheers, > Gabor > -- Anil Madhavapeddy http://anil.recoil.org From avsm@dark.recoil.org Fri Jul 06 11:55:54 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sn6CY-0003oP-Nj (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 11:55:54 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1357494 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:21550 helo=dark.recoil.org) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with smtp id 1Sn6CX-0003RV-sd (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 11:55:54 +0100 Received: (qmail 7134 invoked by uid 10000); 6 Jul 2012 10:55:53 -0000 Date: Fri, 6 Jul 2012 11:55:53 +0100 From: 'Anil Madhavapeddy' To: Dave Scott Subject: Re: 64-bit bootloaders Message-ID: <20120706105553.GB14575@dark.recoil.org> References: <81A73678E76EA642801C8F2E4823AD21DAA0D8F363@LONPMAILBOX01.citrite.net> <68C47CE9-A551-4661-8771-7D2F44362869@recoil.org> <6676A06B-E868-4825-8F16-00F426825129@eu.citrix.com> <21DB758A-8A42-422F-AEDD-F126174A6FD3@recoil.org> <81A73678E76EA642801C8F2E4823AD21DAA0D8F369@LONPMAILBOX01.citrite.net> <81A73678E76EA642801C8F2E4823AD21DAA0D8F372@LONPMAILBOX01.citrite.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <81A73678E76EA642801C8F2E4823AD21DAA0D8F372@LONPMAILBOX01.citrite.net> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: "cl-mirage@lists.cam.ac.uk" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Jul 2012 10:55:54 -0000 X-Keywords: X-UID: 315 Status: O Content-Length: 958 Lines: 25 On Thu, Jul 05, 2012 at 10:07:59PM +0100, Dave Scott wrote: > Hi, > > I downloaded the pre-prepared disk image and this worked just fine. I > think my misunderstanding was that boot16b.bin (bootsector on bootable > partition) loads pure64.sys from the FAT16 fs and then this reads > pure64.cfg which tells it to load kernel64.sys, switch to 64-bit and > jump. I didn't quite manage to parse this sentence. Is the above the correct state of affairs, or the result of your misunderstanding? :-) > Anyway, the easy way to hack on this is just to replace kernel64.sys on > the pre-prepared disk and reboot. I replaced it with the (obviously > inappropriate) .text section of a PV kernel and it GP faulted somewhere, > helpfully dumping register contents. > > Now I've just got to learn some asm :-) Hopefully, you shouldn't need to I think? The distribution seems to have a working newlib, which is definitely enough to get libasmrun compiling... -anil From Richard.Mortier@nottingham.ac.uk Fri Jul 06 12:00:08 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sn6Ge-0003xv-Jz (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 12:00:08 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1357494 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:59646 helo=thb-mta-19.emailfiltering.com) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1Sn6GY-0007GJ-so (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 12:00:08 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2489676138 ;498f0d763e1112f2; Fri, 06 Jul 2012 11:59:42 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sn6GE-0005A4-LT for cl-mirage@lists.cam.ac.uk; Fri, 06 Jul 2012 11:59:42 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Fri, 6 Jul 2012 11:59:23 +0100 From: Richard Mortier To: PALI Gabor Janos , Anil Madhavapeddy Date: Fri, 6 Jul 2012 11:59:23 +0100 Subject: Re: Porting Mirage to FreeBSD Thread-Topic: Porting Mirage to FreeBSD Thread-Index: Ac1bZmb/yeNUJcwvQJe51AGi+EUlhw== Message-ID: References: <20120705221147.GA31658@caesar.elte.hu> <20120706105133.GA14575@dark.recoil.org> In-Reply-To: <20120706105133.GA14575@dark.recoil.org> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Jul 2012 11:00:08 -0000 X-Keywords: X-UID: 316 Status: O Content-Length: 1518 Lines: 41 welcome gabor! On 6 Jul 2012, at 11:51, Anil Madhavapeddy wrote: [snip cool stuff] > 2) Second stage will be to add Io_page bindings. These are OCaml > byte-buffers that are reference counted and guaranteed to be page-aligned > (or rather, suitable for I/O transmission). They should be a very close > match to the mbuf API, and permit zero-copy manipulation of pages within > the kernel. naive question, not being very familiar with either netmap or bad - how muc= h more after this would getting netmap integration entail? (noting that the latest news item on the netmap home page is "20120608 new = source code for Linux and FreeBSD including support for the VALE Virtual Lo= cal Ethernet".) --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From avsm2@cl.cam.ac.uk Fri Jul 06 12:03:29 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sn6Jt-00042M-AX (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 12:03:29 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1357494 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:7208 helo=dark.recoil.org) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with smtp id 1Sn6Js-0002cq-sO (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 12:03:29 +0100 Received: (qmail 6441 invoked by uid 634); 6 Jul 2012 11:03:28 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from host81-149-102-120.in-addr.btopenworld.com (HELO [192.168.0.28]) (81.149.102.120) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Fri, 06 Jul 2012 12:03:28 +0100 Subject: Re: Porting Mirage to FreeBSD Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Fri, 6 Jul 2012 12:03:26 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <957782F6-798A-44D2-B3A8-C20FDA6905AB@cl.cam.ac.uk> References: <20120705221147.GA31658@caesar.elte.hu> <20120706105133.GA14575@dark.recoil.org> To: Richard Mortier X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: PALI Gabor Janos , "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Jul 2012 11:03:29 -0000 X-Keywords: X-UID: 317 Status: O Content-Length: 949 Lines: 31 On 6 Jul 2012, at 11:59, Richard Mortier wrote: > welcome gabor! >=20 > On 6 Jul 2012, at 11:51, Anil Madhavapeddy wrote: >=20 > [snip cool stuff] >=20 >> 2) Second stage will be to add Io_page bindings. These are OCaml >> byte-buffers that are reference counted and guaranteed to be = page-aligned >> (or rather, suitable for I/O transmission). They should be a very = close >> match to the mbuf API, and permit zero-copy manipulation of pages = within >> the kernel. >=20 >=20 > naive question, not being very familiar with either netmap or bad - = how much more after this would getting netmap integration entail? >=20 > (noting that the latest news item on the netmap home page is "20120608 = new source code for Linux and FreeBSD including support for the VALE = Virtual Local Ethernet".) Excellent question; it may be worth benchmarking lwIP/Netmap and = Mirage/Netmap too to get a feel for the CPU/latency/throughput differences. -anil= From Richard.Mortier@nottingham.ac.uk Fri Jul 06 14:25:09 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sn8Wz-0006wC-Ai (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 14:25:09 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1357494 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ixe-mta-19-tx.emailfiltering.com ([194.116.198.150]:57320 helo=ixe-mta-19.emailfiltering.com) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1Sn8Wt-0005bJ-ZN (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 14:25:09 +0100 Received: from smtp4.nottingham.ac.uk ([128.243.220.65]) by ixe-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2306719512 ;5ca0ae0e090ae655; Fri, 06 Jul 2012 14:24:43 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp4.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sn8WZ-0007VO-L7 for cl-mirage@lists.cam.ac.uk; Fri, 06 Jul 2012 14:24:43 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Fri, 6 Jul 2012 14:24:43 +0100 From: Richard Mortier To: "cl-mirage@lists.cam.ac.uk Mailing List" Date: Fri, 6 Jul 2012 14:24:42 +0100 Subject: opam Thread-Topic: opam Thread-Index: Ac1berRBxOEg1H+mRgOg2EOm9CKkyA== Message-ID: Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Jul 2012 13:25:09 -0000 X-Keywords: X-UID: 318 Status: O Content-Length: 1074 Lines: 29 hi all; just tidying up and upgrading my homebrew packages and have toasted my obje= ctive-caml install in anticipation of the Wonder That Is OPAM :) so- what's the state of opam currently? where are the latest install instr= uctions for opam+mirage? =20 --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From thomas.gazagnaire@gmail.com Fri Jul 06 14:32:54 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sn8eU-00076f-1j (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 14:32:54 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score 0.2 from SpamAssassin-3.3.2-1357494 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.213.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (thomas.gazagnaire[at]gmail.com) * 0.0 DKIM_ADSP_CUSTOM_MED No valid author signature, adsp_override is * CUSTOM_MED * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid * 0.9 NML_ADSP_CUSTOM_MED ADSP custom_med hit, and not from a mailing * list X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-yx0-f179.google.com ([209.85.213.179]:41127) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1Sn8eS-0003V9-YN (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 14:32:53 +0100 Received: by yenr13 with SMTP id r13so8315594yen.38 for ; Fri, 06 Jul 2012 06:32:52 -0700 (PDT) Received: by 10.236.73.136 with SMTP id v8mr34839992yhd.103.1341581571968; Fri, 06 Jul 2012 06:32:51 -0700 (PDT) Received: from [192.168.20.11] ([62.200.22.135]) by mx.google.com with ESMTPS id z9sm47525307yhl.6.2012.07.06.06.32.49 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 06 Jul 2012 06:32:51 -0700 (PDT) Subject: Re: opam Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: Thomas Gazagnaire In-Reply-To: Date: Fri, 6 Jul 2012 15:32:46 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <39BE32DF-F86F-426A-8E12-42F7AB43531E@gmail.com> References: To: Richard Mortier X-Mailer: Apple Mail (2.1084) Cc: "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Jul 2012 13:32:54 -0000 X-Keywords: X-UID: 319 Status: O Content-Length: 361 Lines: 14 > so- what's the state of opam currently? where are the latest install = instructions for opam+mirage? =20 I've released 0.2 yesterday (I guess it is not packaged in homebrew yet = :-), so you could be able to run: $ opam init # much quicker than before $ opam remote -add dev git://github.com/mirage/opam-repo-dev.git $ opam install mirage-www -- Thomas From Richard.Mortier@nottingham.ac.uk Fri Jul 06 14:36:00 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sn8hU-0007KZ-1V (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 14:36:00 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1357494 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:58135 helo=thb-mta-19.emailfiltering.com) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1Sn8hN-0005Kd-sc (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 14:35:59 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2489866366 ;476488e43d1edea6; Fri, 06 Jul 2012 14:35:33 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sn8h3-00025N-Lw for cl-mirage@lists.cam.ac.uk; Fri, 06 Jul 2012 14:35:33 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Fri, 6 Jul 2012 14:35:33 +0100 From: Richard Mortier To: Thomas Gazagnaire Date: Fri, 6 Jul 2012 14:35:32 +0100 Subject: Re: opam Thread-Topic: opam Thread-Index: Ac1bfDd+FcFL92suQd6A/ZN7m9wMAA== Message-ID: References: <39BE32DF-F86F-426A-8E12-42F7AB43531E@gmail.com> In-Reply-To: <39BE32DF-F86F-426A-8E12-42F7AB43531E@gmail.com> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Jul 2012 13:36:00 -0000 X-Keywords: X-UID: 320 Status: O Content-Length: 1353 Lines: 39 On 6 Jul 2012, at 14:32, Thomas Gazagnaire wrote: >> so- what's the state of opam currently? where are the latest install in= structions for opam+mirage? =20 >=20 > I've released 0.2 yesterday (I guess it is not packaged in homebrew yet := -), so you could be able to run: >=20 > $ opam init # much quicker than before > $ opam remote -add dev git://github.com/mirage/opam-repo-dev.git > $ opam install mirage-www if i use the mirage/homebrew tap, and then `opam update`, will it just do t= he right thing? (and if not, why not? :) --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From anil@recoil.org Fri Jul 06 14:36:06 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sn8ha-0007Kz-Cd (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 14:36:06 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score 0.0 from SpamAssassin-3.3.2-1357494 X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:37449 helo=dark.recoil.org) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with smtp id 1Sn8hY-0007r2-pS (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 14:36:06 +0100 Received: (qmail 10826 invoked by uid 634); 6 Jul 2012 13:36:04 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-143-229.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-143-229.eduroam.csx.cam.ac.uk) (128.232.143.229) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Fri, 06 Jul 2012 14:36:04 +0100 Subject: Re: opam Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <39BE32DF-F86F-426A-8E12-42F7AB43531E@gmail.com> Date: Fri, 6 Jul 2012 14:36:01 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <17419AF6-924D-41C9-9FB4-47C6155F91BA@recoil.org> References: <39BE32DF-F86F-426A-8E12-42F7AB43531E@gmail.com> To: Thomas Gazagnaire X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Richard Mortier , "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Jul 2012 13:36:06 -0000 X-Keywords: X-UID: 321 Status: O Content-Length: 1023 Lines: 34 Hang on, don't use the ocamlpro one just yet. Do this: $ opam init -kind curl -add default http://mirage.github.com/opam $ opam remote -add dev git://github.com/mirage/opam-repo-dev.git $ opam install dns The reason is that I'm still fixing the compiler description files for = Xen (recompiling at this moment), so the OCamlPro repo will be out of = date with respect to mine (the mirage.github.com) one. Its quite a neat setup now though: the '-kind curl' uses normal HTTP to = fetch the distfiles from the github Pages via HTTP, so no special server = required. -anil On 6 Jul 2012, at 14:32, Thomas Gazagnaire wrote: >> so- what's the state of opam currently? where are the latest install = instructions for opam+mirage? =20 >=20 > I've released 0.2 yesterday (I guess it is not packaged in homebrew = yet :-), so you could be able to run: >=20 > $ opam init # much quicker than before > $ opam remote -add dev git://github.com/mirage/opam-repo-dev.git > $ opam install mirage-www >=20 > -- > Thomas >=20 >=20 From anil@recoil.org Fri Jul 06 14:57:20 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sn928-0007mn-B4 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 14:57:20 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score 0.0 from SpamAssassin-3.3.2-1357494 X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:43761 helo=dark.recoil.org) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with smtp id 1Sn927-0006uv-pF (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 06 Jul 2012 14:57:20 +0100 Received: (qmail 30587 invoked by uid 634); 6 Jul 2012 13:57:19 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-143-229.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-143-229.eduroam.csx.cam.ac.uk) (128.232.143.229) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Fri, 06 Jul 2012 14:57:18 +0100 Subject: Re: opam Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Fri, 6 Jul 2012 14:57:13 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <197BEDD9-5D62-4115-B7B6-0E205E26C2CB@recoil.org> References: <39BE32DF-F86F-426A-8E12-42F7AB43531E@gmail.com> To: Richard Mortier X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: "cl-mirage@lists.cam.ac.uk Mailing List" , Thomas Gazagnaire X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 06 Jul 2012 13:57:20 -0000 X-Keywords: X-UID: 322 Status: O Content-Length: 856 Lines: 31 On 6 Jul 2012, at 14:35, Richard Mortier wrote: >=20 > On 6 Jul 2012, at 14:32, Thomas Gazagnaire wrote: >=20 >>> so- what's the state of opam currently? where are the latest = install instructions for opam+mirage? =20 >>=20 >> I've released 0.2 yesterday (I guess it is not packaged in homebrew = yet :-), so you could be able to run: >>=20 >> $ opam init # much quicker than before >> $ opam remote -add dev git://github.com/mirage/opam-repo-dev.git >> $ opam install mirage-www >=20 > if i use the mirage/homebrew tap, and then `opam update`, will it just = do the right thing? >=20 > (and if not, why not? :) That was pinned at opam-0.1 (and I've just updated the repo to = opam-0.2). You need at least 0.2. I normally install the --HEAD version: $ brew install --HEAD opam which will clone the github repo and install directly from there. -a From anil@recoil.org Sat Jul 07 12:03:01 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SnSmz-0004u9-Js (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 07 Jul 2012 12:03:01 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:30414 helo=dark.recoil.org) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with smtp id 1SnSmy-0007DW-S0 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 07 Jul 2012 12:03:01 +0100 Received: (qmail 1089 invoked by uid 634); 7 Jul 2012 11:02:59 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Sat, 07 Jul 2012 12:02:59 +0100 Subject: Re: opam Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <197BEDD9-5D62-4115-B7B6-0E205E26C2CB@recoil.org> Date: Sat, 7 Jul 2012 12:02:57 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <308B9AC7-B466-4C67-A504-A5EA965B02A5@recoil.org> References: <39BE32DF-F86F-426A-8E12-42F7AB43531E@gmail.com> <197BEDD9-5D62-4115-B7B6-0E205E26C2CB@recoil.org> To: Richard Mortier X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: "cl-mirage@lists.cam.ac.uk Mailing List" , Thomas Gazagnaire X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Jul 2012 11:03:01 -0000 X-Keywords: X-UID: 323 Status: O Content-Length: 695 Lines: 21 With the latest OPAM and repos, almost all the combinations are working = now. I'm using this little script to try it out quickly on x86 and ARM: #!/bin/sh -e rm -rf ~/.opam opam init default http://mirage.github.com/opam opam remote -kind git -add dev git://github.com/mirage/opam-repo-dev opam --verbose install mirage-net opam --verbose install cow opam --verbose switch 3.12.1+mirage-unix-direct eval `opam config -env` opam --verbose install mirage-net opam --verbose install cow So the UNIX direct/socket backends should be fine now. The Xen backend = is failing due to a minor compiler switch issue in OPAM; I've put a bug = here: https://github.com/OCamlPro/opam/issues/35=20 -anil= From Richard.Mortier@nottingham.ac.uk Sat Jul 07 12:32:08 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SnTFA-0005Gn-Fu (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 07 Jul 2012 12:32:08 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:56526 helo=thb-mta-19.emailfiltering.com) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1SnTF4-0004Gx-pC (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 07 Jul 2012 12:32:08 +0100 Received: from smtp4.nottingham.ac.uk ([128.243.220.65]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2490603150 ;41033dada2eb842a; Sat, 07 Jul 2012 12:31:42 +0100 Received: from uiwexhub02.ad.nottingham.ac.uk ([128.243.15.132]) by smtp4.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1SnTEk-0008Iv-Hx for cl-mirage@lists.cam.ac.uk; Sat, 07 Jul 2012 12:31:42 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB02.ad.nottingham.ac.uk ([2002:80f3:f84::80f3:f84]) with mapi; Sat, 7 Jul 2012 12:31:33 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Sat, 7 Jul 2012 12:31:32 +0100 Subject: Re: opam Thread-Topic: opam Thread-Index: Ac1cNA9I/KZ/gNEpRWyzbSFjLR1h/w== Message-ID: <966FB38D-067C-4B37-AF1D-46C58680E124@nottingham.ac.uk> References: <39BE32DF-F86F-426A-8E12-42F7AB43531E@gmail.com> <197BEDD9-5D62-4115-B7B6-0E205E26C2CB@recoil.org> <308B9AC7-B466-4C67-A504-A5EA965B02A5@recoil.org> In-Reply-To: <308B9AC7-B466-4C67-A504-A5EA965B02A5@recoil.org> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "cl-mirage@lists.cam.ac.uk Mailing List" , Thomas Gazagnaire X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Jul 2012 11:32:08 -0000 X-Keywords: X-UID: 324 Status: O Content-Length: 1753 Lines: 49 yes, running through now having done something v similar - mirage-www seems= to be building. possibly need mirage-fs as well as mirage-net and cow...? On 7 Jul 2012, at 12:02, Anil Madhavapeddy wrote: > With the latest OPAM and repos, almost all the combinations are working n= ow. I'm using this little script to try it out quickly on x86 and ARM: >=20 > #!/bin/sh -e > rm -rf ~/.opam > opam init default http://mirage.github.com/opam > opam remote -kind git -add dev git://github.com/mirage/opam-repo-dev > opam --verbose install mirage-net > opam --verbose install cow > opam --verbose switch 3.12.1+mirage-unix-direct > eval `opam config -env` > opam --verbose install mirage-net > opam --verbose install cow >=20 > So the UNIX direct/socket backends should be fine now. The Xen backend is= failing due to a minor compiler switch issue in OPAM; I've put a bug here: > https://github.com/OCamlPro/opam/issues/35=20 >=20 > -anil --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From anil@recoil.org Sat Jul 07 12:35:41 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SnTIb-0005LI-TK (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 07 Jul 2012 12:35:41 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:34493 helo=dark.recoil.org) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with smtp id 1SnTIa-0008Uy-SX (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 07 Jul 2012 12:35:41 +0100 Received: (qmail 1716 invoked by uid 634); 7 Jul 2012 11:35:40 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Sat, 07 Jul 2012 12:35:40 +0100 Subject: Re: opam Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <966FB38D-067C-4B37-AF1D-46C58680E124@nottingham.ac.uk> Date: Sat, 7 Jul 2012 12:35:37 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <4C16E77B-E1A5-4AA8-82BC-6393C6B68373@recoil.org> References: <39BE32DF-F86F-426A-8E12-42F7AB43531E@gmail.com> <197BEDD9-5D62-4115-B7B6-0E205E26C2CB@recoil.org> <308B9AC7-B466-4C67-A504-A5EA965B02A5@recoil.org> <966FB38D-067C-4B37-AF1D-46C58680E124@nottingham.ac.uk> To: Richard Mortier X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: "cl-mirage@lists.cam.ac.uk Mailing List" , Thomas Gazagnaire X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 07 Jul 2012 11:35:42 -0000 X-Keywords: X-UID: 325 Status: O Content-Length: 2149 Lines: 67 Yeah you need mirage-fs: right now, it only contains the 'mir-crunch' = command which generates the ramdisk OCaml modules. =20 It'll eventually be where the Block module will go, and the FAT16/32 = filesystem code that Dave wrote (it still needs to be ported from = Bitstring). -anil On 7 Jul 2012, at 12:31, Richard Mortier wrote: > yes, running through now having done something v similar - mirage-www = seems to be building. >=20 > possibly need mirage-fs as well as mirage-net and cow...? >=20 > On 7 Jul 2012, at 12:02, Anil Madhavapeddy wrote: >=20 >> With the latest OPAM and repos, almost all the combinations are = working now. I'm using this little script to try it out quickly on x86 = and ARM: >>=20 >> #!/bin/sh -e >> rm -rf ~/.opam >> opam init default http://mirage.github.com/opam >> opam remote -kind git -add dev git://github.com/mirage/opam-repo-dev >> opam --verbose install mirage-net >> opam --verbose install cow >> opam --verbose switch 3.12.1+mirage-unix-direct >> eval `opam config -env` >> opam --verbose install mirage-net >> opam --verbose install cow >>=20 >> So the UNIX direct/socket backends should be fine now. The Xen = backend is failing due to a minor compiler switch issue in OPAM; I've = put a bug here: >> https://github.com/OCamlPro/opam/issues/35=20 >>=20 >> -anil >=20 >=20 > --=20 > Cheers, >=20 > R. >=20 >=20 >=20 >=20 > This message and any attachment are intended solely for the addressee = and may contain confidential information. If you have received this = message in error, please send it back to me, and immediately delete it. = Please do not use, copy or disclose the information contained in this = message or in any attachment. Any views or opinions expressed by the = author of this email do not necessarily reflect the views of the = University of Nottingham. >=20 > This message has been checked for viruses but the contents of an = attachment > may still contain software viruses which could damage your computer = system: > you are advised to perform your own checks. Email communications with = the > University of Nottingham may be monitored as permitted by UK = legislation. From anil@recoil.org Sun Jul 08 22:01:29 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Snybh-0004OR-QN (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sun, 08 Jul 2012 22:01:29 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:2969 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1Snybh-0002u1-Wn (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sun, 08 Jul 2012 22:01:29 +0100 Received: (qmail 4513 invoked by uid 634); 8 Jul 2012 21:01:28 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.38]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Sun, 08 Jul 2012 22:01:28 +0100 Subject: Re: opam Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <308B9AC7-B466-4C67-A504-A5EA965B02A5@recoil.org> Date: Sun, 8 Jul 2012 22:01:26 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <6E27140B-F32C-4AA1-BCFE-2787ADC6AF45@recoil.org> References: <39BE32DF-F86F-426A-8E12-42F7AB43531E@gmail.com> <197BEDD9-5D62-4115-B7B6-0E205E26C2CB@recoil.org> <308B9AC7-B466-4C67-A504-A5EA965B02A5@recoil.org> To: Richard Mortier X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: "cl-mirage@lists.cam.ac.uk Mailing List" , Thomas Gazagnaire X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 08 Jul 2012 21:01:29 -0000 X-Keywords: X-UID: 326 Status: O Content-Length: 1428 Lines: 39 On 7 Jul 2012, at 12:02, Anil Madhavapeddy wrote: > With the latest OPAM and repos, almost all the combinations are = working now. I'm using this little script to try it out quickly on x86 = and ARM: >=20 > #!/bin/sh -e > rm -rf ~/.opam > opam init default http://mirage.github.com/opam > opam remote -kind git -add dev git://github.com/mirage/opam-repo-dev > opam --verbose install mirage-net > opam --verbose install cow > opam --verbose switch 3.12.1+mirage-unix-direct > eval `opam config -env` > opam --verbose install mirage-net > opam --verbose install cow >=20 > So the UNIX direct/socket backends should be fine now. The Xen backend = is failing due to a minor compiler switch issue in OPAM; I've put a bug = here: > https://github.com/OCamlPro/opam/issues/35=20 ...and Thomas just fixed this (thanks!), so the Xen backend builds now = too. I've updated the openmirage.org to use the OPAM-based system now: http://www.openmirage.org/wiki/install I'll update all the wiki pages tomorrow asap before doing a blog post, = so that instructions are all in one place. Also been requested is a = "what people are working on" page, so I'll put in a brief roadmap = section with projects. This is also for the benefit of students who are = looking for projects and want to contact someone about them. Thomas: could you tag a version of OPAM with all the latest fixes for = Xen, so I can update the Homebrew tap? -anil= From anil@recoil.org Mon Jul 09 08:51:35 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1So8kp-0003ZD-Se (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 09 Jul 2012 08:51:35 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:8937 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1So8kp-0006al-Wu (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 09 Jul 2012 08:51:35 +0100 Received: (qmail 4529 invoked by uid 634); 9 Jul 2012 07:51:35 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from host81-149-102-120.in-addr.btopenworld.com (HELO [192.168.0.25]) (81.149.102.120) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Mon, 09 Jul 2012 08:51:34 +0100 Subject: Re: Manager.connect possible implementation Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Mon, 9 Jul 2012 08:51:33 +0100 Content-Transfer-Encoding: 7bit Message-Id: References: To: Haris Rotsos X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Balraj Singh , "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 09 Jul 2012 07:51:36 -0000 X-Keywords: X-UID: 327 Status: O Content-Length: 1216 Lines: 30 [adding cl-mirage] If I remember right, the TCP performance tests were done by using the TCP library directly, and not going through the Manager module. Actually, the next thing on my list is to junk the Manager module, and replace it with something that is less strict about how the library is used. Right now, it hides the details of device construction, which isn't exactly what we want. Your work on NS3 is useful to figure out what the design should look like. If you describe what the NS3 interface wants, then Dave and I can come up with something plausible that will work with a real XCP cluster... I was thinking that an Interface module (to match the ifconfig-style configuration on UNIX) would provide an easy mapping to/from UNIX. Dave: is there anything useful we can grab from XCP to act as the UNIX version of this library? Networkd? The Mirage version will be the current code that launches all the relevant protocol threads. -anil On 9 Jul 2012, at 04:25, Haris Rotsos wrote: > Hi all, > > Just wondering out of curiocity, I though that the manager provided a > function to connect as a client over a tcp connection. I though this > was the way we tested the speed of the tcp write path From Dave.Scott@eu.citrix.com Mon Jul 09 10:40:14 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SoARy-0006zX-0D (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 09 Jul 2012 10:40:14 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -2.4 from SpamAssassin-3.3.2-1358082 * -2.3 RCVD_IN_DNSWL_MED RBL: Sender listed at http://www.dnswl.org/, * medium trust * [62.200.22.115 listed in list.dnswl.dnsbl.ja.net] * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from smtp.eu.citrix.com ([62.200.22.115]:44433) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1SoARx-0003VO-oK (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 09 Jul 2012 10:40:13 +0100 X-IronPort-AV: E=Sophos;i="4.77,551,1336348800"; d="scan'208";a="13429127" Received: from lonpmailmx02.citrite.net ([10.30.203.163]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/RC4-MD5; 09 Jul 2012 09:40:13 +0000 Received: from LONPMAILBOX01.citrite.net ([10.30.224.160]) by LONPMAILMX02.citrite.net ([10.30.203.163]) with mapi; Mon, 9 Jul 2012 10:40:13 +0100 From: Dave Scott To: 'Anil Madhavapeddy' , Haris Rotsos Date: Mon, 9 Jul 2012 10:40:12 +0100 Subject: RE: Manager.connect possible implementation Thread-Topic: Manager.connect possible implementation Thread-Index: Ac1dp8LevlvbQUQwSh6AmTY8YuvaTQADtQMg Message-ID: <81A73678E76EA642801C8F2E4823AD21DAA0D8F37A@LONPMAILBOX01.citrite.net> References: In-Reply-To: Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Balraj Singh , "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 09 Jul 2012 09:40:14 -0000 X-Keywords: X-UID: 328 Status: O Content-Length: 592 Lines: 18 Hi, ... > I was thinking that an Interface module (to match the ifconfig-style > configuration on UNIX) would provide an easy mapping to/from UNIX. >=20 > Dave: is there anything useful we can grab from XCP to act as the UNIX > version of this library? Networkd? The Mirage version will be the > current > code that launches all the relevant protocol threads. The networkd might be useful -- it is able to configure bridges, openvswitc= h instances, IP addresses etc. It might be worth ripping out (err sharing) = some of the internals if we refactored them into a library. Cheers, Dave From Dave.Scott@eu.citrix.com Mon Jul 09 10:52:36 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SoAdv-0007OT-VR (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 09 Jul 2012 10:52:35 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -2.4 from SpamAssassin-3.3.2-1358082 * -2.3 RCVD_IN_DNSWL_MED RBL: Sender listed at http://www.dnswl.org/, * medium trust * [62.200.22.115 listed in list.dnswl.dnsbl.ja.net] * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from smtp.ctxuk.citrix.com ([62.200.22.115]:23716 helo=SMTP.EU.CITRIX.COM) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1SoAdu-0006t8-Yd (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 09 Jul 2012 10:52:35 +0100 X-IronPort-AV: E=Sophos;i="4.77,551,1336348800"; d="scan'208";a="13429439" Received: from lonpmailmx01.citrite.net ([10.30.203.162]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/RC4-MD5; 09 Jul 2012 09:51:36 +0000 Received: from LONPMAILBOX01.citrite.net ([10.30.224.160]) by LONPMAILMX01.citrite.net ([10.30.203.162]) with mapi; Mon, 9 Jul 2012 10:51:36 +0100 From: Dave Scott To: 'Anil Madhavapeddy' Date: Mon, 9 Jul 2012 10:51:36 +0100 Subject: RE: 64-bit bootloaders Thread-Topic: 64-bit bootloaders Thread-Index: Ac1bZetSKL3tQPujT2+zQlI9XqItwwCUPm0g Message-ID: <81A73678E76EA642801C8F2E4823AD21DAA0D8F37B@LONPMAILBOX01.citrite.net> References: <81A73678E76EA642801C8F2E4823AD21DAA0D8F363@LONPMAILBOX01.citrite.net> <68C47CE9-A551-4661-8771-7D2F44362869@recoil.org> <6676A06B-E868-4825-8F16-00F426825129@eu.citrix.com> <21DB758A-8A42-422F-AEDD-F126174A6FD3@recoil.org> <81A73678E76EA642801C8F2E4823AD21DAA0D8F369@LONPMAILBOX01.citrite.net> <81A73678E76EA642801C8F2E4823AD21DAA0D8F372@LONPMAILBOX01.citrite.net> <20120706105553.GB14575@dark.recoil.org> In-Reply-To: <20120706105553.GB14575@dark.recoil.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "cl-mirage@lists.cam.ac.uk" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 09 Jul 2012 09:52:36 -0000 X-Keywords: X-UID: 329 Status: O Content-Length: 1871 Lines: 47 Hi, > On Thu, Jul 05, 2012 at 10:07:59PM +0100, Dave Scott wrote: > > Hi, > > > > I downloaded the pre-prepared disk image and this worked just fine. I > > think my misunderstanding was that boot16b.bin (bootsector on > bootable > > partition) loads pure64.sys from the FAT16 fs and then this reads > > pure64.cfg which tells it to load kernel64.sys, switch to 64-bit and > > jump. >=20 > I didn't quite manage to parse this sentence. Is the above the correct > state of affairs, or the result of your misunderstanding? :-) :) The current state is: (I think) 1. MBR loads bootsector of active partition (1) 2. pure64's bootsector reads and executes pure64.sys from FAT16 3. pure64.sys reads pure64.cfg, reads and executes kernel64.sys from FAT16 My kernel64.sys is a mirage guest whose linker script just says, "write raw binary output, putting the .text at 0x100000". I've arranged that my new HVM startup function is right there. The mirage guest then: 1. uses CPUID to detect xen 2. writes to the special MSR to have the hypercall page copied in -- it then memcpy's this into the hypercall_page[] used by miniOS -- hypercalls now work 3. uses HVM_GET_PARAM to fetch the xenstore evtchn and pfn 4. uses XENMEM_add_to_physmap to map the shared_info page -- this allows event channel masking, time, vcpu info Plenty of debug console printing verifies that this is all working. (It's quite fun to manipulate raw framebuffers -- I've not done that for years) So far so good. The next step is to set up the xen PCI device that is used for event channel interrupt delivery. After that I've got to figure out how best to handle interrupts. In an ideal world I would be able to bind all interrupts (including those from the emulated hardware) to event channels a= nd then use the existing mirage Lwt/event channel loop. I don't know if this is possible. Cheers, Dave From avsm@dark.recoil.org Mon Jul 09 11:17:01 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SoB1Z-0000WK-K8 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 09 Jul 2012 11:17:01 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:4179 helo=dark.recoil.org) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with smtp id 1SoB1Y-0002yX-o9 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 09 Jul 2012 11:17:01 +0100 Received: (qmail 23247 invoked by uid 10000); 9 Jul 2012 10:17:00 -0000 Date: Mon, 9 Jul 2012 11:17:00 +0100 From: 'Anil Madhavapeddy' To: Dave Scott Subject: Re: Manager.connect possible implementation Message-ID: <20120709101700.GG6431@dark.recoil.org> References: <81A73678E76EA642801C8F2E4823AD21DAA0D8F37A@LONPMAILBOX01.citrite.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <81A73678E76EA642801C8F2E4823AD21DAA0D8F37A@LONPMAILBOX01.citrite.net> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: Haris Rotsos , Balraj Singh , "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 09 Jul 2012 10:17:01 -0000 X-Keywords: X-UID: 330 Status: O Content-Length: 1986 Lines: 45 On Mon, Jul 09, 2012 at 10:40:12AM +0100, Dave Scott wrote: > Hi, > > ... > > I was thinking that an Interface module (to match the ifconfig-style > > configuration on UNIX) would provide an easy mapping to/from UNIX. > > > > Dave: is there anything useful we can grab from XCP to act as the UNIX > > version of this library? Networkd? The Mirage version will be the > > current > > code that launches all the relevant protocol threads. > > The networkd might be useful -- it is able to configure bridges, > openvswitch instances, IP addresses etc. It might be worth ripping out > (err sharing) some of the internals if we refactored them into a > library. Is this the correct place to start looking? https://github.com/xen-org/xen-api/blob/master/ocaml/network/networkd.ml Looks like most of the logic is in Network_utils: https://github.com/xen-org/xen-api/blob/master/ocaml/network/network_utils.ml It's obviously very XCP-Linux-specific at the moment. I imagine that functorising the DHCP module to accept either the Mirage DHCP client or an external program would be a good start. It also depends on the XCP stdlib which I'd like to avoid a dependency on (since it'll never squeeze into a microkernel with all the UNIX dependencies). The OVS interface could be matched by the Mirage OpenFlow library. In general, this is a very useful exercise to firm up the differences between what is provided in UNIX userspace, and directly via the library version. It does bring up the question of what our inter-process communications interface should look like. The rpc-light module, or something else? I really like the look of: https://github.com/andrenth/release ...which is an Lwt/UNIX multiprocess framework. Crucially, it uses Lwt_bytes (which are raw memory pages that are compatible with Io_page), and so would be a very smooth transition to/from the Mirage exokernel to a normal UNIX binary. -- Anil Madhavapeddy http://anil.recoil.org From thomas.gazagnaire@gmail.com Tue Jul 10 23:08:16 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SoibQ-0003MM-Ch (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 10 Jul 2012 23:08:16 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [74.125.82.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (thomas.gazagnaire[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-we0-f179.google.com ([74.125.82.179]:41462) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SoibO-0000hj-R8 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 10 Jul 2012 23:08:16 +0100 Received: by weyx10 with SMTP id x10so315091wey.38 for ; Tue, 10 Jul 2012 15:08:14 -0700 (PDT) Received: by 10.180.83.66 with SMTP id o2mr20265926wiy.14.1341958094158; Tue, 10 Jul 2012 15:08:14 -0700 (PDT) Received: from [192.168.0.14] (gou06-3-88-170-165-56.fbx.proxad.net. [88.170.165.56]) by mx.google.com with ESMTPS id n6sm46248394wie.7.2012.07.10.15.08.12 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 10 Jul 2012 15:08:13 -0700 (PDT) From: Thomas Gazagnaire Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: version pinning in OPAM Date: Wed, 11 Jul 2012 00:08:10 +0200 Message-Id: To: Anil Madhavapeddy Mime-Version: 1.0 (Apple Message framework v1084) X-Mailer: Apple Mail (2.1084) Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Jul 2012 22:08:16 -0000 X-Keywords: X-UID: 331 Status: O Content-Length: 1692 Lines: 41 Hi, Currently, the dev packages of mirage are managed with a special (git) = backend in OPAM. As a user, its quite convenient to always have the = latest HEAD installed of these packages, but as a developer, you must = commit every changes you make in order to trigger a recompilation ... = This can quickly become painful, so I've started implementing some kind = of version pining for OPAM. I have a first prototype almost working, it = allows you to do the following: $ opam pin mirage-0.3dev /local/path # the path will be used instead = of the remote git url [ cd /local/path && hack hack hack ] $ opam update && opam upgrade # recompile all the packages which = depends on mirage-0.3dev, using the contents you have registered with = "opam pin" Is this convenient ? Would it be better to have "opam pin mirage = /local/path" instead (ie. no package version) and a more specific = update/upgrade command (like "opam pin -reinstall") to just upgrade the = pinned packages without having to do a full upgrade ? Under the hook, I've done the following: * on init, we now have a special "rsync" OPAM repository, which will = contain the pinned packages * each time you call opam pin: - ~/.opam/repo/index is updated to say that the pin repo is prioritary = for the the pinned package - ~/.opam/repo/pin/url/$package.$version is created, containing the = new path - the contents of the new path is copied in = ~/.opam/repo/pin/cache/$package.$version/ * on update, I've extended the behavior of the rsync backend to compare = the cached version with the actual contents, and to mark the package as = new if the diff is not empty * the upgrade hasn't changed -- Thomas= From Richard.Mortier@nottingham.ac.uk Tue Jul 10 23:16:16 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SoijA-0003Rk-UE (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 10 Jul 2012 23:16:16 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ixe-mta-19-tx.emailfiltering.com ([194.116.198.150]:40132 helo=ixe-mta-19.emailfiltering.com) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1Soij5-0001V1-XU (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 10 Jul 2012 23:16:16 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by ixe-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2310256732 ;d02e6b12bfe10300; Tue, 10 Jul 2012 23:15:51 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Soiik-0004fz-TY for cl-mirage@lists.cam.ac.uk; Tue, 10 Jul 2012 23:15:50 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Tue, 10 Jul 2012 23:15:50 +0100 From: Richard Mortier To: Thomas Gazagnaire Date: Tue, 10 Jul 2012 23:15:50 +0100 Subject: Re: version pinning in OPAM Thread-Topic: version pinning in OPAM Thread-Index: Ac1e6ZBV4YnhL1IYSTueVNCapX12Fg== Message-ID: References: In-Reply-To: Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List , Anil Madhavapeddy X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 10 Jul 2012 22:16:17 -0000 X-Keywords: X-UID: 332 Status: O Content-Length: 3141 Lines: 79 sounds useful! i prefer your second suggestion (not having the version num= ber in the package being pinned). would it be possible to extend what you say so that i could type: $ opam pin mirage 0.3dev # to pin the mirage package to upstream release = 0.3dev $ opam pin mirage /local/path # to pin the mirage package to my local path $ opam unpin mirage # to "unpin" and go back to tracking the upstream (or the latter could be "$ opam pin mirage latest" or somesuch if you don't= want the extra verb.) if that makes sense? On 10 Jul 2012, at 23:08, Thomas Gazagnaire wrote: > Hi, >=20 > Currently, the dev packages of mirage are managed with a special (git) ba= ckend in OPAM. As a user, its quite convenient to always have the latest HE= AD installed of these packages, but as a developer, you must commit every c= hanges you make in order to trigger a recompilation ... This can quickly be= come painful, so I've started implementing some kind of version pining for = OPAM. I have a first prototype almost working, it allows you to do the foll= owing: >=20 > $ opam pin mirage-0.3dev /local/path # the path will be used instead of= the remote git url > [ cd /local/path && hack hack hack ] > $ opam update && opam upgrade # recompile all the packages which depend= s on mirage-0.3dev, using the contents you have registered with "opam pin" >=20 > Is this convenient ? Would it be better to have "opam pin mirage /local/p= ath" instead (ie. no package version) and a more specific update/upgrade co= mmand (like "opam pin -reinstall") to just upgrade the pinned packages with= out having to do a full upgrade ? >=20 > Under the hook, I've done the following: >=20 > * on init, we now have a special "rsync" OPAM repository, which will con= tain the pinned packages > * each time you call opam pin: > - ~/.opam/repo/index is updated to say that the pin repo is prioritary f= or the the pinned package > - ~/.opam/repo/pin/url/$package.$version is created, containing the new = path > - the contents of the new path is copied in ~/.opam/repo/pin/cache/$pac= kage.$version/ > * on update, I've extended the behavior of the rsync backend to compare t= he cached version with the actual contents, and to mark the package as new = if the diff is not empty > * the upgrade hasn't changed >=20 > -- > Thomas --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From anil@recoil.org Wed Jul 11 10:21:58 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sot7O-0005LS-83 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 10:21:58 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:44798 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1Sot7N-0007AA-YH (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 10:21:58 +0100 Received: (qmail 30575 invoked by uid 634); 11 Jul 2012 09:21:57 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-143-229.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-143-229.eduroam.csx.cam.ac.uk) (128.232.143.229) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 11 Jul 2012 10:21:57 +0100 Subject: Re: version pinning in OPAM Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Wed, 11 Jul 2012 10:21:57 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <689F1C7E-B102-48C0-B12B-819B66D34CAE@recoil.org> References: To: Thomas Gazagnaire X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 09:21:58 -0000 X-Keywords: X-UID: 333 Status: O Content-Length: 1536 Lines: 33 On 10 Jul 2012, at 23:08, Thomas Gazagnaire wrote: >=20 > Currently, the dev packages of mirage are managed with a special (git) = backend in OPAM. As a user, its quite convenient to always have the = latest HEAD installed of these packages, but as a developer, you must = commit every changes you make in order to trigger a recompilation ... = This can quickly become painful, so I've started implementing some kind = of version pining for OPAM. I have a first prototype almost working, it = allows you to do the following: >=20 > $ opam pin mirage-0.3dev /local/path # the path will be used instead = of the remote git url > [ cd /local/path && hack hack hack ] > $ opam update && opam upgrade # recompile all the packages which = depends on mirage-0.3dev, using the contents you have registered with = "opam pin" >=20 > Is this convenient ? Would it be better to have "opam pin mirage = /local/path" instead (ie. no package version) and a more specific = update/upgrade command (like "opam pin -reinstall") to just upgrade the = pinned packages without having to do a full upgrade ? Hm, the version is a little meaningless with pinned packages, since the = diff between the old/new version is what decides if it's reinstalled or = not. I'd prefer just to pin the package and not worry about version = numbers. The only problem I see with 'update && upgrade' is that you are forced = to upgrade all packages, including any other ones that came from = upstream. Not sure if that will be a problem in practise or not. -anil= From anil@recoil.org Wed Jul 11 10:23:01 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sot8P-0005af-6c (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 10:23:01 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:30338 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1Sot8O-0007wR-Yg (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 10:23:01 +0100 Received: (qmail 6363 invoked by uid 634); 11 Jul 2012 09:23:00 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-143-229.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-143-229.eduroam.csx.cam.ac.uk) (128.232.143.229) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 11 Jul 2012 10:23:00 +0100 Subject: Re: version pinning in OPAM Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Wed, 11 Jul 2012 10:23:01 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <7ADD34F3-DC71-4127-AA4A-62D6A2F8FB9A@recoil.org> References: To: Richard Mortier X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List , Thomas Gazagnaire X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 09:23:01 -0000 X-Keywords: X-UID: 334 Status: O Content-Length: 793 Lines: 26 On 10 Jul 2012, at 23:15, Richard Mortier wrote: > sounds useful! i prefer your second suggestion (not having the = version number in the package being pinned). >=20 > would it be possible to extend what you say so that i could type: >=20 > $ opam pin mirage 0.3dev # to pin the mirage package to upstream = release 0.3dev > $ opam pin mirage /local/path # to pin the mirage package to = my local path > $ opam unpin mirage # to "unpin" and go back to tracking the = upstream >=20 > (or the latter could be "$ opam pin mirage latest" or somesuch if you = don't want the extra verb.) >=20 Oh that's a good idea: it would also permit the user to prevent a = package from being updated even if a new version is available upstream. = Just like the Debian apt source for pinning. -anil From Richard.Mortier@nottingham.ac.uk Wed Jul 11 10:47:35 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SotWB-0006Zy-PG (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 10:47:35 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:48917 helo=thb-mta-19.emailfiltering.com) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SotW5-00028J-Rw (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 10:47:35 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2494218806 ;c4e5cbcf4da66c62; Wed, 11 Jul 2012 10:47:09 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1SotVl-00009Y-CH for cl-mirage@lists.cam.ac.uk; Wed, 11 Jul 2012 10:47:09 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Wed, 11 Jul 2012 10:47:09 +0100 From: Richard Mortier To: Anil Madhavapeddy , Thomas Gazagnaire Date: Wed, 11 Jul 2012 10:47:08 +0100 Subject: Re: version pinning in OPAM Thread-Topic: version pinning in OPAM Thread-Index: Ac1fSiOIyNNj+MohQuWLB2WBfvgGGA== Message-ID: <46907732-1CF4-4E60-A41A-7ABE05C56C4A@nottingham.ac.uk> References: <7ADD34F3-DC71-4127-AA4A-62D6A2F8FB9A@recoil.org> In-Reply-To: <7ADD34F3-DC71-4127-AA4A-62D6A2F8FB9A@recoil.org> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 09:47:35 -0000 X-Keywords: X-UID: 335 Status: O Content-Length: 1076 Lines: 30 On 11 Jul 2012, at 10:23, Anil Madhavapeddy wrote: > Oh that's a good idea: it would also permit the user to prevent a package= from being updated even if a new version is available upstream. Just like= the Debian apt source for pinning. yes, exactly :) --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From thomas.gazagnaire@gmail.com Wed Jul 11 11:12:58 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sotuk-00078h-7R (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 11:12:58 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.212.173 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (thomas.gazagnaire[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wi0-f173.google.com ([209.85.212.173]:56757) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1Sotui-0004wF-Ri (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 11:12:57 +0100 Received: by wibhm6 with SMTP id hm6so3939282wib.2 for ; Wed, 11 Jul 2012 03:12:56 -0700 (PDT) Received: by 10.180.80.134 with SMTP id r6mr45956576wix.1.1342001576429; Wed, 11 Jul 2012 03:12:56 -0700 (PDT) Received: from [10.107.174.49] (37-8-168-113.coucou-networks.fr. [37.8.168.113]) by mx.google.com with ESMTPS id l5sm3956303wix.5.2012.07.11.03.12.53 (version=TLSv1/SSLv3 cipher=OTHER); Wed, 11 Jul 2012 03:12:55 -0700 (PDT) Subject: Re: version pinning in OPAM References: <7ADD34F3-DC71-4127-AA4A-62D6A2F8FB9A@recoil.org> From: Thomas Gazagnaire Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 In-Reply-To: <7ADD34F3-DC71-4127-AA4A-62D6A2F8FB9A@recoil.org> Message-Id: <4B9FFDE5-EA36-4E4A-A882-97756CBBC28B@gmail.com> Date: Wed, 11 Jul 2012 12:07:27 +0200 To: Anil Madhavapeddy Mime-Version: 1.0 (1.0) X-Mailer: iPhone Mail (9B206) Cc: Richard Mortier , Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 10:12:58 -0000 X-Keywords: X-UID: 337 Status: O Content-Length: 904 Lines: 28 >> sounds useful! i prefer your second suggestion (not having the version n= umber in the package being pinned). >>=20 >> would it be possible to extend what you say so that i could type: >>=20 >> $ opam pin mirage 0.3dev # to pin the mirage package to upstream rel= ease 0.3dev >> $ opam pin mirage /local/path # to pin the mirage package to my local p= ath >> $ opam unpin mirage # to "unpin" and go back to tracking the upstr= eam >>=20 >> (or the latter could be "$ opam pin mirage latest" or somesuch if you don= 't want the extra verb.) >>=20 >=20 > Oh that's a good idea: it would also permit the user to prevent a package f= rom being updated even if a new version is available upstream. Just like th= e Debian apt source for=20 I quite like the id=C3=A9al as well, so I'll go implementing something like t= hat (but I will avoid to add a new verb for unpinning) -- Thomas= From thomas.gazagnaire@gmail.com Wed Jul 11 11:12:42 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SotuU-00078J-KX (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 11:12:42 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score 0.2 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [74.125.82.51 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (thomas.gazagnaire[at]gmail.com) * 0.0 DKIM_ADSP_CUSTOM_MED No valid author signature, adsp_override is * CUSTOM_MED * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid * 0.9 NML_ADSP_CUSTOM_MED ADSP custom_med hit, and not from a mailing * list X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wg0-f51.google.com ([74.125.82.51]:47345) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1SotuU-0001G2-Wu (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 11:12:42 +0100 Received: by wgbed3 with SMTP id ed3so680094wgb.20 for ; Wed, 11 Jul 2012 03:12:42 -0700 (PDT) Received: by 10.180.82.164 with SMTP id j4mr45797051wiy.18.1342001562017; Wed, 11 Jul 2012 03:12:42 -0700 (PDT) Received: from [10.107.174.49] (37-8-168-113.coucou-networks.fr. [37.8.168.113]) by mx.google.com with ESMTPS id l5sm3956303wix.5.2012.07.11.03.12.39 (version=TLSv1/SSLv3 cipher=OTHER); Wed, 11 Jul 2012 03:12:40 -0700 (PDT) Subject: Re: version pinning in OPAM References: <689F1C7E-B102-48C0-B12B-819B66D34CAE@recoil.org> From: Thomas Gazagnaire Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii In-Reply-To: <689F1C7E-B102-48C0-B12B-819B66D34CAE@recoil.org> Message-Id: Date: Wed, 11 Jul 2012 12:11:13 +0200 To: Anil Madhavapeddy Mime-Version: 1.0 (1.0) X-Mailer: iPhone Mail (9B206) Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 10:12:42 -0000 X-Keywords: X-UID: 336 Status: O Content-Length: 642 Lines: 16 >> Is this convenient ? Would it be better to have "opam pin mirage /local/p= ath" instead (ie. no package version) and a more specific update/upgrade com= mand (like "opam pin -reinstall") to just upgrade the pinned packages withou= t having to do a full upgrade ? >=20 > The only problem I see with 'update && upgrade' is that you are forced to u= pgrade all packages, including any other ones that came from upstream. Not s= ure if that will be a problem in practise or not. Yes that's exactly the problem with update/upgrade. Any better idea ? 'opam p= in -update' to update/rebuild only the pinned packages in one step ? -- Thomas= From anil@recoil.org Wed Jul 11 11:39:03 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SouJz-0000Ye-Qh (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 11:39:03 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:12889 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1SouJz-0003Mb-XT (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 11:39:03 +0100 Received: (qmail 25881 invoked by uid 634); 11 Jul 2012 10:39:03 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-143-229.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-143-229.eduroam.csx.cam.ac.uk) (128.232.143.229) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 11 Jul 2012 11:39:03 +0100 Subject: Re: version pinning in OPAM Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Wed, 11 Jul 2012 11:39:03 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <689F1C7E-B102-48C0-B12B-819B66D34CAE@recoil.org> To: Thomas Gazagnaire X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 10:39:03 -0000 X-Keywords: X-UID: 338 Status: O Content-Length: 911 Lines: 22 On 11 Jul 2012, at 11:11, Thomas Gazagnaire wrote: >=20 >>> Is this convenient ? Would it be better to have "opam pin mirage = /local/path" instead (ie. no package version) and a more specific = update/upgrade command (like "opam pin -reinstall") to just upgrade the = pinned packages without having to do a full upgrade ? >>=20 >> The only problem I see with 'update && upgrade' is that you are = forced to upgrade all packages, including any other ones that came from = upstream. Not sure if that will be a problem in practise or not. >=20 > Yes that's exactly the problem with update/upgrade. Any better idea ? = 'opam pin -update' to update/rebuild only the pinned packages in one = step ? This seems to be independent of the pinning support. Why not allow = 'opam update && opam upgrade lwt' to only update that package (and its = dependents that must be recompiled due to the new interface)? -anil= From pgj@caesar.elte.hu Wed Jul 11 12:30:08 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sov7Q-0002ae-FH (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 12:30:08 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1358082 * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [157.181.1.138 listed in list.dnswl.dnsbl.ja.net] * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0002] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mx3.mail.elte.hu ([157.181.1.138]:41285) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1Sov7P-0004d5-Y5 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 12:30:08 +0100 Received: from login01.caesar.elte.hu ([157.181.151.130]) by mx3.mail.elte.hu with esmtp (Exim) id 1Sov7J-0003dt-IQ from for ; Wed, 11 Jul 2012 13:30:06 +0200 Received: (Authenticated sender: pgj) by login01.caesar.elte.hu with local (Exim 4.72) (envelope-from ) id 1Sov7J-0002sf-1r for cl-mirage@lists.cam.ac.uk; Wed, 11 Jul 2012 13:30:01 +0200 Date: Wed, 11 Jul 2012 13:30:01 +0200 From: PALI Gabor Janos To: cl-mirage@lists.cam.ac.uk Subject: camlSys__entry vs. FreeBSD kmod Message-ID: <20120711113001.GA5747@caesar.elte.hu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.20 (2009-06-14) Sender: Pali Gabor Janos X-ELTE-SpamScore: -1.5 X-ELTE-SpamLevel: X-ELTE-SpamCheck: no X-ELTE-SpamVersion: ELTE 2.0 X-ELTE-SpamCheck-Details: score=-1.5 required=5.9 tests=AWL, BAYES_20 autolearn=no SpamAssassin version=3.3.1 -1.0 BAYES_20 BODY: Bayes spam probability is 5 to 20% [score: 0.1111] -0.5 AWL AWL: From: address is in the auto white-list X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 11:30:08 -0000 X-Keywords: X-UID: 339 Status: O Content-Length: 692 Lines: 19 Hi, I have just been trying to make a (very)* preliminary version of the kernel-module-embedded Caml run-time (asmrun) work, but somewhere in caml_startup() the execution dies, see the attached picture: http://people.freebsd.org/~pgj/mirage/2012/07/11/camlSys__entry.bt.png Note that it works fine if I do not use the Printf module (and use a fibonacci function instead). You can take a look at the sources I currently have (which is not under public version control for now): http://people.freebsd.org/~pgj/mirage/2012/07/11/src.zip By the way, the platform is FreeBSD/i386 10-CURRENT (r238163). I can provide more data on the crash if that helps. Ideas or suggestions are welcome! From anil@recoil.org Wed Jul 11 12:37:46 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SovEo-0002mX-35 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 12:37:46 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:6844 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1SovEn-0003Rc-Wt (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 12:37:45 +0100 Received: (qmail 19344 invoked by uid 634); 11 Jul 2012 11:37:45 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-143-229.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-143-229.eduroam.csx.cam.ac.uk) (128.232.143.229) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 11 Jul 2012 12:37:44 +0100 Subject: Re: camlSys__entry vs. FreeBSD kmod Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <20120711113001.GA5747@caesar.elte.hu> Date: Wed, 11 Jul 2012 12:37:43 +0100 Content-Transfer-Encoding: 7bit Message-Id: <9ECFF3CE-F144-4EE8-808C-86A78CED87CC@recoil.org> References: <20120711113001.GA5747@caesar.elte.hu> To: PALI Gabor Janos X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 11:37:46 -0000 X-Keywords: X-UID: 340 Status: O Content-Length: 1503 Lines: 40 So Sys__entry is the native code entry point for the Sys module, which will execute any top-level phrases. Looking at stdlib/sys.mlp, we have: external get_config: unit -> string * int * bool = "caml_sys_get_config" external get_argv: unit -> string * string array = "caml_sys_get_argv" let (executable_name, argv) = get_argv() let (os_type, word_size, big_endian) = get_config() let max_array_length = (1 lsl (word_size - 10)) - 1;; let max_string_length = word_size / 8 * max_array_length - 1;; Can you put a printk into caml_sys_get_argv to see if its getting called, and that you are getting past it? That would be a likely source of the crash (although I wonder why it doesnt show up in the backtrace). -anil On 11 Jul 2012, at 12:30, PALI Gabor Janos wrote: > Hi, > > I have just been trying to make a (very)* preliminary version of the > kernel-module-embedded Caml run-time (asmrun) work, but somewhere in > caml_startup() the execution dies, see the attached picture: > > http://people.freebsd.org/~pgj/mirage/2012/07/11/camlSys__entry.bt.png > > Note that it works fine if I do not use the Printf module (and use a > fibonacci function instead). You can take a look at the sources I > currently have (which is not under public version control for now): > > http://people.freebsd.org/~pgj/mirage/2012/07/11/src.zip > > By the way, the platform is FreeBSD/i386 10-CURRENT (r238163). I can > provide more data on the crash if that helps. > > Ideas or suggestions are welcome! > From pgj@caesar.elte.hu Wed Jul 11 12:52:24 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SovSy-00037M-9W (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 12:52:24 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1358082 * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [157.181.1.138 listed in list.dnswl.dnsbl.ja.net] * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mx3.mail.elte.hu ([157.181.1.138]:50283) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1SovSx-0003qL-rG (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 12:52:24 +0100 Received: from login01.caesar.elte.hu ([157.181.151.130]) by mx3.mail.elte.hu with esmtp (Exim) id 1SovSw-0005mM-GB from ; Wed, 11 Jul 2012 13:52:22 +0200 Received: (Authenticated sender: pgj) by login01.caesar.elte.hu with local (Exim 4.72) (envelope-from ) id 1SovSu-0003Xj-W3; Wed, 11 Jul 2012 13:52:21 +0200 Date: Wed, 11 Jul 2012 13:52:20 +0200 From: PALI Gabor Janos To: Anil Madhavapeddy Subject: Re: camlSys__entry vs. FreeBSD kmod Message-ID: <20120711115220.GA12122@caesar.elte.hu> References: <20120711113001.GA5747@caesar.elte.hu> <9ECFF3CE-F144-4EE8-808C-86A78CED87CC@recoil.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <9ECFF3CE-F144-4EE8-808C-86A78CED87CC@recoil.org> User-Agent: Mutt/1.5.20 (2009-06-14) Sender: Pali Gabor Janos X-ELTE-SpamScore: -2.0 X-ELTE-SpamLevel: X-ELTE-SpamCheck: no X-ELTE-SpamVersion: ELTE 2.0 X-ELTE-SpamCheck-Details: score=-2.0 required=5.9 tests=BAYES_00 autolearn=no SpamAssassin version=3.3.1 -2.0 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 11:52:24 -0000 X-Keywords: X-UID: 341 Status: O Content-Length: 723 Lines: 14 On Wed, Jul 11, 2012 at 12:37:43PM +0100, Anil Madhavapeddy wrote: > So Sys__entry is the native code entry point for the Sys module, which > will execute any top-level phrases. Looking at stdlib/sys.mlp, we have: > > external get_config: unit -> string * int * bool = "caml_sys_get_config" > external get_argv: unit -> string * string array = "caml_sys_get_argv" Yeah, but in my current code, caml_sys_get_argv() is not called at all (because I do not have the "(executable_name,argv) = get_argv() line"), and the modified stdlib instance lives without it happily. Maybe that is the problem? I did not see any use of having the argv stuff in the kernel, as the code running there will not be able to work it anyways. From robert.watson@cl.cam.ac.uk Wed Jul 11 12:56:45 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SovXB-0003Ro-1h (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 12:56:45 +0100 X-Cam-AntiVirus: no malware found X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from cyrus.watson.org ([65.122.17.42]:19623) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1SovTn-0007Df-mh (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 12:56:45 +0100 Received: from lemongrass.sec.cl.cam.ac.uk (lemongrass.sec.cl.cam.ac.uk [128.232.18.47]) by cyrus.watson.org (Postfix) with ESMTPSA id 5499F46B1A; Wed, 11 Jul 2012 07:53:10 -0400 (EDT) Subject: Re: camlSys__entry vs. FreeBSD kmod Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: "Robert N. M. Watson" In-Reply-To: <9ECFF3CE-F144-4EE8-808C-86A78CED87CC@recoil.org> Date: Wed, 11 Jul 2012 12:53:08 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <20120711113001.GA5747@caesar.elte.hu> <9ECFF3CE-F144-4EE8-808C-86A78CED87CC@recoil.org> To: Anil Madhavapeddy X-Mailer: Apple Mail (2.1278) Cc: PALI Gabor Janos , cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 11:56:45 -0000 X-Keywords: X-UID: 343 Status: O Content-Length: 2376 Lines: 65 On 11 Jul 2012, at 12:37, Anil Madhavapeddy wrote: > So Sys__entry is the native code entry point for the Sys module, which > will execute any top-level phrases. Looking at stdlib/sys.mlp, we = have: >=20 > external get_config: unit -> string * int * bool =3D = "caml_sys_get_config" > external get_argv: unit -> string * string array =3D = "caml_sys_get_argv" >=20 > let (executable_name, argv) =3D get_argv() > let (os_type, word_size, big_endian) =3D get_config() > let max_array_length =3D (1 lsl (word_size - 10)) - 1;; > let max_string_length =3D word_size / 8 * max_array_length - 1;; >=20 > Can you put a printk into caml_sys_get_argv to see if its getting = called, > and that you are getting past it? That would be a likely source of = the > crash (although I wonder why it doesnt show up in the backtrace). The panic message isn't included, but I'd generally caution that kernel = stacks are, by default, Quite Small, so do keep an eye out for red = zone-related panics from stack overflow. (I can't remember if FreeBSD = always inserts unmapped pages below all kernel stacks -- if it's = optional, you definitely want it on). You should also be able to = configure larger stacks and may want to do so. One approach here to get = a sense of whether you're likely run into problems is to monitor stack = size on the same OCaml program running in userspace -- if suspended at = the right moment, you can probably look at procstat -v output to see how = many pages have been allocated to stack regions. Robert >=20 > -anil >=20 > On 11 Jul 2012, at 12:30, PALI Gabor Janos wrote: >=20 >> Hi, >>=20 >> I have just been trying to make a (very)* preliminary version of the >> kernel-module-embedded Caml run-time (asmrun) work, but somewhere in >> caml_startup() the execution dies, see the attached picture: >>=20 >> = http://people.freebsd.org/~pgj/mirage/2012/07/11/camlSys__entry.bt.png >>=20 >> Note that it works fine if I do not use the Printf module (and use a >> fibonacci function instead). You can take a look at the sources I >> currently have (which is not under public version control for now): >>=20 >> http://people.freebsd.org/~pgj/mirage/2012/07/11/src.zip >>=20 >> By the way, the platform is FreeBSD/i386 10-CURRENT (r238163). I can >> provide more data on the crash if that helps. >>=20 >> Ideas or suggestions are welcome! >>=20 >=20 >=20 From robert.watson@cl.cam.ac.uk Wed Jul 11 12:54:29 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SovUz-0003AO-7d (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 12:54:29 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from cyrus.watson.org ([65.122.17.42]:32033) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1SovUy-0003xh-YQ (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 12:54:29 +0100 Received: from lemongrass.sec.cl.cam.ac.uk (lemongrass.sec.cl.cam.ac.uk [128.232.18.47]) by cyrus.watson.org (Postfix) with ESMTPSA id CE65F46B2C; Wed, 11 Jul 2012 07:54:26 -0400 (EDT) Subject: Re: camlSys__entry vs. FreeBSD kmod Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: "Robert N. M. Watson" In-Reply-To: <20120711115220.GA12122@caesar.elte.hu> Date: Wed, 11 Jul 2012 12:54:24 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <20120711113001.GA5747@caesar.elte.hu> <9ECFF3CE-F144-4EE8-808C-86A78CED87CC@recoil.org> <20120711115220.GA12122@caesar.elte.hu> To: PALI Gabor Janos X-Mailer: Apple Mail (2.1278) Cc: cl-mirage@lists.cam.ac.uk, Anil Madhavapeddy X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 11:54:29 -0000 X-Keywords: X-UID: 342 Status: O Content-Length: 1167 Lines: 32 On 11 Jul 2012, at 12:52, PALI Gabor Janos wrote: > On Wed, Jul 11, 2012 at 12:37:43PM +0100, Anil Madhavapeddy wrote: >> So Sys__entry is the native code entry point for the Sys module, = which >> will execute any top-level phrases. Looking at stdlib/sys.mlp, we = have: >>=20 >> external get_config: unit -> string * int * bool =3D = "caml_sys_get_config" >> external get_argv: unit -> string * string array =3D = "caml_sys_get_argv" >=20 > Yeah, but in my current code, caml_sys_get_argv() is not called at all > (because I do not have the "(executable_name,argv) =3D get_argv() = line"), > and the modified stdlib instance lives without it happily. >=20 > Maybe that is the problem? I did not see any use of having the argv = stuff > in the kernel, as the code running there will not be able to work it = anyways. It depends a bit how you align the program execution model with the = kernel execution model, but you could imagine OCaml argument information = being provided by the kernel environment (kenv) which can be specified = statically in kernel configuration files, via the boot loader, or from = the command line once the system is booted. Robert= From anil@recoil.org Wed Jul 11 13:55:05 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SowRd-0004gO-Ej (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 13:55:05 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:32546 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1SowRb-00029d-XF (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 13:55:04 +0100 Received: (qmail 30557 invoked by uid 634); 11 Jul 2012 12:55:03 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-143-229.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-143-229.eduroam.csx.cam.ac.uk) (128.232.143.229) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 11 Jul 2012 13:55:02 +0100 Subject: Re: camlSys__entry vs. FreeBSD kmod Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <20120711115220.GA12122@caesar.elte.hu> Date: Wed, 11 Jul 2012 13:55:01 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <20120711113001.GA5747@caesar.elte.hu> <9ECFF3CE-F144-4EE8-808C-86A78CED87CC@recoil.org> <20120711115220.GA12122@caesar.elte.hu> To: PALI Gabor Janos X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 12:55:05 -0000 X-Keywords: X-UID: 344 Status: O Content-Length: 2336 Lines: 70 On 11 Jul 2012, at 12:52, PALI Gabor Janos wrote: > On Wed, Jul 11, 2012 at 12:37:43PM +0100, Anil Madhavapeddy wrote: >> So Sys__entry is the native code entry point for the Sys module, = which >> will execute any top-level phrases. Looking at stdlib/sys.mlp, we = have: >>=20 >> external get_config: unit -> string * int * bool =3D = "caml_sys_get_config" >> external get_argv: unit -> string * string array =3D = "caml_sys_get_argv" >=20 > Yeah, but in my current code, caml_sys_get_argv() is not called at all > (because I do not have the "(executable_name,argv) =3D get_argv() = line"), > and the modified stdlib instance lives without it happily. >=20 > Maybe that is the problem? I did not see any use of having the argv = stuff > in the kernel, as the code running there will not be able to work it = anyways. Ah, your bug is just below that. Your modified code looks like this: > external get_config: unit -> string * int =3D "caml_sys_get_config" > (*external get_argv: unit -> string * string array =3D = "caml_sys_get_argv"*) >=20 > (*let (executable_name, argv) =3D get_argv()*) > let (os_type, word_size) =3D get_config() >=20 Note the call to caml_sys_get_config, which in your modified version is: > CAMLprim value caml_sys_get_config(value unit) > { > #if 0 > CAMLparam0 (); /* unit is unused */ > CAMLlocal2 (result, ostype); >=20 > ostype =3D caml_copy_string(OCAML_OS_TYPE); > result =3D caml_alloc_small (2, 0); > Field(result, 0) =3D ostype; > Field(result, 1) =3D Val_long (8 * sizeof(value)); > CAMLreturn (result); > #else > return 0; > #endif > } The function has to return a well-formed OCaml heap value that matches the type of the external function declaration (in this case, a = string*int). Your modified version returns 0, which will cause heap corruption. Just restore the original caml_sys_get_config, and define OCAML_OS_TYPE as=20 "kFreeBSD" or something (it's just for informational reasons). For additional reading btw, it's worth going through this short 6-post blog series about how the OCaml heap works: http://rwmj.wordpress.com/2009/08/04/ocaml-internals/ Robert is correct that you should be wary of stack overflows as they can be hard to spot without guard pages, but at this stage (module = initialisation), the stack usage will be very small indeed. -anil= From pgj@caesar.elte.hu Wed Jul 11 14:20:33 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SowqH-0005K6-49 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 14:20:33 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [157.181.1.138 listed in list.dnswl.dnsbl.ja.net] * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mx3.mail.elte.hu ([157.181.1.138]:49715) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SowqF-0007qW-Qg (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 14:20:33 +0100 Received: from login01.caesar.elte.hu ([157.181.151.130]) by mx3.mail.elte.hu with esmtp (Exim) id 1Sowq5-0005yP-E7 from ; Wed, 11 Jul 2012 15:20:30 +0200 Received: (Authenticated sender: pgj) by login01.caesar.elte.hu with local (Exim 4.72) (envelope-from ) id 1Sowq4-0005yY-W2; Wed, 11 Jul 2012 15:20:21 +0200 Date: Wed, 11 Jul 2012 15:20:20 +0200 From: PALI Gabor Janos To: Anil Madhavapeddy Subject: Re: camlSys__entry vs. FreeBSD kmod Message-ID: <20120711132020.GA20425@caesar.elte.hu> References: <20120711113001.GA5747@caesar.elte.hu> <9ECFF3CE-F144-4EE8-808C-86A78CED87CC@recoil.org> <20120711115220.GA12122@caesar.elte.hu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.20 (2009-06-14) Sender: Pali Gabor Janos X-ELTE-SpamScore: -2.0 X-ELTE-SpamLevel: X-ELTE-SpamCheck: no X-ELTE-SpamVersion: ELTE 2.0 X-ELTE-SpamCheck-Details: score=-2.0 required=5.9 tests=AWL, BAYES_00 autolearn=no SpamAssassin version=3.3.1 -2.0 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] 0.0 AWL AWL: From: address is in the auto white-list Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 13:20:33 -0000 X-Keywords: X-UID: 345 Status: O Content-Length: 948 Lines: 32 On Wed, Jul 11, 2012 at 01:55:01PM +0100, Anil Madhavapeddy wrote: > The function has to return a well-formed OCaml heap value that matches > the type of the external function declaration (in this case, a string*int). Okay, I did that, but that still does not seem to help as the code still crashes at the same place. In the meanwhile I started to experiment with a different solution, e.g. calling the Caml back from C: let rec fib n = ... (* your favorite fib function *) let main _ = fib 100 let _ = Callback.register "main" main Then in C: ... caml_startup(NULL); main_closure = caml_named_value("main"); if (!main_closure) bail_out(); caml_callback(*main_closure, Val_int(42)); ... And that actually seems to work... (at least got a kernel stuck on calculating :-D) > For additional reading btw, it's worth going through this short 6-post > blog series about how the OCaml heap works: Cool, thanks for the pointer, I will read this. From pgj@caesar.elte.hu Wed Jul 11 14:43:41 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SoxCf-0005km-Lr (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 14:43:41 +0100 X-Cam-AntiVirus: no malware found X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mx3.mail.elte.hu ([157.181.1.138]:34449) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1Sox4B-0005Is-mW (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 14:43:41 +0100 Received: from login01.caesar.elte.hu ([157.181.151.130]) by mx3.mail.elte.hu with esmtp (Exim) id 1Sox3z-000757-6J from ; Wed, 11 Jul 2012 15:34:54 +0200 Received: (Authenticated sender: pgj) by login01.caesar.elte.hu with local (Exim 4.72) (envelope-from ) id 1Sox3y-0006JE-Ml; Wed, 11 Jul 2012 15:34:42 +0200 Date: Wed, 11 Jul 2012 15:34:42 +0200 From: PALI Gabor Janos To: Anil Madhavapeddy Subject: Re: camlSys__entry vs. FreeBSD kmod Message-ID: <20120711133442.GA23185@caesar.elte.hu> References: <20120711113001.GA5747@caesar.elte.hu> <9ECFF3CE-F144-4EE8-808C-86A78CED87CC@recoil.org> <20120711115220.GA12122@caesar.elte.hu> <20120711132020.GA20425@caesar.elte.hu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <20120711132020.GA20425@caesar.elte.hu> User-Agent: Mutt/1.5.20 (2009-06-14) Sender: Pali Gabor Janos X-ELTE-SpamScore: -2.0 X-ELTE-SpamLevel: X-ELTE-SpamCheck: no X-ELTE-SpamVersion: ELTE 2.0 X-ELTE-SpamCheck-Details: score=-2.0 required=5.9 tests=AWL, BAYES_00 autolearn=no SpamAssassin version=3.3.1 -2.0 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0002] 0.0 AWL AWL: From: address is in the auto white-list Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 13:43:41 -0000 X-Keywords: X-UID: 346 Status: O Content-Length: 377 Lines: 11 On Wed, Jul 11, 2012 at 03:20:20PM +0200, PALI Gabor Janos wrote: > ... > caml_startup(NULL); > main_closure = caml_named_value("main"); > if (!main_closure) bail_out(); > caml_callback(*main_closure, Val_int(42)); > ... Sorry, I have to correct myself: caml_startup() needs some sensible argument, i.e. a NULL-terminated array of strings. This is { "kmod", NULL } for now. From anil@recoil.org Wed Jul 11 15:23:33 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SoxpF-0006r2-B8 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 15:23:33 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:24444 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1SoxpE-0005BP-YG (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 15:23:33 +0100 Received: (qmail 9396 invoked by uid 634); 11 Jul 2012 14:23:32 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-143-229.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-143-229.eduroam.csx.cam.ac.uk) (128.232.143.229) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 11 Jul 2012 15:23:32 +0100 Subject: Re: camlSys__entry vs. FreeBSD kmod Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <20120711133442.GA23185@caesar.elte.hu> Date: Wed, 11 Jul 2012 15:23:30 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <608AB5AD-CAFC-4957-AB1E-F18090F022F3@recoil.org> References: <20120711113001.GA5747@caesar.elte.hu> <9ECFF3CE-F144-4EE8-808C-86A78CED87CC@recoil.org> <20120711115220.GA12122@caesar.elte.hu> <20120711132020.GA20425@caesar.elte.hu> <20120711133442.GA23185@caesar.elte.hu> To: PALI Gabor Janos X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 14:23:33 -0000 X-Keywords: X-UID: 347 Status: O Content-Length: 1855 Lines: 55 On 11 Jul 2012, at 14:34, PALI Gabor Janos wrote: > On Wed, Jul 11, 2012 at 03:20:20PM +0200, PALI Gabor Janos wrote: >> ... >> caml_startup(NULL); >> main_closure =3D caml_named_value("main"); >> if (!main_closure) bail_out(); >> caml_callback(*main_closure, Val_int(42)); >> ... >=20 > Sorry, I have to correct myself: caml_startup() needs some sensible = argument, > i.e. a NULL-terminated array of strings. This is { "kmod", NULL } for = now. Yes, that's correct, and so is your approach of calling a closure back from C into OCaml. The main-loop of the Xen kernel looks like this: (from = https://github.com/mirage/mirage-platform/blob/master/xen/runtime/kernel/m= ain.c) > caml_startup(argv); > v_main =3D caml_named_value("OS.Main.run"); > ASSERT(v_main !=3D NULL); > while (caml_completed =3D=3D 0) { > evtchn_poll(); > caml_completed =3D Bool_val(caml_callback(*v_main, Val_unit)); > } >=20 We first initialise the runtime, which runs one iteration of the program. However, this may leave a number of blocked cooperative = threads, and we do not yet have a return value. The main thread loop, in the 'run' function: https://github.com/mirage/mirage-platform/blob/master/xen/lib/main.ml ... will register the "OS.Main.run" callback when it is invoked, and=20 this callback will poll all the threads, and then return a boolean=20 indicating if they have all finished or not (and this is the = caml_completed loop in the C runtime). So we'll need to do something similar with the kFreeBSD backend: the = logic is in the OS.Main.run module in mirage-platform (which implements an OS module for either POSIX or Xen at the moment, and will have an extra directory for kFreeBSD with your kernel-specific bindings in it). Summary: the callbacks working and executing code in the kernel is a = very=20 good thing! :) -anil= From pgj@caesar.elte.hu Wed Jul 11 16:08:20 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SoyWa-0000KG-Mk (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 16:08:20 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [157.181.1.138 listed in list.dnswl.dnsbl.ja.net] * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mx3.mail.elte.hu ([157.181.1.138]:58599) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1SoyWX-00044y-qN (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 16:08:20 +0100 Received: from login01.caesar.elte.hu ([157.181.151.130]) by mx3.mail.elte.hu with esmtp (Exim) id 1SoyWW-0008FD-F8 from ; Wed, 11 Jul 2012 17:08:16 +0200 Received: (Authenticated sender: pgj) by login01.caesar.elte.hu with local (Exim 4.72) (envelope-from ) id 1SoyWV-0000c2-Qb; Wed, 11 Jul 2012 17:08:15 +0200 Date: Wed, 11 Jul 2012 17:08:15 +0200 From: PALI Gabor Janos To: Anil Madhavapeddy Subject: Re: camlSys__entry vs. FreeBSD kmod Message-ID: <20120711150815.GA25237@caesar.elte.hu> References: <20120711113001.GA5747@caesar.elte.hu> <9ECFF3CE-F144-4EE8-808C-86A78CED87CC@recoil.org> <20120711115220.GA12122@caesar.elte.hu> <20120711132020.GA20425@caesar.elte.hu> <20120711133442.GA23185@caesar.elte.hu> <608AB5AD-CAFC-4957-AB1E-F18090F022F3@recoil.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <608AB5AD-CAFC-4957-AB1E-F18090F022F3@recoil.org> User-Agent: Mutt/1.5.20 (2009-06-14) Sender: Pali Gabor Janos X-ELTE-SpamScore: -2.0 X-ELTE-SpamLevel: X-ELTE-SpamCheck: no X-ELTE-SpamVersion: ELTE 2.0 X-ELTE-SpamCheck-Details: score=-2.0 required=5.9 tests=BAYES_00 autolearn=no SpamAssassin version=3.3.1 -2.0 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 15:08:20 -0000 X-Keywords: X-UID: 348 Status: O Content-Length: 680 Lines: 19 On Wed, Jul 11, 2012 at 03:23:30PM +0100, Anil Madhavapeddy wrote: > the logic is in the OS.Main.run module in mirage-platform (which implements an OS > module for either POSIX or Xen at the moment, and will have an extra > directory for kFreeBSD with your kernel-specific bindings in it). Right, I then continue with the investigation of that. > Summary: the callbacks working and executing code in the kernel is a very > good thing! :) Yeah :-) By the way: is there some de-initialization routine for the caml run-time? After each kernel module unload, I got this fancy message: Warning: memory type caml leaked memory on destroy (10 allocations, 1581136 bytes leaked). From tm444@hermes.cam.ac.uk Wed Jul 11 16:55:08 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SozFs-0001Za-Qg (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 16:55:08 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: not scanned X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ravage.cl.cam.ac.uk ([128.232.1.17]:57244) by ppsw-51.csi.cam.ac.uk (smtp.hermes.cam.ac.uk [131.111.8.158]:25) with esmtpsa (PLAIN:tm444) (TLSv1:AES128-SHA:128) id 1SozFs-0000zT-Xr (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 16:55:08 +0100 From: Toby Moncaster Content-Type: multipart/alternative; boundary="Apple-Mail=_4ED82989-3A16-41AF-A292-F5EB605C5565" Subject: Compound TCP Date: Wed, 11 Jul 2012 16:55:07 +0100 Message-Id: <2D02EA96-8EF4-4096-852B-57FA4A52947F@cl.cam.ac.uk> To: cl-mirage@lists.cam.ac.uk Mime-Version: 1.0 (Apple Message framework v1278) X-Mailer: Apple Mail (2.1278) Sender: "T. Moncaster" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 15:55:08 -0000 X-Keywords: X-UID: 349 Status: O Content-Length: 1827 Lines: 32 --Apple-Mail=_4ED82989-3A16-41AF-A292-F5EB605C5565 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Hi All, not sure if anyone else has come across Microsoft's Compound TCP (which = I believe now ships as standard with Windows). It uses a combination of = delay-based and loss-based congestion controllers and is designed to = work in high-speed, long-distance networks without adversely affecting = the performance on slower or more congested networks. http://research.microsoft.com/en-us/projects/ctcp/ http://tools.ietf.org/html/draft-sridharan-tcpm-ctcp-02 http://en.wikipedia.org/wiki/Compound_TCP Toby --Apple-Mail=_4ED82989-3A16-41AF-A292-F5EB605C5565 Content-Transfer-Encoding: 7bit Content-Type: text/html; charset=us-ascii Hi All,

not sure if anyone else has come across Microsoft's Compound TCP (which I believe now ships as standard with Windows). It uses a combination of delay-based and loss-based congestion controllers and is designed to work in high-speed, long-distance networks without adversely affecting the performance on slower or more congested networks.




Toby


--Apple-Mail=_4ED82989-3A16-41AF-A292-F5EB605C5565-- From anil@recoil.org Wed Jul 11 17:03:19 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SozNn-0001mE-Kg (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 17:03:19 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:15435 helo=dark.recoil.org) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with smtp id 1SozNn-0000Mo-QT (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 17:03:19 +0100 Received: (qmail 6560 invoked by uid 634); 11 Jul 2012 16:03:19 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-143-229.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-143-229.eduroam.csx.cam.ac.uk) (128.232.143.229) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 11 Jul 2012 17:03:18 +0100 Subject: Re: camlSys__entry vs. FreeBSD kmod Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <20120711150815.GA25237@caesar.elte.hu> Date: Wed, 11 Jul 2012 17:03:17 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <5FE13EB0-3309-4A9C-9D6E-375EB4733A90@recoil.org> References: <20120711113001.GA5747@caesar.elte.hu> <9ECFF3CE-F144-4EE8-808C-86A78CED87CC@recoil.org> <20120711115220.GA12122@caesar.elte.hu> <20120711132020.GA20425@caesar.elte.hu> <20120711133442.GA23185@caesar.elte.hu> <608AB5AD-CAFC-4957-AB1E-F18090F022F3@recoil.org> <20120711150815.GA25237@caesar.elte.hu> To: PALI Gabor Janos X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 16:03:19 -0000 X-Keywords: X-UID: 350 Status: O Content-Length: 1334 Lines: 43 On 11 Jul 2012, at 16:08, PALI Gabor Janos wrote: > On Wed, Jul 11, 2012 at 03:23:30PM +0100, Anil Madhavapeddy wrote: >> the logic is in the OS.Main.run module in mirage-platform (which = implements an OS >> module for either POSIX or Xen at the moment, and will have an extra >> directory for kFreeBSD with your kernel-specific bindings in it). >=20 > Right, I then continue with the investigation of that. >=20 >=20 >> Summary: the callbacks working and executing code in the kernel is a = very=20 >> good thing! :) >=20 > Yeah :-) >=20 > By the way: is there some de-initialization routine for the caml = run-time? > After each kernel module unload, I got this fancy message: >=20 > Warning: memory type caml leaked memory on destroy (10 allocations, = 1581136 > bytes leaked). >=20 Good question; can the unload function call a cleanup function? It = would be nice to be able cancel outstanding Lwt threads, and do a Gc.compact to = free any external resources that have been locked. Finally, we need to track = all the memory allocated for the OCaml runtime and release that en-masse. = Can FreeBSD release all memory allocated to a particular pool? I don't = believe there is a caml_shutdown, but it is easy to modify the runtime to colour = pages that are intended for the OCaml runtime (see byterun/memory.c) -anil From anil@recoil.org Wed Jul 11 17:06:39 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SozR1-0001qG-3p (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 17:06:39 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:34650 helo=dark.recoil.org) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with smtp id 1SozQz-00053q-Sy (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 17:06:38 +0100 Received: (qmail 23479 invoked by uid 634); 11 Jul 2012 16:06:37 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-143-229.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-143-229.eduroam.csx.cam.ac.uk) (128.232.143.229) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 11 Jul 2012 17:06:37 +0100 Subject: Re: camlSys__entry vs. FreeBSD kmod Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <5FE13EB0-3309-4A9C-9D6E-375EB4733A90@recoil.org> Date: Wed, 11 Jul 2012 17:06:35 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <322A7ADA-4A91-4CA4-AB6E-DB8765229D4D@recoil.org> References: <20120711113001.GA5747@caesar.elte.hu> <9ECFF3CE-F144-4EE8-808C-86A78CED87CC@recoil.org> <20120711115220.GA12122@caesar.elte.hu> <20120711132020.GA20425@caesar.elte.hu> <20120711133442.GA23185@caesar.elte.hu> <608AB5AD-CAFC-4957-AB1E-F18090F022F3@recoil.org> <20120711150815.GA25237@caesar.elte.hu> <5FE13EB0-3309-4A9C-9D6E-375EB4733A90@recoil.org> To: PALI Gabor Janos X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 16:06:39 -0000 X-Keywords: X-UID: 351 Status: O Content-Length: 1704 Lines: 53 On 11 Jul 2012, at 17:03, Anil Madhavapeddy wrote: > On 11 Jul 2012, at 16:08, PALI Gabor Janos wrote: >=20 >> On Wed, Jul 11, 2012 at 03:23:30PM +0100, Anil Madhavapeddy wrote: >>> the logic is in the OS.Main.run module in mirage-platform (which = implements an OS >>> module for either POSIX or Xen at the moment, and will have an extra >>> directory for kFreeBSD with your kernel-specific bindings in it). >>=20 >> Right, I then continue with the investigation of that. >>=20 >>=20 >>> Summary: the callbacks working and executing code in the kernel is a = very=20 >>> good thing! :) >>=20 >> Yeah :-) >>=20 >> By the way: is there some de-initialization routine for the caml = run-time? >> After each kernel module unload, I got this fancy message: >>=20 >> Warning: memory type caml leaked memory on destroy (10 allocations, = 1581136 >> bytes leaked). >>=20 >=20 > Good question; can the unload function call a cleanup function? It = would be > nice to be able cancel outstanding Lwt threads, and do a Gc.compact to = free > any external resources that have been locked. Finally, we need to = track all > the memory allocated for the OCaml runtime and release that en-masse. = Can > FreeBSD release all memory allocated to a particular pool? I don't = believe > there is a caml_shutdown, but it is easy to modify the runtime to = colour pages > that are intended for the OCaml runtime (see byterun/memory.c) Incidentally, as a random tip, you might find it helpful to define = -DDEBUG, which will activate internal heap sanity checks and run them regularly. The = default Makefile builds libasmrund.a which has this already activated (and is = otherwise the same as libasmrun.a). -anil= From thomas.gazagnaire@gmail.com Wed Jul 11 17:28:03 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sozlj-0002JV-JS (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 17:28:03 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [74.125.82.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (thomas.gazagnaire[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-we0-f179.google.com ([74.125.82.179]:46632) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1Sozli-0006Ob-S0 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 17:28:03 +0100 Received: by weyx10 with SMTP id x10so851792wey.38 for ; Wed, 11 Jul 2012 09:28:02 -0700 (PDT) Received: by 10.216.218.220 with SMTP id k70mr16210168wep.165.1342024082393; Wed, 11 Jul 2012 09:28:02 -0700 (PDT) Received: from [172.20.10.2] (37-8-165-73.coucou-networks.fr. [37.8.165.73]) by mx.google.com with ESMTPS id ep14sm11652385wid.0.2012.07.11.09.27.45 (version=TLSv1/SSLv3 cipher=OTHER); Wed, 11 Jul 2012 09:28:01 -0700 (PDT) Subject: Re: version pinning in OPAM Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: Thomas Gazagnaire In-Reply-To: Date: Wed, 11 Jul 2012 18:27:29 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <689F1C7E-B102-48C0-B12B-819B66D34CAE@recoil.org> To: Anil Madhavapeddy X-Mailer: Apple Mail (2.1084) Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 16:28:03 -0000 X-Keywords: X-UID: 352 Status: O Content-Length: 1609 Lines: 45 I've pushed a first version of pinning support to my OPAM fork: = https://github.com/samoht/opam.git $ opam pin mirage 0.3dev # pin mirage to version = 0.3dev $ opam pin mirage /path/to/mirage # pin mirage to the content of = /path/to/mirage [cd /path/to/mirage && hack hack hack] $ opam update && opam upgrade $ opam pin mirage none I've done a limited amount of testing, and I'll integrate it upstream = when it works sufficiently enough to be used with mirage. I'll work on the upgrade to be able to upgrade just a collection of = packages instead of doing a full upgrade. -- Thomas On Jul 11, 2012, at 12:39 PM, Anil Madhavapeddy wrote: > On 11 Jul 2012, at 11:11, Thomas Gazagnaire wrote: >=20 >>=20 >>>> Is this convenient ? Would it be better to have "opam pin mirage = /local/path" instead (ie. no package version) and a more specific = update/upgrade command (like "opam pin -reinstall") to just upgrade the = pinned packages without having to do a full upgrade ? >>>=20 >>> The only problem I see with 'update && upgrade' is that you are = forced to upgrade all packages, including any other ones that came from = upstream. Not sure if that will be a problem in practise or not. >>=20 >> Yes that's exactly the problem with update/upgrade. Any better idea ? = 'opam pin -update' to update/rebuild only the pinned packages in one = step ? >=20 > This seems to be independent of the pinning support. Why not allow = 'opam update && opam upgrade lwt' to only update that package (and its = dependents that must be recompiled due to the new interface)? >=20 > -anil From pgj@caesar.elte.hu Wed Jul 11 18:47:51 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp10x-0003Tl-8u (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 18:47:51 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [157.181.151.9 listed in list.dnswl.dnsbl.ja.net] * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mx2.mail.elte.hu ([157.181.151.9]:43193) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1Sp10w-00030B-RL (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 18:47:51 +0100 Received: from login01.caesar.elte.hu ([157.181.151.130]) by mx2.mail.elte.hu with esmtp (Exim) id 1Sp0rD-0003DT-27 from ; Wed, 11 Jul 2012 19:37:49 +0200 Received: (Authenticated sender: pgj) by login01.caesar.elte.hu with local (Exim 4.72) (envelope-from ) id 1Sp0rB-0004tx-IZ; Wed, 11 Jul 2012 19:37:45 +0200 Date: Wed, 11 Jul 2012 19:37:45 +0200 From: PALI Gabor Janos To: Anil Madhavapeddy Subject: Re: camlSys__entry vs. FreeBSD kmod Message-ID: <20120711173745.GA2362@caesar.elte.hu> References: <20120711113001.GA5747@caesar.elte.hu> <9ECFF3CE-F144-4EE8-808C-86A78CED87CC@recoil.org> <20120711115220.GA12122@caesar.elte.hu> <20120711132020.GA20425@caesar.elte.hu> <20120711133442.GA23185@caesar.elte.hu> <608AB5AD-CAFC-4957-AB1E-F18090F022F3@recoil.org> <20120711150815.GA25237@caesar.elte.hu> <5FE13EB0-3309-4A9C-9D6E-375EB4733A90@recoil.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <5FE13EB0-3309-4A9C-9D6E-375EB4733A90@recoil.org> User-Agent: Mutt/1.5.20 (2009-06-14) Sender: Pali Gabor Janos X-ELTE-SpamScore: -2.0 X-ELTE-SpamLevel: X-ELTE-SpamCheck: no X-ELTE-SpamVersion: ELTE 2.0 X-ELTE-SpamCheck-Details: score=-2.0 required=5.9 tests=AWL, BAYES_00 autolearn=no SpamAssassin version=3.3.1 -2.0 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] 0.0 AWL AWL: From: address is in the auto white-list Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 17:47:51 -0000 X-Keywords: X-UID: 353 Status: O Content-Length: 850 Lines: 22 On Wed, Jul 11, 2012 at 05:03:17PM +0100, Anil Madhavapeddy wrote: > can the unload function call a cleanup function? Sure, every kernel module has an event handler function, so it can run code on various actions, including unloading the module. > It would be nice to be able cancel outstanding Lwt threads, and do a > Gc.compact to free any external resources that have been locked. Exactly. > Finally, we need to track all the memory allocated for the OCaml runtime and > release that en-masse. Can FreeBSD release all memory allocated to a particular > pool? I do not know (perhaps Robert does), but one has to specify for the kernel-level malloc() a "memory type" -- so, in theory, the kernel may track memory allocated for different types. (Probably that is how it spots leaked memory and emits a warning on that.) I will look it up. From anil@recoil.org Wed Jul 11 18:52:56 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp15s-0003a4-AX (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 18:52:56 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:16359 helo=dark.recoil.org) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with smtp id 1Sp15r-0005EF-S1 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 18:52:56 +0100 Received: (qmail 29678 invoked by uid 634); 11 Jul 2012 17:52:55 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-129-20.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-129-20.eduroam.csx.cam.ac.uk) (128.232.129.20) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 11 Jul 2012 18:52:55 +0100 Subject: Re: version pinning in OPAM Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Wed, 11 Jul 2012 18:52:43 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <4828EC23-528E-47C8-8A13-F9B2FAF3DC91@recoil.org> References: <689F1C7E-B102-48C0-B12B-819B66D34CAE@recoil.org> To: Thomas Gazagnaire X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 17:52:56 -0000 X-Keywords: X-UID: 354 Status: O Content-Length: 1871 Lines: 54 Great! I've switched my OPAM over to your tree for now and will try this out. I'll be on/offline at a conference tomorrow in Oxford. -anil On 11 Jul 2012, at 17:27, Thomas Gazagnaire wrote: > I've pushed a first version of pinning support to my OPAM fork: = https://github.com/samoht/opam.git >=20 > $ opam pin mirage 0.3dev # pin mirage to version = 0.3dev > $ opam pin mirage /path/to/mirage # pin mirage to the content of = /path/to/mirage > [cd /path/to/mirage && hack hack hack] > $ opam update && opam upgrade > $ opam pin mirage none >=20 > I've done a limited amount of testing, and I'll integrate it upstream = when it works sufficiently enough to be used with mirage. >=20 > I'll work on the upgrade to be able to upgrade just a collection of = packages instead of doing a full upgrade. >=20 > -- > Thomas >=20 > On Jul 11, 2012, at 12:39 PM, Anil Madhavapeddy wrote: >=20 >> On 11 Jul 2012, at 11:11, Thomas Gazagnaire wrote: >>=20 >>>=20 >>>>> Is this convenient ? Would it be better to have "opam pin mirage = /local/path" instead (ie. no package version) and a more specific = update/upgrade command (like "opam pin -reinstall") to just upgrade the = pinned packages without having to do a full upgrade ? >>>>=20 >>>> The only problem I see with 'update && upgrade' is that you are = forced to upgrade all packages, including any other ones that came from = upstream. Not sure if that will be a problem in practise or not. >>>=20 >>> Yes that's exactly the problem with update/upgrade. Any better idea = ? 'opam pin -update' to update/rebuild only the pinned packages in one = step ? >>=20 >> This seems to be independent of the pinning support. Why not allow = 'opam update && opam upgrade lwt' to only update that package (and its = dependents that must be recompiled due to the new interface)? >>=20 >> -anil >=20 >=20 From balraj885@gmail.com Wed Jul 11 19:03:00 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp1Fc-0003mV-A1 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 19:03:00 +0100 X-Cam-AntiVirus: no malware found X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wi0-f173.google.com ([209.85.212.173]:44053) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1Sp1Bq-0000J6-pP (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 19:03:00 +0100 Received: by wibhm6 with SMTP id hm6so4291301wib.2 for ; Wed, 11 Jul 2012 10:59:06 -0700 (PDT) MIME-Version: 1.0 Received: by 10.216.42.65 with SMTP id i43mr2153986web.208.1342029546702; Wed, 11 Jul 2012 10:59:06 -0700 (PDT) Sender: balraj885@gmail.com Received: by 10.194.13.134 with HTTP; Wed, 11 Jul 2012 10:59:06 -0700 (PDT) In-Reply-To: <2D02EA96-8EF4-4096-852B-57FA4A52947F@cl.cam.ac.uk> References: <2D02EA96-8EF4-4096-852B-57FA4A52947F@cl.cam.ac.uk> Date: Wed, 11 Jul 2012 18:59:06 +0100 X-Google-Sender-Auth: nTfprIsVIkaHcI3zid_t98AV8eA Message-ID: Subject: Re: Compound TCP From: Balraj Singh To: Mirage List Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 18:03:00 -0000 X-Keywords: X-UID: 355 Status: O Content-Length: 1675 Lines: 42 It looks like Compound TCP is an improvement to TCP Vegas. Essentially, TCP Vegas measures RTT precisely to detect when buffering starts. It then uses a couple of magic numbers to set how much buffering to maintain in the network. By playing with the magic numbers it can be made more or less aggressive compared to TCP Reno (the reference). FastTCP is a variant in which the window is adjusted in a cleverer manner so that it reaches it's steady state more quickly. It looks like Compound TCP uses both TCP Vegas style RTT based window adjustment for the bottom part of the window and TCP Reno style AIMD with pkt loss based window adjustment for the top part of the window. I can see how this can give the big benefits of TCP Vegas (I like TCP Vegas) and at the same time be able to deal well with pkt loss and be fair with other TCP Renos. So compound here I think is in the sense of both Vegas and Reno in the same TCP flow, but I don't think it has much bearing on multipath TCP, though I could be misunderstanding somethign obvious. Balraj On Wed, Jul 11, 2012 at 4:55 PM, Toby Moncaster wrote: > Hi All, > > not sure if anyone else has come across Microsoft's Compound TCP (which I > believe now ships as standard with Windows). It uses a combination of > delay-based and loss-based congestion controllers and is designed to work in > high-speed, long-distance networks without adversely affecting the > performance on slower or more congested networks. > > http://research.microsoft.com/en-us/projects/ctcp/ > > http://tools.ietf.org/html/draft-sridharan-tcpm-ctcp-02 > > http://en.wikipedia.org/wiki/Compound_TCP > > Toby > > From tm444@hermes.cam.ac.uk Wed Jul 11 19:15:07 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp1RL-0003uW-Kv (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 19:15:07 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: not scanned X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from [82.132.237.150] (port=51292 helo=[10.103.141.179]) by ppsw-51.csi.cam.ac.uk (smtp.hermes.cam.ac.uk [131.111.8.158]:587) with esmtpsa (PLAIN:tm444) (TLSv1:AES128-SHA:128) id 1Sp1RK-0002QK-ZK (Exim 4.72) (return-path ); Wed, 11 Jul 2012 19:15:07 +0100 References: <2D02EA96-8EF4-4096-852B-57FA4A52947F@cl.cam.ac.uk> In-Reply-To: Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Message-Id: X-Mailer: iPhone Mail (9B206) From: Toby Moncaster Subject: Re: Compound TCP Date: Wed, 11 Jul 2012 19:15:00 +0100 To: Balraj Singh Sender: "T. Moncaster" Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 18:15:07 -0000 X-Keywords: X-UID: 356 Status: O Content-Length: 2029 Lines: 53 Definitely no direct bearing on MPTCP but it is interesting as it shows ms i= s prepared to put more complex stuff in their stack. And it is also relevant= to our polyversal tcp On 11 Jul 2012, at 18:59, Balraj Singh wrote: > It looks like Compound TCP is an improvement to TCP Vegas. > Essentially, TCP Vegas measures RTT precisely to detect when buffering > starts. It then uses a couple of magic numbers to set how much > buffering to maintain in the network. By playing with the magic > numbers it can be made more or less aggressive compared to TCP Reno > (the reference). FastTCP is a variant in which the window is adjusted > in a cleverer manner so that it reaches it's steady state more > quickly. >=20 > It looks like Compound TCP uses both TCP Vegas style RTT based window > adjustment for the bottom part of the window and TCP Reno style AIMD > with pkt loss based window adjustment for the top part of the window. > I can see how this can give the big benefits of TCP Vegas (I like TCP > Vegas) and at the same time be able to deal well with pkt loss and be > fair with other TCP Renos. So compound here I think is in the sense > of both Vegas and Reno in the same TCP flow, but I don't think it has > much bearing on multipath TCP, though I could be misunderstanding > somethign obvious. >=20 > Balraj >=20 >=20 > On Wed, Jul 11, 2012 at 4:55 PM, Toby Moncaster > wrote: >> Hi All, >>=20 >> not sure if anyone else has come across Microsoft's Compound TCP (which I= >> believe now ships as standard with Windows). It uses a combination of >> delay-based and loss-based congestion controllers and is designed to work= in >> high-speed, long-distance networks without adversely affecting the >> performance on slower or more congested networks. >>=20 >> http://research.microsoft.com/en-us/projects/ctcp/ >>=20 >> http://tools.ietf.org/html/draft-sridharan-tcpm-ctcp-02 >>=20 >> http://en.wikipedia.org/wiki/Compound_TCP >>=20 >> Toby >>=20 >>=20 >=20 From anil@recoil.org Wed Jul 11 19:21:28 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp1XU-0003xK-EE (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 19:21:28 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:4511 helo=dark.recoil.org) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with smtp id 1Sp1XT-0005eZ-S2 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 19:21:28 +0100 Received: (qmail 13027 invoked by uid 634); 11 Jul 2012 18:21:27 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-129-20.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-129-20.eduroam.csx.cam.ac.uk) (128.232.129.20) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 11 Jul 2012 19:21:27 +0100 Subject: Re: Compound TCP Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Wed, 11 Jul 2012 19:21:26 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <2D02EA96-8EF4-4096-852B-57FA4A52947F@cl.cam.ac.uk> To: Toby Moncaster X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Balraj Singh , Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 18:21:28 -0000 X-Keywords: X-UID: 357 Status: O Content-Length: 2679 Lines: 74 Indeed; Compound TCP appears to try to find the best of both congestion worlds, but doesn't explicitly negotiate options during connection SYN time. This does remind me than another TODO list that Dave and I have at some point is to put support for vchan back into Mirage, so we can benchmark the shared memory vs TCP interdomain throughput with Mirage = applications. We're definitely going to use more 'userland' CPU than the highly tuned C Linux/FreeBSD stacks, so it'll be interesting to see the impact of = this. -anil On 11 Jul 2012, at 19:15, Toby Moncaster wrote: > Definitely no direct bearing on MPTCP but it is interesting as it = shows ms is prepared to put more complex stuff in their stack. And it is = also relevant to our polyversal tcp >=20 >=20 >=20 > On 11 Jul 2012, at 18:59, Balraj Singh wrote: >=20 >> It looks like Compound TCP is an improvement to TCP Vegas. >> Essentially, TCP Vegas measures RTT precisely to detect when = buffering >> starts. It then uses a couple of magic numbers to set how much >> buffering to maintain in the network. By playing with the magic >> numbers it can be made more or less aggressive compared to TCP Reno >> (the reference). FastTCP is a variant in which the window is = adjusted >> in a cleverer manner so that it reaches it's steady state more >> quickly. >>=20 >> It looks like Compound TCP uses both TCP Vegas style RTT based window >> adjustment for the bottom part of the window and TCP Reno style AIMD >> with pkt loss based window adjustment for the top part of the window. >> I can see how this can give the big benefits of TCP Vegas (I like TCP >> Vegas) and at the same time be able to deal well with pkt loss and be >> fair with other TCP Renos. So compound here I think is in the sense >> of both Vegas and Reno in the same TCP flow, but I don't think it has >> much bearing on multipath TCP, though I could be misunderstanding >> somethign obvious. >>=20 >> Balraj >>=20 >>=20 >> On Wed, Jul 11, 2012 at 4:55 PM, Toby Moncaster >> wrote: >>> Hi All, >>>=20 >>> not sure if anyone else has come across Microsoft's Compound TCP = (which I >>> believe now ships as standard with Windows). It uses a combination = of >>> delay-based and loss-based congestion controllers and is designed to = work in >>> high-speed, long-distance networks without adversely affecting the >>> performance on slower or more congested networks. >>>=20 >>> http://research.microsoft.com/en-us/projects/ctcp/ >>>=20 >>> http://tools.ietf.org/html/draft-sridharan-tcpm-ctcp-02 >>>=20 >>> http://en.wikipedia.org/wiki/Compound_TCP >>>=20 >>> Toby >>>=20 >>>=20 >>=20 >=20 From anil@recoil.org Wed Jul 11 19:40:27 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp1pr-00049K-QF (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 19:40:27 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:17703 helo=dark.recoil.org) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with smtp id 1Sp1pr-0007uh-Pr (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 19:40:27 +0100 Received: (qmail 10264 invoked by uid 634); 11 Jul 2012 18:40:26 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-129-20.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-129-20.eduroam.csx.cam.ac.uk) (128.232.129.20) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 11 Jul 2012 19:40:26 +0100 From: Anil Madhavapeddy Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: TCP wait_for transmit question Date: Wed, 11 Jul 2012 19:40:18 +0100 Message-Id: <9DA79A9D-B448-419C-9217-43688C56A4A2@recoil.org> To: Mirage List Mime-Version: 1.0 (Apple Message framework v1278) X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Balraj Singh X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 18:40:27 -0000 X-Keywords: X-UID: 358 Status: O Content-Length: 622 Lines: 15 Haris just raised an interesting point on IRC. He wants to limit the = amount of data sent on TCP write, which is normally done via = TCP.Pcb.write_wait_for . This function calls the User_buffer.TX, which clamps it to the TX = transmit window, which we ideally want to keep full at all times. Do we need another function to wait for space to be free in the = TX.User_buffer (if it's greater than max_size), which will more closely = match the UNIX write(2) semantics? That is, write works until the = transmit buffer is full, providing the TCP stack with more leeway to = schedule on-the-wire packets. -anil= From kosmo.zb@gmail.com Wed Jul 11 20:17:32 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp2Pk-0004Sa-Pl (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 20:17:32 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.212.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (kosmo.zb[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wi0-f179.google.com ([209.85.212.179]:62856) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1Sp2Ph-0005E4-Ru (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 20:17:32 +0100 Received: by wibhq4 with SMTP id hq4so1134755wib.2 for ; Wed, 11 Jul 2012 12:17:29 -0700 (PDT) MIME-Version: 1.0 Received: by 10.180.100.35 with SMTP id ev3mr267133wib.10.1342034249342; Wed, 11 Jul 2012 12:17:29 -0700 (PDT) Sender: kosmo.zb@gmail.com Received: by 10.217.3.68 with HTTP; Wed, 11 Jul 2012 12:17:29 -0700 (PDT) Date: Wed, 11 Jul 2012 12:17:29 -0700 X-Google-Sender-Auth: 8FJAadn3Aoo_e1gqevTbm21LcLE Message-ID: Subject: opam build error on Debian 6.0 "squeeze" From: David Sheets To: Mirage List Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 19:17:32 -0000 X-Keywords: X-UID: 359 Status: O Content-Length: 2343 Lines: 66 Hello, On a fresh Debian 6.0 "squeeze" pv xen vps image, I do $ sudo apt-get install build-essential ocaml ocaml-native-compilers camlp4-extra git $ git clone git://github.com/OCamlPro/opam.git $ cd opam && make from then I see make clone make[1]: Entering directory `/home/sheets/opam' make -C src_ext make[2]: Entering directory `/home/sheets/opam/src_ext' make[2]: Nothing to be done for `all'. make[2]: Leaving directory `/home/sheets/opam/src_ext' make[1]: Leaving directory `/home/sheets/opam' make compile make[1]: Entering directory `/home/sheets/opam' ./_obuild/unixrun ./boot/ocp-build.boot -init -scan -sanitize ocp-build: Entering directory `/home/sheets/opam' Cache: 428 digests loaded [723.1] BEGIN 'ocamlc.opt' '-c' '-o' '/home/sheets/opam/_obuild/723/debcudf.cmo' '-for-pack' 'Debian' '-I' './_obuild/dose/Debian' '-I' './_obuild/dose' '-I' './src_ext' '-I' './_obuild/extlib' '-I' './_obuild/cudf' '-I' './_obuild/graph' '-I' './_obuild/re_perl' '-I' '.' '-pp' 'camlp4o Camlp4MacroParser.cmo' 'src_ext/dose/deb/debcudf.ml' [723.1] END ocamlc.opt -c -o /home/sheets/opam/_obuild/723/debcudf.cmo -for-pack Debian -I ./_obuild/dose/Debian -I ./_obuild/dose -I ./src_ext -I ./_obuild/extlib -I ./_obuild/cudf -I ./_obuild/graph -I ./_obuild/re_perl -I . -pp camlp4o Camlp4MacroParser.cmo src_ext/dose/deb/debcudf.ml Command stderr: File "src_ext/dose/deb/debcudf.ml", line 194, characters 13-26: Error: Unbound value SMap.bindings [723.1] ERROR in project dose Error, exception Unix_error(No such file or directory, stat, _obuild/dose/Debian/debcudf.cmo) in rule_executed Warning: 380 rules waiting in queue ! 2 errors. 1 commands executed, 1 files generated. Error: Target _obuild/dose/Debian/debcudf.cmo not built Error: [723.1] ocamlc.opt -c -o /home/sheets/opam/_obuild/723/debcudf.cmo -for-pack Debian -I ./_obuild/dose/Debian -I ./_obuild/dose -I ./src_ext -I ./_obuild/extlib -I ./_obuild/cudf -I ./_obuild/graph -I ./_obuild/re_perl -I . -pp camlp4o Camlp4MacroParser.cmo src_ext/dose/deb/debcudf.ml File "src_ext/dose/deb/debcudf.ml", line 194, characters 13-26: Error: Unbound value SMap.bindings make[1]: *** [compile] Error 2 make[1]: Leaving directory `/home/sheets/opam' make: *** [all] Error 2 What am I missing? Thanks, David From balraj885@gmail.com Wed Jul 11 21:36:16 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp3dw-0004zx-Tp (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 21:36:16 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.5 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.212.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (balraj885[at]gmail.com) * 0.2 FREEMAIL_ENVFROM_END_DIGIT Envelope-from freemail username ends in * digit (balraj885[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wi0-f179.google.com ([209.85.212.179]:54099) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1Sp3dw-0005Qx-nk (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 21:36:16 +0100 Received: by wibhq4 with SMTP id hq4so1187641wib.2 for ; Wed, 11 Jul 2012 13:36:16 -0700 (PDT) MIME-Version: 1.0 Received: by 10.180.14.193 with SMTP id r1mr22647999wic.19.1342038976225; Wed, 11 Jul 2012 13:36:16 -0700 (PDT) Sender: balraj885@gmail.com Received: by 10.194.13.134 with HTTP; Wed, 11 Jul 2012 13:36:16 -0700 (PDT) Date: Wed, 11 Jul 2012 21:36:16 +0100 X-Google-Sender-Auth: rktj-zufuni-RIBbjmaJ_3HUat8 Message-ID: Subject: Fwd: tcp write performance testing From: Balraj Singh To: Mirage List Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 20:36:17 -0000 X-Keywords: X-UID: 360 Status: O Content-Length: 726 Lines: 17 A quick update on tcp performance after the recent code refactoring: TCP read speeds have gone down from about 1 Gb/s between VMs on the same host to about 450 Mb/s. It looks like this is because of a flow control / pkt dispatch problem. TCP write seems to have a more serious problem that it is sending pkts outside the available window - these pkts are dropped as expected and then the stack spends most of the time re-xmiting and recovering from the losses. It looks like the write calls succeed instead of failing or blocking when there is no window available. So if you are using it, expect TCP to be very fragile for now. Also it looks like DHCP is not working and there is a small race condition in ARP. Balraj From balraj885@gmail.com Wed Jul 11 22:06:46 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp47S-0005G3-Sn (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 22:06:46 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.5 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.212.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (balraj885[at]gmail.com) * 0.2 FREEMAIL_ENVFROM_END_DIGIT Envelope-from freemail username ends in * digit (balraj885[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wi0-f179.google.com ([209.85.212.179]:58500) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1Sp47R-0008NI-Ro (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 22:06:46 +0100 Received: by wibhq4 with SMTP id hq4so1207862wib.2 for ; Wed, 11 Jul 2012 14:06:45 -0700 (PDT) MIME-Version: 1.0 Received: by 10.180.14.193 with SMTP id r1mr22832006wic.19.1342040805247; Wed, 11 Jul 2012 14:06:45 -0700 (PDT) Sender: balraj885@gmail.com Received: by 10.194.13.134 with HTTP; Wed, 11 Jul 2012 14:06:45 -0700 (PDT) In-Reply-To: <9DA79A9D-B448-419C-9217-43688C56A4A2@recoil.org> References: <9DA79A9D-B448-419C-9217-43688C56A4A2@recoil.org> Date: Wed, 11 Jul 2012 22:06:45 +0100 X-Google-Sender-Auth: QfyxcVuqo97TVnSc9EGsEoODxHg Message-ID: Subject: Re: TCP wait_for transmit question From: Balraj Singh To: Anil Madhavapeddy Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 21:06:47 -0000 X-Keywords: X-UID: 361 Status: O Content-Length: 1771 Lines: 51 This is what the write buffer is supposed to do and it definitely improves overall performance. It allows the app and tcp to not be in lock step. The app can dump a chunk of data to be sent in the write buffer, when tcp gets acks that open up the window it has data ready to be sent. This buffer also needed to implement Nagle's algorithm. This is what was implemented: When the app does a write: if (write buffer is not empty) { if (adding pkt to buffer will make the total bytes buffered more than a configured max value) { block till buffer becomes available, then attempt a write again } else { add pkt to buffer and return } } else { if (window is available) { send pkt and return } else { add pkt to write buffer and return } } and when an ack clears some window: if (there are pkts in write buffer) { remove and send pkts from buffer upto available window; wake up any threads waiting for buffer to become available } On Wed, Jul 11, 2012 at 7:40 PM, Anil Madhavapeddy wrote: > Haris just raised an interesting point on IRC. He wants to limit the amo= unt of data sent on TCP write, which is normally done via TCP.Pcb.write_wai= t_for . > > This function calls the User_buffer.TX, which clamps it to the TX transmi= t window, which we ideally want to keep full at all times. > > Do we need another function to wait for space to be free in the TX.User_b= uffer (if it's greater than max_size), which will more closely match the UN= IX write(2) semantics? That is, write works until the transmit buffer is f= ull, providing the TCP stack with more leeway to schedule on-the-wire packe= ts. > > -anil From thomas.gazagnaire@gmail.com Wed Jul 11 23:52:32 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp5lo-00061n-Ke (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 23:52:32 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [74.125.82.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (thomas.gazagnaire[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-we0-f179.google.com ([74.125.82.179]:65350) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1Sp5ln-0003e5-qd (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 11 Jul 2012 23:52:32 +0100 Received: by weyx10 with SMTP id x10so1072651wey.38 for ; Wed, 11 Jul 2012 15:52:31 -0700 (PDT) Received: by 10.180.97.106 with SMTP id dz10mr50748590wib.21.1342047151005; Wed, 11 Jul 2012 15:52:31 -0700 (PDT) Received: from [10.75.183.97] (37-8-167-142.coucou-networks.fr. [37.8.167.142]) by mx.google.com with ESMTPS id j6sm8447431wiy.4.2012.07.11.15.52.27 (version=TLSv1/SSLv3 cipher=OTHER); Wed, 11 Jul 2012 15:52:29 -0700 (PDT) References: In-Reply-To: Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Message-Id: <85EB565A-74A4-4EE4-8AC1-49DE68420E9C@gmail.com> X-Mailer: iPhone Mail (9B206) From: Thomas Gazagnaire Subject: Re: opam build error on Debian 6.0 "squeeze" Date: Thu, 12 Jul 2012 00:52:25 +0200 To: David Sheets Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 22:52:32 -0000 X-Keywords: X-UID: 362 Status: O Content-Length: 2634 Lines: 77 Which version of ocaml are you using ? -- Thomas Le 11 juil. 2012 =C3=A0 21:17, David Sheets a =C3=A9cr= it : > Hello, >=20 > On a fresh Debian 6.0 "squeeze" pv xen vps image, I do >=20 > $ sudo apt-get install build-essential ocaml ocaml-native-compilers > camlp4-extra git > $ git clone git://github.com/OCamlPro/opam.git > $ cd opam && make >=20 > from >=20 > then I see >=20 > make clone > make[1]: Entering directory `/home/sheets/opam' > make -C src_ext > make[2]: Entering directory `/home/sheets/opam/src_ext' > make[2]: Nothing to be done for `all'. > make[2]: Leaving directory `/home/sheets/opam/src_ext' > make[1]: Leaving directory `/home/sheets/opam' > make compile > make[1]: Entering directory `/home/sheets/opam' > ./_obuild/unixrun ./boot/ocp-build.boot -init -scan -sanitize > ocp-build: Entering directory `/home/sheets/opam' > Cache: 428 digests loaded > [723.1] BEGIN 'ocamlc.opt' '-c' '-o' > '/home/sheets/opam/_obuild/723/debcudf.cmo' '-for-pack' 'Debian' '-I' > './_obuild/dose/Debian' '-I' './_obuild/dose' '-I' './src_ext' '-I' > './_obuild/extlib' '-I' './_obuild/cudf' '-I' './_obuild/graph' '-I' > './_obuild/re_perl' '-I' '.' '-pp' 'camlp4o Camlp4MacroParser.cmo' > 'src_ext/dose/deb/debcudf.ml' > [723.1] END ocamlc.opt -c -o > /home/sheets/opam/_obuild/723/debcudf.cmo -for-pack Debian -I > ./_obuild/dose/Debian -I ./_obuild/dose -I ./src_ext -I > ./_obuild/extlib -I ./_obuild/cudf -I ./_obuild/graph -I > ./_obuild/re_perl -I . -pp camlp4o Camlp4MacroParser.cmo > src_ext/dose/deb/debcudf.ml > Command stderr: > File "src_ext/dose/deb/debcudf.ml", line 194, characters 13-26: > Error: Unbound value SMap.bindings > [723.1] ERROR in project dose > Error, exception Unix_error(No such file or directory, stat, > _obuild/dose/Debian/debcudf.cmo) in rule_executed > Warning: 380 rules waiting in queue ! > 2 errors. 1 commands executed, 1 files generated. > Error: > Target _obuild/dose/Debian/debcudf.cmo not built > Error: > [723.1] ocamlc.opt -c -o /home/sheets/opam/_obuild/723/debcudf.cmo > -for-pack Debian -I ./_obuild/dose/Debian -I ./_obuild/dose -I > ./src_ext -I ./_obuild/extlib -I ./_obuild/cudf -I ./_obuild/graph -I > ./_obuild/re_perl -I . -pp camlp4o Camlp4MacroParser.cmo > src_ext/dose/deb/debcudf.ml > File "src_ext/dose/deb/debcudf.ml", line 194, characters 13-26: > Error: Unbound value SMap.bindings >=20 > make[1]: *** [compile] Error 2 > make[1]: Leaving directory `/home/sheets/opam' > make: *** [all] Error 2 >=20 > What am I missing? >=20 > Thanks, >=20 > David >=20 From kosmo.zb@gmail.com Thu Jul 12 00:19:52 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp6CG-0006KG-Nh (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 00:19:52 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score 0.2 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.212.173 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (kosmo.zb[at]gmail.com) * 0.0 DKIM_ADSP_CUSTOM_MED No valid author signature, adsp_override is * CUSTOM_MED * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid * 0.9 NML_ADSP_CUSTOM_MED ADSP custom_med hit, and not from a mailing * list X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wi0-f173.google.com ([209.85.212.173]:44618) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1Sp6CF-0001TE-ZJ (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 00:19:52 +0100 Received: by wibhm6 with SMTP id hm6so4490202wib.2 for ; Wed, 11 Jul 2012 16:19:51 -0700 (PDT) MIME-Version: 1.0 Received: by 10.180.94.163 with SMTP id dd3mr7756877wib.10.1342048791635; Wed, 11 Jul 2012 16:19:51 -0700 (PDT) Received: by 10.217.3.68 with HTTP; Wed, 11 Jul 2012 16:19:51 -0700 (PDT) In-Reply-To: <85EB565A-74A4-4EE4-8AC1-49DE68420E9C@gmail.com> References: <85EB565A-74A4-4EE4-8AC1-49DE68420E9C@gmail.com> Date: Wed, 11 Jul 2012 16:19:51 -0700 Message-ID: Subject: Re: opam build error on Debian 6.0 "squeeze" From: David Sheets To: Thomas Gazagnaire Content-Type: text/plain; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 23:19:52 -0000 X-Keywords: X-UID: 363 Status: O Content-Length: 3145 Lines: 93 On Wed, Jul 11, 2012 at 3:52 PM, Thomas Gazagnaire wrote: > Which version of ocaml are you using ? ocaml 3.11.2-2 which is in the default apt repo for squeeze. I guess I need 3.12? It doesn't appear to be in squeeze-backports, unfortunately. Unless you know of an apt repo with OCaml 3.12 that is compatible with squeeze, perhaps squeeze compat should be removed from install-opam.md? At least, a requirement of 3.12 should be inserted. Or is this a 0xff0000 herring? David > -- > Thomas > > > Le 11 juil. 2012 =E0 21:17, David Sheets a =E9crit = : > >> Hello, >> >> On a fresh Debian 6.0 "squeeze" pv xen vps image, I do >> >> $ sudo apt-get install build-essential ocaml ocaml-native-compilers >> camlp4-extra git >> $ git clone git://github.com/OCamlPro/opam.git >> $ cd opam && make >> >> from >> >> then I see >> >> make clone >> make[1]: Entering directory `/home/sheets/opam' >> make -C src_ext >> make[2]: Entering directory `/home/sheets/opam/src_ext' >> make[2]: Nothing to be done for `all'. >> make[2]: Leaving directory `/home/sheets/opam/src_ext' >> make[1]: Leaving directory `/home/sheets/opam' >> make compile >> make[1]: Entering directory `/home/sheets/opam' >> ./_obuild/unixrun ./boot/ocp-build.boot -init -scan -sanitize >> ocp-build: Entering directory `/home/sheets/opam' >> Cache: 428 digests loaded >> [723.1] BEGIN 'ocamlc.opt' '-c' '-o' >> '/home/sheets/opam/_obuild/723/debcudf.cmo' '-for-pack' 'Debian' '-I' >> './_obuild/dose/Debian' '-I' './_obuild/dose' '-I' './src_ext' '-I' >> './_obuild/extlib' '-I' './_obuild/cudf' '-I' './_obuild/graph' '-I' >> './_obuild/re_perl' '-I' '.' '-pp' 'camlp4o Camlp4MacroParser.cmo' >> 'src_ext/dose/deb/debcudf.ml' >> [723.1] END ocamlc.opt -c -o >> /home/sheets/opam/_obuild/723/debcudf.cmo -for-pack Debian -I >> ./_obuild/dose/Debian -I ./_obuild/dose -I ./src_ext -I >> ./_obuild/extlib -I ./_obuild/cudf -I ./_obuild/graph -I >> ./_obuild/re_perl -I . -pp camlp4o Camlp4MacroParser.cmo >> src_ext/dose/deb/debcudf.ml >> Command stderr: >> File "src_ext/dose/deb/debcudf.ml", line 194, characters 13-26: >> Error: Unbound value SMap.bindings >> [723.1] ERROR in project dose >> Error, exception Unix_error(No such file or directory, stat, >> _obuild/dose/Debian/debcudf.cmo) in rule_executed >> Warning: 380 rules waiting in queue ! >> 2 errors. 1 commands executed, 1 files generated. >> Error: >> Target _obuild/dose/Debian/debcudf.cmo not built >> Error: >> [723.1] ocamlc.opt -c -o /home/sheets/opam/_obuild/723/debcudf.cmo >> -for-pack Debian -I ./_obuild/dose/Debian -I ./_obuild/dose -I >> ./src_ext -I ./_obuild/extlib -I ./_obuild/cudf -I ./_obuild/graph -I >> ./_obuild/re_perl -I . -pp camlp4o Camlp4MacroParser.cmo >> src_ext/dose/deb/debcudf.ml >> File "src_ext/dose/deb/debcudf.ml", line 194, characters 13-26: >> Error: Unbound value SMap.bindings >> >> make[1]: *** [compile] Error 2 >> make[1]: Leaving directory `/home/sheets/opam' >> make: *** [all] Error 2 >> >> What am I missing? >> >> Thanks, >> >> David >> > From anil@recoil.org Thu Jul 12 00:31:54 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp6Nu-0006UM-QE (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 00:31:54 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:21231 helo=dark.recoil.org) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with smtp id 1Sp6Nu-00086v-ni (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 00:31:54 +0100 Received: (qmail 27939 invoked by uid 634); 11 Jul 2012 23:31:54 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Thu, 12 Jul 2012 00:31:53 +0100 Subject: Re: tcp write performance testing Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=iso-8859-1 From: Anil Madhavapeddy In-Reply-To: Date: Thu, 12 Jul 2012 00:31:51 +0100 Content-Transfer-Encoding: 7bit Message-Id: <492B6EDC-9C1F-4D18-8264-1C60582C8B04@recoil.org> References: To: Balraj Singh X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 23:31:54 -0000 X-Keywords: X-UID: 364 Status: O Content-Length: 1101 Lines: 27 On 11 Jul 2012, at 21:36, Balraj Singh wrote: > A quick update on tcp performance after the recent code refactoring: > > TCP read speeds have gone down from about 1 Gb/s between VMs on the > same host to about 450 Mb/s. It looks like this is because of a flow > control / pkt dispatch problem. TCP write seems to have a more > serious problem that it is sending pkts outside the available window - > these pkts are dropped as expected and then the stack spends most of > the time re-xmiting and recovering from the losses. It looks like the > write calls succeed instead of failing or blocking when there is no > window available. > > So if you are using it, expect TCP to be very fragile for now. Also > it looks like DHCP is not working and there is a small race condition > in ARP. Thanks for running those tests Balraj! I did the port from Bitstring to Cstruct as a huge patch, and so I'm not surprised if I introduced small changes in the way that writes are acked from the OS to Net interfaces. I'll see if I can reproduce some of the problems on UNIX in Cosener's tomorrow... -anil From anil@recoil.org Thu Jul 12 00:48:10 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp6de-0006as-8L (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 00:48:10 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:47124 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1Sp6dd-0006C2-Wo (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 00:48:10 +0100 Received: (qmail 15843 invoked by uid 634); 11 Jul 2012 23:48:09 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Thu, 12 Jul 2012 00:48:08 +0100 Subject: Re: TCP wait_for transmit question Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=iso-8859-1 From: Anil Madhavapeddy In-Reply-To: Date: Thu, 12 Jul 2012 00:48:06 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <574FA81B-75CC-40AD-A696-186D9899195E@recoil.org> References: <9DA79A9D-B448-419C-9217-43688C56A4A2@recoil.org> To: Balraj Singh X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 23:48:10 -0000 X-Keywords: X-UID: 365 Status: O Content-Length: 1724 Lines: 51 On 11 Jul 2012, at 22:06, Balraj Singh wrote: > This is what the write buffer is supposed to do and it definitely > improves overall performance. It allows the app and tcp to not be in > lock step. The app can dump a chunk of data to be sent in the write > buffer, when tcp gets acks that open up the window it has data ready > to be sent. This buffer also needed to implement Nagle's algorithm. >=20 > This is what was implemented: >=20 > When the app does a write: >=20 > if (write buffer is not empty) { > if (adding pkt to buffer will make the total bytes buffered > more than a configured max value) { > block till buffer becomes available, then attempt a write = again It's this above logic (blocking until the buffer becomes available) that = I was trying to spot. The code excerpt from user_buffer.ml is: match Lwt_sequence.is_empty t.buffer && (l =3D mss || not (Window.tx_inflight t.wnd)) with | false -> t.bufbytes <- Int32.add t.bufbytes l; List.iter (fun data -> ignore(Lwt_sequence.add_r data t.buffer)) = datav; if t.bufbytes < mss then return () else clear_buffer t So if the buffer is not empty and we have enough, it clears the buffer. = However, where is the check against max_size if the amount of total buffered data = increases to a large amount? I can't see any path where the t.writers blocking set = is appended to except in the wait_for_* functions. Haris, was your test case just calling Tcp.Pcb.write continuously and = finding that it ran out of memory? In that case, it may be a regression that is the same problem as the ARP = race condition (the OS.Netif.write is now too asynchronous). -anil= From h.rotsos@gmail.com Thu Jul 12 00:58:02 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp6nC-0006eb-Rg (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 00:58:02 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.7 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.213.54 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (h.rotsos[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-yw0-f54.google.com ([209.85.213.54]:39054) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1Sp6nB-0001mE-YW (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 00:58:02 +0100 Received: by yhfs35 with SMTP id s35so2241699yhf.41 for ; Wed, 11 Jul 2012 16:58:01 -0700 (PDT) MIME-Version: 1.0 Received: by 10.66.73.70 with SMTP id j6mr85738716pav.5.1342051080348; Wed, 11 Jul 2012 16:58:00 -0700 (PDT) Sender: h.rotsos@gmail.com Received: by 10.142.172.2 with HTTP; Wed, 11 Jul 2012 16:58:00 -0700 (PDT) In-Reply-To: References: <9DA79A9D-B448-419C-9217-43688C56A4A2@recoil.org> Date: Wed, 11 Jul 2012 16:58:00 -0700 X-Google-Sender-Auth: Sl86_-dliXJREac61KvjtDeW8Ag Message-ID: Subject: Re: TCP wait_for transmit question From: Haris Rotsos To: Balraj Singh Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: Mirage List , Anil Madhavapeddy X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 11 Jul 2012 23:58:02 -0000 X-Keywords: X-UID: 366 Status: O Content-Length: 4354 Lines: 144 Looking at the code there is the following logic: an application will call Channel.write_buffer or write_string to write data to the socket: channel.ml:180 let write_buffer t buf =3D queue_obuf t; t.obufq <- buf :: t.obufq (* Queue the active write buffer onto the write queue, resizing the * view if necessary to the correct size. *) let queue_obuf t =3D match t.obuf with |None -> () |Some buf when Cstruct.len buf =3D t.opos -> (* obuf is full *) t.obufq <- buf :: t.obufq; t.obuf <- None |Some buf when t.opos =3D 0 -> (* obuf wasnt ever used, so discard *) t.obuf <- None |Some buf -> (* partially filled obuf, so resize *) let buf =3D Cstruct.sub buf 0 t.opos in t.obufq <- buf :: t.obufq; t.obuf <- None then in order to push the data out to the the networks the flush method should be called: let rec flush t =3D queue_obuf t; let l =3D List.rev t.obufq in t.obufq <- []; Flow.writev t.flow l the blocking call in the closure is Flow.writev. which does the following: let writev t views =3D Tcp.Pcb.writev t views let writev pcb data =3D User_buffer.Tx.write pcb.utx data module Tx : let write t datav =3D let l =3D lenv datav in let mss =3D Int32.of_int (Window.tx_mss t.wnd) in match Lwt_sequence.is_empty t.buffer && (l =3D mss || not (Window.tx_inflight t.wnd)) with | false -> t.bufbytes <- Int32.add t.bufbytes l; List.iter (fun data -> ignore(Lwt_sequence.add_r data t.buffer)) datav; if t.bufbytes < mss then return () else clear_buffer t | true -> let avail_len =3D available_cwnd t in match avail_len < l with | true -> t.bufbytes <- Int32.add t.bufbytes l; List.iter (fun data -> ignore(Lwt_sequence.add_r data t.buffer)) datav; return () | false -> let max_size =3D Window.tx_mss t.wnd in transmit_segments ~mss:max_size ~txq:t.txq datav so the most of the time the write will end up in the false case of the first match. I nthis closure if I write constantly 1460 bytes packet segments, then the call will never block right? Maybe an additional blocking check on the buffer size should be added in order to cover this case? On 11 July 2012 14:06, Balraj Singh wrote: > This is what the write buffer is supposed to do and it definitely > improves overall performance. It allows the app and tcp to not be in > lock step. The app can dump a chunk of data to be sent in the write > buffer, when tcp gets acks that open up the window it has data ready > to be sent. This buffer also needed to implement Nagle's algorithm. > > This is what was implemented: > > When the app does a write: > > if (write buffer is not empty) { > if (adding pkt to buffer will make the total bytes buffered > more than a configured max value) { > block till buffer becomes available, then attempt a write again > } else { > add pkt to buffer and return > } > } else { > if (window is available) { > send pkt and return > } else { > add pkt to write buffer and return > } > } > > > and when an ack clears some window: > > if (there are pkts in write buffer) { > remove and send pkts from buffer upto available window; > wake up any threads waiting for buffer to become available > } > > > > On Wed, Jul 11, 2012 at 7:40 PM, Anil Madhavapeddy wrot= e: >> Haris just raised an interesting point on IRC. He wants to limit the am= ount of data sent on TCP write, which is normally done via TCP.Pcb.write_wa= it_for . >> >> This function calls the User_buffer.TX, which clamps it to the TX transm= it window, which we ideally want to keep full at all times. >> >> Do we need another function to wait for space to be free in the TX.User_= buffer (if it's greater than max_size), which will more closely match the U= NIX write(2) semantics? That is, write works until the transmit buffer is = full, providing the TCP stack with more leeway to schedule on-the-wire pack= ets. >> >> -anil > --=20 Charalampos Rotsos PhD student The University of Cambridge Computer Laboratory William Gates Building JJ Thomson Avenue Cambridge CB3 0FD Phone: +44-(0) 1223 767032 Email: cr409@cl.cam.ac.uk From anil@recoil.org Thu Jul 12 01:02:56 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp6rw-0006j1-NX (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 01:02:56 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:8555 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1Sp6rv-0002qU-YJ (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 01:02:56 +0100 Received: (qmail 15829 invoked by uid 634); 12 Jul 2012 00:02:55 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Thu, 12 Jul 2012 01:02:54 +0100 Subject: Re: TCP wait_for transmit question Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Thu, 12 Jul 2012 01:02:52 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <8736DCCD-CAFE-420A-B1E7-DB0BECB83564@recoil.org> References: <9DA79A9D-B448-419C-9217-43688C56A4A2@recoil.org> To: Haris Rotsos X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Balraj Singh , Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Jul 2012 00:02:56 -0000 X-Keywords: X-UID: 367 Status: O Content-Length: 4871 Lines: 156 That sounds right to me. I think we need to block the write call in the TCP module if the output buffer is full, and not in the Channel module (which can and will have other transport mechanisms such as vchan). -anil On 12 Jul 2012, at 00:58, Haris Rotsos wrote: > Looking at the code there is the following logic: >=20 > an application will call Channel.write_buffer or write_string to write > data to the socket: >=20 > channel.ml:180 > let write_buffer t buf =3D > queue_obuf t; > t.obufq <- buf :: t.obufq >=20 > (* Queue the active write buffer onto the write queue, resizing the > * view if necessary to the correct size. *) > let queue_obuf t =3D > match t.obuf with > |None -> () > |Some buf when Cstruct.len buf =3D t.opos -> (* obuf is full *) > t.obufq <- buf :: t.obufq; > t.obuf <- None > |Some buf when t.opos =3D 0 -> (* obuf wasnt ever used, so discard *) > t.obuf <- None > |Some buf -> (* partially filled obuf, so resize *) > let buf =3D Cstruct.sub buf 0 t.opos in > t.obufq <- buf :: t.obufq; > t.obuf <- None >=20 > then in order to push the data out to the the networks the flush > method should be called: >=20 > let rec flush t =3D > queue_obuf t; > let l =3D List.rev t.obufq in > t.obufq <- []; > Flow.writev t.flow l >=20 > the blocking call in the closure is Flow.writev. which does the = following: >=20 > let writev t views =3D > Tcp.Pcb.writev t views >=20 > let writev pcb data =3D User_buffer.Tx.write pcb.utx data >=20 > module Tx : > let write t datav =3D > let l =3D lenv datav in > let mss =3D Int32.of_int (Window.tx_mss t.wnd) in > match Lwt_sequence.is_empty t.buffer && > (l =3D mss || not (Window.tx_inflight t.wnd)) with > | false -> > t.bufbytes <- Int32.add t.bufbytes l; > List.iter (fun data -> ignore(Lwt_sequence.add_r data t.buffer)) > datav; > if t.bufbytes < mss then > return () > else > clear_buffer t > | true -> > let avail_len =3D available_cwnd t in > match avail_len < l with > | true -> > t.bufbytes <- Int32.add t.bufbytes l; > List.iter (fun data -> ignore(Lwt_sequence.add_r data > t.buffer)) datav; > return () > | false -> > let max_size =3D Window.tx_mss t.wnd in > transmit_segments ~mss:max_size ~txq:t.txq datav >=20 > so the most of the time the write will end up in the false case of the > first match. I nthis closure if I write constantly 1460 bytes packet > segments, then the call will never block right? >=20 > Maybe an additional blocking check on the buffer size should be added > in order to cover this case? >=20 >=20 > On 11 July 2012 14:06, Balraj Singh wrote: >> This is what the write buffer is supposed to do and it definitely >> improves overall performance. It allows the app and tcp to not be in >> lock step. The app can dump a chunk of data to be sent in the write >> buffer, when tcp gets acks that open up the window it has data ready >> to be sent. This buffer also needed to implement Nagle's algorithm. >>=20 >> This is what was implemented: >>=20 >> When the app does a write: >>=20 >> if (write buffer is not empty) { >> if (adding pkt to buffer will make the total bytes buffered >> more than a configured max value) { >> block till buffer becomes available, then attempt a write = again >> } else { >> add pkt to buffer and return >> } >> } else { >> if (window is available) { >> send pkt and return >> } else { >> add pkt to write buffer and return >> } >> } >>=20 >>=20 >> and when an ack clears some window: >>=20 >> if (there are pkts in write buffer) { >> remove and send pkts from buffer upto available window; >> wake up any threads waiting for buffer to become available >> } >>=20 >>=20 >>=20 >> On Wed, Jul 11, 2012 at 7:40 PM, Anil Madhavapeddy = wrote: >>> Haris just raised an interesting point on IRC. He wants to limit = the amount of data sent on TCP write, which is normally done via = TCP.Pcb.write_wait_for . >>>=20 >>> This function calls the User_buffer.TX, which clamps it to the TX = transmit window, which we ideally want to keep full at all times. >>>=20 >>> Do we need another function to wait for space to be free in the = TX.User_buffer (if it's greater than max_size), which will more closely = match the UNIX write(2) semantics? That is, write works until the = transmit buffer is full, providing the TCP stack with more leeway to = schedule on-the-wire packets. >>>=20 >>> -anil >>=20 >=20 >=20 >=20 > --=20 > Charalampos Rotsos > PhD student > The University of Cambridge > Computer Laboratory > William Gates Building > JJ Thomson Avenue > Cambridge > CB3 0FD >=20 > Phone: +44-(0) 1223 767032 > Email: cr409@cl.cam.ac.uk >=20 From h.rotsos@gmail.com Thu Jul 12 01:03:20 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp6sK-0006jw-6U (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 01:03:20 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.160.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (h.rotsos[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-gh0-f179.google.com ([209.85.160.179]:63822) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1Sp6sI-00028l-ph (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 01:03:20 +0100 Received: by ghbg24 with SMTP id g24so1803434ghb.38 for ; Wed, 11 Jul 2012 17:03:17 -0700 (PDT) MIME-Version: 1.0 Received: by 10.66.77.7 with SMTP id o7mr55662590paw.37.1342051396953; Wed, 11 Jul 2012 17:03:16 -0700 (PDT) Sender: h.rotsos@gmail.com Received: by 10.142.172.2 with HTTP; Wed, 11 Jul 2012 17:03:16 -0700 (PDT) In-Reply-To: <574FA81B-75CC-40AD-A696-186D9899195E@recoil.org> References: <9DA79A9D-B448-419C-9217-43688C56A4A2@recoil.org> <574FA81B-75CC-40AD-A696-186D9899195E@recoil.org> Date: Wed, 11 Jul 2012 17:03:16 -0700 X-Google-Sender-Auth: lL-0agQ4sSobBwm7dT0Hz4qb46M Message-ID: Subject: Re: TCP wait_for transmit question From: Haris Rotsos To: Anil Madhavapeddy Content-Type: text/plain; charset=UTF-8 Cc: Balraj Singh , Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Jul 2012 00:03:20 -0000 X-Keywords: X-UID: 368 Status: O Content-Length: 2454 Lines: 72 On 11 July 2012 16:48, Anil Madhavapeddy wrote: > On 11 Jul 2012, at 22:06, Balraj Singh wrote: > >> This is what the write buffer is supposed to do and it definitely >> improves overall performance. It allows the app and tcp to not be in >> lock step. The app can dump a chunk of data to be sent in the write >> buffer, when tcp gets acks that open up the window it has data ready >> to be sent. This buffer also needed to implement Nagle's algorithm. >> >> This is what was implemented: >> >> When the app does a write: >> >> if (write buffer is not empty) { >> if (adding pkt to buffer will make the total bytes buffered >> more than a configured max value) { >> block till buffer becomes available, then attempt a write again > > It's this above logic (blocking until the buffer becomes available) that I was > trying to spot. The code excerpt from user_buffer.ml is: > > match Lwt_sequence.is_empty t.buffer && > (l = mss || not (Window.tx_inflight t.wnd)) with > | false -> > t.bufbytes <- Int32.add t.bufbytes l; > List.iter (fun data -> ignore(Lwt_sequence.add_r data t.buffer)) datav; > if t.bufbytes < mss then > return () > else > clear_buffer t > > So if the buffer is not empty and we have enough, it clears the buffer. However, > where is the check against max_size if the amount of total buffered data increases > to a large amount? I can't see any path where the t.writers blocking set is appended > to except in the wait_for_* functions. > > Haris, was your test case just calling Tcp.Pcb.write continuously and finding that > it ran out of memory? yes. And by the way, because the code is written over the ns3 simulation platform, I think the a call that that pushed packets to a network interface will never block. The simulation hasn't got this requirement fixed yet. This I guess in the case of xen or unix, will be handled with more care as the write may block and create naturally a context switch in the thread scheduler. > > In that case, it may be a regression that is the same problem as the ARP race > condition (the OS.Netif.write is now too asynchronous). why would that affect the arp functionality? > > -anil -- Charalampos Rotsos PhD student The University of Cambridge Computer Laboratory William Gates Building JJ Thomson Avenue Cambridge CB3 0FD Phone: +44-(0) 1223 767032 Email: cr409@cl.cam.ac.uk From anil@recoil.org Thu Jul 12 01:08:27 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sp6xH-0006mR-Jb (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 01:08:27 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:48219 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1Sp6xG-0006k4-XB (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 01:08:27 +0100 Received: (qmail 264 invoked by uid 634); 12 Jul 2012 00:08:26 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Thu, 12 Jul 2012 01:08:25 +0100 Subject: Re: TCP wait_for transmit question Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Thu, 12 Jul 2012 01:08:23 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <82955126-E8A5-48F0-B465-F53CCACCD973@recoil.org> References: <9DA79A9D-B448-419C-9217-43688C56A4A2@recoil.org> <574FA81B-75CC-40AD-A696-186D9899195E@recoil.org> To: Haris Rotsos X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Balraj Singh , Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Jul 2012 00:08:27 -0000 X-Keywords: X-UID: 369 Status: O Content-Length: 1280 Lines: 40 On 12 Jul 2012, at 01:03, Haris Rotsos wrote: >>=20 >> Haris, was your test case just calling Tcp.Pcb.write continuously and = finding that >> it ran out of memory? >=20 > yes. And by the way, because the code is written over the ns3 > simulation platform, I think the a call that that pushed packets to a > network interface will never block. The simulation hasn't got this > requirement fixed yet. >=20 > This I guess in the case of xen or unix, will be handled with more > care as the write may block and create naturally a context switch in > the thread scheduler. Definitely; the Xen Netif has a fixed set of rings slots, and the Unix = backend just uses (slow) blocking tuntap I/O. Both apply backpressure as a = result. >=20 >>=20 >> In that case, it may be a regression that is the same problem as the = ARP race >> condition (the OS.Netif.write is now too asynchronous). >=20 > why would that affect the arp functionality? Only because our ARP support is super-minimal, and doesn't have a = retransmit timer or anything. So you get one ARP query transmitted, and if it is = lost for any reason, we never retransmit. I saw a few cases where we got stuck = as a result. It's a quick job to add a retransmission timer to make it more = RFC-compliant though. -anil= From jac22@cl.cam.ac.uk Thu Jul 12 07:23:19 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SpCo3-000268-69 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 07:23:19 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -1.1 from SpamAssassin-3.3.2-1358082 * -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * 0.0 T_FRT_STOCK2 BODY: ReplaceTags: Stock (2) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mta0.cl.cam.ac.uk ([128.232.25.20]:52385) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1SpCo2-0001qW-pD (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 07:23:19 +0100 Received: from ssh-remote-0.cl.cam.ac.uk ([128.232.0.69] helo=cl.cam.ac.uk) by mta0.cl.cam.ac.uk with esmtp (Exim 4.63) (envelope-from ) id 1SpCo0-0002Rb-TP; Thu, 12 Jul 2012 07:23:16 +0100 To: Balraj Singh Subject: Re: Fwd: tcp write performance testing In-reply-to: References: Comments: In-reply-to Balraj Singh message dated "Wed, 11 Jul 2012 21:36:16 +0100." MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <28787.1342074196.1@cl.cam.ac.uk> Date: Thu, 12 Jul 2012 07:23:16 +0100 From: Jon Crowcroft Message-Id: Cc: Jon.Crowcroft@cl.cam.ac.uk, Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Jul 2012 06:23:19 -0000 X-Keywords: X-UID: 370 Status: O Content-Length: 1181 Lines: 33 doesn't write() on a socket have a non blocking option (e.g. setsockopt or ioctl to do non blocking) then you get EWOULDBLOCK if you write and the buffer is full its nice to have either behaviour for programing (so you can block th calling thread or not as programmer prefers)... In missive , Balraj Singh typed: >>A quick update on tcp performance after the recent code refactoring: >> >>TCP read speeds have gone down from about 1 Gb/s between VMs on the >>same host to about 450 Mb/s. It looks like this is because of a flow >>control / pkt dispatch problem. TCP write seems to have a more >>serious problem that it is sending pkts outside the available window - >>these pkts are dropped as expected and then the stack spends most of >>the time re-xmiting and recovering from the losses. It looks like the >>write calls succeed instead of failing or blocking when there is no >>window available. >> >>So if you are using it, expect TCP to be very fragile for now. Also >>it looks like DHCP is not working and there is a small race condition >>in ARP. >> >>Balraj >> cheers jon From thomas.gazagnaire@gmail.com Thu Jul 12 07:44:53 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SpD8v-0002gX-HY (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 07:44:53 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [74.125.82.51 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (thomas.gazagnaire[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wg0-f51.google.com ([74.125.82.51]:47706) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1SpD8u-0007Ws-nx (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 07:44:53 +0100 Received: by wgbed3 with SMTP id ed3so1375782wgb.20 for ; Wed, 11 Jul 2012 23:44:52 -0700 (PDT) Received: by 10.180.76.135 with SMTP id k7mr53195750wiw.7.1342075492243; Wed, 11 Jul 2012 23:44:52 -0700 (PDT) Received: from sud35-6-83-152-60-83.fbx.proxad.net (sud35-6-83-152-60-83.fbx.proxad.net. [83.152.60.83]) by mx.google.com with ESMTPS id t7sm11080327wix.6.2012.07.11.23.44.50 (version=TLSv1/SSLv3 cipher=OTHER); Wed, 11 Jul 2012 23:44:51 -0700 (PDT) Subject: Re: opam build error on Debian 6.0 "squeeze" Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=iso-8859-1 From: Thomas Gazagnaire In-Reply-To: Date: Thu, 12 Jul 2012 08:44:51 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <13DF8E68-0983-4812-B3B3-66B8B2C61A9B@gmail.com> References: <85EB565A-74A4-4EE4-8AC1-49DE68420E9C@gmail.com> To: David Sheets X-Mailer: Apple Mail (2.1084) Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Jul 2012 06:44:53 -0000 X-Keywords: X-UID: 371 Status: O Content-Length: 3545 Lines: 103 > ocaml 3.11.2-2 which is in the default apt repo for squeeze. >=20 > I guess I need 3.12? It doesn't appear to be in squeeze-backports, > unfortunately. yes, it seems that you need at least 3.12.0 to compile some = dependencies: $ man Map.S val bindings : 'a t -> (key * 'a) list Since 3.12.0 > Unless you know of an apt repo with OCaml 3.12 that is compatible with > squeeze, perhaps squeeze compat should be removed from > install-opam.md? At least, a requirement of 3.12 should be inserted. we hope to distribute more portable bytecode version of OPAM for = bootstrap later, but for now, yes we should write that in the reqs. I = guess the simplest thing for you is to install ocaml from sources = (http://caml.inria.fr/pub/distrib/ocaml-3.12/ocaml-3.12.0.tar.gz). -- Thomas >> -- >> Thomas >>=20 >>=20 >> Le 11 juil. 2012 =E0 21:17, David Sheets a = =E9crit : >>=20 >>> Hello, >>>=20 >>> On a fresh Debian 6.0 "squeeze" pv xen vps image, I do >>>=20 >>> $ sudo apt-get install build-essential ocaml ocaml-native-compilers >>> camlp4-extra git >>> $ git clone git://github.com/OCamlPro/opam.git >>> $ cd opam && make >>>=20 >>> from = >>>=20 >>> then I see >>>=20 >>> make clone >>> make[1]: Entering directory `/home/sheets/opam' >>> make -C src_ext >>> make[2]: Entering directory `/home/sheets/opam/src_ext' >>> make[2]: Nothing to be done for `all'. >>> make[2]: Leaving directory `/home/sheets/opam/src_ext' >>> make[1]: Leaving directory `/home/sheets/opam' >>> make compile >>> make[1]: Entering directory `/home/sheets/opam' >>> ./_obuild/unixrun ./boot/ocp-build.boot -init -scan -sanitize >>> ocp-build: Entering directory `/home/sheets/opam' >>> Cache: 428 digests loaded >>> [723.1] BEGIN 'ocamlc.opt' '-c' '-o' >>> '/home/sheets/opam/_obuild/723/debcudf.cmo' '-for-pack' 'Debian' = '-I' >>> './_obuild/dose/Debian' '-I' './_obuild/dose' '-I' './src_ext' '-I' >>> './_obuild/extlib' '-I' './_obuild/cudf' '-I' './_obuild/graph' '-I' >>> './_obuild/re_perl' '-I' '.' '-pp' 'camlp4o Camlp4MacroParser.cmo' >>> 'src_ext/dose/deb/debcudf.ml' >>> [723.1] END ocamlc.opt -c -o >>> /home/sheets/opam/_obuild/723/debcudf.cmo -for-pack Debian -I >>> ./_obuild/dose/Debian -I ./_obuild/dose -I ./src_ext -I >>> ./_obuild/extlib -I ./_obuild/cudf -I ./_obuild/graph -I >>> ./_obuild/re_perl -I . -pp camlp4o Camlp4MacroParser.cmo >>> src_ext/dose/deb/debcudf.ml >>> Command stderr: >>> File "src_ext/dose/deb/debcudf.ml", line 194, characters 13-26: >>> Error: Unbound value SMap.bindings >>> [723.1] ERROR in project dose >>> Error, exception Unix_error(No such file or directory, stat, >>> _obuild/dose/Debian/debcudf.cmo) in rule_executed >>> Warning: 380 rules waiting in queue ! >>> 2 errors. 1 commands executed, 1 files generated. >>> Error: >>> Target _obuild/dose/Debian/debcudf.cmo not built >>> Error: >>> [723.1] ocamlc.opt -c -o /home/sheets/opam/_obuild/723/debcudf.cmo >>> -for-pack Debian -I ./_obuild/dose/Debian -I ./_obuild/dose -I >>> ./src_ext -I ./_obuild/extlib -I ./_obuild/cudf -I ./_obuild/graph = -I >>> ./_obuild/re_perl -I . -pp camlp4o Camlp4MacroParser.cmo >>> src_ext/dose/deb/debcudf.ml >>> File "src_ext/dose/deb/debcudf.ml", line 194, characters 13-26: >>> Error: Unbound value SMap.bindings >>>=20 >>> make[1]: *** [compile] Error 2 >>> make[1]: Leaving directory `/home/sheets/opam' >>> make: *** [all] Error 2 >>>=20 >>> What am I missing? >>>=20 >>> Thanks, >>>=20 >>> David >>>=20 >>=20 From anil@recoil.org Thu Jul 12 11:00:50 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SpGCY-0000nA-AT (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 11:00:50 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * 0.0 T_FRT_STOCK2 BODY: ReplaceTags: Stock (2) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:21373 helo=dark.recoil.org) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with smtp id 1SpGCX-0000qK-rX (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 11:00:50 +0100 Received: (qmail 30896 invoked by uid 634); 12 Jul 2012 10:00:48 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED,T_FRT_STOCK2 X-Spam-Check-By: dark.recoil.org Received: from Unknown (HELO [130.246.255.206]) (130.246.255.206) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Thu, 12 Jul 2012 11:00:48 +0100 Subject: Re: tcp write performance testing Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Thu, 12 Jul 2012 11:00:45 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <04001E80-7334-4B56-86A2-1FBE8C08E8EF@recoil.org> References: To: Jon Crowcroft X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Balraj Singh , Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Jul 2012 10:00:50 -0000 X-Keywords: X-UID: 372 Status: O Content-Length: 1858 Lines: 68 Yeah; we don't need separate versions in Mirage since the blocking = thread can be manipulated as a first-class value, and composed and joined = separately. parallel: let x =3D write fd page1 in let y =3D write fd page2 in x <&> y serial: lwt x =3D write fd page1 in lwt y =3D write fd page2 in The type of the thread contains an 'Lwt.t' while it's potentially = blocking, and you have to pass it through a yield point before you can get the = value out. More on lightweight threads at: http://www.openmirage.org/wiki/tutorial-lwt -anil On 12 Jul 2012, at 07:23, Jon Crowcroft wrote: > doesn't write() on a socket have a non blocking option (e.g. > setsockopt or ioctl to do non blocking) then you get EWOULDBLOCK > if you write and the buffer is full >=20 > its nice to have either behaviour for programing (so you can block > th calling thread or not as programmer prefers)... >=20 > In missive = om>, Balraj Singh typed: >=20 >>> A quick update on tcp performance after the recent code refactoring: >>>=20 >>> TCP read speeds have gone down from about 1 Gb/s between VMs on the >>> same host to about 450 Mb/s. It looks like this is because of a = flow >>> control / pkt dispatch problem. TCP write seems to have a more >>> serious problem that it is sending pkts outside the available window = - >>> these pkts are dropped as expected and then the stack spends most of >>> the time re-xmiting and recovering from the losses. It looks like = the >>> write calls succeed instead of failing or blocking when there is no >>> window available. >>>=20 >>> So if you are using it, expect TCP to be very fragile for now. Also >>> it looks like DHCP is not working and there is a small race = condition >>> in ARP. >>>=20 >>> Balraj >>>=20 >=20 > cheers >=20 > jon >=20 >=20 From jac22@cl.cam.ac.uk Thu Jul 12 11:09:05 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SpGKX-0001GE-8C (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 11:09:05 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -1.1 from SpamAssassin-3.3.2-1358082 * -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * 0.0 T_FRT_STOCK2 BODY: ReplaceTags: Stock (2) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mta0.cl.cam.ac.uk ([128.232.25.20]:59292) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1SpGKW-0006XA-YO (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 11:09:05 +0100 Received: from ramsey.cl.cam.ac.uk ([128.232.1.219] helo=cl.cam.ac.uk) by mta0.cl.cam.ac.uk with esmtp (Exim 4.63) (envelope-from ) id 1SpGKR-0001Fr-0T; Thu, 12 Jul 2012 11:08:59 +0100 To: Anil Madhavapeddy Subject: Re: tcp write performance testing In-reply-to: <04001E80-7334-4B56-86A2-1FBE8C08E8EF@recoil.org> References: <04001E80-7334-4B56-86A2-1FBE8C08E8EF@recoil.org> Comments: In-reply-to Anil Madhavapeddy message dated "Thu, 12 Jul 2012 11:00:45 +0100." MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <9713.1342087738.1@cl.cam.ac.uk> Date: Thu, 12 Jul 2012 11:08:58 +0100 From: Jon Crowcroft Message-Id: Cc: Jon.Crowcroft@cl.cam.ac.uk, Balraj Singh , Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Jul 2012 10:09:05 -0000 X-Keywords: X-UID: 373 Status: O Content-Length: 2175 Lines: 78 suite:) In missive <04001E80-7334-4B56-86A2-1FBE8C08E8EF@recoil.org>, Anil Madhavapeddy typed: >>Yeah; we don't need separate versions in Mirage since the blocking = >>thread >>can be manipulated as a first-class value, and composed and joined = >>separately. >> >>parallel: >> >>let x =3D write fd page1 in >>let y =3D write fd page2 in >>x <&> y >> >>serial: >> >>lwt x =3D write fd page1 in >>lwt y =3D write fd page2 in >> >> >>The type of the thread contains an 'Lwt.t' while it's potentially = >>blocking, >>and you have to pass it through a yield point before you can get the = >>value >>out. More on lightweight threads at: >>http://www.openmirage.org/wiki/tutorial-lwt >> >>-anil >> >>On 12 Jul 2012, at 07:23, Jon Crowcroft wrote: >> >>> doesn't write() on a socket have a non blocking option (e.g. >>> setsockopt or ioctl to do non blocking) then you get EWOULDBLOCK >>> if you write and the buffer is full >>>=20 >>> its nice to have either behaviour for programing (so you can block >>> th calling thread or not as programmer prefers)... >>>=20 >>> In missive = >>>> om>, Balraj Singh typed: >>>=20 >>>>> A quick update on tcp performance after the recent code refactoring: >>>>>=20 >>>>> TCP read speeds have gone down from about 1 Gb/s between VMs on the >>>>> same host to about 450 Mb/s. It looks like this is because of a = >>flow >>>>> control / pkt dispatch problem. TCP write seems to have a more >>>>> serious problem that it is sending pkts outside the available window = >>- >>>>> these pkts are dropped as expected and then the stack spends most of >>>>> the time re-xmiting and recovering from the losses. It looks like = >>the >>>>> write calls succeed instead of failing or blocking when there is no >>>>> window available. >>>>>=20 >>>>> So if you are using it, expect TCP to be very fragile for now. Also >>>>> it looks like DHCP is not working and there is a small race = >>condition >>>>> in ARP. >>>>>=20 >>>>> Balraj >>>>>=20 >>>=20 >>> cheers >>>=20 >>> jon >>>=20 >>>=20 >> cheers jon From balraj885@gmail.com Thu Jul 12 21:06:41 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SpPer-0005pc-QP (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 21:06:41 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.5 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [74.125.82.48 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (balraj885[at]gmail.com) * 0.2 FREEMAIL_ENVFROM_END_DIGIT Envelope-from freemail username ends in * digit (balraj885[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wg0-f48.google.com ([74.125.82.48]:40223) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SpPeq-0006pF-Re (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 12 Jul 2012 21:06:41 +0100 Received: by wgbdq11 with SMTP id dq11so1671625wgb.5 for ; Thu, 12 Jul 2012 13:06:40 -0700 (PDT) MIME-Version: 1.0 Received: by 10.216.42.65 with SMTP id i43mr4694343web.208.1342123600203; Thu, 12 Jul 2012 13:06:40 -0700 (PDT) Sender: balraj885@gmail.com Received: by 10.194.13.134 with HTTP; Thu, 12 Jul 2012 13:06:40 -0700 (PDT) In-Reply-To: <82955126-E8A5-48F0-B465-F53CCACCD973@recoil.org> References: <9DA79A9D-B448-419C-9217-43688C56A4A2@recoil.org> <574FA81B-75CC-40AD-A696-186D9899195E@recoil.org> <82955126-E8A5-48F0-B465-F53CCACCD973@recoil.org> Date: Thu, 12 Jul 2012 21:06:40 +0100 X-Google-Sender-Auth: X8iISZ8mOrFgalr_eCmGuGlPxH0 Message-ID: Subject: Re: TCP wait_for transmit question From: Balraj Singh To: Anil Madhavapeddy Content-Type: text/plain; charset=ISO-8859-1 Cc: Mirage List , Haris Rotsos X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 12 Jul 2012 20:06:41 -0000 X-Keywords: X-UID: 374 Status: O Content-Length: 2465 Lines: 60 My mistake, yes User_buffer.write should block if the buffer is full, but it doesn't - it always succeeds. I can't remember why, but I put the check for buffer fullness in Flow.write (maybe there was something similar there earlier and I just modified it). Flow.write calls Tcp.Pcb.write which then calls User_buffer.write. For now if you use Flow.write it should work as required. But I agree that it should be moved to User_buffer.write, which should then block (or fail) if the buffer is full. Here is the current write from flow.ml and the particular check to see if the buffer has room is Tcp.Pcb.write_available: let rec write t view = let vlen = Bitstring.bitstring_length view / 8 in match Tcp.Pcb.write_available t with |0 -> (* block for window to open *) Tcp.Pcb.write_wait_for t 1 >> write t view |len when len < vlen -> (* do a short write *) let v' = Bitstring.subbitstring view 0 (len * 8) in Tcp.Pcb.write t v' >> write t (Bitstring.subbitstring view (len*8) ((vlen-len)*8)) |len -> (* full write *) Tcp.Pcb.write t view On Thu, Jul 12, 2012 at 1:08 AM, Anil Madhavapeddy wrote: > On 12 Jul 2012, at 01:03, Haris Rotsos wrote: >>> >>> Haris, was your test case just calling Tcp.Pcb.write continuously and finding that >>> it ran out of memory? >> >> yes. And by the way, because the code is written over the ns3 >> simulation platform, I think the a call that that pushed packets to a >> network interface will never block. The simulation hasn't got this >> requirement fixed yet. >> >> This I guess in the case of xen or unix, will be handled with more >> care as the write may block and create naturally a context switch in >> the thread scheduler. > > Definitely; the Xen Netif has a fixed set of rings slots, and the Unix backend > just uses (slow) blocking tuntap I/O. Both apply backpressure as a result. > >> >>> >>> In that case, it may be a regression that is the same problem as the ARP race >>> condition (the OS.Netif.write is now too asynchronous). >> >> why would that affect the arp functionality? > > Only because our ARP support is super-minimal, and doesn't have a retransmit > timer or anything. So you get one ARP query transmitted, and if it is lost for > any reason, we never retransmit. I saw a few cases where we got stuck as a > result. It's a quick job to add a retransmission timer to make it more RFC-compliant > though. > > -anil From avsm@dark.recoil.org Sat Jul 14 16:49:06 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sq4ag-0007Xl-8L (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 14 Jul 2012 16:49:06 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:32016 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1Sq4af-0004hX-Xr (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 14 Jul 2012 16:49:06 +0100 Received: (qmail 54 invoked by uid 10000); 14 Jul 2012 15:49:05 -0000 Date: Sat, 14 Jul 2012 16:49:04 +0100 From: 'Anil Madhavapeddy' To: Dave Scott Subject: Re: 64-bit bootloaders Message-ID: <20120714154904.GC14582@dark.recoil.org> References: <81A73678E76EA642801C8F2E4823AD21DAA0D8F363@LONPMAILBOX01.citrite.net> <68C47CE9-A551-4661-8771-7D2F44362869@recoil.org> <6676A06B-E868-4825-8F16-00F426825129@eu.citrix.com> <21DB758A-8A42-422F-AEDD-F126174A6FD3@recoil.org> <81A73678E76EA642801C8F2E4823AD21DAA0D8F369@LONPMAILBOX01.citrite.net> <81A73678E76EA642801C8F2E4823AD21DAA0D8F372@LONPMAILBOX01.citrite.net> <20120706105553.GB14575@dark.recoil.org> <81A73678E76EA642801C8F2E4823AD21DAA0D8F37B@LONPMAILBOX01.citrite.net> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <81A73678E76EA642801C8F2E4823AD21DAA0D8F37B@LONPMAILBOX01.citrite.net> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: "cl-mirage@lists.cam.ac.uk" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Jul 2012 15:49:06 -0000 X-Keywords: X-UID: 375 Status: O Content-Length: 2407 Lines: 55 On Mon, Jul 09, 2012 at 10:51:36AM +0100, Dave Scott wrote: > Hi, > > > On Thu, Jul 05, 2012 at 10:07:59PM +0100, Dave Scott wrote: > > > Hi, > > > > > > I downloaded the pre-prepared disk image and this worked just fine. I > > > think my misunderstanding was that boot16b.bin (bootsector on > > bootable > > > partition) loads pure64.sys from the FAT16 fs and then this reads > > > pure64.cfg which tells it to load kernel64.sys, switch to 64-bit and > > > jump. > > > > I didn't quite manage to parse this sentence. Is the above the correct > > state of affairs, or the result of your misunderstanding? :-) > > :) The current state is: (I think) > > 1. MBR loads bootsector of active partition (1) > 2. pure64's bootsector reads and executes pure64.sys from FAT16 > 3. pure64.sys reads pure64.cfg, reads and executes kernel64.sys from FAT16 > > My kernel64.sys is a mirage guest whose linker script just says, "write raw > binary output, putting the .text at 0x100000". I've arranged that > my new HVM startup function is right there. The mirage guest then: > > 1. uses CPUID to detect xen > 2. writes to the special MSR to have the hypercall page copied in > -- it then memcpy's this into the hypercall_page[] used by miniOS > -- hypercalls now work > 3. uses HVM_GET_PARAM to fetch the xenstore evtchn and pfn > 4. uses XENMEM_add_to_physmap to map the shared_info page > -- this allows event channel masking, time, vcpu info > > Plenty of debug console printing verifies that this is all working. (It's > quite fun to manipulate raw framebuffers -- I've not done that for years) > > So far so good. The next step is to set up the xen PCI device that is used > for event channel interrupt delivery. After that I've got to figure out how > best to handle interrupts. In an ideal world I would be able to bind all > interrupts (including those from the emulated hardware) to event channels and > then use the existing mirage Lwt/event channel loop. I don't know if this > is possible. That should be fine; just need to set flags for each of the devices, and then poll them from the Lwt main loop (just as we do with Xen evtchns). Incidentally, I've just ordered the serial UART to try out uBoot/RaspberryPi. It looks like a bare metal kernel on there is also fairly straightforward! http://kernelnomicon.org/?p=133 -- Anil Madhavapeddy http://anil.recoil.org From avsm@dark.recoil.org Sat Jul 14 17:10:43 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sq4vb-0007e1-Hy (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 14 Jul 2012 17:10:43 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:22437 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1Sq4va-0006Td-YW (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 14 Jul 2012 17:10:43 +0100 Received: (qmail 30773 invoked by uid 10000); 14 Jul 2012 16:10:42 -0000 Date: Sat, 14 Jul 2012 17:10:42 +0100 From: Anil Madhavapeddy To: Balraj Singh Subject: Re: TCP wait_for transmit question Message-ID: <20120714161042.GH14582@dark.recoil.org> References: <9DA79A9D-B448-419C-9217-43688C56A4A2@recoil.org> <574FA81B-75CC-40AD-A696-186D9899195E@recoil.org> <82955126-E8A5-48F0-B465-F53CCACCD973@recoil.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: Mirage List , Haris Rotsos X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 14 Jul 2012 16:10:43 -0000 X-Keywords: X-UID: 376 Status: O Content-Length: 3310 Lines: 82 Interesting; so this check is also clamped to the TX MSS (Tcp.Pcb.write_available) and not to the max_size of the application buffer. This is probably a good time to nail down the semantics of all these different modules, particularly as vchan/shmem will be coming along shortly. Channel: buffered I/O, manual flush required Flow: unbuffered I/O, will be triggered immediately Tcp.Pcb: buffered if delay writes are used, unbuffered with nodelay The TCP Nagle's buffer is necessary since only it knows if there are TX packets in flight, whereas the Channel module doesnt... -anil On Thu, Jul 12, 2012 at 09:06:40PM +0100, Balraj Singh wrote: > My mistake, yes User_buffer.write should block if the buffer is full, > but it doesn't - it always succeeds. I can't remember why, but I put > the check for buffer fullness in Flow.write (maybe there was something > similar there earlier and I just modified it). Flow.write calls > Tcp.Pcb.write which then calls User_buffer.write. For now if you use > Flow.write it should work as required. But I agree that it should be > moved to User_buffer.write, which should then block (or fail) if the > buffer is full. > > Here is the current write from flow.ml and the particular check to see > if the buffer has room is Tcp.Pcb.write_available: > > let rec write t view = > let vlen = Bitstring.bitstring_length view / 8 in > match Tcp.Pcb.write_available t with > |0 -> (* block for window to open *) > Tcp.Pcb.write_wait_for t 1 >> > write t view > |len when len < vlen -> (* do a short write *) > let v' = Bitstring.subbitstring view 0 (len * 8) in > Tcp.Pcb.write t v' >> > write t (Bitstring.subbitstring view (len*8) ((vlen-len)*8)) > |len -> (* full write *) > Tcp.Pcb.write t view > > > > On Thu, Jul 12, 2012 at 1:08 AM, Anil Madhavapeddy wrote: > > On 12 Jul 2012, at 01:03, Haris Rotsos wrote: > >>> > >>> Haris, was your test case just calling Tcp.Pcb.write continuously and finding that > >>> it ran out of memory? > >> > >> yes. And by the way, because the code is written over the ns3 > >> simulation platform, I think the a call that that pushed packets to a > >> network interface will never block. The simulation hasn't got this > >> requirement fixed yet. > >> > >> This I guess in the case of xen or unix, will be handled with more > >> care as the write may block and create naturally a context switch in > >> the thread scheduler. > > > > Definitely; the Xen Netif has a fixed set of rings slots, and the Unix backend > > just uses (slow) blocking tuntap I/O. Both apply backpressure as a result. > > > >> > >>> > >>> In that case, it may be a regression that is the same problem as the ARP race > >>> condition (the OS.Netif.write is now too asynchronous). > >> > >> why would that affect the arp functionality? > > > > Only because our ARP support is super-minimal, and doesn't have a retransmit > > timer or anything. So you get one ARP query transmitted, and if it is lost for > > any reason, we never retransmit. I saw a few cases where we got stuck as a > > result. It's a quick job to add a retransmission timer to make it more RFC-compliant > > though. > > > > -anil > -- Anil Madhavapeddy http://anil.recoil.org From amc79@cam.ac.uk Sun Jul 15 22:35:06 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SqWT4-0003Ia-TA (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sun, 15 Jul 2012 22:35:06 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: not scanned X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from cpc1-cmbg15-2-0-cust24.5-4.cable.virginmedia.com ([86.26.8.25]:56449 helo=[192.168.1.114]) by ppsw-43.csi.cam.ac.uk (smtp.hermes.cam.ac.uk [131.111.8.159]:587) with esmtpsa (PLAIN:amc79) (TLSv1:AES128-SHA:128) id 1SqWT3-00049P-oi (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sun, 15 Jul 2012 22:35:06 +0100 From: Amir Chaudhry Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: opam and brew upgrade Date: Sun, 15 Jul 2012 22:35:05 +0100 Message-Id: <7EAFFFD7-974A-4C30-9B50-A0F6CCF31C8E@cam.ac.uk> To: cl-mirage@lists.cam.ac.uk Mime-Version: 1.0 (Apple Message framework v1084) X-Mailer: Apple Mail (2.1084) X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Jul 2012 21:35:07 -0000 X-Keywords: X-UID: 377 Status: O Content-Length: 728 Lines: 25 Hi folks, Just ran brew update and then brew upgrade and got the following error. $ brew upgrade =3D=3D> Upgrading opam =3D=3D> Downloading https://github.com/OCamlPro/opam/tarball/0.2 = ######################################################################## = 100.0% Error: MD5 mismatch Expected: 3f08c3ee397c2ccd42e6d15533bdf958 Actual: 13931989b390821f0d9c822dbf266fcb Archive: /Users/Amir/Library/Caches/Homebrew/opam-0.2.tgz (To retry an incomplete download, remove the file above.) Is this due to muppetry on my part or did something get changed = somewhere? I installed opam via anil's original instructions and = haven't touched it since. What should I be doing wrt opam? ac From anil@recoil.org Sun Jul 15 22:49:00 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SqWgW-0003No-D8 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sun, 15 Jul 2012 22:49:00 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:14316 helo=dark.recoil.org) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with smtp id 1SqWgV-00082Z-nY (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sun, 15 Jul 2012 22:49:00 +0100 Received: (qmail 20557 invoked by uid 634); 15 Jul 2012 21:48:58 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.38]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Sun, 15 Jul 2012 22:48:58 +0100 Subject: Re: opam and brew upgrade Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <7EAFFFD7-974A-4C30-9B50-A0F6CCF31C8E@cam.ac.uk> Date: Sun, 15 Jul 2012 22:48:56 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <7EAFFFD7-974A-4C30-9B50-A0F6CCF31C8E@cam.ac.uk> To: Amir Chaudhry X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 15 Jul 2012 21:49:00 -0000 X-Keywords: X-UID: 378 Status: O Content-Length: 1146 Lines: 41 Thomas rebased the 0.2 distribution to fix a nasty bug, so the checksum = changed. I've updated the Mirage Homebrew tap, so if you try again, it should = work. There have been quite a few bugfixes in the HEAD version though, so you = might want to do 'brew install opam --HEAD' to get the very latest version. -anil On 15 Jul 2012, at 22:35, Amir Chaudhry wrote: > Hi folks, >=20 > Just ran brew update and then brew upgrade and got the following = error. >=20 > $ brew upgrade > =3D=3D> Upgrading opam > =3D=3D> Downloading https://github.com/OCamlPro/opam/tarball/0.2 > = ######################################################################## = 100.0% > Error: MD5 mismatch > Expected: 3f08c3ee397c2ccd42e6d15533bdf958 > Actual: 13931989b390821f0d9c822dbf266fcb > Archive: /Users/Amir/Library/Caches/Homebrew/opam-0.2.tgz > (To retry an incomplete download, remove the file above.) >=20 > Is this due to muppetry on my part or did something get changed = somewhere? I installed opam via anil's original instructions and = haven't touched it since. >=20 > What should I be doing wrt opam? >=20 > ac >=20 >=20 From Richard.Mortier@nottingham.ac.uk Mon Jul 16 10:36:46 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SqhjS-0001NH-P5 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 10:36:46 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ixe-mta-19-tx.emailfiltering.com ([194.116.198.150]:58472 helo=ixe-mta-19.emailfiltering.com) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SqhjM-00082X-Qv (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 10:36:46 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by ixe-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2314951056 ;5635e6a5867a7735; Mon, 16 Jul 2012 10:35:46 +0100 Received: from uiwexhub02.ad.nottingham.ac.uk ([128.243.15.132]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1SqhiU-0004UE-EF; Mon, 16 Jul 2012 10:35:46 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB02.ad.nottingham.ac.uk ([2002:80f3:f84::80f3:f84]) with mapi; Mon, 16 Jul 2012 10:35:38 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Mon, 16 Jul 2012 10:35:38 +0100 Subject: Re: TCP wait_for transmit question Thread-Topic: TCP wait_for transmit question Thread-Index: Ac1jNlvdQYyTwbk2TR2k45rCLwmH0Q== Message-ID: <450ADA26-D102-4505-B3B2-2F7DD5F54DD9@nottingham.ac.uk> References: <9DA79A9D-B448-419C-9217-43688C56A4A2@recoil.org> <574FA81B-75CC-40AD-A696-186D9899195E@recoil.org> <82955126-E8A5-48F0-B465-F53CCACCD973@recoil.org> <20120714161042.GH14582@dark.recoil.org> In-Reply-To: <20120714161042.GH14582@dark.recoil.org> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Balraj Singh , Haris Rotsos , Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Jul 2012 09:36:46 -0000 X-Keywords: X-UID: 379 Status: O Content-Length: 1676 Lines: 44 On 14 Jul 2012, at 17:10, Anil Madhavapeddy wrote: > Interesting; so this check is also clamped to the TX MSS > (Tcp.Pcb.write_available) and not to the max_size of the application > buffer. >=20 > This is probably a good time to nail down the semantics of all these > different modules, particularly as vchan/shmem will be coming along > shortly. >=20 > Channel: buffered I/O, manual flush required > Flow: unbuffered I/O, will be triggered immediately > Tcp.Pcb: buffered if delay writes are used, unbuffered with nodelay >=20 > The TCP Nagle's buffer is necessary since only it knows if there are TX > packets in flight, whereas the Channel module doesnt... naive question- what's the relationship between Tcp.Pcb and Flow then? ie.= , if i have a tcp connection underneath with nagling turned on, is my flow = genuinely unbuffered, or just mostly so? --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From avsm@dark.recoil.org Mon Jul 16 10:53:08 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SqhzI-0001qR-DK (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 10:53:08 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:2858 helo=dark.recoil.org) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with smtp id 1SqhzH-0001JZ-rh (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 10:53:08 +0100 Received: (qmail 32564 invoked by uid 10000); 16 Jul 2012 09:53:07 -0000 Date: Mon, 16 Jul 2012 10:53:07 +0100 From: Anil Madhavapeddy To: Richard Mortier Subject: Re: TCP wait_for transmit question Message-ID: <20120716095307.GA2496@dark.recoil.org> References: <9DA79A9D-B448-419C-9217-43688C56A4A2@recoil.org> <574FA81B-75CC-40AD-A696-186D9899195E@recoil.org> <82955126-E8A5-48F0-B465-F53CCACCD973@recoil.org> <20120714161042.GH14582@dark.recoil.org> <450ADA26-D102-4505-B3B2-2F7DD5F54DD9@nottingham.ac.uk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <450ADA26-D102-4505-B3B2-2F7DD5F54DD9@nottingham.ac.uk> User-Agent: Mutt/1.5.21 (2010-09-15) Cc: Balraj Singh , Mirage List , Haris Rotsos X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Jul 2012 09:53:08 -0000 X-Keywords: X-UID: 380 Status: O Content-Length: 2315 Lines: 50 On Mon, Jul 16, 2012 at 10:35:38AM +0100, Richard Mortier wrote: > > On 14 Jul 2012, at 17:10, Anil Madhavapeddy wrote: > > > Interesting; so this check is also clamped to the TX MSS > > (Tcp.Pcb.write_available) and not to the max_size of the application > > buffer. > > > > This is probably a good time to nail down the semantics of all these > > different modules, particularly as vchan/shmem will be coming along > > shortly. > > > > Channel: buffered I/O, manual flush required > > Flow: unbuffered I/O, will be triggered immediately > > Tcp.Pcb: buffered if delay writes are used, unbuffered with nodelay > > > > The TCP Nagle's buffer is necessary since only it knows if there are TX > > packets in flight, whereas the Channel module doesnt... > > naive question- what's the relationship between Tcp.Pcb and Flow then? > ie., if i have a tcp connection underneath with nagling turned on, is my > flow genuinely unbuffered, or just mostly so? Depends if your question is the current relationship, or the future relationship. 'Flow' is where non-TCP transports, such as vchan also sit, with the same API. 'Channel' is application-level buffering (manually flushed), whereas 'Tcp.Pcb' with nagling on would be stack-level buffering (since it has to detect tx-in-flight which the application can't see). It's an open question as to whether these buffers should be collapsed (particularly the TCP nagle, which could be exposed more generically through Flow). We also need to look closely at the impact of the various multipath transports before locking the Flow interface down, as it doesn't make much sense to design a single-stream application API for use on a fault-ridden cloud infrastructure. I'm thinking of systems like SST [1] and the SSH channel layer [2] as directions our interfaces should be headed in. For example, a multicasting block proxy VM for booting up 1000s of Windows VMs has been brought up by Dave in the past as a good evaluation for the Mirage stack. This VM would act as a blkfront for a real block device, cache blocks in RAM, and serve them up as copy-on-write RAMdisks to booting VMs. A very simple application from a Mirage perspective, but a complete host-killer from a Xen pov. [1] http://pdos.csail.mit.edu/uia/sst/ [2] http://tools.ietf.org/html/rfc4254 -anil From anil@recoil.org Mon Jul 16 13:59:40 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sqkto-0006SR-Lp (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 13:59:40 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:5734 helo=dark.recoil.org) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with smtp id 1Sqkto-0001Gb-Po (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 13:59:40 +0100 Received: (qmail 19870 invoked by uid 634); 16 Jul 2012 12:59:39 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-142-70.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-142-70.eduroam.csx.cam.ac.uk) (128.232.142.70) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Mon, 16 Jul 2012 13:59:39 +0100 From: Anil Madhavapeddy Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: dns/crypto-keys/opam Date: Mon, 16 Jul 2012 13:59:38 +0100 Message-Id: <86CB2060-2D16-41E1-8CBE-08B7D37E45E7@recoil.org> To: Mirage List Mime-Version: 1.0 (Apple Message framework v1278) X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Jul 2012 12:59:40 -0000 X-Keywords: X-UID: 381 Status: O Content-Length: 1145 Lines: 26 This one's mainly for Mort and Haris. I'm working my way through all = the libraries required to compile Signposts, and put stable versions up = on OPAM. I've taken all the forks of ocaml-dns and merged them (with the latest = version using cstruct) into http://github.com/mirage/ocaml-dns. Mort, = there seem to be a lot of commented out conversion functions in the = interfaces (packet.mli). Are these temporary or do you plan on putting = them back at some point? Haris, I've also adapted crypto-keys to = http://github.com/mirage/ocaml-crypto-keys so it works with this DNS = repo. A query about licensing and tidy-up before release: it is = currently GPL-2.0, which doesnt work for OCaml due to the static = linking. Could you modify it to ISC and add your copyright to each file = as with other code, so that it's suitable for release? There are also generally a few build warnings, so it would be good to go = through the code and make sure its suitable for release (e.g. there is a = hardcoded IP address in the default DNSSEC lookup in ocaml-crypto-keys). Good progress though; I should have the rest built very soon. -anil From anil@recoil.org Mon Jul 16 16:56:15 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sqneh-0004EH-Dy (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 16:56:15 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:25979 helo=dark.recoil.org) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with smtp id 1Sqneg-0002fw-RK (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 16:56:15 +0100 Received: (qmail 17691 invoked by uid 634); 16 Jul 2012 15:56:14 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-142-70.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-142-70.eduroam.csx.cam.ac.uk) (128.232.142.70) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Mon, 16 Jul 2012 16:56:13 +0100 Subject: Re: dns/crypto-keys/opam Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <20120716154211.GA3121@cr409-ThinkPad-T60p> Date: Mon, 16 Jul 2012 16:56:12 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <43B23F64-5332-4861-A6E3-4D10398C7D2F@recoil.org> References: <86CB2060-2D16-41E1-8CBE-08B7D37E45E7@recoil.org> <20120716154211.GA3121@cr409-ThinkPad-T60p> To: Haris Rotsos X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Jul 2012 15:56:15 -0000 X-Keywords: X-UID: 382 Status: O Content-Length: 3733 Lines: 96 On 16 Jul 2012, at 16:42, Haris Rotsos wrote: > On Mon, Jul 16, 2012 at 01:59:38PM +0100, Anil Madhavapeddy wrote: >> This one's mainly for Mort and Haris. I'm working my way through all = the libraries required to compile Signposts, and put stable versions up = on OPAM. >>=20 >> I've taken all the forks of ocaml-dns and merged them (with the = latest version using cstruct) into http://github.com/mirage/ocaml-dns. = Mort, there seem to be a lot of commented out conversion functions in = the interfaces (packet.mli). Are these temporary or do you plan on = putting them back at some point? >>=20 >> Haris, I've also adapted crypto-keys to = http://github.com/mirage/ocaml-crypto-keys so it works with this DNS = repo. A query about licensing and tidy-up before release: it is = currently GPL-2.0, which doesnt work for OCaml due to the static = linking. Could you modify it to ISC and add your copyright to each file = as with other code, so that it's suitable for release? >=20 > Are the other libraries also using the ISC copyright? No problem > to change the licence, I only need the small text we put on the top of > each source file.=20 Yeah, that's the default I use as it has the smallest amount of text that obscures the real code :-) Below is a sample bit of text from some other code (you just add on copyrights as you edit it) (* * Copyright (c) 2010-2012 Anil Madhavapeddy * Copyright (c) 2010-2011 Thomas Gazagnaire * * Permission to use, copy, modify, and distribute this software for any * purpose with or without fee is hereby granted, provided that the = above * copyright notice and this permission notice appear in all copies. * * THE SOFTWARE IS PROVIDED "AS IS" AND THE AUTHOR DISCLAIMS ALL = WARRANTIES * WITH REGARD TO THIS SOFTWARE INCLUDING ALL IMPLIED WARRANTIES OF * MERCHANTABILITY AND FITNESS. IN NO EVENT SHALL THE AUTHOR BE LIABLE = FOR * ANY SPECIAL, DIRECT, INDIRECT, OR CONSEQUENTIAL DAMAGES OR ANY = DAMAGES * WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER IN AN * ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION, ARISING OUT = OF * OR IN CONNECTION WITH THE USE OR PERFORMANCE OF THIS SOFTWARE. *) Also update the _oasis file with 'License: ISC'. >> There are also generally a few build warnings, so it would be good to = go through the code and make sure its suitable for release (e.g. there = is a hardcoded IP address in the default DNSSEC lookup in = ocaml-crypto-keys). >>=20 >=20 > the hardcoded ip is for the google dns servers. When fetching a dns = key > the user is allowed to specify the ip address of the dns server, but = in > case he doesn't define one, the library will check on the google dns > server by default. do you think i should change these semantics for = the > API?=20 >=20 > will take a quick look on the compilation error for the rest.=20 Oh that's fine for now; could you put in a comment to that effect in the interface, so that it's obvious? >=20 > By the way, I am not sure and need to check, but I think that the > library had a requirement for openssl 1.*.*. I think I used some calls > wich are not available in version 0.9. Is this version requirement = able=20 > to be expressed in OPAM build process? I noticed this, since on MacOS X, you get 100000 'deprecation' warnings. You should be able to do this on OASIS but I have no idea how... might = be worth checking Lwt or some other library that does these checks. Lets use the mirage/* repos as the masters, as this is where the OPAM = repo is pointed at. I'm not sure if you can send a pull request upstream = (since I forked the Mirage one from yours). Can you try to see if this works? -anil -anil= From Richard.Mortier@nottingham.ac.uk Mon Jul 16 19:41:42 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SqqEo-0006iA-48 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 19:41:42 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:59968 helo=thb-mta-19.emailfiltering.com) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SqqEi-0006Wb-Pv (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 19:41:42 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2499621726 ;abea031a65dda456; Mon, 16 Jul 2012 19:41:15 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1SqqEN-0006xH-OG for cl-mirage@lists.cam.ac.uk; Mon, 16 Jul 2012 19:41:15 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Mon, 16 Jul 2012 19:41:15 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Mon, 16 Jul 2012 19:41:15 +0100 Subject: Re: dns/crypto-keys/opam Thread-Topic: dns/crypto-keys/opam Thread-Index: Ac1jgpSEhq4Tf8+KQ4Wtz9RaH+9H0Q== Message-ID: References: <86CB2060-2D16-41E1-8CBE-08B7D37E45E7@recoil.org> In-Reply-To: <86CB2060-2D16-41E1-8CBE-08B7D37E45E7@recoil.org> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Jul 2012 18:41:42 -0000 X-Keywords: X-UID: 383 Status: O Content-Length: 1209 Lines: 33 On 16 Jul 2012, at 13:59, Anil Madhavapeddy wrote: > Mort, there seem to be a lot of commented out conversion functions in the= interfaces (packet.mli). Are these temporary or do you plan on putting th= em back at some point? oops- that was just as i was working through the port. if they're not neede= d now, no reason to put them back in i guess... i'll send a pull req removing them. --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From Richard.Mortier@nottingham.ac.uk Mon Jul 16 20:22:51 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sqqsd-00078s-Pq (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 20:22:51 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ixe-mta-19-tx.emailfiltering.com ([194.116.198.150]:49561 helo=ixe-mta-19.emailfiltering.com) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1SqqsY-0008ES-qW (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 20:22:51 +0100 Received: from smtp4.nottingham.ac.uk ([128.243.220.65]) by ixe-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2315567404 ;10acb976f8ad1681; Mon, 16 Jul 2012 20:22:26 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp4.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1SqqsD-0002xm-UP for cl-mirage@lists.cam.ac.uk; Mon, 16 Jul 2012 20:22:25 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Mon, 16 Jul 2012 20:22:25 +0100 From: Richard Mortier To: Mirage List Date: Mon, 16 Jul 2012 20:22:25 +0100 Subject: building ocaml-dns and bitstring; using oasis Thread-Topic: building ocaml-dns and bitstring; using oasis Thread-Index: Ac1jiFSGf+k2LXADQ+2NuOmLgVv9qg== Message-ID: Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Jul 2012 19:22:51 -0000 X-Keywords: X-UID: 384 Status: O Content-Length: 1840 Lines: 47 hi all; just removing some cruft from ocaml-dns per anil's earlier mail. issued an = opam update & upgrade to get things up to date. then installed bitstring an= d cryptokit as ocaml-dns requires. =20 now issue "make" and see it failing to build the oasis infrastructure with = the following message: + ocamlfind ocamldep -package re.str -package re -package lwt.unix -package= lwt.syntax -package lwt -package cstruct.syntax -package cstruct -package = cryptokit -package bitstring.syntax -package bitstring -syntax camlp4o -mod= ules lib/base64.mli > lib/base64.mli.depends Camlp4: Uncaught exception: DynLoader.Error ("/Users/mort/.opam/mir-uxd/lib= /bitstring/bitstring.cma", "error loading shared library: dllbitstring.so: = dlopen(dllbitstring.so, 138): image not found")=20 fwiw that .cma does exist: : mort@greyjay:ocaml-dns$; ll /Users/mort/.opam/mir-uxd/lib/bitstring/bitst= ring.cma -rw-rw-r-- 1 mort staff 127949 16 Jul 20:15 /Users/mort/.opam/mir-uxd/li= b/bitstring/bitstring.cma ...so what's up? :) --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From thomas.gazagnaire@gmail.com Mon Jul 16 21:19:02 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sqrkz-0007Vt-WE (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 21:19:02 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [74.125.82.51 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (thomas.gazagnaire[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wg0-f51.google.com ([74.125.82.51]:56359) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1SqrkY-000079-mW (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 21:19:01 +0100 Received: by wgbed3 with SMTP id ed3so4442017wgb.20 for ; Mon, 16 Jul 2012 13:18:33 -0700 (PDT) Received: by 10.180.86.226 with SMTP id s2mr20848185wiz.9.1342469913771; Mon, 16 Jul 2012 13:18:33 -0700 (PDT) Received: from [10.152.145.69] ([37.175.179.119]) by mx.google.com with ESMTPS id ck9sm6283485wib.2.2012.07.16.13.18.31 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 16 Jul 2012 13:18:32 -0700 (PDT) References: In-Reply-To: Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=utf-8 Message-Id: <645F0F88-DB63-4B22-A0B7-96F5B334E0FC@gmail.com> X-Mailer: iPhone Mail (9B206) From: Thomas Gazagnaire Subject: Re: building ocaml-dns and bitstring; using oasis Date: Mon, 16 Jul 2012 22:18:28 +0200 To: Richard Mortier Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Jul 2012 20:19:02 -0000 X-Keywords: X-UID: 385 Status: O Content-Length: 2144 Lines: 58 Seems that CAML_LD_LIBRARY is not set correctly as it complains about =C3=A0= missing .so file. Does 'eval `opam config -envy`' help ?=20 -- Thomas Le 16 juil. 2012 =C3=A0 21:22, Richard Mortier a =C3=A9crit : > hi all; >=20 > just removing some cruft from ocaml-dns per anil's earlier mail. issued an= opam update & upgrade to get things up to date. then installed bitstring an= d cryptokit as ocaml-dns requires. =20 >=20 > now issue "make" and see it failing to build the oasis infrastructure with= the following message: >=20 > + ocamlfind ocamldep -package re.str -package re -package lwt.unix -packag= e lwt.syntax -package lwt -package cstruct.syntax -package cstruct -package c= ryptokit -package bitstring.syntax -package bitstring -syntax camlp4o -modul= es lib/base64.mli > lib/base64.mli.depends > Camlp4: Uncaught exception: DynLoader.Error ("/Users/mort/.opam/mir-uxd/li= b/bitstring/bitstring.cma", "error loading shared library: dllbitstring.so: d= lopen(dllbitstring.so, 138): image not found")=20 >=20 > fwiw that .cma does exist: >=20 > : mort@greyjay:ocaml-dns$; ll /Users/mort/.opam/mir-uxd/lib/bitstring/bits= tring.cma > -rw-rw-r-- 1 mort staff 127949 16 Jul 20:15 /Users/mort/.opam/mir-uxd/l= ib/bitstring/bitstring.cma >=20 > ...so what's up? :) >=20 > --=20 > Cheers, >=20 > R. >=20 >=20 >=20 >=20 > This message and any attachment are intended solely for the addressee and m= ay contain confidential information. If you have received this message in er= ror, please send it back to me, and immediately delete it. Please do not u= se, copy or disclose the information contained in this message or in any att= achment. Any views or opinions expressed by the author of this email do not= necessarily reflect the views of the University of Nottingham. >=20 > This message has been checked for viruses but the contents of an attachmen= t > may still contain software viruses which could damage your computer system= : > you are advised to perform your own checks. Email communications with the > University of Nottingham may be monitored as permitted by UK legislation. From Richard.Mortier@nottingham.ac.uk Mon Jul 16 21:23:25 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SqrpF-0007YA-UU (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 21:23:25 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ixe-mta-19-tx.emailfiltering.com ([194.116.198.150]:38203 helo=ixe-mta-19.emailfiltering.com) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1SqrpA-0002Cy-r0 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 16 Jul 2012 21:23:25 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by ixe-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2315594332 ;8eb80716a5f8a7c; Mon, 16 Jul 2012 21:23:00 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sqroq-0000kJ-5F for cl-mirage@lists.cam.ac.uk; Mon, 16 Jul 2012 21:23:00 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Mon, 16 Jul 2012 21:23:00 +0100 From: Richard Mortier To: Thomas Gazagnaire Date: Mon, 16 Jul 2012 21:22:59 +0100 Subject: Re: building ocaml-dns and bitstring; using oasis Thread-Topic: building ocaml-dns and bitstring; using oasis Thread-Index: Ac1jkMrNZfB+9sVvSnqaYW/HTpzR6Q== Message-ID: References: <645F0F88-DB63-4B22-A0B7-96F5B334E0FC@gmail.com> In-Reply-To: <645F0F88-DB63-4B22-A0B7-96F5B334E0FC@gmail.com> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="iso-8859-1" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 16 Jul 2012 20:23:26 -0000 X-Keywords: X-UID: 386 Status: O Content-Length: 1520 Lines: 41 On 16 Jul 2012, at 21:18, Thomas Gazagnaire wrote: > Seems that CAML_LD_LIBRARY is not set correctly as it complains about =E0= missing .so file. Does 'eval `opam config -envy`' help ?=20 nope- had run that. (and no difference after just running it again after o= pam update etc.) fwiw... : mort@greyjay:ocaml-dns$; opam config -env PATH=3D/Users/mort/.opam/mir-uxd/bin:/Users/mort/.cabal/bin:/usr/local/shar= e/python:/Users/mort/bin/android-sdk-mac_86/tools:/Users/mort/bin:/usr/loca= l/texlive/2011/bin/x86_64-darwin:/usr/X11R6/bin:/usr/local/bin:/usr/local/s= bin:/usr/bin:/usr/sbin:/bin:/sbin MIRAGE_OS=3Dunix MIRAGE_NET=3Ddirect CAML_LD_LIBRARY_PATH=3D/Users/mort/.opam/mir-uxd/lib/stublibs --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From anil@recoil.org Tue Jul 17 01:23:35 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SqvZf-0001rN-0C (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 01:23:35 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:17268 helo=dark.recoil.org) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with smtp id 1SqvZe-0003EV-oG (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 01:23:34 +0100 Received: (qmail 14578 invoked by uid 634); 17 Jul 2012 00:23:34 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dab-bhx2-nat-blade-6-53.dab.02.net (HELO [10.26.78.38]) (82.132.234.118) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Tue, 17 Jul 2012 01:23:33 +0100 References: In-Reply-To: Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Message-Id: X-Mailer: iPhone Mail (9B206) From: Anil Madhavapeddy Subject: Re: building ocaml-dns and bitstring; using oasis Date: Tue, 17 Jul 2012 01:23:21 +0100 To: Richard Mortier X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 00:23:35 -0000 X-Keywords: X-UID: 387 Status: O Content-Length: 2054 Lines: 56 The cma isn't the problem. Does the .so exist in .opam somewhere? -anil On 16 Jul 2012, at 20:22, Richard Mortier = wrote: > hi all; >=20 > just removing some cruft from ocaml-dns per anil's earlier mail. issued an= opam update & upgrade to get things up to date. then installed bitstring an= d cryptokit as ocaml-dns requires. =20 >=20 > now issue "make" and see it failing to build the oasis infrastructure with= the following message: >=20 > + ocamlfind ocamldep -package re.str -package re -package lwt.unix -packag= e lwt.syntax -package lwt -package cstruct.syntax -package cstruct -package c= ryptokit -package bitstring.syntax -package bitstring -syntax camlp4o -modul= es lib/base64.mli > lib/base64.mli.depends > Camlp4: Uncaught exception: DynLoader.Error ("/Users/mort/.opam/mir-uxd/li= b/bitstring/bitstring.cma", "error loading shared library: dllbitstring.so: d= lopen(dllbitstring.so, 138): image not found")=20 >=20 > fwiw that .cma does exist: >=20 > : mort@greyjay:ocaml-dns$; ll /Users/mort/.opam/mir-uxd/lib/bitstring/bits= tring.cma > -rw-rw-r-- 1 mort staff 127949 16 Jul 20:15 /Users/mort/.opam/mir-uxd/l= ib/bitstring/bitstring.cma >=20 > ...so what's up? :) >=20 > --=20 > Cheers, >=20 > R. >=20 >=20 >=20 >=20 > This message and any attachment are intended solely for the addressee and m= ay contain confidential information. If you have received this message in er= ror, please send it back to me, and immediately delete it. Please do not u= se, copy or disclose the information contained in this message or in any att= achment. Any views or opinions expressed by the author of this email do not= necessarily reflect the views of the University of Nottingham. >=20 > This message has been checked for viruses but the contents of an attachmen= t > may still contain software viruses which could damage your computer system= : > you are advised to perform your own checks. Email communications with the > University of Nottingham may be monitored as permitted by UK legislation. From raphlalou@gmail.com Tue Jul 17 09:29:01 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr39R-0001Jf-AY (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 09:29:01 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.214.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (raphlalou[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-ob0-f179.google.com ([209.85.214.179]:54131) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1Sr39Q-00036k-qT (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 09:29:01 +0100 Received: by obbeh20 with SMTP id eh20so220120obb.38 for ; Tue, 17 Jul 2012 01:28:59 -0700 (PDT) MIME-Version: 1.0 Received: by 10.60.12.37 with SMTP id v5mr2087296oeb.25.1342513739303; Tue, 17 Jul 2012 01:28:59 -0700 (PDT) Received: by 10.76.162.198 with HTTP; Tue, 17 Jul 2012 01:28:59 -0700 (PDT) In-Reply-To: <43B23F64-5332-4861-A6E3-4D10398C7D2F@recoil.org> References: <86CB2060-2D16-41E1-8CBE-08B7D37E45E7@recoil.org> <20120716154211.GA3121@cr409-ThinkPad-T60p> <43B23F64-5332-4861-A6E3-4D10398C7D2F@recoil.org> Date: Tue, 17 Jul 2012 10:28:59 +0200 Message-ID: Subject: Re: dns/crypto-keys/opam From: Raphael Proust To: Anil Madhavapeddy Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 08:29:01 -0000 X-Keywords: X-UID: 388 Status: O Content-Length: 1957 Lines: 52 On Mon, Jul 16, 2012 at 5:56 PM, Anil Madhavapeddy wrote: > On 16 Jul 2012, at 16:42, Haris Rotsos wrote: >> On Mon, Jul 16, 2012 at 01:59:38PM +0100, Anil Madhavapeddy wrote: >>> [=E2=80=A6] >> [=E2=80=A6] > > Yeah, that's the default I use as it has the smallest amount of text > that obscures the real code :-) Below is a sample bit of text from some > other code (you just add on copyrights as you edit it) I use a small license and add folding markers. It makes the code appear as = a single line that can be unwrapped into a complete header. There might be a compatibility issue with other editors (but people using an "other editor" = are using a "wrong editor" anyway=E2=80=A6) I have the LICENSE in a file somewhere and I just create newfiles in my pro= jects from my shell or from my editor $ echo root/of/project/LICENSE > file/I/want/to/create ggO:r root/of/project/LICENSE:w:e Here is an adapted version of Anil's LICENSE: (* LICENSE {{{ * vi:set fdm=3Dmarker fdl=3D0: * * Copyright (c) 2010-2012 Anil Madhavapeddy * Copyright (c) 2010-2011 Thomas Gazagnaire * * Permission to use, copy, modify, and distribute this software for any * purpose with or without fee is hereby granted, provided that the above * copyright notice and this permission notice appear in all copies. * * THE SOFTWARE IS PROVIDED "AS IS" AND THE AUTHOR DISCLAIMS ALL WARRANTIES * WITH REGARD TO THIS SOFTWARE INCLUDING ALL IMPLIED WARRANTIES OF * MERCHANTABILITY AND FITNESS. IN NO EVENT SHALL THE AUTHOR BE LIABLE FOR * ANY SPECIAL, DIRECT, INDIRECT, OR CONSEQUENTIAL DAMAGES OR ANY DAMAGES * WHATSOEVER RESULTING FROM LOSS OF USE, DATA OR PROFITS, WHETHER IN AN * ACTION OF CONTRACT, NEGLIGENCE OR OTHER TORTIOUS ACTION, ARISING OUT OF * OR IN CONNECTION WITH THE USE OR PERFORMANCE OF THIS SOFTWARE. * }}} *) Cheers, --=20 ______________ Rapha=C3=ABl Proust From Richard.Mortier@nottingham.ac.uk Tue Jul 17 09:43:30 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr3NS-0001qo-3V (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 09:43:30 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ixe-mta-19-tx.emailfiltering.com ([194.116.198.150]:49676 helo=ixe-mta-19.emailfiltering.com) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1Sr3NM-0006Rr-rV (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 09:43:30 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by ixe-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2315946876 ;4b9e97c330941e71; Tue, 17 Jul 2012 09:43:04 +0100 Received: from uiwexhub02.ad.nottingham.ac.uk ([128.243.15.132]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sr3N2-00029u-5h for cl-mirage@lists.cam.ac.uk; Tue, 17 Jul 2012 09:43:04 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB02.ad.nottingham.ac.uk ([2002:80f3:f84::80f3:f84]) with mapi; Tue, 17 Jul 2012 09:43:03 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Tue, 17 Jul 2012 09:43:02 +0100 Subject: Re: building ocaml-dns and bitstring; using oasis Thread-Topic: building ocaml-dns and bitstring; using oasis Thread-Index: Ac1j+C3VP7Tj0mv6S/mObPOnsr4kfw== Message-ID: <63D15B3C-E81D-4937-8410-97E7919ADDA2@nottingham.ac.uk> References: In-Reply-To: Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 08:43:30 -0000 X-Keywords: X-UID: 389 Status: O Content-Length: 2470 Lines: 81 On 17 Jul 2012, at 01:23, Anil Madhavapeddy wrote: > The cma isn't the problem. Does the .so exist in .opam somewhere? yes- : mort@greyjay:.opam$; find . -name "*bitstring*.so" -ls 14011413 16 -rwxrwxr-x 1 mort staff 8032 16 Jul 20:15 ./mir-uxd/bu= ild/bitstring.2.0.3/dllbitstring.so 14011462 16 -rwxrwxr-x 1 mort staff 8032 16 Jul 20:15 ./mir-uxd/li= b/stublibs/dllbitstring.so >=20 > -anil >=20 >=20 > On 16 Jul 2012, at 20:22, Richard Mortier wrote: >=20 >> hi all; >>=20 >> just removing some cruft from ocaml-dns per anil's earlier mail. issued = an opam update & upgrade to get things up to date. then installed bitstring= and cryptokit as ocaml-dns requires. =20 >>=20 >> now issue "make" and see it failing to build the oasis infrastructure wi= th the following message: >>=20 >> + ocamlfind ocamldep -package re.str -package re -package lwt.unix -pack= age lwt.syntax -package lwt -package cstruct.syntax -package cstruct -packa= ge cryptokit -package bitstring.syntax -package bitstring -syntax camlp4o -= modules lib/base64.mli > lib/base64.mli.depends >> Camlp4: Uncaught exception: DynLoader.Error ("/Users/mort/.opam/mir-uxd/= lib/bitstring/bitstring.cma", "error loading shared library: dllbitstring.s= o: dlopen(dllbitstring.so, 138): image not found")=20 >>=20 >> fwiw that .cma does exist: >>=20 >> : mort@greyjay:ocaml-dns$; ll /Users/mort/.opam/mir-uxd/lib/bitstring/bi= tstring.cma >> -rw-rw-r-- 1 mort staff 127949 16 Jul 20:15 /Users/mort/.opam/mir-uxd= /lib/bitstring/bitstring.cma >>=20 >> ...so what's up? :) >>=20 >> --=20 >> Cheers, >>=20 >> R. >>=20 >>=20 >>=20 >>=20 >> This message and any attachment are intended solely for the addressee an= d may contain confidential information. If you have received this message i= n error, please send it back to me, and immediately delete it. Please do = not use, copy or disclose the information contained in this message or in a= ny attachment. Any views or opinions expressed by the author of this email= do not necessarily reflect the views of the University of Nottingham. >>=20 >> This message has been checked for viruses but the contents of an attachm= ent >> may still contain software viruses which could damage your computer syst= em: >> you are advised to perform your own checks. Email communications with th= e >> University of Nottingham may be monitored as permitted by UK legislation= . --=20 Cheers, R. From anil@recoil.org Tue Jul 17 09:45:29 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr3PN-0001uA-TP (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 09:45:29 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:6517 helo=dark.recoil.org) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with smtp id 1Sr3PN-0002VI-mz (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 09:45:29 +0100 Received: (qmail 14203 invoked by uid 634); 17 Jul 2012 08:45:28 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.38]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Tue, 17 Jul 2012 09:45:28 +0100 Subject: Re: building ocaml-dns and bitstring; using oasis Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <63D15B3C-E81D-4937-8410-97E7919ADDA2@nottingham.ac.uk> Date: Tue, 17 Jul 2012 09:45:24 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <637C249A-FA8E-4BD2-817C-ACD47F66F99A@recoil.org> References: <63D15B3C-E81D-4937-8410-97E7919ADDA2@nottingham.ac.uk> To: Richard Mortier X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 08:45:30 -0000 X-Keywords: X-UID: 390 Status: O Content-Length: 639 Lines: 25 On 17 Jul 2012, at 09:43, Richard Mortier wrote: >=20 > On 17 Jul 2012, at 01:23, Anil Madhavapeddy wrote: >=20 >> The cma isn't the problem. Does the .so exist in .opam somewhere? >=20 > yes- >=20 > : mort@greyjay:.opam$; find . -name "*bitstring*.so" -ls > 14011413 16 -rwxrwxr-x 1 mort staff 8032 16 Jul 20:15 = ./mir-uxd/build/bitstring.2.0.3/dllbitstring.so > 14011462 16 -rwxrwxr-x 1 mort staff 8032 16 Jul 20:15 = ./mir-uxd/lib/stublibs/dllbitstring.so >=20 >=20 Are you trying with the latest OPAM? I fixed=20 https://github.com/OCamlPro/opam/issues/47 over the weekend (variables not fully exported) -anil From Richard.Mortier@nottingham.ac.uk Tue Jul 17 09:50:05 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr3Tp-00021Y-Q8 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 09:50:05 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:49242 helo=thb-mta-19.emailfiltering.com) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1Sr3Tj-0003NC-SW (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 09:50:05 +0100 Received: from smtp4.nottingham.ac.uk ([128.243.220.65]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2500115018 ;e18e859a0f4d362d; Tue, 17 Jul 2012 09:49:39 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp4.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sr3TP-00012H-JQ for cl-mirage@lists.cam.ac.uk; Tue, 17 Jul 2012 09:49:39 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Tue, 17 Jul 2012 09:49:39 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Tue, 17 Jul 2012 09:49:40 +0100 Subject: Re: building ocaml-dns and bitstring; using oasis Thread-Topic: building ocaml-dns and bitstring; using oasis Thread-Index: Ac1j+RnKulMTR0FyT1qN2L9UdK2ylg== Message-ID: References: <63D15B3C-E81D-4937-8410-97E7919ADDA2@nottingham.ac.uk> <637C249A-FA8E-4BD2-817C-ACD47F66F99A@recoil.org> In-Reply-To: <637C249A-FA8E-4BD2-817C-ACD47F66F99A@recoil.org> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 08:50:05 -0000 X-Keywords: X-UID: 391 Status: O Content-Length: 1644 Lines: 51 On 17 Jul 2012, at 09:45, Anil Madhavapeddy wrote: >=20 > On 17 Jul 2012, at 09:43, Richard Mortier wrote: >=20 >>=20 >> On 17 Jul 2012, at 01:23, Anil Madhavapeddy wrote: >>=20 >>> The cma isn't the problem. Does the .so exist in .opam somewhere? >>=20 >> yes- >>=20 >> : mort@greyjay:.opam$; find . -name "*bitstring*.so" -ls >> 14011413 16 -rwxrwxr-x 1 mort staff 8032 16 Jul 20:15 ./mir-uxd= /build/bitstring.2.0.3/dllbitstring.so >> 14011462 16 -rwxrwxr-x 1 mort staff 8032 16 Jul 20:15 ./mir-uxd= /lib/stublibs/dllbitstring.so >>=20 >>=20 >=20 > Are you trying with the latest OPAM? I fixed=20 > https://github.com/OCamlPro/opam/issues/47 > over the weekend (variables not fully exported)# hm- looks like not. i'd thought i was using homebrew opam but seems i had a= local repo. should fix it - ta. --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From anil@recoil.org Tue Jul 17 09:51:14 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr3Uw-00022i-L9 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 09:51:14 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.0 HTML_MESSAGE BODY: HTML included in message X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:24319 helo=dark.recoil.org) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with smtp id 1Sr3Uv-0005S7-nF (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 09:51:14 +0100 Received: (qmail 1240 invoked by uid 634); 17 Jul 2012 08:51:13 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED,HTML_MESSAGE X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.38]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Tue, 17 Jul 2012 09:51:12 +0100 Subject: Re: building ocaml-dns and bitstring; using oasis Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: multipart/alternative; boundary="Apple-Mail=_1C8C2FC8-E496-4D51-8C7D-D7345320EB20" From: Anil Madhavapeddy In-Reply-To: Date: Tue, 17 Jul 2012 09:51:11 +0100 Message-Id: <4218593A-3757-4D5E-8008-6B157AEC5B6E@recoil.org> References: <63D15B3C-E81D-4937-8410-97E7919ADDA2@nottingham.ac.uk> <637C249A-FA8E-4BD2-817C-ACD47F66F99A@recoil.org> To: Richard Mortier X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 08:51:14 -0000 X-Keywords: X-UID: 392 Status: O Content-Length: 4337 Lines: 101 --Apple-Mail=_1C8C2FC8-E496-4D51-8C7D-D7345320EB20 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On 17 Jul 2012, at 09:49, Richard Mortier wrote: >=20 > On 17 Jul 2012, at 09:45, Anil Madhavapeddy wrote: >>=20 >> On 17 Jul 2012, at 09:43, Richard Mortier wrote: >>=20 >>>=20 >>> On 17 Jul 2012, at 01:23, Anil Madhavapeddy wrote: >>>=20 >>>> The cma isn't the problem. Does the .so exist in .opam somewhere? >>>=20 >>> yes- >>>=20 >>> : mort@greyjay:.opam$; find . -name "*bitstring*.so" -ls >>> 14011413 16 -rwxrwxr-x 1 mort staff 8032 16 Jul 20:15 = ./mir-uxd/build/bitstring.2.0.3/dllbitstring.so >>> 14011462 16 -rwxrwxr-x 1 mort staff 8032 16 Jul 20:15 = ./mir-uxd/lib/stublibs/dllbitstring.so >>>=20 >>>=20 >>=20 >> Are you trying with the latest OPAM? I fixed=20 >> https://github.com/OCamlPro/opam/issues/47 >> over the weekend (variables not fully exported)# >=20 > hm- looks like not. i'd thought i was using homebrew opam but seems i = had a local repo. >=20 > should fix it - ta. The recent fixes are all pretty important to make OPAM work reliably. Thomas, how about a 0.2.1 release? That'll hopefully not mess up your = roadmap numbering ;-) -anil= --Apple-Mail=_1C8C2FC8-E496-4D51-8C7D-D7345320EB20 Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii

On 17 Jul 2012, = at 09:45, Anil Madhavapeddy wrote:

On = 17 Jul 2012, at 09:43, Richard Mortier = wrote:


On 17 Jul 2012, at 01:23, Anil = Madhavapeddy wrote:

The = cma isn't the problem. Does the .so exist in .opam = somewhere?

yes-

: mort@greyjay:.opam$; find . = -name "*bitstring*.so" -ls
14011413 =       16 -rwxrwxr-x    1 = mort staff 8032 16 Jul 20:15 = ./mir-uxd/build/bitstring.2.0.3/dllbitstring.so
14011462 =       16 -rwxrwxr-x    1 = mort staff 8032 16 Jul 20:15 = ./mir-uxd/lib/stublibs/dllbitstring.so



Are you trying = with the latest OPAM? I fixed
https://github.com/OCa= mlPro/opam/issues/47
over = the weekend (variables not fully exported)#

hm- = looks like not. i'd thought i was using homebrew opam but seems i had a = local repo.

should fix it - = ta.

The recent fixes are all pretty = important to make OPAM work reliably.
Thomas, how about a = 0.2.1 release? That'll hopefully not mess up your roadmap numbering = ;-)

-anil
= --Apple-Mail=_1C8C2FC8-E496-4D51-8C7D-D7345320EB20-- From Richard.Mortier@nottingham.ac.uk Tue Jul 17 09:55:12 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr3Ym-00029m-Np (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 09:55:12 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:33527 helo=thb-mta-19.emailfiltering.com) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1Sr3Yh-0005j5-Q9 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 09:55:12 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2500122538 ;8f6252bed0e70f3f; Tue, 17 Jul 2012 09:54:47 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sr3YM-0002oD-S9 for cl-mirage@lists.cam.ac.uk; Tue, 17 Jul 2012 09:54:46 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Tue, 17 Jul 2012 09:54:46 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Tue, 17 Jul 2012 09:54:46 +0100 Subject: Re: building ocaml-dns and bitstring; using oasis Thread-Topic: building ocaml-dns and bitstring; using oasis Thread-Index: Ac1j+dB1wCTB/rZ9Sa2RMMtuaP6EAA== Message-ID: <0D6F9B90-6EAA-4A34-9A1A-593B5B82A761@nottingham.ac.uk> References: <63D15B3C-E81D-4937-8410-97E7919ADDA2@nottingham.ac.uk> <637C249A-FA8E-4BD2-817C-ACD47F66F99A@recoil.org> In-Reply-To: Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 08:55:12 -0000 X-Keywords: X-UID: 393 Status: O Content-Length: 1016 Lines: 33 On 17 Jul 2012, at 09:49, Richard Mortier wrote: ... > hm- looks like not. i'd thought i was using homebrew opam but seems i had= a local repo. >=20 > should fix it - ta. and indeed it did... :) --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From Richard.Mortier@nottingham.ac.uk Tue Jul 17 10:03:39 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr3gx-0002LG-9P (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 10:03:39 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ixe-mta-19-tx.emailfiltering.com ([194.116.198.150]:52362 helo=ixe-mta-19.emailfiltering.com) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1Sr3gr-0003IZ-q8 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 10:03:39 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by ixe-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2315975760 ;40d8847b31e37b2; Tue, 17 Jul 2012 10:03:12 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sr3gW-0003Qp-Q5 for cl-mirage@lists.cam.ac.uk; Tue, 17 Jul 2012 10:03:12 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Tue, 17 Jul 2012 10:03:12 +0100 From: Richard Mortier To: Mirage List Date: Tue, 17 Jul 2012 10:03:12 +0100 Subject: opam and myocamlbuild.ml files Thread-Topic: opam and myocamlbuild.ml files Thread-Index: Ac1j+v4q5sBZRAuTRG2PxXwgKL6O3g== Message-ID: <42145234-747E-4254-A83F-A3BA29CDCEDA@nottingham.ac.uk> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 09:03:39 -0000 X-Keywords: X-UID: 394 Status: O Content-Length: 1331 Lines: 35 minor question/nit- we have myocamlbuild.ml files in the repos; but i notice with (e.g.) ocaml-= dns that this may end up creating a lot of spurious commits due to diffs li= ke -# 56 "/Users/avsm/.opam/system/build/oasis.0.3.0/src/plugins/ocamlbuild/My= OCamlbuildBase.ml" +# 56 "/Users/mort/.opam/mir-uxd/build/oasis.0.3.0/src/plugins/ocamlbuild/M= yOCamlbuildBase.ml" now that oasis is easy to install via opam, should we by default ignore oas= is generated files? (of which myocamlbuild.ml is one isn't it?) --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From anil@recoil.org Tue Jul 17 10:35:29 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr4Bl-0003Ki-2z (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 10:35:29 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:43729 helo=dark.recoil.org) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with smtp id 1Sr4Bj-0001pp-os (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 10:35:29 +0100 Received: (qmail 30494 invoked by uid 634); 17 Jul 2012 09:35:27 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-142-70.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-142-70.eduroam.csx.cam.ac.uk) (128.232.142.70) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Tue, 17 Jul 2012 10:35:25 +0100 Subject: Re: opam and myocamlbuild.ml files Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <42145234-747E-4254-A83F-A3BA29CDCEDA@nottingham.ac.uk> Date: Tue, 17 Jul 2012 10:35:21 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <658FD234-2748-472C-800E-BB35D7E75433@recoil.org> References: <42145234-747E-4254-A83F-A3BA29CDCEDA@nottingham.ac.uk> To: Richard Mortier X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 09:35:29 -0000 X-Keywords: X-UID: 395 Status: O Content-Length: 1609 Lines: 52 Good question. We could move to only generating the setup.ml for stable = releases, and not for the working copy. The diff spam is really irritating when bug = bisecting... -anil On 17 Jul 2012, at 10:03, Richard Mortier wrote: > minor question/nit- >=20 > we have myocamlbuild.ml files in the repos; but i notice with (e.g.) = ocaml-dns that this may end up creating a lot of spurious commits due to = diffs like >=20 > -# 56 = "/Users/avsm/.opam/system/build/oasis.0.3.0/src/plugins/ocamlbuild/MyOCaml= buildBase.ml" > +# 56 = "/Users/mort/.opam/mir-uxd/build/oasis.0.3.0/src/plugins/ocamlbuild/MyOCam= lbuildBase.ml" >=20 > now that oasis is easy to install via opam, should we by default = ignore oasis generated files? (of which myocamlbuild.ml is one isn't = it?) >=20 > --=20 > Cheers, >=20 > R. >=20 >=20 >=20 >=20 > This message and any attachment are intended solely for the addressee = and may contain confidential information. If you have received this = message in error, please send it back to me, and immediately delete it. = Please do not use, copy or disclose the information contained in this = message or in any attachment. Any views or opinions expressed by the = author of this email do not necessarily reflect the views of the = University of Nottingham. >=20 > This message has been checked for viruses but the contents of an = attachment > may still contain software viruses which could damage your computer = system: > you are advised to perform your own checks. Email communications with = the > University of Nottingham may be monitored as permitted by UK = legislation. From Richard.Mortier@nottingham.ac.uk Tue Jul 17 11:05:47 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr4f5-0004Q3-6m (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 11:05:47 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ixe-mta-19-tx.emailfiltering.com ([194.116.198.150]:46092 helo=ixe-mta-19.emailfiltering.com) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1Sr4ey-0006uc-YW (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 11:05:46 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by ixe-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2316070148 ;4d4e867e96169af7; Tue, 17 Jul 2012 11:05:20 +0100 Received: from uiwexhub02.ad.nottingham.ac.uk ([128.243.15.132]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sr4ee-00078K-8s for cl-mirage@lists.cam.ac.uk; Tue, 17 Jul 2012 11:05:20 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB02.ad.nottingham.ac.uk ([2002:80f3:f84::80f3:f84]) with mapi; Tue, 17 Jul 2012 11:05:03 +0100 From: Richard Mortier To: Thomas Gazagnaire Date: Tue, 17 Jul 2012 11:05:03 +0100 Subject: opam remove doesn't completely... Thread-Topic: opam remove doesn't completely... Thread-Index: Ac1kA6JZ+DOb0aoaTrC9HbryMvoYgA== Message-ID: <9D8A84D1-430A-497A-AD8F-3A3A7C03A76A@nottingham.ac.uk> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 10:05:47 -0000 X-Keywords: X-UID: 396 Status: O Content-Length: 5589 Lines: 115 ...or so it seems to me :) to whit, : mort@greyjay:ocaml-openflow$; opam remove bitstring : mort@greyjay:ocaml-openflow$; find ~/.opam -name "*bitstring*" /Users/mort/.opam/archives/bitstring.2.0.3.tar.gz /Users/mort/.opam/descr/bitstring.2.0.3 /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3 /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring-objinfo /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring.a /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring.cma /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring.cmi /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring.cmo /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring.cmx /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring.cmxa /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring.env /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring.ml /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring.mli /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring.o /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring.old.env /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_c.c /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_c.o /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_config.cmi /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_config.cmo /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_config.cmx /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_config.ml /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_config.ml.in /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_config.o /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_objinfo.cmi /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_objinfo.cmo /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_objinfo.ml /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_persistent.a /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_persistent.cma /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_persistent.cmi /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_persistent.cmo /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_persistent.cmx /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_persistent.cmxa /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_persistent.ml /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_persistent.mli /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_persistent.o /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_types.cmi /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_types.cmo /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_types.cmx /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_types.ml /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/bitstring_types.o /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/cil-tools/bitstring-import-= prefix.h /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/cil-tools/bitstring_import_= c.ml /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/dllbitstring.so /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/libbitstring.a /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/pa_bitstring.cmi /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/pa_bitstring.cmo /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/pa_bitstring.ml /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/tests/test_31_bitstring_con= cat.ml /Users/mort/.opam/mir-uxd/build/bitstring.2.0.3/tests/test_32_bitstring_com= pare.ml /Users/mort/.opam/mir-uxd/lib/stublibs/dllbitstring.so /Users/mort/.opam/mir-uxd/lib/stublibs/dllbitstring.so.owner /Users/mort/.opam/opam/bitstring.2.0.3.opam /Users/mort/.opam/repo/default/archives/bitstring.2.0.3.tar.gz /Users/mort/.opam/repo/default/descr/bitstring.2.0.3 /Users/mort/.opam/repo/default/opam/bitstring.2.0.3.opam /Users/mort/.opam/repo/default/url/bitstring.2.0.3 i can understand not necessarily removing the archives, descr, etc; but sur= ely stublibs and arguably build/bitstring... should be gone? in particular, "opam remove bitstring && opam install bitstring" fails, whi= ch seems wrong: : mort@greyjay:ocaml-openflow$; opam remove bitstring && opam install bitst= ring Install: bitstring.2.0.3 [bitstring.2.0.3] Build commands: ./configure make srcdir=3D./ make install [94837] ERROR: Command "make install" failed (see /Users/mort/.opam/log/com= mand291.{info,err,out}) ocamlfind install bitstring META *.mli *.cmx *.cma *.cmxa *.a *.so \ bitstring.cmi \ bitstring_persistent.cmi \ pa_bitstring.cmo ocamlfind: Conflict with another package: Library dllbitstring.so is alread= y installed make: *** [install] Error 2 [94837] ERROR: Compilation failed with error 2 [94837] ERROR: Globals.Exit(66) [94835] ERROR: Command failed while installing bitstring.2.0.3 'opam install bitstring' failed --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From avsm2@cl.cam.ac.uk Tue Jul 17 11:57:53 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr5TV-00060T-5w (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 11:57:53 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:4022 helo=dark.recoil.org) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with smtp id 1Sr5TU-0007sV-ou (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 11:57:53 +0100 Received: (qmail 5147 invoked by uid 634); 17 Jul 2012 10:57:52 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED,T_RP_MATCHES_RCVD X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-142-70.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-142-70.eduroam.csx.cam.ac.uk) (128.232.142.70) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Tue, 17 Jul 2012 11:57:52 +0100 Subject: Re: opam remove doesn't completely... Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <9D8A84D1-430A-497A-AD8F-3A3A7C03A76A@nottingham.ac.uk> Date: Tue, 17 Jul 2012 11:57:51 +0100 Content-Transfer-Encoding: 7bit Message-Id: References: <9D8A84D1-430A-497A-AD8F-3A3A7C03A76A@nottingham.ac.uk> To: Richard Mortier X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List , Thomas Gazagnaire X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 10:57:53 -0000 X-Keywords: X-UID: 397 Status: O Content-Length: 741 Lines: 32 On 17 Jul 2012, at 11:05, Richard Mortier wrote: > > : mort@greyjay:ocaml-openflow$; opam remove bitstring > : mort@greyjay:ocaml-openflow$; find ~/.opam -name "*bitstring*" > /Users/mort/.opam/archives/bitstring.2.0.3.tar.gz Yeah, in my laziness, I've not been adding 'remove' entries to some of the newer packages. In opam-repo/opam/bitstring.2.0.3, we have: opam-version: "1" package "bitstring" { version: "2.0.3" maintainer: "" substs: [] build: [ ["./configure"] ["make" "srcdir=./"] ["make" "install"] ] depends: ["base-unix" "ocamlfind"] depopts: [] conflicts: [] libraries: [] syntax: [] } There also needs to be an entry: remove: [["ocamlfind" "remove" "bitstring"]] Now added and synched... -anil From Richard.Mortier@nottingham.ac.uk Tue Jul 17 12:03:21 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr5Yn-0006PD-UK (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 12:03:21 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:44717 helo=thb-mta-19.emailfiltering.com) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1Sr5Yi-0008Nw-R6 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 12:03:21 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2500313918 ;d0dd9ef36c399d45; Tue, 17 Jul 2012 12:02:56 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sr5YO-0001uF-40 for cl-mirage@lists.cam.ac.uk; Tue, 17 Jul 2012 12:02:56 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Tue, 17 Jul 2012 12:02:56 +0100 From: Richard Mortier To: Mirage List Date: Tue, 17 Jul 2012 12:02:55 +0100 Subject: ocaml-openflow- odd (oasis?) error Thread-Topic: ocaml-openflow- odd (oasis?) error Thread-Index: Ac1kC7fPoWUFlL/PQnyry5rVyv1Mfw== Message-ID: <36208526-AFF5-41EC-8FFF-A468279B6639@nottingham.ac.uk> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 11:03:22 -0000 X-Keywords: X-UID: 398 Status: O Content-Length: 1813 Lines: 45 get this when building ocaml-openflow: E: Failure("No one of expected built files '_build/lib/openflow.cmi' exists= ") the _oasis etc all mirror ocaml-dns afaics. but using classic-display, i se= e that ocaml-dns runs ... ocamlfind ocamlopt -c -g -annot -I lib -package re.str -package re -package= lwt.unix -package lwt.syntax -package lwt -package cstruct.syntax -package= cstruct -package cryptokit -syntax camlp4o -for-pack Dns -I lib -o lib/zon= e.cmx lib/zone.ml touch lib/dns.mli ; if ocamlfind ocamlopt -pack -g -I lib lib/base64.cmx = lib/hashcons.cmx lib/operators.cmx lib/name.cmx lib/RR.cmx lib/trie.cmx lib= /loader.cmx lib/packet.cmx lib/query.cmx lib/zone_parser.cmx lib/zone_lexer= .cmx lib/zone.cmx -o lib/dns.cmx ; then rm -f lib/dns.mli ; else rm -f = lib/dns.mli ; exit 1; fi ocamlfind ocamlopt -a -package lwt.syntax lib/dns.cmx -o lib/dns.cmxa ...so what is it that causes the "touch" invocation, why is it required, an= d how do i get it into ocaml-openflow?! --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From anil@recoil.org Tue Jul 17 13:28:02 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr6sk-0001Ke-Kq (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 13:28:02 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:23563 helo=dark.recoil.org) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with smtp id 1Sr6sk-00073P-n1 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 13:28:02 +0100 Received: (qmail 6455 invoked by uid 634); 17 Jul 2012 12:28:02 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-142-70.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-142-70.eduroam.csx.cam.ac.uk) (128.232.142.70) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Tue, 17 Jul 2012 13:28:01 +0100 Subject: Re: ocaml-openflow- odd (oasis?) error Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <36208526-AFF5-41EC-8FFF-A468279B6639@nottingham.ac.uk> Date: Tue, 17 Jul 2012 13:28:00 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <36208526-AFF5-41EC-8FFF-A468279B6639@nottingham.ac.uk> To: Richard Mortier X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 12:28:02 -0000 X-Keywords: X-UID: 399 Status: O Content-Length: 2017 Lines: 57 Not enough information to spot the problem here; do you have a = repository I could look at? -anil On 17 Jul 2012, at 12:02, Richard Mortier wrote: > get this when building ocaml-openflow: >=20 > E: Failure("No one of expected built files '_build/lib/openflow.cmi' = exists") >=20 > the _oasis etc all mirror ocaml-dns afaics. but using classic-display, = i see that ocaml-dns runs >=20 > ... > ocamlfind ocamlopt -c -g -annot -I lib -package re.str -package re = -package lwt.unix -package lwt.syntax -package lwt -package = cstruct.syntax -package cstruct -package cryptokit -syntax camlp4o = -for-pack Dns -I lib -o lib/zone.cmx lib/zone.ml > touch lib/dns.mli ; if ocamlfind ocamlopt -pack -g -I lib = lib/base64.cmx lib/hashcons.cmx lib/operators.cmx lib/name.cmx = lib/RR.cmx lib/trie.cmx lib/loader.cmx lib/packet.cmx lib/query.cmx = lib/zone_parser.cmx lib/zone_lexer.cmx lib/zone.cmx -o lib/dns.cmx ; = then rm -f lib/dns.mli ; else rm -f lib/dns.mli ; exit 1; fi > ocamlfind ocamlopt -a -package lwt.syntax lib/dns.cmx -o lib/dns.cmxa >=20 >=20 > ...so what is it that causes the "touch" invocation, why is it = required, and how do i get it into ocaml-openflow?! >=20 > --=20 > Cheers, >=20 > R. >=20 >=20 >=20 >=20 > This message and any attachment are intended solely for the addressee = and may contain confidential information. If you have received this = message in error, please send it back to me, and immediately delete it. = Please do not use, copy or disclose the information contained in this = message or in any attachment. Any views or opinions expressed by the = author of this email do not necessarily reflect the views of the = University of Nottingham. >=20 > This message has been checked for viruses but the contents of an = attachment > may still contain software viruses which could damage your computer = system: > you are advised to perform your own checks. Email communications with = the > University of Nottingham may be monitored as permitted by UK = legislation. From Richard.Mortier@nottingham.ac.uk Tue Jul 17 13:59:50 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr7NW-0001nx-He (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 13:59:50 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ixe-mta-19-tx.emailfiltering.com ([194.116.198.150]:40724 helo=ixe-mta-19.emailfiltering.com) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1Sr7NR-0004LN-mg (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 13:59:50 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by ixe-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2316298552 ;9226e48bc9fc17c6; Tue, 17 Jul 2012 13:59:24 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sr7N6-0008Eu-Q8 for cl-mirage@lists.cam.ac.uk; Tue, 17 Jul 2012 13:59:24 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Tue, 17 Jul 2012 13:59:24 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Tue, 17 Jul 2012 13:59:23 +0100 Subject: Re: ocaml-openflow- odd (oasis?) error Thread-Topic: ocaml-openflow- odd (oasis?) error Thread-Index: Ac1kG/05adSh+eC4Qj6An+UVFrcJaQ== Message-ID: <49D5ABC5-3902-478A-B496-C7BC200C6D96@nottingham.ac.uk> References: <36208526-AFF5-41EC-8FFF-A468279B6639@nottingham.ac.uk> In-Reply-To: Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 12:59:50 -0000 X-Keywords: X-UID: 400 Status: O Content-Length: 2281 Lines: 71 trying to recreate with a fresh copy of the repo and i can't so it's someth= ing i've moulinxed locally i guess. will keep poking at it... On 17 Jul 2012, at 13:28, Anil Madhavapeddy wrote: > Not enough information to spot the problem here; do you have a repository= I could look at? >=20 > -anil >=20 > On 17 Jul 2012, at 12:02, Richard Mortier wrote: >=20 >> get this when building ocaml-openflow: >>=20 >> E: Failure("No one of expected built files '_build/lib/openflow.cmi' exi= sts") >>=20 >> the _oasis etc all mirror ocaml-dns afaics. but using classic-display, i= see that ocaml-dns runs >>=20 >> ... >> ocamlfind ocamlopt -c -g -annot -I lib -package re.str -package re -pack= age lwt.unix -package lwt.syntax -package lwt -package cstruct.syntax -pack= age cstruct -package cryptokit -syntax camlp4o -for-pack Dns -I lib -o lib/= zone.cmx lib/zone.ml >> touch lib/dns.mli ; if ocamlfind ocamlopt -pack -g -I lib lib/base64.c= mx lib/hashcons.cmx lib/operators.cmx lib/name.cmx lib/RR.cmx lib/trie.cmx = lib/loader.cmx lib/packet.cmx lib/query.cmx lib/zone_parser.cmx lib/zone_le= xer.cmx lib/zone.cmx -o lib/dns.cmx ; then rm -f lib/dns.mli ; else rm = -f lib/dns.mli ; exit 1; fi >> ocamlfind ocamlopt -a -package lwt.syntax lib/dns.cmx -o lib/dns.cmxa >>=20 >>=20 >> ...so what is it that causes the "touch" invocation, why is it required,= and how do i get it into ocaml-openflow?! >>=20 >> --=20 >> Cheers, >>=20 >> R. >>=20 >>=20 >>=20 >>=20 >> This message and any attachment are intended solely for the addressee an= d may contain confidential information. If you have received this message i= n error, please send it back to me, and immediately delete it. Please do = not use, copy or disclose the information contained in this message or in a= ny attachment. Any views or opinions expressed by the author of this email= do not necessarily reflect the views of the University of Nottingham. >>=20 >> This message has been checked for viruses but the contents of an attachm= ent >> may still contain software viruses which could damage your computer syst= em: >> you are advised to perform your own checks. Email communications with th= e >> University of Nottingham may be monitored as permitted by UK legislation= . >=20 --=20 Cheers, R. From Richard.Mortier@nottingham.ac.uk Tue Jul 17 14:57:01 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr8Gr-0003DJ-BX (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 14:57:01 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:46703 helo=thb-mta-19.emailfiltering.com) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1Sr8Gk-0003YN-Sr (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 14:57:01 +0100 Received: from smtp4.nottingham.ac.uk ([128.243.220.65]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2500542678 ;139759740c5fbd28; Tue, 17 Jul 2012 14:56:34 +0100 Received: from uiwexhub02.ad.nottingham.ac.uk ([128.243.15.132]) by smtp4.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sr8GQ-0006cR-Ku for cl-mirage@lists.cam.ac.uk; Tue, 17 Jul 2012 14:56:34 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB02.ad.nottingham.ac.uk ([2002:80f3:f84::80f3:f84]) with mapi; Tue, 17 Jul 2012 14:56:29 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Tue, 17 Jul 2012 14:56:28 +0100 Subject: Re: ocaml-openflow- odd (oasis?) error Thread-Topic: ocaml-openflow- odd (oasis?) error Thread-Index: Ac1kI/az4ODno/k7Rn67k/H8cnwICA== Message-ID: References: <36208526-AFF5-41EC-8FFF-A468279B6639@nottingham.ac.uk> <49D5ABC5-3902-478A-B496-C7BC200C6D96@nottingham.ac.uk> In-Reply-To: <49D5ABC5-3902-478A-B496-C7BC200C6D96@nottingham.ac.uk> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 13:57:01 -0000 X-Keywords: X-UID: 401 Status: O Content-Length: 1851 Lines: 52 On 17 Jul 2012, at 13:59, Richard Mortier wrote: > trying to recreate with a fresh copy of the repo and i can't so it's some= thing i've moulinxed locally i guess. will keep poking at it... >=20 > On 17 Jul 2012, at 13:28, Anil Madhavapeddy wrote: >=20 >> Not enough information to spot the problem here; do you have a repositor= y I could look at? so- turns out it's the "Pack: true" line, in some circumstances. haven't figured out which ones yet - but i now have a tree where i see the = error if that line is present, and i don't see if if that line is removed. ring any bells? if you want to try it, look at HEA= D (commit 1c2216c62950289022c1e20f5cb8e53856669c38). removing the "Pack: t= rue" line from _oasis kills the error. fwiw ocaml-dns appears to be fine with having "Pack: true". >> On 17 Jul 2012, at 12:02, Richard Mortier wrote: >>=20 >>> get this when building ocaml-openflow: >>>=20 >>> E: Failure("No one of expected built files '_build/lib/openflow.cmi' ex= ists") --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From anil@recoil.org Tue Jul 17 15:37:29 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr8u1-0004dS-Kx (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 15:37:29 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:7046 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1Sr8u0-0005gd-Yv (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 15:37:29 +0100 Received: (qmail 10748 invoked by uid 634); 17 Jul 2012 14:37:28 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-142-70.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-142-70.eduroam.csx.cam.ac.uk) (128.232.142.70) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Tue, 17 Jul 2012 15:37:27 +0100 Subject: Re: ocaml-openflow- odd (oasis?) error Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Tue, 17 Jul 2012 15:37:26 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <36208526-AFF5-41EC-8FFF-A468279B6639@nottingham.ac.uk> <49D5ABC5-3902-478A-B496-C7BC200C6D96@nottingham.ac.uk> To: Richard Mortier X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 14:37:29 -0000 X-Keywords: X-UID: 402 Status: O Content-Length: 1217 Lines: 39 On 17 Jul 2012, at 14:56, Richard Mortier wrote: >=20 > On 17 Jul 2012, at 13:59, Richard Mortier wrote: >=20 >> trying to recreate with a fresh copy of the repo and i can't so it's = something i've moulinxed locally i guess. will keep poking at it... >>=20 >> On 17 Jul 2012, at 13:28, Anil Madhavapeddy wrote: >>=20 >>> Not enough information to spot the problem here; do you have a = repository I could look at? >=20 > so- turns out it's the "Pack: true" line, in some circumstances. >=20 > haven't figured out which ones yet - but i now have a tree where i see = the error if that line is present, and i don't see if if that line is = removed. >=20 > ring any bells? >=20 > if you want to try it, look at = HEAD (commit = 1c2216c62950289022c1e20f5cb8e53856669c38). removing the "Pack: true" = line from _oasis kills the error. >=20 > fwiw ocaml-dns appears to be fine with having "Pack: true". Do you have some sort of a namespace clash? Make sure none of the = modules you are packing are also called Openflow, and also that your Modules = line contains ALL the modules that you are packing into that. Just about to cycle, so I'll look at the repo later... -anil= From Richard.Mortier@nottingham.ac.uk Tue Jul 17 15:51:09 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr97F-0005Gd-QZ (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 15:51:09 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:58504 helo=thb-mta-19.emailfiltering.com) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1Sr97A-00081n-R7 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 15:51:09 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2500617962 ;78d5096eda52d230; Tue, 17 Jul 2012 15:50:44 +0100 Received: from uiwexhub02.ad.nottingham.ac.uk ([128.243.15.132]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sr96q-0007g5-3O for cl-mirage@lists.cam.ac.uk; Tue, 17 Jul 2012 15:50:44 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB02.ad.nottingham.ac.uk ([2002:80f3:f84::80f3:f84]) with mapi; Tue, 17 Jul 2012 15:50:28 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Tue, 17 Jul 2012 15:50:27 +0100 Subject: Re: ocaml-openflow- odd (oasis?) error Thread-Topic: ocaml-openflow- odd (oasis?) error Thread-Index: Ac1kK4FwCt6r/DVbREKvSMv2MORJmQ== Message-ID: References: <36208526-AFF5-41EC-8FFF-A468279B6639@nottingham.ac.uk> <49D5ABC5-3902-478A-B496-C7BC200C6D96@nottingham.ac.uk> In-Reply-To: Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 14:51:09 -0000 X-Keywords: X-UID: 403 Status: O Content-Length: 1434 Lines: 45 On 17 Jul 2012, at 15:37, Anil Madhavapeddy wrote: > On 17 Jul 2012, at 14:56, Richard Mortier wrote: >=20 >> so- turns out it's the "Pack: true" line, in some circumstances. >>=20 >> ... >=20 > Do you have some sort of a namespace clash? Make sure none of the modules > you are packing are also called Openflow, Modules: Controller, Packet, Nettypes, Checksum, Tcp > and also that your Modules line > contains ALL the modules that you are packing into that. it didn't (was missing Tcp module) - but have now added that, and error per= sists. > Just about to cycle, so I'll look at the repo later... cool, ta --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From anil@recoil.org Tue Jul 17 16:15:27 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr9Ul-00064h-IA (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 16:15:27 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:15303 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1Sr9Uk-0000Ic-Yv (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 16:15:27 +0100 Received: (qmail 28106 invoked by uid 634); 17 Jul 2012 15:15:26 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Tue, 17 Jul 2012 16:15:26 +0100 Subject: Re: ocaml-openflow- odd (oasis?) error Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Tue, 17 Jul 2012 16:15:24 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <36208526-AFF5-41EC-8FFF-A468279B6639@nottingham.ac.uk> <49D5ABC5-3902-478A-B496-C7BC200C6D96@nottingham.ac.uk> To: Richard Mortier X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 15:15:27 -0000 X-Keywords: X-UID: 404 Status: O Content-Length: 814 Lines: 27 On 17 Jul 2012, at 15:50, Richard Mortier wrote: > On 17 Jul 2012, at 15:37, Anil Madhavapeddy wrote: >> On 17 Jul 2012, at 14:56, Richard Mortier wrote: >>> so- turns out it's the "Pack: true" line, in some circumstances. >>>=20 >>> ... >>=20 >> Do you have some sort of a namespace clash? Make sure none of the = modules >> you are packing are also called Openflow, >=20 > Modules: Controller, Packet, Nettypes, Checksum, Tcp >=20 >> and also that your Modules line >> contains ALL the modules that you are packing into that. >=20 > it didn't (was missing Tcp module) - but have now added that, and = error persists. delete lib/openflow.mllib (which declares a collection of libraries), as you already have lib/openflow.mlpack (which repacks the libs into = Openflow.cma). probably an OASIS leftover... -a= From Richard.Mortier@nottingham.ac.uk Tue Jul 17 16:19:14 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sr9YQ-0006C9-Rd (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 16:19:14 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ixe-mta-19-tx.emailfiltering.com ([194.116.198.150]:52131 helo=ixe-mta-19.emailfiltering.com) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1Sr9YK-0001Tp-p9 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 16:19:14 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by ixe-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2316493012 ;f9aec9399b0eb18c; Tue, 17 Jul 2012 16:18:48 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sr9Y0-0000oc-EJ for cl-mirage@lists.cam.ac.uk; Tue, 17 Jul 2012 16:18:48 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Tue, 17 Jul 2012 16:18:48 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Tue, 17 Jul 2012 16:18:47 +0100 Subject: Re: ocaml-openflow- odd (oasis?) error Thread-Topic: ocaml-openflow- odd (oasis?) error Thread-Index: Ac1kL3aYpsCSm8/7SPGoEuLGxabn9g== Message-ID: <6AFAACE4-3E16-4306-B200-F9EDDFBCE7D1@nottingham.ac.uk> References: <36208526-AFF5-41EC-8FFF-A468279B6639@nottingham.ac.uk> <49D5ABC5-3902-478A-B496-C7BC200C6D96@nottingham.ac.uk> In-Reply-To: Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 15:19:14 -0000 X-Keywords: X-UID: 405 Status: O Content-Length: 1149 Lines: 34 On 17 Jul 2012, at 16:15, Anil Madhavapeddy wrote: > delete lib/openflow.mllib (which declares a collection of libraries), as > you already have lib/openflow.mlpack (which repacks the libs into Openflo= w.cma). solved it, thanks. > probably an OASIS leftover... yes probably... (the perils of putting autogen files in a repo ;) --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From h.rotsos@gmail.com Tue Jul 17 17:48:43 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SrAx1-0000S6-D5 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 17:48:43 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.213.51 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (h.rotsos[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-yw0-f51.google.com ([209.85.213.51]:53934) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1SrAx0-0002be-nK (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 17:48:43 +0100 Received: by yhnn12 with SMTP id n12so581310yhn.38 for ; Tue, 17 Jul 2012 09:48:41 -0700 (PDT) MIME-Version: 1.0 Received: by 10.66.76.130 with SMTP id k2mr6653061paw.19.1342543721028; Tue, 17 Jul 2012 09:48:41 -0700 (PDT) Sender: h.rotsos@gmail.com Received: by 10.142.172.2 with HTTP; Tue, 17 Jul 2012 09:48:40 -0700 (PDT) In-Reply-To: <6AFAACE4-3E16-4306-B200-F9EDDFBCE7D1@nottingham.ac.uk> References: <36208526-AFF5-41EC-8FFF-A468279B6639@nottingham.ac.uk> <49D5ABC5-3902-478A-B496-C7BC200C6D96@nottingham.ac.uk> <6AFAACE4-3E16-4306-B200-F9EDDFBCE7D1@nottingham.ac.uk> Date: Tue, 17 Jul 2012 09:48:40 -0700 X-Google-Sender-Auth: 64wc6pU3io6m1Kgs28JPUt9MI3c Message-ID: Subject: Re: ocaml-openflow- odd (oasis?) error From: Haris Rotsos To: Richard Mortier Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: Mirage List , Anil Madhavapeddy X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 16:48:43 -0000 X-Keywords: X-UID: 406 Status: O Content-Length: 1709 Lines: 61 On 17 July 2012 08:18, Richard Mortier w= rote: > > On 17 Jul 2012, at 16:15, Anil Madhavapeddy wrote: > >> delete lib/openflow.mllib (which declares a collection of libraries), as >> you already have lib/openflow.mlpack (which repacks the libs into Openfl= ow.cma). > I never managed to get the packed version of oasis working so I hadn't tried to generate a packed library. Sorry abotu that. > solved it, thanks. > >> probably an OASIS leftover... > > yes probably... (the perils of putting autogen files in a repo ;) ooops. My mistake. I wanted to have the library able to compile without the use of oasis so that is why I added all the autogen files in the repo. > > -- > Cheers, > > R. > > > > > This message and any attachment are intended solely for the addressee and= may contain confidential information. If you have received this message in= error, please send it back to me, and immediately delete it. Please do n= ot use, copy or disclose the information contained in this message or in an= y attachment. Any views or opinions expressed by the author of this email = do not necessarily reflect the views of the University of Nottingham. > > This message has been checked for viruses but the contents of an attachme= nt > may still contain software viruses which could damage your computer syste= m: > you are advised to perform your own checks. Email communications with the > University of Nottingham may be monitored as permitted by UK legislation. --=20 Charalampos Rotsos PhD student The University of Cambridge Computer Laboratory William Gates Building JJ Thomson Avenue Cambridge CB3 0FD Phone: +44-(0) 1223 767032 Email: cr409@cl.cam.ac.uk From Richard.Mortier@nottingham.ac.uk Tue Jul 17 17:51:49 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SrB01-0000a4-VF (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 17:51:49 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:56945 helo=thb-mta-19.emailfiltering.com) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SrAzw-0000uC-RY (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 17:51:49 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2500759858 ;f2125b2f7b5c5e3d; Tue, 17 Jul 2012 17:50:55 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1SrAz9-0005CQ-Bn; Tue, 17 Jul 2012 17:50:55 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Tue, 17 Jul 2012 17:50:48 +0100 From: Richard Mortier To: Haris Rotsos Date: Tue, 17 Jul 2012 17:50:47 +0100 Subject: Re: ocaml-openflow- odd (oasis?) error Thread-Topic: ocaml-openflow- odd (oasis?) error Thread-Index: Ac1kPFCHNXZHRk8DRdWLYXBopUvY6Q== Message-ID: References: <36208526-AFF5-41EC-8FFF-A468279B6639@nottingham.ac.uk> <49D5ABC5-3902-478A-B496-C7BC200C6D96@nottingham.ac.uk> <6AFAACE4-3E16-4306-B200-F9EDDFBCE7D1@nottingham.ac.uk> In-Reply-To: Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List , Anil Madhavapeddy X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 16:51:50 -0000 X-Keywords: X-UID: 407 Status: O Content-Length: 1411 Lines: 37 On 17 Jul 2012, at 17:48, Haris Rotsos wrote: > On 17 July 2012 08:18, Richard Mortier = wrote: >>=20 >> yes probably... (the perils of putting autogen files in a repo ;) >=20 > ooops. My mistake. I wanted to have the library able to compile > without the use of oasis so that is why I added all the autogen files > in the repo. no problem :) it made sense when oasis was a pain to install. just wonder = with opam now basically working whether we need to continue doing it though= ... (since could just express a dependency on oasis and be done i think.) --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From Richard.Mortier@nottingham.ac.uk Tue Jul 17 17:52:39 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SrB0p-0000cZ-U9 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 17:52:39 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:57718 helo=thb-mta-19.emailfiltering.com) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SrB0k-00015j-RT (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 17:52:39 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2500760718 ;350e1c8c442f594f; Tue, 17 Jul 2012 17:52:14 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1SrB0O-0005EL-Tn for cl-mirage@lists.cam.ac.uk; Tue, 17 Jul 2012 17:52:12 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Tue, 17 Jul 2012 17:52:12 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Tue, 17 Jul 2012 17:52:12 +0100 Subject: Re: opam and myocamlbuild.ml files Thread-Topic: opam and myocamlbuild.ml files Thread-Index: Ac1kPIMHRPsaW3UVQOK85wUKkH3HRg== Message-ID: <46C88A77-65F0-4DE3-A9C0-25270C9423B9@nottingham.ac.uk> References: <42145234-747E-4254-A83F-A3BA29CDCEDA@nottingham.ac.uk> <658FD234-2748-472C-800E-BB35D7E75433@recoil.org> In-Reply-To: <658FD234-2748-472C-800E-BB35D7E75433@recoil.org> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 16:52:40 -0000 X-Keywords: X-UID: 408 Status: O Content-Length: 1170 Lines: 32 On 17 Jul 2012, at 10:35, Anil Madhavapeddy wrote: > Good question. We could move to only generating the setup.ml for stable = releases, and > not for the working copy. The diff spam is really irritating when bug bi= secting... agree; at risk of repeating in other mail- could we even just move to oasis= being a dependency and let opam handle it? --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From thomas.gazagnaire@gmail.com Tue Jul 17 18:12:39 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SrBKA-00019w-Uz (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 18:12:38 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [74.125.82.41 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (thomas.gazagnaire[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wg0-f41.google.com ([74.125.82.41]:47136) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1SrBKA-0003iz-oE (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 18:12:38 +0100 Received: by wgbds1 with SMTP id ds1so3553989wgb.2 for ; Tue, 17 Jul 2012 10:12:38 -0700 (PDT) Received: by 10.180.99.196 with SMTP id es4mr5793759wib.18.1342545158331; Tue, 17 Jul 2012 10:12:38 -0700 (PDT) Received: from [192.168.0.14] (gou06-3-88-170-165-56.fbx.proxad.net. [88.170.165.56]) by mx.google.com with ESMTPS id ep14sm28636571wid.0.2012.07.17.10.12.36 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 17 Jul 2012 10:12:37 -0700 (PDT) Subject: Re: opam and myocamlbuild.ml files Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: Thomas Gazagnaire In-Reply-To: <46C88A77-65F0-4DE3-A9C0-25270C9423B9@nottingham.ac.uk> Date: Tue, 17 Jul 2012 19:12:35 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <841C14CD-6382-40FF-BB0C-8B0571144CB5@gmail.com> References: <42145234-747E-4254-A83F-A3BA29CDCEDA@nottingham.ac.uk> <658FD234-2748-472C-800E-BB35D7E75433@recoil.org> <46C88A77-65F0-4DE3-A9C0-25270C9423B9@nottingham.ac.uk> To: Richard Mortier X-Mailer: Apple Mail (2.1084) Cc: Mirage List , Anil Madhavapeddy X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 17:12:39 -0000 X-Keywords: X-UID: 409 Status: O Content-Length: 491 Lines: 17 >> Good question. We could move to only generating the setup.ml for = stable releases, and >> not for the working copy. The diff spam is really irritating when = bug bisecting... >=20 > agree; at risk of repeating in other mail- could we even just move to = oasis being a dependency and let opam handle it? sure, that's already what we've been doing with ocamlfind. so 'opam = install oasis' works and 'oasis' can be added as a dependency. Working on a opam-0.3 tonight ... -- Thomas From h.rotsos@gmail.com Tue Jul 17 18:21:24 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SrBSe-0001It-Fz (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 18:21:24 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.160.51 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (h.rotsos[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-pb0-f51.google.com ([209.85.160.51]:62083) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1SrBSb-0000Zn-qN (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 18:21:24 +0100 Received: by pbbrp16 with SMTP id rp16so1101596pbb.38 for ; Tue, 17 Jul 2012 10:21:20 -0700 (PDT) MIME-Version: 1.0 Received: by 10.68.189.135 with SMTP id gi7mr397879pbc.68.1342545680164; Tue, 17 Jul 2012 10:21:20 -0700 (PDT) Sender: h.rotsos@gmail.com Received: by 10.142.172.2 with HTTP; Tue, 17 Jul 2012 10:21:20 -0700 (PDT) Date: Tue, 17 Jul 2012 10:21:20 -0700 X-Google-Sender-Auth: 6Y_gQtaqeUAkRBD9gna8S1J5PoU Message-ID: Subject: Gc.compact weirdness help From: Haris Rotsos To: "cl-mirage@lists.cam.ac.uk Mailing List" Content-Type: text/plain; charset=UTF-8 X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 17:21:24 -0000 X-Keywords: X-UID: 410 Status: O Content-Length: 15871 Lines: 419 HI all, got a problem with the Gc memory managment in ocaml and I was wondering if someone could give me some help. So currently I am working on integrating ns3 network simulator (http://www.nsnam.org/) as a network backend for mirage. The idea is to convert mirage into a network simulator for software defined network designs. I have so far managed to get packets and timing integration and all works nicely, but I got a memory managment problem. My problem is that when Gc start to compact memory, my program goes on an halt and nothing moves. SO far I have a simple program which creates two hosts, one wotking as a tcp server and the other working as a tcp client. At time t=1 sec the client sets up a tcp connection and starts sending packets as fast as it can. >From the network perspective the way I hanfle packet passing is as follows: for each interface I register a packet handler which pushed packet to the OS.Netif module as follows: bool PktDemux(Ptr dev, Ptr pkt, uint16_t proto, const Address &src, const Address &dst, NetDevice::PacketType type) { CAMLlocal1( ml_data ); printf("packet demux...\n"); fprintf(stdout, "%f: receiving %u packet done...\n", (long)Simulator::Now().GetMicroSeconds() / 1e6, pkt->GetSize()); fflush(stdout); int pkt_len = pkt->GetSize(); ml_data = caml_alloc_string(pkt_len); pkt->CopyData((uint8_t *)String_val(ml_data), pkt_len); // find host name string node_name = getHostName(dev); //printf("node %s.%d packet\n", node_name.c_str(), dev->GetIfIndex()); // call packet handling code in caml caml_callback3(*caml_named_value("demux_pkt"), caml_copy_string((const char *)node_name.c_str()), Val_int(dev->GetIfIndex()), ml_data ); printf("packet demux end...\n"); return true; } for packet transmission I have the following code: CAMLprim value caml_pkt_write(value v_node_name, value v_id, value v_ba, value v_off, value v_len) { CAMLparam5(v_node_name, v_id, v_ba, v_off, v_len); printf("sending packet begin...\n"); uint32_t ifIx = (uint32_t)Int_val(v_id); string node_name = string(String_val(v_node_name)); //get a pointer to the packet byte data uint8_t *buf = (uint8_t *) Caml_ba_data_val(v_ba); int len = Int_val(v_len), off = Int_val(v_off); Ptr< Packet> pkt = Create(buf + off, len ); // rther proto of the packet. uint16_t proto = ntohs(*(uint16_t *)(buf + off + 12)); // find the right device for the node and send packet Ptr node = nodes[node_name]; Mac48Address mac_dst; mac_dst.CopyFrom(buf+off); for (uint32_t i = 0; i < node->GetNDevices (); i++) if(node->GetDevice(i)->GetIfIndex() == ifIx) { if(!node->GetDevice(i)->Send(pkt, mac_dst, proto)) fprintf(stdout, "%f: packet dropped...\n", (long)Simulator::Now().GetMicroSeconds() / 1e6); fprintf(stdout, "%f: (left pkt %u) sending %u packet done...\n", (long)Simulator::Now().GetMicroSeconds() / 1e6, node->GetDevice(i)->GetObject()->GetQueue()->GetNPackets(), pkt->GetSize()); fflush(stdout); } printf("sending packet end...\n"); CAMLreturn( Val_unit ); } On the ocaml side of things the netif listem uses an Lwt_stream to read for packets and blocks when no packets are queued for processing. The pkt_demux method calls an ocaml method that will simply convert the strimg into a Cstruct and push it down to the Lwt_stream. I am thinking that maybe this is where I am over using memory, but the memory overutilisation should account only for a few packets and the program shouldn't be running out of memory so fast. For packet transmission I also have a method that will check the size of the queue of the network device. If the queue is full, the netif thrread will block on an Lwt condition and setup a timer event which will check every milisecond if the queue has space for packets. If the device transmits a packet, then the timer handler will call an ocaml method that will broadcast on the condition a unit in order to unblock the sending thread. Now from during run I get the following problem. cr409@nile ~/scratch/mirage/regress> gdb ./_build/ns3-direct/basic/sleep_ns3.bin GNU gdb (GDB) Red Hat Enterprise Linux (7.2-50.el6) Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /local/scratch/cr409/mirage/regress/_build/ns3-direct/basic/sleep_ns3.bin...done. (gdb) run Starting program: /local/scratch/cr409/mirage/regress/_build/ns3-direct/basic/sleep_ns3.bin [Thread debugging using libthread_db enabled] Main: startup OS.Topology started... Adding node node1 Adding node node2 Adding link between nodes node1 - node2 Netif: plug node1.0 Netif: plug node2.0 Initialising nodes.... Manager: create Manager: plug 0 Manager: plug done, to listener Listening Server Manager: VIF 0 to 10.0.0.1 nm 255.255.255.0 gw [10.0.0.1] ARP: sending gratuitous from 10.0.0.1 sending packet begin... 0.000000: (left pkt 0) sending 64 packet done... sending packet end... Listening Server Manager: init done Manager: create Manager: plug 0 Manager: plug done, to listener 0.000000: trying to connect client Manager: VIF 0 to 10.0.0.2 nm 255.255.255.0 gw [10.0.0.1] ARP: sending gratuitous from 10.0.0.2 sending packet begin... 0.000000: (left pkt 0) sending 64 packet done... sending packet end... Manager: init done packet demux... 0.001000: receiving 46 packet done... ARP: updating 10.0.0.1 -> 00:00:00:00:00:01 packet demux end... packet demux... 0.002342: receiving 46 packet done... ARP: updating 10.0.0.2 -> 00:00:00:00:00:02 packet demux end... event handler begin... 1.000000: trying to connect client sending packet begin... 1.000000: (left pkt 0) sending 80 packet done... sending packet end... event handler end... packet demux... 1.001000: receiving 62 packet done... ............................................ 1.139615: receiving 54 packet done... sending packet begin... 1.139615: (left pkt 36) sending 1532 packet done... sending packet end... sending packet begin... 1.139615: (left pkt 37) sending 1532 packet done... sending packet end... sending packet begin... 1.139615: (left pkt 38) sending 1532 packet done... sending packet end... 1.139615: Writing new buffer.... 1.139615: Writing new buffer.... 1.139615: Writing new buffer.... packet demux end... packet demux... 1.140655: receiving 1514 packet done... 1.140655: read 1460 ^Z Program received signal SIGTSTP, Stopped (user). 0x0000000000493e58 in caml_oldify_local_roots () Missing separate debuginfos, use: debuginfo-install atk-1.28.0-2.el6.x86_64 cairo-1.8.8-3.1.el6.x86_64 expat-2.0.1-11.el6_2.x86_64 fontconfig-2.8.0-3.el6.x86_64 freetype-2.3.11-6.el6_2.9.x86_64 glib2-2.22.5-6.el6.x86_64 glibc-2.12-1.47.el6_2.12.x86_64 gsl-1.13-1.el6.x86_64 gtk2-2.18.9-6.el6.centos.x86_64 libX11-1.3-2.el6.x86_64 libXau-1.0.5-1.el6.x86_64 libXcomposite-0.4.1-2.el6.x86_64 libXcursor-1.1.10-2.el6.x86_64 libXdamage-1.1.2-1.el6.x86_64 libXext-1.1-3.el6.x86_64 libXfixes-4.0.4-1.el6.x86_64 libXi-1.3-3.el6.x86_64 libXinerama-1.1-1.el6.x86_64 libXrandr-1.3.0-4.el6.x86_64 libXrender-0.9.5-1.el6.x86_64 libgcc-4.4.6-3.el6.x86_64 libpng-1.2.49-1.el6_2.x86_64 libselinux-2.0.94-5.2.el6.x86_64 libstdc++-4.4.6-3.el6.x86_64 libxcb-1.5-1.el6.x86_64 libxml2-2.7.6-4.el6_2.4.x86_64 ncurses-libs-5.7-3.20090208.el6.x86_64 pango-1.28.1-3.el6_0.5.1.centos.x86_64 pixman-0.18.4-1.el6_0.1.x86_64 sqlite-3.6.20-1.el6.x86_64 zlib-1.2.3-27.el6.x86_64 (gdb) bt #0 0x0000000000493e58 in caml_oldify_local_roots () #1 0x0000000000496525 in caml_empty_minor_heap () #2 0x000000000049665a in caml_minor_collection () #3 0x0000000000494a32 in caml_garbage_collection () #4 0x00000000004a40d6 in caml_call_gc () #5 0x00000000000000ff in ?? () #6 0x2525252525252525 in ?? () #7 0x0000000000000000 in ?? () I got a note from anil that he default ulimit of the program might be my problem. I have so far: cr409@nile ~/scratch/mirage/regress> ulimit -s 1024 Another interesting point is that if I call the Gc.compact method every time I get a packet on the demux method then the program halts with a couple of packets. cr409@nile ~/scratch/mirage/regress> gdb ./_build/ns3-direct/basic/sleep_ns3.bin GNU gdb (GDB) Red Hat Enterprise Linux (7.2-50.el6) Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /local/scratch/cr409/mirage/regress/_build/ns3-direct/basic/sleep_ns3.bin...done. (gdb) run Starting program: /local/scratch/cr409/mirage/regress/_build/ns3-direct/basic/sleep_ns3.bin [Thread debugging using libthread_db enabled] Main: startup OS.Topology started... Adding node node1 Adding node node2 Adding link between nodes node1 - node2 Netif: plug node1.0 Netif: plug node2.0 Initialising nodes.... Manager: create Manager: plug 0 Manager: plug done, to listener Listening Server Manager: VIF 0 to 10.0.0.1 nm 255.255.255.0 gw [10.0.0.1] ARP: sending gratuitous from 10.0.0.1 sending packet begin... 0.000000: (left pkt 0) sending 64 packet done... sending packet end... Listening Server Manager: init done Manager: create Manager: plug 0 Manager: plug done, to listener 0.000000: trying to connect client Manager: VIF 0 to 10.0.0.2 nm 255.255.255.0 gw [10.0.0.1] ARP: sending gratuitous from 10.0.0.2 sending packet begin... 0.000000: (left pkt 0) sending 64 packet done... sending packet end... Manager: init done packet demux... 0.001000: receiving 46 packet done... ARP: updating 10.0.0.1 -> 00:00cr409@nile ~/scratch/mirage/regress> gdb ./_build/ns3-direct/basic/sleep_ns3.bin GNU gdb (GDB) Red Hat Enterprise Linux (7.2-50.el6) Copyright (C) 2010 Free Software Foundation, Inc. License GPLv3+: GNU GPL version 3 or later This is free software: you are free to change and redistribute it. There is NO WARRANTY, to the extent permitted by law. Type "show copying" and "show warranty" for details. This GDB was configured as "x86_64-redhat-linux-gnu". For bug reporting instructions, please see: ... Reading symbols from /local/scratch/cr409/mirage/regress/_build/ns3-direct/basic/sleep_ns3.bin...done. (gdb) run Starting program: /local/scratch/cr409/mirage/regress/_build/ns3-direct/basic/sleep_ns3.bin [Thread debugging using libthread_db enabled] Main: startup OS.Topology started... Adding node node1 Adding node node2 Adding link between nodes node1 - node2 Netif: plug node1.0 Netif: plug node2.0 Initialising nodes.... Manager: create Manager: plug 0 Manager: plug done, to listener Listening Server Manager: VIF 0 to 10.0.0.1 nm 255.255.255.0 gw [10.0.0.1] ARP: sending gratuitous from 10.0.0.1 sending packet begin... 0.000000: (left pkt 0) sending 64 packet done... sending packet end... Listening Server Manager: init done Manager: create Manager: plug 0 Manager: plug done, to listener 0.000000: trying to connect client Manager: VIF 0 to 10.0.0.2 nm 255.255.255.0 gw [10.0.0.1] ARP: sending gratuitous from 10.0.0.2 sending packet begin... 0.000000: (left pkt 0) sending 64 packet done... sending packet end... Manager: init done packet demux... 0.001000: receiving 46 packet done... ARP: updating 10.0.0.1 -> 00:00:00:00:00:01 packet demux end... packet demux... 0.002342: receiving 46 packet done... ^Z Program received signal SIGTSTP, Stopped (user). 0x0000000000493e5c in caml_oldify_local_roots () Missing separate debuginfos, use: debuginfo-install atk-1.28.0-2.el6.x86_64 cairo-1.8.8-3.1.el6.x86_64 expat-2.0.1-11.el6_2.x86_64 fontconfig-2.8.0-3.el6.x86_64 freetype-2.3.11-6.el6_2.9.x86_64 glib2-2.22.5-6.el6.x86_64 glibc-2.12-1.47.el6_2.12.x86_64 gsl-1.13-1.el6.x86_64 gtk2-2.18.9-6.el6.centos.x86_64 libX11-1.3-2.el6.x86_64 libXau-1.0.5-1.el6.x86_64 libXcomposite-0.4.1-2.el6.x86_64 libXcursor-1.1.10-2.el6.x86_64 libXdamage-1.1.2-1.el6.x86_64 libXext-1.1-3.el6.x86_64 libXfixes-4.0.4-1.el6.x86_64 libXi-1.3-3.el6.x86_64 libXinerama-1.1-1.el6.x86_64 libXrandr-1.3.0-4.el6.x86_64 libXrender-0.9.5-1.el6.x86_64 libgcc-4.4.6-3.el6.x86_64 libpng-1.2.49-1.el6_2.x86_64 libselinux-2.0.94-5.2.el6.x86_64 libstdc++-4.4.6-3.el6.x86_64 libxcb-1.5-1.el6.x86_64 libxml2-2.7.6-4.el6_2.4.x86_64 ncurses-libs-5.7-3.20090208.el6.x86_64 pango-1.28.1-3.el6_0.5.1.centos.x86_64 pixman-0.18.4-1.el6_0.1.x86_64 sqlite-3.6.20-1.el6.x86_64 zlib-1.2.3-27.el6.x86_64 (gdb) bt #0 0x0000000000493e5c in caml_oldify_local_roots () #1 0x0000000000496585 in caml_empty_minor_heap () #2 0x000000000049f750 in caml_gc_compaction () #3 0x00000000004a42b8 in caml_c_call () #4 0x00007ffff7fcafd0 in ?? () #5 0x000000000045bf81 in camlLwt__backtrace_catch_1667 () #6 0x00007fffffffd2c0 in ?? () #7 0x000000000045bf63 in camlLwt__backtrace_catch_1667 () #8 0x00007fffffffd300 in ?? () #9 0x00007ffff2ef3904 in mcount () from /lib64/libc.so.6 #10 0x00000000006e2080 in camlOS__64 () #11 0x00007ffff7fcafb0 in ?? () #12 0x0000000000000000 in ?? () :00:00:00:01 packet demux end... packet demux... 0.002342: receiving 46 packet done... ^Z Program received signal SIGTSTP, Stopped (user). 0x0000000000493e5c in caml_oldify_local_roots () Missing separate debuginfos, use: debuginfo-install atk-1.28.0-2.el6.x86_64 cairo-1.8.8-3.1.el6.x86_64 expat-2.0.1-11.el6_2.x86_64 fontconfig-2.8.0-3.el6.x86_64 freetype-2.3.11-6.el6_2.9.x86_64 glib2-2.22.5-6.el6.x86_64 glibc-2.12-1.47.el6_2.12.x86_64 gsl-1.13-1.el6.x86_64 gtk2-2.18.9-6.el6.centos.x86_64 libX11-1.3-2.el6.x86_64 libXau-1.0.5-1.el6.x86_64 libXcomposite-0.4.1-2.el6.x86_64 libXcursor-1.1.10-2.el6.x86_64 libXdamage-1.1.2-1.el6.x86_64 libXext-1.1-3.el6.x86_64 libXfixes-4.0.4-1.el6.x86_64 libXi-1.3-3.el6.x86_64 libXinerama-1.1-1.el6.x86_64 libXrandr-1.3.0-4.el6.x86_64 libXrender-0.9.5-1.el6.x86_64 libgcc-4.4.6-3.el6.x86_64 libpng-1.2.49-1.el6_2.x86_64 libselinux-2.0.94-5.2.el6.x86_64 libstdc++-4.4.6-3.el6.x86_64 libxcb-1.5-1.el6.x86_64 libxml2-2.7.6-4.el6_2.4.x86_64 ncurses-libs-5.7-3.20090208.el6.x86_64 pango-1.28.1-3.el6_0.5.1.centos.x86_64 pixman-0.18.4-1.el6_0.1.x86_64 sqlite-3.6.20-1.el6.x86_64 zlib-1.2.3-27.el6.x86_64 (gdb) bt #0 0x0000000000493e5c in caml_oldify_local_roots () #1 0x0000000000496585 in caml_empty_minor_heap () #2 0x000000000049f750 in caml_gc_compaction () #3 0x00000000004a42b8 in caml_c_call () #4 0x00007ffff7fcafd0 in ?? () #5 0x000000000045bf81 in camlLwt__backtrace_catch_1667 () #6 0x00007fffffffd2c0 in ?? () #7 0x000000000045bf63 in camlLwt__backtrace_catch_1667 () #8 0x00007fffffffd300 in ?? () #9 0x00007ffff2ef3904 in mcount () from /lib64/libc.so.6 #10 0x00000000006e2080 in camlOS__64 () #11 0x00007ffff7fcafb0 in ?? () #12 0x0000000000000000 in ?? () any ideas how I handle this weirdness? I am planning today as a debugging test to try and keep either the server or the client in c++ so that I can check if the problem is somewhere on the way I processing packets currently and try to find out how I can optimise the packet reading or writing process. -- Charalampos Rotsos PhD student The University of Cambridge Computer Laboratory William Gates Building JJ Thomson Avenue Cambridge CB3 0FD Phone: +44-(0) 1223 767032 Email: cr409@cl.cam.ac.uk From anil@recoil.org Tue Jul 17 18:34:22 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SrBfC-0001Qa-F6 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 18:34:22 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:40855 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1SrBfC-0000UY-WN (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 18:34:22 +0100 Received: (qmail 6325 invoked by uid 634); 17 Jul 2012 17:34:21 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from Unknown (HELO [10.209.131.79]) (82.132.139.69) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Tue, 17 Jul 2012 18:34:21 +0100 Subject: Re: opam and myocamlbuild.ml files References: <42145234-747E-4254-A83F-A3BA29CDCEDA@nottingham.ac.uk> <658FD234-2748-472C-800E-BB35D7E75433@recoil.org> <46C88A77-65F0-4DE3-A9C0-25270C9423B9@nottingham.ac.uk> From: Anil Madhavapeddy Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii In-Reply-To: <46C88A77-65F0-4DE3-A9C0-25270C9423B9@nottingham.ac.uk> Message-Id: <524F04D4-BF81-4EC3-9EDF-DD7FCF2F85E6@recoil.org> Date: Tue, 17 Jul 2012 18:27:54 +0100 To: Richard Mortier Mime-Version: 1.0 (1.0) X-Mailer: iPhone Mail (9B206) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 17:34:22 -0000 X-Keywords: X-UID: 411 Status: O Content-Length: 1418 Lines: 42 On 17 Jul 2012, at 17:52, Richard Mortier = wrote: >=20 > On 17 Jul 2012, at 10:35, Anil Madhavapeddy wrote: >=20 >> Good question. We could move to only generating the setup.ml for stable r= eleases, and >> not for the working copy. The diff spam is really irritating when bug bi= secting... >=20 > agree; at risk of repeating in other mail- could we even just move to oasi= s being a dependency and let opam handle it? Could do; but that would require different OPAM files for dev and releases. J= ust needs someone to make sure that works... -anil >=20 > --=20 > Cheers, >=20 > R. >=20 >=20 >=20 >=20 > This message and any attachment are intended solely for the addressee and m= ay contain confidential information. If you have received this message in er= ror, please send it back to me, and immediately delete it. Please do not u= se, copy or disclose the information contained in this message or in any att= achment. Any views or opinions expressed by the author of this email do not= necessarily reflect the views of the University of Nottingham. >=20 > This message has been checked for viruses but the contents of an attachmen= t > may still contain software viruses which could damage your computer system= : > you are advised to perform your own checks. Email communications with the > University of Nottingham may be monitored as permitted by UK legislation. From Richard.Mortier@nottingham.ac.uk Tue Jul 17 19:13:37 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SrCHB-00024B-5v (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 19:13:37 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:51494 helo=thb-mta-19.emailfiltering.com) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SrCH4-0001lW-RI (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 19:13:37 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.104) by TLS id 2500820702 ;b3b0268af231fe1d; Tue, 17 Jul 2012 19:13:10 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1SrCGk-0006vI-6t for cl-mirage@lists.cam.ac.uk; Tue, 17 Jul 2012 19:13:10 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::60c2:2879:5a5a:29a6]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Tue, 17 Jul 2012 19:13:10 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Tue, 17 Jul 2012 19:13:09 +0100 Subject: Re: opam and myocamlbuild.ml files Thread-Topic: opam and myocamlbuild.ml files Thread-Index: Ac1kR9HXCwf0jzrnSGGH+9CgpmeF4g== Message-ID: References: <42145234-747E-4254-A83F-A3BA29CDCEDA@nottingham.ac.uk> <658FD234-2748-472C-800E-BB35D7E75433@recoil.org> <46C88A77-65F0-4DE3-A9C0-25270C9423B9@nottingham.ac.uk> <524F04D4-BF81-4EC3-9EDF-DD7FCF2F85E6@recoil.org> In-Reply-To: <524F04D4-BF81-4EC3-9EDF-DD7FCF2F85E6@recoil.org> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 18:13:37 -0000 X-Keywords: X-UID: 412 Status: O Content-Length: 1667 Lines: 46 On 17 Jul 2012, at 18:27, Anil Madhavapeddy wrote: > On 17 Jul 2012, at 17:52, Richard Mortier wrote: >=20 >>=20 >> On 17 Jul 2012, at 10:35, Anil Madhavapeddy wrote: >>=20 >>> Good question. We could move to only generating the setup.ml for stabl= e releases, and >>> not for the working copy. The diff spam is really irritating when bug = bisecting... >>=20 >> agree; at risk of repeating in other mail- could we even just move to oa= sis being a dependency and let opam handle it? >=20 > Could do; but that would require different OPAM files for dev and release= s. Just needs someone to make sure that works... hm- don't follow. why does that require different opam files? (perhaps a more general question here is- what's the difference in concept = between dev and release versions of an opam package?) --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From thomas.gazagnaire@gmail.com Tue Jul 17 23:52:49 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SrGdN-0004wh-A6 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 23:52:49 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score 0.2 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.212.173 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (thomas.gazagnaire[at]gmail.com) * 0.0 DKIM_ADSP_CUSTOM_MED No valid author signature, adsp_override is * CUSTOM_MED * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid * 0.9 NML_ADSP_CUSTOM_MED ADSP custom_med hit, and not from a mailing * list X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wi0-f173.google.com ([209.85.212.173]:51684) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1SrGdM-0002LJ-ZG (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 17 Jul 2012 23:52:49 +0100 Received: by wibhm6 with SMTP id hm6so3302797wib.2 for ; Tue, 17 Jul 2012 15:52:48 -0700 (PDT) Received: by 10.216.233.95 with SMTP id o73mr412968weq.59.1342565568709; Tue, 17 Jul 2012 15:52:48 -0700 (PDT) Received: from [192.168.0.14] (gou06-3-88-170-165-56.fbx.proxad.net. [88.170.165.56]) by mx.google.com with ESMTPS id ef5sm43401206wib.3.2012.07.17.15.52.46 (version=TLSv1/SSLv3 cipher=OTHER); Tue, 17 Jul 2012 15:52:48 -0700 (PDT) Subject: Re: building ocaml-dns and bitstring; using oasis Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: Thomas Gazagnaire In-Reply-To: <4218593A-3757-4D5E-8008-6B157AEC5B6E@recoil.org> Date: Wed, 18 Jul 2012 00:52:45 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <63D15B3C-E81D-4937-8410-97E7919ADDA2@nottingham.ac.uk> <637C249A-FA8E-4BD2-817C-ACD47F66F99A@recoil.org> <4218593A-3757-4D5E-8008-6B157AEC5B6E@recoil.org> To: Anil Madhavapeddy X-Mailer: Apple Mail (2.1084) Cc: Richard Mortier , Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 17 Jul 2012 22:52:49 -0000 X-Keywords: X-UID: 413 Status: O Content-Length: 322 Lines: 11 > The recent fixes are all pretty important to make OPAM work reliably. > Thomas, how about a 0.2.1 release? That'll hopefully not mess up your = roadmap numbering ;-) I've just made a 0.3 release with few more bugfixes (including a way to = use topfind, but you'll need to update ocamlfind .install files). -- Thomas From h.rotsos@gmail.com Thu Jul 19 06:21:25 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SrjAz-00041h-QT (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 19 Jul 2012 06:21:25 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score 0.3 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.160.51 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (h.rotsos[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.0 HTML_MESSAGE BODY: HTML included in message * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid * 1.0 MANY_SPAN_IN_TEXT Many tags embedded within text X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-pb0-f51.google.com ([209.85.160.51]:40133) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1SrjAy-0007mF-Z9 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 19 Jul 2012 06:21:25 +0100 Received: by pbbrp16 with SMTP id rp16so3797015pbb.38 for ; Wed, 18 Jul 2012 22:21:23 -0700 (PDT) MIME-Version: 1.0 Received: by 10.68.232.229 with SMTP id tr5mr2102363pbc.101.1342675283733; Wed, 18 Jul 2012 22:21:23 -0700 (PDT) Sender: h.rotsos@gmail.com Received: by 10.142.172.2 with HTTP; Wed, 18 Jul 2012 22:21:23 -0700 (PDT) In-Reply-To: References: Date: Wed, 18 Jul 2012 22:21:23 -0700 X-Google-Sender-Auth: ujxXDQoYNkY6oQApwtiQ94pGPP0 Message-ID: Subject: Re: Gc.compact weirdness help From: Haris Rotsos To: "cl-mirage@lists.cam.ac.uk Mailing List" Content-Type: multipart/alternative; boundary=047d7b33cf9e55ed4104c527f3ab X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jul 2012 05:21:25 -0000 X-Keywords: X-UID: 414 Status: O Content-Length: 11166 Lines: 223 --047d7b33cf9e55ed4104c527f3ab Content-Type: text/plain; charset=UTF-8 So I found my problem on the aforthmentioned problem, and I am writing here the solution just for the records. reading a bit the documentation about c interfacing of ocaml, I discovered that then CAMLlocal1 function registers a value variable with the gc, but is not sufficient if the function is not returing with the CAMLReturn method. I think the problem is that the Gc during a compact face will try to change memory mapping and update also the value of the local variable. If this variable is in the stuck, then the gc will not be able to update its value. The strange thing is the code never returned a segfault. In order to sort this problem I did the following modification in the c code: On 17 July 2012 10:21, Haris Rotsos wrote: > bool > PktDemux(Ptr dev, Ptr pkt, uint16_t proto, > const Address &src, const Address &dst, NetDevice::PacketType type) { > - CAMLlocal1( ml_data ); > + value ml_data; + caml_register_global_root(&ml_data); printf("packet demux...\n"); > fprintf(stdout, "%f: receiving %u packet done...\n", > (long)Simulator::Now().GetMicroSeconds() / 1e6, pkt->GetSize()); > fflush(stdout); > > int pkt_len = pkt->GetSize(); > ml_data = caml_alloc_string(pkt_len); > pkt->CopyData((uint8_t *)String_val(ml_data), pkt_len); > > // find host name > string node_name = getHostName(dev); > > //printf("node %s.%d packet\n", node_name.c_str(), dev->GetIfIndex()); > // call packet handling code in caml > caml_callback3(*caml_named_value("demux_pkt"), > caml_copy_string((const char *)node_name.c_str()), > Val_int(dev->GetIfIndex()), ml_data ); > printf("packet demux end...\n"); > + caml_remove_global_root(&ml_data); > return true; > } > pretty simple but pretty tricky also to know about it. I had to revert reading some source code from relevant project (basically it was a code binding of ocaml to a video codec library) in order to figure out the solution. -- Charalampos Rotsos PhD student The University of Cambridge Computer Laboratory William Gates Building JJ Thomson Avenue Cambridge CB3 0FD Phone: +44-(0) 1223 767032 Email: cr409@cl.cam.ac.uk --047d7b33cf9e55ed4104c527f3ab Content-Type: text/html; charset=UTF-8 Content-Transfer-Encoding: quoted-printable So I found my problem on the aforthmentioned= =C2=A0 problem, and I am writing here the solution just for the records.=C2= =A0

reading a bit the documentation about c i= nterfacing of ocaml, I discovered that then=C2=A0CAMLl= ocal1 function registers a value variable with the = gc, but is not sufficient if the function is not returing=C2=A0with the CAMLReturn metho= d. I think the problem is that the Gc during a compact fa= ce will try to change memory mapping and update also the value of the local= variable. If this variable is in the stuck, then the = gc=C2=A0will not be able to update its value. The strange= thing is the code never returned a segfault.=C2=A0=

In order to sort this problem I did = the following modification in the c code:

On 17 July 2012 10:21, Haris Rotsos <cr409@cl.cam.ac.uk> w= rote:
bool PktDemux(Ptr<NetDevice> dev,= Ptr<const Packet> pkt, uint= 16_t proto,
=C2=A0 =C2=A0 const Address &src, co= nst Address &dst, NetDevice::PacketType type) {=
- =C2=A0CAMLlocal1( ml_data );
= + =C2=A0value ml_data; =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2= =A0 =C2=A0 =C2=A0 =C2=A0
+ =C2=A0caml_register_global_root(&ml_data);

=C2=A0 printf("packet demux...\= n");
=C2=A0 fprintf(stdout, "%f: re= ceiving %u packet done...\n",
=C2=A0 =C2=A0 =C2=A0 (long)Simulator::Now().GetMicroSeconds() / 1e6, pkt-&g= t;GetSize());
=C2=A0 fflush(stdout<= /span>);

=C2=A0 int pkt_len =3D pkt->GetSize();
=C2=A0 ml_data =3D caml_alloc_string(pkt_len);
=C2=A0 pkt->CopyData((uint8_t *)String_val(ml_data), pkt_len);

=C2=A0 // find host name
=C2=A0 string node_name =3D getHo= stName(dev);

=C2=A0 //printf("node %s.%d packet\n", node_name.c_str(), dev->= ;GetIfIndex());
=C2=A0 // call packet handling code in cam= l
=C2=A0 caml_callback3(*caml_named_value(&= quot;demux_pkt"),
=C2=A0 =C2=A0 =C2=A0 caml_copy_string((const char *)node_name.c_str()),
=C2=A0 =C2=A0 =C2=A0 Val_int(dev->GetIfIndex(= )), ml_data );
=C2=A0 printf("packet demux end...\n");

+ =C2=A0caml_remove_global_root(&ml_data);
=C2=A0
=C2=A0 return true;
}

pretty simple but prett= y tricky also to know about it. I had to revert reading some source code fr= om relevant project (basically it was a cod= e binding of ocaml to a video codec=C2=A0library) in order to figure out the solution.=C2=A0

--
Charalampos Rotsos
PhD = student
The University of Cambridge
Computer Laboratory
William Ga= tes Building
JJ Thomson Avenue
Cambridge
CB3 0FD

Phone: +44-(0) 1223 767032=
Email: cr409@cl.cam.ac.uk
--047d7b33cf9e55ed4104c527f3ab-- From avsm@dark.recoil.org Thu Jul 19 09:33:10 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SrmAY-0001F4-0M (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 19 Jul 2012 09:33:10 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:39030 helo=dark.recoil.org) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with smtp id 1SrmAW-0005Eo-rh (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 19 Jul 2012 09:33:09 +0100 Received: (qmail 23307 invoked by uid 10000); 19 Jul 2012 08:33:08 -0000 Date: Thu, 19 Jul 2012 09:33:08 +0100 From: Anil Madhavapeddy To: Richard Mortier Subject: Re: opam and myocamlbuild.ml files Message-ID: <20120719083308.GD24288@dark.recoil.org> References: <42145234-747E-4254-A83F-A3BA29CDCEDA@nottingham.ac.uk> <658FD234-2748-472C-800E-BB35D7E75433@recoil.org> <46C88A77-65F0-4DE3-A9C0-25270C9423B9@nottingham.ac.uk> <524F04D4-BF81-4EC3-9EDF-DD7FCF2F85E6@recoil.org> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jul 2012 08:33:10 -0000 X-Keywords: X-UID: 415 Status: O Content-Length: 1395 Lines: 36 On Tue, Jul 17, 2012 at 07:13:09PM +0100, Richard Mortier wrote: > > On 17 Jul 2012, at 18:27, Anil Madhavapeddy wrote: > > > On 17 Jul 2012, at 17:52, Richard Mortier > > wrote: > > > >> > >> On 17 Jul 2012, at 10:35, Anil Madhavapeddy wrote: > >> > >>> Good question. We could move to only generating the setup.ml for > >>> stable releases, and not for the working copy. The diff spam is > >>> really irritating when bug bisecting... > >> > >> agree; at risk of repeating in other mail- could we even just move to > >> oasis being a dependency and let opam handle it? > > > > Could do; but that would require different OPAM files for dev and > > releases. Just needs someone to make sure that works... > > hm- don't follow. why does that require different opam files? > > (perhaps a more general question here is- what's the difference in > concept between dev and release versions of an opam package?) A release package would ideally not require a dependency on OASIS, as its designed like autoconf: the autogenerated files only need an OCaml installation. So I was thinking that the dev packages would call "oasis setup" before invoking make (to generate the ocamlbuild plugin), and released packages would have that done already, to reduce the source dependencies for people not using OPAM (which, believe it or not, is most people). -anil From avsm@dark.recoil.org Thu Jul 19 14:18:16 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SrqcS-0000uL-Ld (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 19 Jul 2012 14:18:16 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:1830 helo=dark.recoil.org) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with smtp id 1Srqc8-0007za-mr (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 19 Jul 2012 14:18:16 +0100 Received: (qmail 3811 invoked by uid 10000); 19 Jul 2012 13:17:55 -0000 Date: Thu, 19 Jul 2012 14:17:55 +0100 From: Anil Madhavapeddy To: Haris Rotsos Subject: Re: Gc.compact weirdness help Message-ID: <20120719131755.GD25915@dark.recoil.org> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jul 2012 13:18:16 -0000 X-Keywords: X-UID: 416 Status: O Content-Length: 3529 Lines: 94 Yes, you need to be *very* careful about not getting the CAMLlocal/return orders wrong, or your stack will become corrupted due to not registering the appropriate local roots for the GC. This sort of issue also does not necessarily register a segfault as it will silently alter a few bytes of your stack, depending on the liveness of the value. The way to debug this is by switching your libasmrun.a (which is the OCaml native code runtime and present in the OCaml standard library directory) with libasmrund.a. This is the asmrun compiled with -DDEBUG, and includes aggressive heap-integrity checks that are triggered on every entry to the major GC. This checking, combined with frequent calls to Gc.compact in your code, are sufficient to find these bugs much more easily. You can compile a libasmrund.a from the OCaml distribution (cd asmrun && make libasmrund.a). You have to manually swap the library with OCaml-3.12, but the upcoming OCaml-4.00 has a compiler flag to switch to the debug library without needing to go through this process. -anil On Wed, Jul 18, 2012 at 10:21:23PM -0700, Haris Rotsos wrote: > So I found my problem on the aforthmentioned problem, and I am writing > here the solution just for the records. > > reading a bit the documentation about c interfacing of ocaml, I discovered > that then CAMLlocal1 function registers a value variable with the gc, but > is not sufficient if the function is not returing with the CAMLReturn > method. I think the problem is that the Gc during a compact face will try > to change memory mapping and update also the value of the local variable. > If this variable is in the stuck, then the gc will not be able to update > its value. The strange thing is the code never returned a segfault. > > In order to sort this problem I did the following modification in the c > code: > > On 17 July 2012 10:21, Haris Rotsos wrote: > > > bool > > PktDemux(Ptr dev, Ptr pkt, uint16_t proto, > > const Address &src, const Address &dst, NetDevice::PacketType type) { > > - CAMLlocal1( ml_data ); > > > + value ml_data; > + caml_register_global_root(&ml_data); > > printf("packet demux...\n"); > > fprintf(stdout, "%f: receiving %u packet done...\n", > > (long)Simulator::Now().GetMicroSeconds() / 1e6, pkt->GetSize()); > > fflush(stdout); > > > > int pkt_len = pkt->GetSize(); > > ml_data = caml_alloc_string(pkt_len); > > pkt->CopyData((uint8_t *)String_val(ml_data), pkt_len); > > > > // find host name > > string node_name = getHostName(dev); > > > > //printf("node %s.%d packet\n", node_name.c_str(), dev->GetIfIndex()); > > // call packet handling code in caml > > caml_callback3(*caml_named_value("demux_pkt"), > > caml_copy_string((const char *)node_name.c_str()), > > Val_int(dev->GetIfIndex()), ml_data ); > > printf("packet demux end...\n"); > > > > + caml_remove_global_root(&ml_data); > > > > return true; > > } > > > > pretty simple but pretty tricky also to know about it. I had to revert > reading some source code from relevant project (basically it was a code > binding of ocaml to a video codec library) in order to figure out the > solution. > > -- > Charalampos Rotsos > PhD student > The University of Cambridge > Computer Laboratory > William Gates Building > JJ Thomson Avenue > Cambridge > CB3 0FD > > Phone: +44-(0) 1223 767032 > Email: cr409@cl.cam.ac.uk -- Anil Madhavapeddy http://anil.recoil.org From anil@recoil.org Thu Jul 19 17:41:07 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Srtml-0005Oi-Mo (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 19 Jul 2012 17:41:07 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:47257 helo=dark.recoil.org) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with smtp id 1SrtmT-0004pY-mb (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 19 Jul 2012 17:41:07 +0100 Received: (qmail 28980 invoked by uid 634); 19 Jul 2012 16:40:48 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from volstagg-0.srg.cl.cam.ac.uk (HELO [10.0.0.81]) (128.232.32.232) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Thu, 19 Jul 2012 17:40:46 +0100 From: Anil Madhavapeddy Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: Fwd: [Caml-list] Release Candidate 4.00.0+rc1 Date: Thu, 19 Jul 2012 17:40:45 +0100 References: <5E28FA4D-240E-4401-B3EF-1461EB281D2B@inria.fr> To: Mirage List Message-Id: <1B76A0E9-84E1-48AC-B0F8-5D55157109B5@recoil.org> Mime-Version: 1.0 (Apple Message framework v1278) X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jul 2012 16:41:07 -0000 X-Keywords: X-UID: 417 Status: O Content-Length: 19943 Lines: 443 Just an FYI, but OCaml 4 has an epic number of features and = improvements. I've been selectively backporting stuff to Mirage/Xen, but switching = should be quite straightforward when the final version is released. -anil Begin forwarded message: > From: Damien Doligez > Subject: [Caml-list] Release Candidate 4.00.0+rc1 > Date: 19 July 2012 17:18:46 GMT+01:00 > To: caml users >=20 > Dear OCaml users, >=20 > The release of OCaml version 4.00.0 is imminent. We have > created a release candidate for your testing pleasure. Please > download the sources, compile, install, and test your favourite > software with it. Then let me know whether it works for you. >=20 > We want to know about any show-stopping bugs, especially in the > compilation and installation phases. >=20 > This release candidate is available as source code at this > address: < http://caml.inria.fr/pub/distrib/ocaml-4.00/ > >=20 > Happy hacking, >=20 > -- Damien Doligez for the OCaml team. >=20 >=20 >=20 >=20 > OCaml 4.00.0: > ------------- >=20 > (Changes that can break existing programs are marked with a "*") >=20 > - The official name of the language is now OCaml. >=20 > Language features: > - Added Generalized Abstract Data Types (GADTs) to the language. > See chapter "Language extensions" of the reference manual for = documentation. > - It is now possible to omit type annotations when packing and = unpacking > first-class modules. The type-checker attempts to infer it from the = context. > Using the -principal option guarantees forward compatibility. > - New (module M) and (module M : S) syntax in patterns, for immediate > unpacking of a first-class module. >=20 > Compilers: > - Revised simplification of let-alias (PR#5205, PR#5288) > - Better reporting of compiler version mismatch in .cmi files > * Warning 28 is now enabled by default. > - New option -absname to use absolute paths in error messages > - Optimize away compile-time beta-redexes, e.g. (fun x y -> e) a b. > - Added option -bin-annot to dump the AST with type annotations. > - Added lots of new warnings about unused variables, opens, fields, > constructors, etc. > * New meaning for warning 7: it is now triggered when a method is = overridden > with the "method" keyword. Use "method!" to avoid the warning. >=20 > Native-code compiler: > - Optimized handling of partially-applied functions (PR#5287) > - Small improvements in code generated for array bounds checks = (PR#5345, > PR#5360). > * New ARM backend (PR#5433): > . Supports both Linux/EABI (armel) and Linux/EABI+VFPv3 (armhf). > . Added support for the Thumb-2 instruction set with average code = size > savings of 28%. > . Added support for position-independent code, natdynlink, = profiling and > exception backtraces. > - Generation of CFI information, and filename/line number debugging = (with -g) > annotations, enabling in particular precise stack backtraces with > the gdb debugger. Currently supported for x86 32-bits and 64-bits = only. > (PR#5487) > - New tool: ocamloptp, the equivalent of ocamlcp for the native-code = compiler. >=20 > OCamldoc: > - PR#5645: ocamldoc doesn't handle module/type substitution in = signatures > - PR#5544: improve HTML output (less formatting in html code) > - PR#5522: allow refering to record fields and variant constructors > - fix PR#5419 (error message in french) > - fix PR#5535 (no cross ref to class after dump+load) > * Use first class modules for custom generators, to be able to > load various plugins incrementally adding features to the current > generator > * PR#5507: Use Location.t structures for locations. > - fix: do not keep code when not told to keep code. >=20 > Standard library: > - Added float functions "hypot" and "copysign" (PR#3806, PR#4752, = PR#5246) > * Arg: options with empty doc strings are no longer included in the = usage string > (PR#5437) > - Array: faster implementations of "blit", "copy", "sub", "append" and = "concat" > (PR#2395, PR#2787, PR#4591) > * Hashtbl: > . Statistically-better generic hash function based on Murmur 3 = (PR#5225) > . Fixed behavior of generic hash function w.r.t. -0.0 and NaN = (PR#5222) > . Added optional "random" parameter to Hashtbl.create to randomize > collision patterns and improve security (PR#5572, CVE-2012-0839) > . Added "randomize" function and "R" parameter to OCAMLRUNPARAM > to turn randomization on by default (PR#5572, CVE-2012-0839) > . Added new functorial interface "MakeSeeded" to support = randomization > with user-provided seeded hash functions. > . Install new header for C code. > - Filename: on-demand (lazy) initialization of the PRNG used by = "temp_file". > - Marshal: marshalling of function values (flag Marshal.Closures) now > also works for functions that come from dynamically-loaded modules = (PR#5215) > - Random: > . More random initialization (Random.self_init()), using = /dev/urandom > when available (e.g. Linux, FreeBSD, MacOS X, Solaris) > * Faster implementation of Random.float (changes the generated = sequences) > - Scanf: new function "unescaped" (PR#3888) > - Set and Map: more efficient implementation of "filter" and = "partition" > - String: new function "map" (PR#3888) >=20 > Installation procedure: > - Compiler internals are now installed in `ocamlc = -where`/compiler-libs. > The files available there include the .cmi interfaces for all = compiler > modules, plus the following libraries: > ocamlcommon.cma/.cmxa modules common to ocamlc, ocamlopt, = ocaml > ocamlbytecomp.cma/.cmxa modules for ocamlc and ocaml > ocamloptcomp.cma/.cmxa modules specific to ocamlopt > ocamltoplevel.cma modules specific to ocaml > (PR#1804, PR#4653, frequently-asked feature). > * Some .cmi for toplevel internals that used to be installed in > `ocamlc -where` are now to be found in `ocamlc = -where`/compiler-libs. > Add "-I +compiler-libs" where needed. > * toplevellib.cma is no longer installed because subsumed by > ocamlcommon.cma ocamlbytecomp.cma ocamltoplevel.cma > - Added a configuration option (-with-debug-runtime) to compile and = install > a debug version of the runtime system, and a compiler option > (-runtime-variant) to select the debug runtime. >=20 > Bug Fixes: > - PR#1643: functions of the Lazy module whose named started with = 'lazy_' have > been deprecated, and new ones without the prefix added > - PR#3571: in Bigarrays, call msync() before unmapping to commit = changes > - PR#4292: various documentation problems > - PR#4511, PR#4838: local modules remove polymorphism > * PR#4549: Filename.dirname is not handling multiple / on Unix > - PR#4688: (Windows) special floating-point values aren't converted to = strings > correctly > - PR#4697: Unix.putenv leaks memory on failure > - PR#4705: camlp4 does not allow to define types with `True or `False > - PR#4746: wrong detection of stack overflows in native code under = Linux > - PR#4869: rare collisions between assembly labels for code and data > - PR#4880: "assert" constructs now show up in the exception stack = backtrace > - PR#4892: Array.set could raise "out of bounds" before evaluating 3rd = arg > - PR#4937: camlp4 incorrectly handles optional arguments if 'option' = is > redefined > - PR#5024: camlp4r now handles underscores in irrefutable pattern = matching of > records > - PR#5064, PR#5485: try to ensure that 4K words of stack are available > before calling into C functions, raising a Stack_overflow exception > otherwise. This reduces (but does not eliminate) the risk of > segmentation faults due to stack overflow in C code > - PR#5073: wrong location for 'Unbound record field label' error > - PR#5084: sub-sub-module building fails for native code compilation > - PR#5120: fix the output function of Camlp4.Debug.formatter > - PR#5131: compilation of custom runtime with g++ generates lots of = warnings > - PR#5137: caml-types-explore does not work > - PR#5159: better documentation of type Lexing.position > - PR#5171: Map.join does more comparisons than needed > - PR#5176: emacs mode: stack overflow in regexp matcher > - PR#5179: port OCaml to mingw-w64 > - PR#5211: updated Genlex documentation to state that camlp4 is = mandatory for > 'parser' keyword and associated notation > - PR#5214: ocamlfind plugin invokes 'cut' utility > - PR#5218: use $(MAKE) instead of "make" in Makefiles > - PR#5224: confusing error message in non-regular type definition > - PR#5231: camlp4: fix parsing of <:str_item< type t =3D $x$ >> > - PR#5233: finaliser on weak array gives dangling pointers (crash) > - PR#5238, PR#5277: Sys_error when getting error location > - PR#5261, PR#5497: Ocaml source-code examples are not = "copy-paste-able" > * PR#5279: executable name is not initialized properly in = caml_startup_code > - PR#5290: added hash functions for channels, nats, mutexes, = conditions > - PR#5295: OS threads: problem with caml_c_thread_unregister() > - PR#5301: camlp4r and exception equal to another one with parameters > - PR#5305: prevent ocamlbuild from complaining about links to _build/ > - PR#5306: comparing to Thread.self() raises exception at runtime > - PR#5309: Queue.add is not thread/signal safe > - PR#5310: Ratio.create_ratio/create_normalized_ratio have misleading = names > - PR#5311: better message for warning 23 > * PR#5312: command-line arguments @reponsefile auto-expansion feature > removed from the Windows OCaml runtime, to avoid conflicts with "-w = @..." > - PR#5313: ocamlopt -g misses optimizations > - PR#5316: objinfo now shows ccopts/ccobjs/force_link when applicable > - PR#5318: segfault on stack overflow when reading marshaled data > - PR#5319: %r11 clobbered by Lswitch in Windows AMD64 native-code = compilation > - PR#5322: type abbreviations expanding to a universal type variable > - PR#5325: (Windows) blocked Unix.recv in one thread blocks Unix.send = in > another thread > - PR#5328: under Windows, Unix.select leaves sockets in non-blocking = mode > - PR#5330: thread tag with '.top' and '.inferred.mli' targets > - PR#5331: ocamlmktop is not always a shell script > - PR#5335: Unix.environment segfaults after a call to clearenv > - PR#5338: sanitize.sh has windows style end-of-lines (mingw) > - PR#5343: ocaml -rectypes is unsound wrt module subtyping > - PR#5344: some predefined exceptions need special printing > - PR#5349: Hashtbl.replace uses new key instead of reusing old key > - PR#5356: ocamlbuild handling of 'predicates' for ocamlfind > - PR#5364: wrong compilation of "((val m : SIG1) : SIG2)" > - PR#5370: ocamldep omits filename in syntax error message > - PR#5374: camlp4 creates wrong location for type definitions > - PR#5380: strange sscanf input segfault > - PR#5382: EOPNOTSUPP and ENOTSUPP different on exotic platforms > - PR#5383: build failure in Win32/MSVC > - PR#5387: camlp4: str_item and other syntactic elements with Nils are > not very usable > - PR#5389: compaction sometimes leaves a very large heap > - PR#5393: fails to build from source on GNU/kFreeBSD because of -R = link option > - PR#5394: documentation for -dtypes is missing in manpage > - PR#5397: Filename.temp_dir_name should be mutable > - PR#5410: fix printing of class application with Camlp4 > - PR#5416: (Windows) Unix.(set|clear)_close_on_exec now preserves = blocking mode > - PR#5435: ocamlbuild does not find .opt executables on Windows > - PR#5436: update object ids on unmarshaling > - PR#5442: camlp4: quotation issue with strings > - PR#5453: configure doesn't find X11 under Ubuntu/MultiarchSpec > - PR#5461: Double linking of bytecode modules > - PR#5463: Bigarray.*.map_file fail if empty array is requested > - PR#5465: increase stack size of ocamlopt.opt for windows > - PR#5469: private record type generated by functor loses abbreviation > - PR#5475: Wrapper script for interpreted LablTk wrongly handles = command line > parameters > - PR#5476: bug in native code compilation of let rec on float arrays > - PR#5477: use pkg-config to configure graphics on linux > - PR#5481: update camlp4 magic numbers > - PR#5482: remove bashism in test suite scripts > - PR#5495: camlp4o dies on infix definition (or) > - PR#5498: Unification with an empty object only checks the absence of > the first method > - PR#5503: error when ocamlbuild is passed an absolute path as build = directory > - PR#5509: misclassification of statically-allocated empty array that > falls exactly at beginning of an otherwise unused data page. > - PR#5510: ocamldep has duplicate -ml{,i}-synonym options > - PR#5511: in Bigarray.reshape, unwarranted limitation on new array = dimensions. > - PR#5513: Int64.div causes floating point exception (ocamlopt, x86) > - PR#5516: in Bigarray C stubs, use C99 flexible array types if = possible > - PR#5518: segfault with lazy empty array > - PR#5531: Allow ocamlbuild to add ocamldoc flags through -docflag > and -docflags switches > - PR#5543: in Bigarray.map_file, try to avoid using lseek() when = growing file > - PR#5538: combining -i and -annot in ocamlc > - PR#5648: (probably fixed) test failures in tests/lib-threads > - PR#5551: repeated calls to find_in_path degrade performance > - PR#5552: Mac OS X: unrecognized gcc option "-no-cpp-precomp" > - PR#5555: add Hashtbl.reset to resize the bucket table to its initial = size > - PR#5560: incompatible type for tuple pattern with -principal > - PR#5575: Random states are not marshallable across architectures > - PR#5579: camlp4: when a plugin is loaded in the toplevel, > Token.Filter.define_filter has no effect before the first syntax = error > - PR#5585: typo: "explicitely" > - PR#5587: documentation: "allows to" is not correct English > - PR#5593: remove C file when -output-obj fails > - PR#5597: register names for instrtrace primitives in embedded = bytecode > - PR#5598: add backslash-space support in strings in ocamllex > - PR#5603: wrong .file debug info generated by ocamlopt -g > - PR#5604: fix permissions of files created by ocamlbuild itself > - PR#5610: new unmarshaler (from PR#5318) fails to freshen object = identifiers > - PR#5614: add missing -linkall flag when compiling ocamldoc.opt > - PR#5616: move ocamlbuild documentation to the reference manual > - PR#5619: Uncaught CType.Unify exception in the compiler > - PR#5620: invalid printing of type manifest (camlp4 revised syntax) > - PR#5637: invalid printing of anonymous type parameters (camlp4 = revised syntax) > - PR#5643: issues with .cfi and .loc directives generated by ocamlopt = -g > - PR#5644: Stream.count broken when used with Sapp or Slazy nodes > - PR#5647: Cannot use install_printer in debugger > - PR#5651: printer for abstract data type (camlp4 revised syntax) > - PR#5654: self pattern variable location tweak > - PR#5655: ocamlbuild doesn't pass cflags when building C stubs > - PR#5657: wrong error location for abbreviated record fields > - PR#5659: ocamlmklib -L option breaks with MSVC > - PR#5661: fixes for the test suite > - PR#5668: Camlp4 produces invalid syntax for "let _ =3D ..." > - PR#5671: initialization of compare_ext field in = caml_final_custom_operations() > - PR#5677: do not use "value" as identifier (genprintval.ml) > - PR#5687: dynlink broken when used from "output-obj" main program = (bytecode) > - problem with printing of string literals in camlp4 (reported on = caml-list) > - emacs mode: colorization of comments and strings now works correctly > - problem with forall and method (reported on caml-list on 2011-07-26) > - crash when using OCAMLRUNPARAM=3Da=3DX with invalid X (reported in = private) >=20 > Feature wishes: > - PR#352: new option "-stdin" to make ocaml read stdin as a script > - PR#1164: better error message when mixing -a and .cmxa > - PR#1284: documentation: remove restriction on mixed streams > - PR#1496: allow configuring LIBDIR, BINDIR, and MANDIR relative to = $(PREFIX) > - PR#1835: add Digest.from_hex > - PR#1898: toplevel: add option to suppress continuation prompts > - PR#4278: configure: option to disable "graph" library > - PR#4444: new String.trim function, removing leading and trailing = whistespace > - PR#4549: make Filename.dirname/basename POSIX compliant > - PR#4830: add option -v to expunge.ml > - PR#4898: new Sys.big_endian boolean for machine endianness > - PR#4963, PR#5467: no extern "C" into ocaml C-stub headers > - PR#5199: tests are run only for bytecode if either native support is = missing, > or a non-empty value is set to "BYTECODE_ONLY" Makefile variable > - PR#5215: marshalling of dynlinked closure > - PR#5236: new '%revapply' primitive with the semantics 'revapply x f = =3D f x', > and '%apply' with semantics 'apply f x =3D f x'. > - PR#5255: natdynlink detection on powerpc, hurd, sparc > - PR#5295: OS threads: problem with caml_c_thread_unregister() > - PR#5297: compiler now checks existence of builtin primitives > - PR#5329: (Windows) more efficient Unix.select if all fd's are = sockets > - PR#5357: warning for useless open statements > - PR#5358: first class modules don't allow "with type" declarations = for types > in sub-modules > - PR#5385: configure: emit a warning when MACOSX_DEPLOYMENT_TARGET is = set > - PR#5396: ocamldep: add options -sort, -all, and -one-line > - PR#5397: Filename.temp_dir_name should be mutable > - PR#5403: give better error message when emacs is not found in PATH > - PR#5411: new directive for the toplevel: #load_rec > - PR#5420: Unix.openfile share mode (Windows) > - PR#5421: Unix: do not leak fds in various open_proc* functions > - PR#5434: implement Unix.times in win32unix (partially) > - PR#5438: new warnings for unused declarations > - PR#5439: upgrade config.guess and config.sub > - PR#5445 and others: better printing of types with user-provided = names > - PR#5454: Digest.compare is missing and md5 doc update > - PR#5455: .emacs instructions, add lines to recognize ocaml scripts > - PR#5456: pa_macro: replace __LOCATION__ after macro expansion; add = LOCATION_OF > - PR#5461: bytecode: emit warning when linking two modules with the = same name > - PR#5478: ocamlopt assumes ar command exists > - PR#5479: Num.num_of_string may raise an exception, not reflected in = the > documentation. > - PR#5501: increase IO_BUFFER_SIZE to 64KiB > - PR#5532: improve error message when bytecode file is wrong > - PR#5555: add function Hashtbl.reset to resize the bucket table to > its initial size. > - PR#5586: increase UNIX_BUFFER_SIZE to 64KiB > - PR#5597: register names for instrtrace primitives in embedded = bytecode > - PR#5599: Add warn() tag in ocamlbuild to control -w compiler switch > - PR#5628: add #remove_directory and Topdirs.remove_directory to = remove > a directory from the load path > - PR#5636: in system threads library, issue with linking of = pthread_atfork > - PR#5666: C includes don't provide a revision number > - ocamldebug: ability to inspect values that contain code pointers > - ocamldebug: new 'environment' directive to set environment variables > for debuggee > - configure: add -no-camlp4 option >=20 > Shedding weight: > * Removed the obsolete native-code generators for Alpha, HPPA, IA64 = and MIPS. > * The "DBM" library (interface with Unix DBM key-value stores) is no > longer part of this distribution. It now lives its own life at > https://forge.ocamlcore.org/projects/camldbm/ > * The "OCamlWin" toplevel user interface for MS Windows is no longer > part of this distribution. It now lives its own life at > https://forge.ocamlcore.org/projects/ocamltopwin/ >=20 > Other changes: > - Copy VERSION file to library directory when installing. >=20 >=20 > --=20 > Caml-list mailing list. Subscription management and archives: > https://sympa-roc.inria.fr/wws/info/caml-list > Beginner's list: http://groups.yahoo.com/group/ocaml_beginners > Bug reports: http://caml.inria.fr/bin/caml-bugs >=20 From balraj885@gmail.com Thu Jul 19 18:22:29 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SruQn-0005vt-OH (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 19 Jul 2012 18:22:29 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.5 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [74.125.82.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (balraj885[at]gmail.com) * 0.2 FREEMAIL_ENVFROM_END_DIGIT Envelope-from freemail username ends in * digit (balraj885[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-we0-f179.google.com ([74.125.82.179]:60947) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SruQl-000843-Qi (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Thu, 19 Jul 2012 18:22:29 +0100 Received: by weyx10 with SMTP id x10so1845497wey.38 for ; Thu, 19 Jul 2012 10:22:27 -0700 (PDT) MIME-Version: 1.0 Received: by 10.180.78.4 with SMTP id x4mr7171418wiw.19.1342718546924; Thu, 19 Jul 2012 10:22:26 -0700 (PDT) Sender: balraj885@gmail.com Received: by 10.194.13.134 with HTTP; Thu, 19 Jul 2012 10:22:26 -0700 (PDT) Date: Thu, 19 Jul 2012 18:22:26 +0100 X-Google-Sender-Auth: dOX07z8MVvLMfPXOO6cLgp02shc Message-ID: Subject: Xen/OS layer debugging help From: Balraj Singh To: Mirage List Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Thu, 19 Jul 2012 17:22:29 -0000 X-Keywords: X-UID: 418 Status: O Content-Length: 691 Lines: 16 A request for some debugging help: the remaining TCP problem that I see can be attributed to significant pkt loss somewhere in the Xen/OS layer. I see packets if I sniff the virtual interface, but a lot of the packets never make it to Ethif.input. I've tried to trace the code from netif down to the grant tables myself, but I think I need help. If you can take a look, can you see a reason why pkts would get lost at busy times, between the vif and Ethif.input. This may just be my current test, but the particular packets that get lost are the pure ACKs (no payload) coming back to my Mirage data source from a linux data sink running on the same host in another VM. Thanks, Balraj From sdiris@gmail.com Fri Jul 20 12:40:11 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SsBZ5-0006sl-RN (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 20 Jul 2012 12:40:11 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score 0.2 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [74.125.82.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (sdiris[at]gmail.com) * 0.0 DKIM_ADSP_CUSTOM_MED No valid author signature, adsp_override is * CUSTOM_MED * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * 0.0 FSL_FREEMAIL_2 FSL_FREEMAIL_2 * 0.0 FSL_FREEMAIL_1 FSL_FREEMAIL_1 * 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid * 0.9 NML_ADSP_CUSTOM_MED ADSP custom_med hit, and not from a mailing * list X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-we0-f179.google.com ([74.125.82.179]:41677) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1SsBZ4-0008Pq-XD (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 20 Jul 2012 12:40:11 +0100 Received: by weyx10 with SMTP id x10so2383273wey.38 for ; Fri, 20 Jul 2012 04:40:10 -0700 (PDT) Received: by 10.216.81.7 with SMTP id l7mr1498874wee.23.1342784410066; Fri, 20 Jul 2012 04:40:10 -0700 (PDT) Received: from YimingZhang-PC (c215.al.cl.cam.ac.uk. [128.232.110.215]) by mx.google.com with ESMTPS id i46sm13701380eem.0.2012.07.20.04.40.08 (version=SSLv3 cipher=OTHER); Fri, 20 Jul 2012 04:40:09 -0700 (PDT) Date: Fri, 20 Jul 2012 12:40:11 +0100 From: "Yiming Zhang" To: "cl-mirage" Subject: Problem in OPAM installation Message-ID: <201207201240111493638@gmail.com> X-mailer: Foxmail 6, 15, 201, 26 [cn] Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list Reply-To: sdiris@gmail.com List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jul 2012 11:40:11 -0000 X-Keywords: X-UID: 419 Status: O Content-Length: 1577 Lines: 21 I encountered a problem during installing OPAM in Ubuntu 1004 (as listed below). Can somebody help me figure out the problem? Thanks! Yiming ------------------------- [723.1] BEGIN 'ocamlc.opt' '-c' '-o' '/root/opam/_obuild/723/debcudf.cmo' '-for-pack' 'Debian' '-I' './_obuild/dose/Debian' '-I' './_obuild/dose' '-I' './src_ext' '-I' './_obuild/extlib' '-I' './_obuild/cudf' '-I' './_obuild/graph' '-I' './_obuild/re_perl' '-I' '.' '-pp' 'camlp4o Camlp4MacroParser.cmo' 'src_ext/dose/deb/debcudf.ml' [723.1] END ocamlc.opt -c -o /root/opam/_obuild/723/debcudf.cmo -for-pack Debian -I ./_obuild/dose/Debian -I ./_obuild/dose -I ./src_ext -I ./_obuild/extlib -I ./_obuild/cudf -I ./_obuild/graph -I ./_obuild/re_perl -I . -pp camlp4o Camlp4MacroParser.cmo src_ext/dose/deb/debcudf.ml Command stderr: File "src_ext/dose/deb/debcudf.ml", line 194, characters 13-26: Error: Unbound value SMap.bindings [723.1] ERROR in project dose Error, exception Unix_error(No such file or directory, stat, _obuild/dose/Debian/debcudf.cmo) in rule_executed Warning: 380 rules waiting in queue ! 2 errors. 429 commands executed, 561 files generated. Error: Target _obuild/dose/Debian/debcudf.cmo not built Error: [723.1] ocamlc.opt -c -o /root/opam/_obuild/723/debcudf.cmo -for-pack Debian -I ./_obuild/dose/Debian -I ./_obuild/dose -I ./src_ext -I ./_obuild/extlib -I ./_obuild/cudf -I ./_obuild/graph -I ./_obuild/re_perl -I . -pp camlp4o Camlp4MacroParser.cmo src_ext/dose/deb/debcudf.ml File "src_ext/dose/deb/debcudf.ml", line 194, characters 13-26: Error: Unbound value SMap.bindings From thomas.gazagnaire@gmail.com Fri Jul 20 14:28:40 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SsDG4-0000ys-Bk (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 20 Jul 2012 14:28:40 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.160.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (thomas.gazagnaire[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-gh0-f179.google.com ([209.85.160.179]:59503) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1SsDG3-0007oi-qe (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 20 Jul 2012 14:28:40 +0100 Received: by ghbg24 with SMTP id g24so3789875ghb.38 for ; Fri, 20 Jul 2012 06:28:38 -0700 (PDT) Received: by 10.236.179.42 with SMTP id g30mr5509512yhm.77.1342790918380; Fri, 20 Jul 2012 06:28:38 -0700 (PDT) Received: from [192.168.1.130] ([62.200.22.135]) by mx.google.com with ESMTPS id i34sm4935011anm.12.2012.07.20.06.28.36 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 20 Jul 2012 06:28:37 -0700 (PDT) Subject: Re: Problem in OPAM installation Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: Thomas Gazagnaire In-Reply-To: <201207201240111493638@gmail.com> Date: Fri, 20 Jul 2012 15:28:33 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <201207201240111493638@gmail.com> To: sdiris@gmail.com X-Mailer: Apple Mail (2.1084) Cc: cl-mirage X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jul 2012 13:28:40 -0000 X-Keywords: X-UID: 420 Status: O Content-Length: 1805 Lines: 46 Seems that you don't have the right OCaml version. You need 3.12.1 to = build OPAM. -- Thomas On Jul 20, 2012, at 1:40 PM, Yiming Zhang wrote: > I encountered a problem during installing OPAM in Ubuntu 1004 (as = listed below). Can somebody help me figure out the problem? Thanks! >=20 > Yiming=20 > ------------------------- > [723.1] BEGIN 'ocamlc.opt' '-c' '-o' = '/root/opam/_obuild/723/debcudf.cmo' '-for-pack' 'Debian' '-I' = './_obuild/dose/Debian' '-I' './_obuild/dose' '-I' './src_ext' '-I' = './_obuild/extlib' '-I' './_obuild/cudf' '-I' './_obuild/graph' '-I' = './_obuild/re_perl' '-I' '.' '-pp' 'camlp4o Camlp4MacroParser.cmo' = 'src_ext/dose/deb/debcudf.ml' > [723.1] END ocamlc.opt -c -o /root/opam/_obuild/723/debcudf.cmo = -for-pack Debian -I ./_obuild/dose/Debian -I ./_obuild/dose -I ./src_ext = -I ./_obuild/extlib -I ./_obuild/cudf -I ./_obuild/graph -I = ./_obuild/re_perl -I . -pp camlp4o Camlp4MacroParser.cmo = src_ext/dose/deb/debcudf.ml > Command stderr: > File "src_ext/dose/deb/debcudf.ml", line 194, characters 13-26: > Error: Unbound value SMap.bindings > [723.1] ERROR in project dose > Error, exception Unix_error(No such file or directory, stat, = _obuild/dose/Debian/debcudf.cmo) in rule_executed > Warning: 380 rules waiting in queue ! > 2 errors. 429 commands executed, 561 files generated. > Error: > Target _obuild/dose/Debian/debcudf.cmo not built > Error: > [723.1] ocamlc.opt -c -o /root/opam/_obuild/723/debcudf.cmo -for-pack = Debian -I ./_obuild/dose/Debian -I ./_obuild/dose -I ./src_ext -I = ./_obuild/extlib -I ./_obuild/cudf -I ./_obuild/graph -I = ./_obuild/re_perl -I . -pp camlp4o Camlp4MacroParser.cmo = src_ext/dose/deb/debcudf.ml > File "src_ext/dose/deb/debcudf.ml", line 194, characters 13-26: > Error: Unbound value SMap.bindings >=20 >=20 From sdiris@gmail.com Fri Jul 20 19:06:35 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SsHb1-0006p6-RI (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 20 Jul 2012 19:06:35 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.212.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (sdiris[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature * 0.0 FSL_FREEMAIL_2 FSL_FREEMAIL_2 * 0.0 FSL_FREEMAIL_1 FSL_FREEMAIL_1 X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wi0-f179.google.com ([209.85.212.179]:60262) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SsHb1-0001Mt-Qs (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 20 Jul 2012 19:06:35 +0100 Received: by wibhq4 with SMTP id hq4so626799wib.2 for ; Fri, 20 Jul 2012 11:06:35 -0700 (PDT) Received: by 10.180.84.164 with SMTP id a4mr16624745wiz.12.1342807595117; Fri, 20 Jul 2012 11:06:35 -0700 (PDT) Received: from YimingZhang-PC (c215.al.cl.cam.ac.uk. [128.232.110.215]) by mx.google.com with ESMTPS id de10sm16243200wib.7.2012.07.20.11.06.33 (version=SSLv3 cipher=OTHER); Fri, 20 Jul 2012 11:06:34 -0700 (PDT) Date: Fri, 20 Jul 2012 19:06:36 +0100 From: "Yiming Zhang" To: "cl-mirage" Subject: 'lwt.unix' not found Message-ID: <201207201906361502114@gmail.com> X-mailer: Foxmail 6, 15, 201, 26 [cn] Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list Reply-To: sdiris@gmail.com List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jul 2012 18:06:35 -0000 X-Keywords: X-UID: 421 Status: O Content-Length: 627 Lines: 16 I followed the wiki instructions to install mirage on Debian Squeeze. However, I got the following errors when I arrived at the step "opam --verbose install cow mirage-fs". Can anybody can help me solve this problem? Thanks! Yiming -------------------------------------------- ocamlfind: Package `lwt.unix' not found make[1]: *** [all] Error 2 make: *** [all] Error 2 ocamlfind: [WARNING] No such directory: /root/.opam/system/lib/mirage [2514] ERROR: Compilation failed with error 2 [2514] ERROR: Globals.Exit(66) [2506] ERROR: Command failed while installing mirage.0.3dev 'opam --verbose install cow mirage-fs' failed From tm444@hermes.cam.ac.uk Fri Jul 20 19:11:04 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SsHfM-0006sG-CZ (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 20 Jul 2012 19:11:04 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: not scanned X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ravage.cl.cam.ac.uk ([128.232.1.17]:65153) by ppsw-51.csi.cam.ac.uk (smtp.hermes.cam.ac.uk [131.111.8.158]:25) with esmtpsa (PLAIN:tm444) (TLSv1:AES128-SHA:128) id 1SsHfM-000516-XG (Exim 4.72) (return-path ); Fri, 20 Jul 2012 19:11:04 +0100 Subject: Re: 'lwt.unix' not found Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Toby Moncaster In-Reply-To: <201207201906361502114@gmail.com> Date: Fri, 20 Jul 2012 19:11:04 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <84A5A54A-700B-4A00-BC8C-F929F0E7EFBB@cl.cam.ac.uk> References: <201207201906361502114@gmail.com> To: sdiris@gmail.com X-Mailer: Apple Mail (2.1278) Sender: "T. Moncaster" Cc: cl-mirage X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jul 2012 18:11:04 -0000 X-Keywords: X-UID: 422 Status: O Content-Length: 865 Lines: 28 might this be an $OCAMLLIB issue? is that lib directory the correct one = for your build to point to (are the lib files actually there?) Toby On 20 Jul 2012, at 19:06, Yiming Zhang wrote: > I followed the wiki instructions to install mirage on Debian Squeeze. = However, I got the following errors when I arrived at the step "opam = --verbose install cow mirage-fs". Can anybody can help me solve this = problem? >=20 > Thanks! > Yiming >=20 > -------------------------------------------- > ocamlfind: Package `lwt.unix' not found > make[1]: *** [all] Error 2 > make: *** [all] Error 2 > ocamlfind: [WARNING] No such directory: /root/.opam/system/lib/mirage > [2514] ERROR: Compilation failed with error 2 > [2514] ERROR: Globals.Exit(66) > [2506] ERROR: Command failed while installing mirage.0.3dev > 'opam --verbose install cow mirage-fs' failed >=20 >=20 From thomas.gazagnaire@gmail.com Fri Jul 20 20:54:05 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SsJH3-0007eN-7F (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 20 Jul 2012 20:54:05 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.212.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (thomas.gazagnaire[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wi0-f179.google.com ([209.85.212.179]:45911) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SsJH2-0000ni-Rz (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 20 Jul 2012 20:54:05 +0100 Received: by wibhq4 with SMTP id hq4so691169wib.2 for ; Fri, 20 Jul 2012 12:54:04 -0700 (PDT) Received: by 10.216.132.91 with SMTP id n69mr3999222wei.178.1342814044316; Fri, 20 Jul 2012 12:54:04 -0700 (PDT) Received: from [192.168.1.130] (167.193.76.188.dynamic.jazztel.es. [188.76.193.167]) by mx.google.com with ESMTPS id fu8sm46596449wib.5.2012.07.20.12.54.02 (version=TLSv1/SSLv3 cipher=OTHER); Fri, 20 Jul 2012 12:54:03 -0700 (PDT) Subject: Re: 'lwt.unix' not found Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: Thomas Gazagnaire In-Reply-To: <201207201906361502114@gmail.com> Date: Fri, 20 Jul 2012 21:54:01 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: <6531059C-DD8A-4659-8194-930202E770D8@gmail.com> References: <201207201906361502114@gmail.com> To: sdiris@gmail.com X-Mailer: Apple Mail (2.1084) Cc: cl-mirage X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 20 Jul 2012 19:54:05 -0000 X-Keywords: X-UID: 423 Status: O Content-Length: 488 Lines: 15 > I followed the wiki instructions to install mirage on Debian Squeeze. = However, I got the following errors when I arrived at the step "opam = --verbose install cow mirage-fs". Can anybody can help me solve this = problem? There is a bug in 0.3 which was sometime uninstalling packages. We are = trying to fix it (a tentative fix is in the git HEAD repository). You = can work-around this issue by reinstalling base-unix manually: $ opam install base-unix cow mirage-fs -- Thomas= From thomas.gazagnaire@gmail.com Sat Jul 21 08:27:38 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SsU6E-0005Tq-Ey (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 21 Jul 2012 08:27:38 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.212.169 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (thomas.gazagnaire[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-wi0-f169.google.com ([209.85.212.169]:55310) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SsU6D-0001Af-S8 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 21 Jul 2012 08:27:38 +0100 Received: by wibhm2 with SMTP id hm2so1193918wib.2 for ; Sat, 21 Jul 2012 00:27:37 -0700 (PDT) Received: by 10.180.99.232 with SMTP id et8mr13051762wib.11.1342855657528; Sat, 21 Jul 2012 00:27:37 -0700 (PDT) Received: from [192.168.1.130] (167.193.76.188.dynamic.jazztel.es. [188.76.193.167]) by mx.google.com with ESMTPS id fb20sm3865291wid.1.2012.07.21.00.27.35 (version=TLSv1/SSLv3 cipher=OTHER); Sat, 21 Jul 2012 00:27:36 -0700 (PDT) Subject: Re: 'lwt.unix' not found Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: Thomas Gazagnaire In-Reply-To: <201207201906361502114@gmail.com> Date: Sat, 21 Jul 2012 09:27:33 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <201207201906361502114@gmail.com> To: sdiris@gmail.com X-Mailer: Apple Mail (2.1084) Cc: cl-mirage X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Jul 2012 07:27:38 -0000 X-Keywords: X-UID: 424 Status: O Content-Length: 713 Lines: 23 The regression is now fixed in 0.3.1. > I followed the wiki instructions to install mirage on Debian Squeeze. = However, I got the following errors when I arrived at the step "opam = --verbose install cow mirage-fs". Can anybody can help me solve this = problem? >=20 > Thanks! > Yiming >=20 > -------------------------------------------- > ocamlfind: Package `lwt.unix' not found > make[1]: *** [all] Error 2 > make: *** [all] Error 2 > ocamlfind: [WARNING] No such directory: /root/.opam/system/lib/mirage > [2514] ERROR: Compilation failed with error 2 > [2514] ERROR: Globals.Exit(66) > [2506] ERROR: Command failed while installing mirage.0.3dev > 'opam --verbose install cow mirage-fs' failed >=20 >=20 From anil@recoil.org Sat Jul 21 09:33:52 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SsV8K-0005xq-St (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 21 Jul 2012 09:33:52 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:30506 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1SsV8K-0001BS-Wa (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 21 Jul 2012 09:33:52 +0100 Received: (qmail 1761 invoked by uid 634); 21 Jul 2012 08:33:51 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.38]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Sat, 21 Jul 2012 09:33:51 +0100 Subject: Re: 'lwt.unix' not found Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Sat, 21 Jul 2012 09:33:49 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <4B29D754-3FB4-4DA3-A7F4-588A861C2584@recoil.org> References: <201207201906361502114@gmail.com> To: Thomas Gazagnaire X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: cl-mirage , sdiris@gmail.com X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Jul 2012 08:33:53 -0000 X-Keywords: X-UID: 425 Status: O Content-Length: 846 Lines: 31 I've updated the Homebrew tap to 0.3.1 also. -a On 21 Jul 2012, at 08:27, Thomas Gazagnaire wrote: > The regression is now fixed in 0.3.1. >=20 >> I followed the wiki instructions to install mirage on Debian Squeeze. = However, I got the following errors when I arrived at the step "opam = --verbose install cow mirage-fs". Can anybody can help me solve this = problem? >>=20 >> Thanks! >> Yiming >>=20 >> -------------------------------------------- >> ocamlfind: Package `lwt.unix' not found >> make[1]: *** [all] Error 2 >> make: *** [all] Error 2 >> ocamlfind: [WARNING] No such directory: /root/.opam/system/lib/mirage >> [2514] ERROR: Compilation failed with error 2 >> [2514] ERROR: Globals.Exit(66) >> [2506] ERROR: Command failed while installing mirage.0.3dev >> 'opam --verbose install cow mirage-fs' failed >>=20 >>=20 >=20 >=20 From anil@recoil.org Sat Jul 21 09:42:17 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SsVGT-00061b-Pb (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 21 Jul 2012 09:42:17 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:39120 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1SsVGT-0006Ox-WR (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 21 Jul 2012 09:42:17 +0100 Received: (qmail 16241 invoked by uid 634); 21 Jul 2012 08:42:16 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.38]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Sat, 21 Jul 2012 09:42:16 +0100 Subject: Re: Mirage, suspend resume and the ocaml GC Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: Date: Sat, 21 Jul 2012 09:42:14 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <58BAC6F4-DFC1-4AC9-B6EB-73D9EF07897E@recoil.org> References: To: Jonathan Ludlam X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: cl-mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 21 Jul 2012 08:42:17 -0000 X-Keywords: X-UID: 426 Status: O Content-Length: 6782 Lines: 190 Hi Jon, [+cc cl-mirage] This could be an event channel not being initialised and causing it to = spin in the event loop.=20 You can try to recompile the monolithic mirage with MIR-TRACE=3D1 (see = lib/myocamlbuild.ml) which will cause every function call to printf. = It'll be very verbose, but spins should be obvious as long as your = console doesn't overflow. Thomas: it occurs to me that we cannot actually do MIR-TRACE with the = OPAM-based build, as we can't add a global pp flag for pa_trace to all = libraries. Any thoughts on how to do this in the future? -anil On 20 Jul 2012, at 16:57, Jonathan Ludlam wrote: > Hi Anil, >=20 > I've been playing with getting suspend/resume working for mirage = guests, and it's in a state where it does suspend and resume, but = there's some odd behaviour on resume - specifically, the GC starts going = bananas. >=20 > I'm using a modified regress/lwt/echoserver.ml guest, which is putting = random strings of 'a's on the console: >=20 >=20 > = ----------------------------------------------------------------------- > kernel.c: Mirage OS! > kernel.c: start_info: 0x10e3000(VA) > kernel.c: nr_pages: 0x4000 > kernel.c: shared_inf: 0xdda73000(MA) > kernel.c: pt_base: 0x10e6000(VA) > kernel.c: nr_pt_frames: 0xd > kernel.c: mfn_list: 0x10c3000(VA) > kernel.c: mod_start: 0x0(VA) > kernel.c: mod_len: 0 > kernel.c: flags: 0x0 > kernel.c: cmd_line:=20 > x86_setup.c: stack: 0xc2780-0x8c2780 > mm.c: MM: Init > x86_mm.c: _text: 0x0(VA) > x86_mm.c: _etext: 0x27bff(VA) > x86_mm.c: _erodata: 0x33000(VA) > x86_mm.c: _edata: 0x36620(VA) > x86_mm.c: stack start: 0xc2780(VA) > x86_mm.c: _end: 0x10c3000(VA) > x86_mm.c: start_pfn: 10f6 > x86_mm.c: max_pfn: 4000 > x86_mm.c: Mapping memory range 0x1400000 - 0x4000000 > x86_mm.c: setting 0x0-0x33000 readonly > x86_mm.c: skipped 0x1000 > mm.c: MM: Initialise page allocator for 0x110c000 -> 0x4000000 > mm.c: MM: done > x86_mm.c: Demand map pfns at 4001000-2004001000. > Initial minor heap size: 1024k bytes > Initial major heap size: 992k bytes > Initial space overhead: 80% > Initial max overhead: 500% > Initial heap increment: 992k bytes > Initial allocation policy: 0 > Growing page table to 1024 entries > xs_watch () > Not initialising grant tablesDevices: [Xen.Blkif] provider start > watch callback: [ control/shutdown =3D XXX ] >=20 > About to dir: > Got this list: [platform-feature-multiprocessor-suspend] > aaaaaaaaa > aa > aaaaaa > aaa > aaaaaaaaaaaa > aaaaaaaaa > aaaaaaaaaaaaaaaa > aaaaaaaaaaaaaaaaa > aaaaaaaaaaaaaaaaaa > aaaaaaaaaa > watch callback: [ control/shutdown =3D XXX ] >=20 > About to dir: > Got this list: [platform-feature-multiprocessor-suspend,shutdown] > Got control message: suspend > = ----------------------------------------------------------------------- >=20 > All good so far, it has found the suspend key in xenstore and called = HYPERVISOR_suspend. On resuming however, you get this: >=20 > = ----------------------------------------------------------------------- >=20 > cancelled=3D0 > aaaaaaaaaaaaaaaaa > <>Starting new major GC cycle > ### O'Caml runtime: heap check ### > !<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$aaaaaaaaaaa > <>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### > = !<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>!<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<>$<= >$<>$<>$<>$<>$<>$<>$<>$<>Starting new major GC cycle > ### O'Caml runtime: heap check ### >=20 > = ----------------------------------------------------------------------- >=20 >=20 > I've done a little digging, but can't see quite where it's going = wrong. It looks a little like perhaps an allocation is failing and it's = kicking the GC to try and free up space, maybe? >=20 > The code is on github - I've made a temporary commit of the work so = far in jonludlam/mirage branch suspend-resume. >=20 > Any thoughts? >=20 > Jon >=20 From sdiris@gmail.com Sun Jul 22 14:25:03 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Ssw9f-0002cy-3O (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sun, 22 Jul 2012 14:25:03 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [74.125.82.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (sdiris[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature * 0.0 FSL_FREEMAIL_2 FSL_FREEMAIL_2 * 0.0 FSL_FREEMAIL_1 FSL_FREEMAIL_1 X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-we0-f179.google.com ([74.125.82.179]:44027) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1Ssw9e-0002OK-rQ (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sun, 22 Jul 2012 14:25:03 +0100 Received: by weyx10 with SMTP id x10so3395123wey.38 for ; Sun, 22 Jul 2012 06:25:02 -0700 (PDT) Received: by 10.180.107.2 with SMTP id gy2mr40380299wib.2.1342963502334; Sun, 22 Jul 2012 06:25:02 -0700 (PDT) Received: from YimingZhang-PC (c184.al.cl.cam.ac.uk. [128.232.110.184]) by mx.google.com with ESMTPS id o2sm16182900wiz.11.2012.07.22.06.25.01 (version=SSLv3 cipher=OTHER); Sun, 22 Jul 2012 06:25:01 -0700 (PDT) Date: Sun, 22 Jul 2012 14:25:01 +0100 From: "Yiming Zhang" To: "cl-mirage" Subject: Package `lwt' not found Message-ID: <201207221425004933009@gmail.com> X-mailer: Foxmail 6, 15, 201, 26 [cn] Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list Reply-To: sdiris@gmail.com List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 22 Jul 2012 13:25:03 -0000 X-Keywords: X-UID: 427 Status: O Content-Length: 615 Lines: 17 I followed Thomas's advice and type 'opam update' and 'opam install base-unix cow mirage-fs'. But there still be errors as follows. Is it still due to the regression in 0.3? If so, how to upgrade to 0.3.1? Thanks! Yiming ------------------------------------------ + /root/.opam/system/bin/ocamlfind query -r -i-format cstruct lwt lwt.unix ocamlfind: Package `lwt' not found make[1]: *** [all] Error 2 make: *** [all] Error 2 [2914] ERROR: Compilation failed with error 2 [2914] ERROR: Globals.Exit(66) [2910] ERROR: Command failed while installing mirage.0.3dev 'opam install base-unix cow mirage-fs' failed From thomas.gazagnaire@gmail.com Mon Jul 23 12:48:07 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1StH7P-0004AA-Mb (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 23 Jul 2012 12:48:07 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.160.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (thomas.gazagnaire[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-gh0-f179.google.com ([209.85.160.179]:39469) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1StH7P-0000F8-Q3 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 23 Jul 2012 12:48:07 +0100 Received: by ghbg24 with SMTP id g24so5074550ghb.38 for ; Mon, 23 Jul 2012 04:48:06 -0700 (PDT) Received: by 10.236.183.168 with SMTP id q28mr14051323yhm.45.1343044086327; Mon, 23 Jul 2012 04:48:06 -0700 (PDT) Received: from [192.168.0.14] ([62.200.22.135]) by mx.google.com with ESMTPS id u23sm24653022yhl.21.2012.07.23.04.48.04 (version=TLSv1/SSLv3 cipher=OTHER); Mon, 23 Jul 2012 04:48:05 -0700 (PDT) Subject: Re: Package `lwt' not found Mime-Version: 1.0 (Apple Message framework v1084) Content-Type: text/plain; charset=us-ascii From: Thomas Gazagnaire In-Reply-To: <201207221425004933009@gmail.com> Date: Mon, 23 Jul 2012 13:48:02 +0200 Content-Transfer-Encoding: quoted-printable Message-Id: References: <201207221425004933009@gmail.com> To: sdiris@gmail.com X-Mailer: Apple Mail (2.1084) Cc: cl-mirage X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 23 Jul 2012 11:48:07 -0000 X-Keywords: X-UID: 428 Status: O Content-Length: 891 Lines: 28 yes, this is still due to the regression in 0.3.=20 How did you get opam installed at the first place ? If you download it = from the git repo, "git pull origin master && make && sudo make install" = should be enough .. =20 > I followed Thomas's advice and type 'opam update' and 'opam install = base-unix cow mirage-fs'. But there still be errors as follows.=20 >=20 > Is it still due to the regression in 0.3? If so, how to upgrade to = 0.3.1? >=20 > Thanks! > Yiming > ------------------------------------------ > + /root/.opam/system/bin/ocamlfind query -r -i-format cstruct lwt = lwt.unix > ocamlfind: Package `lwt' not found > make[1]: *** [all] Error 2 > make: *** [all] Error 2 > [2914] ERROR: Compilation failed with error 2 > [2914] ERROR: Globals.Exit(66) > [2910] ERROR: Command failed while installing mirage.0.3dev > 'opam install base-unix cow mirage-fs' failed >=20 >=20 From pgj@caesar.elte.hu Tue Jul 24 15:45:56 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1StgN2-0003xd-50 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 24 Jul 2012 15:45:56 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [157.181.151.9 listed in list.dnswl.dnsbl.ja.net] * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mx2.mail.elte.hu ([157.181.151.9]:46420) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1StgN0-0006gE-Rm (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 24 Jul 2012 15:45:56 +0100 Received: from login01.caesar.elte.hu ([157.181.151.130]) by mx2.mail.elte.hu with esmtp (Exim) id 1StgMu-0004Hn-K9 from for ; Tue, 24 Jul 2012 16:45:53 +0200 Received: (Authenticated sender: pgj) by login01.caesar.elte.hu with local (Exim 4.72) (envelope-from ) id 1StgMu-00081R-Cd for cl-mirage@lists.cam.ac.uk; Tue, 24 Jul 2012 16:45:48 +0200 Date: Tue, 24 Jul 2012 16:45:48 +0200 From: PALI Gabor Janos To: cl-mirage@lists.cam.ac.uk Subject: OPAM does not init (on FreeBSD) Message-ID: <20120724144548.GA20254@caesar.elte.hu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.20 (2009-06-14) Sender: Pali Gabor Janos X-ELTE-SpamScore: -2.0 X-ELTE-SpamLevel: X-ELTE-SpamCheck: no X-ELTE-SpamVersion: ELTE 2.0 X-ELTE-SpamCheck-Details: score=-2.0 required=5.9 tests=BAYES_00 autolearn=no SpamAssassin version=3.3.1 -2.0 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0007] X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 24 Jul 2012 14:45:56 -0000 X-Keywords: X-UID: 429 Status: O Content-Length: 1184 Lines: 33 Hi there, I am trying to use OPAM on FreeBSD/amd64 (10-CURRENT), but I cannot pass through the "init" phase. The following happens: % opam init New compiler descriptions available: - 3.12.1 - 3.12.1+mirage-unix-direct - 3.12.1+mirage-xen - 4.00.0+beta2 WARNING: /usr/home/pgj/.opam/repo/default/descr/deriving-ocsigen.0 does not exist WARNING: /usr/home/pgj/.opam/repo/default/descr/eliom.2.2.2 does not exist WARNING: /usr/home/pgj/.opam/repo/default/descr/ocaml-ssl.0.4.6 does not exist WARNING: /usr/home/pgj/.opam/repo/default/descr/ocaml-text.0.5 does not exist WARNING: /usr/home/pgj/.opam/repo/default/descr/ocsigenserver.2.1 does not exist WARNING: /usr/home/pgj/.opam/repo/default/descr/tyxml.2.1 does not exist [28118] ERROR: Package base-unix not found [28118] ERROR: Package base-bigarray not found [28118] ERROR: Package base-threads not found 'opam init' failed However, it seems all the "missing" packages are there: % ocamlfind list | grep -E "(unix|threads |bigarray)" bigarray (version: [distributed with Ocaml]) threads (version: [distributed with Ocaml]) unix (version: [distributed with Ocaml]) Any ideas? From pgj@caesar.elte.hu Wed Jul 25 11:19:14 2012 Received: from ppsw-43.csi.cam.ac.uk ([131.111.8.143]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1StygU-00055n-2F (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 25 Jul 2012 11:19:14 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1358082 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [157.181.1.138 listed in list.dnswl.dnsbl.ja.net] * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mx3.mail.elte.hu ([157.181.1.138]:48813) by ppsw-43.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1StygS-0001F7-pS (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 25 Jul 2012 11:19:13 +0100 Received: from login01.caesar.elte.hu ([157.181.151.130]) by mx3.mail.elte.hu with esmtp (Exim) id 1StygO-0007I0-PG from for ; Wed, 25 Jul 2012 12:19:12 +0200 Received: (Authenticated sender: pgj) by login01.caesar.elte.hu with local (Exim 4.72) (envelope-from ) id 1StygO-0006DG-AI for cl-mirage@lists.cam.ac.uk; Wed, 25 Jul 2012 12:19:08 +0200 Date: Wed, 25 Jul 2012 12:19:08 +0200 From: PALI Gabor Janos To: cl-mirage@lists.cam.ac.uk Subject: ELF Relocations and OCaml Code Message-ID: <20120725101908.GA16872@caesar.elte.hu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.20 (2009-06-14) Sender: Pali Gabor Janos X-ELTE-SpamScore: -2.0 X-ELTE-SpamLevel: X-ELTE-SpamCheck: no X-ELTE-SpamVersion: ELTE 2.0 X-ELTE-SpamCheck-Details: score=-2.0 required=5.9 tests=BAYES_00 autolearn=no SpamAssassin version=3.3.1 -2.0 BAYES_00 BODY: Bayes spam probability is 0 to 1% [score: 0.0000] X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Jul 2012 10:19:14 -0000 X-Keywords: X-UID: 430 Status: O Content-Length: 2008 Lines: 57 Hi, Yesterday I had a strange issue with unsupported ELF relocations while building a kernel module out of OCaml programs for FreeBSD/amd64. I have finally resolved the problem, but Anil suggested me to send in here for the record. I am working on the FreeBSD port of the Mirage OS module. Everything seemed to compile and link fine, until I wanted to load the module using the kldload(8) command: # kldload mirage.ko Then the console was pounded by lot of linker errors: kldload: unexpected relocation type 9 ... kldload: unexpected relocation type 4 link_elf_obj: symbol camlPervasives__entry undefined linker_load_file: Unsupported file type kldload: can't load mirage.ko: Exec format error By browsing the kernel sources, it turned out that the 64-bit FreeBSD kernel does not support ELF relocation types 9 (R_X86_64_GOTPCREL), 10 (R_X86_32) and 4 (R_X86_64_PLT32) (among many others). So, in order to get rid of these, I had to compile all my OCaml sources as position-dependent code, without support for dynamic linking. This means that ocamlopt must be called with the following flags: -fno-PIC and -nodynlink. In addition, a custom OCaml stdlib has to be built in the same fashion and used when compiling the sources. (By the way, I use -output-obj to get a large C object file with all the referenced code, so it could be linked into the kernel module.) This can be overridden by setting the CAMLLIB environmental variable. However, note that, in the OCaml run-time sources (which gets finally linked to the generated object code) the file called amd64.S should be also modified to remove the last pieces of PIC addressing. That is, the lines #define GREL(r) r@GOTPCREL #define GCALL(r) r@PLT should be rewritten as #define GREL(r) r #define GCALL(r) r One can always check if there is any PIC object left in the ELF by using readelf(1): # readelf -r mirage.ko | grep -E "(PLT32|GOTPCREL)" Obviously, do not forget to compile all the referenced OCaml modules in the same way. From avsm@dark.recoil.org Wed Jul 25 11:37:36 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1StyyG-0005eq-4N (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 25 Jul 2012 11:37:36 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1358082 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:43325 helo=dark.recoil.org) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with smtp id 1StyyE-0007Vo-SR (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 25 Jul 2012 11:37:35 +0100 Received: (qmail 8260 invoked by uid 10000); 25 Jul 2012 10:37:34 -0000 Date: Wed, 25 Jul 2012 11:37:34 +0100 From: Anil Madhavapeddy To: Balraj Singh Subject: Re: Xen/OS layer debugging help Message-ID: <20120725103734.GB24139@dark.recoil.org> References: MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: Mirage List X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 25 Jul 2012 10:37:36 -0000 X-Keywords: X-UID: 431 Status: O Content-Length: 1258 Lines: 24 On Thu, Jul 19, 2012 at 06:22:26PM +0100, Balraj Singh wrote: > A request for some debugging help: the remaining TCP problem that I > see can be attributed to significant pkt loss somewhere in the Xen/OS > layer. I see packets if I sniff the virtual interface, but a lot of > the packets never make it to Ethif.input. I've tried to trace the > code from netif down to the grant tables myself, but I think I need > help. If you can take a look, can you see a reason why pkts would get > lost at busy times, between the vif and Ethif.input. > > This may just be my current test, but the particular packets that get > lost are the pure ACKs (no payload) coming back to my Mirage data > source from a linux data sink running on the same host in another VM. This could point to a bug in Netfront not updating the pointers, but it would be unusual to see this only happening for ACKs. Of course, if it's only on the transmit ring, then we might only ever be sending ACKs. Could you share details of your test case so that Dave/I can reproduce this? A ping-flood to my Mirage VM resulted in no packet loss over 5 minutes, so I think this requires looking at your specific test. -- Anil Madhavapeddy http://anil.recoil.org From sdiris@gmail.com Fri Jul 27 14:41:01 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sukmr-00061t-9n (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 27 Jul 2012 14:41:01 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1358082 * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (sdiris[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.215.182 listed in list.dnswl.dnsbl.ja.net] * 0.0 FSL_FREEMAIL_2 FSL_FREEMAIL_2 * 0.0 FSL_FREEMAIL_1 FSL_FREEMAIL_1 X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-ey0-f182.google.com ([209.85.215.182]:34895) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1Sukmq-0004Jr-sH (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 27 Jul 2012 14:41:01 +0100 Received: by eaa11 with SMTP id 11so479031eaa.41 for ; Fri, 27 Jul 2012 06:41:00 -0700 (PDT) Received: by 10.14.178.129 with SMTP id f1mr2749574eem.5.1343396460575; Fri, 27 Jul 2012 06:41:00 -0700 (PDT) Received: from YimingZhang-PC (c176.al.cl.cam.ac.uk. [128.232.110.176]) by mx.google.com with ESMTPS id k48sm6328621eep.13.2012.07.27.06.40.58 (version=SSLv3 cipher=OTHER); Fri, 27 Jul 2012 06:40:59 -0700 (PDT) Date: Fri, 27 Jul 2012 14:41:01 +0100 From: "Yiming Zhang" To: "cl-mirage" Subject: about "hello mirage world" Message-ID: <201207271441008347713@gmail.com> X-mailer: Foxmail 6, 15, 201, 26 [cn] Mime-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: 7bit X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list Reply-To: sdiris@gmail.com List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 27 Jul 2012 13:41:01 -0000 X-Keywords: X-UID: 432 Status: O Content-Length: 313 Lines: 6 I have finished installing process and successfully run mirage-www. However, now I am stuck in the first step of "hello mirage world". First, it is required to "have mir-xen in your PATH", but where mir-xen is? And second, the first step is to "cd mirage.git/regress", but where mirage.git is? Thanks! Yiming From pgj@caesar.elte.hu Tue Jul 31 14:19:34 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SwCMI-0005Ek-C4 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 31 Jul 2012 14:19:34 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1358082 * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [157.181.1.138 listed in list.dnswl.dnsbl.ja.net] * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mx3.mail.elte.hu ([157.181.1.138]:45029) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1SwCMH-0003D5-X8 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 31 Jul 2012 14:19:34 +0100 Received: from login01.caesar.elte.hu ([157.181.151.130]) by mx3.mail.elte.hu with esmtp (Exim) id 1SwCMB-0001Mq-4M from ; Tue, 31 Jul 2012 15:19:32 +0200 Received: (Authenticated sender: pgj) by login01.caesar.elte.hu with local (Exim 4.72) (envelope-from ) id 1SwCMA-0001bq-NW; Tue, 31 Jul 2012 15:19:26 +0200 Date: Tue, 31 Jul 2012 15:19:26 +0200 From: PALI Gabor Janos To: Yiming Zhang Subject: Re: about "hello mirage world" Message-ID: <20120731131926.GA7254@caesar.elte.hu> References: <201207271441008347713@gmail.com> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: <201207271441008347713@gmail.com> User-Agent: Mutt/1.5.20 (2009-06-14) Sender: Pali Gabor Janos X-ELTE-SpamScore: -1.2 X-ELTE-SpamLevel: X-ELTE-SpamCheck: no X-ELTE-SpamVersion: ELTE 2.0 X-ELTE-SpamCheck-Details: score=-1.2 required=5.9 tests=AWL, BAYES_05 autolearn=no SpamAssassin version=3.3.1 -0.5 BAYES_05 BODY: Bayes spam probability is 1 to 5% [score: 0.0123] -0.7 AWL AWL: From: address is in the auto white-list Cc: cl-mirage X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Jul 2012 13:19:34 -0000 X-Keywords: X-UID: 433 Status: O Content-Length: 738 Lines: 21 Hi, On Fri, Jul 27, 2012 at 02:41:01PM +0100, Yiming Zhang wrote: > First, it is required to "have mir-xen in your PATH", but where mir-xen is? > And second, the first step is to "cd mirage.git/regress", but where > mirage.git is? I think it is because the documentation has not been updated. There was a major reorganization for the Mirage sources: mirage.git has been split into multiple smaller repositories that now you can find under mirage.github.com (and install via using OPAM). The old mirage.git repository lives at Anil's github's profile, that is where you could find the referenced files: http://github.com/avsm/mirage.git However, I do not know whether it would make any sense to use them any more. Hope that helps. From pgj@caesar.elte.hu Tue Jul 31 14:30:41 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SwCX3-0005cD-Iw (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 31 Jul 2012 14:30:41 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1358082 * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [157.181.151.9 listed in list.dnswl.dnsbl.ja.net] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mx2.mail.elte.hu ([157.181.151.9]:38184) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1SwCX2-0003Em-Xk (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 31 Jul 2012 14:30:41 +0100 Received: from login01.caesar.elte.hu ([157.181.151.130]) by mx2.mail.elte.hu with esmtp (Exim) id 1SwCWw-0002Dq-ET from for ; Tue, 31 Jul 2012 15:30:39 +0200 Received: (Authenticated sender: pgj) by login01.caesar.elte.hu with local (Exim 4.72) (envelope-from ) id 1SwCWw-0001zd-6b for cl-mirage@lists.cam.ac.uk; Tue, 31 Jul 2012 15:30:34 +0200 Date: Tue, 31 Jul 2012 15:30:34 +0200 From: PALI Gabor Janos To: cl-mirage@lists.cam.ac.uk Subject: Mirage/kFreeBSD on GitHub Message-ID: <20120731133034.GB7254@caesar.elte.hu> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline User-Agent: Mutt/1.5.20 (2009-06-14) Sender: Pali Gabor Janos X-ELTE-SpamScore: -0.5 X-ELTE-SpamLevel: X-ELTE-SpamCheck: no X-ELTE-SpamVersion: ELTE 2.0 X-ELTE-SpamCheck-Details: score=-0.5 required=5.9 tests=BAYES_05 autolearn=no SpamAssassin version=3.3.1 -0.5 BAYES_05 BODY: Bayes spam probability is 1 to 5% [score: 0.0141] X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 31 Jul 2012 13:30:41 -0000 X-Keywords: X-UID: 434 Status: O Content-Length: 389 Lines: 13 Hi there, I have just added a repository with an initial version of the Mirage/kFreeBSD port to GitHub: https://github.com/pgj/mirage-kfreebsd It does not do too much at the moment, however it is possible to build and run a kernel module with OCaml inside. I am hoping to continue the development there, any feedback is appreciated. See the associated README file for documentation.