From Richard.Mortier@nottingham.ac.uk Mon Jun 04 19:07:01 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SbbgD-0002Mh-5X (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 04 Jun 2012 19:07:01 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1345631 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:57531 helo=thb-mta-19.emailfiltering.com) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1Sbbg7-0000M5-Py (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 04 Jun 2012 19:07:01 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.86) by TLS id 2450073430 ;e982eabccbf7819; Mon, 04 Jun 2012 19:06:34 +0100 Received: from uiwexhub02.ad.nottingham.ac.uk ([128.243.15.132]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sbbfm-0006uQ-IM for cl-mirage@lists.cam.ac.uk; Mon, 04 Jun 2012 19:06:34 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::7962:f868:e6ee:6267]) by UIWEXHUB02.ad.nottingham.ac.uk ([2002:80f3:f84::80f3:f84]) with mapi; Mon, 4 Jun 2012 19:06:09 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Mon, 4 Jun 2012 19:06:16 +0100 Subject: Cstruct.shift_left Thread-Topic: Cstruct.shift_left Thread-Index: Ac1CfLeQTHaczkOPQoirK0oJRSgnpg== Message-ID: <1A6D05DA-E6A6-47D2-9996-759A0182D117@nottingham.ac.uk> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Jun 2012 18:07:01 -0000 X-Keywords: X-UID: 266 Status: O Content-Length: 1193 Lines: 35 is there a reason this has signature val shift_left : buf -> int -> bool ...with the bool indicating whether it worked (true) or not (false); rather= than val shift_left : buf -> int -> buf=20 ...with exception raised when it fails? (i seem to be doing a lot of shift_lefting in DNS, and it's a bit fiddly - = i'm wrapping it up but wondered if i was missing something.) --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From anil@recoil.org Mon Jun 04 19:24:04 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sbbwi-0002Y1-Ec (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 04 Jun 2012 19:24:04 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1345631 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:38763 helo=dark.recoil.org) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with smtp id 1Sbbwh-0002Y9-rN (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 04 Jun 2012 19:24:04 +0100 Received: (qmail 27349 invoked by uid 634); 4 Jun 2012 18:24:03 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Mon, 04 Jun 2012 19:24:02 +0100 Subject: Re: Cstruct.shift_left Mime-Version: 1.0 (Apple Message framework v1257) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <1A6D05DA-E6A6-47D2-9996-759A0182D117@nottingham.ac.uk> Date: Mon, 4 Jun 2012 19:24:07 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <1A6D05DA-E6A6-47D2-9996-759A0182D117@nottingham.ac.uk> To: Richard Mortier X-Mailer: Apple Mail (2.1257) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 04 Jun 2012 18:24:04 -0000 X-Keywords: X-UID: 267 Status: O Content-Length: 2638 Lines: 69 That's a slightly odd function in cstruct; it mutates the buffer = in-place to shift the data pointer towards the beginning, to enable the = FABLE-style buffer write functions to expose packet headers on packet = transmit. It's quite a low-level function, and could be made safer by duplicating = the buffer reference and modifying that, rather than being the only = function to actually mutate the buffer that is passed in. I've just pushed the cstruct TCP code that works to os-bigarray (and am = finishing up the buffered channel at the moment, which will unlock HTTP = and friends). This doesn't actually use shift_left, since every TCP = write uses scatter-gather IO to write segment fragments to the interface = (with a small fragment for the header, and a list of Io_page views). Therefore, the only real use for shift_left is now in UDP/IPv4, where it = could also be removed and scatter-gather used for everything. This will = be slightly more inefficient, but I suspect that it wont make a = difference in practise, since the netback will read all the fragments on = the ring in one pass without any extra events being involved. What are you using shift_left for in DNS? I would have thought that you = just need to keep track of an offset to write into, and create = sub-views. You shouldn't need to shift_left (I think). -anil On 4 Jun 2012, at 19:06, Richard Mortier wrote: > is there a reason this has signature >=20 > val shift_left : buf -> int -> bool >=20 > ...with the bool indicating whether it worked (true) or not (false); = rather than >=20 > val shift_left : buf -> int -> buf=20 >=20 > ...with exception raised when it fails? >=20 > (i seem to be doing a lot of shift_lefting in DNS, and it's a bit = fiddly - i'm wrapping it up but wondered if i was missing something.) >=20 > --=20 > Cheers, >=20 > R. >=20 >=20 >=20 >=20 > This message and any attachment are intended solely for the addressee = and may contain confidential information. If you have received this = message in error, please send it back to me, and immediately delete it. = Please do not use, copy or disclose the information contained in this = message or in any attachment. Any views or opinions expressed by the = author of this email do not necessarily reflect the views of the = University of Nottingham. >=20 > This message has been checked for viruses but the contents of an = attachment > may still contain software viruses which could damage your computer = system: > you are advised to perform your own checks. Email communications with = the > University of Nottingham may be monitored as permitted by UK = legislation. From anil@recoil.org Tue Jun 05 17:26:06 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sbwa6-0006xH-NW (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 05 Jun 2012 17:26:06 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1345872 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:14839 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1Sbwa6-0006ty-X4 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 05 Jun 2012 17:26:06 +0100 Received: (qmail 14688 invoked by uid 634); 5 Jun 2012 16:26:06 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.38]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Tue, 05 Jun 2012 17:26:05 +0100 From: Anil Madhavapeddy Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: 7bit Subject: update on os-bigarray branch Date: Tue, 5 Jun 2012 17:26:03 +0100 Message-Id: To: "cl-mirage@lists.cam.ac.uk Mailing List" Mime-Version: 1.0 (Apple Message framework v1257) X-Mailer: Apple Mail (2.1257) X-Virus-Checked: Checked by ClamAV on dark.recoil.org X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 05 Jun 2012 16:26:06 -0000 X-Keywords: X-UID: 268 Status: O Content-Length: 2060 Lines: 43 I've been porting the network stack to switch all data buffers to directly use data buffers as external reference counted pages, rather than wrapping them in OCaml string types. These buffers are exposed as 'bigarrays', and manipulated via the new 'cstruct' syntax extension which maps c structs to OCaml, and generates accessor functions for them. Everything works up until the Channel module (which will work very shortly), but I did some ICMP echo flood tests to check out the performance as a rough metric, and the results are pretty good. With 2000 byte packets and a million echo requests, going between two PV domains, all the tests have zero packet loss or reordering issues (good!). In descending order performance, we have the zero-copy Mirage cstruct stack, then PV Linux, and then the Mirage bitstring (which performs a data copy into an OCaml string). --- Mirage-cstruct 10.0.0.2 ping statistics --- 100000 packets transmitted, 100000 received, 0% packet loss, time 16885ms rtt min/avg/max/mdev = 0.089/0.114/0.704/0.026 ms, ipg/ewma 0.168/0.109 ms --- PV Linux 10.0.0.4 ping statistics --- 100000 packets transmitted, 100000 received, 0% packet loss, time 17044ms rtt min/avg/max/mdev = 0.106/0.123/0.201/0.007 ms, ipg/ewma 0.170/0.125 ms --- Mirage-bitstring 10.0.0.2 ping statistics --- 100000 packets transmitted, 100000 received, 0% packet loss, time 18062ms rtt min/avg/max/mdev = 0.095/0.132/0.498/0.030 ms, ipg/ewma 0.180/0.138 ms I've done some quick TCP write tests, and we seem to have fixed the very slow problem that the old Bitstring had (due to the multiple string creates). Next steps before merging this into trunk are: - Finish Channel for buffered TCP (will let HTTP and SSH work again) - Mort is porting lib/dns (while on vacation i believe!) - Haris will take a look at the Openflow switch, once I port the controller over to the new Channel stack. So we should get to a self-hosting website again very shortly, merge this to trunk, and then get on with the developer preview release by the end of June! -anil From anil@recoil.org Wed Jun 06 14:55:17 2012 Received: from ppsw-52.csi.cam.ac.uk ([131.111.8.152]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1ScGhh-0001kw-9q (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 06 Jun 2012 14:55:17 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1346294 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:27567 helo=dark.recoil.org) by ppsw-52.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with smtp id 1ScGhf-0003fS-FC (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 06 Jun 2012 14:55:17 +0100 Received: (qmail 14793 invoked by uid 634); 6 Jun 2012 13:55:14 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from dhcp-128-232-142-222.eduroam.csx.cam.ac.uk (HELO dhcp-128-232-142-222.eduroam.csx.cam.ac.uk) (128.232.142.222) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 06 Jun 2012 14:55:13 +0100 From: Anil Madhavapeddy Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: Trace mode integrated Date: Wed, 6 Jun 2012 14:55:12 +0100 Message-Id: To: "cl-mirage@lists.cam.ac.uk Mailing List" Mime-Version: 1.0 (Apple Message framework v1257) X-Mailer: Apple Mail (2.1257) X-Virus-Checked: Checked by ClamAV on dark.recoil.org X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Jun 2012 13:55:17 -0000 X-Keywords: X-UID: 269 Status: O Content-Length: 3794 Lines: 77 Printf debugging still remains the best way to debug lots of code, and = Jeremie Diminio sent me a *really* useful camlp4 extension which adds = function-boundary tracing to a file. I've integrated this trivially into the Mirage tree in os-bigarray, so = now you can specify "MIR-TRACE=3D1" in the Makefile, and recompile, and = the entire stack will spew out trace output on every function call, with = nice ANSI colour coding to signify which bit it comes from (std, net, = os, other). Very useful for debugging or generally seeing whats going = on. You can try it out by setting MIR-TRACE=3D1, and optionally edit = syntax/pa_trace.ml to set the top variables (you can filter out "std" to = reduce the output levels considerably). Example output below (sans colors of course): input: File "net/direct/ethif.ml", line 37, characters 2-332 (end at = line 46, character 55) get_ethernet_ethertype: File "net/direct/ethif.ml", line 29, characters = 0-111 (end at line 33, character 15) get_uint16: File "std/cstruct.ml", line 64, characters 4-87 (end at line = 66, character 19) get_uint8: File "std/cstruct.ml", line 33, characters 2-23 get_uint8: File "std/cstruct.ml", line 33, characters 2-23 shift: File "std/cstruct.ml", line 153, characters 2-29 len: File "std/cstruct.ml", line 123, characters 14-21 dim: File "std/bigarray.ml", line 107, characters 14-34 sub: File "std/cstruct.ml", line 133, characters 22-37 input: File "net/direct/ipv4.ml", line 129, characters 2-579 (end at = line 143, character 63) get_ipv4_hlen_version: File "net/direct/ipv4.ml", line 21, characters = 0-261 (end at line 32, character 15) get_uint8: File "std/cstruct.ml", line 33, characters 2-23 get_ipv4_src: File "net/direct/ipv4.ml", line 21, characters 0-261 (end = at line 32, character 15) get_uint32: File "std/cstruct.ml", line 69, characters 4-125 (end at = line 71, character 55) get_uint16: File "std/cstruct.ml", line 64, characters 4-87 (end at line = 66, character 19) get_uint8: File "std/cstruct.ml", line 33, characters 2-23 get_uint8: File "std/cstruct.ml", line 33, characters 2-23 get_uint16: File "std/cstruct.ml", line 64, characters 4-87 (end at line = 66, character 19) get_uint8: File "std/cstruct.ml", line 33, characters 2-23 get_uint8: File "std/cstruct.ml", line 33, characters 2-23 get_ipv4_dst: File "net/direct/ipv4.ml", line 21, characters 0-261 (end = at line 32, character 15) get_uint32: File "std/cstruct.ml", line 69, characters 4-125 (end at = line 71, character 55) get_uint16: File "std/cstruct.ml", line 64, characters 4-87 (end at line = 66, character 19) get_uint8: File "std/cstruct.ml", line 33, characters 2-23 get_uint8: File "std/cstruct.ml", line 33, characters 2-23 get_uint16: File "std/cstruct.ml", line 64, characters 4-87 (end at line = 66, character 19) get_uint8: File "std/cstruct.ml", line 33, characters 2-23 get_uint8: File "std/cstruct.ml", line 33, characters 2-23 get_ipv4_len: File "net/direct/ipv4.ml", line 21, characters 0-261 (end = at line 32, character 15) get_uint16: File "std/cstruct.ml", line 64, characters 4-87 (end at line = 66, character 19) get_uint8: File "std/cstruct.ml", line 33, characters 2-23 get_uint8: File "std/cstruct.ml", line 33, characters 2-23 sub: File "std/cstruct.ml", line 133, characters 22-37 sub: File "std/cstruct.ml", line 133, characters 22-37 get_ipv4_proto: File "net/direct/ipv4.ml", line 21, characters 0-261 = (end at line 32, character 15) get_uint8: File "std/cstruct.ml", line 33, characters 2-23 input: File "net/direct/udp.ml", line 34, characters 2-339 (end at line = 41, character 13) get_udpv4_dest_port: File "net/direct/udp.ml", line 26, characters 0-116 = (end at line 31, character 15) get_uint16: File "std/cstruct.ml", line 64, characters 4-87 (end at line = 66, character 19) From jac22@cl.cam.ac.uk Wed Jun 06 15:09:56 2012 Received: from ppsw-52.csi.cam.ac.uk ([131.111.8.152]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1ScGvs-0002Nm-PB (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 06 Jun 2012 15:09:56 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -1.1 from SpamAssassin-3.3.2-1346294 * -1.0 ALL_TRUSTED Passed through trusted hosts only via SMTP * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mta1.cl.cam.ac.uk ([128.232.25.21]:53203) by ppsw-52.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1ScGvr-0005KD-Dw (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 06 Jun 2012 15:09:56 +0100 Received: from ssh-remote-0.cl.cam.ac.uk ([128.232.0.69] helo=cl.cam.ac.uk) by mta1.cl.cam.ac.uk with esmtp (Exim 4.63) (envelope-from ) id 1ScGxC-0002Qj-NR; Wed, 06 Jun 2012 15:11:18 +0100 To: Anil Madhavapeddy Subject: flexible nets etc MIME-Version: 1.0 Content-Type: text/plain; charset="us-ascii" Content-ID: <7214.1338991791.1@cl.cam.ac.uk> Date: Wed, 06 Jun 2012 15:09:51 +0100 From: Jon Crowcroft Message-Id: Cc: Jon.Crowcroft@cl.cam.ac.uk, "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 06 Jun 2012 14:09:56 -0000 X-Keywords: X-UID: 270 Status: O Content-Length: 271 Lines: 4 scott shenker just gave a nice talk here starting from SDN, but going on to talk about checkable and secure and cloud etc- i spoke to him about mirage and sent him a pointer - he's probably hooked (all the guys here except him cite vmware, but he said xen hypervisor:) From anil@recoil.org Fri Jun 08 15:21:01 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sd03h-0002ST-Ne (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 08 Jun 2012 15:21:01 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1347536 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:27034 helo=dark.recoil.org) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with smtp id 1Sd03h-0005xq-Pt (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Fri, 08 Jun 2012 15:21:01 +0100 Received: (qmail 5980 invoked by uid 634); 8 Jun 2012 14:21:00 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Fri, 08 Jun 2012 15:21:00 +0100 From: Anil Madhavapeddy Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: release roadmap and tags Date: Fri, 8 Jun 2012 15:20:58 +0100 Message-Id: To: "cl-mirage@lists.cam.ac.uk Mailing List" Mime-Version: 1.0 (Apple Message framework v1257) X-Mailer: Apple Mail (2.1257) X-Virus-Checked: Checked by ClamAV on dark.recoil.org X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Fri, 08 Jun 2012 14:21:01 -0000 X-Keywords: X-UID: 271 Status: O Content-Length: 2202 Lines: 53 I'm preparing a few versioned releases of Mirage. These are represented = as git 'tags', with the version number being the tag name. Details = follow: 0.1: https://github.com/avsm/mirage/tree/0.1 This is the tree that uses Bitstring, and the last commit was very early = in the morning after a certain conference deadline :-) We've done quite = a bit of benchmarking on this version, and it has working Openflow and = storage (FAT32), and is sufficient to self-host the website. =20 Haris: you can use this version to demonstrate your Openflow work at ICC = next week. 0.2: (available in a few days) I am in the process of merging the os-bigarray branch (faster write = path, scatter gather I/O, zero-copy Io_page), and this will be version = 0.2. It has *features disabled*, notably Openflow, DNS and storage, = but will be sufficient to self-host the website with the Ramdisk = filesystem. =20 Intention is for Mort and Haris to use this to get their respective = features synched, and Balraj and me to test the TCP performance vs 0.1. 0.3: (available end of June) This release will be the developer preview release, and will have the = build system reworked to support ocamlfind and separate repositories, to = make it suitable for packaging on Debian, Fedora and Free/OpenBSD. I'll = send more details of this shortly, but Thomas, David and I likely work = on this to ensure that stub Xen domains and proxy VMs can be easily = built, as well as conventional UNIX and js_of_ocaml outputs. Hopefully, we will have DNS and OpenFlow and FAT32 back for this = release. All of the ports are in pretty good shape. 0.4: (available early Autumn/late summer) Gabor Pali will be joining us in July in Cambridge for a 3 month visit, = and working on a FreeBSD kernel port of the networking stack so that it = can run side-by-side with the production C stack. The 0.4 release is = aiming to have the following new ports: - FreeBSD kernel (x86_64) - Raspberry Pi userspace (ARM) - Simulation backend (for load-testing, based on Haris' planned work at = SRI this summer). We will be storing all the components libraries under the 'Mirage' = organisation, at http://github.com/mirage/ -anil= From anil@recoil.org Sat Jun 09 10:58:20 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SdIR2-0003bQ-27 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 09 Jun 2012 10:58:20 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1347949 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:3807 helo=dark.recoil.org) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with smtp id 1SdIR1-0007q8-ra (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 09 Jun 2012 10:58:20 +0100 Received: (qmail 24287 invoked by uid 634); 9 Jun 2012 09:58:19 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from host81-149-102-120.in-addr.btopenworld.com (HELO [192.168.0.12]) (81.149.102.120) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Sat, 09 Jun 2012 10:58:18 +0100 From: Anil Madhavapeddy Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: the gitocalypse repo splitting for v0.3 Date: Sat, 9 Jun 2012 10:58:16 +0100 Message-Id: <106E70E7-B3C7-4EB2-96C3-6A826E1A81A9@recoil.org> To: "cl-mirage@lists.cam.ac.uk Mailing List" Mime-Version: 1.0 (Apple Message framework v1257) X-Mailer: Apple Mail (2.1257) X-Virus-Checked: Checked by ClamAV on dark.recoil.org X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 Jun 2012 09:58:20 -0000 X-Keywords: X-UID: 272 Status: O Content-Length: 1162 Lines: 30 I'm just taking a look at splitting up the Mirage repository for 0.3 and = wondered if anyone had a strong opinion on the repository history. I'm = currently doing this: - Start with mirage.git from master - 'Git mv' everything into a set of sub-directories which can operate = independently. Each subdir has its own configure/Makefile/ocamlfind = script which is copied from a common Makefile structure. - git subtree export everything into separate repositories to host on = github.com/master The last bit is the unfortunate one, since it filters out changesets = before the directory rearrangement and so in practical terms leaves no = useful history. Ideally (somehow), we would keep the individual commit = histories on the files even after they've been exported.=20 One alternative is to clone mirage.git once per component, and delete = everything else that isn't needed. That's a pretty enormous space = requirement though. It's a bit tedious, so I'm inclined to preserve copyrights and the = original repository, and reset the history (as I believe xen-api.git did = when open-sourced, right Dave?). Any objections/ideas/agreement? -anil From Dave.Scott@eu.citrix.com Sat Jun 09 12:42:12 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SdK3Y-00055t-SC (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 09 Jun 2012 12:42:12 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1347949 * -0.0 T_RP_MATCHES_RCVD Envelope sender domain matches handover relay * domain * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from smtp.ctxuk.citrix.com ([62.200.22.115]:51684 helo=SMTP.EU.CITRIX.COM) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with esmtp id 1SdK3X-0000lM-sN (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 09 Jun 2012 12:42:12 +0100 X-IronPort-AV: E=Sophos;i="4.75,741,1330905600"; d="scan'208";a="12923963" Received: from lonpmailmx02.citrite.net ([10.30.203.163]) by LONPIPO01.EU.CITRIX.COM with ESMTP/TLS/RC4-MD5; 09 Jun 2012 11:42:11 +0000 Received: from LONPMAILBOX01.citrite.net ([10.30.224.160]) by LONPMAILMX02.citrite.net ([10.30.203.163]) with mapi; Sat, 9 Jun 2012 12:42:11 +0100 From: Dave Scott To: Anil Madhavapeddy Date: Sat, 9 Jun 2012 12:42:08 +0100 Subject: Re: the gitocalypse repo splitting for v0.3 Thread-Topic: the gitocalypse repo splitting for v0.3 Thread-Index: Ac1GNOefO8t5G3xcTjC4VgqMPbdzDw== Message-ID: <9556AB13-BFF2-4B83-87C8-151AF4150D5E@eu.citrix.com> References: <106E70E7-B3C7-4EB2-96C3-6A826E1A81A9@recoil.org> In-Reply-To: <106E70E7-B3C7-4EB2-96C3-6A826E1A81A9@recoil.org> Accept-Language: en-US Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 Jun 2012 11:42:12 -0000 X-Keywords: X-UID: 273 Status: O Content-Length: 1532 Lines: 40 Personally I think it's fine provided the archived history is available som= ewhere online for future reference. When we squashed the history of xen-api= .git we kept the old hg repo, which is useful very occasionally. --=20 Dave Scott On Jun 9, 2012, at 10:58 AM, "Anil Madhavapeddy" wrote: > I'm just taking a look at splitting up the Mirage repository for 0.3 and = wondered if anyone had a strong opinion on the repository history. I'm cur= rently doing this: >=20 > - Start with mirage.git from master >=20 > - 'Git mv' everything into a set of sub-directories which can operate ind= ependently. Each subdir has its own configure/Makefile/ocamlfind script wh= ich is copied from a common Makefile structure. >=20 > - git subtree export everything into separate repositories to host on git= hub.com/master >=20 > The last bit is the unfortunate one, since it filters out changesets befo= re the directory rearrangement and so in practical terms leaves no useful h= istory. Ideally (somehow), we would keep the individual commit histories o= n the files even after they've been exported.=20 >=20 > One alternative is to clone mirage.git once per component, and delete eve= rything else that isn't needed. That's a pretty enormous space requirement= though. >=20 > It's a bit tedious, so I'm inclined to preserve copyrights and the origin= al repository, and reset the history (as I believe xen-api.git did when ope= n-sourced, right Dave?). Any objections/ideas/agreement? >=20 > -anil >=20 >=20 >=20 From anil@recoil.org Sat Jun 09 13:01:36 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SdKMK-0005JC-UG (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 09 Jun 2012 13:01:36 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1347949 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.0 HTML_MESSAGE BODY: HTML included in message X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:14036 helo=dark.recoil.org) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with smtp id 1SdKMK-0002RU-qJ (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 09 Jun 2012 13:01:36 +0100 Received: (qmail 4956 invoked by uid 634); 9 Jun 2012 12:01:35 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED,HTML_MESSAGE X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Sat, 09 Jun 2012 13:01:34 +0100 Subject: Re: the gitocalypse repo splitting for v0.3 Mime-Version: 1.0 (Apple Message framework v1257) Content-Type: multipart/alternative; boundary="Apple-Mail=_E0898756-0130-4C7D-BE5D-47708BEECF9A" From: Anil Madhavapeddy In-Reply-To: Date: Sat, 9 Jun 2012 13:01:32 +0100 Message-Id: <1ADEF3D1-F21B-4B8C-8463-E5CC3D46EC31@recoil.org> References: To: Richard Mortier X-Mailer: Apple Mail (2.1257) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 Jun 2012 12:01:37 -0000 X-Keywords: X-UID: 274 Status: O Content-Length: 6475 Lines: 163 --Apple-Mail=_E0898756-0130-4C7D-BE5D-47708BEECF9A Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii I had a quick go at a sub-tree export by filtering the diff header to = look for commit chunks that only touch that file, but it's quite fiddly. Sounds like it doesn't matter too much to maintain history, and the = current repository will be around anyway, as Dave says. Onwards! I'm about to merge os-bigarray into master (so Haris, dont = forget to use the 0.1 tag for your demo in Ottawa). -anil On 9 Jun 2012, at 11:09, Richard Mortier wrote: > Can replay each file as a sequence of patches? Would require some = (serious) scripting tho- is it worth it? >=20 > Or could do the clone, then some of the gc options in git? Never used = so not familiar with them...=20 >=20 >=20 > Anil Madhavapeddy wrote:=20 >=20 >=20 > I'm just taking a look at splitting up the Mirage repository for 0.3 = and wondered if anyone had a strong opinion on the repository history. = I'm currently doing this: >=20 > - Start with mirage.git from master >=20 > - 'Git mv' everything into a set of sub-directories which can operate = independently. Each subdir has its own configure/Makefile/ocamlfind = script which is copied from a common Makefile structure. >=20 > - git subtree export everything into separate repositories to host on = github.com/master >=20 > The last bit is the unfortunate one, since it filters out changesets = before the directory rearrangement and so in practical terms leaves no = useful history. Ideally (somehow), we would keep the individual commit = histories on the files even after they've been exported.=20 >=20 > One alternative is to clone mirage.git once per component, and delete = everything else that isn't needed. That's a pretty enormous space = requirement though. >=20 > It's a bit tedious, so I'm inclined to preserve copyrights and the = original repository, and reset the history (as I believe xen-api.git did = when open-sourced, right Dave?). Any objections/ideas/agreement? >=20 > -anil >=20 >=20 >=20 >=20 > This message and any attachment are intended solely for the addressee = and may contain confidential information. If you have received this = message in error, please send it back to me, and immediately delete it. = Please do not use, copy or disclose the information contained in this = message or in any attachment. Any views or opinions expressed by the = author of this email do not necessarily reflect the views of the = University of Nottingham. >=20 > This message has been checked for viruses but the contents of an = attachment may still contain software viruses which could damage your = computer system: you are advised to perform your own checks. Email = communications with the University of Nottingham may be monitored as = permitted by UK legislation. >=20 --Apple-Mail=_E0898756-0130-4C7D-BE5D-47708BEECF9A Content-Transfer-Encoding: quoted-printable Content-Type: text/html; charset=us-ascii I had = a quick go at a sub-tree export by filtering the diff header to look for = commit chunks that only touch that file, but it's quite = fiddly.

Sounds like it doesn't matter too much to = maintain history, and the current repository will be around anyway, as = Dave says.

Onwards! I'm about to merge = os-bigarray into master (so Haris, dont forget to use the 0.1 tag for = your demo in = Ottawa).

-anil

On 9 Jun = 2012, at 11:09, Richard Mortier wrote:

Can replay each file as a sequence of patches? = Would require some (serious) scripting tho- is it worth = it?

Or could do the clone, then some of the gc options in = git? Never used so not familiar with them... 


Anil = Madhavapeddy <anil@recoil.org> wrote: =


I'm just taking a = look at splitting up the Mirage repository for 0.3 and wondered if = anyone had a strong opinion on the repository history.  I'm = currently doing this:

- Start with mirage.git from master

- 'Git mv' everything into a set of sub-directories which can operate = independently.  Each subdir has its own = configure/Makefile/ocamlfind script which is copied from a common = Makefile structure.

- git subtree export everything into separate repositories to host on github.com/master

The last bit is the unfortunate one, since it filters out changesets = before the directory rearrangement and so in practical terms leaves no = useful history.  Ideally (somehow), we would keep the individual = commit histories on the files even after they've been exported.

One alternative is to clone mirage.git once per component, and delete = everything else that isn't needed.  That's a pretty enormous space = requirement though.

It's a bit tedious, so I'm inclined to preserve copyrights and the = original repository, and reset the history (as I believe xen-api.git did = when open-sourced, right Dave?).  Any = objections/ideas/agreement?

-anil

This message and any attachment are intended solely for the addressee = and may=20 contain confidential information. If you have received this message in = error,=20 please send it back to me, and immediately delete it. Please do not = use,=20 copy or disclose the information contained in this message or in any = attachment. =20 Any views or opinions expressed by the author of this email do not = necessarily=20 reflect the views of the University of Nottingham.

This message has been checked for viruses but the contents of an = attachment may still contain software viruses which could damage your computer = system: you are advised to perform your own checks. Email communications with = the University of Nottingham may be monitored as permitted by UK = legislation.


= --Apple-Mail=_E0898756-0130-4C7D-BE5D-47708BEECF9A-- From anil@recoil.org Sat Jun 09 13:28:39 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SdKmV-0005hw-LH (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 09 Jun 2012 13:28:39 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1347949 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:47682 helo=dark.recoil.org) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with smtp id 1SdKmV-0006KN-qW (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 09 Jun 2012 13:28:39 +0100 Received: (qmail 3325 invoked by uid 634); 9 Jun 2012 12:28:39 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Sat, 09 Jun 2012 13:28:38 +0100 From: Anil Madhavapeddy Content-Type: text/plain; charset=us-ascii Content-Transfer-Encoding: quoted-printable Subject: unix-socket removed Date: Sat, 9 Jun 2012 13:28:36 +0100 Message-Id: To: "cl-mirage@lists.cam.ac.uk Mailing List" Mime-Version: 1.0 (Apple Message framework v1257) X-Mailer: Apple Mail (2.1257) X-Virus-Checked: Checked by ClamAV on dark.recoil.org X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 Jun 2012 12:28:39 -0000 X-Keywords: X-UID: 275 Status: O Content-Length: 685 Lines: 16 Just a heads up: v0.2 will also have the unix-socket backend broken when = I merge into master.=20 Part of the breakup of the repository means that we can use the standard = Lwt UNIX module to access kernel sockets, and no longer need our shim = layer. Switching to upstream Lwt pulls in numerous bug fixes = (particularly in the libev integration, which is a bit tricky with = respect to the garbage collector and generational roots). But in the very short term, only unix-direct and xen-direct will work. = I'm thinking the TCP stack is in good enough shape to just turn the = default live openmirage.org to use the microkernel version now; who = needs UNIX sockets eh! -anil= From anil@recoil.org Sat Jun 09 17:54:48 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SdOw4-0000ZS-Td (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 09 Jun 2012 17:54:48 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1347949 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:22160 helo=dark.recoil.org) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with smtp id 1SdOw3-0003Yh-ST (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sat, 09 Jun 2012 17:54:48 +0100 Received: (qmail 7255 invoked by uid 634); 9 Jun 2012 16:54:47 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.38]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Sat, 09 Jun 2012 17:54:46 +0100 Content-Type: text/plain; charset=us-ascii Mime-Version: 1.0 (Apple Message framework v1257) Subject: Re: unix-socket removed From: Anil Madhavapeddy In-Reply-To: Date: Sat, 9 Jun 2012 17:54:44 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: To: "cl-mirage@lists.cam.ac.uk Mailing List" X-Mailer: Apple Mail (2.1257) X-Virus-Checked: Checked by ClamAV on dark.recoil.org X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sat, 09 Jun 2012 16:54:49 -0000 X-Keywords: X-UID: 276 Status: O Content-Length: 1301 Lines: 33 Well, it turned out to be a 10 minute job to fix unix-socket, so I did. v0.2 is now live on my master branch, along with the 100+ commits to = shift over to Io_page/cstruct. I'm now beginning the rearrangement of the repositories to an = independent layout within a 'v3-build' branch, but will resolve any = conflicts against the v0.2 master branch. I suspect Haris won't have = time to restore Openflow before I complete the switch to a new = repository layout, but it would be good to get DNS in if you can finish = that off, Mort. -anil On 9 Jun 2012, at 13:28, Anil Madhavapeddy wrote: > Just a heads up: v0.2 will also have the unix-socket backend broken = when I merge into master.=20 >=20 > Part of the breakup of the repository means that we can use the = standard Lwt UNIX module to access kernel sockets, and no longer need = our shim layer. Switching to upstream Lwt pulls in numerous bug fixes = (particularly in the libev integration, which is a bit tricky with = respect to the garbage collector and generational roots). >=20 > But in the very short term, only unix-direct and xen-direct will work. = I'm thinking the TCP stack is in good enough shape to just turn the = default live openmirage.org to use the microkernel version now; who = needs UNIX sockets eh! >=20 > -anil From Richard.Mortier@nottingham.ac.uk Sun Jun 10 20:28:23 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SdnoF-0001SB-1h (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Sun, 10 Jun 2012 20:28:23 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1348336 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ixe-mta-19-tx.emailfiltering.com ([194.116.198.150]:54027 helo=ixe-mta-19.emailfiltering.com) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1Sdno9-0004z4-YO (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Sun, 10 Jun 2012 20:28:23 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by ixe-mta-19.emailfiltering.com with emfmta (version 4.8.5.86) by TLS id 2279090108 ;fc59eee7e20a0ec6; Sun, 10 Jun 2012 20:27:57 +0100 Received: from uiwexhub01.ad.nottingham.ac.uk ([128.243.15.133]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sdnnp-0007dn-8r for cl-mirage@lists.cam.ac.uk; Sun, 10 Jun 2012 20:27:57 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::7962:f868:e6ee:6267]) by UIWEXHUB01.ad.nottingham.ac.uk ([2002:80f3:f85::80f3:f85]) with mapi; Sun, 10 Jun 2012 20:27:52 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Sun, 10 Jun 2012 20:27:55 +0100 Subject: Re: unix-socket removed Thread-Topic: unix-socket removed Thread-Index: Ac1HPyAnYKUxcgWqRVq4oiiKsnbv+g== Message-ID: <22188330-3490-46E2-97C5-F540A817C227@nottingham.ac.uk> References: In-Reply-To: Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Sun, 10 Jun 2012 19:28:23 -0000 X-Keywords: X-UID: 277 Status: O Content-Length: 1096 Lines: 29 On 9 Jun 2012, at 17:54, Anil Madhavapeddy wrote: >=20 > , but it would be good to get DNS in if you can finish that off, Mort. working on it... will try and coordinate this week - won't get it done bef= ore end of this week, but might (hopefully) get it done by end of month. --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From anil@recoil.org Mon Jun 11 11:07:29 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Se1Wz-0001nP-QU (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 11 Jun 2012 11:07:29 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1348551 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:22609 helo=dark.recoil.org) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with smtp id 1Se1Wz-0003vA-Ql (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 11 Jun 2012 11:07:29 +0100 Received: (qmail 109 invoked by uid 634); 11 Jun 2012 10:07:29 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.64]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Mon, 11 Jun 2012 11:07:28 +0100 Subject: Re: unix-socket removed Mime-Version: 1.0 (Apple Message framework v1257) Content-Type: text/plain; charset=us-ascii From: Anil Madhavapeddy In-Reply-To: <22188330-3490-46E2-97C5-F540A817C227@nottingham.ac.uk> Date: Mon, 11 Jun 2012 11:07:29 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: References: <22188330-3490-46E2-97C5-F540A817C227@nottingham.ac.uk> To: Richard Mortier X-Mailer: Apple Mail (2.1257) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 11 Jun 2012 10:07:29 -0000 X-Keywords: X-UID: 278 Status: O Content-Length: 724 Lines: 23 On 10 Jun 2012, at 20:27, Richard Mortier wrote: >=20 > On 9 Jun 2012, at 17:54, Anil Madhavapeddy wrote: >>=20 >> , but it would be good to get DNS in if you can finish that off, = Mort. >=20 > working on it... will try and coordinate this week - won't get it = done before end of this week, but might (hopefully) get it done by end = of month. ack; DNS is probably the most hassle due to the sheer number of RR = definitions that need to be updated to the new system. If you keep your = tree up-to-date, I'll see if I get a moment to help out (since I'd like = to port Signposts to cstruct too). If anyone else wants to learn cstruct, then the DNS bitstring->cstruct = is a good place to leap in now too... -anil= From derek.murray@gmail.com Wed Jun 13 18:53:32 2012 Received: from ppsw-52.csi.cam.ac.uk ([131.111.8.152]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Serl6-0007hL-5S (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 13 Jun 2012 18:53:32 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.8 from SpamAssassin-3.3.2-1349193 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.215.51 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (derek.murray[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-lpp01m010-f51.google.com ([209.85.215.51]:46407) by ppsw-52.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.149]:25) with esmtp id 1Serl3-0001FM-Fl (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 13 Jun 2012 18:53:32 +0100 Received: by lagw12 with SMTP id w12so586235lag.38 for ; Wed, 13 Jun 2012 10:53:29 -0700 (PDT) Received: by 10.152.148.169 with SMTP id tt9mr25144925lab.49.1339610009382; Wed, 13 Jun 2012 10:53:29 -0700 (PDT) MIME-Version: 1.0 Sender: derek.murray@gmail.com Received: by 10.112.109.129 with HTTP; Wed, 13 Jun 2012 10:53:09 -0700 (PDT) From: Derek Murray Date: Wed, 13 Jun 2012 10:53:09 -0700 X-Google-Sender-Auth: tbNM5MUx6Wx-ih3ojqMYOREvuv0 Message-ID: Subject: Possible related work: Scalable Elastic Systems Architecture To: cl-mirage@lists.cam.ac.uk Content-Type: text/plain; charset=ISO-8859-1 X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list Reply-To: Derek.Murray@cl.cam.ac.uk List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Jun 2012 17:53:32 -0000 X-Keywords: X-UID: 279 Status: O Content-Length: 513 Lines: 21 Hello from Boston, I noticed that these people are giving a poster about their new library OS for cloud computing: https://www.usenix.org/conference/atc12/library-os-cloud-computing Some or all of the same people have a slideshare: http://www.slideshare.net/ericvh/scalable-elastic-systems-architecture-sesa There's a paper from RESOLVE'11, but it seems to be behind some kind of VMWare subscribe-wall. Perhaps you've already heard about this, but it seems like it might be related to Mirage! Cheers, D. From anil@recoil.org Wed Jun 13 19:49:52 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sesdb-0000kP-VK (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 13 Jun 2012 19:49:51 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1349193 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:46562 helo=dark.recoil.org) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with smtp id 1Sesdb-00075A-QT (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Wed, 13 Jun 2012 19:49:51 +0100 Received: (qmail 14179 invoked by uid 634); 13 Jun 2012 18:49:51 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from cpc7-cmbg14-2-0-cust238.5-4.cable.virginmedia.com (HELO [192.168.1.41]) (86.30.244.239) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Wed, 13 Jun 2012 19:49:50 +0100 Subject: Re: Possible related work: Scalable Elastic Systems Architecture Mime-Version: 1.0 (Apple Message framework v1257) Content-Type: text/plain; charset=iso-8859-1 From: Anil Madhavapeddy In-Reply-To: Date: Wed, 13 Jun 2012 19:49:48 +0100 Content-Transfer-Encoding: 7bit Message-Id: References: To: Derek.Murray@cl.cam.ac.uk X-Mailer: Apple Mail (2.1257) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Wed, 13 Jun 2012 18:49:52 -0000 X-Keywords: X-UID: 280 Status: O Content-Length: 1372 Lines: 43 Thanks for the heads up Derek! From reading the slides, it looks quite complementary: the mention of Snowflock implies fast cloning support for conventional guest operating systems, with some more support for hardware hotplug and library-based configuration. As the merge with the Xen Cloud Platform continues, Mirage is going to turn into a coordination platform that executes 'legacy jobs' in VMs and establishes input/output channels and storage resources across them. Their use of 9P is also quite encouraging; Dave wrote a 9P implementation in 2007 or so, and we've always been meaning to use something very close to it for the distributed name-service. Would be interested to hear any thoughts you might have if you attend the poster session. cheers, Anil On 13 Jun 2012, at 18:53, Derek Murray wrote: > Hello from Boston, > > I noticed that these people are giving a poster about their new > library OS for cloud computing: > > https://www.usenix.org/conference/atc12/library-os-cloud-computing > > Some or all of the same people have a slideshare: > > http://www.slideshare.net/ericvh/scalable-elastic-systems-architecture-sesa > > There's a paper from RESOLVE'11, but it seems to be behind some kind > of VMWare subscribe-wall. > > Perhaps you've already heard about this, but it seems like it might be > related to Mirage! > > Cheers, > > D. > From dpp23@hermes.cam.ac.uk Mon Jun 18 14:53:34 2012 Received: from ppsw-52.csi.cam.ac.uk ([131.111.8.152]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SgcOc-0002Eq-16 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 18 Jun 2012 14:53:34 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: not scanned X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from hermes-2.csi.cam.ac.uk ([131.111.8.54]:44083) by ppsw-52.csi.cam.ac.uk (smtp.hermes.cam.ac.uk [131.111.8.159]:25) with esmtpa (EXTERNAL:dpp23) id 1SgcOb-0005aw-Fz (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 18 Jun 2012 14:53:33 +0100 Received: from prayer by hermes-2.csi.cam.ac.uk (hermes.cam.ac.uk) with local (PRAYER:dpp23) id 1SgcOb-0001HV-SD (Exim 4.67) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 18 Jun 2012 14:53:33 +0100 Received: from [128.232.143.138] by webmail.hermes.cam.ac.uk with HTTP (Prayer-1.3.4); 18 Jun 2012 14:53:33 +0100 Date: 18 Jun 2012 14:53:33 +0100 From: Dimitar Popov To: cl-mirage@lists.cam.ac.uk Message-ID: X-Mailer: Prayer v1.3.4 Mime-Version: 1.0 Content-Type: text/plain; format=flowed; charset=ISO-8859-1 Sender: Dimitar Popov X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jun 2012 13:53:34 -0000 X-Keywords: X-UID: 281 Status: O Content-Length: 2 Lines: 2 From Richard.Mortier@nottingham.ac.uk Mon Jun 18 17:17:15 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sgedf-0006xe-Of (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 18 Jun 2012 17:17:15 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1351075 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ixe-mta-19-tx.emailfiltering.com ([194.116.198.150]:50122 helo=ixe-mta-19.emailfiltering.com) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SgedZ-0002YU-Rr (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 18 Jun 2012 17:17:15 +0100 Received: from smtp4.nottingham.ac.uk ([128.243.220.65]) by ixe-mta-19.emailfiltering.com with emfmta (version 4.8.5.86) by TLS id 2287305504 ;bcf1132a3691b5f2; Mon, 18 Jun 2012 17:16:49 +0100 Received: from uiwexhub02.ad.nottingham.ac.uk ([128.243.15.132]) by smtp4.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1SgdqW-0005tm-Vx for cl-mirage@lists.cam.ac.uk; Mon, 18 Jun 2012 16:26:28 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::7962:f868:e6ee:6267]) by UIWEXHUB02.ad.nottingham.ac.uk ([2002:80f3:f84::80f3:f84]) with mapi; Mon, 18 Jun 2012 16:26:13 +0100 From: Richard Mortier To: "cl-mirage@lists.cam.ac.uk Mailing List" Date: Mon, 18 Jun 2012 16:26:21 +0100 Subject: ocaml-dns- quick ocaml question Thread-Topic: ocaml-dns- quick ocaml question Thread-Index: Ac1NZrHr0lNavyBeRPi+yyaGn2aC4A== Message-ID: <7A26D38A-5F2D-4E7E-9BC2-731678AE34E2@nottingham.ac.uk> Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jun 2012 16:17:15 -0000 X-Keywords: X-UID: 282 Status: O Content-Length: 1543 Lines: 36 i have two types, rr_type and q_type. rr_type is a subset of q_type, extend= ed it by about 5 elements. both are currently implemented in Dns.Packet as = cenums which are translated to variant types. i've just realised that (of course?) this means that the last definition (r= r_type) overrides the first (q_type) as they have overlapping elements. is there a nice/idiomatic way around this without either going to polymorph= ic variant types (that's what the `T types are called, right?) or just defi= ning the cenum q_type with rr_type aliased to it (for slightly better reada= bility), and using that everywhere? eg., should i do something like create submodules Qtype and RRtype of Packe= t, and define cenum t in each? --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From raphlalou@gmail.com Mon Jun 18 18:38:05 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sgftt-0000FC-Qi (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 18 Jun 2012 18:38:05 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1351075 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.214.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (raphlalou[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-ob0-f179.google.com ([209.85.214.179]:34747) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1Sgfts-0007FQ-Pr (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 18 Jun 2012 18:38:05 +0100 Received: by obbeh20 with SMTP id eh20so6459324obb.38 for ; Mon, 18 Jun 2012 10:38:03 -0700 (PDT) MIME-Version: 1.0 Received: by 10.182.38.66 with SMTP id e2mr16557193obk.31.1340041082807; Mon, 18 Jun 2012 10:38:02 -0700 (PDT) Received: by 10.76.69.131 with HTTP; Mon, 18 Jun 2012 10:38:02 -0700 (PDT) In-Reply-To: <7A26D38A-5F2D-4E7E-9BC2-731678AE34E2@nottingham.ac.uk> References: <7A26D38A-5F2D-4E7E-9BC2-731678AE34E2@nottingham.ac.uk> Date: Mon, 18 Jun 2012 19:38:02 +0200 Message-ID: Subject: Re: ocaml-dns- quick ocaml question From: Raphael Proust To: Richard Mortier Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jun 2012 17:38:05 -0000 X-Keywords: X-UID: 283 Status: O Content-Length: 1680 Lines: 60 On Mon, Jun 18, 2012 at 5:26 PM, Richard Mortier wrote: > i have two types, rr_type and q_type. rr_type is a subset of q_type, exte= nded it by about 5 elements. both are currently implemented in Dns.Packet a= s cenums which are translated to variant types. > > i've just realised that (of course?) this means that the last definition = (rr_type) overrides the first (q_type) as they have overlapping elements. > > is there a nice/idiomatic way around this without either going to polymor= phic variant types (that's what the `T types are called, right?) or just de= fining the cenum q_type with rr_type aliased to it (for slightly better rea= dability), and using that everywhere? > > eg., should i do something like create submodules Qtype and RRtype of Pac= ket, and define cenum t in each? I see several possibilities: - use polymorphic variants (yes that's what `Ts are called) - use one variant type and add assertion checks or other dynamic failure (b= ad!) - use several submodules - prefix the variants (very common) (feels similar to submodules but preven= ts "open"-induced ambiguities) type q =3D | Q_Foo | Q_Bar of int type rr =3D | RR_Foo | RR_Bar of int | RR_Baz of float - use GADTs (requires OCaml 4.00 (still in beta)) (I am unsure of the prope= r syntax, check the manual if need be) type q type rr type 'a t =3D | Foo : 'a t | Bar : int -> 'a t | Baz : float -> q t (* This branch forces the ['a] to be instantiated wi= th [q], thus preventing anyuse with functions requir= ing [rr t] *) Cheers, --=20 _______ Raphael From Richard.Mortier@nottingham.ac.uk Mon Jun 18 18:42:59 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sgfyd-0000JJ-EN (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 18 Jun 2012 18:42:59 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1351075 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from ixe-mta-19-tx.emailfiltering.com ([194.116.198.150]:36289 helo=ixe-mta-19.emailfiltering.com) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SgfyX-0000nI-St (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 18 Jun 2012 18:42:59 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by ixe-mta-19.emailfiltering.com with emfmta (version 4.8.5.86) by TLS id 2287385940 ;7ca170a8cf1e4e9a; Mon, 18 Jun 2012 18:42:33 +0100 Received: from uiwexhub02.ad.nottingham.ac.uk ([128.243.15.132]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1SgfyD-00018b-F5 for cl-mirage@lists.cam.ac.uk; Mon, 18 Jun 2012 18:42:33 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::7962:f868:e6ee:6267]) by UIWEXHUB02.ad.nottingham.ac.uk ([2002:80f3:f84::80f3:f84]) with mapi; Mon, 18 Jun 2012 18:42:25 +0100 From: Richard Mortier To: Raphael Proust Date: Mon, 18 Jun 2012 18:42:32 +0100 Subject: Re: ocaml-dns- quick ocaml question Thread-Topic: ocaml-dns- quick ocaml question Thread-Index: Ac1NebiZoFFmakRWQFWFiPUF4gI9fQ== Message-ID: <7E3E8BF0-4E4B-422A-AD92-9796C73D96BC@nottingham.ac.uk> References: <7A26D38A-5F2D-4E7E-9BC2-731678AE34E2@nottingham.ac.uk> In-Reply-To: Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jun 2012 17:42:59 -0000 X-Keywords: X-UID: 284 Status: O Content-Length: 2885 Lines: 89 On 18 Jun 2012, at 18:38, Raphael Proust wrote: > On Mon, Jun 18, 2012 at 5:26 PM, Richard Mortier > wrote: >> i have two types, rr_type and q_type. rr_type is a subset of q_type, ext= ended it by about 5 elements. both are currently implemented in Dns.Packet = as cenums which are translated to variant types. >>=20 >> i've just realised that (of course?) this means that the last definition= (rr_type) overrides the first (q_type) as they have overlapping elements. >>=20 >> is there a nice/idiomatic way around this without either going to polymo= rphic variant types (that's what the `T types are called, right?) or just d= efining the cenum q_type with rr_type aliased to it (for slightly better re= adability), and using that everywhere? >>=20 >> eg., should i do something like create submodules Qtype and RRtype of Pa= cket, and define cenum t in each? >=20 >=20 > I see several possibilities: >=20 > - use polymorphic variants (yes that's what `Ts are called) unfortunately cstruct targets variants only at the moment. > - use one variant type and add assertion checks or other dynamic failure = (bad!) ack- i thought that didn't "feel" right :) > - use several submodules >=20 > - prefix the variants (very common) (feels similar to submodules but prev= ents > "open"-induced ambiguities) > type q =3D > | Q_Foo > | Q_Bar of int > type rr =3D > | RR_Foo > | RR_Bar of int > | RR_Baz of float ok- i'll probably go with one of these options then. (likely the latter.) was just wondering if there was a "better" way. > - use GADTs (requires OCaml 4.00 (still in beta)) (I am unsure of the pro= per > syntax, check the manual if need be) > type q > type rr > type 'a t =3D > | Foo : 'a t > | Bar : int -> 'a t > | Baz : float -> q t (* This branch forces the ['a] to be instantiated w= ith > [q], thus preventing anyuse with functions requi= ring > [rr t] > *) interesting! but possibly a little advanced for me for now :) thanks! --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From anil@recoil.org Mon Jun 18 19:44:11 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sggvr-0001FW-Fu (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 18 Jun 2012 19:44:11 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1351075 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:19843 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1Sggvq-0006tW-Z2 (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 18 Jun 2012 19:44:11 +0100 Received: (qmail 10420 invoked by uid 634); 18 Jun 2012 18:44:10 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from Unknown (HELO [10.210.186.129]) (82.132.248.213) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Mon, 18 Jun 2012 19:44:09 +0100 References: <7A26D38A-5F2D-4E7E-9BC2-731678AE34E2@nottingham.ac.uk> <7E3E8BF0-4E4B-422A-AD92-9796C73D96BC@nottingham.ac.uk> In-Reply-To: <7E3E8BF0-4E4B-422A-AD92-9796C73D96BC@nottingham.ac.uk> Mime-Version: 1.0 (1.0) Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii Message-Id: X-Mailer: iPhone Mail (9B206) From: Anil Madhavapeddy Subject: Re: ocaml-dns- quick ocaml question Date: Mon, 18 Jun 2012 19:43:56 +0100 To: Richard Mortier X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: "cl-mirage@lists.cam.ac.uk Mailing List" , Raphael Proust X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jun 2012 18:44:11 -0000 X-Keywords: X-UID: 285 Status: O Content-Length: 3363 Lines: 103 So cstruct shouldnt be a constraint; it's trivial to retarget to polymorphic= variants. There is a very slight performance hit, but I don't think that ma= tters. GADTs: I don't see how they help here; did you have anything in mind Raphael= , or was it a general "new shiny feature"? :-) -anil On 18 Jun 2012, at 18:42, Richard Mortier = wrote: >=20 > On 18 Jun 2012, at 18:38, Raphael Proust wrote: >=20 >> On Mon, Jun 18, 2012 at 5:26 PM, Richard Mortier >> wrote: >>> i have two types, rr_type and q_type. rr_type is a subset of q_type, ext= ended it by about 5 elements. both are currently implemented in Dns.Packet a= s cenums which are translated to variant types. >>>=20 >>> i've just realised that (of course?) this means that the last definition= (rr_type) overrides the first (q_type) as they have overlapping elements. >>>=20 >>> is there a nice/idiomatic way around this without either going to polymo= rphic variant types (that's what the `T types are called, right?) or just de= fining the cenum q_type with rr_type aliased to it (for slightly better read= ability), and using that everywhere? >>>=20 >>> eg., should i do something like create submodules Qtype and RRtype of Pa= cket, and define cenum t in each? >>=20 >>=20 >> I see several possibilities: >>=20 >> - use polymorphic variants (yes that's what `Ts are called) >=20 > unfortunately cstruct targets variants only at the moment. >=20 >> - use one variant type and add assertion checks or other dynamic failure (= bad!) >=20 > ack- i thought that didn't "feel" right :) >=20 >> - use several submodules >>=20 >> - prefix the variants (very common) (feels similar to submodules but prev= ents >> "open"-induced ambiguities) >> type q =3D >> | Q_Foo >> | Q_Bar of int >> type rr =3D >> | RR_Foo >> | RR_Bar of int >> | RR_Baz of float >=20 > ok- i'll probably go with one of these options then. (likely the latter.)= >=20 > was just wondering if there was a "better" way. >=20 >> - use GADTs (requires OCaml 4.00 (still in beta)) (I am unsure of the pro= per >> syntax, check the manual if need be) >> type q >> type rr >> type 'a t =3D >> | Foo : 'a t >> | Bar : int -> 'a t >> | Baz : float -> q t (* This branch forces the ['a] to be instantiated wi= th >> [q], thus preventing anyuse with functions requir= ing >> [rr t] >> *) >=20 > interesting! but possibly a little advanced for me for now :) >=20 > thanks! >=20 > --=20 > Cheers, >=20 > R. >=20 >=20 >=20 >=20 > This message and any attachment are intended solely for the addressee and m= ay contain confidential information. If you have received this message in er= ror, please send it back to me, and immediately delete it. Please do not u= se, copy or disclose the information contained in this message or in any att= achment. Any views or opinions expressed by the author of this email do not= necessarily reflect the views of the University of Nottingham. >=20 > This message has been checked for viruses but the contents of an attachmen= t > may still contain software viruses which could damage your computer system= : > you are advised to perform your own checks. Email communications with the > University of Nottingham may be monitored as permitted by UK legislation. From Richard.Mortier@nottingham.ac.uk Mon Jun 18 19:49:56 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sgh1Q-0001O7-45 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 18 Jun 2012 19:49:56 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1351075 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:44280 helo=thb-mta-19.emailfiltering.com) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1Sgh1K-00010T-Xm (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Mon, 18 Jun 2012 19:49:56 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.86) by TLS id 2468983258 ;258f63dfea6e87c8; Mon, 18 Jun 2012 19:49:30 +0100 Received: from uiwexhub02.ad.nottingham.ac.uk ([128.243.15.132]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1Sgh0z-0003BX-Vi for cl-mirage@lists.cam.ac.uk; Mon, 18 Jun 2012 19:49:29 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::7962:f868:e6ee:6267]) by UIWEXHUB02.ad.nottingham.ac.uk ([2002:80f3:f84::80f3:f84]) with mapi; Mon, 18 Jun 2012 19:49:21 +0100 From: Richard Mortier To: Anil Madhavapeddy Date: Mon, 18 Jun 2012 19:49:28 +0100 Subject: Re: ocaml-dns- quick ocaml question Thread-Topic: ocaml-dns- quick ocaml question Thread-Index: Ac1NgxJ4TXYDib1dS5KQ5HfX61TMNQ== Message-ID: References: <7A26D38A-5F2D-4E7E-9BC2-731678AE34E2@nottingham.ac.uk> <7E3E8BF0-4E4B-422A-AD92-9796C73D96BC@nottingham.ac.uk> In-Reply-To: Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: Raphael Proust , "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Mon, 18 Jun 2012 18:49:56 -0000 X-Keywords: X-UID: 286 Status: O Content-Length: 1213 Lines: 33 On 18 Jun 2012, at 19:43, Anil Madhavapeddy wrote: > So cstruct shouldnt be a constraint; it's trivial to retarget to polymorp= hic variants. There is a very slight performance hit, but I don't think tha= t matters. i'll go with non-polymorphic variants for now - it's only search+replace - = and a closed type is "better", right?=20 (i may well have moulinexed and/or invented terms there :) --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From raphlalou@gmail.com Tue Jun 19 09:21:58 2012 Received: from ppsw-41.csi.cam.ac.uk ([131.111.8.141]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SgthG-0006gT-IF (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 19 Jun 2012 09:21:58 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.9 from SpamAssassin-3.3.2-1351242 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.214.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (raphlalou[at]gmail.com) * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * -0.1 DKIM_VALID_AU Message has a valid DKIM or DK signature from * author's domain * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * -0.1 DKIM_VALID Message has at least one valid DKIM or DK signature X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-ob0-f179.google.com ([209.85.214.179]:50049) by ppsw-41.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.146]:25) with esmtp id 1SgthF-0005AB-RD (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 19 Jun 2012 09:21:58 +0100 Received: by obbeh20 with SMTP id eh20so7396351obb.38 for ; Tue, 19 Jun 2012 01:21:56 -0700 (PDT) MIME-Version: 1.0 Received: by 10.60.1.202 with SMTP id 10mr18742513oeo.15.1340094116565; Tue, 19 Jun 2012 01:21:56 -0700 (PDT) Received: by 10.76.69.131 with HTTP; Tue, 19 Jun 2012 01:21:56 -0700 (PDT) In-Reply-To: References: <7A26D38A-5F2D-4E7E-9BC2-731678AE34E2@nottingham.ac.uk> <7E3E8BF0-4E4B-422A-AD92-9796C73D96BC@nottingham.ac.uk> Date: Tue, 19 Jun 2012 10:21:56 +0200 Message-ID: Subject: Re: ocaml-dns- quick ocaml question From: Raphael Proust To: Anil Madhavapeddy Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: Richard Mortier , "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Jun 2012 08:21:58 -0000 X-Keywords: X-UID: 287 Status: O Content-Length: 1909 Lines: 71 On Mon, Jun 18, 2012 at 8:43 PM, Anil Madhavapeddy wrote: > So cstruct shouldnt be a constraint; it's trivial to retarget to polymorp= hic variants. There is a very slight performance hit, but I don't think tha= t matters. > > GADTs: I don't see how they help here; did you have anything in mind Raph= ael, or was it a general "new shiny feature"? :-) It's a new shiny feature=E2=80=A6 that can be used to enforce some sub-typi= ng invariants. The Ocsigen project plans to rewrite their polymorphic-variant based phanto= m types using GADTs. The way to do it is to put a phantom type and constrain its value in the branches of the variant. Considering >>> type q >>> type rr >>> type 'a t =3D >>> | Foo : 'a t >>> | Bar : int -> 'a t >>> | Baz : float -> q t (* This branch forces the ['a] to be instantiated = with >>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 [q], thus preventing anyuse with functions requiring >>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 =C2=A0 [rr t] >>> =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 =C2=A0 = =C2=A0 *) You can constrain a function to accept only values of type [rr t] or [q t] = or both ['a t]. The example in http://caml.inria.fr/pub/distrib/ocaml-4.00/ocaml-4.00beta-refman.html#htoc= 113 is nice: type _ term =3D | Int : int -> int term | Add : (int -> int -> int) term | App : ('b -> 'a) term * 'b term -> 'a term let get_int : int term -> int =3D function | Int n -> n | App(_,_) -> 0 Thus, in the foo-bar-baz example, one could code: let process_query : q t -> unit =3D function | Foo -> .. | Bar i -> .. | Baz f -> .. let process_reply : rr t -> unit =3D function | Foo -> .. | Bar i -> .. (* adding a Baz match would be an error here, as [rr t] and [q t] are incompatible *) --=20 _______ Raphael From Richard.Mortier@nottingham.ac.uk Tue Jun 19 09:27:41 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1Sgtmn-0006w4-2a (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 19 Jun 2012 09:27:41 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1351242 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from thb-mta-19-tx.emailfiltering.com ([194.116.199.150]:35350 helo=thb-mta-19.emailfiltering.com) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1Sgtmh-0001to-XI (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 19 Jun 2012 09:27:40 +0100 Received: from smtp3.nottingham.ac.uk ([128.243.44.55]) by thb-mta-19.emailfiltering.com with emfmta (version 4.8.5.86) by TLS id 2469500266 ;1dc44e5714548468; Tue, 19 Jun 2012 09:27:15 +0100 Received: from uiwexhub02.ad.nottingham.ac.uk ([128.243.15.132]) by smtp3.nottingham.ac.uk with esmtps (TLSv1:AES128-SHA:128) (Exim 4.77) (envelope-from ) id 1SgtmM-0005Zn-UX for cl-mirage@lists.cam.ac.uk; Tue, 19 Jun 2012 09:27:14 +0100 Received: from EXCHANGE1.ad.nottingham.ac.uk ([fe80::7962:f868:e6ee:6267]) by UIWEXHUB02.ad.nottingham.ac.uk ([2002:80f3:f84::80f3:f84]) with mapi; Tue, 19 Jun 2012 09:27:13 +0100 From: Richard Mortier To: Raphael Proust Date: Tue, 19 Jun 2012 09:27:14 +0100 Subject: Re: ocaml-dns- quick ocaml question Thread-Topic: ocaml-dns- quick ocaml question Thread-Index: Ac1N9VPL3bpnGCNrTrWHzp6nOfthSQ== Message-ID: <07463CDD-6AA6-4FE8-8A0A-4E9B464E6356@nottingham.ac.uk> References: <7A26D38A-5F2D-4E7E-9BC2-731678AE34E2@nottingham.ac.uk> <7E3E8BF0-4E4B-422A-AD92-9796C73D96BC@nottingham.ac.uk> In-Reply-To: Accept-Language: en-US, en-GB Content-Language: en-US X-MS-Has-Attach: X-MS-TNEF-Correlator: acceptlanguage: en-US, en-GB Content-Type: text/plain; charset="us-ascii" Content-Transfer-Encoding: quoted-printable MIME-Version: 1.0 Cc: "cl-mirage@lists.cam.ac.uk Mailing List" , Anil Madhavapeddy X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Jun 2012 08:27:41 -0000 X-Keywords: X-UID: 288 Status: O Content-Length: 1377 Lines: 44 On 19 Jun 2012, at 09:21, Raphael Proust wrote: [snip] > Thus, in the foo-bar-baz example, one could code: >=20 > let process_query : q t -> unit =3D function > | Foo -> .. > | Bar i -> .. > | Baz f -> .. > let process_reply : rr t -> unit =3D function > | Foo -> .. > | Bar i -> .. > (* adding a Baz match would be an error here, as [rr t] and [q t] are > incompatible *) ahh, interesting... i'd have to think about how exactly to apply that here = - i suspect it would take more refactoring than i really want to do right n= ow though. thanks! --=20 Cheers, R. = This message and any attachment are intended solely for the addressee a= nd may contain confidential information. If you have received this mess= age in error, please send it back to me, and immediately delete it. P= lease do not use, copy or disclose the information contained in this me= ssage or in any attachment. Any views or opinions expressed by the aut= hor of this email do not necessarily reflect the views of the Universit= y of Nottingham.=0D=0A=0D=0AThis message has been checked for viruses b= ut the contents of an attachment=0D=0Amay still contain software viruse= s which could damage your computer system:=0D=0Ayou are advised to perf= orm your own checks. Email communications with the=0D=0AUniversity of N= ottingham may be monitored as permitted by UK legislation.= From avsm@dark.recoil.org Tue Jun 19 10:00:50 2012 Received: from ppsw-50.csi.cam.ac.uk ([131.111.8.150]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SguIs-0000w2-Fh (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 19 Jun 2012 10:00:50 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1351242 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:14377 helo=dark.recoil.org) by ppsw-50.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.147]:25) with smtp id 1SguIr-00036z-qA (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 19 Jun 2012 10:00:49 +0100 Received: (qmail 28169 invoked by uid 10000); 19 Jun 2012 09:00:48 -0000 Date: Tue, 19 Jun 2012 10:00:48 +0100 From: Anil Madhavapeddy To: Richard Mortier Subject: Re: ocaml-dns- quick ocaml question Message-ID: <20120619090048.GE1139@dark.recoil.org> References: <7A26D38A-5F2D-4E7E-9BC2-731678AE34E2@nottingham.ac.uk> <7E3E8BF0-4E4B-422A-AD92-9796C73D96BC@nottingham.ac.uk> MIME-Version: 1.0 Content-Type: text/plain; charset=us-ascii Content-Disposition: inline In-Reply-To: User-Agent: Mutt/1.5.21 (2010-09-15) Cc: Raphael Proust , "cl-mirage@lists.cam.ac.uk Mailing List" X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 19 Jun 2012 09:00:50 -0000 X-Keywords: X-UID: 289 Status: O Content-Length: 1336 Lines: 32 On Mon, Jun 18, 2012 at 07:49:28PM +0100, Richard Mortier wrote: > > On 18 Jun 2012, at 19:43, Anil Madhavapeddy wrote: > > > So cstruct shouldnt be a constraint; it's trivial to retarget to > > polymorphic variants. There is a very slight performance hit, but I > > don't think that matters. > > i'll go with non-polymorphic variants for now - it's only search+replace > - and a closed type is "better", right? A closed type isn't always better: especially if the underlying data structure is actually extensible. Would you ever need to sub-type RRs to only have a smaller set of them? In that case, a polymorphic variant would keep the same memory-representation, but be castable into different forms. A closed type would have to be assigned to a new value to move between them. Another limitation of closed variants is that if they have parameters (e.g. A of ipv4_addr), you can only have around 240 of them due to the memory representation [1]. If they have no parameters, they are limited only by integer-size. There is a slight performance difference between normal and polymorphic variants, due to the lack of precise type information, but it's pretty negligible in practise (probably only for pattern-matching, really). [1] http://rwmj.wordpress.com/2009/08/05/ocaml-internals-part-2-strings-and-other-types/ -anil From dpp23@hermes.cam.ac.uk Tue Jun 26 13:18:33 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SjUj3-0004t5-U5 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 26 Jun 2012 13:18:33 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: not scanned X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from hermes-2.csi.cam.ac.uk ([131.111.8.54]:36914) by ppsw-51.csi.cam.ac.uk (smtp.hermes.cam.ac.uk [131.111.8.158]:25) with esmtpa (EXTERNAL:dpp23) id 1SjUj3-00050B-Yv (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 26 Jun 2012 13:18:33 +0100 Received: from prayer by hermes-2.csi.cam.ac.uk (hermes.cam.ac.uk) with local (PRAYER:dpp23) id 1SjUj3-0005lF-PE (Exim 4.67) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 26 Jun 2012 13:18:33 +0100 Received: from [128.232.143.52] by webmail.hermes.cam.ac.uk with HTTP (Prayer-1.3.4); 26 Jun 2012 13:18:33 +0100 Date: 26 Jun 2012 13:18:33 +0100 From: Dimitar Popov To: cl-mirage@lists.cam.ac.uk Subject: using d3 bindings for js_of_ocaml Message-ID: In-Reply-To: References: X-Mailer: Prayer v1.3.4 Mime-Version: 1.0 Content-Type: text/plain; format=flowed; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Sender: Dimitar Popov X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 12:18:34 -0000 X-Keywords: X-UID: 290 Status: O Content-Length: 1026 Lines: 36 I am trying to use the bindings, but have some problems doing so.=20 This code: let svg =3D select(Selector.tag "body") =09=09>>append "svg" =09=09>> attr "width" (fun _ _-> Some(w)) =09=09>> attr "height" (fun _ _-> Some (h)) in =09=09svg>>subnodes "rect" =09=09=09 >> data dataset =09=09=09 >> enter =09=09=09 >> append "rect"=20 =09=09=09 >> attr "x" (fun d i -> Some(i * (w / Array.length dataset)) ) =09=09=09 >> attr "y" (fun d _ ->Some(h - (d * 4))) >> attr "width" (fun _ _ -> Some(w /=20 Array.length dataset - barPadding)) =09=09=09 >> attr "height" (fun d _ -> Some( d * 4)) >> attr "fill" (fun d _ ->Some( "rgb(0, 0, " ^= =20 string_of_int (d * 10) ^ ")")); ... Produces weird results when I inspect the page : ); Tue, 26 Jun 2012 13:23:03 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score -0.1 from SpamAssassin-3.3.2-1352457 * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from recoil.dh.bytemark.co.uk ([89.16.177.154]:36601 helo=dark.recoil.org) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with smtp id 1SjUnP-0000Yn-XT (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 26 Jun 2012 13:23:03 +0100 Received: (qmail 14708 invoked by uid 634); 26 Jun 2012 12:23:03 -0000 X-Spam-Level: * X-Spam-Status: No, hits=-1.0 required=5.0 tests=ALL_TRUSTED X-Spam-Check-By: dark.recoil.org Received: from no-dns-yet.demon.co.uk (HELO [192.168.15.111]) (62.49.66.12) (smtp-auth username remote@recoil.org, mechanism cram-md5) by dark.recoil.org (qpsmtpd/0.84) with ESMTPA; Tue, 26 Jun 2012 13:23:02 +0100 Subject: Re: using d3 bindings for js_of_ocaml Mime-Version: 1.0 (Apple Message framework v1278) Content-Type: text/plain; charset=iso-8859-1 From: Anil Madhavapeddy In-Reply-To: Date: Tue, 26 Jun 2012 13:23:00 +0100 Content-Transfer-Encoding: quoted-printable Message-Id: <70FA9096-046E-4C1D-9120-2B0B9D8E0574@recoil.org> References: To: Dimitar Popov X-Mailer: Apple Mail (2.1278) X-Virus-Checked: Checked by ClamAV on dark.recoil.org Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 12:23:04 -0000 X-Keywords: X-UID: 291 Status: O Content-Length: 1328 Lines: 50 That's definitely flawed output, since the contents of the tag should = never leak javascript. What happens if you just run: > let svg =3D select(Selector.tag "body") > >>append "svg" > >> attr "width" (fun _ _-> Some(w)) ? -anil On 26 Jun 2012, at 13:18, Dimitar Popov wrote: > I am trying to use the bindings, but have some problems doing so. This = code: >=20 > let svg =3D select(Selector.tag "body") > >>append "svg" > >> attr "width" (fun _ _-> Some(w)) > >> attr "height" (fun _ _-> Some (h)) in >=20 > svg>>subnodes "rect" > >> data dataset > >> enter > >> append "rect" >> = attr "x" (fun d i -> Some(i * (w / Array.length dataset)) ) > >> attr "y" (fun d _ ->Some(h - (d * 4))) > >> attr "width" (fun _ _ -> Some(w / = Array.length dataset - barPadding)) > >> attr "height" (fun d _ -> Some( d * 4)) > >> attr "fill" (fun d _ ->Some( "rgb(0, 0, " = ^ string_of_int (d * 10) ^ ")")); ... >=20 > Produces weird results when I inspect the page : =20 > all the parameters of the svg and the rect's are strings of functions. >=20 > What am I doing wrong? >=20 > Many thanks in advance! >=20 > Best wishes, > Dimitar >=20 >=20 >=20 From dpp23@hermes.cam.ac.uk Tue Jun 26 13:26:30 2012 Received: from ppsw-52.csi.cam.ac.uk ([131.111.8.152]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SjUqk-00057c-6u (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 26 Jun 2012 13:26:30 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: not scanned X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from hermes-2.csi.cam.ac.uk ([131.111.8.54]:57302) by ppsw-52.csi.cam.ac.uk (smtp.hermes.cam.ac.uk [131.111.8.159]:25) with esmtpa (EXTERNAL:dpp23) id 1SjUqk-0008BE-DG (Exim 4.72) (return-path ); Tue, 26 Jun 2012 13:26:30 +0100 Received: from prayer by hermes-2.csi.cam.ac.uk (hermes.cam.ac.uk) with local (PRAYER:dpp23) id 1SjUqk-0006sf-2D (Exim 4.67) (return-path ); Tue, 26 Jun 2012 13:26:30 +0100 Received: from [128.232.143.52] by webmail.hermes.cam.ac.uk with HTTP (Prayer-1.3.4); 26 Jun 2012 13:26:30 +0100 Date: 26 Jun 2012 13:26:30 +0100 From: Dimitar Popov To: Anil Madhavapeddy Subject: Re: using d3 bindings for js_of_ocaml Message-ID: In-Reply-To: <70FA9096-046E-4C1D-9120-2B0B9D8E0574@recoil.org> References: <70FA9096-046E-4C1D-9120-2B0B9D8E0574@recoil.org> X-Mailer: Prayer v1.3.4 Mime-Version: 1.0 Content-Type: text/plain; format=flowed; charset=ISO-8859-1 Content-Transfer-Encoding: quoted-printable Sender: Dimitar Popov Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 12:26:30 -0000 X-Keywords: X-UID: 292 Status: O Content-Length: 1647 Lines: 62 Still got > (x) { return caml_call_gen(f, args.concat([x]));} Best wishes, Dimitar On Jun 26 2012, Anil Madhavapeddy wrote: > That's definitely flawed output, since the contents of the tag should=20 > never leak javascript. > >What happens if you just run: >> let svg =3D select(Selector.tag "body") >> =09=09>>append "svg" >> =09=09>> attr "width" (fun _ _-> Some(w)) > >? > >-anil > >On 26 Jun 2012, at 13:18, Dimitar Popov wrote: > >> I am trying to use the bindings, but have some problems doing so. This= =20 >> code: >>=20 >> let svg =3D select(Selector.tag "body") >> =09=09>>append "svg" >> =09=09>> attr "width" (fun _ _-> Some(w)) >> =09=09>> attr "height" (fun _ _-> Some (h)) in >>=20 >> =09=09svg>>subnodes "rect" >> =09=09=09 >> data dataset enter append "rect" >> attr "x" (fun d i ->= =20 >> =09=09=09 >> Some(i * (w / Array.length dataset)) ) attr "y" (fun d _= =20 >> =09=09=09 >> ->Some(h - (d * 4))) >> >> attr "width" (fun _ _ -> Some(w /=20 >> >> Array.length dataset - barPadding)) >> =09=09=09 >> attr "height" (fun d _ -> Some( d * 4)) >> >> attr "fill" (fun d _ ->Some( "rgb(0, 0, "= =20 >> >> ^ string_of_int (d * 10) ^ ")")); ... >>=20 >> Produces weird results when I inspect the page : > (x) { return caml_call_gen(f, args.concat([x]));}" ... >>=20 >> all the parameters of the svg and the rect's are strings of functions. >>=20 >> What am I doing wrong? >>=20 >> Many thanks in advance! >>=20 >> Best wishes, >> Dimitar >>=20 >>=20 >>=20 > > From raphlalou@gmail.com Tue Jun 26 13:44:55 2012 Received: from ppsw-51.csi.cam.ac.uk ([131.111.8.151]) by lists-2.csi.cam.ac.uk (lists.cam.ac.uk [131.111.8.15]:25) with esmtp id 1SjV8Z-0005ba-59 (Exim 4.70) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 26 Jun 2012 13:44:55 +0100 X-Cam-AntiVirus: no malware found X-Cam-SpamDetails: score 0.2 from SpamAssassin-3.3.2-1352457 * -0.7 RCVD_IN_DNSWL_LOW RBL: Sender listed at http://www.dnswl.org/, low * trust * [209.85.213.179 listed in list.dnswl.dnsbl.ja.net] * 0.0 FREEMAIL_FROM Sender email is commonly abused enduser mail provider * (raphlalou[at]gmail.com) * 0.0 DKIM_ADSP_CUSTOM_MED No valid author signature, adsp_override is * CUSTOM_MED * -0.1 BAYES_00 BODY: Bayes spam probability is 0 to 1% * [score: 0.0000] * 0.1 DKIM_SIGNED Message has a DKIM or DK signature, not necessarily * valid * 0.0 T_DKIM_INVALID DKIM-Signature header exists but is not valid * 0.9 NML_ADSP_CUSTOM_MED ADSP custom_med hit, and not from a mailing * list X-Cam-ScannerInfo: http://www.cam.ac.uk/cs/email/scanner/ Received: from mail-yx0-f179.google.com ([209.85.213.179]:57488) by ppsw-51.csi.cam.ac.uk (mx.cam.ac.uk [131.111.8.148]:25) with esmtp id 1SjV8Y-0002f0-XL (Exim 4.72) for cl-mirage@lists.cam.ac.uk (return-path ); Tue, 26 Jun 2012 13:44:55 +0100 Received: by yenr13 with SMTP id r13so3682857yen.38 for ; Tue, 26 Jun 2012 05:44:53 -0700 (PDT) MIME-Version: 1.0 Received: by 10.50.94.169 with SMTP id dd9mr10788255igb.7.1340714693353; Tue, 26 Jun 2012 05:44:53 -0700 (PDT) Received: by 10.50.169.73 with HTTP; Tue, 26 Jun 2012 05:44:53 -0700 (PDT) In-Reply-To: References: Date: Tue, 26 Jun 2012 14:44:53 +0200 Message-ID: Subject: Re: using d3 bindings for js_of_ocaml From: Raphael Proust To: Dimitar Popov Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: quoted-printable Cc: cl-mirage@lists.cam.ac.uk X-BeenThere: cl-mirage@lists.cam.ac.uk X-Mailman-Version: 2.1.8 Precedence: list List-Id: MirageOS development List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , X-List-Received-Date: Tue, 26 Jun 2012 12:44:55 -0000 X-Keywords: X-UID: 293 Status: O Content-Length: 2652 Lines: 71 Can you detail your setup a little more. What is your file structure? How did you build your example? (Your make rules, or your compilation command line.) In particular, are you generating html? If so, why? From what template/file/whatever? I am not sure how to reproduce such results without these few explanations. You can have a look at how the examples (in the tests/ directory of the d3 bindings repository) are organised. The html is static and a