Re: [MirageOS-devel] performance regression tests

[Anil Madhavapeddy <anil@xxxxxxxxxx>]

This is great to see -- thanks for working on this Masoud!

In particular, having even a simple iperf test would let us test 
several interesting combinations straight away:

- vary OCaml version (4.01 vs 4.02 is now supported), and there
  is an experimental inlining branch in 4.03dev that could directly
  be tested using this infrastructure.

- evaluate the impact of some features incoming such as the open
  RFC for checksum offload.

In terms of immediate feedback, I'd request a version that just does
iperf so that it has no dependencies on the host dom0 kernel.
See: https://github.com/mirage/mirage-skeleton/pull/75

For this repository, what is the supported dom0 kernel that is expected?
The script tried to insmod a kmod that I didn't have.

Once there's even a minimal test, I'd like to recreate it on an
infrastructure machine in Cambridge and have it run daily via cron
alongside the is-mirage-broken scripts.

cheers,
Anil

> On 14 Feb 2015, at 22:42, Richard Mortier <richard.mortier@xxxxxxxxxxxx> 
> wrote:
> 
> it has been said that regression testing, particularly performance
> regression testing, is something that we should probably get better
> at... :)
> 
> so-- masoud has started rebuilding the `mirage-perf` repo to provide
> some simple, standard performance regression tests. the idea is to
> provide a battery of tests that can be fired off against specific
> versions of libraries, ultimately in tandem.
> 
> there're several TODO items already, so this is clearly a work in
> progress, but if anyone's got any thoughts/suggestions already, please
> pass them on either to the list, or file them as issues against the
> repo at https://github.com/koleini/mirage-perf
> 
> in particular, if anyone would like to try using the current test
> setup, against mirage-net-xen only at the moment, please do pass on
> any feedback!
> 
> thanks!
> 
> -- 
> Richard Mortier
> richard.mortier@xxxxxxxxxxxx
> 
> _______________________________________________
> MirageOS-devel mailing list
> MirageOS-devel@xxxxxxxxxxxxxxxxxxxx
> http://lists.xenproject.org/cgi-bin/mailman/listinfo/mirageos-devel
> 


_______________________________________________
MirageOS-devel mailing list
MirageOS-devel@xxxxxxxxxxxxxxxxxxxx
http://lists.xenproject.org/cgi-bin/mailman/listinfo/mirageos-devel