|
[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] [linux-4.19 bisection] complete test-amd64-amd64-qemuu-nested-intel
branch xen-unstable xenbranch xen-unstable job test-amd64-amd64-qemuu-nested-intel testid debian-hvm-install/l1/l2 Tree: linux git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git Tree: qemuu git://xenbits.xen.org/qemu-xen.git Tree: xen git://xenbits.xen.org/xen.git *** Found and reproduced problem changeset *** Bug is in tree: xen git://xenbits.xen.org/xen.git Bug introduced: dafd936dddbd7978d4131275ad1112f64457bf64 Bug not present: 1ecb1ee4d8475475c3ccf72f6654644b242ce856 Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/129524/ commit dafd936dddbd7978d4131275ad1112f64457bf64 Author: George Dunlap <george.dunlap@xxxxxxxxxx> Date: Mon Oct 29 14:51:51 2018 +0000 Make credit2 the default scheduler Credit2 was declared "supported" in 4.8, and as of 4.10 had two other critical features implemented (soft affinity / NUMA and caps). Why change the default? The code is better: more predictable, less jitter, easier to determine how modifications will affect overall behavior, easier in the future to make load-balancing behavior more subtle (e.g., taking into account the cost of powering up extra cores, &c). Overall performance compared to Credit1 is somewhat of a mixed bag. Unfortunately most of what I have are tests using XenServer's internal perf testing system, so I can't share the raw data (via links anyway). Here is a summary of data from an internal e-mail Dario sent in the past: * DVDbench: On underloaded systems, credit2 outperformed credit1 by about 4%. On overloaded systems, credit2 underperformed by about 3%. * On a range of tests (unixbench, lmbench, &c), credit and credit2 perform within 5% of each other (up and down). * Credit2 fairly consistently beats credit for TCP-style workloads. * Credit2 is sometimes equal to, sometimes 5-15% worse than, credit for synthetic CPU workloads (e.g., Dhrystone). * On LoginVSI, credit2 fairly consistently outperforms credit by about 10%. Credit2, like credit, has a number of workloads / setups for which performance could be improved. Personally I think networking and partially-loaded systems is going to be more representative of what Xen is actually used for; so I think credit2 is on the whole the better scheduler to use by default. And in any case, making those improvements on credit2 will be easier than on credit. Signed-off-by: George Dunlap <george.dunlap@xxxxxxxxxx> Acked-by: Dario Faggioli <dfaggioli@xxxxxxxx> For bisection revision-tuple graph see: http://logs.test-lab.xenproject.org/osstest/results/bisect/linux-4.19/test-amd64-amd64-qemuu-nested-intel.debian-hvm-install--l1--l2.html Revision IDs in each graph node refer, respectively, to the Trees above. ---------------------------------------- Running cs-bisection-step --graph-out=/home/logs/results/bisect/linux-4.19/test-amd64-amd64-qemuu-nested-intel.debian-hvm-install--l1--l2 --summary-out=tmp/129524.bisection-summary --basis-template=129313 --blessings=real,real-bisect linux-4.19 test-amd64-amd64-qemuu-nested-intel debian-hvm-install/l1/l2 Searching for failure / basis pass: 129428 fail [host=elbling0] / 129313 [host=huxelrebe0] template as basis? using template as basis. Failure / basis pass flights: 129428 / 129313 (tree with no url: minios) (tree with no url: ovmf) (tree with no url: seabios) Tree: linux git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git Tree: linuxfirmware git://xenbits.xen.org/osstest/linux-firmware.git Tree: qemu git://xenbits.xen.org/qemu-xen-traditional.git Tree: qemuu git://xenbits.xen.org/qemu-xen.git Tree: xen git://xenbits.xen.org/xen.git Latest 07a03b97b9ce2a6430344386eeab9b16283b893f c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 2cf113891a38cc05434bc9876ffc107a990887be Basis pass 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d c530a75c1e6a472b0eb9558310b518f0dfcd8860 9c0eed618f37dd5b4a57c8b3fbc48ef8913e3149 de5b678ca4dcdfa83e322491d478d66df56c1986 92666fdd6e0afab989b2d89759d9b43f2c645ae7 Generating revisions with ./adhoc-revtuple-generator git://git.kernel.org/pub/scm/linux/kernel/git/stable/linux-stable.git#84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d-07a03b97b9ce2a6430344386eeab9b16283b893f git://xenbits.xen.org/osstest/linux-firmware.git#c530a75c1e6a472b0eb9558310b518f0dfcd8860-c530a75c1e6a472b0eb9558310b518f0dfcd8860 git://xenbits.xen.org/qemu-xen-traditional.git#9c0eed618f37dd5b4a57c8b3fbc48ef8913e3149-d0d8ad39ecb51cd7497cd524484fe09f50876798 git://xenbits.xen.org/qemu-xen.git#de5b678ca4dcdfa83e322491d478d66df56c1986-de5b678ca4dcdfa83e322491d478d66df56c1986 git://xenbits.xen.org/xen.git#92666fdd6e0afab989b2d89759d9b43f2c645ae7-2cf113891a38cc05434bc9876ffc107a990887be Loaded 110636 nodes in revision graph Searching for test results: 129313 [host=huxelrebe0] 129412 fail 07a03b97b9ce2a6430344386eeab9b16283b893f c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 2cf113891a38cc05434bc9876ffc107a990887be 129428 fail 07a03b97b9ce2a6430344386eeab9b16283b893f c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 2cf113891a38cc05434bc9876ffc107a990887be 129476 pass 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 1ecb1ee4d8475475c3ccf72f6654644b242ce856 129497 fail 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 dafd936dddbd7978d4131275ad1112f64457bf64 129511 fail 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 dafd936dddbd7978d4131275ad1112f64457bf64 129482 fail 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 45cb9a4123b5550eb1f84846fe5482acae1c13a3 129459 pass 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d c530a75c1e6a472b0eb9558310b518f0dfcd8860 9c0eed618f37dd5b4a57c8b3fbc48ef8913e3149 de5b678ca4dcdfa83e322491d478d66df56c1986 92666fdd6e0afab989b2d89759d9b43f2c645ae7 129464 fail 07a03b97b9ce2a6430344386eeab9b16283b893f c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 2cf113891a38cc05434bc9876ffc107a990887be 129487 fail 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 f355ed8448bc5685af749ebbd3b3816f3c8f927a 129469 pass 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d c530a75c1e6a472b0eb9558310b518f0dfcd8860 9c0eed618f37dd5b4a57c8b3fbc48ef8913e3149 de5b678ca4dcdfa83e322491d478d66df56c1986 92666fdd6e0afab989b2d89759d9b43f2c645ae7 129471 fail 07a03b97b9ce2a6430344386eeab9b16283b893f c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 2cf113891a38cc05434bc9876ffc107a990887be 129490 fail 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 6faff8f9005d685185cd3f4ed116bf45d7d1553f 129494 fail 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 0a1fa635029d100d4b6b7eddb31d49603217cab7 129504 pass 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 1ecb1ee4d8475475c3ccf72f6654644b242ce856 129524 fail 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 dafd936dddbd7978d4131275ad1112f64457bf64 129517 pass 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 1ecb1ee4d8475475c3ccf72f6654644b242ce856 Searching for interesting versions Result found: flight 129459 (pass), for basis pass Result found: flight 129464 (fail), for basis failure Repro found: flight 129469 (pass), for basis pass Repro found: flight 129471 (fail), for basis failure 0 revisions at 84df9525b0c27f3ebc2ebb1864fa62a97fdedb7d c530a75c1e6a472b0eb9558310b518f0dfcd8860 d0d8ad39ecb51cd7497cd524484fe09f50876798 de5b678ca4dcdfa83e322491d478d66df56c1986 1ecb1ee4d8475475c3ccf72f6654644b242ce856 No revisions left to test, checking graph state. Result found: flight 129476 (pass), for last pass Result found: flight 129497 (fail), for first failure Repro found: flight 129504 (pass), for last pass Repro found: flight 129511 (fail), for first failure Repro found: flight 129517 (pass), for last pass Repro found: flight 129524 (fail), for first failure *** Found and reproduced problem changeset *** Bug is in tree: xen git://xenbits.xen.org/xen.git Bug introduced: dafd936dddbd7978d4131275ad1112f64457bf64 Bug not present: 1ecb1ee4d8475475c3ccf72f6654644b242ce856 Last fail repro: http://logs.test-lab.xenproject.org/osstest/logs/129524/ commit dafd936dddbd7978d4131275ad1112f64457bf64 Author: George Dunlap <george.dunlap@xxxxxxxxxx> Date: Mon Oct 29 14:51:51 2018 +0000 Make credit2 the default scheduler Credit2 was declared "supported" in 4.8, and as of 4.10 had two other critical features implemented (soft affinity / NUMA and caps). Why change the default? The code is better: more predictable, less jitter, easier to determine how modifications will affect overall behavior, easier in the future to make load-balancing behavior more subtle (e.g., taking into account the cost of powering up extra cores, &c). Overall performance compared to Credit1 is somewhat of a mixed bag. Unfortunately most of what I have are tests using XenServer's internal perf testing system, so I can't share the raw data (via links anyway). Here is a summary of data from an internal e-mail Dario sent in the past: * DVDbench: On underloaded systems, credit2 outperformed credit1 by about 4%. On overloaded systems, credit2 underperformed by about 3%. * On a range of tests (unixbench, lmbench, &c), credit and credit2 perform within 5% of each other (up and down). * Credit2 fairly consistently beats credit for TCP-style workloads. * Credit2 is sometimes equal to, sometimes 5-15% worse than, credit for synthetic CPU workloads (e.g., Dhrystone). * On LoginVSI, credit2 fairly consistently outperforms credit by about 10%. Credit2, like credit, has a number of workloads / setups for which performance could be improved. Personally I think networking and partially-loaded systems is going to be more representative of what Xen is actually used for; so I think credit2 is on the whole the better scheduler to use by default. And in any case, making those improvements on credit2 will be easier than on credit. Signed-off-by: George Dunlap <george.dunlap@xxxxxxxxxx> Acked-by: Dario Faggioli <dfaggioli@xxxxxxxx> Revision graph left in /home/logs/results/bisect/linux-4.19/test-amd64-amd64-qemuu-nested-intel.debian-hvm-install--l1--l2.{dot,ps,png,html,svg}. ---------------------------------------- 129524: tolerable ALL FAIL flight 129524 linux-4.19 real-bisect [real] http://logs.test-lab.xenproject.org/osstest/logs/129524/ Failures :-/ but no regressions. Tests which did not succeed, including tests which could not be run: test-amd64-amd64-qemuu-nested-intel 17 debian-hvm-install/l1/l2 fail baseline untested jobs: test-amd64-amd64-qemuu-nested-intel fail ------------------------------------------------------------ sg-report-flight on osstest.test-lab.xenproject.org logs: /home/logs/logs images: /home/logs/images Logs, config files, etc. are available at http://logs.test-lab.xenproject.org/osstest/logs Explanation of these reports, and of osstest in general, is at http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README.email;hb=master http://xenbits.xen.org/gitweb/?p=osstest.git;a=blob;f=README;hb=master Test harness code can be found at http://xenbits.xen.org/gitweb?p=osstest.git;a=summary _______________________________________________ osstest-output mailing list osstest-output@xxxxxxxxxxxxxxxxxxxx https://lists.xenproject.org/mailman/listinfo/osstest-output
|
 |
Lists.xenproject.org is hosted with RackSpace, monitoring our |