[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-devel] [PATCH 00/60] xen: add core scheduling support


  • To: Juergen Gross <jgross@xxxxxxxx>, <xen-devel@xxxxxxxxxxxxxxxxxxxx>
  • From: Sergey Dyasli <sergey.dyasli@xxxxxxxxxx>
  • Date: Tue, 16 Jul 2019 16:45:26 +0100
  • Authentication-results: esa6.hc3370-68.iphmx.com; dkim=none (message not signed) header.i=none; spf=None smtp.pra=sergey.dyasli@xxxxxxxxxx; spf=Pass smtp.mailfrom=sergey.dyasli@xxxxxxxxxx; spf=None smtp.helo=postmaster@xxxxxxxxxxxxxxx
  • Autocrypt: addr=sergey.dyasli@xxxxxxxxxx; keydata= mQINBFtMVHEBEADc/hZcLexrB6vGTdGqEUsYZkFGQh6Z1OO7bCtM1go1RugSMeq9tkFHQSOc 9c7W9NVQqLgn8eefikIHxgic6tGgKoIQKcPuSsnqGao2YabsTSSoeatvmO5HkR0xGaUd+M6j iqv3cD7/WL602NhphT4ucKXCz93w0TeoJ3gleLuILxmzg1gDhKtMdkZv6TngWpKgIMRfoyHQ jsVzPbTTjJl/a9Cw99vuhFuEJfzbLA80hCwhoPM+ZQGFDcG4c25GQGQFFatpbQUhNirWW5b1 r2yVOziSJsvfTLnyzEizCvU+r/Ek2Kh0eAsRFr35m2X+X3CfxKrZcePxzAf273p4nc3YIK9h cwa4ZpDksun0E2l0pIxg/pPBXTNbH+OX1I+BfWDZWlPiPxgkiKdgYPS2qv53dJ+k9x6HkuCy i61IcjXRtVgL5nPGakyOFQ+07S4HIJlw98a6NrptWOFkxDt38x87mSM7aSWp1kjyGqQTGoKB VEx5BdRS5gFdYGCQFc8KVGEWPPGdeYx9Pj2wTaweKV0qZT69lmf/P5149Pc81SRhuc0hUX9K DnYBa1iSHaDjifMsNXKzj8Y8zVm+J6DZo/D10IUxMuExvbPa/8nsertWxoDSbWcF1cyvZp9X tUEukuPoTKO4Vzg7xVNj9pbK9GPxSYcafJUgDeKEIlkn3iVIPwARAQABtChTZXJnZXkgRHlh c2xpIDxzZXJnZXkuZHlhc2xpQGNpdHJpeC5jb20+iQJOBBMBCgA4FiEEkI7HMI5EbM2FLA1L Aa+w5JvbyusFAltMVHECGwMFCwkIBwIGFQoJCAsCBBYCAwECHgECF4AACgkQAa+w5JvbyuuQ JBAAry/oRK6m0I+ck1Tarz9a1RrF73r1YoJUk5Bw+PSxsBJOPp3vDeAz3Kqw58qmBXeNlMU4 1cqAxFxCCKMtER1gpmrKWBA1/H1ZoBRtzhaHgPTQLyR7LB1OgdpgwEOjN1Q5gME8Pk21y/3N cG5YBgD/ZHbq8nWS/G3r001Ie3nX55uacGk/Ry175cS48+asrerShKMDNMT1cwimo9zH/3Lm RTpWloh2dG4jjwtCXqB7s+FEE5wQVCpPp9p55+9pPd+3DXmsQEcJ/28XHo/UJW663WjRlRc4 wgPwiC9Co1HqaMKSzdPpZmI5D4HizWH8jF7ppUjWoPapwk4dEA7Al0vx1Bz3gbJAL8DaRgQp H4j/16ifletfGUNbHJR2vWljZ5SEf2vMVcdubf9eFUfBF/9OOR1Kcj1PISP8sPhcP7oCfFtH RcxXh1OStrRFtltJt2VlloKXAUggdewwyyD4xl9UHCfI4lSexOK37wNSQYPQcVcOS1bl4NhQ em6pw2AC32NsnQE5PmczFADDIpWhO/+WtkTFeE2HHfAn++y3YDtKQd7xes9UJjQNiGziArST l6Zrx4/nShVLeYRVW76l27gI5a8BZLWwBVRsWniGM50OOJULvSag7kh+cjsrXXpNuA4rfEoB Bxr7pso9e5YghupDc8XftsYd7mlAgOTCAC8uZme5Ag0EW0xUcQEQAMKi97v3DwwPgYVPYIbQ JAvoMgubJllC9RcE0PQsE6nEKSrfOT6Gh5/LHOXLbQI9nzU/xdr6kMfwbYVTnZIY/SwsLrJa gSKm64t11MjC1Vf03/sncx1tgI7nwqMMIAYLsXnQ9X/Up5L/gLO2YDIPxrQ6g4glgRYPT53i r6/hTz3dlpqyPCorpuF+WY7P2ujhlFlXCAaD6btPPM/9LZSmI0xS4aCBLH+pZeCr0UGSMhsX JYN0QRLjfsIDGyqaXVH9gwV2Hgsq6z8fNPQlBc3IpDvfXa1rYtgldYBfG521L3wnsMcKoFSr R5dpH7Jtvv5YBuAk8r571qlMhyAmVKiEnc+RonWl503D5bAHqNmFNjV248J5scyRD/+BcYLI 2CFG28XZrCvjxq3ux5hpmg2fCu+y98h6/yuwB/JhbFlDOSoluEpysiEL3R5GTKbxOF664q5W fiSObxNONxs86UtghqNDRUJgyS0W6TfykGOnZDVYAC9Gg8SbQDta1ymA0q76S/NG2MrJEOIr 1GtOr/UjNv2x4vW56dzX/3yuhK1ilpgzh1q504ETC6EKXMaFT8cNgsMlk9dOvWPwlsIJ249+ PizMDFGITxGTIrQAaUBO+HRLSBYdHNrHJtytkBoTjykCt7M6pl7l+jFYjGSw4fwexVy0MqsD AZ2coH82RTPb6Q7JABEBAAGJAjYEGAEKACAWIQSQjscwjkRszYUsDUsBr7Dkm9vK6wUCW0xU cQIbDAAKCRABr7Dkm9vK6+9uD/9Ld3X5cvnrwrkFMddpjFKoJ4yphtX2s+EQfKT6vMq3A1dJ tI7zHTFm60uBhX6eRbQow8fkHPcjXGJEoCSJf8ktwx/HYcBcnUK/aulHpvHIIYEma7BHry4x L+Ap7oBbBNiraS3Wu1k+MaX07BWhYYkpu7akUEtaYsCceVc4vpYNITUzPYCHeMwc5pLICA+7 VdI1rrTSAwlCtLGBt7ttbvaAKN4dysiN+/66Hlxnn8n952lZdG4ThPPzafG50EgcTa+dASgm tc6HaQAmJiwb4iWUOoUoM+udLRHcN6cE0bQivyH1bqF4ROeFBRz00MUJKvzUynR9E50F9hmd DOBJkyM3Z5imQ0RayEkRHhlhj7uECaojnUeewq4zjpAg2HTSMkdEzKRbdMEyXCdQXFnSCmUB 5yMIULuDbOODWo3EufExLjAKzIRWEKQ/JidLzO6hrhlQffsJ7MPTU+Hg7WxqWfn4zhuUcIQB SlkiRMalSiJITC2jG7oQRRh9tyNaDMkKzTbeFtHKRmUUAuhE0LBXP8Wc+5W7b3WOf2SO8JMR 4TqDZ0K06s66S5fOTW0h56iCCxTsAnRvM/tA4SERyRoFs/iTqJzboskZY0yKeWV4/IQxfOyC YwdU3//zANM1ZpqeE/8lnW/kx+fyzVyEioLSwkjDvdG++4GQ5r6PHQ7BbdEWhA==
  • Cc: "sergey.dyasli@xxxxxxxxxx >> Sergey Dyasli" <sergey.dyasli@xxxxxxxxxx>, Stefano Stabellini <sstabellini@xxxxxxxxxx>, Wei Liu <wl@xxxxxxx>, Konrad Rzeszutek Wilk <konrad.wilk@xxxxxxxxxx>, George Dunlap <george.dunlap@xxxxxxxxxxxxx>, Andrew Cooper <andrew.cooper3@xxxxxxxxxx>, Tim Deegan <tim@xxxxxxx>, Robert VanVossen <robert.vanvossen@xxxxxxxxxxxxxxx>, Dario Faggioli <dfaggioli@xxxxxxxx>, Julien Grall <julien.grall@xxxxxxx>, Josh Whitehead <josh.whitehead@xxxxxxxxxxxxxxx>, Meng Xu <mengxu@xxxxxxxxxxxxx>, Jan Beulich <jbeulich@xxxxxxxx>, Ian Jackson <ian.jackson@xxxxxxxxxxxxx>, Roger Pau Monné <roger.pau@xxxxxxxxxx>
  • Delivery-date: Tue, 16 Jul 2019 15:46:05 +0000
  • Ironport-sdr: 2+dFcb0YkNC6VVaoy47G84NuSjPrV6VCufLCk6MbIlfugBNhFLjQcP8CrzapIm9fvs3P02pCtC nfftO0WBniM0pnJrDrc3GH8Gogwf82ZmS0x/PB7/XOsLTIlHUWtGa4Mvrh0E+ba/6pnZAUthPe po4d0CS3p+hEJNMmayUyeBeThL1ByxZTyFhESVsKeNE9XrPydKbjd1Dzmbkf8j6LKlmvdgWo9U qQBj6DqhaSOeSIJznFLRMUFD0tLVjz/HR1Rfhe4j171a9S+g8xr1V7HeE7S/ih4KbhNrAipM9B Hvk=
  • List-id: Xen developer discussion <xen-devel.lists.xenproject.org>
  • Openpgp: preference=signencrypt

On 05/07/2019 14:17, Sergey Dyasli wrote:
> [2019-07-05 00:37:16 UTC] (XEN) [24907.482686] Watchdog timer detects that 
> CPU30 is stuck!
> [2019-07-05 00:37:16 UTC] (XEN) [24907.514180] ----[ Xen-4.13.0-8.0.6-d  
> x86_64  debug=y   Not tainted ]----
> [2019-07-05 00:37:16 UTC] (XEN) [24907.552070] CPU:    30
> [2019-07-05 00:37:16 UTC] (XEN) [24907.565281] RIP:    
> e008:[<ffff82d0802406fc>] sched_context_switched+0xaf/0x101
> [2019-07-05 00:37:16 UTC] (XEN) [24907.601232] RFLAGS: 0000000000000202   
> CONTEXT: hypervisor
> [2019-07-05 00:37:16 UTC] (XEN) [24907.629998] rax: 0000000000000002   rbx: 
> ffff83202782e880   rcx: 000000000000001e
> [2019-07-05 00:37:16 UTC] (XEN) [24907.669651] rdx: ffff83202782e904   rsi: 
> ffff832027823000   rdi: ffff832027823000
> [2019-07-05 00:37:16 UTC] (XEN) [24907.706560] rbp: ffff83403cab7d20   rsp: 
> ffff83403cab7d00   r8:  0000000000000000
> [2019-07-05 00:37:16 UTC] (XEN) [24907.743258] r9:  0000000000000000   r10: 
> 0200200200200200   r11: 0100100100100100
> [2019-07-05 00:37:16 UTC] (XEN) [24907.779940] r12: ffff832027823000   r13: 
> ffff832027823000   r14: ffff83202782e7b0
> [2019-07-05 00:37:16 UTC] (XEN) [24907.816849] r15: ffff83202782e880   cr0: 
> 000000008005003b   cr4: 00000000000426e0
> [2019-07-05 00:37:16 UTC] (XEN) [24907.854125] cr3: 00000000bd8a1000   cr2: 
> 000000001851b798
> [2019-07-05 00:37:16 UTC] (XEN) [24907.881483] fsb: 0000000000000000   gsb: 
> 0000000000000000   gss: 0000000000000000
> [2019-07-05 00:37:16 UTC] (XEN) [24907.918309] ds: 0000   es: 0000   fs: 0000 
>   gs: 0000   ss: 0000   cs: e008
> [2019-07-05 00:37:16 UTC] (XEN) [24907.952619] Xen code around 
> <ffff82d0802406fc> (sched_context_switched+0xaf/0x101):
> [2019-07-05 00:37:16 UTC] (XEN) [24907.990277]  00 00 eb 18 f3 90 8b 02 <85> 
> c0 75 f8 eb 0e 49 8b 7e 30 48 85 ff 74 05 e8
> [2019-07-05 00:37:16 UTC] (XEN) [24908.032393] Xen stack trace from 
> rsp=ffff83403cab7d00:
> [2019-07-05 00:37:16 UTC] (XEN) [24908.061298]    ffff832027823000 
> ffff832027823000 0000000000000000 ffff83202782e880
> [2019-07-05 00:37:16 UTC] (XEN) [24908.098529]    ffff83403cab7d60 
> ffff82d0802407c0 0000000000000082 ffff83202782e7c8
> [2019-07-05 00:37:16 UTC] (XEN) [24908.135622]    000000000000001e 
> ffff83202782e7c8 000000000000001e ffff82d080602628
> [2019-07-05 00:37:16 UTC] (XEN) [24908.172671]    ffff83403cab7dc0 
> ffff82d080240d83 000000000000df99 000000000000001e
> [2019-07-05 00:37:16 UTC] (XEN) [24908.210212]    ffff832027823000 
> 000016a62dc8c6bc 000000fc00000000 000000000000001e
> [2019-07-05 00:37:16 UTC] (XEN) [24908.247181]    ffff83202782e7c8 
> ffff82d080602628 ffff82d0805da460 000000000000001e
> [2019-07-05 00:37:16 UTC] (XEN) [24908.284279]    ffff83403cab7e60 
> ffff82d080240ea4 00000002802aecc5 ffff832027823000
> [2019-07-05 00:37:16 UTC] (XEN) [24908.321128]    ffff83202782e7b0 
> ffff83202782e880 ffff83403cab7e10 ffff82d080273b4e
> [2019-07-05 00:37:16 UTC] (XEN) [24908.358308]    ffff83403cab7e10 
> ffff82d080242f7f ffff83403cab7e60 ffff82d08024663a
> [2019-07-05 00:37:17 UTC] (XEN) [24908.395662]    ffff83403cab7ea0 
> ffff82d0802ec32a ffff8340000000ff ffff82d0805bc880
> [2019-07-05 00:37:17 UTC] (XEN) [24908.432376]    ffff82d0805bb980 
> ffffffffffffffff ffff83403cab7fff 000000000000001e
> [2019-07-05 00:37:17 UTC] (XEN) [24908.469812]    ffff83403cab7e90 
> ffff82d080242575 0000000000000f00 ffff82d0805bb980
> [2019-07-05 00:37:17 UTC] (XEN) [24908.508373]    000000000000001e 
> ffff82d0806026f0 ffff83403cab7ea0 ffff82d0802425ca
> [2019-07-05 00:37:17 UTC] (XEN) [24908.549856]    ffff83403cab7ef0 
> ffff82d08027a601 ffff82d080242575 0000001e7ffde000
> [2019-07-05 00:37:17 UTC] (XEN) [24908.588022]    ffff832027823000 
> ffff832027823000 ffff83127ffde000 ffff83203ffe5000
> [2019-07-05 00:37:17 UTC] (XEN) [24908.625217]    000000000000001e 
> ffff831204092000 ffff83403cab7d78 00000000ffffffed
> [2019-07-05 00:37:17 UTC] (XEN) [24908.662932]    ffffffff81800000 
> 0000000000000000 ffffffff81800000 0000000000000000
> [2019-07-05 00:37:17 UTC] (XEN) [24908.703246]    ffffffff818f4580 
> ffff880039118848 00000e6a3c4b2698 00000000148900db
> [2019-07-05 00:37:17 UTC] (XEN) [24908.743671]    0000000000000000 
> ffffffff8101e650 ffffffff8185c3e0 0000000000000000
> [2019-07-05 00:37:17 UTC] (XEN) [24908.781927]    0000000000000000 
> 0000000000000000 0000beef0000beef ffffffff81054eb2
> [2019-07-05 00:37:17 UTC] (XEN) [24908.820986] Xen call trace:
> [2019-07-05 00:37:17 UTC] (XEN) [24908.836789]    [<ffff82d0802406fc>] 
> sched_context_switched+0xaf/0x101
> [2019-07-05 00:37:17 UTC] (XEN) [24908.869916]    [<ffff82d0802407c0>] 
> schedule.c#sched_context_switch+0x72/0x151
> [2019-07-05 00:37:17 UTC] (XEN) [24908.907384]    [<ffff82d080240d83>] 
> schedule.c#sched_slave+0x2a3/0x2b2
> [2019-07-05 00:37:17 UTC] (XEN) [24908.941241]    [<ffff82d080240ea4>] 
> schedule.c#schedule+0x112/0x2a1
> [2019-07-05 00:37:17 UTC] (XEN) [24908.973939]    [<ffff82d080242575>] 
> softirq.c#__do_softirq+0x85/0x90
> [2019-07-05 00:37:17 UTC] (XEN) [24909.007101]    [<ffff82d0802425ca>] 
> do_softirq+0x13/0x15
> [2019-07-05 00:37:17 UTC] (XEN) [24909.035971]    [<ffff82d08027a601>] 
> domain.c#idle_loop+0xad/0xc0
> [2019-07-05 00:37:17 UTC] (XEN) [24909.070546]
> [2019-07-05 00:37:17 UTC] (XEN) [24909.080286] CPU0 @ e008:ffff82d0802431ba 
> (stop_machine.c#stopmachine_wait_state+0x1a/0x24)
> [2019-07-05 00:37:17 UTC] (XEN) [24909.122896] CPU1 @ e008:ffff82d0802406f8 
> (sched_context_switched+0xab/0x101)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.159518] CPU3 @ e008:ffff82d0802431fa 
> (stop_machine.c#stopmachine_action+0x36/0xa0)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.199607] CPU2 @ e008:ffff82d0802406fc 
> (sched_context_switched+0xaf/0x101)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.235773] CPU5 @ e008:ffff82d0802431f4 
> (stop_machine.c#stopmachine_action+0x30/0xa0)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.276039] CPU4 @ e008:ffff82d0802406fa 
> (sched_context_switched+0xad/0x101)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.312371] CPU7 @ e008:ffff82d0802431fa 
> (stop_machine.c#stopmachine_action+0x36/0xa0)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.352930] CPU6 @ e008:ffff82d0802406fc 
> (sched_context_switched+0xaf/0x101)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.388928] CPU8 @ e008:ffff82d0802406fa 
> (sched_context_switched+0xad/0x101)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.424664] CPU9 @ e008:ffff82d0802431fa 
> (stop_machine.c#stopmachine_action+0x36/0xa0)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.465376] CPU10 @ e008:ffff82d0802431fa 
> (stop_machine.c#stopmachine_action+0x36/0xa0)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.507449] CPU11 @ e008:ffff82d0802406fa 
> (sched_context_switched+0xad/0x101)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.544703] CPU13 @ e008:ffff82d0802431f2 
> (stop_machine.c#stopmachine_action+0x2e/0xa0)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.588884] CPU12 @ e008:ffff82d0802406fc 
> (sched_context_switched+0xaf/0x101)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.625781] CPU15 @ e008:ffff82d0802431fa 
> (stop_machine.c#stopmachine_action+0x36/0xa0)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.666649] CPU14 @ e008:ffff82d0802406fa 
> (sched_context_switched+0xad/0x101)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.703396] CPU17 @ e008:ffff82d0802431f4 
> (stop_machine.c#stopmachine_action+0x30/0xa0)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.744089] CPU16 @ e008:ffff82d0802406fa 
> (sched_context_switched+0xad/0x101)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.781117] CPU23 @ e008:ffff82d0802431fa 
> (stop_machine.c#stopmachine_action+0x36/0xa0)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.821692] CPU22 @ e008:ffff82d0802406fa 
> (sched_context_switched+0xad/0x101)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.858139] CPU27 @ e008:ffff82d0802431f4 
> (stop_machine.c#stopmachine_action+0x30/0xa0)
> [2019-07-05 00:37:18 UTC] (XEN) [24909.898704] CPU26 @ e008:ffff82d0802406fa 
> (sched_context_switched+0xad/0x101)
> [2019-07-05 00:37:19 UTC] (XEN) [24909.936069] CPU19 @ e008:ffff82d0802431fa 
> (stop_machine.c#stopmachine_action+0x36/0xa0)
> [2019-07-05 00:37:19 UTC] (XEN) [24909.977291] CPU18 @ e008:ffff82d0802406fa 
> (sched_context_switched+0xad/0x101)
> [2019-07-05 00:37:19 UTC] (XEN) [24910.014078] CPU31 @ e008:ffff82d0802431fa 
> (stop_machine.c#stopmachine_action+0x36/0xa0)
> [2019-07-05 00:37:19 UTC] (XEN) [24910.055692] CPU21 @ e008:ffff82d0802431fa 
> (stop_machine.c#stopmachine_action+0x36/0xa0)
> [2019-07-05 00:37:19 UTC] (XEN) [24910.100486] CPU24 @ e008:ffff82d0802406fa 
> (sched_context_switched+0xad/0x101)
> [2019-07-05 00:37:19 UTC] (XEN) [24910.136824] CPU25 @ e008:ffff82d0802431fa 
> (stop_machine.c#stopmachine_action+0x36/0xa0)
> [2019-07-05 00:37:19 UTC] (XEN) [24910.177529] CPU29 @ e008:ffff82d0802431f4 
> (stop_machine.c#stopmachine_action+0x30/0xa0)
> [2019-07-05 00:37:19 UTC] (XEN) [24910.218420] CPU28 @ e008:ffff82d0802406fc 
> (sched_context_switched+0xaf/0x101)
> [2019-07-05 00:37:19 UTC] (XEN) [24910.255219] CPU20 @ e008:ffff82d0802406fc 
> (sched_context_switched+0xaf/0x101)
> [2019-07-05 00:37:19 UTC] (XEN) [24910.292152]
> [2019-07-05 00:37:19 UTC] (XEN) [24910.301667] 
> ****************************************
> [2019-07-05 00:37:19 UTC] (XEN) [24910.327892] Panic on CPU 30:
> [2019-07-05 00:37:19 UTC] (XEN) [24910.344165] FATAL TRAP: vector = 2 (nmi)
> [2019-07-05 00:37:19 UTC] (XEN) [24910.365476] [error_code=0000]
> [2019-07-05 00:37:19 UTC] (XEN) [24910.382509] 
> ****************************************
> [2019-07-05 00:37:19 UTC] (XEN) [24910.408547]
> [2019-07-05 00:37:19 UTC] (XEN) [24910.418129] Reboot in five seconds...

On a closer look, the second crash happens when you try to shutdown
the host ("poweroff" in my case).

Thanks,
Sergey


_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxxx
https://lists.xenproject.org/mailman/listinfo/xen-devel

 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.