[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index] Re: [Xen-users] ntpd under Xen Dom0 exhibits extremely high jitter/noise? runs stable/quiet under non-xen kernel.
What platform timer does Xen say is initialised during boot? Possibly Xen's 'clocksource=' boot option could be used to select a different platform timer exhibiting less jitter. Tbh I don't think we've ever done a detailed analysis of ntp performance on Xen before -- this is something we might be able to improve. -- Keir On 17/01/2010 20:22, "Pasi Kärkkäinen" <pasik@xxxxxx> wrote: > > Keir and others, > > Please check the table in the end of the mail below.. is there > hypervisor (boot time) option to make it behave better for ntpd? > > -- Pasi > > On Sat, Jan 16, 2010 at 11:17:36AM -0800, mail ignored wrote: >> On Thu, Jan 14, 2010 at 8:20 PM, Fajar A. Nugraha <fajar@xxxxxxxxx> wrote: >>>> @ novell say it's xen & ntp >>>> @ ntp say it's novell & xen >>>> @ xen say it's novell & ntp >>>> >> >>> That's why I suggested you use a workaround: use 2.6.18 kernel, either >>> from RHEL or from xen.org :D >>> If this works -> novell problem >>> If this doesn't work -> xen problem >> >> On Sat, Jan 16, 2010 at 5:05 AM, Fajar A. Nugraha <fajar@xxxxxxxxx> wrote: >>> You might want to try latest pv_ops as well >>> (http://wiki.xensource.com/xenwiki/XenParavirtOps), which should be >>> easier to work with Opensuse since the version number is close. >> >> it seems it's _not_ the kernel -- unless there's a coincident kernel >> problem across source/vendor ... >> >> per >> http://lists.xensource.com/archives/html/xen-devel/2009-12/msg01127.html >> http://wiki.xensource.com/xenwiki/XenParavirtOps >> http://wiki.xensource.com/xenwiki/Kernel.org_Linux_on_Xen >> >> cd /home/workspace && rm -rf linux-2.6-xen >> git clone git://git.kernel.org/pub/scm/linux/kernel/git/jeremy/xen.git >> linux-2.6-xen >> cd linux-2.6-xen >> make clean >> cp -a .config .config-old >> wget -O .config >> http://pasik.reaktio.net/xen/pv_ops-dom0-debug/config-2.6.31.4-pvops_dom0-x86 >> _64 >> make oldconfig >> ... >> Xen PCI Frontend (XEN_PCIDEV_FRONTEND) [N/m/y/?] (NEW) <-- m >> ... >> "IMQ" target support (NETFILTER_XT_TARGET_IMQ) [N/m/?] (NEW) <-- m >> ... >> IMQ (intermediate queueing device) support (IMQ) [M/y/?] (NEW) <-- >> [enter] >> ... >> Block-device tap backend driver (XEN_BLKDEV_TAP) [N/m/y/?] (NEW) <-- m >> ... >> >> make bzImage >> make modules >> make modules_install >> strip vmlinux -o vmlinux-stripped >> gzip vmlinux-stripped -c > vmlinuz-gzipped >> >> ls -al .config \ >> System.map \ >> arch/x86/boot/bzImage \ >> vmlinux \ >> vmlinux-stripped \ >> vmlinuz-gzipped >> >> cp -a .config /boot/config-2.6.31.6 >> cp -a System.map /boot/System.map-2.6.31.6 >> cp -a arch/x86/boot/bzImage /boot/vmlinuz-2.6.31.6 >> mkinitrd >> ls -al /boot/*2.6.31.6* >> -rw-r--r-- 1 root root 98510 2010-01-16 03:02 /boot/config-2.6.31.6 >> -rw-r--r-- 1 root root 21304611 2010-01-16 04:14 /boot/initrd-2.6.31.6 >> -rw-r--r-- 1 root root 1940879 2010-01-16 03:14 /boot/System.map-2.6.31.6 >> -rw-r--r-- 1 root root 3751936 2010-01-16 03:14 /boot/vmlinuz-2.6.31.6 >> >> >> vi /boot/grub/menu.lst >> ... >> title xen.git >> root (hd0,0) >> kernel /xen.gz loglvl=all loglvl_guest=all dom0_mem=1024M >> vga=gfx-1280x1024x32 console=vga,com1 com1=57600,8n1 >> module /vmlinuz-2.6.31.6 root=/dev/VG0/ROOT rootfstype=ext4 >> rootflags=journal_checksum resume=/dev/VG0/SWAP nomodeset selinux=0 >> SELINUX_INIT=NO vga=0x31a console=tty0 console=xvc0,57600 >> module /initrd-2.6.31.6 >> >> title xen.git DISABLED >> root (hd0,0) >> kernel /vmlinuz-2.6.31.6 root=/dev/VG_SVR/LV_SVR_DOM0_ROOT >> rootfstype=ext4 rootflags=journal_checksum >> resume=/dev/VG_SVR/LV_SVR_DOM0_SWAP nomodeset showopts splash=silent >> selinux=0 SELINUX_INIT=NO elevator=cfq vga=0x31a console=tty0 >> console=ttyS0,57600n8 >> module /initrd-2.6.31.6 >> ... >> >> >> boot to "xen.git" >> >> uname -a >> Linux test 2.6.31.6 #1 SMP Sat Jan 16 03:14:19 PST 2010 x86_64 >> x86_64 x86_64 GNU/Linux >> lsb_release -a >> LSB Version: >> core-2.0-noarch:core-3.2-noarch:core-4.0-noarch:core-2.0-x86_64:core-3.2-x86_ >> 64:core-4.0-x86_64:desktop-4.0-amd64:desktop-4.0-noarch:graphics-2.0-amd64:gr >> aphics-2.0-noarch:graphics-3.2-amd64:graphics-3.2-noarch:graphics-4.0-amd64:g >> raphics-4.0-noarch >> Distributor ID: SUSE LINUX >> Description: openSUSE 11.2 (x86_64) >> Release: 11.2 >> Codename: n/a >> >> service ntp stop >> rm /etc/adjtime /var/ >> rm /var/lib/ntp/drift/ntp.drift >> >> cat << EOF > /etc/sysconfig/clock >> HWCLOCK="--utc" >> SYSTOHC="yes" >> TIMEZONE="America/Los_Angeles" >> DEFAULT_TIMEZONE="US/Pacific" >> EOF >> hwclock --systohc --utc >> service ntp start >> >> sntp clock.isc.org && date && hwclock --utc --show >> 2010 Jan 16 04:37:09.000729 + 1.435060 +/- 0.028944 secs >> Sat Jan 16 04:37:11 PST 2010 >> Sat 16 Jan 2010 04:37:11 AM PST -0.345191 seconds >> >> ... (wait ~ 6 hours) ... >> >> date >> Sat Jan 16 11:01:42 PST 2010 >> ntpq -p -c rv >> assID=0 status=06c4 leap_none, sync_ntp, 12 events, event_peer/strat_chg, >> version="ntpd 4.2.4p8@xxxxxx Mon Dec 28 17:26:30 UTC 2009 (1)", >> processor="x86_64", system="Linux/2.6.31.6", leap=00, stratum=2, >> precision=-20, rootdelay=14.718, rootdispersion=135.995, peer=11390, >> refid=66.220.9.122, >> reftime=cefc89b2.a36f1342 Sat, Jan 16 2010 10:53:38.638, poll=6, >> clock=cefc8b82.7e523feb Sat, Jan 16 2010 11:01:22.493, state=2, >> offset=-115.130, frequency=-500.000, jitter=464.242, noise=29.343, >> stability=154.680 >> remote refid st t when poll reach delay offset jitter >> =============================================================================>> = >> *clock.fmt.he.ne .PPS. 1 u 29 64 377 21.438 -811.68 >> 462.837 >> +otc2.psu.edu 129.6.15.29 2 u 7 64 377 109.399 -850.99 >> 470.522 >> +clock.isc.org .GPS. 1 u 7 64 377 21.440 -854.82 >> 468.274 >> +clock.sjc.he.ne .CDMA. 1 u 49 64 377 16.889 -780.55 >> 469.481 >> +zorro.sf-bay.or 216.218.254.202 2 u 59 64 377 20.366 -762.14 >> 458.947 >> +nist1.aol-ca.tr .ACTS. 1 u 38 64 377 16.260 -795.87 >> 463.170 >> >> boot to "xen.git DISABLED" >> >> uname -a >> Linux test 2.6.31.6 #1 SMP Sat Jan 16 09:14:19 PST 2010 x86_64 x86_64 >> x86_64 GNU/Linux >> >> service ntp stop >> rm /etc/adjtime /var/ >> rm /var/lib/ntp/drift/ntp.drift >> service ntp start >> >> ... (wait ~ 10 minutes) ... >> date >> Sat Jan 16 11:15:05 PST 2010 >> ntpq -p -c rv >> assID=0 status=0664 leap_none, sync_ntp, 6 events, event_peer/strat_chg, >> version="ntpd 4.2.4p8@xxxxxx Mon Dec 28 17:26:30 UTC 2009 (1)", >> processor="x86_64", system="Linux/2.6.31.6", leap=00, stratum=2, >> precision=-20, rootdelay=22.750, rootdispersion=975.184, peer=43091, >> refid=66.220.9.122, >> reftime=cefc8c7c.35ca466a Sat, Jan 16 2010 11:05:32.210, poll=6, >> clock=cefc8eb9.25103a1f Sat, Jan 16 2010 11:15:05.144, state=3, >> offset=27.534, frequency=0.000, jitter=6.740, noise=16.331, >> stability=0.000 >> remote refid st t when poll reach delay offset jitter >> =============================================================================>> = >> *clock.fmt.he.ne .PPS. 1 u 4 64 377 18.112 10.541 >> 5.892 >> +otc2.psu.edu 147.84.59.145 2 u 64 64 377 101.103 12.106 >> 8.621 >> +clock.isc.org .GPS. 1 u 57 64 377 14.990 4.830 >> 9.622 >> +clock.sjc.he.ne .CDMA. 1 u 59 64 377 16.503 9.299 >> 9.440 >> +zorro.sf-bay.or 216.218.254.202 2 u 56 64 377 22.212 6.323 >> 11.031 >> +nist1.aol-ca.tr .ACTS. 1 u 60 64 377 17.076 14.316 >> 9.260 >> >> in summary, >> >> kernel OS/distro xen timekeeping >> ------------------------------------- --------------- ------- ------------ >> opensuse kernel-default-2.6.31.8-0.1 opensuse 11.2 (n/a) OK >> opensuse kernel-default-2.6.32-41 opensuse 11.2 (n/a) OK >> opensuse kernel-xen-2.6.31.8-0.1 opensuse 11.2 3.4.x NOISY/FAIL >> opensuse kernel-xen-2.6.32-41 opensuse 11.2 3.4.x NOISY/FAIL >> opensuse kernel-xen-2.6.31.8-0.1 opensuse 11.2 4.0.x NOISY/FAIL >> opensuse kernel-xen-2.6.32-41 opensuse 11.2 4.0.x NOISY/FAIL >> xen.git kernel-2.6.31.6 (pvops Dom0) opensuse 11.2 4.0.x NOISY/FAIL >> xen.git kernel-2.6.31.6 opensuse 11.2 (n/a) OK >> >> i.e., >> >> 3 different kernel versions, from two different vendors, have >> low-noise/accurate timekeeping in NON-xen configs. >> >> boot any of those kernels with either v34x or v40x hypervisor in >> place, and timekeeping suffers from unusably excessive jitter & >> offset. >> >> _______________________________________________ >> Xen-users mailing list >> Xen-users@xxxxxxxxxxxxxxxxxxx >> http://lists.xensource.com/xen-users _______________________________________________ Xen-users mailing list Xen-users@xxxxxxxxxxxxxxxxxxx http://lists.xensource.com/xen-users
|
Lists.xenproject.org is hosted with RackSpace, monitoring our |