[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

Re: [Xen-devel] Hi,something about the xentrace tool


  • To: "Rob Gardner" <rob.gardner@xxxxxx>
  • From: "George Dunlap " <dunlapg@xxxxxxxxx>
  • Date: Mon, 19 Jun 2006 10:02:15 -0400
  • Cc: xen-tools@xxxxxxxxxxxxxxxxxxx, xen-devel@xxxxxxxxxxxxxxxxxxx
  • Delivery-date: Mon, 19 Jun 2006 07:02:38 -0700
  • Domainkey-signature: a=rsa-sha1; q=dns; c=nofws; s=beta; d=gmail.com; h=received:message-id:date:from:sender:to:subject:cc:in-reply-to:mime-version:content-type:content-transfer-encoding:content-disposition:references:x-google-sender-auth; b=CgBTclZQsk5Pt+eKP9dm7V3S5B2EfS4WotJDtvKXYjC3+fPbMJcTca/GrpLkwMq+Agry3LLRkA/6Ush/IYNTjBm82vYfHhFSuMLOALNsDyMy4TjMccS0kerqARoNkkgjd+1wrfvw1nuWww1NdrUD+lVP/xQdpSNKsRiU2d/9yU4=
  • List-id: Xen developer discussion <xen-devel.lists.xensource.com>

On 6/19/06, Rob Gardner <rob.gardner@xxxxxx> wrote:
Stdio is there for a reason; Doing lots of raw I/O using
very small buffers is highly inefficient.

You misunderstand me. :-)  I meant to write out (via DMA) several
pages at a time, straight from the HV trace buffers.  The default tbuf
size in xentrace is 20 pages, so if (as the plan is) xentrace would be
notified when it would be half full, we could easily write out 10
pages in one transaction.  The tbuf size could be increased if DMA
setup/teardown overhead were an issue on that scale.

You're right, for traces that fit in the file cache, buffering is a
big win.  The copy overhead is negligible, writes to disk are more
efficient, and the data will be in the file cache for reading for
subsequent analysis.  But for traces that won't fit in the file cache,
the best thing would be to get them to disk with as little copying and
cache-trashing as possible.

Some of my recent traces have been on the order of 10 gigabytes.  I
haven't done much to modify xentrace, because I'm not worried about
the trace overhead at this point.  But I've had to pull some tricks to
get my analysis tools to run in anything like a reasonable amount of
time.

-George

_______________________________________________
Xen-devel mailing list
Xen-devel@xxxxxxxxxxxxxxxxxxx
http://lists.xensource.com/xen-devel


 


Rackspace

Lists.xenproject.org is hosted with RackSpace, monitoring our
servers 24x7x365 and backed by RackSpace's Fanatical Support®.